Selected Posts
all ideas →
Persona vectors and the persona selection model
Notes on two accounts of character in language models: persona vectors, which locate traits as steerable directions in activation space, and the persona selection model, which explains why such directions exist.
Notes on Tracing Attention Computation Through Feature Interactions
Notes on QK attributions, attention-head loadings, and what feature interactions reveal about why a transformer attends to one token rather than another.
How collaborative apps handle conflicting edits
A survey of last-writer-wins, operational transformation, CRDTs, optimistic concurrency, and locks, and what each one does when two people edit the same thing at once.
A full-stack AI calorie tracker PWA
A mobile-first nutrition PWA that estimates calories and macros from food photos, scans barcodes and menus, and turns model output into a reviewable first draft.
Git worktrees: branches without the context switch
Work on multiple branches at once without ever touching git stash.
CUDA Fundamentals: Tiled Matrix Multiply & Bitonic Sort
Writing real GPU kernels, exploring shared memory tiling, parallel sorting algorithms, and performance optimization on an NVIDIA H100.
Notes on Effective ML Research
A summary of my takeaways from three influential articles on conducting effective empirical AI alignment research.
Using uv: A Modern Python Workflow
An introduction to uv, a fast, Rust-based tool for Python packaging