Complete 17 min read
CUDA Fundamentals: Tiled Matrix Multiply & Bitonic Sort
Writing real GPU kernels, exploring shared memory tiling, parallel sorting algorithms, and performance optimization on an NVIDIA H100.
Digital Garden
The notes, thoughts, and projects I've been working on.
Complete 29 min read
GPU Hardware and Software
What I Learned in GPU Hardware and Software (CS 8803) - A Retrospective
Complete 17 min read
GPU Simulation: Warp Scheduling & Compute/Tensor Cores
Building a cycle-level GPU simulator from the inside, implementing GTO and CCWS warp schedulers, modeling compute instruction latencies, and extending to tensor core simulation.
Complete 15 min read
Static Analysis: Detecting Branch Divergence in GPU Code
A simple if statement can halve GPU throughput, exploring how static dataflow analysis detects branch divergence by building a def-use chain over a SASS control flow graph.
Complete 19 min read
FlashAttention & LLM Inference on GPUs
Writing a FlashAttention CUDA kernel from scratch, tiling the attention matrix to avoid materializing N×N memory, building a KV cache for token generation, and running GPT-2 with custom kernels end-to-end.
Complete 39 min read
Graduate Introduction to Operating Systems
What I Learned in Graduate Introduction to Operating Systems (GIOS) - A Retrospective
Complete 16 min read
Building a Scalable Multithreaded File Server in C
A project that explores multithreading, sockets, and the basics of operating systems
Complete 17 min read
A Deep Dive into IPC with a Proxy-Cache Project
Exploring Inter-Process Communication and synchronization in C by building a high-performance proxy and cache.
Complete 17 min read
Building a Distributed File System: A Study in C++
An exploration of remote communication, data consistency, and synchronization in a C++ distributed file system project.
