Archives
All the articles I've archived.
2026 1
June 1
-
Inside a Blackwell 2-CTA GEMM: A Gluon Kernel Tour
A line-by-line, interactive walk through a 2-CTA Gluon GEMM for NVIDIA Blackwell (B200): TMA, Tensor Memory, tcgen05 MMA, mbarriers, and software pipelining.
2025 1
November 1
-
RMSNorm Backward: From Derivation to a Triton Kernel
Derive RMSNorm backward step by step and implement a Triton kernel with PyTorch, numerics tips