Tag: gpu-kernels

All the articles with the tag "gpu-kernels".

• Inside a Blackwell 2-CTA GEMM: A Gluon Kernel Tour

  17 Jun, 2026

  A line-by-line, interactive walk through a 2-CTA Gluon GEMM for NVIDIA Blackwell (B200): TMA, Tensor Memory, tcgen05 MMA, mbarriers, and software pipelining.

• RMSNorm Backward: From Derivation to a Triton Kernel

  1 Nov, 2025

  Derive RMSNorm backward step by step and implement a Triton kernel with PyTorch, numerics tips