Research· AI-written
FLAMIA: low-precision attention for Transformer training on Blackwell
This paper presents FLAMIA, a family of attention kernels designed to accelerate Transformer training on NVIDIA Blackwell GPUs using mixed low-bit formats, showing speedups on B200 and B300 hardware without compromising model quality.
Nov 3, 2026 · 3 min read