
Research· AI-written
Factored One-sided Adam-Moment for Practical and Scalable SOAP
This paper introduces FOAM, a lightweight variant of the SOAP second-order optimizer that matches SOAP's performance while using half its optimizer memory and running at Muon-class speeds.
Nov 14, 2026 · 2 min read