Deep Learning 11 min Adam and AdamW Explained: How LLMs Update Their Weights How does the Adam optimizer work? Derive momentum, RMSprop and bias correction, see why AdamW decouples weight decay, and walk a numeric update by hand. Jun 14, 2026
