SCALE Optimizer

A memory-efficient LLM pretraining optimizer following a minimalist design.