2026 11 Autoscaffold

A new paper AutoScaffold: AI-Guided Scaffolding for Reinforcement Learning of Language Models, joint work with Zijian Zhang, Rizhen Hu, Jon, Shiyang Li, Sujay Bhatt and Sihan Zeng, is available here. In this work, we let a frozen teacher model review the student’s training attempts, identify where it gets stuck, and write training-time hints – both strategies shared across task types and hints for individual hard tasks – which are then removed at evaluation.