When Does Online Imitation Learning Help in LLM Post-Training? The Role of (Non-)Realizability Beyond Horizon
Online imitation learning for LLM post-training succeeds when student policy class is realizable; error accumulation is not the primary advantage mechanism.