Knowledge Distillation During Mid-Training Favors Reasoning over Factual Recall

Written on September 1, 2026