Towards Distillation Guarantees under Algorithmic Alignment for Combinatorial Optimization

Distillation transfers knowledge from a large model trained on broad data to a smaller, more efficient model suitable for deployment. In structured prediction settings, prior knowledge about the task can guide the choice of a target architecture that is algorithmically aligned with the underlying pr...