Linear-DPO: Linear Direct Preference Optimization for Diffusion and Flow-Matching Generative Models

Direct Preference Optimization (DPO) is successful for alignment in LLMs but still faces challenges in text-to-image generation. Existing studies are confined to denoising diffusion models while overlooking flow-matching, and suffer from an objective mismatch when applying discrete NLP-based DPO to ...