{"id":"arxiv:2602.00413","kind":"preprint","title":"Alignment of Diffusion Model and Flow Matching for Text-to-Image Generation","authors":["Yidong Ouyang","Liyan Xie","Hongyuan Zha","Guang Cheng"],"author_count":4,"year":2026,"published":"2026-01-31","venue":null,"cited_by":0,"doi":null,"arxiv_id":"2602.00413","nct_id":null,"source_url":"https://arxiv.org/abs/2602.00413","archive_url":"https://space-kitty.com/papers/arxiv:2602.00413","updated":"2026-01-31","pmid":null,"pmcid":null,"openalex_id":"W7127363472","pdf_url":"https://arxiv.org/pdf/2602.00413","abstract":"Diffusion models and flow matching have demonstrated remarkable success in text-to-image generation. While many existing alignment methods primarily focus on fine-tuning pre-trained generative models to maximize a given reward function, these approaches require extensive computational resources and may not generalize well across different objectives. In this work, we propose a novel alignment framework by leveraging the underlying nature of the alignment problem -- sampling from reward-weighted distributions -- and show that it applies to both diffusion models (via score guidance) and flow matching models (via velocity guidance). The score function (velocity field) required for the reward-weighted distribution can be decomposed into the pre-trained score (velocity field) plus a conditional expectation of the reward. For the alignment on the diffusion model, we identify a fundamental challenge: the adversarial nature of the guidance term can introduce undesirable artifacts in the generated images. Therefore, we propose a finetuning-free framework that trains a guidance network to estimate the conditional expectation of the reward. We achieve comparable performance to finetuning-based models with one-step generation with at least a 60% reduction in computational cost. For the alignment on flow matching, we propose a training-free framework that improves the generation quality without additional computational cost.","abstract_license":"CC0-1.0 (arXiv descriptive metadata)","license":null,"is_open_access":false,"retracted":false,"peer_reviewed":false,"categories":["stat.ML","cs.LG"],"details":null,"provenance":"arxiv","attribution":"Abstract: arXiv descriptive metadata (CC0). Thank you to arXiv for use of its open access interoperability. This service was not reviewed or approved by, nor does it necessarily express or reflect the policies or opinions of, arXiv.","topics":[{"slug":"generative-multimodal","name":"Generative & Multimodal Models","domain_slug":"ai"}],"cited_in_dossiers":[]}