AI 服務暫時不可用,以下為來源正文,待恢復後補全翻譯。
content type paperpublished September 2026 How to Guide Your Language Flow AuthorsRohit Dilip†, Tianrong Chen, Yuyang Wang, David Van Valen†, Josh Susskind, Miguel Angel Bautista View publication We introduce a new method to guide flow matching models. Our approach, which we call probe guidance, uses the frozen internal states of an existing diffusion model to construct a guidance signal. This works using a similar principle as autoguidance, but eliminates the need for an additional forward pass at inference time and provides a reliable path to ensure that the weak and strong model share similar dynamics. We apply and benchmark this method on continuous diffusion language models, where probe guidance sets a new state-of-the-art performance on unconditional generation. When applied to a 1.7B diffusion language model, probe guidance consistently improves on multiple choice question answering benchmarks. Using our probes, we study the traditional autoguidance setting where the strong model is a weak checkpoint, and find that the weak model must come from a low-entropy region of training. These findings both provide a practical way to improve diffusion language models and shed light on the actual mechanism behind autoguidance, which is currently poorly understood. † Caltech Work done while at Apple FS-DFM: Fast and Accurate Long Text Generation with Few-Step Diffusion Language Models October 13, 2025research area Speech and Natural Language Processingconference ICLR Autoregressive language models (ARMs) deliver strong likelihoods, but are inherently serial: they generate one token per forward pass, which limits throughput and inflates latency for long sequences. Diffusion Language Models (DLMs) parallelize across positions and thus appear promising for language generation, yet standard discrete diffusion typically needs hundreds to thousands of model evaluations to reach high quality, trading serial depth… Read more Scaling Diffusion Language Models via Adaptation from Autoregressive Models April 16, 2025research area Speech and Natural Language Processingconference ICLR Diffusion Language Models (DLMs) have emerged as a promising new paradigm for text generative modeling, potentially addressing limitations of autoregressive (AR) models. However, current DLMs have been studied at a smaller scale compared to their AR counterparts and lack fair comparison on language modeling benchmarks. Additionally, training diffusion models from scratch at scale remains challenging. Given the prevalence of open-source AR… Read more