跳到主要内容
AI News HubLIVE
来源内容 · 翻译待补全1 分钟阅读

待翻译:From Preferences to Principles: Rubric-Based Alignment for Grounded Knowledge Answers

文章摘要

AI 服务暂时不可用,以下为来源摘要,待恢复后补全翻译:Designing effective reward signals for open-domain question answering is challenging because high-quality responses must simultaneously satisfy multiple aspects of answer quality that are difficult to capture with a holistic scalar objective. We introduce a rubric-based reward framework that generates query-specific rubrics grounded in retrieved evidence and decomposed into multiple quality dimensions, providing fine-grained supervision during post-training. Averaged across three evaluation axes (composition, grounding, and instruction-following), our approach improves over the…

待翻译:From Preferences to Principles: Rubric-Based Alignment for Grounded Knowledge Answers
报告错误

纠错通道尚未开通,可先复制下方文章信息留存。

查看更正说明
直接读正文

AI 服务暂时不可用,以下为来源正文,待恢复后补全翻译。

content type paperpublished August 2026 From Preferences to Principles: Rubric-Based Alignment for Grounded Knowledge Answers AuthorsAman Saini, Priyanshu Kumar, Eric Peng, Kai Yuan, Harsh Girase, Wanming Chen View publication Designing effective reward signals for open-domain question answering is challenging because high-quality responses must simultaneously satisfy multiple aspects of answer quality that are difficult to capture with a holistic scalar objective. We introduce a rubric-based reward framework that generates query-specific rubrics grounded in retrieved evidence and decomposed into multiple quality dimensions, providing fine-grained supervision during post-training. Averaged across three evaluation axes (composition, grounding, and instruction-following), our approach improves over the instruction-tuned baseline by 6.5% and over flat rubric variants by 4%, with consistent gains across all evaluation datasets. Conditioning rubrics on retrieved evidence improves factual support, while decomposing rubrics into quality-specific dimensions further improves coherence, organization, and adherence to query requirements. Our results show that grounded, multi-dimensional rubrics provide more effective reward supervision for complex open-domain question answering. Can Open Domain Question Answering Models Answer Visual Knowledge Questions? February 28, 2022research area Speech and Natural Language Processing The task of Outside Knowledge Visual Question Answering (OKVQA) requires an automatic system to answer natural language questions about pictures and images using external knowledge. We observe that many visual questions, which contain deictic referential phrases referring to entities in the image, can be rewritten as “non-grounded” questions and can be answered by existing text-based question answering systems. This allows for the reuse of… Read more MKQA: A Linguistically Diverse Benchmark for Multilingual Open Domain Question Answering July 30, 2020research area Knowledge Bases and Search, research area Speech and Natural Language Processing Progress in cross-lingual modeling depends on challenging, realistic, and diverse evaluation sets. We introduce Multilingual Knowledge Questions and Answers (MKQA), an open-domain question answering evaluation set comprising 10k question-answer pairs aligned across 26 typologically diverse languages (260k question-answer pairs in total). The goal of this dataset is to provide a challenging benchmark for question answering quality across a wide… Read more

展开要点与分析

文章情报

投资人进阶

要点

  • AI 服务暂时不可用,系统已先保留来源内容与降级元数据。
  • Designing effective reward signals for open-domain question answering is challenging because high-quality responses must simultaneously satisfy multiple aspects of answer quality…

要点与分析由自动化流程生成,可能有误,请结合原始来源核实。