AI 服務暫時不可用，以下為來源正文，待恢復後補全翻譯。
[Submitted on 2 Oct 2026] Title:Same Answer, New Box: How Much of RLVR's Out-of-Domain Gain Is Answer Format? View a PDF of the paper titled Same Answer, New Box: How Much of RLVR's Out-of-Domain Gain Is Answer Format?, by Zongye Lyu View PDF HTML (experimental) Abstract:Reinforcement learning with verifiable rewards (RLVR) is credited with gains beyond the domain its rewards check, such as higher MMLU accuracy after training on mathematics. Such accuracies are usually read out of the model's text by an answer extractor. A model that learns to write its answer where the extractor looks can therefore score higher without answering better. We measure how much of the gain reported by extractors copied from public code arises this way. We generate outputs from a base model and its RL model and score them twice: with those extractors, and with one extractor of our own that reads a stated answer whether it is in the answer box \boxed{} or in the text. On four released 7B SimpleRL base-RL pairs, 82% of the out-of-domain multiple-choice gain that these extractors report disappears under ours: it is a gain in answer format, not in answers. The base models already state most of their answers in text, and RL moves them into the box, where these extractors look first. Independent LLM readers, in place of our extractor, put the figure at 77%. With a prompt that itself asks for the box, our extractor puts it at 79%. On a 32B pair trained with another recipe, almost none of the reported gain is format gain: its base model boxes its answers when asked, and its RL model rarely does when not. A reported gain is partly a property of the extractor that read it, and re-scoring stored outputs with a second extractor shows how much, without re-running RL. Comments: 36 pages (10 main), 5 figures, 28 tables Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL) ACM classes: I.2.7 Cite as: arXiv:2610.20639 [cs.LG] (or arXiv:2610.20639v1 [cs.LG] for this version) https://doi.org/10.48550/arXiv.2610.20639 arXiv-issued DOI via DataCite Submission history From: Zongye Lyu [view email] [v1] Fri, 2 Oct 2026 12:33:17 UTC (3,633 KB) Full-text links: Access Paper: View a PDF of the paper titled Same Answer, New Box: How Much of RLVR's Out-of-Domain Gain Is Answer Format?, by Zongye Lyu View PDF HTML (experimental) TeX Source view license Ancillary-file links: Ancillary files (details): README.md REDACTIONS.txt data/items/MANIFEST.json data/items/aqua_rat.jsonl data/items/arc_c.jsonl data/items/bbh.jsonl data/items/gsm8k.jsonl data/items/math500.jsonl data/items/mmlu.jsonl data/items/mmlu_pro.jsonl data/items/sat_math.jsonl data/llama-pilot-items/arc_c.jsonl data/llama-pilot-items/mmlu.jsonl data/llama-pilot-items/mmlu_pro.jsonl harness/adjudicate.py harness/adjudication_descriptive.py harness/adjudication_prompt.txt harness/adjudication_result.py harness/analyze.py harness/answer_tags.py harness/boxing_by_prompt.py harness/build_generation_manifest.py harness/correctness_criterion.py harness/decompose.py harness/denominator_weight.py harness/derive_supporting.py harness/dose_response.py harness/dose_response_pooled.py harness/external_matched.py harness/external_reference.py harness/extraction_rate_settings.py harness/extractors.py harness/first_pilot_generate.py harness/format_compliance.py harness/freeze_items.py harness/gen_model.py harness/gen_unit.py harness/larger_pairs.py harness/llama_pilot.py harness/llama_pilot_arc_c.py harness/make_figures_2_3.py harness/make_figures_4_5.py harness/math_equiv.py harness/mechanism_by_prompt.py harness/mechanism_main_pairs.py harness/omega_matched.py harness/omega_sensitivity.py harness/parser_departures.py harness/parser_fidelity.py harness/parser_reach_matrix.py harness/parser_reach_nonempty.py harness/poison_test.py harness/pooled.py harness/publish_bounds.py harness/published_vs_reread.py harness/qwen_repair_impact.py harness/qwen_strip_string.py harness/release_loop.py harness/release_loop_effect.py harness/running_example.py harness/running_example_misses.py harness/share_checks.py harness/shipped_parsers.py harness/transcript_differential.py harness/verify_upstream_pins.py harness/with_letter_step.py records/adjudication-precommitment.CORRECTION.md records/adjudication-precommitment.json records/first-pilot/abstaining_extractor.py records/first-pilot/accuracy_where_read.py records/first-pilot/extraction_rate_criterion.py records/first-pilot/extractors_on_grid.py records/first-pilot/format_share.py records/first-pilot/generations/gen-base.json records/first-pilot/generations/gen-post.json records/first-pilot/outputs_without_answer.py records/first-pilot/permissive_extractor.py records/first-pilot/prompts.py records/first-pilot/reconciliation.json records/first-pilot/result.json records/first-pilot/results/accuracy-where-read.json records/first-pilot/results/extraction-rate-criterion.json records/first-pilot/results/extractors-on-grid.json records/first-pilot/results/format-share.json records/first-pilot/results/outputs-without-answer.json records/first-pilot/results/prompts.json records/harness-checks/model-roster.json records/harness-checks/parser-fidelity.json records/harness-checks/poison-test.json records/harness-checks/transcript-differential.json records/larger-pairs-precommitment.json records/release-survey.json records/screening/parsers-transcribed.json records/screening/rlvr-pairs-verified.json records/upstream-pin-verification.json requirements.txt results/MANIFEST.json results/MANIFEST.md results/adjudication-descriptive.json results/adjudication-result.json results/adjudication/RESULT.md results/adjudication/batches.json results/adjudication/human-kit/README.md results/adjudication/human-kit/answers-to-fill.csv results/adjudication/human-kit/items.html results/adjudication/raw/first/0000.attempt0.json results/adjudication/raw/first/0001.attempt0.json results/adjudication/raw/first/0002.attempt0.json results/adjudication/raw/first/0003.attempt0.json results/adjudication/raw/first/0004.attempt0.json results/adjudication/raw/first/0005.attempt0.json results/adjudication/raw/first/0006.attempt0.json results/adjudication/raw/first/0007.attempt0.json results/adjudication/raw/first/0008.attempt0.json results/adjudication/raw/first/0009.attempt0.json results/adjudication/raw/first/0010.attempt0.json results/adjudication/raw/first/0011.attempt0.json results/adjudication/raw/first/0012.attempt0.json results/adjudication/raw/first/0013.attempt0.json results/adjudication/raw/first/0014.attempt0.json results/adjudication/raw/first/0015.attempt0.json results/adjudication/raw/first/0016.attempt0.json results/adjudication/raw/first/0017.attempt0.json results/adjudication/raw/first/0018.attempt0.json results/adjudication/raw/first/0019.attempt0.json results/adjudication/raw/first/0020.attempt0.json results/adjudication/raw/first/0021.attempt0.json results/adjudication/raw/first/0022.attempt0.json results/adjudication/raw/first/0023.attempt0.json results/adjudication/raw/first/0024.attempt0.json results/adjudication/raw/first/0025.attempt0.json results/adjudication/raw/first/0026.attempt0.json results/adjudication/raw/first/0027.attempt0.json results/adjudication/raw/first/0028.attempt0.json results/adjudication/raw/first/0029.attempt0.json results/adjudication/raw/first/0030.attempt0.json results/adjudication/raw/first/0031.attempt0.json results/adjudication/raw/first/0032.attempt0.json results/adjudication/raw/first/0033.attempt0.json results/adjudication/raw/first/0034.attempt0.json results/adjudication/raw/first/0035.attempt0.json results/adjudication/raw/first/0036.attempt0.json results/adjudication/raw/first/0037.attempt0.json results/adjudication/raw/first/0038.attempt0.json results/adjudication/raw/first/0039.attempt0.json results/adjudication/raw/first/0040.attempt0.json results/adjudication/raw/first/0041.attempt0.json results/adjudication/raw/first/0042.attempt0.json results/adjudication/raw/first/0043.attempt0.json results/adjudication/raw/first/0044.attempt0.json results/adjudication/raw/first/0045.attempt0.json results/adjudication/raw/first/0046.attempt0.json results/adjudication/raw/first/0047.attempt0.json results/adjudication/raw/first/0048.attempt0.json results/adjudication/raw/first/0049.attempt0.json results/adjudication/raw/first/0050.attempt0.json results/adjudication/raw/first/0051.attempt0.json results/adjudication/raw/first/0052.attempt0.json results/adjudication/raw/first/0053.attempt0.json results/adjudication/raw/first/0054.attempt0.json results/adjudication/raw/first/0055.attempt0.json results/adjudication/raw/first/0056.attempt0.json results/adjudication/raw/first/0057.attempt0.json results/adjudication/raw/first/0058.attempt0.json results/adjudication/raw/first/0059.attempt0.json results/adjudication/raw/first/0060.attempt0.json results/adjudication/raw/first/0061.attempt0.json results/adjudication/raw/first/0062.attempt0.json results/adjudication/raw/first/0063.attempt0.json results/adjudication/raw/first/0064.attempt0.json results/adjudication/raw/first/0065.attempt0.json results/adjudication/raw/first/0066.attempt0.json results/adjudication/raw/first/0067.attempt0.json results/adjudication/raw/first/0068.attempt0.json results/adjudication/raw/first/0069.attempt0.json results/adjudication/raw/first/0070.attempt0.json results/adjudication/raw/first/0071.attempt0.json results/adjudication/raw/first/0072.attempt0.json results/adjudication/raw/first/0073.attempt0.json results/adjudication/raw/first/0074.attempt0.json results/adjudication/raw/first/0075.attempt0.json results/adjudication/raw/first/0076.attempt0.json results/adjudication/raw/first/0077.attempt0.json results/adjudication/raw/first/0078.attempt0.json results/adjudication/raw/first/0079.attempt0.json results/adjudication/raw/first/0080.attempt0.json results/adjudication/raw/first/0081.attempt0.json results/adjudication/raw/first/0082.attempt0.json results/adjudication/raw/first/0083.attempt0.json results/adjudication/raw/first/0084.attempt0.json results/adjudication/raw/first/0085.attempt0.json results/adjudication/raw/first/0086.attempt0.json results/adjudication/raw/first/0087.attempt0.json results/adjudication/raw/first/0088.attempt0.json results/adjudication/raw/first/0089.attempt0.json results/adjudication/raw/first/0090.attempt0.json results/adjudication/raw/first/0091.attempt0.json results/adjudication/raw/first/0092.attempt0.json results/adjudication/raw/first/0093.attempt0.json results/adjudication/raw/first/0094.attempt0.json results/adjudication/raw/first/0095.attempt0.json results/adjudication/raw/first/0096.attempt0.json results/adjudication/raw/first/0097.attempt0.json results/adjudication/raw/first/0098.attempt0.json results/adjudication/raw/first/0099.attempt0.json results/adjudication/raw/first/0100.attempt0.json results/adjudication/raw/first/0101.attempt0.json results/adjudication/raw/first/0102.attempt0.json results/adjudication/raw/first/0103.attempt0.json results/adjudication/raw/first/0104.attempt0.json results/adjudication/raw/first/0105.attempt0.json results/adjudication/raw/first/0106.attempt0.json results/adjudication/raw/first/0107.attempt0.json results/adjudication/raw/first/0108.attempt0.json results/adjudication/raw/first/0109.attempt0.json results/adjudication/raw/first/0110.attempt0.json results/adjudication/raw/first/0111.attempt0.json results/adjudication/raw/first/0112.attempt0.json results/adjudication/raw/first/0113.attempt0.json results/adjudication/raw/first/0114.attempt0.json results/adjudication/raw/first/0114.attempt1.json results/adjudication/raw/first/0115.attempt0.json results/adjudication/raw/first/0116.attempt0.json results/adjudicatio [truncated for AI cost control]