Skip to content
AI News HubLIVE
Original source3 min read

DIAGRAMS: A Review Framework for Reasoning-Level Attribution in Diagram QA

Summary

Diagram question answering requires reasoning-level attribution that links each QA pair to all visual regions needed to derive the answer, not just the region with the final answer. Existing annotation tools are tightly coupled to dataset-specific formats. DIAGRAMS is a lightweight, schema-driven review framework that decouples interface logic from dataset-specific JSON structures via an internal meta-schema and dataset adapters. It performs QA-conditioned evidence selection and proposes required regions, generating missing QA pairs or candidate regions when needed, with human verification. Across six datasets, model-suggested evidence achieves 85.39% precision and 75.30% recall against reviewer-final selections, indicating reduced manual effort with high agreement.

SourcearXiv Computational LinguisticsAuthor: Anirudh Iyengar Kaniyar Narayana Iyengar, Tampu Ravi Kumar, Manan Suri, Raviteja Bommireddy, Dinesh Manocha, Puneet Mathur, Vivek Gupta
DIAGRAMS: A Review Framework for Reasoning-Level Attribution in Diagram QA
Report an error

The correction channel is not available yet. You can copy the article reference below for later.

Correction instructions
Read article

[2605.00905] DIAGRAMS: A Review Framework for Reasoning-Level Attribution in Diagram QA

Skip to main content

Learn about arXiv becoming an independent nonprofit.

We gratefully acknowledge support from the Simons Foundation, member institutions, and all contributors. Donate

> cs > arXiv:2605.00905

Help | Advanced Search

All fields Title Author Abstract Comments Journal reference ACM classification MSC classification Report number arXiv identifier DOI ORCID arXiv author ID Help pages Full text

Search

GO

quick links

Login

Help Pages

About

-->

Computer Science > Computation and Language

arXiv:2605.00905 (cs)

[Submitted on 29 Apr 2026]

Title:DIAGRAMS: A Review Framework for Reasoning-Level Attribution in Diagram QA

Authors:Anirudh Iyengar Kaniyar Narayana Iyengar, Tampu Ravi Kumar, Manan Suri, Raviteja Bommireddy, Dinesh Manocha, Puneet Mathur, Vivek Gupta

View a PDF of the paper titled DIAGRAMS: A Review Framework for Reasoning-Level Attribution in Diagram QA, by Anirudh Iyengar Kaniyar Narayana Iyengar and 6 other authors

View PDF HTML (experimental)

Abstract:Diagram question answering (Diagram QA) requires reasoning-level attribution that links each question-answer pair to all visual regions needed to derive the answer, rather than only the region containing the final response. Creating such structured evidence across diagrams, charts, maps, circuits, and infographics is time-consuming, and existing annotation tools tightly couple their interfaces to dataset-specific formats. We present DIAGRAMS, a lightweight, schema-driven review framework that decouples interface logic from dataset-specific JSON structures through an internal meta-schema and dataset adapters. Given an image and QA pair with optional candidate regions, the system performs QA-conditioned evidence selection and proposes the regions required for reasoning. When QA pairs or candidate regions are missing, it generates them and supports human verification and refinement. Across six Diagram QA datasets, model-suggested evidence achieves 85.39% precision and 75.30% recall against reviewer-final selections (micro-averaged). These results indicate that the review-first framework reduces manual region creation while maintaining high agreement with final reasoning-level attributions. We release a public demo and installable package to support dataset auditing, grounded supervision creation, and grounded evaluation.

Comments: 10 Pages, 4 figures

Subjects:

Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)

Cite as: arXiv:2605.00905 [cs.CL]

(or arXiv:2605.00905v1 [cs.CL] for this version)

https://doi.org/10.48550/arXiv.2605.00905

Focus to learn more

arXiv-issued DOI via DataCite

Submission history

From: Anirudh Iyengar Kaniyar Narayana Iyengar [view email] [v1] Wed, 29 Apr 2026 02:34:51 UTC (12,209 KB)

Full-text links:

Access Paper:

View a PDF of the paper titled DIAGRAMS: A Review Framework for Reasoning-Level Attribution in Diagram QA, by Anirudh Iyengar Kaniyar Narayana Iyengar and 6 other authors

View PDF

HTML (experimental)

TeX Source

view license

Current browse context:

cs.CL

new | recent | 2026-05

Change to browse by:

cs cs.AI cs.CV

References & Citations

NASA ADS

Google Scholar

Semantic Scholar

export BibTeX citation Loading...

BibTeX formatted citation

×

loading...

Data provided by:

Bookmark

Bibliographic Tools

Bibliographic and Citation Tools

Bibliographic Explorer Toggle

Bibliographic Explorer (What is the Explorer?)

Connected Papers Toggle

Connected Papers (What is Connected Papers?)

Litmaps Toggle

Litmaps (What is Litmaps?)

scite.ai Toggle

scite Smart Citations (What are Smart Citations?)

Code, Data, Media

Code, Data and Media Associated with this Article

alphaXiv Toggle

alphaXiv (What is alphaXiv?)

Links to Code Toggle

CatalyzeX Code Finder for Papers (What is CatalyzeX?)

DagsHub Toggle

DagsHub (What is DagsHub?)

GotitPub Toggle

Gotit.pub (What is GotitPub?)

Huggingface Toggle

Hugging Face (What is Huggingface?)

ScienceCast Toggle

ScienceCast (What is ScienceCast?)

Demos

Demos

Replicate Toggle

Replicate (What is Replicate?)

Spaces Toggle

Hugging Face Spaces (What is Spaces?)

Spaces Toggle

TXYZ.AI (What is TXYZ.AI?)

Related Papers

Recommenders and Search Tools

Link to Influence Flower

Influence Flower (What are Influence Flowers?)

Core recommender toggle

CORE Recommender (What is CORE?)

Author

Venue

Institution

Topic

About arXivLabs

arXivLabs: experimental projects with community collaborators

arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.

Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.

Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.

Which authors of this paper are endorsers? | Disable MathJax (What is MathJax?)

About

Help

contact arXivClick here to contact arXiv Contact

subscribe to arXiv mailingsClick here to subscribe Subscribe

Copyright

Privacy Policy

Web Accessibility Assistance

arXiv Operational Status

Key points and analysis

Article intelligence

EngineersAdvanced

Key points

  • Diagram QA requires reasoning-level attribution to all relevant visual regions, not just the answer region.
  • DIAGRAMS decouples interface logic from dataset-specific formats using a meta-schema and adapters.
  • The system automatically generates missing QA pairs or candidate regions and supports human verification.
  • On six datasets, model-suggested evidence achieves 85.39% precision and 75.30% recall compared to human final selections.

Highlights and analysis are generated automatically and may contain errors. Check the original source.