Skip to content
AI News HubLIVE
Original source2 min read

Multimodal Graph Learning: A Survey of Models, Benchmarks, and Frontiers

Summary

This survey provides an algorithm-centric and evaluation-grounded review of multimodal attributed graph learning, introducing a unified message-passing formulation across five integration levels, reviewing benchmarks and evaluation protocols, and connecting the field to AI agents and graph engineering.

SourcearXiv Machine LearningAuthor: Rui Xue, Tianfu Wu
Multimodal Graph Learning: A Survey of Models, Benchmarks, and Frontiers
Report an error

The correction channel is not available yet. You can copy the article reference below for later.

Correction instructions
Read article

[Submitted on 8 Nov 2026]

Title:Multimodal Graph Learning: A Survey of Models, Benchmarks, and Frontiers

View a PDF of the paper titled Multimodal Graph Learning: A Survey of Models, Benchmarks, and Frontiers, by Rui Xue and 1 other authors

View PDF HTML (experimental)

Abstract:Multimodal attributed graphs (MAGs), in which nodes carry text, images, and other modalities while edges encode relations among entities, underlie e-commerce, social media, content platforms, and creative applications. Learning on MAGs has developed along two complementary lines: graph-centric methods redesign how modalities are fused, propagated, and connected within message passing, while foundation-model-centric methods pretrain transferable multimodal graph encoders or bring graph context into multimodal large language models for prediction and generation. In parallel, several benchmarks have appeared with different datasets and evaluation protocols. This survey takes an algorithm-centric and evaluation-grounded view of the field and makes three contributions. Modeling: we introduce a unified message-passing formulation and organize methods into five integration levels (feature, propagation, topology, learning, and foundation model), covering discriminative and graph-conditioned generative models; within this formulation we derive representative methods as special cases, compare their assumptions, expressiveness, and cost, and identify cross-modal sensitivity as a property that separates otherwise similar architectures. Datasets and evaluation: we review recent benchmarks, summarize their datasets and metrics, define model-independent descriptors (label homophily, average degree, clustering, and edge provenance), and map each evaluation protocol to the baselines it uses. Frontiers: we connect multimodal graph learning to AI agents, covering the multimodal graphs that agents perceive and remember and graph engineering, the practice of organizing agent workflows as explicit graphs; we then discuss open problems, concrete efforts for the community, and research directions, including when graph structure helps in the presence of strong multimodal foundation models.

Subjects:

Machine Learning (cs.LG)

Cite as: arXiv:2611.12990 [cs.LG]

(or arXiv:2611.12990v1 [cs.LG] for this version)

https://doi.org/10.48550/arXiv.2611.12990

arXiv-issued DOI via DataCite

Submission history

From: Rui Xue [view email] [v1] Sun, 8 Nov 2026 10:29:16 UTC (116 KB)

Full-text links:

Access Paper:

View a PDF of the paper titled Multimodal Graph Learning: A Survey of Models, Benchmarks, and Frontiers, by Rui Xue and 1 other authors

View PDF

HTML (experimental)

TeX Source

view license

Additional Features

Audio Summary

Current browse context:

cs.LG

new | recent | 2026-11

Change to browse by:

cs

References & Citations

SciX

Google Scholar

Semantic Scholar

Loading...

Data provided by:

Bibliographic Tools

Bibliographic and Citation Tools

Bibliographic Explorer Toggle

Bibliographic Explorer (What is the Explorer?)

Connected Papers Toggle

Connected Papers (What is Connected Papers?)

Litmaps Toggle

Litmaps (What is Litmaps?)

scite.ai Toggle

scite Smart Citations (What are Smart Citations?)

Code, Data, Media

Code, Data and Media Associated with this Article

alphaXiv Toggle

alphaXiv (What is alphaXiv?)

Links to Code Toggle

CatalyzeX Code Finder for Papers (What is CatalyzeX?)

DagsHub Toggle

DagsHub (What is DagsHub?)

GotitPub Toggle

Gotit.pub (What is GotitPub?)

Huggingface Toggle

Hugging Face (What is Huggingface?)

ScienceCast Toggle

ScienceCast (What is ScienceCast?)

Demos

Demos

Replicate Toggle

Replicate (What is Replicate?)

Spaces Toggle

Hugging Face Spaces (What is Spaces?)

Spaces Toggle

TXYZ.AI (What is TXYZ.AI?)

Related Papers

Recommenders and Search Tools

Link to Influence Flower

Influence Flower (What are Influence Flowers?)

Core recommender toggle

CORE Recommender (What is CORE?)

IArxiv recommender toggle

IArxiv Recommender (What is IArxiv?)

Author

Venue

Institution

Topic

About arXivLabs

arXivLabs: experimental projects with community collaborators

arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.

Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.

Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.

Which authors of this paper are endorsers? | Disable MathJax (What is MathJax?)

Key points and analysis

Article intelligence

EngineersAdvanced

Key points

  • Introduces a unified message-passing formulation organizing methods into five integration levels: feature, propagation, topology, learning, and foundation model.
  • Reviews benchmarks with model-independent descriptors such as label homophily, average degree, clustering, and edge provenance.
  • Connects multimodal graph learning to AI agents, covering perceived and remembered multimodal graphs and graph engineering.

Highlights and analysis are generated automatically and may contain errors. Check the original source.

Multimodal Graph Learning: A Survey of Models, Benchmarks, and Frontiers | AI News Hub