Skip to content
AI News HubLIVE
Original source2 min read

Jev with Foresight: Safe Language-Guided Autonomous Driving via a Language World Model

Summary

Jev-AD combines a typed decision model with a language world model to foresee consequences of driving actions, reducing collision rates from 26.0% to 2.4% in simulation and from 48.2% to 2.8% in real-world replays.

SourcearXiv RoboticsAuthor: Yansong Qu, Jiancong Chen, Samuel Labi
Jev with Foresight: Safe Language-Guided Autonomous Driving via a Language World Model
Report an error

The correction channel is not available yet. You can copy the article reference below for later.

Correction instructions
Read article

[Submitted on 3 Nov 2026]

Title:Jev with Foresight: Safe Language-Guided Autonomous Driving via a Language World Model

View a PDF of the paper titled Jev with Foresight: Safe Language-Guided Autonomous Driving via a Language World Model, by Yansong Qu and 2 other authors

View PDF HTML (experimental)

Abstract:Large language models understand passengers' driving commands, but as driving agents they reason in generated text for seconds and must infer each action's consequences implicitly from the scene. We present Jev-AD, which pairs Jev, a typed decision model that answers predefined questions with probabilities, not generated text, with a language world model that predicts for every candidate action how nearby vehicles move over the next two seconds. Code turns these predictions into foreseen consequences, which Jev compares instead of inferring them from coordinates. In simulated highway merging (500 car-episodes), this foresight lowers the same decision model's collision rate from 26.0% to 2.4% at 0.25 seconds per decision, and Jev-AD achieves the passenger's intent in 93% of free-form command trials. In 500 replayed real-world NGSIM episodes, foresight lowers the collision rate from 48.2% to 2.8%, and the world model, learned from this traffic, foresees 93% of dangerous actions. Project page: this https URL.

Subjects:

Robotics (cs.RO); Artificial Intelligence (cs.AI)

Cite as: arXiv:2611.05448 [cs.RO]

(or arXiv:2611.05448v1 [cs.RO] for this version)

https://doi.org/10.48550/arXiv.2611.05448

arXiv-issued DOI via DataCite

Submission history

From: Yansong Qu [view email] [v1] Tue, 3 Nov 2026 17:36:47 UTC (1,173 KB)

Full-text links:

Access Paper:

View a PDF of the paper titled Jev with Foresight: Safe Language-Guided Autonomous Driving via a Language World Model, by Yansong Qu and 2 other authors

View PDF

HTML (experimental)

TeX Source

view license

Additional Features

Audio Summary

Current browse context:

cs.RO

new | recent | 2026-11

Change to browse by:

cs cs.AI

References & Citations

SciX

Google Scholar

Semantic Scholar

Loading...

Data provided by:

Bibliographic Tools

Bibliographic and Citation Tools

Bibliographic Explorer Toggle

Bibliographic Explorer (What is the Explorer?)

Connected Papers Toggle

Connected Papers (What is Connected Papers?)

Litmaps Toggle

Litmaps (What is Litmaps?)

scite.ai Toggle

scite Smart Citations (What are Smart Citations?)

Code, Data, Media

Code, Data and Media Associated with this Article

alphaXiv Toggle

alphaXiv (What is alphaXiv?)

Links to Code Toggle

CatalyzeX Code Finder for Papers (What is CatalyzeX?)

DagsHub Toggle

DagsHub (What is DagsHub?)

GotitPub Toggle

Gotit.pub (What is GotitPub?)

Huggingface Toggle

Hugging Face (What is Huggingface?)

ScienceCast Toggle

ScienceCast (What is ScienceCast?)

Demos

Demos

Replicate Toggle

Replicate (What is Replicate?)

Spaces Toggle

Hugging Face Spaces (What is Spaces?)

Spaces Toggle

TXYZ.AI (What is TXYZ.AI?)

Related Papers

Recommenders and Search Tools

Link to Influence Flower

Influence Flower (What are Influence Flowers?)

Core recommender toggle

CORE Recommender (What is CORE?)

Author

Venue

Institution

Topic

About arXivLabs

arXivLabs: experimental projects with community collaborators

arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.

Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.

Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.

Which authors of this paper are endorsers? | Disable MathJax (What is MathJax?)

Key points and analysis

Article intelligence

EngineersIntermediate

Key points

  • Jev-AD predicts the next two seconds of nearby vehicle movements for each candidate action using a language world model.
  • In simulated highway merging, collision rate drops from 26.0% to 2.4% at 0.25 seconds per decision.
  • In replayed NGSIM episodes, collision rate drops from 48.2% to 2.8%, with the world model foreseeing 93% of dangerous actions.

Highlights and analysis are generated automatically and may contain errors. Check the original source.