Skip to content
AI News HubLIVE
More
Summary only

Does a URL just sitting in a prompt steer an LLM's output toward its content?

This article investigates whether including a URL in an LLM prompt influences the model's output toward the content at that URL. Experiments show that a URL only steers output if its content was in the model's training data. Many sites that rely on JavaScript are missing from training corpora. Descriptive URLs can influence as normal text, while famous opaque identifiers (like arXiv IDs) may decode if memorized. The research highlights the opacity of training data and the impact of SPA design on model knowledge.

SourceHacker News AIAuthor: kinlan
Does a URL just sitting in a prompt steer an LLM's output toward its content?
Report an error

The correction channel is not available yet. You can copy the article reference below for later.

Correction instructions

Summary only

Under the source content permission, this page provides an editorial summary, key points, and a link to the original article.

Key points and analysis

Article intelligence

EngineersAdvanced

Key points

  • URLs influence LLM output only if their content is included in training data.
  • JavaScript-dependent websites are often absent from training data.
  • Descriptive URLs act as normal prompt text; famous opaque identifiers may be decoded if memorized.
  • Greater transparency in model training data is needed.

Highlights and analysis are generated automatically and may contain errors. Check the original source.