Does a URL just sitting in a prompt steer an LLM's output toward its content?
This article investigates whether including a URL in an LLM prompt influences the model's output toward the content at that URL. Experiments show that a URL only steers output if its content was in the model's training data. Many sites that rely on JavaScript are missing from training corpora. Descriptive URLs can influence as normal text, while famous opaque identifiers (like arXiv IDs) may decode if memorized. The research highlights the opacity of training data and the impact of SPA design on model knowledge.
Does a URL just sitting in a prompt steer an LLM's output toward its content?
Report an error
The correction channel is not available yet. You can copy the article reference below for later.
Correction instructionsSummary only
Under the source content permission, this page provides an editorial summary, key points, and a link to the original article.