Skip to content
AI News HubLIVE
Original source2 min read

An Operationalization of Opaque Serial Depth

Summary

The paper proposes NLS depth, a measure of the longest path through a model's computation that avoids natural-language-rooted interpretable bottlenecks. It can be adjudicated before training from architecture, training recipe, and deployment configuration, and is insensitive to ordinary post-training. Across open-weight models, NLS depth correlates strongly with layer count and has grown slowly; latent-reasoning architectures such as full-bandwidth transformers could increase it substantially. The authors argue developers should track and report NLS depth alongside direct CoT monitorability measurements.

SourcearXiv AIAuthor: Nathan Sheffield, Alek Westover, Lukas Finnveden, Alexa Pan, Julian Stastny, Ryan Greenblatt
An Operationalization of Opaque Serial Depth
Report an error

The correction channel is not available yet. You can copy the article reference below for later.

Correction instructions
Read article

[Submitted on 12 Nov 2026]

Title:An Operationalization of Opaque Serial Depth

View a PDF of the paper titled An Operationalization of Opaque Serial Depth, by Nathan Sheffield and 5 other authors

View PDF HTML (experimental)

Abstract:Chain-of-thought (CoT) is currently a valuable tool for overseeing AI models, but some architectural shifts could significantly reduce CoT monitorability. We operationalize a measure that serves as a proxy for the amount of unverbalized serial cognition a model can perform, as a specific instantiation of the notion of opaque serial depth: roughly, the length of the longest path through a model's computation that does not pass through an interpretable bottleneck. Our main contribution is a particular standard for what counts as such a bottleneck. We define natural-language-rooted (NL-rooted) nodes as nodes that were initialized from a pre-training prior to produce human-understandable outputs, whose output space has not been expanded beyond that prior, and whose outputs the model has not been modified to interpret as a different type of data. By construction, the resulting measure, NLS depth, can be adjudicated before training from an architecture, training recipe, and deployment configuration alone, and is insensitive to ordinary post-training such as prompting, distillation, and RL. We find that, across open-weight models, NLS depth correlates strongly with layer count, with some exceptions, and has grown slowly over recent years. It would likely grow slowly under continued scaling of standard transformers, while latent-reasoning architectures such as full-bandwidth transformers could increase it by a large amount. We work through how NLS depth applies to a range of existing and proposed architectures, discuss alternative operationalizations, and give a worked example bounding the depth of Gemma3-1B. We argue that AI developers should track and report the NLS depth of their models as a complement to direct measurements of CoT monitorability.

Comments: 32 pages, 6 figures. An earlier version appeared on the Redwood Research blog

Subjects:

Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

Cite as: arXiv:2611.17495 [cs.AI]

(or arXiv:2611.17495v1 [cs.AI] for this version)

https://doi.org/10.48550/arXiv.2611.17495

arXiv-issued DOI via DataCite (pending registration)

Submission history

From: Alexa Pan [view email] [v1] Thu, 12 Nov 2026 20:34:11 UTC (3,329 KB)

Full-text links:

Access Paper:

View a PDF of the paper titled An Operationalization of Opaque Serial Depth, by Nathan Sheffield and 5 other authors

View PDF

HTML (experimental)

TeX Source

view license

Additional Features

Audio Summary

Current browse context:

cs.AI

new | recent | 2026-11

Change to browse by:

cs cs.LG

References & Citations

SciX

Google Scholar

Semantic Scholar

Loading...

Data provided by:

Bibliographic Tools

Bibliographic and Citation Tools

Bibliographic Explorer Toggle

Bibliographic Explorer (What is the Explorer?)

Connected Papers Toggle

Connected Papers (What is Connected Papers?)

Litmaps Toggle

Litmaps (What is Litmaps?)

scite.ai Toggle

scite Smart Citations (What are Smart Citations?)

Code, Data, Media

Code, Data and Media Associated with this Article

alphaXiv Toggle

alphaXiv (What is alphaXiv?)

Links to Code Toggle

CatalyzeX Code Finder for Papers (What is CatalyzeX?)

DagsHub Toggle

DagsHub (What is DagsHub?)

GotitPub Toggle

Gotit.pub (What is GotitPub?)

Huggingface Toggle

Hugging Face (What is Huggingface?)

ScienceCast Toggle

ScienceCast (What is ScienceCast?)

Demos

Demos

Replicate Toggle

Replicate (What is Replicate?)

Spaces Toggle

Hugging Face Spaces (What is Spaces?)

Spaces Toggle

TXYZ.AI (What is TXYZ.AI?)

Related Papers

Recommenders and Search Tools

Link to Influence Flower

Influence Flower (What are Influence Flowers?)

Core recommender toggle

CORE Recommender (What is CORE?)

Author

Venue

Institution

Topic

About arXivLabs

arXivLabs: experimental projects with community collaborators

arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.

Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.

Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.

Which authors of this paper are endorsers? | Disable MathJax (What is MathJax?)

Key points and analysis

Article intelligence

EngineersAdvanced

Key points

  • Introduces NLS depth to quantify unverbalized serial computation bypassing natural-language-rooted bottlenecks
  • Can be determined before training from architecture, recipe, and deployment configuration, insensitive to prompting, distillation, and RL
  • NLS depth correlates with layer count across open-weight models and has grown slowly in recent years
  • Full-bandwidth transformers and other latent-reasoning architectures could greatly increase NLS depth
  • Recommends tracking and reporting NLS depth as a complement to direct CoT monitorability measurements

Highlights and analysis are generated automatically and may contain errors. Check the original source.

An Operationalization of Opaque Serial Depth | AI News Hub