Skip to content
AI News HubLIVE
Original source2 min read

A Computational Approach to Measuring Semantic Change in Sanskrit Literature

Summary

A new paper tests whether diachronic word embeddings, typically validated on modern high-resource languages, can track semantic change in ancient, low-resource Sanskrit. The author builds a 2.7M-token corpus across four canonical periods, uses a neural byte-level sandhi splitter and lemmatizer to recover word boundaries, and trains per-period embeddings. Of 21 testable shifts, 19 move in the philologically attested direction (sign test p=0.00011).

SourcearXiv Computational LinguisticsAuthor: Tanay Agrawal
A Computational Approach to Measuring Semantic Change in Sanskrit Literature
Report an error

The correction channel is not available yet. You can copy the article reference below for later.

Correction instructions
Read article

[Submitted on 31 Jul 2026]

Title:A Computational Approach to Measuring Semantic Change in Sanskrit Literature

View a PDF of the paper titled A Computational Approach to Measuring Semantic Change in Sanskrit Literature, by Tanay Agrawal

View PDF HTML (experimental)

Abstract:Diachronic word embeddings have become the modern standard for tracking semantic change, yet they have been largely validated on modern, high-resource, and well-segmented languages. This paper tests whether the paradigm transfers to Sanskrit, an ancient, low-resource language whose phonological fusion (sandhi), morphological inflection, compounding, and polysemy pose a unique challenge. I assemble a 2.7M-token corpus spanning four canonical periods, recover word boundaries with a neural byte-level sandhi splitter and lemmatizer, and train per-period embeddings across configurations. To evaluate the system, I curate a validation set from historical scholarship and test recovery directionally with anchor displacement. Of 21 testable shifts, 19 move in the philologically attested direction (sign test, p=0.00011). I further show which configuration the language forces and comment on opportunities for improvement.

Subjects:

Computation and Language (cs.CL)

Cite as: arXiv:2609.25012 [cs.CL]

(or arXiv:2609.25012v1 [cs.CL] for this version)

https://doi.org/10.48550/arXiv.2609.25012

arXiv-issued DOI via DataCite

Submission history

From: Tanay Agrawal [view email] [v1] Fri, 31 Jul 2026 05:22:21 UTC (34 KB)

Full-text links:

Access Paper:

View a PDF of the paper titled A Computational Approach to Measuring Semantic Change in Sanskrit Literature, by Tanay Agrawal

View PDF

HTML (experimental)

TeX Source

view license

Current browse context:

cs.CL

new | recent | 2026-09

Change to browse by:

cs

References & Citations

NASA ADS

Google Scholar

Semantic Scholar

Loading...

Data provided by:

Bibliographic Tools

Bibliographic and Citation Tools

Bibliographic Explorer Toggle

Bibliographic Explorer (What is the Explorer?)

Connected Papers Toggle

Connected Papers (What is Connected Papers?)

Litmaps Toggle

Litmaps (What is Litmaps?)

scite.ai Toggle

scite Smart Citations (What are Smart Citations?)

Code, Data, Media

Code, Data and Media Associated with this Article

alphaXiv Toggle

alphaXiv (What is alphaXiv?)

Links to Code Toggle

CatalyzeX Code Finder for Papers (What is CatalyzeX?)

DagsHub Toggle

DagsHub (What is DagsHub?)

GotitPub Toggle

Gotit.pub (What is GotitPub?)

Huggingface Toggle

Hugging Face (What is Huggingface?)

ScienceCast Toggle

ScienceCast (What is ScienceCast?)

Demos

Demos

Replicate Toggle

Replicate (What is Replicate?)

Spaces Toggle

Hugging Face Spaces (What is Spaces?)

Spaces Toggle

TXYZ.AI (What is TXYZ.AI?)

Related Papers

Recommenders and Search Tools

Link to Influence Flower

Influence Flower (What are Influence Flowers?)

Core recommender toggle

CORE Recommender (What is CORE?)

Author

Venue

Institution

Topic

About arXivLabs

arXivLabs: experimental projects with community collaborators

arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.

Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.

Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.

Which authors of this paper are endorsers? | Disable MathJax (What is MathJax?)

Key points and analysis

Article intelligence

EngineersAdvanced

Key points

  • Tests whether diachronic word embeddings transfer to ancient, low-resource Sanskrit
  • Builds a 2.7M-token corpus across four canonical periods and recovers word boundaries with a neural byte-level sandhi splitter and lemmatizer
  • 19 of 21 testable shifts align with philologically attested directions (sign test p=0.00011)
  • Discusses the configuration Sanskrit forces and opportunities for improvement

Highlights and analysis are generated automatically and may contain errors. Check the original source.