Skip to content
AI News HubLIVE
Original source2 min read

On Measuring Semantic Preservation in Legal Ontology Learning

Summary

The paper proposes an evaluation methodology that quantifies semantic loss in ontology learning by comparing LLM task performance on source documents versus transformed representations, demonstrated on legal merger agreement analysis across six models and three ontology learning methods.

SourcearXiv Computational LinguisticsAuthor: Albert Sadowski, Jaros{\l}aw A. Chudziak
On Measuring Semantic Preservation in Legal Ontology Learning
Report an error

The correction channel is not available yet. You can copy the article reference below for later.

Correction instructions
Read article

[Submitted on 30 May 2026]

Title:On Measuring Semantic Preservation in Legal Ontology Learning

View a PDF of the paper titled On Measuring Semantic Preservation in Legal Ontology Learning, by Albert Sadowski and Jaros{\l}aw A. Chudziak

View PDF HTML (experimental)

Abstract:Ontology learning transforms unstructured text into structured representations for automated reasoning. Yet structuring information risks losing it, and current evaluation methodologies cannot detect such loss, focusing on structural correctness while failing to measure whether meaning survives transformation. We propose an evaluation methodology that addresses this: comparing LLM task performance on source documents against performance on transformed representations, with the difference quantifying semantic loss. We demonstrate this approach on legal merger agreement analysis, a domain chosen for its complex language and precise semantic requirements, comparing direct LLM application against three ontology learning methods across six language models. The results reveal systematic semantic loss with significant variation based on reasoning complexity and model-method interactions. Our contributions are: (1) an evaluation framework for measuring semantic preservation in ontology learning, and (2) empirical evidence that semantic loss varies dramatically with model-method pairing, providing guidance for selecting optimal configurations in legal knowledge systems.

Comments: Accepted for publication at the 30th International Conference on Knowledge-Based and Intelligent Information & Engineering Systems (KES 2026)

Subjects:

Computation and Language (cs.CL)

Cite as: arXiv:2608.12326 [cs.CL]

(or arXiv:2608.12326v1 [cs.CL] for this version)

https://doi.org/10.48550/arXiv.2608.12326

arXiv-issued DOI via DataCite

Submission history

From: Albert Sadowski [view email] [v1] Sat, 30 May 2026 05:51:12 UTC (283 KB)

Full-text links:

Access Paper:

View a PDF of the paper titled On Measuring Semantic Preservation in Legal Ontology Learning, by Albert Sadowski and Jaros{\l}aw A. Chudziak

View PDF

HTML (experimental)

TeX Source

view license

Current browse context:

cs.CL

new | recent | 2026-08

Change to browse by:

cs

References & Citations

NASA ADS

Google Scholar

Semantic Scholar

Loading...

Data provided by:

Bibliographic Tools

Bibliographic and Citation Tools

Bibliographic Explorer Toggle

Bibliographic Explorer (What is the Explorer?)

Connected Papers Toggle

Connected Papers (What is Connected Papers?)

Litmaps Toggle

Litmaps (What is Litmaps?)

scite.ai Toggle

scite Smart Citations (What are Smart Citations?)

Code, Data, Media

Code, Data and Media Associated with this Article

alphaXiv Toggle

alphaXiv (What is alphaXiv?)

Links to Code Toggle

CatalyzeX Code Finder for Papers (What is CatalyzeX?)

DagsHub Toggle

DagsHub (What is DagsHub?)

GotitPub Toggle

Gotit.pub (What is GotitPub?)

Huggingface Toggle

Hugging Face (What is Huggingface?)

ScienceCast Toggle

ScienceCast (What is ScienceCast?)

Demos

Demos

Replicate Toggle

Replicate (What is Replicate?)

Spaces Toggle

Hugging Face Spaces (What is Spaces?)

Spaces Toggle

TXYZ.AI (What is TXYZ.AI?)

Related Papers

Recommenders and Search Tools

Link to Influence Flower

Influence Flower (What are Influence Flowers?)

Core recommender toggle

CORE Recommender (What is CORE?)

Author

Venue

Institution

Topic

About arXivLabs

arXivLabs: experimental projects with community collaborators

arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.

Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.

Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.

Which authors of this paper are endorsers? | Disable MathJax (What is MathJax?)

Key points and analysis

Article intelligence

InvestorsAdvanced

Key points

  • Introduces an evaluation framework measuring semantic preservation by the performance gap between source and transformed representations
  • Applies the method to legal merger agreement analysis, comparing direct LLM use with three ontology learning methods across six language models
  • Finds systematic semantic loss that varies significantly with reasoning complexity and model-method interactions
  • Provides empirical guidance for selecting model-method configurations in legal knowledge systems

Highlights and analysis are generated automatically and may contain errors. Check the original source.