Skip to content
AI News HubLIVE
Original source2 min read

Climbing the Ladder: Automating Data Pipelines and Reproducing Baselines in Low-Resource Settings

Summary

This paper rebuilds the data pipeline behind a small Sicilian neural machine translation system, re-extracting parallel text from PDFs of the bilingual journal Arba Sicula and porting tokenization and subword segmentation to a Perl-free implementation. It compares small Transformers trained from scratch with a LoRA-adapted pretrained NLLB model, finding the pretrained model far superior and staged training more helpful for translation into Sicilian than out of it, while a multilingual adapter degrades untrained directions.

SourcearXiv Computational LinguisticsAuthor: Donato Meoli, Eryk Wdowiak
Climbing the Ladder: Automating Data Pipelines and Reproducing Baselines in Low-Resource Settings
Report an error

The correction channel is not available yet. You can copy the article reference below for later.

Correction instructions
Read article

[Submitted on 21 Oct 2026]

Title:Climbing the Ladder: Automating Data Pipelines and Reproducing Baselines in Low-Resource Settings

View a PDF of the paper titled Climbing the Ladder: Automating Data Pipelines and Reproducing Baselines in Low-Resource Settings, by Donato Meoli and Eryk Wdowiak

View PDF HTML (experimental)

Abstract:The massively multilingual translation systems that now include Sicilian learned it from noisy, non-standardised web text. To obtain better translation quality, we redevelop the small neural machine translation (NMT) system that Wdowiak customized for Sicilian. We rebuild on maintained software the extraction of the parallel text from the PDFs of the bilingual journal Arba Sicula, whose sentences are aligned by a language-agnostic sentence encoder with thresholds tuned against an existing hand alignment and then filtered for the typical errors of automatic alignment. Furthermore, the tokenization and the desinence-biased subword segmentation of the original system are ported to a Perl-free implementation, and all the results are measured on a frozen test set drawn from the journal. We compare small Transformers trained from scratch with the pretrained NLLB model adapted by low-rank fine-tuning, in both directions and with Italian as a closely related bridge language, and we adapt to the pretrained model the reverse-training recipe of the original system, i.e., a stage on forward-scored back-translations of the web Sicilian followed by a stage on the curated literary text. The pretrained model is by far the better of the two, and the staged training improves the translation into Sicilian more than the translation from it. On the test set of the original system, and in the tokenized space in which it was scored, the staged model with a larger adapter and more back-translations is above the reverse-training recipe in the directions that involve English and below it between Sicilian and Italian. Yet, a multilingual adapter degrades the directions on which it was not trained, which limits its use as a general multilingual model.

Comments: 17 pages, 6 tables

Subjects:

Computation and Language (cs.CL)

ACM classes: I.2.7

Cite as: arXiv:2610.30374 [cs.CL]

(or arXiv:2610.30374v1 [cs.CL] for this version)

https://doi.org/10.48550/arXiv.2610.30374

arXiv-issued DOI via DataCite (pending registration)

Submission history

From: Eryk Wdowiak [view email] [v1] Wed, 21 Oct 2026 19:36:05 UTC (26 KB)

Full-text links:

Access Paper:

View a PDF of the paper titled Climbing the Ladder: Automating Data Pipelines and Reproducing Baselines in Low-Resource Settings, by Donato Meoli and Eryk Wdowiak

View PDF

HTML (experimental)

TeX Source

view license

Additional Features

Audio Summary

Current browse context:

cs.CL

new | recent | 2026-10

Change to browse by:

cs

References & Citations

SciX

Google Scholar

Semantic Scholar

Loading...

Data provided by:

Bibliographic Tools

Bibliographic and Citation Tools

Bibliographic Explorer Toggle

Bibliographic Explorer (What is the Explorer?)

Connected Papers Toggle

Connected Papers (What is Connected Papers?)

Litmaps Toggle

Litmaps (What is Litmaps?)

scite.ai Toggle

scite Smart Citations (What are Smart Citations?)

Code, Data, Media

Code, Data and Media Associated with this Article

alphaXiv Toggle

alphaXiv (What is alphaXiv?)

Links to Code Toggle

CatalyzeX Code Finder for Papers (What is CatalyzeX?)

DagsHub Toggle

DagsHub (What is DagsHub?)

GotitPub Toggle

Gotit.pub (What is GotitPub?)

Huggingface Toggle

Hugging Face (What is Huggingface?)

ScienceCast Toggle

ScienceCast (What is ScienceCast?)

Demos

Demos

Replicate Toggle

Replicate (What is Replicate?)

Spaces Toggle

Hugging Face Spaces (What is Spaces?)

Spaces Toggle

TXYZ.AI (What is TXYZ.AI?)

Related Papers

Recommenders and Search Tools

Link to Influence Flower

Influence Flower (What are Influence Flowers?)

Core recommender toggle

CORE Recommender (What is CORE?)

Author

Venue

Institution

Topic

About arXivLabs

arXivLabs: experimental projects with community collaborators

arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.

Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.

Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.

Which authors of this paper are endorsers? | Disable MathJax (What is MathJax?)

Key points and analysis

Article intelligence

EngineersAdvanced

Key points

  • Sentences from the bilingual journal are aligned with a language-agnostic sentence encoder, with thresholds tuned against hand alignment and filtered for common automatic-alignment errors
  • Tokenization and desinence-biased subword segmentation are ported to a Perl-free implementation, and results are measured on a frozen test set drawn from the journal
  • The pretrained NLLB model clearly outperforms small Transformers trained from scratch, and staged training helps translation into Sicilian more than translation from it
  • A multilingual adapter degrades directions it was not trained on, limiting its use as a general multilingual model

Highlights and analysis are generated automatically and may contain errors. Check the original source.