Skip to content
AI News HubLIVE
Original source2 min read

LuxSQA: Ask Me in Luxembourgish with TTS-Augmented Spoken Question Answering

Summary

A new approach uses text-to-speech (TTS) to generate training data for Spoken Question Answering in Luxembourgish, a low-resource language. By translating existing text QA pairs, synthesizing speech, and training a parameter-efficient model with a frozen Whisper encoder and LoRA adapters, the method outperforms single-source TTS. Multi-source synthetic data and voice design improve performance, and no-reference TTS quality scores don't reliably predict QA accuracy.

SourcearXiv Computational LinguisticsAuthor: Nina Hosseini-Kivanani, Marco Matassoni, Alessio Brutti
LuxSQA: Ask Me in Luxembourgish with TTS-Augmented Spoken Question Answering
Report an error

The correction channel is not available yet. You can copy the article reference below for later.

Correction instructions
Read article

[Submitted on 2 Jul 2026]

Title:LuxSQA: Ask Me in Luxembourgish with TTS-Augmented Spoken Question Answering

View a PDF of the paper titled LuxSQA: Ask Me in Luxembourgish with TTS-Augmented Spoken Question Answering, by Nina Hosseini-Kivanani and 1 other authors

View PDF HTML (experimental)

Abstract:Spoken Question Answering (SQA) remains largely focused on high-resource languages and carefully recorded speech, limiting the reach of speech-LLM methods in low-resource settings. This paper investigates whether text-to-speech (TTS) can provide task-specific training data for Luxembourgish SQA without requiring a large human-recorded QA corpus. Starting from existing text-based QA resources, we translate questions into Luxembourgish, synthesize spoken questions with multiple TTS systems, and pair them with textual answers. We train a parameter-efficient SLAM-style architecture that connects a frozen Whisper encoder to frozen multilingual LLM backends through a learned projector and LoRA adapters. We compare MMS-TTS, Qwen3-TTS, and OmniVoice variants, including single-source corpora of about 48k questions and a 4TTS multi-source mix of approximately 230k questions. Evaluation on LLAMA-LB-Test with two real Luxembourgish speaker conditions shows that multi-source and voice-design-based synthetic training configurations yield the strongest SQA performance. The results also show that no-reference TTS quality scores do not monotonically predict downstream QA performance, indicating that synthetic speech must be evaluated as task-specific training data rather than only as natural-sounding audio.

Comments: 7 pages, under review

Subjects:

Computation and Language (cs.CL)

Cite as: arXiv:2607.02763 [cs.CL]

(or arXiv:2607.02763v1 [cs.CL] for this version)

https://doi.org/10.48550/arXiv.2607.02763

arXiv-issued DOI via DataCite (pending registration)

Submission history

From: Nina Hosseini-Kivanani [view email] [v1] Thu, 2 Jul 2026 21:00:52 UTC (6,863 KB)

Full-text links:

Access Paper:

View a PDF of the paper titled LuxSQA: Ask Me in Luxembourgish with TTS-Augmented Spoken Question Answering, by Nina Hosseini-Kivanani and 1 other authors

View PDF

HTML (experimental)

TeX Source

view license

Current browse context:

cs.CL

new | recent | 2026-07

Change to browse by:

cs

References & Citations

NASA ADS

Google Scholar

Semantic Scholar

Loading...

Data provided by:

Bibliographic Tools

Bibliographic and Citation Tools

Bibliographic Explorer Toggle

Bibliographic Explorer (What is the Explorer?)

Connected Papers Toggle

Connected Papers (What is Connected Papers?)

Litmaps Toggle

Litmaps (What is Litmaps?)

scite.ai Toggle

scite Smart Citations (What are Smart Citations?)

Code, Data, Media

Code, Data and Media Associated with this Article

alphaXiv Toggle

alphaXiv (What is alphaXiv?)

Links to Code Toggle

CatalyzeX Code Finder for Papers (What is CatalyzeX?)

DagsHub Toggle

DagsHub (What is DagsHub?)

GotitPub Toggle

Gotit.pub (What is GotitPub?)

Huggingface Toggle

Hugging Face (What is Huggingface?)

ScienceCast Toggle

ScienceCast (What is ScienceCast?)

Demos

Demos

Replicate Toggle

Replicate (What is Replicate?)

Spaces Toggle

Hugging Face Spaces (What is Spaces?)

Spaces Toggle

TXYZ.AI (What is TXYZ.AI?)

Related Papers

Recommenders and Search Tools

Link to Influence Flower

Influence Flower (What are Influence Flowers?)

Core recommender toggle

CORE Recommender (What is CORE?)

Author

Venue

Institution

Topic

About arXivLabs

arXivLabs: experimental projects with community collaborators

arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.

Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.

Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.

Which authors of this paper are endorsers? | Disable MathJax (What is MathJax?)

Key points and analysis

Article intelligence

InvestorsAdvanced

Key points

  • TTS-generated synthetic speech can effectively train SQA for low-resource languages like Luxembourgish.
  • Multi-source TTS data (using 4 TTS systems) and voice-design variations lead to better SQA performance.
  • No-reference TTS quality metrics do not correlate with downstream QA accuracy; synthetic speech must be evaluated task-specifically.

Highlights and analysis are generated automatically and may contain errors. Check the original source.