{"id":"arxiv:2610.36911","kind":"preprint","title":"Developing a Speech Language Model for Basque","authors":["Andoni Sudupe","Inma Hernaez","Ander Arriandiaga","Christoforos Souganidis","Ibon Saratxaga","Eva Navas"],"author_count":6,"year":2026,"published":"2026-10-27","venue":null,"cited_by":0,"doi":null,"arxiv_id":"2610.36911","nct_id":null,"source_url":"https://arxiv.org/abs/2610.36911","archive_url":"https://space-kitty.com/papers/arxiv:2610.36911","updated":"2026-10-27","pmid":null,"pmcid":null,"openalex_id":"W7224136406","pdf_url":"https://arxiv.org/pdf/2610.36911","abstract":"Although the recent development of LLMs has paved the way for multi-modal interaction, minority languages face difficulties keeping pace. This work presents the first open Speech Language Model for Basque, designed for low-latency, end-to-end spoken interaction. Based on the LLaMA-Omni architecture, the system integrates a Latxa model as its backbone, transferring its Basque capabilities to the spoken modality by fine-tuning several modules. To address data scarcity, the English VoiceAssistant-400K corpus was translated into Basque, and the audio was synthesized using a Basque TTS. Evaluation results confirm the system's viability, achieving 3.86/5 in content quality, a 9.94% WER for spoken intelligibility, and a 3.07 UTMOS for audio quality. This work demonstrates that advanced spoken interaction systems can be developed using modular architectures and synthetic data even in low-resource languages.","abstract_license":"CC0-1.0 (arXiv descriptive metadata)","license":null,"is_open_access":false,"peer_reviewed":false,"categories":["cs.CL","cs.AI","eess.AS"],"details":null,"provenance":"arxiv","attribution":"Abstract: arXiv descriptive metadata (CC0). Thank you to arXiv for use of its open access interoperability. This service was not reviewed or approved by, nor does it necessarily express or reflect the policies or opinions of, arXiv.","topics":[{"slug":"scaling-laws","name":"Scaling Laws & Compute-Optimal Training","domain_slug":"ai"}],"cited_in_dossiers":[]}