{"id":"arxiv:2610.36195","kind":"preprint","title":"Learning to Read Braille: Benchmarking and Improving Braille Recognition Capabilities of VLMs","authors":["Kartik Jangra","Atharva Gawane","Siddharth Pulipaka","Hemachandran Karah","Raj Dabre"],"author_count":5,"year":2026,"published":"2026-10-26","venue":null,"cited_by":0,"doi":null,"arxiv_id":"2610.36195","nct_id":null,"source_url":"https://arxiv.org/abs/2610.36195","archive_url":"https://space-kitty.com/papers/arxiv:2610.36195","updated":"2026-10-28","pmid":null,"pmcid":null,"openalex_id":"W7224086379","pdf_url":"https://arxiv.org/pdf/2610.36195","abstract":"Despite rapid progress in visual understanding and document transcription, modern vision-language models (VLMs) struggle with a fundamental accessibility task: reading Braille from images. We introduce BrailleBench, a manually curated benchmark of 259 real-world Grade-1 and Grade-2 Braille images. We evaluate proprietary, open-weight, OCR-specialized, and tool-assisted multimodal systems and find that standalone general-purpose models perform poorly at directly transcribing Braille images, whereas tool-assisted systems perform much better. We design a synthetic Braille generation pipeline with diverse layouts and image perturbations. A 2B VLM model trained on our synthetic data reaches 87% exact match on Grade-1 and 61% on Grade-2 BrailleBench, outperforming standalone VLMs and achieving the highest Grade-2 exact match score among the evaluated systems. We further show that high accuracy on synthetic validation data does not guarantee high accuracy on real photographs in our experiments: models trained on prior synthetic data reach up to 96% on their synthetic validation set but at most 3.26% on Grade-1 BrailleBench. Our results identify an accessibility-relevant capability gap in multimodal systems and show that targeted synthetic supervision can improve real-world Braille transcription.","abstract_license":"CC0-1.0 (arXiv descriptive metadata)","license":null,"is_open_access":false,"retracted":false,"peer_reviewed":false,"categories":["cs.CV","cs.CL"],"details":null,"provenance":"arxiv","attribution":"Abstract: arXiv descriptive metadata (CC0). Thank you to arXiv for use of its open access interoperability. This service was not reviewed or approved by, nor does it necessarily express or reflect the policies or opinions of, arXiv.","topics":[{"slug":"scaling-laws","name":"Scaling Laws & Compute-Optimal Training","domain_slug":"ai"}],"cited_in_dossiers":[]}