{"id":"arxiv:2411.19378","kind":"article","title":"Libra: Leveraging Temporal Images for Biomedical Radiology Analysis","authors":["Xi Zhang","Zaiqiao Meng","Jake Lever","Edmond S. L. Ho"],"author_count":4,"year":2024,"published":"2024-11-28","venue":"Association for Computational Linguistics, 2025","cited_by":8,"doi":"10.18653/v1/2025.findings-acl.888","arxiv_id":"2411.19378","nct_id":null,"source_url":"https://arxiv.org/abs/2411.19378","archive_url":"https://space-kitty.com/papers/arxiv:2411.19378","updated":"2025-02-16","pmid":null,"pmcid":null,"openalex_id":"W4412887823","pdf_url":"https://arxiv.org/pdf/2411.19378","abstract":"Radiology report generation (RRG) requires advanced medical image analysis, effective temporal reasoning, and accurate text generation. While multimodal large language models (MLLMs) align with pre-trained vision encoders to enhance visual-language understanding, most existing methods rely on single-image analysis or rule-based heuristics to process multiple images, failing to fully leverage temporal information in multi-modal medical datasets. In this paper, we introduce Libra, a temporal-aware MLLM tailored for chest X-ray report generation. Libra combines a radiology-specific image encoder with a novel Temporal Alignment Connector (TAC), designed to accurately capture and integrate temporal differences between paired current and prior images. Extensive experiments on the MIMIC-CXR dataset demonstrate that Libra establishes a new state-of-the-art benchmark among similarly scaled MLLMs, setting new standards in both clinical relevance and lexical accuracy.","abstract_license":"CC0-1.0 (arXiv descriptive metadata)","license":null,"is_open_access":false,"retracted":false,"peer_reviewed":null,"categories":["cs.CV","cs.AI","cs.CL","cs.LG"],"details":null,"provenance":"arxiv","attribution":"Abstract: arXiv descriptive metadata (CC0). Thank you to arXiv for use of its open access interoperability. This service was not reviewed or approved by, nor does it necessarily express or reflect the policies or opinions of, arXiv.","topics":[{"slug":"ai-medicine","name":"AI in Clinical Medicine","domain_slug":"medicine"}],"cited_in_dossiers":[]}