{"id":"arxiv:2610.36510","kind":"preprint","title":"Identity or Evidence? Auditing Evidence Dependence in Agentic Life-Science Benchmarks","authors":["Danai Brilli","Maria Georgila"],"author_count":2,"year":2026,"published":"2026-10-27","venue":null,"cited_by":0,"doi":null,"arxiv_id":"2610.36510","nct_id":null,"source_url":"https://arxiv.org/abs/2610.36510","archive_url":"https://space-kitty.com/papers/arxiv:2610.36510","updated":"2026-10-27","pmid":null,"pmcid":null,"openalex_id":"W7224083779","pdf_url":"https://arxiv.org/pdf/2610.36510","abstract":"Agentic life-science benchmarks give an agent evidence about a named entity and score an answer against a recorded outcome. That score tests reasoning over evidence only if the evidence, rather than the name, determines the answer. We examine this distinction by varying identity and evidence independently on a clinical-outcome benchmark and published tasks from Biomni and LAB-Bench. Blinding identity matters little when a prompt contains a decisive sequence or passage. It matters a great deal when the prompt is mostly a name and candidate list (0.742 named versus 0.082 blinded; chance 0.093). Across 96 LAB-Bench LitQA2 questions, the gap increases under one fixed passage-redaction scheme (+0.000 to +0.135; per-instance slope +0.147, p= 0.004). On the clinical benchmark, a no-evidence recall probe matches prediction accuracy and recovers a database-specific programme count. So, we argue that benchmarks intended to measure evidence-dependent reasoning should report identity-blinded results, retrieval telemetry, and positive controls.","abstract_license":"CC0-1.0 (arXiv descriptive metadata)","license":null,"is_open_access":false,"retracted":false,"peer_reviewed":false,"categories":["cs.CV"],"details":null,"provenance":"arxiv","attribution":"Abstract: arXiv descriptive metadata (CC0). Thank you to arXiv for use of its open access interoperability. This service was not reviewed or approved by, nor does it necessarily express or reflect the policies or opinions of, arXiv.","topics":[{"slug":"ai-medicine","name":"AI in Clinical Medicine","domain_slug":"medicine"}],"cited_in_dossiers":[]}