{"id":"arxiv:2610.36513","kind":"preprint","title":"MedConstBench: Benchmarking How Constitutions Steer LLMs in Medical Ethics","authors":["Yibo Yang","Zerui Huang","Haomiao Yang","Zixia Wang"],"author_count":4,"year":2026,"published":"2026-10-27","venue":null,"cited_by":0,"doi":null,"arxiv_id":"2610.36513","nct_id":null,"source_url":"https://arxiv.org/abs/2610.36513","archive_url":"https://space-kitty.com/papers/arxiv:2610.36513","updated":"2026-10-27","pmid":null,"pmcid":null,"openalex_id":"W7224097642","pdf_url":"https://arxiv.org/pdf/2610.36513","abstract":"As large language models advance rapidly, they are increasingly used to answer medical questions, and many such models are now deployed locally. Once a model is deployed, its behavior is governed mainly by the ethical policy written into its constitution. However, most existing work focuses on factual correctness rather than the trade-off between competing ethical values. Even benchmarks that do evaluate ethics treat it as a fixed property of the model rather than as a variable, so how a constitution reshapes medical-ethics behavior remains largely unexplored. We introduce MedConstBench, a medical-ethics benchmark that treats the deployment constitution as a controlled variable, is organized around Beauchamp's four principles, and is scored by human-calibrated multi-model peer review. It includes MedDilemma, our own dataset of clinical dilemmas, and supports a systematic analysis of how constitutions steer LLMs. Evaluating ten open-source LLMs under four constitutions, we find that the effect of a constitution is dimension-selective and model-dependent, and that no constitution is universally optimal. Motivated by these findings, we propose a do-no-harm adaptive selector that chooses a constitution per model, matching the per-model oracle while guaranteeing a worst-case floor and generalizing to unseen models at low cost.","abstract_license":"CC0-1.0 (arXiv descriptive metadata)","license":null,"is_open_access":false,"retracted":false,"peer_reviewed":false,"categories":["cs.AI","cs.CL"],"details":null,"provenance":"arxiv","attribution":"Abstract: arXiv descriptive metadata (CC0). Thank you to arXiv for use of its open access interoperability. This service was not reviewed or approved by, nor does it necessarily express or reflect the policies or opinions of, arXiv.","topics":[{"slug":"ai-medicine","name":"AI in Clinical Medicine","domain_slug":"medicine"}],"cited_in_dossiers":[]}