# A study of generative large language model for medical research and healthcare

Article · Peng Cheng, Xi Yang, Aokun Chen, Kaleb E. Smith, Nima PourNejatian, Anthony Beardsworth Costa, Cheryl English Martin, Mona G. Flores, Ying Zhang, Tanja Magoč, Gloria Pflugfelder Lipori, Duane A. Mitchell, Naykky Singh Ospina, Mustafa Mohammed Ahmed, William R. Hogan, Elizabeth A. Shenkman, Yi Maggie Guo, Jiang Bian, Yonghui Wu

- Archive id: arxiv:2305.13523
- Published: 2023-11-16
- Venue: npj Digital Medicine
- DOI: https://doi.org/10.1038/s41746-023-00958-w
- arXiv: https://arxiv.org/abs/2305.13523
- PMID: 37973919
- Citations: 408
- Source URL: https://doi.org/10.1038/s41746-023-00958-w
- PDF: https://www.nature.com/articles/s41746-023-00958-w.pdf
- Provenance: openalex+arxiv

## Abstract

There is enormous enthusiasm and concerns in using large language models (LLMs) in healthcare, yet current assumptions are all based on general-purpose LLMs such as ChatGPT. This study develops a clinical generative LLM, GatorTronGPT, using 277 billion words of mixed clinical and English text with a GPT-3 architecture of 20 billion parameters. GatorTronGPT improves biomedical natural language processing for medical research. Synthetic NLP models trained using GatorTronGPT generated text outperform NLP models trained using real-world clinical text. Physicians Turing test using 1 (worst) to 9 (best) scale shows that there is no significant difference in linguistic readability (p = 0.22; 6.57 of GatorTronGPT compared with 6.93 of human) and clinical relevance (p = 0.91; 7.0 of GatorTronGPT compared with 6.97 of human) and that physicians cannot differentiate them (p \< 0.001). This study provides insights on the opportunities and challenges of LLMs for medical research and healthcare.

_Abstract reproduced under CC0-1.0 (arXiv descriptive metadata)._

Topics: [LLM Architectures & Pretraining](https://space-kitty.com/topics/llm-architectures)

---
Space Kitty Archive · https://space-kitty.com · API: https://space-kitty.com/api/v1 · MCP: https://space-kitty.com/mcp · Premium: $0.20/request via x402 (Base Sepolia (testnet)). Metadata: arXiv (CC0), OpenAlex (CC0), Europe PMC (CC BY/CC0 works), ClinicalTrials.gov.