# Chain-of-Thought Prompting Elicits Reasoning in Large Language Models

Preprint · Wei, Jason, Wang, Xuezhi, Dale Schuurmans, Maarten Bosma, Brian Ichter, Fei Xia, Ed H., Quoc Viet Le, Denny Zhou

- Archive id: arxiv:2201.11903
- Published: 2022-01-28
- arXiv: https://arxiv.org/abs/2201.11903
- Citations: 4,209
- Source URL: http://arxiv.org/abs/2201.11903
- PDF: https://arxiv.org/pdf/2201.11903
- Provenance: openalex+arxiv

## Abstract

We explore how generating a chain of thought -- a series of intermediate reasoning steps -- significantly improves the ability of large language models to perform complex reasoning. In particular, we show how such reasoning abilities emerge naturally in sufficiently large language models via a simple method called chain of thought prompting, where a few chain of thought demonstrations are provided as exemplars in prompting. Experiments on three large language models show that chain of thought prompting improves performance on a range of arithmetic, commonsense, and symbolic reasoning tasks. The empirical gains can be striking. For instance, prompting a 540B-parameter language model with just eight chain of thought exemplars achieves state of the art accuracy on the GSM8K benchmark of math word problems, surpassing even finetuned GPT-3 with a verifier.

_Abstract reproduced under CC0-1.0 (arXiv descriptive metadata)._

Topics: [Reasoning Models & Test-Time Compute](https://space-kitty.com/topics/reasoning-models)

---
Space Kitty Archive · https://space-kitty.com · API: https://space-kitty.com/api/v1 · MCP: https://space-kitty.com/mcp · Premium: $0.20/request via x402 (Base Sepolia (testnet)). Metadata: arXiv (CC0), OpenAlex (CC0), Europe PMC (CC BY/CC0 works), ClinicalTrials.gov.