# SparseGPT: Massive Language Models Can Be Accurately Pruned in One-Shot

Preprint · Elias Frantar, Dan Alistarh

- Archive id: arxiv:2301.00774
- Published: 2023-01-02
- arXiv: https://arxiv.org/abs/2301.00774
- Citations: 131
- Source URL: http://arxiv.org/abs/2301.00774
- PDF: https://arxiv.org/pdf/2301.00774
- Provenance: openalex+arxiv

## Abstract

We show for the first time that large-scale generative pretrained transformer (GPT) family models can be pruned to at least 50% sparsity in one-shot, without any retraining, at minimal loss of accuracy. This is achieved via a new pruning method called SparseGPT, specifically designed to work efficiently and accurately on massive GPT-family models. We can execute SparseGPT on the largest available open-source models, OPT-175B and BLOOM-176B, in under 4.5 hours, and can reach 60% unstructured sparsity with negligible increase in perplexity: remarkably, more than 100 billion weights from these models can be ignored at inference time. SparseGPT generalizes to semi-structured (2:4 and 4:8) patterns, and is compatible with weight quantization approaches. The code is available at: https://github.com/IST-DASLab/sparsegpt.

_Abstract reproduced under CC0-1.0 (arXiv descriptive metadata)._

Topics: [Efficient Training & Inference](https://space-kitty.com/topics/efficient-ai)

Cited in dossiers:
- [Efficient Training & Inference: State of the Field (October 2026)](https://space-kitty.com/dossiers/efficient-ai)

---
Space Kitty Archive · https://space-kitty.com · API: https://space-kitty.com/api/v1 · MCP: https://space-kitty.com/mcp · Premium: $0.20/request via x402 (Base Sepolia (testnet)). Metadata: arXiv (CC0), OpenAlex (CC0), Europe PMC (CC BY/CC0 works), ClinicalTrials.gov.