# Unified Stochastic Framework for Neural Network Quantization and Pruning

Preprint · Haoyu Zhang, Rayan Saab

- Archive id: arxiv:2412.18184
- Published: 2024-12-24
- arXiv: https://arxiv.org/abs/2412.18184
- Source URL: https://arxiv.org/abs/2412.18184
- PDF: https://arxiv.org/pdf/2412.18184
- Provenance: arxiv

## Abstract

Quantization and pruning are two essential techniques for compressing neural networks, yet they are often treated independently, with limited theoretical analysis connecting them. This paper introduces a unified framework for post-training quantization and pruning using stochastic path-following algorithms. Our approach builds on the Stochastic Path Following Quantization (SPFQ) method, extending its applicability to pruning and low-bit quantization, including challenging 1-bit regimes. By incorporating a scaling parameter and generalizing the stochastic operator, the proposed method achieves robust error correction and yields rigorous theoretical error bounds for both quantization and pruning as well as their combination.

_Abstract reproduced under CC0-1.0 (arXiv descriptive metadata)._

---
Space Kitty Archive · https://space-kitty.com · API: https://space-kitty.com/api/v1 · MCP: https://space-kitty.com/mcp · Premium: $0.20/request via x402 (Base Sepolia (testnet)). Metadata: arXiv (CC0), OpenAlex (CC0), Europe PMC (CC BY/CC0 works), ClinicalTrials.gov.