AWQ: Activation-aware Weight Quantization for On-Device LLM Compression and Acceleration
Ji Lin, Jiaming Tang, Haotian Tang, Shang Wen Yang, Guangxuan Xiao, Song Han
The abstract is not reproduced here because its license does not permit redistribution. Read it at the original source.
Record
- Archive ID
- doi:10.1145/3714983.3714987
- Published
- Jan 20, 2025
- Venue
- GetMobile Mobile Computing and Communications
- DOI
- 10.1145/3714983.3714987
- Categories
- Advanced Neural Network Applications
- Provenance
- openalex