{"id":"arxiv:2609.31641","kind":"preprint","title":"Product-Aware Deterministic Rounding for Quantized Matrix Multiplication","authors":["Piyush Sao","Narasinga Miniskar","Pedro Valero-Lara","Keita Teranishi","Sudip Seal"],"author_count":5,"year":2026,"published":"2026-09-11","venue":null,"cited_by":null,"doi":null,"arxiv_id":"2609.31641","nct_id":null,"source_url":"https://arxiv.org/abs/2609.31641","archive_url":"https://space-kitty.com/papers/arxiv:2609.31641","updated":"2026-09-11","pmid":null,"pmcid":null,"openalex_id":null,"pdf_url":"https://arxiv.org/pdf/2609.31641","abstract":"Scalar rounding decisions interact through matrix multiplication. We study deterministic product-aware rounding after scales, clipping bounds, and grids are fixed, with each active scalar choosing between adjacent levels. For dynamic activation rounding, null-space reduction preserves the relaxed product while leaving at most $r$ fractional decisions, where $r$ is the rank of the active gap-weighted weight block. Conditional-expectation completion gives a deterministic polynomial-time algorithm with squared product error at most $ \\mathrm{OPT}_{\\mathrm{dyn}}+rν_{\\max}^2/4$, where $\\mathrm{OPT}_{\\mathrm{dyn}}$ is the best admissible error and $ν_{\\max}$ is the largest row norm of that block. For reusable static weights, the exact expected product-loss metric is the uncentered input second moment with fixed output bias; free bias recalibration yields the centered covariance. Exact optimization is NP-hard even at rank one. In balanced blocks with $K=1024$ and $r=16$, conditional- expectation completion attains a dither-normalized median error of $0.010$, compared with $0.899$ for round-to-nearest. Clipping-aware initialization reduces median normalized error by a factor of $43.4$ at ten-percent clipping. Held-out Digits experiments show that retaining the input mean or correcting the output bias improves median product error over round-to-nearest in all four tested bit-width and calibration-size settings.","abstract_license":"CC0-1.0 (arXiv descriptive metadata)","license":null,"is_open_access":false,"retracted":false,"peer_reviewed":false,"categories":["cs.LG","cs.DS","cs.IT"],"details":null,"provenance":"arxiv","attribution":"Abstract: arXiv descriptive metadata (CC0). Thank you to arXiv for use of its open access interoperability. This service was not reviewed or approved by, nor does it necessarily express or reflect the policies or opinions of, arXiv.","topics":[],"cited_in_dossiers":[]}