OpenTensor: Reproducing Faster Matrix Multiplication Discovering Algorithms

Yiwen Sun, Wenye Li

Preprint: not peer reviewed. Results may change in later versions.

Abstract

OpenTensor is a reproduction of AlphaTensor, which discovered a new algorithm that outperforms the state-of-the-art methods for matrix multiplication by Deep Reinforcement Learning (DRL). While AlphaTensor provides a promising framework for solving scientific problems, it is really hard to reproduce due to the massive tricks and lack of source codes. In this paper, we clean up the algorithm pipeline, clarify the technical details, and make some improvements to the training process. Computational results show that OpenTensor can successfully find efficient matrix multiplication algorithms.

Abstract: arXiv descriptive metadata (CC0). Thank you to arXiv for use of its open access interoperability. This service was not reviewed or approved by, nor does it necessarily express or reflect the policies or opinions of, arXiv.

Record

Archive ID
arxiv:2405.20748
Published
May 31, 2024
arXiv
2405.20748
Categories
cs.AI, cs.DS, cs.LG
Provenance
arxiv