paper-with-me

Papers

Matrix Multiplication: Verifying Strong Uniquely Solvable Puzzles

2022-12-30 · Matthew Anderson, Zongliang Ji, Anthony Yang Xu

Cohn and Umans proposed a framework for developing fast matrix multiplication algorithms based on the embedding computation in certain groups algebras. In subsequent work with Kleinberg and Szegedy, they connected this to the search for combinatorial objects called strong uniquely solvable puzzles (strong USPs). We begin a systematic computer-aided search for these objects. We develop and implement constraint-based algorithms build on reductions to $\mathrm{SAT}$ and $\mathrm{IP}$ to verify that puzzles are strong USPs, and to search for large strong USPs. We produce tight bounds on the maximum size of a strong USP for width $k \le 5$, construct puzzles of small width that are larger than previous work, and improve the upper bounds on strong USP size for $k \le 12$. Although our work only deals with puzzles of small-constant width, the strong USPs we find imply matrix multiplication algorithms that run in $O(n^\omega)$ time with exponent $\omega \le 2.66$. While our algorithms do not beat the fastest algorithms, our work provides evidence and, perhaps, a path to finding families of strong USPs that imply matrix multiplication algorithms that are more efficient than those currently known.

📄 PDF Abstract BibTeX arXiv:2301.00074

Code (1)

https://bitbucket.org/paraphase/matmult 공식 구현

Similar Papers 제목 키워드 기반

Efficiently-Verifiable Strong Uniquely Solvable Puzzles and Matrix Multiplication

2023-07-12 · Matthew Anderson, Vu Le

We advance the Cohn-Umans framework for developing fast matrix multiplication algorithms. We introduce, analyze, and search for a new subclass of strong uniquely solvable puzzles (SUSP), which we call simplifiable SUSPs.…

Blockbuster, Part 1: Block-level AI Operator Fusion

2025-04-29 · Ofer Dekel

Blockbuster is a framework for AI operator fusion in inference programs. The Blockbuster framework is compatible with any multiprocessor architecture that has a tiered memory hierarchy, including GPUs, multi-core CPUs, a…

Cyclic functional causal models beyond unique solvability with a graph separation theorem

2025-02-06 · Carla Ferradini, Victor Gitton, V. Vilasini

Functional causal models (fCMs) specify functional dependencies between random variables associated to the vertices of a graph. In directed acyclic graphs (DAGs), fCMs are well-understood: a unique probability distributi…

Leveraging ASIC AI Chips for Homomorphic Encryption

2025-01-13 · Jianming Tong, Tianhao Huang, Leo de Castro, Anirudh Itagi 외

Cloud-based services are making the outsourcing of sensitive client data increasingly common. Although homomorphic encryption (HE) offers strong privacy guarantee, it requires substantially more resources than computing …

Universal Matrix Multiplication on Quantum Computer

2024-08-06 · Jiaqi Yao, Tianjian Huang, Ding Liu

As a core underlying operation in pattern recognition and machine learning, matrix multiplication plays a crucial role in modern machine learning models and constitutes a major contributor to computational expenditure. H…