One of the most common, but at the same time expensive operations in linear algebra, is multiplying two matrices $A$ and $B$. With the rapid development of machine learning and increases in data volume, performing fast matrix intensive multiplications has become a major hurdle. Two different approaches to overcoming this issue are, 1) to approximate the product; and 2) to perform the multiplication distributively. A \textit{$CR$-multiplication} is an approximation where columns and rows of $A$ and $B$ are respectively sampled with replacement. In the distributed setting, multiple workers perform matrix multiplication subtasks in parallel. Some of the workers may be stragglers, meaning they do not complete their task in time. We present a novel \textit{approximate weighted $CR$ coded matrix multiplication} scheme, that achieves improved performance for distributed matrix multiplication.
翻译:最常见的一个是,但同时也是昂贵的线性代数操作之一,正在乘以两个矩阵,即A美元和B美元。随着机器学习的迅速发展以及数据量的增加,快速矩阵密集乘法已成为一个主要障碍。克服这一问题的两种不同办法是:(1) 接近产品;(2) 进行乘法分配。\ textit{$CR$乘法}是一个近似,用替换对列和行分别进行美元和B美元的抽样。在分布式设置中,多个工人同时执行矩阵乘法子。有些工人可能是累加工,意思是他们没有及时完成任务。我们提出了一个新颖的\ textit{ap might sight $CR$编码矩阵乘法计划,它提高了分布式矩阵乘法的性能。