Entropic optimal transport problems are regularized versions of optimal transport problems. These models play an increasingly important role in machine learning and generative modelling. For finite spaces, these problems are commonly solved using Sinkhorn algorithm (a.k.a. iterative proportional fitting procedure). However, in more general settings the Sinkhorn iterations are based on nonlinear conditional/conjugate transformations and exact finite-dimensional solutions cannot be computed. This article presents a finite-dimensional recursive formulation of the iterative proportional fitting procedure for general Gaussian multivariate models. As expected, this recursive formulation is closely related to the celebrated Kalman filter and related Riccati matrix difference equations, and it yields algorithms that can be implemented in practical settings without further approximations. We extend this filtering methodology to develop a refined and self-contained convergence analysis of Gaussian Sinkhorn algorithms, including closed form expressions of entropic transport maps and Schrödinger bridges.
翻译:熵最优传输问题是最优传输问题的正则化版本。这些模型在机器学习和生成建模中发挥着日益重要的作用。对于有限空间,这些问题通常使用Sinkhorn算法(亦称迭代比例拟合程序)求解。然而,在更一般的设定中,Sinkhorn迭代基于非线性条件/共轭变换,无法计算精确的有限维解。本文针对一般高斯多元模型,提出了迭代比例拟合程序的有限维递归公式。正如预期,该递归公式与著名的卡尔曼滤波器及相关Riccati矩阵差分方程紧密关联,并产生了可在实际设定中直接实现而无需进一步近似的算法。我们将此滤波方法扩展至高斯Sinkhorn算法的精细化且自洽的收敛性分析,包括熵传输映射与薛定谔桥的闭式表达式。