The Schrödinger bridge (SB) has evolved into a universal class of probabilistic generative models. In practice, however, estimated learning signals are innately uncertain, and the reliability promised by existing methods is often based on speculative optimal case scenarios. Recent studies regarding the Sinkhorn algorithm through mirror descent (MD) have gained attention, revealing geometric insights into solution acquisition of the SB problems. In this paper, we propose a variational online MD (OMD) framework for the SB problems, which provides further stability to SB solvers. We formally prove convergence and a regret bound for the novel OMD formulation of SB acquisition. As a result, we propose a simulation-free SB algorithm called Variational Mirrored Schrödinger Bridge (VMSB) by utilizing the Wasserstein-Fisher-Rao geometry of the Gaussian mixture parameterization for Schrödinger potentials. Based on the Wasserstein gradient flow theory, the algorithm offers tractable learning dynamics that precisely approximate each OMD step. In experiments, we validate the performance of the proposed VMSB algorithm across an extensive suite of benchmarks. VMSB consistently outperforms contemporary SB solvers on a wide range of SB problems, demonstrating the robustness as well as generality predicted by our OMD theory.
翻译:薛定谔桥已发展为一类通用的概率生成模型。然而在实践中,估计的学习信号本质上是具有不确定性的,现有方法所承诺的可靠性往往基于推测性的最优情况假设。近期关于通过镜像下降实现Sinkhorn算法的研究备受关注,揭示了获取薛定谔桥问题解的几何洞察。本文针对薛定谔桥问题提出了一种变分在线镜像下降框架,该框架为薛定谔桥求解器提供了更强的稳定性。我们严格证明了这种新颖的薛定谔桥获取问题的在线镜像下降表述的收敛性及遗憾界。基于此,我们通过利用高斯混合参数化薛定谔势的Wasserstein-Fisher-Rao几何,提出了一种无模拟的薛定谔桥算法——变分镜像薛定谔桥。该算法基于Wasserstein梯度流理论,提供了可处理的学习动态,能够精确逼近每个在线镜像下降步骤。在实验中,我们在广泛的基准测试集上验证了所提VMSB算法的性能。VMSB在各类薛定谔桥问题上持续超越当代薛定谔桥求解器,展现了我们在线镜像下降理论所预测的鲁棒性与普适性。