Score-based generative models based on stochastic differential equations (SDEs) achieve impressive performance in sampling from unknown distributions, but often fail to satisfy underlying constraints. We propose a constrained generative model using kinetic (underdamped) Langevin dynamics with specular reflection of velocity on the boundary defining constraints. This results in piecewise continuously differentiable noising and denoising process where the latter is characterized by a time-reversed dynamics restricted to a domain with boundary due to specular boundary condition. In addition, we also contribute to existing reflected SDEs based constrained generative models, where the stochastic dynamics is restricted through an abstract local time term. By presenting efficient numerical samplers which converge with optimal rate in terms of discretizations step, we provide a comprehensive comparison of models based on confined (specularly reflected kinetic) Langevin diffusion with models based on reflected diffusion with local time.
翻译:基于随机微分方程(SDEs)的分数生成模型在从未知分布中采样方面表现出色,但往往难以满足底层约束条件。我们提出了一种约束生成模型,采用动力学(欠阻尼)朗之万动力学,并在定义约束的边界上对速度进行镜面反射。这导致了一个分段连续可微的加噪和去噪过程,其中去噪过程由于镜面边界条件而被限制在具有边界的域内,其特征由时间反转动力学描述。此外,我们还对现有的基于反射SDEs的约束生成模型做出了贡献,其中随机动力学通过抽象的局部时间项进行限制。通过提出在离散化步长方面以最优速率收敛的高效数值采样器,我们对基于受限(镜面反射动力学)朗之万扩散的模型与基于带局部时间的反射扩散的模型进行了全面比较。