In performative prediction, predictions guide decision-making and hence can influence the distribution of future data. To date, work on performative prediction has focused on finding performatively stable models, which are the fixed points of repeated retraining. However, stable solutions can be far from optimal when evaluated in terms of the performative risk, the loss experienced by the decision maker when deploying a model. In this paper, we shift attention beyond performative stability and focus on optimizing the performative risk directly. We identify a natural set of properties of the loss function and model-induced distribution shift under which the performative risk is convex, a property which does not follow from convexity of the loss alone. Furthermore, we develop algorithms that leverage our structural assumptions to optimize the performative risk with better sample efficiency than generic methods for derivative-free convex optimization.
翻译:实绩预测、预测可以指导决策,从而影响未来数据的分布。到目前为止,实绩预测工作的重点是寻找性能稳定的模型,这些模型是反复再培训的固定点。然而,如果从性能风险、决策者在部署模型时所经历的损失来评估,稳定的解决办法可能远非最佳。在本文中,我们把注意力转移到性能稳定性之外,并侧重于直接优化性能风险。我们确定了损失函数的自然属性和模型引起的分配变化,在这种变化下,性能风险是锥体的,这种属性并非仅从损失的共性出发。此外,我们开发了各种算法,利用我们的结构性假设,以比无衍生物锥体优化的通用方法更高效的样本优化性能风险。