Classification models are often used to make decisions that affect humans: whether to approve a loan application, extend a job offer, or provide insurance. In such applications, individuals should have the ability to change the decision of the model. When a person is denied a loan by a credit scoring model, for example, they should be able to change the input variables of the model in a way that will guarantee approval. Otherwise, this person will be denied the loan so long as the model is deployed, and -- more importantly -- will lack agency over a decision that affects their livelihood. In this paper, we propose to audit a linear classification model in terms of recourse, which we define as the ability of a person to change the decision of the model through actionable input variables (e.g., income vs. gender, age, or marital status). We present an integer programming toolkit to: (i) measure the feasibility and difficulty of recourse in a target population; and (ii) generate a list of actionable changes for an individual to obtain a desired outcome. We demonstrate how our tools can inform practitioners, policymakers, and consumers by auditing credit scoring models built using real-world datasets. Our results illustrate how recourse can be significantly impacted by common modeling practices, and motivate the need to guarantee recourse as a policy objective for regulation in algorithmic decision-making.
翻译:通常使用分类模式来做出影响人类的决定:是批准贷款申请,提供工作机会,还是提供保险;在这种申请中,个人应有能力改变模式的决定;例如,当一个人因信用评分模式而拒绝贷款时,他们应能够改变模式的投入变量,以保证得到批准;否则,只要采用模式,此人将被拒绝贷款;更重要的是,在影响其生计的决定方面,将缺乏机构;在本文中,我们提议从追索的角度来审计线性分类模式,我们将这种模式界定为一个人通过可操作的投入变量(例如收入相对于性别、年龄或婚姻状况)改变模式决定的能力;我们提出了一个整数方案拟订工具包,以便:(一) 衡量目标人群求助的可行性和困难;以及(二) 制定个人获得理想结果的可操作性变化清单;我们展示我们的工具如何通过审计使用真实世界数据集构建的信用评分模型来告知从业人员、决策者和消费者,我们将其界定为一个人通过可操作的投入变量(例如收入相对于性别、年龄或婚姻状况)改变模式决定的能力;我们提出一个总体规划工具,以便:(一) 衡量目标人口求助的可行性和困难;以及(二) 提出个人获得预期结果。