As artificial intelligence increasingly influences our world, it becomes crucial to assess its technical progress and societal impact. This paper surveys problems and opportunities in the measurement of AI systems and their impact, based on a workshop held at Stanford University in the fall of 2019. We identify six summary challenges inherent to measuring the progress and impact of AI, and summarize over 40 presentations and associated discussions from the workshop. We hope this can inspire research agendas in this crucial area.
翻译:由于人工智能日益影响我们的世界,评估其技术进步和社会影响变得至关重要。本文件根据2019年秋季斯坦福大学举办的讲习班,对测量AI系统及其影响方面的问题和机会进行了调查。我们确定了衡量AI的进展和影响所固有的六项挑战,总结了讲习班的40多场介绍和相关讨论。我们希望这能够激发这一关键领域的研究议程。