SciVer 共同科学索赔核查任务概述和展望 (Overview and Insights from the SciVer Shared Task on Scientific Claim Verification)

We present an overview of the SciVer shared task, presented at the 2nd Scholarly Document Processing (SDP) workshop at NAACL 2021. In this shared task, systems were provided a scientific claim and a corpus of research abstracts, and asked to identify which articles SUPPORT or REFUTE the claim as well as provide evidentiary sentences justifying those labels. 11 teams made a total of 14 submissions to the shared task leaderboard, leading to an improvement of more than +23 F1 on the primary task evaluation metric. In addition to surveying the participating systems, we provide several insights into modeling approaches to support continued progress and future research on the important and challenging task of scientific claim verification.

翻译：我们概述了SciVer在2021年NAACL第二次学术性文件处理(SDP)讲习班上提出的共同任务。在这项共同任务中,向各系统提供了一份科学主张和一系列研究摘要,要求查明哪些条款支持这项主张,或要求其提供证据判决,以证明这些标签是正确的。 11个小组共向共同任务领导委员会提交了14份材料,从而改进了主要任务评价标准方面超过+23F1。除了调查参与系统外,我们还就模式方法提供了若干见解,以支持在科学索赔核实这一重要和具有挑战性的任务方面继续取得进展和今后开展研究。