Legal reasoning is a fundamental component of legal analysis and decision-making. Existing computational approaches to legal reasoning predominantly rely on generic reasoning frameworks such as syllogism and IRAC, which do not comprehensively examine the nuanced processes that underpin legal reasoning. Moreover, current research has largely focused on criminal cases, with insufficient modeling for civil cases. In this work, we present a novel framework for explicitly modeling legal reasoning in the analysis of Chinese tort-related civil cases. We first operationalize the legal reasoning processes used in tort analysis into the LawChain framework. LawChain is a three-module reasoning framework, with each module consisting of multiple finer-grained sub-steps. Informed by the LawChain framework, we introduce the task of tort legal reasoning and construct an evaluation benchmark, LawChain$_{eval}$, to systematically assess the critical steps within analytical reasoning chains for tort analysis. Leveraging this benchmark, we evaluate state-of-the-art large language models for their legal reasoning ability in civil tort contexts. Our results indicate that current models still fall short in accurately handling crucial elements of tort legal reasoning. Furthermore, we introduce several baseline approaches that explicitly incorporate LawChain-style reasoning through prompting or post-training. We conduct further experiments on additional legal analysis tasks, such as Legal Named-Entity Recognition and Criminal Damages Calculation, to verify the generalizability of these baselines. The proposed baseline approaches achieve significant improvements in tort-related legal reasoning and generalize well to related legal analysis tasks, thus demonstrating the value of explicitly modeling legal reasoning chains to enhance the reasoning capabilities of language models.
翻译:法律推理是法律分析与决策的基础组成部分。现有的法律推理计算方法主要依赖于三段论和IRAC等通用推理框架,未能全面考察支撑法律推理的细微过程。此外,当前研究主要集中于刑事案件,对民事案件的建模不足。本研究提出了一种新颖框架,用于在中国侵权相关民事案件分析中显式建模法律推理。我们首先将侵权分析中使用的法律推理过程操作化为LawChain框架。LawChain是一个三模块推理框架,每个模块包含多个更细粒度的子步骤。基于LawChain框架,我们引入了侵权法律推理任务,并构建了评估基准LawChain$_{eval}$,以系统评估侵权分析推理链中的关键步骤。利用该基准,我们评估了前沿大语言模型在民事侵权语境下的法律推理能力。结果表明,当前模型在处理侵权法律推理的关键要素方面仍存在不足。此外,我们提出了若干基线方法,通过提示或后训练显式融入LawChain式推理。我们在其他法律分析任务(如法律命名实体识别和刑事损害赔偿计算)上进行了进一步实验,以验证这些基线的泛化能力。所提出的基线方法在侵权相关法律推理中取得了显著改进,并能良好泛化至相关法律分析任务,从而证明了显式建模法律推理链对于增强语言模型推理能力的价值。