Reading comprehension is an important ability of human intelligence. Literacy and numeracy are two most essential foundation for people to succeed at study, at work and in life. Reading comprehension ability is a core component of literacy. In most of the education systems, developing reading comprehension ability is compulsory in the curriculum from year one to year 12. It is an indispensable ability in the dissemination of knowledge. With the emerging artificial intelligence, computers start to be able to read and understand like people in some context. They can even read better than human beings for some tasks, but have little clue in other tasks. It will be very beneficial if we can identify the levels of machine comprehension ability, which will direct us on the further improvement. Turing test is a well-known test of the difference between computer intelligence and human intelligence. In order to be able to compare the difference between people reading and machines reading, we proposed a test called (reading) Comprehension Ability Test (CAT).CAT is similar to Turing test, passing of which means we cannot differentiate people from algorithms in term of their comprehension ability. CAT has multiple levels showing the different abilities in reading comprehension, from identifying basic facts, performing inference, to understanding the intent and sentiment.
翻译:阅读和识数是人们在学习、工作和生活中取得成功的两个最基本的基础。阅读和识数是识字的核心组成部分。在大多数教育系统中,培养阅读理解能力是一至十二年级必修的课程。在大多数教育系统中,培养阅读能力是一至十二年级必修的课程。在传播知识方面,这是不可或缺的能力。随着新兴的人工智能的出现,计算机开始能够像人一样在某种情况下阅读和理解。计算机在某些任务中甚至可以比人更能阅读和理解,但在其他任务中却没有什么线索。如果我们能够确定机器理解能力的水平,从而指导我们进一步改进,那将非常有益。图灵测试是众所周知的计算机智能和人类智能之间差异的测试。为了能够比较人们阅读和机器阅读之间的差异,我们提议了一种叫作(阅读)理解能力测试(CAT)的测试。CAT与Turing测试相似,通过测试意味着我们不能在理解能力方面区分人和算法。CAT具有多种程度的阅读能力,从查明基本事实、判断、理解、理解意向和理解感知。