融入直觉化交互机理的人机界面全息设计与评价理论研究

项目名称： 融入直觉化交互机理的人机界面全息设计与评价理论研究

项目编号： No.61472314

项目类型： 面上项目

立项/批准年度： 2015

项目学科： 计算机科学学科

项目作者： 李晓玲

作者单位： 西安交通大学

项目金额： 81万元

中文摘要： 舱室的显示与控制系统是操控者和装备间传递信息的重要人机交互界面。随着智能交互技术的出现，通过人机界面传递给操控者的信息量大幅增加，如何全面的探究人体认知特性，设计具有直觉化交互用户体验模式的多通道人机界面将是一个新的发展方向。本申请拟开展面向直觉化交互的多感知通道人机界面设计方法研究，通过神经生理学和认知心理学理论，分析直觉思维特点以及信息加工过程，探索直觉化交互机理与多通道间的响应模式，根据多通道信息融合理论和多色集合理论，对不同属性信号进行提取、表达和整合，构建多通道直觉化人机交互模型。基于以上研究，最终提出一套面向复杂机电装备舱室的多通道人机界面全息设计与评价理论。本项目研究旨在提高操控者面对复杂信息的认知精度和效率，降低认知负荷，为多通道舱室显控界面设计与评价提供理论指导，而且对于提升复杂机电装备舱室的自主研发能力，形成系统配套的高新技术装备体系有着重要意义

中文关键词： 自然人机交互；人工智能；人机界面；人机交互技术；交互模型

英文摘要： The display and control system of cockpit is an important human computer interface between the controller and equipment. With the emergence of intelligent interaction technology, the information transferred between controller and equipment has increased substantially, which necessatres the exploration of the comprehensive human cognitive characteristics. Therefore the design of multimodal human computer interface based on intuitive interaction mechanism becomes a new branch. This study will focus on the design and evaluation of multimodal human computer interface based on intuitive interaction mechanism through the following objectives. Firstly, intuition thinking features and the process of information transfer will be characterized based on neurophysiology and cognitive psychology, and the mapping between the intuitive interaction mechanism and multimodal information are explored. Secondly, based on the theory of Multimodal fusion and Polyehtomatic Sets, different sensory signals from the multimodal information will be extracted and expressed, by now a multimodal intuitive human computer interaction model can be established. Finally, based on the above research, holographic theory of designning and evaluation of multimodal human computer interface is proposed for the complex mechatronic equipment cockpit. This project aims to improve the cognitive accuracy, efficiency and workload of controller when facing complex information, to provide theoretical guidance for the design and evaluation of multimodal human computer interface and to enhance the ability of independent research and development of complex mechatronic equipment cockpit.

英文关键词： Intuitive Interaction;Holographic Theory;Human Computer Interface;Multimodal