This paper proposed a novel method to replace the traditional mouse controller by using Microsoft Kinect Sensor to realize the functional implementation on human-machine interaction. With human hand gestures and movements, Kinect Sensor could accurately recognize the participants intention and transmit our order to desktop or laptop. In addition, the trend in current HCI market is giving the customer more freedom and experiencing feeling by involving human cognitive factors more deeply. Kinect sensor receives the motion cues continuously from the humans intention and feedback the reaction during the experiments. The comparison accuracy between the hand movement and mouse cursor demonstrates the efficiency for the proposed method. In addition, the experimental results on hit rate in the game of Fruit Ninja and Shape Touching proves the real-time ability of the proposed framework. The performance evaluation built up a promise foundation for the further applications in the field of human-machine interaction. The contribution of this work is the expansion on hand gesture perception and early formulation on Mac iPad.
翻译:本文提出了一个新颖的方法,用微软 Kinect 传感器取代传统的鼠标控制器,用微软 Kinect Sensor 实现人体-机械互动的功能性实施。随着人的手势和动作,Kinect Sensor可以准确地识别参与者的意图,并将我们的订单传送到台式或膝上型电脑。此外,目前HCI市场的趋势正在使客户有更多的自由,更深入地参与人类认知因素,从而感受更多的自由。Kinect 传感器不断从人的意图中收到运动提示,并在实验期间反馈反应。手动和鼠标光标之间的比较准确性表明了拟议方法的效率。此外,水果忍者与Shape Touching游戏的点击率实验结果证明了拟议框架的实时能力。业绩评估为进一步应用人类-机器互动领域奠定了一个有希望的基础。这项工作的贡献是扩展手势感和早期配方在Ma iPad上的贡献。