Machine learning (ML) is actively finding its way into modern cyber-physical systems (CPS), many of which are safety-critical real-time systems. It is well known that ML outputs are not reliable when testing data are novel with regards to model training and validation data, i.e., out-of-distribution (OOD) test data. We implement an unsupervised deep neural network-based OOD detector on a real-time embedded autonomous Duckiebot and evaluate detection performance. Our OOD detector produces a success rate of 87.5% for emergency stopping a Duckiebot on a braking test bed we designed. We also provide case analysis on computing resource challenges specific to the Robot Operating System (ROS) middleware on the Duckiebot.
翻译:机器学习(ML)正在积极探索进入现代网络物理系统(CPS)的途径,其中许多系统是安全的临界实时系统。众所周知,当测试数据在模型培训和验证数据(即分配外(OOD)测试数据)方面是新颖的时,ML产出就不可靠。我们在实时嵌入的自主Duckiebot上安装了无监督的深神经网络OOD探测器,并评价探测性能。我们的OOD探测器产生了87.5%的成功率,用于紧急阻止一个Duckiebot人坐在我们设计的制动式试验床上。我们还提供了Duckiebot机器人操作系统(ROS)中间软件特有的计算资源挑战的案例分析。