Video quality assessment is a challenging problem having a critical significance in the context of medical imaging. For instance, in laparoscopic surgery, the acquired video data suffers from different kinds of distortion that not only hinder surgery performance but also affect the execution of subsequent tasks in surgical navigation and robotic surgeries. For this reason, we propose in this paper neural network-based approaches for distortion classification as well as quality prediction. More precisely, a Residual Network (ResNet) based approach is firstly developed for simultaneous ranking and classification task. Then, this architecture is extended to make it appropriate for the quality prediction task by using an additional Fully Connected Neural Network (FCNN). To train the overall architecture (ResNet and FCNN models), transfer learning and end-to-end learning approaches are investigated. Experimental results, carried out on a new laparoscopic video quality database, have shown the efficiency of the proposed methods compared to recent conventional and deep learning based approaches.
翻译:视频质量评估是一个具有挑战性的问题,在医学成像方面具有至关重要的意义。例如,在腹腔外科手术中,获得的视频数据受到各种扭曲,不仅阻碍手术的性能,而且影响手术导航和机器人手术中随后执行任务的执行。因此,我们在本论文中提出以神经网络为基础的扭曲分类和质量预测方法。更确切地说,基于残余网络(ResNet)的方法首先为同时的排序和分类任务开发。然后,这一结构扩大,通过使用额外的全连通神经网络(FCNN),使质量预测任务适合质量预测任务。培训总体结构(ResNet和FCNN模型)、转移学习和端到端学习方法,对实验结果进行了调查,在新的腹腔图像质量数据库中进行的实验结果显示了拟议方法与最近的常规和深层学习方法相比的效率。