Real-time and high-performance 3D object detection is of critical importance for autonomous driving. Recent top-performing 3D object detectors mainly rely on point-based or 3D voxel-based convolutions, which are both computationally inefficient for onboard deployment. While recent researches focus on point-based or 3D voxel-based convolutions for higher performance, these methods fail to meet latency and power efficiency requirements especially for deployment on embedded devices. In contrast, pillar-based methods use merely 2D convolutions, which consume less computation resources, but they lag far behind their voxel-based counterparts in detection accuracy. However, the superiority of such 3D voxel-based methods over pillar-based methods is still broadly attributed to the effectiveness of 3D convolution neural network (CNN). In this paper, by examining the primary performance gap between pillar- and voxel-based detectors, we develop a real-time and high-performance pillar-based detector, dubbed PillarNet. The proposed PillarNet consists of a powerful encoder network for effective pillar feature learning, a neck network for spatial-semantic feature fusion and the commonly used detect head. Using only 2D convolutions, PillarNet is flexible to an optional pillar size and compatible with classical 2D CNN backbones, such as VGGNet and ResNet. Additionally, PillarNet benefits from our designed orientation-decoupled IoU regression loss along with the IoU-aware prediction branch. Extensive experimental results on large-scale nuScenes Dataset and Waymo Open Dataset demonstrate that the proposed PillarNet performs well over the state-of-the-art 3D detectors in terms of effectiveness and efficiency. Code will be made publicly available.
翻译:实时和高性能 3D 对象探测对于自主驱动至关重要。 最近的高性能 3D 对象探测器主要依赖基于点的或基于3D的三维对象探测器,而这些基于三维对象探测器主要依赖基于点的或基于三维的反oxel的变异,这些变异在计算上对机载部署来说都是效率低下的。 虽然最近的研究侧重于基于点的或基于三维的反共变异,对于提高性能而言,这些方法未能满足潜伏和高功率要求,特别是对于嵌入装置的部署。 相比之下,基于支柱的方法只使用2D 的UD 共性变异器,但是在检测准确性方面远远落后于基于异异异异体的对应方。 然而,基于三维异异异异性基的3D方法优于基于界系方法,这在很大程度上归因于3D 变异性神经元网络的变异能。 在本文中,我们开发了一个实时和高性能的基流检测器探测器。 高级的ICFRONet 网络 运行网络运行网络运行网络运行系统定位和常规变变电路段 运行系统 运行系统系统运行系统运行系统运行系统运行系统运行系统运行系统运行系统运行系统运行系统运行系统运行系统运行系统运行系统运行系统运行系统运行系统运行系统运行系统运行系统运行系统运行系统运行系统运行系统运行系统运行系统运行系统运行系统系统运行系统运行系统运行系统运行系统运行系统运行系统运行系统运行系统运行系统运行系统运行系统运行系统运行系统运行系统运行系统运行系统运行系统。