Deep learning has thrived by training on large-scale datasets. However, for continual learning in applications such as robotics, it is critical to incrementally update its model in a sample efficient manner. We propose a novel method that constructs the new class weights from few labelled samples in the support set without back-propagation, relying on our adaptive masked proxies approach. It utilizes multi-resolution average pooling on the output embeddings masked with the label to act as a positive proxy for the new class, while fusing it with the previously learned class signatures. Our proposed method is evaluated on PASCAL-$5^i$ dataset and outperforms the state of the art in the 5-shot semantic segmentation. Unlike previous methods, our proposed approach does not require a second branch to estimate parameters or prototypes, which enables it to be used with 2-stream motion and appearance based segmentation networks. The proposed adaptive proxies allow the method to be used with a continuous data stream. Our online adaptation scheme is evaluated on the DAVIS and FBMS video object segmentation benchmark. We further propose a novel setup for evaluating continual learning of object segmentation which we name incremental PASCAL (iPASCAL) where our method has shown to outperform the baseline method. Code is publicly available at https://github.com/MSiam/AdaptiveMaskedProxies.
翻译:深层学习因大规模数据集培训而蓬勃发展。然而,对于在机器人等应用中不断学习而言,关键是要以抽样效率的方式逐步更新模型。我们提出了一个新颖的方法,根据我们适应性化的遮盖式替代物方法,从未反向调整的辅助器中,从少数贴标签样本中构建新的类权重,不进行反反向调整,依靠的是我们的适应性掩蔽式替代物方法。它使用以标签遮盖的输出嵌入中多分辨率平均集合,以作为新类的积极代谢,同时与先前学习过的类符号签名连接在一起。我们的拟议方法是用PASACAL-5$5 美元的数据设置,并超越了5发式语义分割法的艺术状态。与以前的方法不同,我们的拟议方法不需要第二个分支来估算参数或原型,从而使其能够与2流运动和外观基于分解的分解网络一起使用。拟议的适应性能允许在连续数据流中使用该方法。我们的在线适应计划是在DAVIS和FBMS视频对象分解基准基准中进行评估,我们进一步提议在5发式ASA/MAS格式上显示我们用于不断学习的递模标准。