The emergence of the single-chip polarized color sensor now allows for simultaneously capturing chromatic and polarimetric information of the scene on a monochromatic image plane. However, unlike the usual camera with an embedded demosaicing method, the latest polarized color camera is not delivered with an in-built demosaicing tool. For demosaicing, the users have to down-sample the captured images or to use traditional interpolation techniques. Neither of them can perform well since the polarization and color are interdependent. Therefore, joint chromatic and polarimetric demosaicing is the key to obtaining high-quality polarized color images. In this paper, we propose a joint chromatic and polarimetric demosaicing model to address this challenging problem. Instead of mechanically demosaicing for the multi-channel polarized color image, we further present a sparse representation-based optimization strategy that utilizes chromatic information and polarimetric information to jointly optimize the model. To avoid the interaction between color and polarization during demosaicing, we separately construct the corresponding dictionaries. We also build an optical data acquisition system to collect a dataset, which contains various sources of polarization, such as illumination, reflectance and birefringence. Results of both qualitative and quantitative experiments have shown that our method is capable of faithfully recovering full RGB information of four polarization angles for each pixel from a single mosaic input image. Moreover, the proposed method can perform well not only on the synthetic data but the real captured data.
翻译:单芯片极化色传感器的出现使得现在能够同时在单色图像平面上捕捉到场景的色和极度信息。 但是,与通常的带有嵌入式分解法的摄像头不同, 最新的极极化彩色摄像头不是用内嵌式分解工具提供的。 用于分解的图像, 用户必须低调取样, 或者使用传统的分解技术。 由于两极化和颜色是相互依存的, 它们都无法同时同时捕捉到色和极度分解信息。 因此, 共制色和极度分解是获得高品质极化的彩色图像的关键。 在本文中,我们建议采用一种合制色和极化的彩色和极化模型, 而不是用机械化式的分解色化工具提供最新分解的彩色和极化模型, 我们从每部的两极化角度建立一种真实的双极化和两极化的双极化数据采集方法, 我们用一种正态的双极化方法, 来分析一种双极化的双极化数据, 两种方法, 来反映一种正态的两极化数据, 。