Realistic image super-resolution (SR) focuses on transforming real-world low-resolution (LR) images into high-resolution (HR) ones, handling more complex degradation patterns than synthetic SR tasks. This is critical for applications like surveillance, medical imaging, and consumer electronics. However, current methods struggle with limited real-world LR-HR data, impacting the learning of basic image features. Pre-trained SR models from large-scale synthetic datasets offer valuable prior knowledge, which can improve generalization, speed up training, and reduce the need for extensive real-world data in realistic SR tasks. In this paper, we introduce a novel approach, Dual-domain Adaptation Networks, which is able to efficiently adapt pre-trained image SR models from simulated to real-world datasets. To achieve this target, we first set up a spatial-domain adaptation strategy through selectively updating parameters of pre-trained models and employing the low-rank adaptation technique to adjust frozen parameters. Recognizing that image super-resolution involves recovering high-frequency components, we further integrate a frequency domain adaptation branch into the adapted model, which combines the spectral data of the input and the spatial-domain backbone's intermediate features to infer HR frequency maps, enhancing the SR result. Experimental evaluations on public realistic image SR benchmarks, including RealSR, D2CRealSR, and DRealSR, demonstrate the superiority of our proposed method over existing state-of-the-art models. Codes are available at: https://github.com/dummerchen/DAN.
翻译:真实图像超分辨率(SR)旨在将现实世界中的低分辨率(LR)图像转换为高分辨率(HR)图像,其处理的退化模式比合成SR任务更为复杂。这对于监控、医学成像和消费电子等应用至关重要。然而,现有方法受限于现实世界LR-HR数据的稀缺,影响了基础图像特征的学习。基于大规模合成数据集预训练的SR模型提供了宝贵的先验知识,可提升泛化能力、加速训练,并减少真实SR任务对大量现实数据的需求。本文提出一种新颖方法——双域自适应网络,能够高效地将预训练图像SR模型从模拟数据集自适应迁移至真实数据集。为实现这一目标,我们首先通过选择性更新预训练模型参数并采用低秩自适应技术调整冻结参数,建立空间域自适应策略。考虑到图像超分辨率涉及高频分量的恢复,我们进一步将频域自适应分支集成到自适应模型中,该分支结合输入图像的频谱数据与空间域骨干网络的中间特征,以推断HR频率图,从而增强SR结果。在包括RealSR、D2CRealSR和DRealSR在内的公开真实图像SR基准测试上的实验评估表明,我们提出的方法优于现有的先进模型。代码发布于:https://github.com/dummerchen/DAN。