标题: A Single-Frame and Multi-Frame Cascaded Image Super-Resolution Method

作者: Sun, J (Sun, Jing); Yuan, QQ (Yuan, Qiangqiang); Shen, HF (Shen, Huanfeng); Li, J (Li, Jie); Zhang, LP (Zhang, Liangpei)

来源出版物: SENSORS  卷: 24  期: 17  文献号: 5566  DOI: 10.3390/s24175566  Published Date: 2024 SEP  

摘要: The objective of image super-resolution is to reconstruct a high-resolution (HR) image with the prior knowledge from one or several low-resolution (LR) images. However, in the real world, due to the limited complementary information, the performance of both single-frame and multi-frame super-resolution reconstruction degrades rapidly as the magnification increases. In this paper, we propose a novel two-step image super resolution method concatenating multi-frame super-resolution (MFSR) with single-frame super-resolution (SFSR), to progressively upsample images to the desired resolution. The proposed method consisting of an L0-norm constrained reconstruction scheme and an enhanced residual back-projection network, integrating the flexibility of the variational model-based method and the feature learning capacity of the deep learning-based method. To verify the effectiveness of the proposed algorithm, extensive experiments with both simulated and real world sequences were implemented. The experimental results show that the proposed method yields superior performance in both objective and perceptual quality measurements. The average PSNRs of the cascade model in set5 and set14 are 33.413 dB and 29.658 dB respectively, which are 0.76 dB and 0.621 dB more than the baseline method. In addition, the experiment indicates that this cascade model can be robustly applied to different SFSR and MFSR methods.

作者关键词: super-resolution; deep learning; cascade model; resolution enhancement; regularized framework

地址: [Sun, Jing; Shen, Huanfeng] Wuhan Univ, Sch Resource & Environm Sci, Wuhan 430079, Peoples R China.

[Yuan, Qiangqiang; Li, Jie] Wuhan Univ, Sch Geodesy & Geomat, Wuhan 430079, Peoples R China.

[Zhang, Liangpei] Wuhan Univ, State Key Lab Informat Engn Surveying Mapping & Re, Wuhan 430079, Peoples R China.

通讯作者地址: Shen, HF (通讯作者)，Wuhan Univ, Sch Resource & Environm Sci, Wuhan 430079, Peoples R China.

电子邮件地址: rainsunny@hotmail.com; qqyuan@sgg.whu.edu.cn; shenhf@whu.edu.cn; aaronleecool@whu.edu.cn; zlp62@whu.edu.cn

影响因子：3.4