Loading [a11y]/accessibility-menu.js
DTDeMo: A Deep Learning-Based Two-Stage Image Demosaicing Model With Interpolation and Enhancement | IEEE Journals & Magazine | IEEE Xplore

DTDeMo: A Deep Learning-Based Two-Stage Image Demosaicing Model With Interpolation and Enhancement


Abstract:

Image demosaicing is one of the most ubiquitous and performance-critical image processing tasks. However, traditional demosaicing methods use fixed weights to finish the ...Show More

Abstract:

Image demosaicing is one of the most ubiquitous and performance-critical image processing tasks. However, traditional demosaicing methods use fixed weights to finish the interpolation, while deep learning demosaicing restoration always breaks the image array arrangement rule, and they can't fully use the existing pixel information. To rectify these weaknesses, in this paper, we propose the convolution interpolation block (CIB) to obey the RAW data arrangement rule and the deep demosaicing residual block (DDRB) to repeatedly utilize existing pixel information for demosaicing. Based on the CIB and DDRB, we present a novel two-stage demosaicing model (DTDeMo), including differential interpolation and enhancement processes. Specifically, the interpolation process contains several CIBs and DDRBs with trainable interpolation parameters. Meanwhile, the enhancement process consists of a transformer-based block and a series of DDRBs to enhance the interpolation results. The effectiveness of CIBs, DDRBs, the proposed interpolation process, and the enhancement process is confirmed through an ablation study. A thorough comparison with several methods shows that our DTDeMo outperforms state of the art quantitatively and qualitatively.
Published in: IEEE Transactions on Computational Imaging ( Volume: 10)
Page(s): 1026 - 1039
Date of Publication: 10 July 2024

ISSN Information:

Funding Agency:


References

References is not available for this document.