Improved resolution from subpixel shifted pictures

doi:10.1016/1049-9652(92)90065-6

CVGIP: Graphical Models and Image Processing

Volume 54, Issue 2, March 1992, Pages 181-186

CVGIP: Graphical Mod...

https://doi.org/10.1016/1049-9652(92)90065-6 Get rights and content

Abstract

In this paper we consider the problem of obtaining a picture with improved resolution from an ensemble of K spatially shifted low-resolution pictures. We show that it can be done and provide a procedure for its implementations. The framework and scheme utilized in the generalized multichannel sampling theorem of Papoulis and Brown was found to be an appropriate representation for our problem. The linear channels of this scheme correspond to the processes that produce the low-resolution pictures (by blur and shifts) and to the process of reconstruction. The total process is shown to consist of two distinct degradation-restoration pairs: blurring-deblurring and undersampling-merging. This paper discusses merging. Deblurring (deconvolution) can be done by any desired scheme independent of merging. It is shown that the procedure achieves the claims of super resolution schemes but, unlike many of them, is well posed and robust. This procedure holds for a selected ensemble so that K is not too large and no two of the pictures practially coincide. The number of multiplications per pixel of the improved picture can be reduced to O(K²).

References (13)

S Peleg et al.
Improving image resolution using subpixel offsets
Pattern Recognit. Lett.
(1987)
J.L Brown
Multi-channel sampling of low-pass signals
IEEE Trans. Circuit Syst.
(1981)
H Freeman
D Gross
Super-Resolution from Subpixel Sifted Pictures
M.Sc. Thesis
(Oct. 1986)
D. Gross and H. Ur, FIR inverse filters for deconvolution of pictures, to be...
W Lukosz
Optical systems with resolving power exceeding the classical limit
J. Opt. Soc. Am.
(1966)

There are more references available in the full text version of this article.

Cited by (290)

An efficient image super resolution model with dense skip connections between complex filter structures in Generative Adversarial Networks
2021, Expert Systems with Applications
Generative Adversarial Network (GAN) based models have gained a lot of popularity due to their outstanding performance in image super resolution tasks. However, these networks have few inherent problems; such as, high computational complexity, large depth and vanishing gradient. Present work proposes a novel GAN based architecture, namely, Super Resolution with Inception Network (SRINet) to solve the above mentioned problems. Generator architecture of SRINet uses complex filter structure rather than the linear filter structure to increase the depth and width of network without increasing the computational cost. Complex filter settings, present in the architecture, helps it to attain locally distributed information along with hierarchical global information in an image. Hence, the proposed method approximates the most favorable sparse structures to foster the learning capability of network. Additionally, progressive two stage upscaling approach with dense skip connections are introduced in the generator architecture. This technique helps the proposed network to learn precise mapping to generate an output image from the low resolution image. To measure visual quality of an image, we use human visual system based visual information fidelity metric. Proposed method outperforms all the state-of-the-art methods qualitatively (perceptually) and quantitatively on other GAN based methods.
Multi-frame super-resolution reconstruction based on mixed Poisson–Gaussian noise
2020, Signal Processing: Image Communication
In this paper, a non-blind multi-frame super-resolution (SR) model based on mixed Poisson–Gaussian noise (MPGSR) is proposed. Poisson noise arises from the stochastic nature of the photon-counting process. Readout noise and reset noise inherent to the readout circuitry can be modeled by an additive Gaussian noise. Therefore, a mixed Poisson–Gaussian noise model is more appropriate for real imaging system. Instead of deriving the data fidelity term from the perspective of error norms and the corresponding influence functions, we address the multi-frame SR problem based on a statistical noise model. The derived objective function is decomposed into sub-functions and solved by the alternating direction method of multipliers (ADMM) algorithm which allows using techniques of constrained optimization. The validation of the proposed MPGSR was performed quantitatively and qualitatively on natural and X-ray images. In comparison to the optimization-based and learning-based state-of-the-art methods, we have demonstrated the feasibility of MPGSR and the significance of applying a more appropriate noise model on the SR image reconstruction.
Super Resolution Dual-Energy Cone-Beam CT Imaging with Dual-Layer Flat-Panel Detector
2024, IEEE Transactions on Medical Imaging
Computational Imaging and Artificial Intelligence: The Next Revolution of Mobile Vision
2023, Proceedings of the IEEE
Real-timing processing of fiber bundle endomicroscopy images in Python using PyFibreBundle
2023, Applied Optics
Roadmap on Label-Free Super-Resolution Imaging
2023, Laser and Photonics Reviews

View all citing articles on Scopus

View full text

NoteImproved resolution from subpixel shifted pictures

Abstract

Pattern Recognit. Lett.

Multi-channel sampling of low-pass signals

IEEE Trans. Circuit Syst.

Super-Resolution from Subpixel Sifted Pictures

M.Sc. Thesis

Optical systems with resolving power exceeding the classical limit

J. Opt. Soc. Am.

Note
Improved resolution from subpixel shifted pictures