Skip to main content

Advertisement

Log in

Deblurring sequential ocular images from multi-spectral imaging (MSI) via mutual information

  • Original Article
  • Published:
Medical & Biological Engineering & Computing Aims and scope Submit manuscript

Abstract

Multi-spectral imaging (MSI) produces a sequence of spectral images to capture the inner structure of different species, which was recently introduced into ocular disease diagnosis. However, the quality of MSI images can be significantly degraded by motion blur caused by the inevitable saccades and exposure time required for maintaining a sufficiently high signal-to-noise ratio. This degradation may confuse an ophthalmologist, reduce the examination quality, or defeat various image analysis algorithms. We propose an early work specially on deblurring sequential MSI images, which is distinguished from many of the current image deblurring techniques by resolving the blur kernel simultaneously for all the images in an MSI sequence. It is accomplished by incorporating several a priori constraints including the sharpness of the latent clear image, the spatial and temporal smoothness of the blur kernel and the similarity between temporally-neighboring images in MSI sequence. Specifically, we model the similarity between MSI images with mutual information considering the different wavelengths used for capturing different images in MSI sequence. The optimization of the proposed approach is based on a multi-scale framework and stepwise optimization strategy. Experimental results from 22 MSI sequences validate that our approach outperforms several state-of-the-art techniques in natural image deblurring.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6

Similar content being viewed by others

References

  1. Dugel PU, Zimmer CN, Shahidi AM (2016) A case study of choroideremia carrier-use of multi-spectral imaging in highlighting clinical features. Retina Today. https://doi.org/10.1016/j.ajoc.2016.04.003

  2. Li S, Huang L, Bai Y et al (2015) In vivo study of retinal transmission function in different sections of the choroidal structure using multispectral imaging. Invest Ophthalmol Vis Sci 56(6):3731. https://doi.org/10.1167/iovs.14-15783

    Article  PubMed  CAS  Google Scholar 

  3. Bhavsar KV, Mukkamala L, Freund KB (2015) Multimodal imaging in a severe case of hydroxychloroquine toxicity. Ophthalmic Surg Lasers 46(3):377–379. https://doi.org/10.3928/23258160-20150323-14

    Article  Google Scholar 

  4. Calcagni A, Gibson JM, Styles I et al (2011) Multispectral retinal image analysis a novel non-invasive tool for retinal imaging. Eye 25(12):1562–1569. https://doi.org/10.1038/eye.2011.202

    Article  PubMed  PubMed Central  CAS  Google Scholar 

  5. Switonski A, Blachowicz T, Zielinski M et al (2011) Ophthalmic diagnosis based on multispectral imaging. Przegld Elektrotechniczny

  6. Everdell N, Styles IB, Calcagni A et al (2010) Multispectral imaging of the ocular fundus using light emitting diode illumination. Rev Sci Instrum 81(9):93706. https://doi.org/10.1063/1.3478001

    Article  CAS  Google Scholar 

  7. Clancy NT, Stoyanov D, James DR et al (2012) Multispectral image alignment using a three channel endoscope in vivo during minimally invasive surgery. Biomed Opt Express 3(10):2567–2578. https://doi.org/10.1364/BOE.3.002567

    Article  PubMed  PubMed Central  Google Scholar 

  8. Campisi P, Egiazarian K (2007) Blind image deconvolution: theory and applications. CRC Press, Boca Raton. https://doi.org/10.1201/9781420007299

    Book  Google Scholar 

  9. Zhuang X, Arridge S, Hawkes DJ et al (2011) A nonrigid registration framework using spatially encoded mutual information and free-form deformations. IEEE Trans Med Imaging 30(10):1819–1828. https://doi.org/10.1109/TMI.2011.2150240

    Article  PubMed  Google Scholar 

  10. Relan D, Ballerini L, Trucco E et al (2016) Retinal vessel classification based on maximization of squared-loss mutual information. Springer, Berlin

    Book  Google Scholar 

  11. Zheng Y, Wang Y, Jiao W et al (2017) Joint alignment of multispectral images via semidefinite programming. Biomed Opt Express 8(2):890–901. https://doi.org/10.1364/BOE.8.000890

    Article  PubMed  PubMed Central  Google Scholar 

  12. Sourati J, Akcakaya M, Dy JG et al (2016) Classification active learning based on mutual information. Entropy 18(2):51. https://doi.org/10.3390/e18020051

    Article  Google Scholar 

  13. Fergus R, Singh B, Hertzmann A et al (2006) Removing camera shake from a single photograph. International Conference on Computer Graphics and Interactive Techniques 25:787–794. https://doi.org/10.1145/1141911.1141956

    Google Scholar 

  14. Vogel CR, Oman ME (1996) Iterative methods for total variation denoising. SIAM J Sci Comput 17 (1):227–238. https://doi.org/10.1137/0917016

    Article  Google Scholar 

  15. Sroubek F, Milanfar P (2012) Robust multichannel blind deconvolution via fast alternating minimization. IEEE Trans Image Process 21(4):1687–1700. https://doi.org/10.1109/TIP.2011.2175740

    Article  PubMed  Google Scholar 

  16. Cho S, Wang J, Lee S (2011) Handling outliers in non-blind image deconvolution. In: International conference on computer vision. https://doi.org/10.1109/ICCV.2011.6126280, pp 495–502

  17. Tay T, Krishnan D, Fergus R (2011) Blind deconvolution using a normalized sparsity measure. In: 2013 IEEE conference on computer vision and pattern recognition, pp 233–240. https://doi.org/10.1109/CVPR.2011.5995521

  18. Wang J, Wang H (2017) A study of 3D model similarity based on surface bipartite graph matching. Eng Comput 34(1):174–188. https://doi.org/10.1108/EC-10-2015-0315

    Article  Google Scholar 

  19. Jing B, Hong L (2016) Multi-objective artificial bee algorithm based on decomposition by PBI method. Appl Intell 45(4):976–991. https://doi.org/10.1007/s10489-016-0787-x

    Article  Google Scholar 

  20. Chunyu H, Hong L, Peng Z (2016) Cooperative co-evolutionary artificial bee colony algorithm based on hierarchical communication model. Chin J Electron 25:570–576. https://doi.org/10.1049/cje.2016.05.025

    Article  Google Scholar 

  21. Song X, Park JH (2017) Linear optimal estimation for discrete-time measurement-delay systems with multi-channel multiplicative noise. IEEE Trans Circuits Systems II: Express Brief 64(2):156–160. https://doi.org/10.1109/TCSII.2016.2551548

    Article  Google Scholar 

Download references

Acknowledgments

The authors would like to thank the National Natural Science Foundation of China (NSFC) (61572300), Natural Science Foundation of Shandong Province in China (ZR2014FM001), Taishan Scholar Program of Shandong Province in China (TSHW201502038), SDUST Excellent Teaching Team Construction Plan (JXTD20160512), and Shandong Province Higher Educational Science & Technology Program (J14LN79).

Disclosures

The authors declare no conflict of interest. The funding sponsors had no role in the design of the study; in the collection, analyses, or interpretation of data; in the writing of the manuscript; and in the decision to publish the results.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Yuanjie Zheng.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Lian, J., Zheng, Y., Jiao, W. et al. Deblurring sequential ocular images from multi-spectral imaging (MSI) via mutual information. Med Biol Eng Comput 56, 1107–1113 (2018). https://doi.org/10.1007/s11517-017-1743-6

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11517-017-1743-6

Keywords

Navigation