Skip to main content

Advertisement

Springer Nature Link
Log in

Quick response barcode deblurring via doubly convolutional neural network

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Various image preprocessing applications for two dimensional (2D) barcode involve reversing the degradation operations (e.g. deblurring). Most of the previously proposed deblurring approaches focus on the construction of suitable deconvolution models, which have shown significant performance at laboratory level. However, the model-based image deblurring solutions might not work well in practical scenarios. To deal with this problem, we propose a convolutional neural network (CNN) based framework to tackle the parameter-free situation for 2D barcode deblurring. The proposed solution leverages the deep learning technique to bridge the gap between traditional model-based methods and requirement of reversing the blurry 2D barcode images. Experiments on practically blurred quick response (QR) barcode images demonstrate that the proposed approach achieves the superior performance in comparison with state-of-the-art model-based image deblurring approaches.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11

Similar content being viewed by others

References

  1. Battiato S (2002) Restoration of out-of-focus images based on circle of confusion estimate. Proceedings of SPIE - The International Society for Optical Engineering 4790(2):408–416

    Google Scholar 

  2. Bengio Y, Lamblin P, Popovici D, Larochelle H et al (2007) Greedy layer-wise training of deep networks. Adv Neural Inf Proces Syst 19:153

    Google Scholar 

  3. Boulanger-Lewandowski N, Bengio Y, Vincent P (2012) Modeling temporal dependencies in high-dimensional sequences: Application to polyphonic music generation and transcription, arXiv preprint arXiv:1206.6392

  4. Chan TF, Wong CK (1998) Total variation blind deconvolution. IEEE Transactions on Image Processing. A Publication of the IEEE Signal Processing Society 7(3):370–375

  5. Choksi R, van Gennip Y, Oberman A (2017) Anisotropic total variation regularized l^1-approximation and denoising/deblurring of 2d bar codes. Inverse Prob Imaging 5(3):591–617

    Article  MathSciNet  Google Scholar 

  6. Chu CH, Yang DN, Pan YL, Chen MS (2011) Stabilization and extraction of 2d barcodes for camera phones. Multimedia Systems 17(2):113–133

    Article  Google Scholar 

  7. Collobert R, Weston J, Bottou L, Karlen M, Kavukcuoglu K, Kuksa P (2011) Natural language processing (almost) from scratch. The Journal of Machine Learning Research 12:2493–2537

    MATH  Google Scholar 

  8. Dahl G, Mohamed A-r, Hinton GE, et al (2010) Phone recognition with the mean-covariance restricted Boltzmann machine, in: Advances in neural information processing systems, pp. 469–477

  9. Dahl GE, Yu D, Deng L, Acero A (2012) Context-dependent pre-trained deep neural networks for large-vocabulary speech recognition. Audio, Speech, and Language Processing, IEEE Transactions on 20(1):30–42

    Article  Google Scholar 

  10. Dan TU, Gan YL, Zong-Qi XU (2007) A real-time deblurring algorithm for the qr barcode images. Computer Engineering & Science 29(3):43–45

    Google Scholar 

  11. Deng L, Seltzer ML, Yu D, Acero A, Mohamed A-R, Hinton GE (2010) Binary coding of speech spectrograms using a deep auto-encoder., in: Interspeech, Citeseer, pp. 1692–1695

  12. Gennip YV, Athavale P, Gilles J, Choksi R (2015) A regularization approach to blind deblurring and denoising of qr barcodes. IEEE Transactions on Image Processing A Publication of the IEEE Signal Processing Society 24(9):2864–2873

    Article  MathSciNet  Google Scholar 

  13. Gregersen E, Code QR (2014) https://www.britannica.com/ technology/QR-Code, [Online; accessed 02-July-2014]

  14. Guo D, Liu R, Wang X, Lan F (2013) QR barcode decoding chip and decoding method thereof. US Patent 8,550,352, 8 October 2013

  15. Hinton GE, Osindero S, Teh Y-W (2006) A fast learning algorithm for deep belief nets. Neural Comput 18(7):1527–1554

    Article  MathSciNet  Google Scholar 

  16. Hsu HH, Chang MH, Yen NY (2012) A health management application with qr code input and rule inference, in: International Conference on Information Security and Intelligence Control, pp. 119–122

  17. Jain V, Seung S (2009) Natural image denoising with convolutional networks, in: Ad-vances in Neural Information Processing Systems, pp. 769–776

  18. Jalobeanu A, Blancferaud L, Zerubia J (2004) An adaptive gaussian model for satellite image deblurring. IEEE Trans Image Process 13(4):613–621

    Article  Google Scholar 

  19. Jia Y, Shelhamer E, Donahue J, Karayev S, Long J, Girshick R, Guadarrama S, Darrell T (2014) Caffe: Convolutional architecture for fast feature embedding, in: Proceedings of the ACM International Conference on Multimedia, ACM,pp. 675–678

  20. Karpathy A, Toderici G, Shetty S, Leung T, Sukthankar R, Fei-Fei L (2014) Large-scale video classification with convolutional neural networks, in: Proceedings of the IEEE conference on Computer Vision and Pattern Recognition, pp. 1725–1732

  21. Kim YG, Woo E (2016) Consumer acceptance of a quick response (qr) code for the food traceability system: Application of an extended technology acceptance model (tam). Food Res Int 85:266–272

    Article  Google Scholar 

  22. Krishnan D, Fergus R (2009) Fast image deconvolution using hyper-laplacian priors. in nips, in: Advances in Neural Information Processing Systems 22: Conference on Neural Information Processing Systems 2009. Proceedings of A Meeting Held 7–10 December 2009, Vancouver, British Columbia, pp. 1033–1041

  23. Krishnan D, Tay T, Fergus R (2011) Blind deconvolution using a normalized sparsity measure, in: Computer Vision and Pattern Recognition, pp. 233–240

  24. Krishnan D, Bruna J, Fergus R. (2013) Blind Deconvolution with Non-local Sparsity Reweighting. arXiv:1311.4029

  25. Krizhevsky A, Sutskever I, Hinton GE (2012) Imagenet classification with deep convolutional neural networks, in: Advances in neural information processing systems, pp. 1097–1105

  26. Kundur D, Hatzinakos D (2002) Blind image deconvolution. IEEE Signal Process Mag 13(3):43–64

    Article  Google Scholar 

  27. LeCun Y, Bottou L, Bengio Y, Haffner P (1998) Gradient-based learning applied to document recognition. Proc IEEE 86(11):2278–2324

    Article  Google Scholar 

  28. Levin A (2006) Blind motion deblurring using image statistics 841–848

  29. Levin A, Weiss Y, Durand F, Freeman WT (2009) Understanding and evaluating blind deconvolution algorithms, in: Computer Vision and Pattern Recognition, 2009. CVPR 2009. IEEE Conference on, pp. 1964–1971

  30. Lin P (2016) Distributed secret sharing approach with cheater prevention based on qrcode. IEEE Transactions on Industrial Informatics 12(1):384–392

    Google Scholar 

  31. Liu Y, Yang J, Liu M (2008) Recognition of qr code with mobile phones, in: Control and Decision Conference, 2008, pp. 203–206Ccdc

  32. Liu N, Zheng X, Sun H, Tan X (2013) Two-dimensional bar code out-of-focus deblurring via the increment constrained least squares filter. Pattern Recogn Lett 34(2):124–130

    Article  Google Scholar 

  33. Long J, Shelhamer E, Darrell T (2015) Fully convolutional networks for semantic segmentation, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 3431–3440

  34. Man M S, Dwivedi A, Sonkar C, Prasad R (2012) A QR Code Based Processing For Dynamic and Transparent Seat Allocation in Indian Railway. International Journal of Computer Science Issues. http://www.ijcsi.org/papers/IJCSI-9-3-1-338-344.pdf

  35. Ouaviani P, Bottazzi B, Caselli G (2002) A common image processing framework for 2d barcode reading 2: 652–655

  36. Pnevmatikakis EA, Soudry D, Gao Y, Machado TA, Merel J, Pfau D, Reardon T, Mu Y, Lacefield C, Yang W (2016) Simultaneous denoising, deconvolution, and demixing of calcium imaging data. Neuron 89(2):285

    Article  Google Scholar 

  37. Prasoon A, Petersen K, Igel C, Lauze F, Dam E, Nielsen M (2013) Deep feature learning for knee cartilage segmentation using a triplanar convolutional neural network, in: Medical Image Computing and Computer-Assisted Intervention–MICCAI 2013, Springer, pp. 246–253

  38. QR Code (2017) https://www.so.com/s?q=%E4%BA%8C%E7%BB%B4%E7%A0%81%E7%94%9F%E6%88%90%E5%99%A8&psid=0d5464aca3162c02017e34ba8e8bd468&src=pdr_guide_2.30&fr=se7_newtab_new

  39. Simonyan K, Zisserman A (2014) Very deep convolutional networks for large-scale image recognition, arXiv preprint arXiv:1409.1556

  40. Simonyan K, Vedaldi A, Zisserman A (2013) Deep inside convolutional networks: Visualising image classification models and saliency maps, arXiv preprint arXiv:1312.6034

  41. Sixou B, Toma A, Denis L, Peyrin F (2017) Iterative choice of the optimal regularization parameter in tv image deconvolution. Inverse Problems & Imaging 9(4):1171–1191

    MATH  Google Scholar 

  42. Socher R, Huval B, Bath B, Manning CD, Ng AY (2012) Convolutional-recursive deep learning for 3d object classification, in: Advances in Neural Information Processing Systems, pp. 665–673

  43. Sörös G, Semmler S, Humair L, Hilliges O (2015) Fast blur removal for wearable qr code scanners. ACM International Symposium on Wearable Computers. ACM, New York, pp 117–124

  44. Stork DG, Gill PR (2014) Reading qr code symbols with an ultra-miniature com-putational diffractive imager, in: Computational Optical Sensing and Imaging

  45. Tai YW, Tan P, Brown MS (2011) Richardson-lucy deblurring for scenes under a projective motion path. IEEE Transactions on Pattern Analysis & Machine Intelligence 33(8):1603–1618

    Article  Google Scholar 

  46. Tarjan L, Enk I, Tegeltija S, Stankovski S, Ostojic G (2014) A readability analysis for qr code application in a traceability system. Computers & Electronics in Agriculture 109(109):1–11

    Article  Google Scholar 

  47. Turaga SC, Murray JF, Jain V, Roth F, Helmstaedter M, Briggman K, Denk W, Seung HS (2010) Convolutional networks can learn to generate affinity graphs for image segmentation. Neural Comput 22(2):511–538

    Article  Google Scholar 

  48. Walsh A (2010) Qr codes: Using mobile phones to deliver library instruction and help at the point of need. Journal of Information Literacy 4(1):55–65

    Article  Google Scholar 

  49. Weston J, Bengio S, Usunier N (2010) Large scale image annotation: learning to rank with joint word-image embeddings. Mach Learn 81(1):21–35

    Article  MathSciNet  Google Scholar 

  50. Zbar bar code reader, https://zbar.sourceforge.net

Download references

Acknowledgements

The authors would like to thank the reviewers and editors. This work was financially supported by the Teaching Reform Research Project of Shandong University of Finance and Economics (2891470), Teaching Reform Research Project of Undergraduate Colleges and Universities of Shandong Province (2015 M136), SDUST Excellent Teaching Team Construction Plan (JXTD20160512) and Jinan campus of SDUST Excellent Teaching Team Construction Plan (JNJXTD201711), SDUST Young Teachers Teaching Talent Training Plan (BJRC20160509), Teaching research project of Shandong University of Science and Technology (JG201509 and qx2013286), Shandong Province Science and Technology Major Project (2015ZDXX0801A02) and National Natural Science Foundation of China (61703243). We would like to appreciate the reviewers and editors for their valuable comments.

Authors Disclosures

The authors declare no conflict of interest. The funding sponsors had no role in the design of the study; in the collection, analyses, or interpretation of data; in the writing of the manuscript, and in the decision to publish the results.

Author information

Authors and Affiliations

  1. Department of Electronic Engineering Information Technology, Shandong University of Sci&Tech, Jinan, 250031, China

    Haitao Pu, Mingqu Fan, Jinliang Yang & Jian Lian

Authors
  1. Haitao Pu
    View author publications

    You can also search for this author inPubMed Google Scholar

  2. Mingqu Fan
    View author publications

    You can also search for this author inPubMed Google Scholar

  3. Jinliang Yang
    View author publications

    You can also search for this author inPubMed Google Scholar

  4. Jian Lian
    View author publications

    You can also search for this author inPubMed Google Scholar

Corresponding author

Correspondence to Jian Lian.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Pu, H., Fan, M., Yang, J. et al. Quick response barcode deblurring via doubly convolutional neural network. Multimed Tools Appl 78, 897–912 (2019). https://doi.org/10.1007/s11042-018-5802-2

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-018-5802-2

Keywords