Skip to main content
SpringerLink
Log in

Multi-scale recursive codec network with authority parameters (MRCN-AP) for RFID multi-label deblurring

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

The dynamic non-uniform blur caused by Radio Frequency Identification (RFID) multi-label motion seriously affects the identification and location of labels. It is an ill-posed inverse problem for that the blur kernel and sharp image are unknown. The traditional method of removing the blur is very time-consuming. In this work, we propose Multi-scale Recursive Codec Network based on the Authority Parameter (MRCN-AP) to deblur RFID multi-label images in a vision-based RFID multi-label 3D measurement system. This network is composed of a stack of three encoder-decoder subnets of different scales, which restores the blurry image in an end-to-end manner, and extracts the detail edge on each scale effectively from coarse to fine. The proposed authority parameters reduce the parameters memory of redundant networks and improve the speed of the deblurring network. Also, we propose new large-scale RFID multi-label blur-sharp image pairs captured by the dual CCD camera. The proposed model is implemented on an extended dataset. We prove that our method improves the speed by at least 0.55 s, and also increases Peak Signal to Noise Ratio (PSNR) by 2.43dB. Besides, better visual effects are obtained by MRCN-AP deblurring network for RFID multi-label image, which is more conducive to subsequent positioning and optimization.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13

Similar content being viewed by others

References

  1. Atzori L, Iera A, Morabito G (2010) The internet of things: a survey. Comput Netw 54(15):2787–2805

    Article  Google Scholar 

  2. Bahat Y, Efrat N, Irani M (2017) Non-uniform blind deblurring by reblurring. In: Proceedings of the IEEE international conference on computer vision, pp 3286–3294. https://doi.org/10.1109/ICCV.2017.356

  3. Benvenuto F, Zanella R, Zanni L, Bertero M (2009) Nonnegative least-squares image deblurring: improved gradient projection approaches. Inverse Probl 26(2):025004. https://doi.org/10.1088/0266-5611/26/2/025004

    Article  MathSciNet  MATH  Google Scholar 

  4. Cai J, Zuo W, Zhang L (2019) Extreme channel prior embedded network for dynamic scene deblurring. arXiv:1903.00763

  5. Carasso A S (1999) Linear and nonlinear image deblurring: a documented study. SIAM J Numer Anal 36(6):1659–1689. https://doi.org/10.1137/S0036142997320413

    Article  MathSciNet  Google Scholar 

  6. Deng X, Shen Y, Song M, Tao D, Bu J, Chen C (2012) Video-based non-uniform object motion blur estimation and deblurring. Neurocomputing 86:170–178. https://doi.org/10.1016/j.neucom.2012.01.017

    Article  Google Scholar 

  7. Dosovitskiy A, Fischer P, Ilg E, Hausser P, Hazirbas C, Golkov V, Van Der Smagt P, Cremers D, Brox T (2015) Flownet: Learning optical flow with convolutional networks. In: Proceedings of the IEEE international conference on computer vision, pp 2758–2766. https://doi.org/10.1109/ICCV.2015.316

  8. Dong W, Zhang L, Shi G, Wu X (2011) Image deblurring and super-resolution by adaptive sparse domain selection and adaptive regularization. IEEE Trans Image Process 20(7):1838–1857. https://doi.org/10.1109/TIP.2011.2108306

    Article  MathSciNet  Google Scholar 

  9. Fan Y, Liang Q (2018) An improved method for detection of the pedestrian flow based on rfid. Multimed Tools Appl 77:11425–11438. https://doi.org/10.1007/s11042-017-5303-8

    Article  Google Scholar 

  10. Fan G F, Guo Y H, Zheng J M, Hong W C (2020) A generalized regression model based on hybrid empirical mode decomposition and support vector regression with back-propagation neural network for mid-short-term load forecasting. J Forecasting 39(5):737–756. https://doi.org/10.1002/for.2655

    Article  MathSciNet  Google Scholar 

  11. Fan G F, Peng L L, Hong W C, Sun F (2016) Electric load forecasting by the SVR model with differential empirical mode decomposition and auto regression. Neurocomputing 173:958–970. https://doi.org/10.1016/j.neucom.2015.08.051

    Article  Google Scholar 

  12. Fan G F, Wei X, Li Y T, Hong W C (2020) Forecasting electricity consumption using a novel hybrid model. Sustainable Cities and Society 61:102320. https://doi.org/10.1016/j.scs.2020.102320

    Article  Google Scholar 

  13. Fan G F, Qing S, Wang H, Hong W C, Li H J (2013) Support vector regression model based on empirical mode decomposition and auto regression for electric load forecasting. Energies 6(4):1887–1901. https://doi.org/10.3390/en6041887

    Article  Google Scholar 

  14. Gong D, Yang J, Liu L, Zhang Y, Reid I, Shen C, Van Den Hengel A, Shi Q (2017) From motion blur to motion flow: a deep learning solution for removing heterogeneous motion blur. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 2319–2328. https://doi.org/10.1109/CVPR.2017.405

  15. Hong W C, Fan G F (2019) Hybrid empirical mode decomposition with support vector regression model for short term load forecasting. Energies 12(6):1093. https://doi.org/10.3390/en12061093

    Article  Google Scholar 

  16. Hyun Kim T, Mu Lee K (2014) Segmentation-free dynamic scene deblurring. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 2766–2773. https://doi.org/10.1109/CVPR.2014.348

  17. Hyun Kim T, Ahn B, Mu Lee K (2013) Dynamic scene deblurring. In: Proceedings of the IEEE international conference on computer vision, pp 3160–3167. https://doi.org/10.1109/ICCV.2013.392

  18. Joshi N, Kang S B, Zitnick C L, Szeliski R (2010) Image deblurring using inertial measurement sensors. In: ACM Trans Graph, vol 29. ACM, p 30. https://doi.org/10.1145/1833351.1778767

  19. Khan M K, Zhang J (2008) Multimodal face and fingerprint biometrics authentication on space-limited tokens. Neurocomputing 71 (13-15):3026–3031

    Article  Google Scholar 

  20. Köhler R, Hirsch M, Mohler B, Schölkopf B, Harmeling S (2012) Recording and playback of camera shake: Benchmarking blind deconvolution with a real-world database. In: European conference on computer vision. Springer, pp 27–40. https://doi.org/10.1007/978-3-642-33786-4_3

  21. Lee D, Park H, Kyu Park I, Mu Lee K (2018) Joint blind motion deblurring and depth estimation of light field. In: Proceedings of the European Conference on Computer Vision (ECCV), pp 288–303. https://doi.org/10.1007/978-3-030-01270-0_18

  22. Li M, Chen Y, Zhang Y, Yang J, Du H (2019) Fusing rfid and computer vision for occlusion-aware object identifying and tracking. In: International conference on wireless algorithms, systems, and applications. Springer, pp 175–187, DOI https://doi.org/10.1007/978-3-030-23597-0_14, (to appear in print)

  23. Li L, Yu X, Jin Z, Zhao Z, Zhuang X, Liu Z (2019) Fdncnn-based image denoising for multi-label localization measurement. Measurement: 107367. https://doi.org/10.1016/j.measurement.2019.107367

  24. Liu R, He Y, Cheng S, Fan X, Luo Z (2018) Learning collaborative generation correction modules for blind image deblurring and beyond. arXiv:1807.11706

  25. Li L, Pan J, Lai W S, Gao C, Sang N, Yang M H (2018) Learning a discriminative prior for blind image deblurring. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 6616–6625. https://doi.org/10.1109/CVPR.2018.00692

  26. Li M W, Geng J, Hong W C, Zhang L D (2019) Periodogram estimation based on lssvr-ccpso compensation for forecasting ship motion. Nonlinear Dynamics (5). https://doi.org/10.1007/s11071-019-05149-5

  27. Mao X, Shen C, Yang Y B (2016) Image restoration using very deep convolutional encoder-decoder networks with symmetric skip connections. In: Advances in neural information processing systems, pp 2802–2810

  28. Mei J, Wu Z, Chen X, Qiao Y, Jiang X (2019) Deepdeblur: text image recovery from blur to sharp. Multimed Tools Appl 78(2). https://doi.org/10.1007/s11042-019-7251-y

  29. Nah S, Hyun Kim T, Mu Lee K (2017) Deep multi-scale convolutional neural network for dynamic scene deblurring. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 3883–3891. https://doi.org/10.1109/CVPR.2017.35

  30. Nah S, Son S, Lee K M (2019) Recurrent neural networks with intra-frame iterations for video deblurring. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 8102–8111. https://doi.org/10.1109/CVPR.2019.00829

  31. Osher S, Burger M, Goldfarb D, Xu J, Yin W (2005) An iterative regularization method for total variation-based image restoration. Multiscale Model Simul 4(2):460–489. https://doi.org/10.1137/040605412

    Article  MathSciNet  Google Scholar 

  32. Pan J, Hu Z, Su Z, Lee H Y, Yang M H (2016) Soft-segmentation guided object motion deblurring. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 459–468. https://doi.org/10.1109/CVPR.2016.56

  33. Ren S, He K, Girshick R, Sun J (2017) Faster r-cnn towards real-time object detection with region proposal networks. In: IEEE Trans Pattern Anal Mach Intell, vol 39. IEEE Press, pp 1137–1149

  34. Sun J, Cao W, Xu Z, Ponce J (2015) Learning a convolutional neural network for non-uniform motion blur removal. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 769–777. https://doi.org/10.1109/CVPR.2015.7298677

  35. Tao X, Gao H, Shen X, Wang J, Jia J (2018) Scale-recurrent network for deep image deblurring. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 8174–8182. https://doi.org/10.1109/CVPR.2018.00853

  36. Vallabhaneni R B, Rajesh V (2018) Brain tumour detection using mean shift clustering and glcm features with edge adaptive total variation denoising technique. Alexandria Engineering Journal 57(4):2387–2392. https://doi.org/10.1016/j.aej.2017.09.011

    Article  Google Scholar 

  37. Wang Y, Tao X, Qi X, Shen X, Jia J (2018) Image inpainting via generative multi-column convolutional neural networks. In: Advances in neural information processing systems, pp 331–340

  38. Wang Z, Xu M, Ye N, Wang R, Huang H (2019) Rf-focus: Computer vision-assisted region-of-interest rfid tag recognition and localization in multipath-prevalent environments. Proceedings of the ACM on Interactive, Mobile Wearable and Ubiquitous Technologies 3(1):29. https://doi.org/10.1145/3314416

    Google Scholar 

  39. Wen F, Ying R, Liu P, Truong T K (2019) Blind image deblurring using patch-wise minimal pixels regularization. arXiv:1906.06642

  40. Wieschollek P, Hirsch M, Scholkopf B, Lensch H (2017) Learning blind motion deblurring. In: Proceedings of the IEEE international conference on computer vision, pp 231–240. https://doi.org/10.1109/ICCV.2017.34

  41. Xiao F, Wang Z, Ye N, Wang R, Li X Y (2018) One more tag enables fine-grained rfid localization and tracking. IEEE-ACM Trans Netw 26(1):161–174

    Article  Google Scholar 

  42. Yu X, Wang D, Zhao Z (2019) Application and semi-physical verification of artificial neural network in rfid multi-tag distribution optimization. In: Semi-physical verification technology for dynamic performance of internet of things system. Springer, pp 105–130

  43. Yu Y, Yu X, Zhao Z, Qian K, Wang D (2018) Image analysis system for optimal geometric distribution of rfid tags based on flood fill and dlt. IEEE Trans Instrum Meas 67(4):839–848. https://doi.org/10.1109/TIM.2017.2789122

    Article  Google Scholar 

  44. Yu Y, Yu X, Zhao Z, Liu J, Wang D (2016) Measurement uncertainty limit analysis of biased estimators in rfid multiple tags system. IET Sci Meas Technol 10(5):449–455. https://doi.org/10.1049/iet-smt.2015.0202

    Article  Google Scholar 

  45. Yu K, Dong C, Lin L, Change Loy C (2018) Crafting a toolchain for image restoration by deep reinforcement learning. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 2443–2452

  46. Zhang F, Lu W, Liu H, Xue F (2018) Natural image deblurring based on l0-regularization and kernel shape optimization. Multimed Tools Appl 77 (20):26239–26257. https://doi.org/10.1007/s11042-018-5847-2

    Article  Google Scholar 

  47. Zhang J, Pan J, Ren J, Song Y, Bao L, Lau R W, Yang M H (2018) Dynamic scene deblurring using spatially variant recurrent neural networks. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 2521–2529. https://doi.org/10.1109/CVPR.2018.00267

  48. Zaremba W, Sutskever I, Vinyals O (2014) Recurrent neural network regularization. arXiv:1409.2329

  49. Zhang Z, Ding S, Sun Y (2020) A support vector regression model hybridized with chaotic krill herd algorithm and empirical mode decomposition for regression task. Neurocomputing: 410. https://doi.org/10.1016/j.neucom.2020.05.075

  50. Zhang Z, Hong W C (2019) Electric load forecasting by complete ensemble empirical mode decomposition adaptive noise and support vector regression with quantum-based dragonfly algorithm. Nonlinear Dynamics 98(4). https://doi.org/10.1007/s11071-019-05252-7

  51. Zhang Y, Li K, Li K, Wang L, Zhong B, Fu Y (2018) Image super-resolution using very deep residual channel attention networks. In: Proceedings of the European conference on computer vision (ECCV), pp 286–301, DOI https://doi.org/10.1007/978-3-030-01234-2_18, (to appear in print)

  52. Zhuang X, Yu X, Zhao Z, Zhang W, Liu Z, Lu D, Dong D (2018) A novel method for 3d measurement of rfid multi-tag network using a machine vision system. Metrol. Meas. Syst 25(3). https://doi.org/10.24425/123898

  53. Zhuang X, Yu X, Zhou D, Zhao Z, Zhang W, Li L, Liu Z (2019) A novel 3d position measurement and structure prediction method for rfid tag group based on deep belief network. Measurement 136:25–35. https://doi.org/10.1016/j.measurement.2018.12.071

    Article  Google Scholar 

  54. Zhuang X, Yu X, Zhao Z, Wang D, Zhang W, Liu Z, Lu D, Dong D (2018) A novel method for 3d measurement of rfid multi-tag network based on matching vision and wavelet. Meas Sci Technol 29(7):075001. https://doi.org/10.1088/1361-6501/aabcac

    Article  Google Scholar 

Download references

Acknowledgements

This work was supported by National Natural Science Foundation of China (NNSFC) (61771240), Fund Project of Jiangsu Engineering Laboratory for Lake Environment Remote Sensing Technologies (JSLERS-2018-003), China Postdoctoral Science Foundation (2016T90452), and Six Talent Peaks Project in Jiangsu Province of China (XYDXX-058).

Author information

Authors and Affiliations

  1. Nanjing University of Aeronautics and Astronautics, Nanjing, China

    Lin Li, Xiaolei Yu, Zhenlu Liu, Zhimin Zhao, Ke Zhang & Shanhao Zhou

  2. National Quality Supervision and Testing Center for RFID Product (Jiangsu), Nanjing, China

    Lin Li & Xiaolei Yu

Authors
  1. Lin Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Xiaolei Yu
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Zhenlu Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Zhimin Zhao
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Ke Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Shanhao Zhou
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Xiaolei Yu.

Ethics declarations

Conflict of Interests

The authors declare that they have no conflict of interest.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Li, L., Yu, X., Liu, Z. et al. Multi-scale recursive codec network with authority parameters (MRCN-AP) for RFID multi-label deblurring. Multimed Tools Appl 80, 32149–32169 (2021). https://doi.org/10.1007/s11042-021-11216-0

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-021-11216-0

Keywords

Search

Navigation