Skip to main content
SpringerLink
Log in

Cloud-Based Data Offloading for Multi-focus and Multi-views Image Fusion in Mobile Applications

  • Published:
Mobile Networks and Applications Aims and scope Submit manuscript

Abstract

The mobile phone is currently the most wid- ely used and most convenient photographic device. Like many optical imaging devices the camera of mobile ph- one are far from flawless, such as limited field of view and depth of focus in photos. Due to its limited computing power, it is not possible to use a mobile phone to fuse images. In addition, the multimedia communication need a good network connection and bandwidth. In this paper, we solve this problem by proposing an image fusion strategy and mobile data offloading method based on cloud computing platform. We design a cloud computing environment to fuse the images captured by the mobile phone where mobile terminal uploads and downloads images to the cloud through 5G signal. And a continuous time Markov model is applied to offload the mobile network data. We fuse the original images to all-in-focus image and 3D stereo image based on Non Subsampled Contourlet Transform and Detail-preserving & Content-aware Variational multiple images fusion method, respectively. The experimental results show that the proposed image fusion and data offloading method achieves satisfactory image quality and execution performance.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10

Similar content being viewed by others

References

  1. Chen Y, Guan J, Cham WK (2018) Robust multi-focus image fusion using edge model and multi-matting. IEEE Trans Image Process 27(3):1526–1541

    Article  MathSciNet  MATH  Google Scholar 

  2. Tan W, Yu Y, Du J, et al (2017) Multi-focus image fusion using spatial frequency and discrete wavelet transform. Optical Sensing and Imaging Technology and Applications, pp 243

  3. Sun J, Han Q, Kou L, et al (2018) Multi-focus image fusion algorithm based on Laplacian pyramids. J Opt Soc Am A Opt Image Sci Vis 35(3):480–490

    Article  Google Scholar 

  4. Liu M, Dai Y, Jie Z, et al (2015) PCA-Based sea-ice image fusion of optical data by HIS transform and SAR data by wavelet transform. Acta Oceanol Sin 34(3):59–67

    Article  Google Scholar 

  5. Cui J, Zhang Y, Cai Z, Liu A, Li Y (2018) Securing display path for security-sensitive applications on mobile devices. Computers, Materials & Continua 55(1):017–017

    Google Scholar 

  6. Jadhav T, Singh K, Abhyankar A (2017) A review and comparison of multi-view 3D reconstruction methods. Journal of Engineering Research 5(3):50–72

    Google Scholar 

  7. Hedman P, Alsisan S, Szeliski R, et al (2017) Casual 3D photography. ACM Trans Graph 36(6):234

    Article  Google Scholar 

  8. Hilliges O, Weiss MH, Izadi S, et al (2018) Using photometric stereo for 3D environment modeling, U.S. Patent 9,857,470[P]

  9. Kuhn A, Hirschmüller H, Scharstein D, et al (2017) A tv prior for high-quality scalable multi-view stereo reconstruction. Int J Comput Vis 124(1):2–17

    Article  MathSciNet  Google Scholar 

  10. Bódis-Szomorú A, Riemenschneider H, Van Gool L (2017) Efficient edge-aware surface mesh reconstruction for urban scenes. Comput Vis Image Underst 157:3–24

    Article  Google Scholar 

  11. Zhang R, Wang M, Cai L, Zheng Z (2015) Lte-unlicensed: the future of spectrum aggregation for cellular networks. IEEE Wirel Commun 22(3):150–159

    Article  Google Scholar 

  12. Liu W, Luo X, Liu Y, Liu J, Liu M, Shi YQ (2018) Localization algorithm of indoor Wi-Fi access points based on signal strength relative relationship and region division. Computers, Materials & Continua 55(1):071–071

    Google Scholar 

  13. Liu D, Khoukhi L, Hafid AS (2018) Prediction based mobile data offloading in mobile cloud computing. IEEE Transactions on Vehicular Communications 17(7):4660–4673

    Google Scholar 

  14. Peng YT, Sou SI, Tsai MH, et al (2017) Multipath mobile data offloading of deadline assurance with policy and charging control in cellular/wifi networks. Comput Netw 129(1):17–27

    Article  Google Scholar 

  15. Mehmeti F, Spyropoulos T (2017) Performance modeling, analysis, and optimization of delayed mobile data offloading for mobile users. IEEE/ACM Trans Networking 25(99):1–15

    Google Scholar 

  16. Tudzarov A, Janevski T (2011) Experience-based radio access technology selection in wireless environment. In: IEEE international conference on computer as a tool, Lisbon, pp 1–4

  17. Pei X, Jiang T, Qu D, Zhu G, Liu J (2010) Radio-resource management and access-control mechanism based on a novel economic model in heterogeneous wireless networks. IEEE Trans Veh Technol 59(6):3047–3056

    Article  Google Scholar 

  18. Falowo OE, Chan HA (2010) Joint call admission control algorithm for fair radio resource allocation in heterogeneous wireless networks supporting heterogeneous mobile terminals. In: IEEE conference on consumer communications and networking conference, Las Vegas, pp 544–548

  19. Roy A, Karandikar A (2015) Optimal radio access technology selection policy for LTE-WiFi network. In: IEEE international symposium on modeling and optimization in mobile, ad hoc, and wireless networks, Mumbai, pp 291–298

  20. Gayathri N, Deepa PL (2017) Multi-focus color image fusion using NSCT and PCNN. In: IEEE international conference on communication systems and networks. Thiruvananthapuram, pp 173–178

  21. Li Z, Wang K, Zuo W, Deyu M, Zhang L (2015) Detail-preserving and content-aware variational multi-view stereo reconstruction. IEEE Trans Image Process 25(2):864–877

    Article  MathSciNet  MATH  Google Scholar 

  22. Wang H, Peng X, Xiao X, Liu Y (2017) Bslic: slic superpixels based on boundary term. SYMMETRY-BASEL 9(3):31–45

    Article  MathSciNet  Google Scholar 

  23. Li Z, Chen J (2015) Superpixel segmentation using linear spectral clustering. In: IEEE conference on computer vision and pattern recognition, pp 1356–1363

  24. Seitz S, Curless B, Diebel J, Scharstein D, Szeliski R (2006) A comparison and evaluation of multi-view stereo reconstruction algorithms. In: IEEE conference on computer vision and pattern recognition, vol 1, New York, pp 519–528

  25. Hiep V, Keriven R, Labatut P, Pons J (2009) Towards high-resolution large-scale multi-view stereo. In: IEEE conference on computer vision and pattern recognition, Miami, pp 1430–1437

  26. Campbell N, Vogiatzis G, Hernández C, Cipolla R (2008) Using multiple hypotheses to improve depth-maps for multi-view stereo. In: European conference on computer vision. Springer, Berlin, pp 766–779

  27. Furukawa Y, Ponce J (2010) Accurate, dense, and robust multiview stereopsis. IEEE Trans Pattern Anal Mach Intell 32(8): 1362–1376

    Article  Google Scholar 

  28. Hernandez C, Schmitt F (2004) Silhouette and stereo fusion for 3D object modeling. Comput Vis Image Underst 96(3):367–392

    Article  Google Scholar 

  29. Liu MJ, Dai YS, Zhang J, et al (2015) PCA-based seaice image fusion of optical data by HIS transform and SAR data by wavelet transform. Acta Oceanol Sin 34(3):59–67

    Article  Google Scholar 

  30. Yang Y, Tong S, Huang S, et al (2015) Multifocus image fusion based on NSCT and focused area detection. IEEE Sensors J 15(5):2824–2838

    Google Scholar 

  31. Jin X, Nie R, Zhou D, et al (2016) Multifocus color image fusion based on NSST and PCNN. Journal of Sensors 2016(2): 1–12

    Article  Google Scholar 

  32. Yang Y (2011) A novel DWT based multi-focus image fusion method. Procedia Engineering 24:177–181

    Article  Google Scholar 

  33. Paninski L (2014) Estimation of entropy and mutual information. Neural Comput 15(6):1191–1253

    Article  MATH  Google Scholar 

  34. Xue X, Yu M, He M (2016) Stereoscopic image-quality-assessment method based on visual cell model. Laser & Optoelectronics Progress 53(4):041004

    Article  Google Scholar 

  35. Taujuddin NSAM, Ibrahim R, Sari S, et al (2017) The effect on compressed image quality using standard deviation-based thresholding algorithm. Journal of Telecommunication, Electronic and Computer Engineering 9(3):39–43

    Google Scholar 

Download references

Acknowledgments

This work is supported by National Natural Science Foundation of China (61501132, 61370084), China Postdoctoral Science Foundation (2016M591515), Heilong jiang Postdoctoral Sustentation Fund (LBH-Z14055), Youth Foundation of Heilongjiang Province of China (QC2016083), Fundamental Research Funds for the Central Universities (HEUCS201706).

Author information

Authors and Affiliations

  1. Harbin Engineering University, Harbin, 150001, People’s Republic of China

    Yiqi Shi, Jianguo Sun, Duo Liu, Liang Kou, Boquan Li & Liguo Zhang

  2. Department of Computer Science and Engineering, University of North Texas, Denton, TX, 76207, USA

    Qing Yang

Authors
  1. Yiqi Shi
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Jianguo Sun
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Duo Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Liang Kou
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Boquan Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Qing Yang
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Liguo Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Liguo Zhang.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Shi, Y., Sun, J., Liu, D. et al. Cloud-Based Data Offloading for Multi-focus and Multi-views Image Fusion in Mobile Applications. Mobile Netw Appl 26, 830–841 (2021). https://doi.org/10.1007/s11036-019-01326-3

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11036-019-01326-3

Keywords

Search

Navigation