Skip to main content

Advertisement

SpringerLink
Log in

Development of a fast transmission method for 3D point cloud

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

In this paper, a transmission method of the 3D point cloud data of the object upper body is proposed. The key idea of the method is to reduce the amount of transmission data in the condition of retaining the necessary information. In our system, the unnecessary information is removed by using filters and the segmentation algorithm. Three P frames (Predicted frame) are inserted between two I frames (Intra frame) to further improve the transmission rate. The I frame of large size includes all the vision information that is related to the object upper body, while the P frame includes only the information of the small change in the current frame, whose size is smaller than the former. In order to acquire the information of the P frame, first, a human face detection algorithm based on the machine learning technology is implemented. Then, a coarse-to-fine approach is used to detect the nose tip which helps to improve the precision of acquiring the human faces information. The experiment result demonstrates that the proposed method is able to reduce the time delay of processing and transmission and to lower the compression ratio with an allowable distortion rate.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12

Similar content being viewed by others

References

  1. Bhimani J, Mi N, Leeser M, Yang Z (2017) Fim: performance prediction model for parallel computation in iterative data processing applications. In: IEEE International Conference on Cloud Computing

  2. Bhimani J, Yang Z, Leeser M, Mi N (2017) Accelerating big data applications using lightweight virtualization framework on enterprise cloud. In: IEEE High Performance Extreme Computing Conference

  3. Brahimi T, Boubchir L, Fournier R, Naït-ali A (2016) An improved multimodal signal-image compression scheme with application to natural images and biomedical data. Multimed Tool Appl:1–23

  4. Chen S, Xia P, Nahrstedt K (2013) Activity-aware adaptive compression: a morphing-based frame synthesis application in 3dti. In: Proceedings of the 21st ACM international conference on Multimedia. ACM, pp 349–352

  5. Chum O, Matas J (2002) Randomized ransac with td, d test, vol 2, pp 448–457

  6. Cui J, Liu Y, Xu Y, Zhao H, Zha H (2013) Tracking generic human motion via fusion of low-and high-dimensional approaches. IEEE Trans Syst Man Cybern Syst 43(4):996–1002

    Article  Google Scholar 

  7. Derpanis KG (2010) Overview of the ransac algorithm. Image Rochester NY 4 (1):2–3

    Google Scholar 

  8. Doumanoglou A, Alexiadis D, Asteriadis S, Zarpalas D, Daras P (2014) On human time-varying mesh compression exploiting activity-related characteristics. In: IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). IEEE, p 2014

  9. Gao H, Yang Z, Bhimani J, Wang T, Wang J, Mi N, Sheng B (2017) Autopath: harnessing parallel execution paths for efficient resource allocation in multi-stage big data frameworks. In: International Conference on Computer Communications and Networks

  10. Han S-R, Yamasaki T, Aizawa K (2007) Time-varying mesh compression using an extended block matching algorithm. IEEE Trans Circuits Syst Video Technol 17(11):1506–1518

    Article  Google Scholar 

  11. He W, Ge W, Li Y, Liu Y, Yang C, Sun C (2017) Model identification and control design for a humanoid robot. IEEE Trans Syst Man Cybern Syst Hum 47(1):45–57

    Article  Google Scholar 

  12. He W, Yan Z, Sun C, Chen Y (2017) Adaptive neural network control of a flapping wing micro aerial vehicle with disturbance observer. IEEE Trans Cybern 47(10):3452

    Article  Google Scholar 

  13. Huang H-C, Kao C-C, Lin Y-C, Hung Y-P (2000) Disparity-based view interpolation for multiple-perspective stereoscopic displays. In: International Society for Optics and Photonics, Electronic Imaging, pp 102–113

  14. Kammerl J, Blodow N, Rusu RB, Gedikli S, Beetz M, Steinbach E (2012) Real-time compression of point cloud streams. In: IEEE International Conference on Robotics and Automation (ICRA). IEEE, p 2012

  15. Kim K-T, Siegel M, Son J-Y (1998) Synthesis of a high-resolution 3d stereoscopic image pair from a high-resolution monoscopic image and a low-resolution depth map. In: International Society for Optics and Photonics, Photonics West’98 Electronic Imaging, pp 76–86

  16. Kost B (1990) Irrelevance reduction of the depth information in stereo images. In: International Society for Optics and Photonics, SC-DL tentative, pp 280–288

  17. Lienhart R, Maydt J (2002) An extended set of haar-like features for rapid object detection. In: 2002 Proceedings International Conference on Image Processing, vol 1. IEEE, p 2002

  18. Liu L, Cheng L, Liu Y, Jia Y, Rosenblum DS (2016) Recognizing complex activities by a probabilistic interval-based model. In: Thirtieth AAAI Conference on Artificial Intelligence, pp 1266–1272

  19. Loop C, Zhang C, Zhang Z (2013) Real-time high-resolution sparse voxelization with application to image-based modeling. In: Proceedings of the 5th High-Performance Graphics Conference. ACM, pp 73–79

  20. Lu Y, Wei Y, Liu L, Zhong J, Sun L, Liu Y (2017) Towards unsupervised physical activity recognition using smartphone accelerometers. Multimed Tool Appl 76(8):10701–10719

    Article  Google Scholar 

  21. Mekuria RN, Cesar P, Bulterman DC (2014) Source coding for transmission of reconstructed dynamic geometry: a rate-distortion-complexity analysis of different approaches. In: International Society for Optics and Photonics, SPIE Optical Engineering+ Applications, pp 92170S–92170S

  22. Menzies R, Rogers S, Phillips A, Chiarovano E, de Waele C, Verstraten F, MacDougall H (2016) An objective measure for the visual fidelity of virtual reality and the risks of falls in a virtual environment. Virtual Reality 20(3):173–181

    Article  Google Scholar 

  23. Mian A, Bennamoun M, Owens R (2006) Automatic 3d face detection, normalization and recognition. In: Third International Symposium on 3D Data Processing, Visualization, and Transmission. IEEE, pp 735–742

  24. Nguyen HQ, Chou PA, Chen Y (2014) Compression of human body sequences using graph wavelet filter banks. In: IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). IEEE, p 2014

  25. Ohm J-R (1999) Stereo/multiview video encoding using the mpeg family of standards. In: International Society for Optics and Photonics, Electronic Imaging’99, pp 242–253

  26. Rabie T (2016) Color-secure digital image compression. Multimed Tool Appl:1–23

  27. Rusu RB, Marton ZC, Blodow N, Dolha M, Beetz M (2008) Towards 3d point cloud based object maps for household environments. Robot Auton Syst 56 (11):927–941

    Article  Google Scholar 

  28. Siegel M, Sethuraman S, McVeigh JS, Jordan AG (1997) Compression and interpolation of 3d stereoscopic and multiview video. In: International Society for Optics and Photonics, Electronic Imaging’97, pp 227–238

  29. Strintzis M, Malassiotis S (1999) Object-based coding of stereoscopic and 3d image sequences. IEEE Signal Proc Mag 16(3):14–28

    Article  Google Scholar 

  30. Váša L, Skala V (2010) Geometry-driven local neighbourhood based predictors for dynamic mesh compression. In: Computer Graphics Forum, vol 29. Wiley Online Library, pp 1921–1933

  31. Wang Z, Yang C, Ju Z, Li Z, Su C-Y (2017) Preprocessing and transmission for 3d point cloud data

  32. Xie X, Zaitsev Y, Velásquezgarcía LF, Teller SJ, Livermore C (2014) Scalable, mems-enabled, vibrational tactile actuators for high resolution tactile displays. J Micromech Microeng 24(12):125014

    Article  Google Scholar 

  33. Xie X, Zaitsev Y, Livermore C (2016) Compact, scalable, high-resolution, mems-enabled tactile displays. In: Research, Innovation, Scholarship Expo

  34. Yan C, Zhang Y, Xu J, Dai F, Li L, Dai Q, Wu F (2014) A highly parallel framework for hevc coding unit partitioning tree decision on many-core processors. IEEE Signal Process Lett 21(5):573–576

    Article  Google Scholar 

  35. Yan C, Zhang Y, Xu J, Dai F, Zhang J, Dai Q, Wu F (2014) Efficient parallel framework for hevc motion estimation on many-core processors. IEEE Trans Circuits Syst Video Technol 24(12):2077–2089

    Article  Google Scholar 

  36. Yan C, Xie H, Yang D, Yin J, Zhang Y, Dai Q, Yan C, Xie H, Yang D, Yin J (2017) Supervised hash coding with deep neural network for environment perception of intelligent vehicles. IEEE Trans Intell Transp Syst:1–12

  37. Yang C, Huang K, Cheng H, Li Y, Su CY (2017) Haptic identification by elm-controlled uncertain manipulator. IEEE Trans Syst Man Cybern Syst 47(8):2398–2409

    Article  Google Scholar 

  38. Yang C, Wang X, Li Z, Li Y, Su C-Y (2017) Teleoperation control based on combination of wave variable and neural networks. IEEE Trans Syst Man Cybern Syst 47(8):2125–2136

    Article  Google Scholar 

  39. Yu H, Liu H (2014) Regression-based facial expression optimization. IEEE Trans Human-Mach Syst 44(3):386–394

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. The Key Laboratory of Autonomous Systems and Networked Control, College of Automation Science and Engineering, South China University of Technology, Guangzhou, China

    Chenguang Yang, Zunran Wang & Zhijun Li

  2. School of Automation and Electrical Engineering, University of Science and Technology Beijing, Beijing, China

    Wei He

Authors
  1. Chenguang Yang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Zunran Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Wei He
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Zhijun Li
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Chenguang Yang.

Additional information

This work was partially supported by National Nature Science Foundation (NSFC) under Grant 61473120, Science and Technology Planning Project of Guangzhou 201607010006, State Key Laboratory of Robotics and System (HIT) Grant SKLRS-2017-KF-13, and the Fundamental Research Funds for the Central Universities 2017ZD057.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Yang, C., Wang, Z., He, W. et al. Development of a fast transmission method for 3D point cloud. Multimed Tools Appl 77, 25369–25387 (2018). https://doi.org/10.1007/s11042-018-5789-8

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-018-5789-8

Keywords

Search

Navigation