Skip to main content
Log in

Crawling robot manipulator tracking based on gaussian mixture model of machine vision

  • S.I on NC for Industry 4.0
  • Published:
Neural Computing and Applications Aims and scope Submit manuscript

Abstract

In the grasping process of the robot, the pose of robot should adapt to the change of the object's pose. In order to avoid the cumbersome calibration and difficulty of inversion in the existing vision-based robotic arm-grasping methods, a robotic arm grasping and tracking method based on Gaussian mixture of machine vision model (MGV) are proposed. This method uses Gaussian mixture model of machine vision to build the mapping relationship between the observed variables of the object and the robot joint variables. In the learning phase, the Gaussian mixture model of machine vision is used to directly construct the mapping from the pose of the target object to the joint angle of the manipulator. In the grasping stage, the pose of the target object is acquired through the camera, and the generation probability of the pose under each Gaussian component is calculated, respectively, and the Gaussian process regression corresponding to the Gaussian component with the largest posterior probability is selected to calculate the corresponding manipulator joint angle. The experimental results show that using Gaussian mixture machine vision model can make the robot manipulator grasp and track better than using single Gaussian process model.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11

Similar content being viewed by others

References

  1. Mei G, Xu N, Qin J et al (2019) A survey of Internet of Things (IoT) for geohazard prevention: applications, technologies, and challenges. IEEE Internet Things J 7(5):4371–4386

    Article  Google Scholar 

  2. Usak M, Kubiatko M, Shabbir MS et al (2020) Health care service delivery based on the Internet of things: systematic and comprehensive study. Int J Commun Syst 33(2):e4179

    Article  Google Scholar 

  3. Fu H, Wang M, Li P et al (2019) Tracing knowledge development trajectories of the internet of things domain: a main path analysis. IEEE Trans Ind Inf 15(12):6531–6540

    Article  Google Scholar 

  4. Zhang X, Liu S, Chen X et al (2018) Health information privacy concerns, antecedents, and information disclosure intention in online health communities. Inf Manag 55(4):482–493

    Article  Google Scholar 

  5. Li R, Qiao H (2019) A survey of methods and strategies for high-precision robotic grasping and assembly tasks—some new trends. IEEE/ASME Trans Mechatron 24(6):2718–2732

    Article  Google Scholar 

  6. Ginestra JC, Giannini HM, Schweickert WD et al (2019) Clinician perception of a machine learning–based early warning system designed to predict severe sepsis and septic shock. Crit Care Med 47(11):1477–1484

    Article  Google Scholar 

  7. Parshuram CS, Dryden-Palmer K, Farrell C et al (2018) Effect of a pediatric early warning system on all-cause mortality in hospitalized pediatric patients: the EPOCH randomized clinical trial. JAMA 319(10):1002–1012

    Article  Google Scholar 

  8. Azimi I, Rahmani AM, Liljeberg P et al (2017) Internet of things for remote elderly monitoring: a study from user-centered perspective. J Ambient Intell Humaniz Comput 8(2):273–289

    Article  Google Scholar 

  9. Liu Y, Zhang L, Yang Y et al (2019) A novel cloud-based framework for the elderly healthcare services using digital twin. IEEE Access 7:49088–49101

    Article  Google Scholar 

  10. Zeadally S, Bello O (2021) Harnessing the power of Internet of Things based connectivity to improve healthcare. Internet of Things 14:100074

    Article  Google Scholar 

  11. Kang S, Baek H, Jung E et al (2019) Survey on the demand for adoption of Internet of Things (IoT)-based services in hospitals: investigation of nurses’ perception in a tertiary university hospital. Appl Nurs Res 47:18–23

    Article  Google Scholar 

  12. He D, Chan S, Guizani M (2018) Security in the Internet of Things supported by mobile edge computing. IEEE Commun Mag 56(8):56–61

    Article  Google Scholar 

  13. Dhanvijay MM, Patil SC (2019) Internet of Things: a survey of enabling technologies in healthcare and its applications. Comput Netw 153:113–131

    Article  Google Scholar 

  14. Lin SX, Liu HZ, Chen SJ et al (2017) Optimization and implementation of Zigbee wireless location algorithm. Revest de la Faulted de Ingenerate 32(5):396–404

    Google Scholar 

  15. Dang LM, Piran M, Han D et al (2019) A survey on Internet of Things and cloud computing for healthcare. Electronics 8(7):768

    Article  Google Scholar 

  16. Panchatcharam P, Vivekanandan S (2019) Internet of Things (IOT) in healthcare–smart health and surveillance, architectures, security analysis and data transfer: a review. Int J Softw Innov 7(2):21–40

    Article  Google Scholar 

  17. de la Torre DI, Alonso SG, Hamrioui S et al (2019) IoT-based services and applications for mental health in the literature. J Med Syst 43(1):11

    Article  Google Scholar 

  18. El Kafhali S, Salah K (2018) Performance modelling and analysis of Internet of Things enabled healthcare monitoring systems. IET Netw 8(1):48–58

    Article  Google Scholar 

  19. Wang B, Kong W, Guan H et al (2019) Air quality forecasting based on gated recurrent long short term memory model in Internet of Things. IEEE Access 7:69524–69534

    Article  Google Scholar 

  20. Baig MM, Afifi S, GholamHosseini H et al (2019) A systematic review of wearable sensors and IoT-based monitoring applications for older adults: a focus on ageing population and independent living. J Med Syst 43(8):233

    Article  Google Scholar 

  21. Shen T, Radmard S, Chan A et al (2018) Optimized vision-based robot motion planning from multiple demonstrations. Auton Robot 42(6):1117–1132

    Article  Google Scholar 

Download references

Acknowledgements

The study was supported by “School-enterprise Cooperation Project” for Domestic Visiting Engineers of Institutions of Higher Learning in 2020, China (Grant No. fw20200879).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Jingjing Lou.

Ethics declarations

Conflict of interest

The authors declared that they have no conflicts of interest to this work. We declare that we do not have any commercial or associative interest that represents a conflict of interest in connection with the work submitted.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Lou, J. Crawling robot manipulator tracking based on gaussian mixture model of machine vision. Neural Comput & Applic 34, 6683–6693 (2022). https://doi.org/10.1007/s00521-021-06063-x

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00521-021-06063-x

Keywords

Navigation