Skip to main content
SpringerLink
Log in

An information processing method of software and hardware coupling for VR monitoring of hydraulic support groups

  • Track 4: Digital Games, Virtual Reality, and Augmented Reality
  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

The development of a digital twin virtual reality monitoring system for the hydraulic support group is the key to ensuring the safe and efficient operation of longwall mining face. Establishing a stable and reliable information processing channel to obtain information that is close to the actual working condition is an important link to ensure monitoring. Based on the prototype system of hydraulic support and the data of underground working conditions, an information interactive processing technology of software and hardware coupling is presented. The sensor’s real-time data is filtered by hardware and denoised by software based on empirical mode decomposition to obtain the most accurate working condition data. Relevant experiments were carried out under the conditions of information channels with various software and hardware filtering configurations. Comprehensive experiments were conducted from three aspects: the absolute posture monitoring test of hydraulic support, the virtual posture monitoring under the undulating floor, and the real-time sensing data driving and control under the virtual reality environment. The experiments show that the hardware and software-coupled filtering method can obtain reliable attitude data in real-time and ensure the effectiveness of digital twin virtual monitoring and control, which can offer technical assistance for the condition monitoring of mechanical equipment under complex working conditions.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13

Similar content being viewed by others

Data availability

Data sharing not applicable to this article as no datasets were generated or analyzed during the current study.

References

  1. Bołoz Ł, Biały W (2020) Automation and robotization of underground mining in Poland. Appl Sci 10(20):7221

    Article  Google Scholar 

  2. Chen D, Li S (2016) Measuring method of mining height based on inclination angle of hydraulic support. J Coal Sci 41(03):788–793

    Google Scholar 

  3. Chen L, Hu X, Wang G, Cao D, Li L, Wang F (2021) Parallel mining operating systems: from digital twins to mining intelligence. In: IEEE 1st international conference on digital twins and parallel intelligence (DTPI), pp 469–473. https://doi.org/10.1109/DTPI52967.2021.9540195

  4. Chen H, Chen H, Xu Y, Zhang D, Ma Y, Mao J (2022) Research on attitude monitoring method of advanced hydraulic support based on multi-sensor fusion. Measurement 187:110341

    Article  Google Scholar 

  5. Chen J, Liu Y, Chen Y, Nie K (2021) Study on fault diagnosis of airborne fuel pump based on EMD and SVM. J Beijing Univ Aeronaut Astronaut 47(08):1687–1696. https://doi.org/10.13700/j.bh.1001-5965.2020.0620

  6. Farrelly CT, Davies J (2021) Interoperability, integration, and digital twins for mining—part 2: pathways to the network-centric mine. IEEE Ind Electron Mag 15(3):22–31. https://doi.org/10.1109/MIE.2020.3029388

    Article  Google Scholar 

  7. Farrelly CT, Davies J (2021) Interoperability, integration, and digital twins for mining—part 1: pathways to the network-centric mine. IEEE Ind Electron Mag 15(3):13–21. https://doi.org/10.1109/MIE.2020.3029391

    Article  Google Scholar 

  8. Gao K, Xu W, Zhang H, Zhang Y, Zeng Q, Sun L (2020) Relative position and posture detection of hydraulic support based on particle swarm optimization. IEEE Access 8:200789–200811

    Article  Google Scholar 

  9. Garg H, Sharma B, Shekhar S, Agarwal R (2022) Spoofing detection system for e-health digital twin using EfficientNet convolution neural network. Multimed Tools Appl 81:26873–26888. https://doi.org/10.1007/s11042-021-11578-5

  10. Ge X, Xie J, Wang X, Liu Y, Shi H (2020) A virtual adjustment method and experimental study of the support attitude of hydraulic support groups in propulsion state. Measurement 158:107743

    Article  Google Scholar 

  11. Hu XP (2020) Cooperative automatic control for the canopy posture of a four-leg hydraulic support. Int J Simulation Modell 19(4):713–724

  12. Jia P, Wang X, Shen X (2020) Digital-twin-enabled intelligent distributed clock synchronization in industrial IoT systems. IEEE Internet Things J 8(6):4548–4559

    Article  Google Scholar 

  13. Jin J, Xu Z, Li C et al (2021) Fault diagnosis of rolling bearing based on variational mode decomposition and optimal support vector machine. J Power Eng 41(03):214–220+243

    Google Scholar 

  14. Li X, He B, Zhou Y, Li G (2020) Multisource model-driven digital twin system of robotic assembly. IEEE Syst J 15(1):114–123

    Article  Google Scholar 

  15. Li S, Xie J, Ren F, Zhang X, Wang X, Wang B (2021) Virtual straightening of scraper conveyor based on the position and attitude solution of industrial robot model. Int J Coal Sci Technol 8:1149–1170. https://doi.org/10.1007/s40789-020-00389-y

    Article  Google Scholar 

  16. Li W, Wang L, Shen Q, Li C (2021) Random drift analysis method of EMD-based MEMS gyroscope. J Beijing Univ Aeronautic Astronautic 47(09):1927–1932. https://doi.org/10.13700/j.bh.1001-5965.2020.0681

  17. Lu X, Wang Z, Tan C, Yan H, Si L, Wei D (2020) A portable support attitude sensing system for accurate attitude estimation of hydraulic support based on unscented kalman filter. Sensors 20(19):5459

    Article  Google Scholar 

  18. Meng Z, Zeng Q, Wan L et al (2018) Pose adjusting simulation of hydraulic support based on mechanical-electrical-hydraulic coordination. Tehnički vjesnik 25(4):1110–1118

    Google Scholar 

  19. Meng ZS, Zhang S, Xie YY, Zeng QL (2020) Attitude adjustment of backfilling support based on mechanical-hydraulic co-simulation. Int J Simulation Modell 19(3):399–409

    Article  Google Scholar 

  20. Ralston JC, Hargrave CO, Dunn MT (2017) Longwall automation: trends, challenges and opportunities. Int J Min Sci Technol 27(5):733–739

    Article  Google Scholar 

  21. Reid PB, Dunn MT, Reid DC, Ralston JC (2010) Real-world automation: new capabilities for underground longwall mining. Australasian Conference on Robotics and Automation, ACRA, December 1, 2010 - December 3, 2010, Brisbane

  22. Ren P, Li J, Yang D (2019) The research on model construction and application of coal mine CPS perception and control layer. Int J Embed Syst 11(4):483–492

    Google Scholar 

  23. Rozmus M, Tokarczyk J, Michalak D, Dudek M, Szewerda K, Rotkegel M, Lamot A, Rošer J (2021) Application of 3D scanning, computer simulations and virtual reality in the redesigning process of selected areas of underground transportation routes in coal mining industry. Energies 14(9):2589

    Article  Google Scholar 

  24. Savolainen J, Urbani M (2021) Maintenance optimization for a multi-unit system with digital twin simulation. J Intell Manuf 32(7):1953–1973

    Article  Google Scholar 

  25. Semenov Y, Semenova O, Kuvataev I (2020) Solutions for digitalization of the coal industry implemented in UC Kuzbassrazrezugol[C]//E3S web of conferences. EDP Sci 174:01042

    Google Scholar 

  26. Sengan S, Kumar K, Subramaniyaswamy V, Ravi L (2022) Cost-effective and efficient 3D human model creation and re-identification application for human digital twins. Multimed Tools Appl 81(19):26839–26856

    Article  Google Scholar 

  27. Suh J (2019) Utilization of augmented and virtual reality technologies in geoscience and mining. Journal of the Korean Society of Mineral and Energy Resources Engineers 56(5):468–479. https://doi.org/10.32390/ksmer.2019.56.5.468

  28. Torano J, Diego I, Menéndez M et al (2008) A finite element method (FEM)–fuzzy logic (soft computing)–virtual reality model approach in a coalface longwall mining simulation. Autom Constr 17(4):413–424

    Article  Google Scholar 

  29. Wang B, Xie J, Wang X, Liu S, Liu Y (2021) A new method for measuring the attitude and straightness of hydraulic support groups based on point clouds. Arab J Sci Eng 46(12):11739–11757

    Article  Google Scholar 

  30. Wang X, Wang H, Wang C (2021) Vibration signal denoising of hydrate machine based on EMD adaptive threshold. J China Agricultural Univ 26(01):99–106

    Google Scholar 

  31. Xie J, Wang X, Yang Z, Hao S (2019) Attitude-aware method for hydraulic support groups in a virtual reality environment. Proc Inst Mech Eng C J Mech Eng Sci 233(14):4805–4818

    Article  Google Scholar 

  32. Xie J, Wang X, Yang Z, Hao S (2019) Virtual monitoring method for hydraulic supports based on digital twin theory. Min Technol 128(2):77–87

    Article  Google Scholar 

  33. Xie J, Li S, Wang X (2022) A digital smart product service system and a case study of the mining industry: MSPSS. Adv Eng Inform 53:101694

    Article  Google Scholar 

  34. Xie J, Liu S, Wang X (2022) Framework for a closed-loop cooperative human cyber-physical system for the mining industry driven by VR and AR: MHCPS. Comput Ind Eng 168:108050

    Article  Google Scholar 

  35. Xie J, Ge F, Cui T, Wang X (2022) A virtual test and evaluation method for fully mechanized mining production system with different smart levels. Int J Coal Sci Technol 9(1):1–20

    Article  Google Scholar 

  36. Xu X (2017) Key technology research on hydraulic support posture monitoring. China University of Mining and Technology, Xuzhou

  37. Yetkin ME, Simsir F, Ozfirat MK, Ozfirat PM, Yenice H (2016) A fuzzy approach to selecting roof supports in longwall mining. South African J Industrial Eng 27(1):162–177

    Article  Google Scholar 

  38. Yuan X, Xie J, Gao F, Lian Z (2022) Assessment of shield support performance based on an innovative mathematical-physical model in longwall faces. Proc Inst Mech Eng C J Mech Eng Sci 236(16):8935–8954. https://doi.org/10.1177/09544062221091467

  39. Zhang K, Lian Z, Xie J et al (2017) Height measurement method of hydraulic support based on multi-sensor data fusion. Industrial Mining Autom 43(09):65–69

    Google Scholar 

  40. Zhang Y, Zhang H, Gao K, Xu W, Zeng Q (2019) New method and experiment for detecting relative position and posture of the hydraulic support. IEEE Access 7:181842–181854

    Article  Google Scholar 

  41. Zhang J, Chen Z, Chen L et al (2020) Extraction of current characteristic values of breaking coil of vacuum circuit breaker based on improved set mode decomposition. High Voltage Appliances 56(12):116–123

    Google Scholar 

  42. Zhou H, Zhang X (2014) The model construction and implementation of discrete physical system in industrial CPS. Computer Model New Technol 18(10):82–89

Download references

Funding

This work was supported by the National Natural Science Foundation of China [grant number 52004174], Major Science and Technology Projects in Shanxi Province [202101020101021], the Fund for Shanxi “1331” Project, Key project of the Chinese Society of Academic Degrees and Graduate Education [grant number 2020ZDA12], Scientific Research Planning for Higher Education in 2022 [grant number 22SZH0306], Central Government Guides Local Science and Technology Development Funds Projects [YDZJSX2022A014].

Author information

Authors and Affiliations

  1. Shanxi Key Laboratory of Fully Mechanized Coal Mining Equipment, Taiyuan University of Technology, No.216 mailbox, HuYu Campus, No.18, XinKuangYuan Road, TaiYuan, ShanXi Province, 030024, People’s Republic of China

    Zhao Feng, Jiacheng Xie, Zewen Yan, Zhenhuai Mei, Ziying Zheng & Ting Li

  2. Post-doctoral Research Workstation of Taiyuan Mining Machinery Group Co.,Ltd., Taiyuan, 030032, China

    Zhao Feng, Jiacheng Xie, Zewen Yan, Zhenhuai Mei, Ziying Zheng & Ting Li

Authors
  1. Zhao Feng
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Jiacheng Xie
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Zewen Yan
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Zhenhuai Mei
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Ziying Zheng
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Ting Li
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Jiacheng Xie.

Ethics declarations

Disclosure statement

No potential conflict of interest was reported by the authors.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Feng, Z., Xie, J., Yan, Z. et al. An information processing method of software and hardware coupling for VR monitoring of hydraulic support groups. Multimed Tools Appl 82, 19067–19089 (2023). https://doi.org/10.1007/s11042-022-14128-9

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-022-14128-9

Keywords

Search

Navigation