Skip to main content
SpringerLink
Log in

Research and Development of Virtual Instruments System Based on Depth Camera

  • Conference paper
  • First Online:
Data Science (ICPCSEE 2017)

Part of the book series: Communications in Computer and Information Science ((CCIS,volume 728))

Abstract

This paper takes advantage of the depth camera of somatosensory kinect and sensors to implement gesture recognition and design a virtual instrument system. As long as the user waves his arm without the help of other equipments, our system can automatically recognize the hand gesture and make suitable sound. In order to achieve depth camera’s detection of hands movement, this paper introduce the depth imaging technology Light Coding and bone tracking technology to obtain the actual position information and hand movement information of the human body. Feet movement detection uses sensor technology, different stampede strength outputs different digital number after AD conversion so that the intensity can be controlled. A series of experiments show that the system has good fluency and practicality and increased the fun of playing instruments.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Peng, J.: There should be an instrument in life. Cross-Century. Time 11, 66 (2011)

    Google Scholar 

  2. Wu, Y.: A study on the identity, dissimilarity and harmony of western percussion and national percussion. The Youth Writers 5, 125 (2013)

    Google Scholar 

  3. Song, T.: The choice of musical instruments and the age of beginners. Parents 10 (1986)

    Google Scholar 

  4. Gao, P.: Virtual musicians world guide. Trading Up 9, 156–157 (2008)

    Google Scholar 

  5. Li, Q., Shen, M.: Gesture recognition technology and its application in human - computer interaction. Chin. J. Ergon. 8(1), 27–29, 33 (2002)

    Google Scholar 

  6. Yan, L., Li, Y.: Extraction of human skeleton based on Kinect depth data. Electron. Measure. Technol. 38(3), 39–42 (2015)

    Google Scholar 

  7. Luo, T.: Design and realization of percussion virtual performance and entertainment system based on human pose. Diss. Zhejiang University (2016)

    Google Scholar 

  8. Wu, G., Li, B., Yan, J.: KINECT Human Computer Interaction Development Practice. Post&Telecom Press (2013)

    Google Scholar 

  9. D’Ausilio, A.: Arduino: a low-cost multipurpose lab equipment. Behav. Res. Methods 44(2), 305–313 (2012)

    Article  Google Scholar 

  10. Zhao, Y.: Perfect graphic Arduino interactive design introduction. Science Press (2014)

    Google Scholar 

  11. Shi, M.: Research on the technology and working principle of Kinect. Nat. Sci. J. Harbin Normal Univ. 29(3) (2013)

    Google Scholar 

  12. Fan, J., Zhou, G.: The research of gesture recognition based on Kinect skeleton tracking technology. J. Anhui Agri. Sci. 42(11), 3444–3446 (2014)

    Google Scholar 

  13. Li, J.: Research on Human Body Motion Recognition Based on Kinect Depth Image. Beijing University of Posts and Telecommunications (2015)

    Google Scholar 

  14. Ye, C.: Research on the important role of computer image technology in visual communication design. Comput. CD Softw. Appl. 8, 183–184 (2014)

    Google Scholar 

  15. Margolis, M.: Arduino Cookbook. Post&Telecom Press (2015)

    Google Scholar 

  16. Wang, S.: Introduction to Kinect somatosensory programming. Science Press (2015)

    Google Scholar 

  17. Li, Y.: The design and implementation of a wireless hand piano system based on Arduino and Arduino control. Yunnan University (2015)

    Google Scholar 

  18. Bai, Z.: Research and Implementation of Sports Teaching System Based on Kinect. Tianjin University (2012)

    Google Scholar 

  19. Zhang, S.: Study on gesture recognition and national stringed instruments virtual. Playing Hangzhou Normal University (2015)

    Google Scholar 

  20. Lu, S.: Research and development of virtual instruments system based on depth camera. Central China Normal University (2016)

    Google Scholar 

Download references

Acknowledgments

This study has been partially supported by National Key Research and Development Program of China (No. 2016YFB1001300), Postdoctoral Science Foundation of China (2014M561294) and the Science, Technology Development Program Funded Projects of Jilin Province (20150520065JH) and Fundamental Research Funds for the Central Universities.

Author information

Authors and Affiliations

  1. College of Computer Science and Technology, Jilin University, Changchun, 130012, China

    Xiao-li Xu, Ming-hui Sun, Xin-yue Sun & Wei-yu Zhao

  2. Key Laboratory of Symbol Computation and Knowledge Engineering of the Ministry of Education, Jilin University, Changchun, 130012, China

    Ming-hui Sun

  3. College of Communication Engineering, Jilin University, Changchun, 130022, China

    Xiaoying Sun

Authors
  1. Xiao-li Xu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Ming-hui Sun
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Xin-yue Sun
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Wei-yu Zhao
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Xiaoying Sun
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Ming-hui Sun .

Editor information

Editors and Affiliations

  1. Central South University, Changsha, China

    Beiji Zou

  2. Harbin Engineering University, Harbin, China

    Qilong Han

  3. Harbin University of Science and Technology, Harbin, China

    Guanglu Sun

  4. Northeast Forestry University, Harbin, China

    Weipeng Jing

  5. Huaihua University, Huaihua, Hunan, China

    Xiaoning Peng

  6. Sciences of Country Tripod Institute of Data Science, Harbin, China

    Zeguang Lu

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Springer Nature Singapore Pte Ltd.

About this paper

Cite this paper

Xu, Xl., Sun, Mh., Sun, Xy., Zhao, Wy., Sun, X. (2017). Research and Development of Virtual Instruments System Based on Depth Camera. In: Zou, B., Han, Q., Sun, G., Jing, W., Peng, X., Lu, Z. (eds) Data Science. ICPCSEE 2017. Communications in Computer and Information Science, vol 728. Springer, Singapore. https://doi.org/10.1007/978-981-10-6388-6_9

Download citation

  • DOI: https://doi.org/10.1007/978-981-10-6388-6_9

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-10-6387-9

  • Online ISBN: 978-981-10-6388-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation