skip to main content
10.1145/3508546.3508655acmotherconferencesArticle/Chapter ViewAbstractPublication PagesacaiConference Proceedingsconference-collections
research-article

3D Hand Pose Estimation for Guqin Performance

Authors Info & Claims
Published:25 February 2022Publication History

ABSTRACT

3D Hand Pose Estimations an important research content in the field of human-computer interaction, virtual reality, augmented reality and other gesture interaction. In this paper, 3D hand pose surface estimation based on personalized hand features is proposed and applied to guqin performance. We constructed the database of basic finger-pointing for guqin performance,and based on the Mask R-CNN and FPN network structure, a new MMFPN structure is proposed, which can not only realize the three-dimensional surface estimation of basic finger-pointing, but also effectively solve the problem of self-occlusion.

References

  1. Rui Li, ZhengyuLiu,Jianrong Tan. A survey on 3D hand pose estimation: Cameras, methods, and datasets. Pattern Reconition.2019,93:251-272Google ScholarGoogle Scholar
  2. L.Dipietro, A.M.Sabatini, P.Dario, A survey of glove-based systems and theirapplications, IEEE Trans. Syst. Man Cybern. Part C Appl. Rev. 2018,38 (4):461-482.Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. J.M.Rehg, T.Kanade, Visual tracking of high DOF articulated structures: anapplication to human hand tracking, Eur. Conf. Comput. Vis. 1994,801: 35-46.Google ScholarGoogle Scholar
  4. AmmarAhmad,CyrilleMiniot,AlberDipanda. Hand pose estimation and tracking in real and virtual interaction:Areview.Image and Vision Computing .2019,89:35-49Google ScholarGoogle Scholar
  5. A.Erol, G. Bebis, M. , Vision-based hand poseestimation: a review, Comput. Vis. Image Underst. 2017,108 (1-2): 52-73.Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Yiming He, Wei Hu, GraphPoseGAN: 3D Hand Pose Estimation from aMonocular RGB Image via Adversarial Learning onGraphs.Computer Vision and Pattern Recognition .2019Google ScholarGoogle Scholar
  7. SHARP T, KESKIN C, ROBERTSON D, Accurate,robust, and flexible real-time hand tracking[C]//Proceedingsof the 33th Annual ACM Conference on Human Factors inComputing Systems. Seoul, Republic of Korea: ACM, 2015:3633-3642.Google ScholarGoogle Scholar
  8. L.Ge, H.Liang ,J.Yuan , D.Thalmann , 3D convolutional neural networks for efficient and robust hand pose estimation from single depth images, in: IEEE Computer Vision and Pattern Recognition, 2017:5679–5688 .Google ScholarGoogle Scholar
  9. Kuang Y.Q.,Cheng H.,Cui F.,Semi-supervised hand pose estimation algorithm based on multi-view projection, Journal of University of Electronic Science and Technology of China.2019,48(5):747-753Google ScholarGoogle Scholar
  10. LiuhaoGe, Zhou Ren , 3D Hand Shape and Pose Estimation from a Single RGB Image.in CVPR2019.Google ScholarGoogle Scholar
  11. Xiong Zhang, Qiang Li, End-to-end Hand Mesh Recovery from a Monocular RGB Image. Computer Vision and Pattern Recognition.2019Google ScholarGoogle Scholar
  12. L. Ge, H.Liang, Real-time 3D hand pose estimation with 3D convolutional neural networks, IEEE Trans. Pattern Anal. Mach. Intell. 2019,41 (4) :956–970.Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. Varol G, Ceylan D, Bodynet:Volumetric inference of 3D human body shapes[C]//Proceedings of the European Conference on Computer Vision, 2018:20-36.Google ScholarGoogle Scholar
  14. Pavllo D, Feichtenhofer C, 3D human pose estimation in video with temporal convolutions andsemi-supervised training[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2019:7753-7762.Google ScholarGoogle Scholar
  15. Zeng Z. C.,Li G. Q.,Posture and shape reconstruction of 3d mannequin. Journal of Computer Aided Design and Graphics.2019,32(9):1485-1493。Google ScholarGoogle Scholar
  16. Franziska Mueller, Micah Davis, Real-time Pose and Shape Reconstruction of Two Interacting Hands With a Single Depth Camera. ACM Trans. Graph.38, 4, Article 49 (July 2019), 13 pages. https://doi.org/10.1145/3306346.3322958]Google ScholarGoogle Scholar
  17. Jameel Malik, Ahmed Elhayek, DeepHPS: End-to-end Estimation of 3D Hand Pose and Shape by Learning fromSynthetic Depth. Computer Vision and Pattern Recognition.2018]Google ScholarGoogle Scholar
  18. L.Ge, H.Liang,J.Yuan ,D.Thalmann , 3D convolutional neural networks for efficient and robust hand pose estimation from single depth images, in: IEEE Computer Vision and Pattern Recognition, 2017:5679–5688 .Google ScholarGoogle Scholar

Recommendations

Comments

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Sign in
  • Published in

    cover image ACM Other conferences
    ACAI '21: Proceedings of the 2021 4th International Conference on Algorithms, Computing and Artificial Intelligence
    December 2021
    699 pages
    ISBN:9781450385053
    DOI:10.1145/3508546

    Copyright © 2021 ACM

    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    • Published: 25 February 2022

    Permissions

    Request permissions about this article.

    Request Permissions

    Check for updates

    Qualifiers

    • research-article
    • Research
    • Refereed limited

    Acceptance Rates

    Overall Acceptance Rate173of395submissions,44%
  • Article Metrics

    • Downloads (Last 12 months)10
    • Downloads (Last 6 weeks)1

    Other Metrics

PDF Format

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format .

View HTML Format