Abstract
This paper proposes a temporal Grouping and pattern analysis-based algorithm that could track the fingertips of guitarists during their guitar playing towards the actualization of the automatic guitar fingering recognition system. First a machine learning-based Bayesian Pixel Classifier is used to segment the hand area on the test data. Then, the probability map of fingertip is generated on the segmentation results by counting the voting numbers of the Template Matching and Reversed Hough Transform. Furthermore, a temporal Grouping algorithm, which is a geometry analysis for consecutive frames, is applied to removal noise and group the same fingertips (index finger, middle finger, ring finger, little finger). Then, a data association algorithm is utilized to associate 4 tracked fingers (index finger, middle finger, ring finger, little finger) with their correspondent tracked results frame by frame. Finally, particles are distributed only between the associated fingertip candidates to track the fingertips of guitarist effectively. The experimental result demonstrates that this fingertip tracking algorithm is robust enough for tracking fingertips (1) without any constrains such us color marker; (2) under the complex contexts, such us complicated background, different illumination conditions, (3) with the high tracking accuracy (mean error 3.36 pixels for four fingertips).
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Radisavljevic, A., Driessen, P.: Path difference learning for guitar fingering problem. In: Proceedings of the International Computer Music Conference, vol. 28 (2004)
Radicioni, D., Lombardo, V.: Guitar fingering for music performance strings. 40(45) (2005)
Sayegh, S.I.: Fingering for string instruments with the optimum path paradigm. Comput. Music J. 13(3), 76–83 (1989)
Motokawa, Y., Saito, H.: Support system for guitar playing using augmented reality display. In: Proceedings of the Fifth IEEE and ACM International Symposium on Mixed and Augmented Reality (ISMAR 2006), pp. 243–244. IEEE Computer Society (2006)
Scarr, J., Green, R.: Retrieval of guitarist fingering information using computer vision. In: 25th International Conference on Image and Vision Computing New Zealand (IVCNZ), Queenstown, New Zealand, 8–9 November 2010, pp. 1–7 (2010). ISSN2151-2191
Burns, A.: Visual methods for the retrieval of guitarist fingering. In: Proceedings of the Conference on New Interfaces for Musical Expression, Paris, France, pp. 196–199 (2006). ISBN: 2-84426-314-3
Kerdvibulvech, C., Saito, H.: Real-time guitar chord estimation by stereo cameras for supporting guitarists. In: Proceedings of 10th International Workshop on Advanced Image Technology 2007 (IWAIT 2007), Bangkok, Thailand, pp. 147–152, January 2007
Kerdvibulvech, C., Saito, H.: Guitarist fingertip tracking by integrating a Bayesian classifier into particle filters. Int. J. Adv. Hum.-Comput. Interact. (AHCI), 10 p. (2008). Hindawi Publishing Corporation. ISSN 1687-5893
Kerdvibulvech, C., Saito, H.: Markerless guitarist fingertip detection using a Bayesian classifier and a template matching for supporting guitarists. In: Proceedings of the 10th ACM/IEEE Virtual Reality International Conference, VRIC 2008, Laval, France (2008)
Ng, W., Li, J., Godsill, S., Vermaak, J.: A hybrid approach for online joint detection and tracking for multiple targets. In: Proceedings of IEEE Aerospace Conferences, pp. 2126–2141 (2005)
Zhao, W., Ohya, J.: Research on detecting and tracking the guitar neck and guitarist’s fingers from a video sequence. EI (Electron. Imaging), D-11-12, San Francisco (2016)
Kovac, J., Peer, P., Solina, F.: Human skin color group for face detection, vol. 2. IEEE (2003)
http://www.guitarworld.com/three-steps-shred-fundamental-daily-practice-techniques-about-15-minutes
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2017 Springer International Publishing AG
About this paper
Cite this paper
Wang, Z., Ohya, J. (2017). Fingertips Tracking Algorithm for Guitarist Based on Temporal Grouping and Pattern Analysis . In: Chen, CS., Lu, J., Ma, KK. (eds) Computer Vision – ACCV 2016 Workshops. ACCV 2016. Lecture Notes in Computer Science(), vol 10118. Springer, Cham. https://doi.org/10.1007/978-3-319-54526-4_16
Download citation
DOI: https://doi.org/10.1007/978-3-319-54526-4_16
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-54525-7
Online ISBN: 978-3-319-54526-4
eBook Packages: Computer ScienceComputer Science (R0)