ABSTRACT
In the last years, the introduction of new, precise and pervasive tracking devices has contributed to the popularity of gestural interaction. In general, the effectiveness of such interfaces depends on two components: the algorithm used for accurately recognizing the user movements and the guidance provided to users while executing gestures. In this paper, we discuss a work in progress research for connecting these two components and increasing their effectiveness: the recognition algorithm supports the implementation of feedback the and feed-forward mechanisms, providing information on the identified gesture parts in real time, while developers define complex gestures starting from simple primitives.
- Alessandro Carcangiu, Lucio Davide Spano, Giorgio Fumera, and Fabio Roli. 2017. Gesture modelling and recognition by integrating declarative models and pattern recognition algorithms. In International Conference on Image Analysis and Processing. Springer, 84--95.Google ScholarCross Ref
- Alessandro Carcangiu, Lucio Davide Spano, Giorgio Fumera, and Fabio Roli. 2019. DEICTIC: A compositional and declarative gesture description based on hidden markov models. International Journal of Human-Computer Studies 122 (2019), 113--132.Google ScholarCross Ref
- Kenrick Kin, B Hartmann, T DeRose, and Maneesh Agrawala. 2012. Proton++ : A Customizable Declarative Multitouch Framework. In Proceedings of UIST 2012. ACM Press, Berkeley, California, USA, 477--486. Google ScholarDigital Library
- Kenrick Kin, B Hartmann, T DeRose, and Maneesh Agrawala. 2012. Proton: multitouch gestures as regular expressions. In Proceedings of CHI 2012. ACM Press, Austin, Texas, USA, 2885--2894. Google ScholarDigital Library
- Lawrence R Rabiner. 1989. A tutorial on hidden Markov models and selected applications in speech recognition. Proc. IEEE 77, 2 (1989), 257--286.Google ScholarCross Ref
- Lucio Davide Spano, Antonio Cisternino, and Fabio Paternö. 2012. A Compositional Model for Gesture Definition. In Proceedings of HCSE 2012. Springer, 34--52. Google ScholarDigital Library
- Lucio Davide Spano, Antonio Cisternino, Fabio Paternò, and Gianni Fenu. 2013. GestIT: a Declarative and Compositional Framework for Multiplatform Gesture Definition. In Proceedings of EICS 2013. ACM, 187--196. Google ScholarDigital Library
- Jo Vermeulen, Kris Luyten, Elise van den Hoven, and Karin Coninx. 2013. Crossing the bridge over Norman's Gulf of Execution: revealing feedforward's true identity. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 1931--1940. Google ScholarDigital Library
- Jacob O. Wobbrock, Andrew D. Wilson, and Yang Li. 2007. Gestures Without Libraries, Toolkits or Training: A $1 Recognizer for User Interface Prototypes. In Proceedings of the 20th Annual ACM Symposium on User Interface Software and Technology (UIST '07). ACM, New York, NY, USA, 159--168. Google ScholarDigital Library
Index Terms
- Integrating declarative models and HMMs for online gesture recognition
Recommendations
G-Gene: A Gene Alignment Method for Online Partial Stroke Gestures Recognition
The large availability of touch-sensitive screens fostered the research in gesture recognition. The Machine Learning community focused mainly on accuracy and robustness to noise, creating classifiers that precisely recognize gestures after their ...
Hand Gesture Recognition Using Input-Output Hidden Markov Models
FG '00: Proceedings of the Fourth IEEE International Conference on Automatic Face and Gesture Recognition 2000A new hand gesture recognition method based on Input-Output Hidden Markov Models is presented. This method deals with the dynamic aspects of gestures. Gestures are extracted from a sequence of video images by tracking the skin-color blobs corresponding ...
Gesture Recognition through Declarative and Classifier Approach
IUI '17 Companion: Companion Proceedings of the 22nd International Conference on Intelligent User InterfacesNow, users can easily provide input relying on body movements through the newest tracking devices. The available solutions have a mismatch: on one hand, classifiers offer a high precision, but their structure is difficult to inspect for providing ...
Comments