Abstract
In this paper, we report on the design of 19 foot-movements (or gestures) for a soccer game on a mobile phone, all of which are performed by professional footballers. In our experiment, a person wore a Myo armband below the knee and performed each movement, and an accelerometer-based gesture recognition system on an Android smartphone was used to map out each movement. The recognition system ran on a limited memory device, and so a light gesture recognition method was required. Therefore, a real-time online dynamic time warping algorithm was used, since this is faster than a classical method. The algorithm-generated results are comparable with those obtained on workstations, and an average recognition rate of 91 % was obtained.
Similar content being viewed by others
References
Alexander, J., Han, T., Judd, W., Irani, P., & Subramanian, S. (2012). Putting your best foot forward: Investigating real-world mappings for foot-based gestures. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (pp. 1229–1238).
Alon, J., Athitsos, V., Yuan, Q., & Sclaroff, S. (2009). A unified framework for gesture recognition and spatiotemporal gesture segmentation. IEEE Transactions on Pattern Analysis and Machine Intelligence, 31(9), 1685–1699.
Arts, E. Fifa. http://www.ea.com/ca/fifa/.
Berman, S., & Stern, H. (2012). Sensors for gesture recognition systems. IEEE Transactions on Systems, Man, and Cybernetics, Part C: Applications and Reviews, 42(3), 277–290.
Bouchard, B., Imbeault, F., Bouzouane, A., & Menelas, B. A. J. (2012). Developing serious games specifically adapted to people suffering from alzheimer. In Serious games development and applications (pp. 243–254). Springer.
Bourgault, N., Bouchard, B., & Menelas, B. A. J. (2014). Effect of ecological gestures on the immersion of the player in a serious game. In Serious games development and applications (pp. 21–33). Springer.
Boyle, E., Kennedy, A. M., Traynor, O., & Hill, A. D. (2011). Training surgical skills using nonsurgical tasks—Can nintendo WII™ improve surgical performance? Journal of Surgical Education, 68(2), 148–154.
Brahem, M. B., Ménélas, B. A. J., & Otis, M. J. D. (2013). Use of a 3DOF accelerometer for foot tracking and gesture recognition in mobile HCI. Procedia Computer Science, 19, 453–460.
Brassard, S., Otis, M. J. D., Poirier, A., & Menelas, B. A. J. (2012). Towards an automatic version of the berg balance scale test through a serious game. In Proceedings of the Second ACM Workshop on Mobile Systems, Applications, and Services for Healthcare, Article 5, 6 pages. ACM.
Burke, J. W., McNeill, M., Charles, D. K., Morrow, P. J., Crosbie, J. H., & McDonough, S. M. (2009). Optimising engagement for stroke rehabilitation using serious games. The Visual Computer, 25(12), 1085–1099.
Chatzis, S. P., Kosmopoulos, D. I., & Varvarigou, T. A. (2009). Robust sequential data modeling using an outlier tolerant hidden markov model. IEEE Transactions on Pattern Analysis and Machine Intelligence, 31(9), 1657–1669.
Dai, J., Bai, X., Yang, Z., Shen, Z., & Xuan, D. (2010). Perfalld. A pervasive fall detection system using mobile phones. In 2010 8th IEEE International Conference on Pervasive Computing and Communications Workshops (PERCOM Workshops) (pp. 292–297). IEEE.
Fifa Fifa. https://www.fifa.com/.
Frey, B. J., & Dueck, D. (2007). Clustering by passing messages between data points. Science, 315(5814), 972–976.
Han, T., Alexander, J., Karnik, A., Irani, P., & Subramanian, S. (2011). Kick investigating the use of kick gestures for mobile interactions. In M. Bylund, O. Juhlin & Y. Fernaeus (Eds.), Mobile HCI (pp. 29–32). ACM.
Hwang, K., & Lee, J. M. (2013). An implementation experience of accelerometer-based gesture recognition with android smartphone. International Journal of Advancements in Computing Technology, 5(12), 305.
Jensen, M. M., Rasmussen, M. K., Mueller, F., & Grønbæk, K. (2015). Designing training games for soccer. Interactions, 22(2), 36–39.
Katzourin, M., Ignatoff, D., Quirk, L., LaViola, J., & Jenkins, O. C. (2006). Swordplay: Innovating game development through vr. IEEE Computer Graphics and Applications, 26(6), 15–19.
Keogh, E., & Ratanamahatana, C. A. (2005). Exact indexing of dynamic time warping. Knowledge and Information Systems, 7(3), 358–386.
Labs, T. Myo. https://www.thalmic.com/myo/.
Lipscomb, J. S. (1991). A trainable gesture recognizer. Pattern Recognition, 24(9), 895–907.
Liu, J., Zhong, L., Wickramasuriya, J., & Vasudevan, V. (2009). uWave: Accelerometer-based personalized gesture recognition and its applications. Pervasive and Mobile Computing, 5(6), 657–675.
Lv, Z., Halawani, A., Feng, S., Li, H., & Réhman, S. U. (2014). Multimodal hand and foot gesture interaction for handheld devices. ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM), 11(1s), 10.
Menelas, B. A. J., & Otis, M. J. D. (2013). Use of foot for direct interactions with entities of a virtual environment displayed on a mobile device. In IEEE International Conference on Systems, Man, and Cybernetics (pp. 3745–3750). Manchester: IEEE.
Menelas, B., Picinalli, L., Katz, B. F., & Bourdot, P. (2010). Audio haptic feedbacks for an acquisition task in a multi-target context. In 2010 IEEE Symposium on 3D User Interfaces (3DUI) (pp. 51–54). IEEE.
Menelas, B., Hu, Y., Lahamy, H., & Lichti, D. (2011). Haptic and gesture-based interactions for manipulating geological datasets. In 2011 IEEE International Conference on Systems, Man, and Cybernetics (SMC) (pp. 2051–2055). IEEE.
Menelas, B. A. J., Picinali, L., Bourdot, P., & Katz, B. F. (2014). Non-visual identification, localization, and selection of entities of interest in a 3D environment. Journal on Multimodal User Interfaces, 8(3), 243–256.
Milanovic, B. (2005). Globalization and goals: Does soccer show the way? Review of International Political Economy, 12(5), 829–850.
Mitra, S., & Acharya, T. (2007). Gesture recognition: A survey. IEEE Transactions on Systems, Man, and Cybernetics, Part C: Applications and Reviews, 37(3), 311–324.
Nguyen-Dinh, L. V., Roggen, D., Calatroni, A., & Troster, G. (2012). Improving online gesture recognition with template matching methods in accelerometer data. In 2012 12th International Conference on, Intelligent Systems Design and Applications (ISDA) (pp. 831–836). IEEE.
Plantevin, V., & Menelas, B. A. J. (2014). Use of ecological gestures in soccer games running on mobile devices. The International Journal of Serious Games 1(4).
Poli, G., Mari, J. F., Saito, J. H., & Levada, A. L. (2007). Voice command recognition with dynamic time warping (DTW) using graphics processing units (GPU) with compute unified device architecture (CUDA). In 19th International Symposium on Computer Architecture and High Performance Computing, 2007. SBAC-PAD 2007 (pp. 19–25). IEEE.
Schlӧmer, T., Poppinga, B., Henze, N., & Boll, S. (2008). Gesture recognition with a Wii controller. In Proceedings of the 2nd International Conference on Tangible and Embedded Interaction (pp. 11–14). ACM.
Scott, J., Dearman, D., Yatani, K., & Truong, K. N. (2010). Sensing foot gestures from the pocket. In Proceedings of the 23rd Annual ACM Symposium on User Interface Software and Technology, UIST’10 (pp. 199–208). New York, NY: ACM.
Vandewynckel, J., Otis, M., Bouchard, B., Menelas, B. A., & Bouzouane, A. (2013). Towards a real-time error detection within a smart home by using activity recognition with a shoe-mounted accelerometer. Procedia Computer Science, 19, 516–523.
Velloso, E., Schmidt, D., Alexander, J., Gellersen, H., & Bulling, A. (2015). The feet in human–computer interaction: A survey of foot-based interaction. ACM Computer Survey, 48(2), Article 21.
Yamagiri, Y., Kitahara, I., Kameda, Y., & Ohta, Y. (2013). Body motion design for maneuvering a virtual camera in 3D soccer game. In Proceedings of 23th International Conference on Artificial Reality and Telexistence (Vol. 2).
Zhang, X., Chen, X., Li, Y., Lantz, V., Wang, K., & Yang, J. (2011). A framework for hand gesture recognition based on accelerometer and emg sensors. IEEE Transactions on Systems, Man and Cybernetics, Part A: Systems and Humans, 41(6), 1064–1076.
Zhong, K., Tian, F., & Wang, H. (2011). Foot menu: Using heel rotation information for menu selection. In Proceedings of the 2011 15th Annual International Symposium on Wearable Computers, ISWC’11 (pp. 115–116). Washington, DC: IEEE Computer Society.
Acknowledgments
This work has been supported by the Natural Sciences and Engineering Research Council of Canada (NSERC), through the discovery Grant of Dr. Bob-Antoine J. Menelas Number 418624-2013.
Author information
Authors and Affiliations
Corresponding author
About this article
Cite this article
Lavoie, T., Menelas, BA.J. Design of a Set of Foot Movements for a Soccer Game on a Mobile Phone. Comput Game J 5, 131–148 (2016). https://doi.org/10.1007/s40869-016-0024-1
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s40869-016-0024-1