research-article

Shoes++: A Smart Detachable Sole for Social Foot-to-foot Interaction

Authors:

Xiang 'Anthony' Chen,

Guanyun WangAuthors Info & Claims

Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, Volume 6, Issue 2

Article No.: 85, Pages 1 - 29

https://doi.org/10.1145/3534620

Published: 07 July 2022 Publication History

Abstract

Feet are the foundation of our bodies that not only perform locomotion but also participate in intent and emotion expression. Thus, foot gestures are an intuitive and natural form of expression for interpersonal interaction. Recent studies have mostly introduced smart shoes as personal gadgets, while foot gestures used in multi-person foot interactions in social scenarios remain largely unexplored. We present Shoes++, which includes an inertial measurement unit (IMU)-mounted sole and an input vocabulary of social foot-to-foot gestures to support foot-based interaction. The gesture vocabulary is derived and condensed by a set of gestures elicited from a participatory design session with 12 users. We implement a machine learning model in Shoes++ which can recognize two-person and three-person social foot-to-foot gestures with 94.3% and 96.6% accuracies (N=18). In addition, the sole is designed to easily attach to and detach from various daily shoes to support comfortable social foot interaction without taking off the shoes. Based on users' qualitative feedback, we also found that Shoes++ can support team collaboration and enhance emotion expression, thus making social interactions or interpersonal dynamics more engaging in an expanded design space.

Supplemental Material

ZIP File - yan

Supplemental movie, appendix, image and software files for, Shoes++: A Smart Detachable Sole for Social Foot-to-foot Interaction

Download
101.65 MB

References

[1]

Davide Jose Nogueira Amorim, Troy Nachtigall, and Miguel Bruns Alonso. 2019. Exploring mechanical meta-material structures through personalised shoe sole design. In Proceedings of the ACM Symposium on Computational Fabrication. Association for Computing Machinery, New York, NY, USA, 1--8.

Digital Library

[2]

Takashi Aoki, Jonathan Feng-Shun Lin, Dana Kulić, and Gentiane Venture. 2016. Segmentation of human upper body movement using multiple IMU sensors. In 2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC). IEEE, IEEE, Orlando, FL, USA, 3163--3166.

[3]

Nivedita Arora and Gregory D Abowd. 2018. ZEUSSS: Zero energy ubiquitous sound sensing surface leveraging triboelectric nanogenerator and analog backscatter communication. In The 31st Annual ACM Symposium on User Interface Software and Technology Adjunct Proceedings. Association for Computing Machinery, New York, NY, USA, 81--83.

Digital Library

[4]

Thomas Augsten, Konstantin Kaefer, René Meusel, Caroline Fetzer, Dorian Kanitz, Thomas Stoff, Torsten Becker, Christian Holz, and Patrick Baudisch. 2010. Multitoe: high-precision interaction with back-projected floors based on high-resolution multi-touch input. In Proceedings of the 23nd annual ACM symposium on User interface software and technology. Association for Computing Machinery, New York, NY, USA, 209--218.

Digital Library

[5]

Gilles Bailly, Jörg Müller, Michael Rohs, Daniel Wigdor, and Sven Kratz. 2012. Shoesense: a new perspective on gestural interaction and wearable applications. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, 1239--1248.

Digital Library

[6]

Katerina Baousi, Nate Fear, Christos Mourouzis, Ben Stokes, Henry Wood, Paul Worgan, and Anne Roudaut. 2017. Inflashoe: A shape changing shoe to control underfoot pressure. In Proceedings of the 2017 CHI Conference extended abstracts on human factors in computing systems. Association for Computing Machinery, New York, NY, USA, 2381--2387.

Digital Library

[7]

Xavier Benavides, Chang Long Zhu Jin, Pattie Maes, and Joseph Paradiso. 2015. KickSoul: A wearable system for feet interactions with digital devices. In Adjunct Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology. Association for Computing Machinery, New York, NY, USA, 83--84.

Digital Library

[8]

Frank J Bernieri and Robert Rosenthal. 1991. Interpersonal coordination: Behavior matching and interactional synchrony. Fundamentals of nonverbal behavior 0, 0 (1991), 401--432.

[9]

Idil Bostan, Oğuz Turan Buruk, Mert Canat, Mustafa Ozan Tezcan, Celalettin Yurdakul, Tilbe Göksun, and Oğuzhan Özcan. 2017. Hands as a controller: User preferences for hand specific on-skin gestures. In Proceedings of the 2017 Conference on Designing Interactive Systems. Association for Computing Machinery, New York, NY, USA, 1123--1134.

Digital Library

[10]

Madjda Bouklachi, Marc Biancheri-Astier, Antoine Diet, and Yann Le Bihan. 2019. Energy Harvesting of a NFC Flexible Patch for Medical Applications. In 2019 IEEE Wireless Power Transfer Conference (WPTC). IEEE, 2019 IEEE Wireless Power Transfer Conference, London, UK, 249--252.

[11]

Alan Bränzel, Christian Holz, Daniel Hoffmann, Dominik Schmidt, Marius Knaust, Patrick Lühne, René Meusel, Stephan Richter, and Patrick Baudisch. 2013. GravitySpace: tracking users and their poses in a smart room using a pressure-sensing floor. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, 725--734.

[12]

Justin Chan and Shyamnath Gollakota. 2017. Data storage and interaction using magnetized fabric. In Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology. Association for Computing Machinery, New York, NY, USA, 655--663.

Digital Library

[13]

Victor Chen, Xuhai Xu, Richard Li, Yuanchun Shi, Shwetak Patel, and Yuntao Wang. 2021. Understanding the Design Space of Mouth Microgestures. In Designing Interactive Systems Conference 2021 (Virtual Event, USA) (DIS '21). Association for Computing Machinery, New York, NY, USA, 1068--1081. https://doi.org/10.1145/3461778.3462004

Digital Library

[14]

A Cosco. 2016. The social age of wearable tech: From Quantified Self to emotional second skin," Wareable. Retrieved September 15 (2016), 2016.

[15]

Rafael De Pinho André, Pedro Henrique FS Diniz, and Hugo Fuks. 2017. Bottom-up investigation: Human activity recognition based on feet movement and posture information. In Proceedings of the 4th international Workshop on Sensor-based Activity Recognition and Interaction. Association for Computing Machinery, New York, NY, USA, 1--6.

Digital Library

[16]

Omid Dehzangi, Mojtaba Taherisadr, and Raghvendar ChangalVala. 2017. IMU-based gait recognition using convolutional neural networks and multi-sensor fusion. Sensors 17, 12 (2017), 2735.

[17]

Emilie Delaherche and Mohamed Chetouani. 2010. Multimodal coordination: exploring relevant features and measures. In Proceedings of the 2nd international workshop on Social signal processing. Association for Computing Machinery, New York, NY, USA, 47--52.

Digital Library

[18]

Emilie Delaherche, Mohamed Chetouani, Ammar Mahdhaoui, Catherine Saint-Georges, Sylvie Viaux, and David Cohen. 2012. Interpersonal synchrony: A survey of evaluation methods across disciplines. IEEE Transactions on Affective Computing 3, 3 (2012), 349--365.

Digital Library

[19]

Tilman Dingler, Rufat Rzayev, Alireza Sahami Shirazi, and Niels Henze. 2018. Designing Consistent Gestures Across Device Types: Eliciting RSVP Controls for Phone, Watch, and Glasses. Association for Computing Machinery, New York, NY, USA, 1--12. https://doi.org/10.1145/3173574.3173993

Digital Library

[20]

Haiwei Dong, Ali Danesh, Nadia Figueroa, and Abdulmotaleb El Saddik. 2015. An elicitation study on gesture preferences and memorability toward a practical hand-gesture vocabulary for smart televisions. IEEE access 3 (2015), 543--555.

[21]

Christopher Moufawad El Achkar, Fabien Massé, Arash Arami, and Kamiar Aminian. 2013. Physical activity recognition via minimal inshoes force sensor configuration. In 2013 7th International Conference on Pervasive Computing Technologies for Healthcare and Workshops. Ieee, ICST (Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering), Brussels, BEL, 256--259.

[22]

Bjoern M Eskofier, Sunghoon Ivan Lee, Manuela Baron, André Simon, Christine F Martindale, Heiko Gaßner, and Jochen Klucken. 2017. An overview of smart shoes in the internet of health things: gait and mobility assessment in health promotion and disease monitoring. Applied Sciences 7, 10 (2017), 986.

[23]

Hessam Jahani Fariman, Hasan J Alyamani, Manolya Kavakli, and Len Hamey. 2016. Designing a user-defined gesture vocabulary for an in-vehicle climate control system. In Proceedings of the 28th Australian Conference on Computer-Human Interaction. Association for Computing Machinery, New York, NY, USA, 391--395.

Digital Library

[24]

Yasmin Felberbaum and Joel Lanir. 2018. Better Understanding of Foot Gestures: An Elicitation Study. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, 1--12. https://doi.org/10.1145/3173574.3173908

Digital Library

[25]

Martin Frey. 2007. CabBoots: Shoes with Integrated Guidance System. In Proceedings of the 1st International Conference on Tangible and Embedded Interaction (Baton Rouge, Louisiana) (TEI '07). Association for Computing Machinery, New York, NY, USA, 245--246. https://doi.org/10.1145/1226969.1227019

Digital Library

[26]

Xiaoyan Fu and Dahai Li. 2005. Haptic shoes: representing information by vibration. In proceedings of the 2005 Asia-Pacific symposium on Information visualisation-Volume 45. Australian Computer Society, Inc., AUS, 47--50.

Digital Library

[27]

Koumei Fukahori, Daisuke Sakamoto, and Takeo Igarashi. 2015. Exploring Subtle Foot Plantar-Based Gestures with Sock-Placed Pressure Sensors. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (Seoul, Republic of Korea) (CHI '15). Association for Computing Machinery, New York, NY, USA, 3019--3028. https://doi.org/10.1145/2702123.2702308

Digital Library

[28]

Bogdan-Florin Gheran, Jean Vanderdonckt, and Radu-Daniel Vatavu. 2018. Gestures for smart rings: empirical results, insights, and design implications. In Proceedings of the 2018 Designing Interactive Systems Conference. Association for Computing Machinery, New York, NY, USA, 623--635.

Digital Library

[29]

Ian Gibson, Bhat Nikhil Jagdish, Gao Zhan, Khatereh Hajizedah, Hyunh Kim Tho, Huang Mengjie, and Chevanthie Dissanayake. 2012. Development of a human spine simulation system. Advances in Therapeutic Engineering 0, 0 (2012), 1.

[30]

Fabian Göbel, Konstantin Klamka, Andreas Siegel, Stefan Vogt, Sophie Stellmach, and Raimund Dachselt. 2013. Gaze-Supported Foot Interaction in Zoomable Information Spaces. In CHI '13 Extended Abstracts on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, 3059--3062. https://doi.org/10.1145/2468356.2479610

Digital Library

[31]

Yizheng Gu, Chun Yu, Zhipeng Li, Weiqi Li, Shuchang Xu, Xiaoying Wei, and Yuanchun Shi. 2019. Accurate and low-latency sensing of touch contact on any surface with finger-worn imu sensor. In Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology. Association for Computing Machinery, New York, NY, USA, 1059--1070.

Digital Library

[32]

Yizheng Gu, Chun Yu, Zhipeng Li, Zhaoheng Li, Xiaoying Wei, and Yuanchun Shi. 2020. QwertyRing: Text Entry on Physical Surfaces Using a Ring. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 4, 4 (2020), 1--29.

Digital Library

[33]

Yang Han, Chunbao Liu, Lingyun Yan, and Lei Ren. 2021. Design of decision tree structure with improved BPNN nodes for high-accuracy locomotion mode recognition using a single IMU. Sensors 21, 2 (2021), 526.

[34]

Benjamin Hatscher and Christian Hansen. 2018. Hand, Foot or Voice: Alternative Input Modalities for Touchless Interaction in the Medical Domain. In Proceedings of the 20th ACM International Conference on Multimodal Interaction (Boulder, CO, USA) (ICMI '18). Association for Computing Machinery, New York, NY, USA, 145--153. https://doi.org/10.1145/3242969.3242971

Digital Library

[35]

Benjamin Hatscher, Maria Luz, Lennart E. Nacke, Norbert Elkmann, Veit Müller, and Christian Hansen. 2017. GazeTap: Towards Hands-Free Interaction in the Operating Room. In Proceedings of the 19th ACM International Conference on Multimodal Interaction (Glasgow, UK) (ICMI '17). Association for Computing Machinery, New York, NY, USA, 243--251. https://doi.org/10.1145/3136755.3136759

Digital Library

[36]

Ken Hinckley. 2003. Synchronous gestures for multiple persons and computers. In Proceedings of the 16th annual ACM symposium on User interface software and technology. Association for Computing Machinery, New York, NY, USA, 149--158.

Digital Library

[37]

Chengli Hou. 2020. A study on IMU-based human activity recognition using deep learning and traditional machine learning. In 2020 5th International Conference on Computer and Communication Systems (ICCCS). IEEE, Shanghai, China, 225--234.

[38]

Kunpeng Huang, Ruojia Sun, Ximeng Zhang, Md Tahmidul Islam Molla, Margaret Dunne, Francois Guimbretiere, and Cindy Hsin-Liu Kao. 2021. WovenProbe: Probing Possibilities for Weaving Fully-Integrated On-Skin Systems Deployable in the Field. In Designing Interactive Systems Conference 2021. Association for Computing Machinery, New York, NY, USA, 1143--1158.

Digital Library

[39]

Hayley Hung, Gwenn Englebienne, and Laura Cabrera Quiros. 2014. Detecting conversing groups with a single worn accelerometer. In Proceedings of the 16th international conference on multimodal interaction. Association for Computing Machinery, New York, NY, USA, 84--91.

Digital Library

[40]

Nike Inc. 2019. Nike Adapt.

[41]

Filip D. Jevtić and Rade T. Živaljević. 2021. Bier spheres of extremal volume and generalized permutohedra. https://doi.org/10.48550/ARXIV.2108.00618

[42]

Adam Kendon. 1990. Spatial organization in social encounters: The F-formation system. Conducting interaction: Patterns of behavior in focused encounters 0, 0 (1990), 0 pages.

[43]

Heung Soo Kim, Joo-Hyong Kim, and Jaehwan Kim. 2011. A review of piezoelectric energy harvesting based on vibration. International journal of precision engineering and manufacturing 12, 6 (2011), 1129--1141.

[44]

Taeyong Kim, Hao Ju, and Jeremy R. Cooperstock. 2018. Pressure or Movement? Usability of Multi-Functional Foot-Based Interfaces. In Proceedings of the 2018 Designing Interactive Systems Conference (Hong Kong, China) (DIS '18). Association for Computing Machinery, New York, NY, USA, 1219--1227. https://doi.org/10.1145/3196709.3196759

Digital Library

[45]

Sven Kratz and Maribeth Back. 2015. Towards accurate automatic segmentation of imu-tracked motion gestures. In Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, 1337--1342.

Digital Library

[46]

Christine Kühnel, Tilo Westermann, Fabian Hemmert, Sven Kratz, Alexander Müller, and Sebastian Möller. 2011. I'm home: Defining and evaluating a gesture set for smart-home control. International Journal of Human-Computer Studies 69, 11 (2011), 693--704.

[47]

Jennifer R Kwapisz, Gary M Weiss, and Samuel A Moore. 2011. Activity recognition using cell phone accelerometers. ACM SigKDD Explorations Newsletter 12, 2 (2011), 74--82.

Digital Library

[48]

Hyeokhyen Kwon, Bingyao Wang, Gregory D Abowd, and Thomas Plötz. 2021. Approaching the Real-World: Supporting Activity Recognition Training with Virtual IMU Data. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 5, 3 (2021), 1--32.

Digital Library

[49]

DoYoung Lee, Youryang Lee, Yonghwan Shin, and Ian Oakley. 2018. Designing socially acceptable hand-to-face input. In Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology. Association for Computing Machinery, New York, NY, USA, 711--723.

Digital Library

[50]

Chen Liang, Chun Yu, Yue Qin, Yuntao Wang, and Yuanchun Shi. 2021. DualRing: Enabling Subtle and Expressive Hand Interaction with Dual IMU Rings. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 5, 3 (2021), 1--27.

Digital Library

[51]

Fannie Liu, Mario Esparza, Maria Pavlovskaia, Geoff Kaufman, Laura Dabbish, and Andrés Monroy-Hernández. 2019. Animo: Sharing Biosignals on a Smartwatch for Lightweight Social Connection. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 3, 1, Article 18 (mar 2019), 19 pages. https://doi.org/10.1145/3314405

Digital Library

[52]

Guanhong Liu, Yizheng Gu, Yiwen Yin, Chun Yu, Yuntao Wang, Haipeng Mi, and Yuanchun Shi. 2020. Keep the Phone in Your Pocket: Enabling Smartphone Operation with an IMU Ring for Visually Impaired People. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 4, 2 (2020), 1--23.

Digital Library

[53]

Xin Liu, Katia Vega, Pattie Maes, and Joe A. Paradiso. 2016. Wearability Factors for Skin Interfaces. In Proceedings of the 7th Augmented Human International Conference 2016 (Geneva, Switzerland) (AH '16). Association for Computing Machinery, New York, NY, USA, Article 21, 8 pages. https://doi.org/10.1145/2875194.2875248

Digital Library

[54]

Infitex Ltd. 2017. Info Soles.

[55]

Yiqin Lu, Bingjian Huang, Chun Yu, Guahong Liu, and Yuanchun Shi. 2020. Designing and Evaluating Hand-to-Hand Gestures with Dual Commodity Wrist-Worn Devices. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 4, 1 (2020), 1--27.

Digital Library

[56]

Zhihan Lv, Shengzhong Feng, Muhammad Sikandar Lal Khan, Shafiq Ur Réhman, and Haibo Li. 2014. Foot Motion Sensing: Augmented Game Interface Based on Foot Interaction for Smartphone. In CHI '14 Extended Abstracts on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, 293--296. https://doi.org/10.1145/2559206.2580096

Digital Library

[57]

Zhihan Lv, Alaa Halawani, Shengzhong Feng, Haibo Li, and Shafiq Ur Réhman. 2014. Multimodal Hand and Foot Gesture Interaction for Handheld Devices. ACM Trans. Multimedia Comput. Commun.Appl. 11, 1s, Article 10 (oct 2014), 19 pages. https://doi.org/10.1145/2645860

Digital Library

[58]

Sumit Majumder and M Jamal Deen. 2020. Wearable IMU-based system for real-time monitoring of lower-limb joints. IEEE Sensors Journal 21, 6 (2020), 8267--8275.

[59]

Eric Markvicka, Guanyun Wang, Yi-Chin Lee, Gierad Laput, Carmel Majidi, and Lining Yao. 2019. ElectroDermis: Fully Untethered, Stretchable, and Highly-Customizable Electronic Bandages. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI '19). Association for Computing Machinery, New York, NY, USA, 1--10. https://doi.org/10.1145/3290605.3300862

Digital Library

[60]

Jesús Martín-Vaquero, Ascensión Hernández Encinas, Araceli Queiruga-Dios, Juan José Bullón, Alfonso Martínez-Nova, Jose Torreblanca González, and Cristina Bullón-Carbajo. 2019. Review on wearables to monitor foot temperature in diabetic patients. Sensors 19, 4 (2019), 776.

[61]

Dan Mauney, Jonathan Howarth, Andrew Wirtanen, and Miranda Capra. 2010. Cultural similarities and differences in user-defined gestures for touchscreen user interfaces. In CHI'10 extended abstracts on human factors in computing systems. Association for Computing Machinery, New York, NY, USA, 4015--4020.

[62]

Meredith Ringel Morris, Jacob O Wobbrock, and Andrew D Wilson. 2010. Understanding users' preferences for surface gestures. In Proceedings of graphics interface 2010. Canadian Information Processing Society, CAN, 261--268.

Digital Library

[63]

Florian Müller, Joshua McManus, Sebastian Günther, Martin Schmitz, Max Mühlhäuser, and Markus Funk. 2019. Mind the Tap: Assessing Foot-Taps for Interacting with Head-Mounted Displays. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI '19). Association for Computing Machinery, New York, NY, USA, 1--13. https://doi.org/10.1145/3290605.3300707

Digital Library

[64]

Miguel A Nacenta, Yemliha Kamber, Yizhou Qiang, and Per Ola Kristensson. 2013. Memorability of pre-designed and user-defined gesture sets. In Proceedings of the SIGCHI conference on human factors in computing systems. Association for Computing Machinery, New York, NY, USA, 1099--1108.

Digital Library

[65]

Troy Nachtigall, Oscar Tomico, Ron Wakkary, and Pauline Van Dongen. 2019. Encoding materials and data for iterative personalization. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, 1--12.

Digital Library

[66]

Troy Robert Nachtigall, Oscar Tomico, Ron Wakkary, Stephan Wensveen, Pauline Van Dongen, and Leonie Tenthof Van Noorden. 2018. Towards ultra personalized 4D printed shoes. In Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, 1--9.

Digital Library

[67]

Amin Nozariasbmarz, Henry Collins, Kelvin Dsouza, Mobarak Hossain Polash, Mahshid Hosseini, Melissa Hyland, Jie Liu, Abhishek Malhotra, Francisco Matos Ortiz, Farzad Mohaddes, Viswanath Padmanabhan Ramesh, Yasaman Sargolzaeiaval, Nicholas Snouwaert, Mehmet C. Özturk, and Daryoosh Vashaee. 2020. Review of wearable thermoelectric energy harvesting: From body temperature to electronic systems. Applied Energy 258 (2020), 114069. https://doi.org/10.1016/j.apenergy.2019.114069

[68]

Ata Otaran and Ildar Farkhatdinov. 2021. Haptic Ankle Platform for Interactive Walking in Virtual Reality. IEEE Transactions on Visualization and Computer Graphics 0, 0 (2021), 12 pages.

[69]

Joseph A Paradiso, Kai-Yuh Hsiao, Ari Y Benbasat, and Zoe Teegarden. 2000. Design and implementation of expressive footwear. IBM systems journal 39, 3.4 (2000), 511--529.

[70]

Thammathip Piumsomboon, Adrian Clark, Mark Billinghurst, and Andy Cockburn. 2013. User-defined gestures for augmented reality. In IFIP Conference on Human-Computer Interaction. Springer, Association for Computing Machinery, New York, NY, USA, 282--299.

Digital Library

[71]

Vijay Dandur Rajanna. 2016. Gaze and Foot Input: Toward a Rich and Assistive Interaction Modality. In Companion Publication of the 21st International Conference on Intelligent User Interfaces (Sonoma, California, USA) (IUI '16 Companion). Association for Computing Machinery, New York, NY, USA, 126--129. https://doi.org/10.1145/2876456.2876462

Digital Library

[72]

Christopher Ring, Maria Kavussanu, and Andrew Cooke. 2022. Effects of Cooperation and Competition on Performance, Emotion, and Effort: Goal and Means Interdependence. Journal of Sport and Exercise Psychology 1, aop (2022), 1--8.

[73]

Patricio Rivera, Edwin Valarezo, Mun-Taik Choi, and Tae-Seong Kim. 2017. Recognition of human hand activities based on a single wrist imu using recurrent neural networks. Int. J. Pharma Med. Biol. Sci 6, 4 (2017), 114--118.

[74]

Jaime Ruiz, Yang Li, and Edward Lank. 2011. User-defined motion gestures for mobile interaction. In Proceedings of the SIGCHI conference on human factors in computing systems. Association for Computing Machinery, New York, NY, USA, 197--206.

Digital Library

[75]

William Saunders and Daniel Vogel. 2016. Tap-Kick-Click: Foot Interaction for a Standing Desk. In Proceedings of the 2016 ACM Conference on Designing Interactive Systems (Brisbane, QLD, Australia) (DIS '16). Association for Computing Machinery, New York, NY, USA, 323--333. https://doi.org/10.1145/2901790.2901815

Digital Library

[76]

Korbinian Schmid and Heiko Hirschmüller. 2013. Stereo vision and IMU based real-time ego-motion and depth image computation on a handheld device. In 2013 IEEE International Conference on Robotics and Automation. IEEE, IEEE, Karlsruhe, Germany, 4671--4678.

[77]

Genevieve Scott, Hylton B Menz, and Lesley Newcombe. 2007. Age-related differences in foot structure and function. Gait & posture 26, 1 (2007), 68--75.

[78]

Abigail J Sellen, Gordon P Kurtenbach, and William AS Buxton. 1992. The prevention of mode errors through sensory feedback. Human-computer interaction 7, 2 (1992), 141--164.

Digital Library

[79]

Freddie Sherratt, Andrew Plummer, and Pejman Iravani. 2021. Understanding LSTM network behaviour of IMU-based locomotion mode recognition for applications in prostheses and wearables. Sensors 21, 4 (2021), 1264.

[80]

Muhammad Shoaib, Stephan Bosch, Ozlem Durmaz Incel, Hans Scholten, and Paul JM Havinga. 2014. Fusion of smartphone motion sensors for physical activity recognition. Sensors 14, 6 (2014), 10146--10176.

[81]

Muhammad Shoaib, Stephan Bosch, Ozlem Durmaz Incel, Hans Scholten, and Paul JM Havinga. 2015. A survey of online activity recognition using mobile phones. Sensors 15, 1 (2015), 2059--2085.

[82]

Danilo B da Silva, Creto A Vidal, Joaquim B Cavalcante-Neto, Italo NS Pessoa, and Rubens F Nunes. 2021. Topple-free foot strategy applied to real-time motion capture data using kinect sensor. In Proceedings of the 36th Annual ACM Symposium on Applied Computing. Association for Computing Machinery, New York, NY, USA, 98--106.

Digital Library

[83]

Paul Strohmeier, Seref Güngör, Luis Herres, Dennis Gudea, Bruno Fruchard, and Jürgen Steimle. 2020. barefoot: Generating virtual materials using motion coupled vibration in shoes. In Proceedings of the 33rd Annual ACM Symposium on User Interface Software and Technology. Association for Computing Machinery, New York, NY, USA, 579--593.

Digital Library

[84]

Radu-Daniel Vatavu. 2012. User-defined gestures for free-hand TV control. In Proceedings of the 10th European conference on Interactive tv and video. Association for Computing Machinery, New York, NY, USA, 45--48.

Digital Library

[85]

Tomás Vega Gálvez, Shardul Sapkota, Alexandru Dancu, and Pattie Maes. 2019. Byte. it: discreet teeth gestures for mobile device interaction. In Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, 1--6.

[86]

Eduardo Velloso, Dominik Schmidt, Jason Alexander, Hans Gellersen, and Andreas Bulling. 2015. The feet in human-computer interaction: A survey of foot-based interaction. ACM Computing Surveys (CSUR) 48, 2 (2015), 1--35.

Digital Library

[87]

Junji Watanabe, Hideyuki Ando, and Taro Maeda. 2005. Shoe-shaped interface for inducing a walking cycle. In Proceedings of the 2005 international conference on Augmented tele-existence. Association for Computing Machinery, New York, NY, USA, 30--34.

Digital Library

[88]

Jacob O Wobbrock, Meredith Ringel Morris, and Andrew D Wilson. 2009. User-defined gestures for surface computing. In Proceedings of the SIGCHI conference on human factors in computing systems. Association for Computing Machinery, New York, NY, USA, 1083--1092.

Digital Library

[89]

Xuhai Xu, Jiahao Li, Tianyi Yuan, Liang He, Xin Liu, Yukang Yan, Yuntao Wang, Yuanchun Shi, Jennifer Mankoff, and Anind K Dey. 2021. HulaMove: Using Commodity IMU for Waist Interaction. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, 1--16.

Digital Library

[90]

Xuhai Xu, Haitian Shi, Xin Yi, Wenjia Liu, Yukang Yan, Yuanchun Shi, Alex Mariakakis, Jennifer Mankoff, and Anind K Dey. 2020. Earbuddy: Enabling on-face interaction via wireless earbuds. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, 1--14.

Digital Library

[91]

Yukang Yan, Chun Yu, Xin Yi, and Yuanchun Shi. 2018. Headgesture: Hands-free input approach leveraging head movements for hmd devices. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 2, 4 (2018), 1--23.

Digital Library

[92]

Lining Yao, Yan Shi, Hengfeng Chi, Xiaoyu Ji, and Fangtian Ying. 2010. Music-touch shoes: vibrotactile interface for hearing impaired dancers. In Proceedings of the fourth international conference on Tangible, embedded, and embodied interaction. Association for Computing Machinery, New York, NY, USA, 275--276.

Digital Library

[93]

Tuo Yu, Haiming Jin, and Klara Nahrstedt. 2019. Shoesloc: In-shoe force sensor-based indoor walking path tracking. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 3, 1 (2019), 1--23.

Digital Library

[94]

Clint Zeagler. 2017. Where to Wear It: Functional, Technical, and Social Considerations in on-Body Location for Wearable Technology 20 Years of Designing for Wearability. In Proceedings of the 2017 ACM International Symposium on Wearable Computers (Maui, Hawaii) (ISWC '17). Association for Computing Machinery, New York, NY, USA, 150--157. https://doi.org/10.1145/3123021.3123042

Digital Library

[95]

Wenlong Zhang, Masayoshi Tomizuka, and Nancy Byl. 2016. A wireless human motion monitoring system for smart rehabilitation. Journal of Dynamic Systems, Measurement, and Control 138, 11 (2016), 9.

Cited By

Tsai CYen RKim DVogel D(2024)Gait Gestures: Examining Stride and Foot Strike Variation as an Input Method While WalkingProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676342(1-16)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3654777.3676342
Lu YWang XXiong RCui XGuo YMi HGrollman DBroadbent EJu WSoh HWilliams T(2024)Exploring Foot-Interactive Robotics: A Study on Gobot's Role in Enhancing Daily Walking Experience through Emotion-Infused DesignCompanion of the 2024 ACM/IEEE International Conference on Human-Robot Interaction10.1145/3610978.3640624(707-711)Online publication date: 11-Mar-2024
https://dl.acm.org/doi/10.1145/3610978.3640624
Lankes MWinklbauer AStiglbauer B(2023)Down to Earth: Investigating Barefooted Experiences in Seated Virtual Reality ScenariosProceedings of the 2023 7th International Conference on Virtual and Augmented Reality Simulations10.1145/3603421.3603427(35-44)Online publication date: 3-Mar-2023
https://dl.acm.org/doi/10.1145/3603421.3603427
Show More Cited By

Index Terms

Shoes++: A Smart Detachable Sole for Social Foot-to-foot Interaction
1. Human-centered computing
  1. Interaction design
    1. Systems and tools for interaction design
  2. Ubiquitous and mobile computing
    1. Ubiquitous and mobile devices

Recommendations

Text Input with Foot Gestures Using the Myo Armband
Computers Helping People with Special Needs
Abstract
This article describes the study in the area of alternative text entry. The aim of the project was to use the Myo band to detect foot gestures using EMG or acceleration signals for the special needs of people with physical disabilities. The Myo ...
Pace-sync shoes: intuitive walking-pace guidance based on cyclic vibro-tactile stimulation for the foot

We propose a walking guidance method with a sandal-shaped vibration interface and describe two experiments we performed to formulate the design principles of the interface. In the interface, a vibrating motor presents timing information to the foot, and ...
An empirical study of foot gestures for hands-occupied mobile interaction
ISWC '17: Proceedings of the 2017 ACM International Symposium on Wearable Computers

User-defined foot-gesture is a promising approach to interacting with mobile devices when both hands are occupied. In this research, we first present a survey to identify how often interacting with mobile devices is needed when both hands are busy and ...

Comments

Information & Contributors

Information

Published In

cover image Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies

Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies Volume 6, Issue 2

June 2022

1551 pages

EISSN:2474-9567

DOI:10.1145/3547347

Issue’s Table of Contents

Copyright © 2022 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 07 July 2022

Published in IMWUT Volume 6, Issue 2

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed

Funding Sources

National Key R&D Program of China
National Natural Science Foundation of China

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

7
Total Citations
View Citations
1,008
Total Downloads

Downloads (Last 12 months)278
Downloads (Last 6 weeks)32

Reflects downloads up to 05 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Tsai CYen RKim DVogel D(2024)Gait Gestures: Examining Stride and Foot Strike Variation as an Input Method While WalkingProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676342(1-16)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3654777.3676342
Lu YWang XXiong RCui XGuo YMi HGrollman DBroadbent EJu WSoh HWilliams T(2024)Exploring Foot-Interactive Robotics: A Study on Gobot's Role in Enhancing Daily Walking Experience through Emotion-Infused DesignCompanion of the 2024 ACM/IEEE International Conference on Human-Robot Interaction10.1145/3610978.3640624(707-711)Online publication date: 11-Mar-2024
https://dl.acm.org/doi/10.1145/3610978.3640624
Lankes MWinklbauer AStiglbauer B(2023)Down to Earth: Investigating Barefooted Experiences in Seated Virtual Reality ScenariosProceedings of the 2023 7th International Conference on Virtual and Augmented Reality Simulations10.1145/3603421.3603427(35-44)Online publication date: 3-Mar-2023
https://dl.acm.org/doi/10.1145/3603421.3603427
Zhou ZChen PLu YCui QPan DLiu YLi JZhang YTao YLiu XSun LWang G(2023)3D Deformation Capture via a Configurable Self-Sensing IMU Sensor NetworkProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/35808747:1(1-24)Online publication date: 28-Mar-2023
https://dl.acm.org/doi/10.1145/3580874
Wang GYang YGuo MZhu KYan ZCui QZhou ZJi JLi JLuo DPan DFan YHan TTao YSun L(2023)ThermoFitProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/35808067:1(1-27)Online publication date: 28-Mar-2023
https://dl.acm.org/doi/10.1145/3580806
Yan ZLin YWang GCai YCao PMi HZhang Y(2023)LaserShoes: Low-Cost Ground Surface Detection Using Laser Speckle ImagingProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581344(1-20)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581344
Wang Q(2023)Efficient Modeling and Estimation of Group Music and Dance Happiness via Intelligent Wearable DevicesInternational Journal of Computational Intelligence Systems10.1007/s44196-023-00265-y16:1Online publication date: 9-May-2023
https://doi.org/10.1007/s44196-023-00265-y

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Issue’s Table of Contents