ABSTRACT
Prior research has offered a plethora of wearables centred around sensing bodily actions ranging from more explicit data, such as movement and physiological response, to implicit information, such as ocular and brain activity. Bodily augmentations that physically extend the user’s body along with altering body schema and image have been proposed recently as well, owing to factors such as accessibility and improving communication. However, these attempts have usually consisted of uncomfortable interfaces that either restrict the user’s movement or are intrusive in nature. In this work, we present Pneunocchio, a playful nose augmentation based on the lore of Pinocchio. Pneunocchio consists of a pneumatic-based inflatable that a user wears on their nose to play a game of two truths and a lie. With our work, we aim to explore expressive bodily augmentations that respond to a player’s physiological state that can alter the perception of their body while serving as an expressive match for a current part of the body.
- Catarina Allen d’Ávila Silveira, Ozgun Kilic Afsar, and Sarah Fdili Alaoui. 2022. Wearable Choreographer: Designing Soft-Robotics for Dance Practice. In Designing Interactive Systems Conference. ACM, Virtual Event Australia, 1581–1596. https://doi.org/10.1145/3532106.3533499Google ScholarDigital Library
- Takashi Amesaka, Hiroki Watanabe, and Masanori Sugimoto. 2019. Facial Expression Recognition Using Ear Canal Transfer Function. In Proceedings of the 2019 ACM International Symposium on Wearable Computers (London, United Kingdom) (ISWC ’19). Association for Computing Machinery, New York, NY, USA, 1–9. https://doi.org/10.1145/3341163.3347747Google ScholarDigital Library
- Toshiyuki Ando, Yuki Kubo, Buntarou Shizuki, and Shin Takahashi. 2017. CanalSense: Face-Related Movement Recognition System Based on Sensing Air Pressure in Ear Canals. In Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology (Québec City, QC, Canada) (UIST ’17). Association for Computing Machinery, New York, NY, USA, 679–689. https://doi.org/10.1145/3126594.3126649Google ScholarDigital Library
- Jatin Arora, Kartik Mathur, Aryan Saini, and Aman Parnami. 2019. Gehna: Exploring the Design Space of Jewelry as an Input Modality. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems(CHI ’19). Association for Computing Machinery, New York, NY, USA, 1–12. https://doi.org/10.1145/3290605.3300751Google ScholarDigital Library
- Daniel Ashbrook, Carlos Tejada, Dhwanit Mehta, Anthony Jiminez, Goudam Muralitharam, Sangeeta Gajendra, and Ross Tallents. 2016. Bitey: An Exploration of Tooth Click Gestures for Hands-Free User Interface Control. In Proceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and Services (Florence, Italy) (MobileHCI ’16). Association for Computing Machinery, New York, NY, USA, 158–169. https://doi.org/10.1145/2935334.2935389Google ScholarDigital Library
- Arpit Bhatia, Aryan Saini, Isha Kalra, Manideepa Mukherjee, and Aman Parnami. 2023. DUMask: A Discrete and Unobtrusive Mask-Based Interface for Facial Gestures. In Proceedings of the Augmented Humans International Conference 2023 (Glasgow, United Kingdom) (AHs ’23). Association for Computing Machinery, New York, NY, USA, 255–266. https://doi.org/10.1145/3582700.3582726Google ScholarDigital Library
- Oğuz ’Oz’ Buruk, Louise Petersen Matjeka, and Florian ‘Floyd’ Mueller. 2023. Towards Designing Playful Bodily Extensions: Learning from Expert Interviews. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. ACM, Hamburg Germany, 1–20. https://doi.org/10.1145/3544548.3581165Google ScholarDigital Library
- Sharice Clough and Melissa C. Duff. 2020. The Role of Gesture in Communication and Cognition: Implications for Understanding and Treating Neurogenic Communication Disorders. Frontiers in Human Neuroscience 14 (Aug. 2020), 323. https://doi.org/10.3389/fnhum.2020.00323Google ScholarCross Ref
- Rose De Kock, Keri Anne Gladhill, Minaz Numa Ali, Wilsaan Mychal Joiner, and Martin Wiener. 2021. How movements shape the perception of time. Trends in Cognitive Sciences 25, 11 (Nov. 2021), 950–963. https://doi.org/10.1016/j.tics.2021.08.002Google ScholarCross Ref
- Paul Dourish. 2001. Where the Action Is: The Foundations of Embodied Interaction. –256.Google Scholar
- Kate Hartman, Boris Kourtoukov, Izzie Colpitts-Campbell, and Erin Lewis. 2020. Monarch V2: An Iterative Design Approach to Prototyping a Wearable Electronics Project. In Proceedings of the 2020 ACM Designing Interactive Systems Conference (Eindhoven, Netherlands) (DIS ’20). Association for Computing Machinery, New York, NY, USA, 2215–2227. https://doi.org/10.1145/3357236.3395573Google ScholarDigital Library
- Ozgun Kilic Afsar, Ali Shtarbanov, Hila Mor, Ken Nakagaki, Jack Forman, Karen Modrei, Seung Hee Jeong, Klas Hjort, Kristina Höök, and Hiroshi Ishii. 2021. OmniFiber: Integrated Fluidic Fiber Actuators for Weaving Movement based Interactions into the ‘Fabric of Everyday Life’. In The 34th Annual ACM Symposium on User Interface Software and Technology(UIST ’21). Association for Computing Machinery, New York, NY, USA, 1010–1026. https://doi.org/10.1145/3472749.3474802Google ScholarDigital Library
- KirshDavid. 2013. Embodied cognition and the magical future of interaction design. ACM Transactions on Computer-Human Interaction (TOCHI) (April 2013). https://doi.org/10.1145/2442106.2442109 Publisher: ACM PUB27 New York, NY, USA.Google ScholarDigital Library
- Richard Li, Jason Wu, and Thad Starner. 2019. TongueBoard: An Oral Interface for Subtle Input. In Proceedings of the 10th Augmented Human International Conference 2019 (Reims, France) (AH2019). Association for Computing Machinery, New York, NY, USA, Article 1, 9 pages. https://doi.org/10.1145/3311823.3311831Google ScholarDigital Library
- Zhuying Li, Tianze Huang, Rakesh Patibanda, and Florian Mueller. 2023. AI in the Shell: Towards an Understanding of Integrated Embodiment. In Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems(CHI EA ’23). Association for Computing Machinery, New York, NY, USA, 1–7. https://doi.org/10.1145/3544549.3585867Google ScholarDigital Library
- Pedro Lopes and Patrick Baudisch. 2013. Muscle-propelled force feedback: bringing force feedback to mobile devices. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems(CHI ’13). Association for Computing Machinery, New York, NY, USA, 2577–2580. https://doi.org/10.1145/2470654.2481355Google ScholarDigital Library
- Pedro Lopes and Patrick Baudisch. 2017. Interactive Systems Based on Electrical Muscle Stimulation. Computer 50, 10 (2017), 28–35. https://doi.org/10.1109/MC.2017.3641627Google ScholarDigital Library
- Florian Floyd Mueller, Pedro Lopes, Paul Strohmeier, Wendy Ju, Caitlyn Seim, Martin Weigel, Suranga Nanayakkara, Marianna Obrist, Zhuying Li, Joseph Delfa, Jun Nishida, Elizabeth M. Gerber, Dag Svanaes, Jonathan Grudin, Stefan Greuter, Kai Kunze, Thomas Erickson, Steven Greenspan, Masahiko Inami, Joe Marshall, Harald Reiterer, Katrin Wolf, Jochen Meyer, Thecla Schiphorst, Dakuo Wang, and Pattie Maes. 2020. Next Steps for Human-Computer Integration. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI ’20). Association for Computing Machinery, New York, NY, USA, 1–15. https://doi.org/10.1145/3313831.3376242Google ScholarDigital Library
- Rakesh Patibanda, Xiang Li, Yuzheng Chen, Aryan Saini, Christian N Hill, Elise van den Hoven, and Florian Floyd Mueller. 2021. Actuating Myself: Designing Hand-Games Incorporating Electrical Muscle Stimulation. In Extended Abstracts of the 2021 Annual Symposium on Computer-Human Interaction in Play(CHI PLAY ’21). Association for Computing Machinery, New York, NY, USA, 228–235. https://doi.org/10.1145/3450337.3483464Google ScholarDigital Library
- Rakesh Patibanda, Elise Van Den Hoven, and Florian ’Floyd Mueller. 2022. Towards Understanding the Design of Body-Actuated Play. In Extended Abstracts of the 2022 Annual Symposium on Computer-Human Interaction in Play(CHI PLAY ’22). Association for Computing Machinery, New York, NY, USA, 388–391. https://doi.org/10.1145/3505270.3558367Google ScholarDigital Library
- Victoria Peng. 2021. Wigglears: Wiggle Your Ears With Your Emotions. In Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems(CHI EA ’21). Association for Computing Machinery, New York, NY, USA, 1–5. https://doi.org/10.1145/3411763.3451846Google ScholarDigital Library
- Max Pfeiffer, Tim Dünte, Stefan Schneegass, Florian Alt, and Michael Rohs. 2015. Cruise Control for Pedestrians: Controlling Walking Direction Using Electrical Muscle Stimulation. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (Seoul, Republic of Korea) (CHI ’15). Association for Computing Machinery, New York, NY, USA, 2505–2514. https://doi.org/10.1145/2702123.2702190Google ScholarDigital Library
- Aryan Saini, Haotian Huang, Rakesh Patibanda, Nathalie Overdevest, Elise Van Den Hoven, and Florian Floyd Mueller. 2022. SomaFlatables: Supporting Embodied Cognition through Pneumatic Bladders. In Adjunct Proceedings of the 35th Annual ACM Symposium on User Interface Software and Technology(UIST ’22 Adjunct). Association for Computing Machinery, New York, NY, USA, 1–4. https://doi.org/10.1145/3526114.3558705Google ScholarDigital Library
- T. Starner. 2001. The challenges of wearable computing: Part 2. IEEE Micro 21, 4 (2001), 54–67. https://doi.org/10.1109/40.946683Google ScholarDigital Library
- Jurgen Steimle. 2016. Skin–The Next User Interface. Computer 49, 4 (apr 2016), 83–87. https://doi.org/10.1109/MC.2016.93Google ScholarDigital Library
- Dag Svanaes and Martin Solheim. 2016. Wag Your Tail and Flap Your Ears: The Kinesthetic User Experience of Extending Your Body. In Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems(CHI EA ’16). Association for Computing Machinery, New York, NY, USA, 3778–3779. https://doi.org/10.1145/2851581.2890268Google ScholarDigital Library
- Xinlei Zhang, Ali Shtarbanov, Jiani Zeng, Valerie K. Chen, V. Michael Bove, Pattie Maes, and Jun Rekimoto. 2019. Bubble: Wearable Assistive Grasping Augmentation Based on Soft Inflatables. In Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems. ACM, Glasgow Scotland Uk, 1–6. https://doi.org/10.1145/3290607.3312868Google ScholarDigital Library
Index Terms
- Pneunocchio: A playful nose augmentation for facilitating embodied representation
Recommendations
SomaFlatables: Supporting Embodied Cognition through Pneumatic Bladders
UIST '22 Adjunct: Adjunct Proceedings of the 35th Annual ACM Symposium on User Interface Software and TechnologyApplying the theory of Embodied Cognition through design allows us to create computational interactions that engage our bodies by modifying our body schema. However, in HCI, most of these interactive experiences have been stationed around creating ...
Demonstrating Fluito: A playful floatation tank experience
CHI EA '23: Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing SystemsThe use of technologies for interactions in bodies of water has fostered the WaterHCI field. However, the interactive systems proposed for water activities have, so far, primarily focused on supporting instrumental and performance aspects. In contrast, ...
Embodied interactions with audio-tactile virtual objects in AHNE
HAID'12: Proceedings of the 7th international conference on Haptic and Audio Interaction DesignInteractive virtual environments are often focused on visual representation. This study introduces embodied and eyes-free interaction with audio-haptic navigation environment (AHNE) in a 3-dimensional space. AHNE is based on an optical tracking ...
Comments