skip to main content
10.1145/3294109.3295623acmconferencesArticle/Chapter ViewAbstractPublication PagesteiConference Proceedingsconference-collections
research-article

A Wearable Nebula Material Investigations of Implicit Interaction

Published: 17 March 2019 Publication History

Abstract

In this paper, we present the Nebula, a garment that translates intentional gestures and implicit interaction into sound.Nebula is a studded cloak made from a heavy fabric that envelopes the wearer with many pendulous folds. We describe the design process, and specifically highlight three material investigations that show particularly important material connections that were fundamental to the experience of the garment: How the draping and construction of the garment allowed for implicit interaction, how the studs were used both as a computational sensing material and a strong visual component, and how the sound design exploited tangible material qualities in the garment. Finally, we discuss how such material investigations in general can be put to use. Both as a way to produce evocative connections in the materials available in design work, but also as a way to extract legible design intentions for other designers and researchers.

References

[1]
David Barnard, Joachim Bondo, Dan Burcaw, David Kaneda, Craig Kemper, Tim Novikoff, Chris Parris, Brad Ellis, Keith Peters, Jürgen Siebert, et almbox. 2009. Epilogue: Reactive Music and Invisible Interfaces. In iPhone User Interface Design Projects . Springer, 235--238.
[2]
Thomas Binder and Johan Redström. 2006. Exemplary design research. (2006).
[3]
Johannes Birringer and Michèle Danjoux. 2013. The sound of movement wearables: performing ukiyo. Leonardo, Vol. 46, 3 (2013), 232--240.
[4]
Bert Bongers. 1998. An interview with Sensorband. Computer Music Journal, Vol. 22, 1 (1998), 13--24.
[5]
Leah Buechley, Mike Eisenberg, Jaime Catchen, and Ali Crockett. 2008. The LilyPad Arduino: using computational textiles to investigate engagement, aesthetics, and diversity in computer science education. In Proceedings of the SIGCHI conference on Human factors in computing systems. ACM, 423--432.
[6]
Daniel Cesarini, Thomas Hermann, and Bodo Ungerechts. 2014. A real-time auditory biofeedback system for sports swimming. In Proceedings of the 20th International Conference on Auditory Display (ICAD 2014) .
[7]
Jessica Charlesworth. 2007. Wearables as relationship tools? Ai & Society, Vol. 22, 1 (2007), 63--84.
[8]
Nick Collins. 2009. Musical form and algorithmic composition. Contemporary Music Review, Vol. 28, 1 (2009), 103--114.
[9]
Ludvig Elblaus, Kjetil Falkenberg Hansen, and Carl Unander-Scharin. 2012. Artistically directed prototyping in development and in practice. Journal of New Music Research, Vol. 41, 4 (2012), 377--387.
[10]
Ludvig Elblaus, Vasiliki Tsaknaki, Vincent Lewandowski, and Roberto Bresin. 2015. Nebula: An Interactive Garment Designed for Functional Aesthetics. In Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA '15). ACM, New York, NY, USA, 275--278.
[11]
Martin Eriksson and Roberto Bresin. 2010. Improving running mechanics by use of interactive sonification. Proceedings of ISon (2010), 95--98.
[12]
Alexander Fiannaca, Ilias Apostolopoulous, and Eelke Folmer. 2014. Headlock: a wearable navigation aid that helps blind cane users traverse large open spaces. In Proceedings of the 16th international ACM SIGACCESS conference on Computers & accessibility. ACM, 19--26.
[13]
Minoru Fujimoto, Naotaka Fujita, Yoshinari Takegawa, Tsutomu Terada, and Masahiko Tsukamoto. 2008. Musical B-boying: A Wearable Musical Instrument by Dancing. In International Conference on Entertainment Computing. Springer, 155--160.
[14]
William Gaver, John Bowers, Tobie Kerridge, Andy Boucher, and Nadine Jarvis. 2009. Anatomy of a Failure: How We Knew when Our Design Went Wrong, and What We Learned from It. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '09). ACM, New York, NY, USA, 2213--2222.
[15]
Connie Golsteijn, Elise Van Den Hoven, David Frohlich, and Abigail Sellen. 2014. Hybrid crafting: towards an integrated practice of crafting with physical and digital components. Personal and ubiquitous computing, Vol. 18, 3 (2014), 593--611.
[16]
Rafael E Gomez, Tricia Flanagan, and Rebekah M Davis. 2015. Designing experiences with wearables: A case study exploring the blurring boundaries of art, design, technology, culture and distance. In Proceedings of the 6th IASDR (The International Association of Societies of Design Research Congress). IASDR (The International Association of Societies of Design Research), 805--820.
[17]
Yu-I Ha and Yi-Kyung Kim. 2014. The design process of wearable computers for extending the performer's expression. In International Conference on Human-Computer Interaction. Springer, 421--426.
[18]
Yoonchang Han, Jinsoo Na, and Kyogu Lee. 2012. FutureGrab: A wearable synthesizer using vowel formants. NIME'12 (2012).
[19]
Michaela Honauer and Eva Hornecker. 2015. Challenges for creating and staging interactive costumes for the theatre stage. In Proceedings of the 2015 ACM SIGCHI Conference on Creativity and Cognition. ACM, 13--22.
[20]
Brian Horsak, Michael Iber, Karin Bauer, Anita Kiselka, Anna-Maria Gorgas, Ronald Dlapka, and Jakob Doppler. 2015. A wireless instrumented insole device for real-time sonification of gait. Georgia Institute of Technology.
[21]
Aurie Hsu and Steven Kemper. 2015. Kinesonic approaches to mapping movement and music with the remote electroacoustic kinesthetic sensing (RAKS) system. In Proceedings of the 2nd International Workshop on Movement and Computing. ACM, 45--47.
[22]
Tim Ingold. 2010. The textility of making. Cambridge Journal of Economics, Vol. 34, 1 (2010), 91--102.
[23]
X io Technologies. {n. d.}. X-OSC. http://x-io.co.uk/x-osc/
[24]
Alexandra Ju. 2016. Functionality in Wearable Tech: Device, As Jewelry, As Body Mediator. In Proceedings of the TEI '16: Tenth International Conference on Tangible, Embedded, and Embodied Interaction (TEI '16). ACM, New York, NY, USA, 641--646.
[25]
Ajay Kapur, Eric L Yang, Adam R Tindale, and Peter F Driessen. 2005. Wearable sensors for real-time musical signal processing. In Communications, Computers and signal Processing, 2005. PACRIM. 2005 IEEE Pacific Rim Conference on. IEEE, 424--427.
[26]
Volker Krefeld and Michel Waisvisz. 1990. The hand in the web: An interview with Michel Waisvisz. Computer music journal, Vol. 14, 2 (1990), 28--33.
[27]
Kari Kuutti and Liam J Bannon. 2014. The turn to practice in HCI: towards a research agenda. In Proceedings of the 32nd annual ACM conference on Human factors in computing systems. ACM, 3543--3552.
[28]
Lizzy. {n. d.}. http://lizzy.berlin
[29]
Teresa Marrin and Rosalind W Picard. 1998. The" Conductor's Jacket": A Device for Recording Expressive Musical Gestures. In ICMC .
[30]
Stefano Papetti, Marco Civolani, and Federico Fontana. 2011. Rhythm'n'Shoes: a Wearable Foot Tapping Interface with Audio-Tactile Feedback. In NIME . 473--476.
[31]
Hannah Perner-Wilson, Leah Buechley, and Mika Satomi. 2011. Handcrafting textile interfaces from a kit-of-no-parts. In Proceedings of the fifth international conference on Tangible, embedded, and embodied interaction . ACM, 61--68.
[32]
Ernest Rehmatulla Post, Maggie Orth, Peter R Russo, and Neil Gershenfeld. 2000. E-broidery: Design and fabrication of textile-based computing. IBM Systems journal, Vol. 39, 3.4 (2000), 840--860.
[33]
Halley Profita, Nicholas Farrow, and Nikolaus Correll. 2015. Flutter: An exploration of an assistive garment using distributed sensing, computation and actuation. In Proceedings of the Ninth International Conference on Tangible, Embedded, and Embodied Interaction. ACM, 359--362.
[34]
Curtis Roads. 1988. Introduction to granular synthesis. Computer Music Journal, Vol. 12, 2 (1988), 11--13.
[35]
Thecla Schiphorst, Wynnie Wing Yi Chung, and Emily Ip. 2013. Wo. Defy: wearable interaction design inspired by a Chinese 19 th century suffragette movement. In Proceedings of the 7th International Conference on Tangible, Embedded and Embodied Interaction. ACM, 319--322.
[36]
Sabine Seymour. 2008. Fashionable technology: The intersection of design, fashion, science, and technology .Springer Publishing Company, Incorporated.
[37]
SparkFun. {n. d.}. EeonTex. https://www.sparkfun.com/products/14110
[38]
Thad Starner, Joshua Weaver, and Alex Pentland. 1998. Real-time american sign language recognition using desk and wearable computer based video. IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 20, 12 (1998), 1371--1375.
[39]
Bob L Sturm. 2005. Pulse of an ocean: sonification of ocean buoy data. Leonardo, Vol. 38, 2 (2005), 143--149.
[40]
SuperCollider. {n. d.}. https://supercollider.github.io/
[41]
Oscar Tomico, Mascha van Zijverden, Tom Fejér, Yiyu Chen, Eef Lubbers, Meerthe Heuvelings, Sonia A"issaoui, and Verena Schepperheyn. 2013. Crafting wearables: interaction design meets fashion design. In CHI'13 Extended Abstracts on Human Factors in Computing Systems. ACM, 2875--2876.
[42]
Wouter Walmink, Danielle Wilde, and Florian'Floyd' Mueller. 2014. Displaying heart rate data on a bicycle helmet to support social exertion experiences. In Proceedings of the 8th International Conference on Tangible, Embedded and Embodied Interaction. ACM, 97--104.
[43]
Danielle Wilde. 2012. hipDisk: experiencing the value of ungainly, embodied, performative, fun. In CHI'12 Extended Abstracts on Human Factors in Computing Systems. ACM, 979--982.
[44]
Danielle Wilde and Sophie Birkmayer. 2004. Dress and Ange: coercing the address of highly personal body-centric issues. Personal and Ubiquitous Computing, Vol. 8, 3--4 (2004), 264--273.
[45]
Michele A. Williams, Asta Roseway, Chris O'Dowd, Mary Czerwinski, and Meredith Ringel Morris. 2015. SWARM: An Actuated Wearable for Mediating Affect. In Proceedings of the Ninth International Conference on Tangible, Embedded, and Embodied Interaction (TEI '15). ACM, New York, NY, USA, 293--300.
[46]
Koji Yatani and Khai N Truong. 2012. BodyScope: a wearable acoustic sensor for activity recognition. In Proceedings of the 2012 ACM Conference on Ubiquitous Computing. ACM, 341--350.
[47]
Clint Zeagler, Maribeth Gandy, Scott M Gilliland, Delton Moore, Rocco Centrella, and Brandon Montgomery. 2017. In Harmony: Making a Wearable Musical Instrument as a Case Study of using Boundary Objects in an Interdisciplinary Collaborative Design Process. In Conference on Designing Interactive Systems. 369--378.

Cited By

View all
  • (2021)The Bodies of TEI – Investigating Norms and Assumptions in the Design of Embodied InteractionProceedings of the Fifteenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3430524.3440651(1-19)Online publication date: 14-Feb-2021
  • (2021)Articulating Soma Experiences using TrajectoriesProceedings of the 2021 CHI Conference on Human Factors in Computing Systems10.1145/3411764.3445482(1-16)Online publication date: 6-May-2021
  • (2020)What HCI Can Learn from ASMR: Becoming Enchanted with the MundaneProceedings of the 2020 CHI Conference on Human Factors in Computing Systems10.1145/3313831.3376741(1-12)Online publication date: 21-Apr-2020
  • Show More Cited By

Index Terms

  1. A Wearable Nebula Material Investigations of Implicit Interaction

      Recommendations

      Comments

      Information & Contributors

      Information

      Published In

      cover image ACM Conferences
      TEI '19: Proceedings of the Thirteenth International Conference on Tangible, Embedded, and Embodied Interaction
      March 2019
      785 pages
      ISBN:9781450361965
      DOI:10.1145/3294109
      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Sponsors

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 17 March 2019

      Permissions

      Request permissions for this article.

      Check for updates

      Author Tags

      1. crafting
      2. implicit interaction
      3. materials
      4. sound and music computing
      5. wearable technology

      Qualifiers

      • Research-article

      Conference

      TEI '19
      Sponsor:

      Acceptance Rates

      TEI '19 Paper Acceptance Rate 36 of 110 submissions, 33%;
      Overall Acceptance Rate 393 of 1,367 submissions, 29%

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)18
      • Downloads (Last 6 weeks)3
      Reflects downloads up to 07 Mar 2025

      Other Metrics

      Citations

      Cited By

      View all
      • (2021)The Bodies of TEI – Investigating Norms and Assumptions in the Design of Embodied InteractionProceedings of the Fifteenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3430524.3440651(1-19)Online publication date: 14-Feb-2021
      • (2021)Articulating Soma Experiences using TrajectoriesProceedings of the 2021 CHI Conference on Human Factors in Computing Systems10.1145/3411764.3445482(1-16)Online publication date: 6-May-2021
      • (2020)What HCI Can Learn from ASMR: Becoming Enchanted with the MundaneProceedings of the 2020 CHI Conference on Human Factors in Computing Systems10.1145/3313831.3376741(1-12)Online publication date: 21-Apr-2020
      • (2019)Teaching Soma DesignProceedings of the 2019 on Designing Interactive Systems Conference10.1145/3322276.3322327(1237-1249)Online publication date: 18-Jun-2019

      View Options

      Login options

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      Figures

      Tables

      Media

      Share

      Share

      Share this Publication link

      Share on social media