skip to main content
10.1145/3491102.3517462acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
research-article
Open access

STRAIDE: A Research Platform for Shape-Changing Spatial Displays based on Actuated Strings

Published: 29 April 2022 Publication History

Abstract

We present STRAIDE, a string-actuated interactive display environment that allows to explore the promising potential of shape-changing interfaces for casual visualizations. At the core, we envision a platform that spatially levitates elements to create dynamic visual shapes in space. We conceptualize this type of tangible mid-air display and discuss its multifaceted design dimensions. Through a design exploration, we realize a physical research platform with adjustable parameters and modular components. For conveniently designing and implementing novel applications, we provide developer tools ranging from graphical emulators to in-situ augmented reality representations. To demonstrate STRAIDE’s reconfigurability, we further introduce three representative physical setups as a basis for situated applications including ambient notifications, personal smart home controls, and entertainment. They serve as a technical validation, lay the foundations for a discussion with developers that provided valuable insights, and encourage ideas for future usage of this type of appealing interactive installation.

Supplemental Material

MP4 File
Talk Video
Transcript for: Talk Video

References

[1]
Jason Alexander, Andrés Lucero, and Sriram Subramanian. 2012. Tilt Displays: Designing Display Surfaces with Multi-Axis Tilting and Actuation. In Proceedings of the 14th International Conference on Human-Computer Interaction with Mobile Devices and Services (San Francisco, California, USA) (MobileHCI ’12). Association for Computing Machinery, New York, NY, USA, 161–170. https://doi.org/10.1145/2371574.2371600
[2]
Jason Alexander, Anne Roudaut, Jürgen Steimle, Kasper Hornbæk, Miguel Bruns Alonso, Sean Follmer, and Timothy Merritt. 2018. Grand Challenges in Shape-Changing Interface Research. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI ’18). Association for Computing Machinery, New York, NY, USA, 1–14. https://doi.org/10.1145/3173574.3173873
[3]
Tobias Alrøe, Jonas Grann, Erik Grönvall, Marianne Graves Petersen, and Jesper L. Rasmussen. 2012. Aerial Tunes: Exploring Interaction Qualities of Mid-Air Displays. In Proceedings of the 7th Nordic Conference on Human-Computer Interaction: Making Sense Through Design(Copenhagen, Denmark) (NordiCHI ’12). Association for Computing Machinery, New York, NY, USA, 514–523. https://doi.org/10.1145/2399016.2399095
[4]
Arduino. 2021. Arduino - Open-Source Electronics Platform. Retrieved 01.03.2022 from https://www.arduino.cc/
[5]
ART+COM Studios. 2008. Kinetic Sculpture | ART+COM Studios. Retrieved 01.03.2022 from https://artcom.de/en/?project=kinetic-sculpture
[6]
ART+COM Studios. 2011. Anamorphic Logos | ART+COM Studios. Retrieved 01.03.2022 from https://artcom.de/en/?project=anamorphic-logos
[7]
ART+COM Studios. 2012. Kinetic Rain | ART+COM Studios. Retrieved 01.03.2022 from https://artcom.de/en/?project=kinetic-rain
[8]
Ayah Bdeir. 2009. Electronics as Material: LittleBits. In Proceedings of the 3rd International Conference on Tangible and Embedded Interaction (Cambridge, United Kingdom) (TEI ’09). Association for Computing Machinery, New York, NY, USA, 397–400. https://doi.org/10.1145/1517664.1517743
[9]
David Bowen. 2012. underwater. Retrieved 01.03.2022 from https://www.dwbowen.com/underwater/
[10]
Aubrey Colter, Patlapa Davivongsa, Donald Derek Haddad, Halla Moore, Brian Tice, and Hiroshi Ishii. 2016. SoundFORMS: Manipulating Sound Through Touch. In Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems (San Jose, California, USA) (CHI EA ’16). Association for Computing Machinery, New York, NY, USA, 2425–2430. https://doi.org/10.1145/2851581.2892414
[11]
Maxime Daniel, Guillaume Rivière, and Nadine Couture. 2019. CairnFORM: A Shape-Changing Ring Chart Notifying Renewable Energy Availability in Peripheral Locations. In Proceedings of the Thirteenth International Conference on Tangible, Embedded, and Embodied Interaction (Tempe, Arizona, USA) (TEI ’19). Association for Computing Machinery, New York, NY, USA, 275–286. https://doi.org/10.1145/3294109.3295634
[12]
Digit. 2010. Ask Poly. Retrieved 01.03.2022 from http://dataphys.org/list/poly-physical-bar-chart-showing-online-poll-data/
[13]
Pierre Dragicevic and Yvonne Jansen. 2012. List of Physical Visualizations. Retrieved 01.03.2022 from http://dataphys.org/list/
[14]
Pierre Dragicevic, Yvonne Jansen, and Andrew Vande Moere. 2021. Data Physicalization. In Springer Handbook of Human Computer Interaction, Jean Vanderdonckt, Philippe Palanque, and Marco Winckler (Eds.). Springer, Cham, Ile de France. https://doi.org/10.1007/978-3-319-27648-9_94-1
[15]
Patrick Th. Eugster, Pascal A. Felber, Rachid Guerraoui, and Anne-Marie Kermarrec. 2003. The Many Faces of Publish/Subscribe. ACM Comput. Surv. 35, 2 (jun 2003), 114–131. https://doi.org/10.1145/857076.857078
[16]
Aluna Everitt and Jason Alexander. 2017. PolySurface: A Design Approach for Rapid Prototyping of Shape-Changing Displays Using Semi-Solid Surfaces. In Proceedings of the 2017 Conference on Designing Interactive Systems (Edinburgh, United Kingdom) (DIS ’17). Association for Computing Machinery, New York, NY, USA, 1283–1294. https://doi.org/10.1145/3064663.3064677
[17]
Aluna Everitt, Faisal Taher, and Jason Alexander. 2016. ShapeCanvas: An Exploration of Shape-Changing Content Generation by Members of the Public. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (San Jose, California, USA) (CHI ’16). Association for Computing Machinery, New York, NY, USA, 2778–2782. https://doi.org/10.1145/2858036.2858316
[18]
Looking Glass Factory. 2020. Looking Glass 15.6” Pro. Retrieved 01.03.2022 from https://lookingglassfactory.com/product/overview
[19]
Sean Follmer, Daniel Leithinger, Alex Olwal, Nadia Cheng, and Hiroshi Ishii. 2012. Jamming User Interfaces: Programmable Particle Stiffness and Sensing for Malleable and Shape-Changing Devices. In Proceedings of the 25th Annual ACM Symposium on User Interface Software and Technology (Cambridge, Massachusetts, USA) (UIST ’12). Association for Computing Machinery, New York, NY, USA, 519–528. https://doi.org/10.1145/2380116.2380181
[20]
Sean Follmer, Daniel Leithinger, Alex Olwal, Akimitsu Hogge, and Hiroshi Ishii. 2013. InFORM: Dynamic Physical Affordances and Constraints through Shape and Object Actuation. In Proceedings of the 26th Annual ACM Symposium on User Interface Software and Technology (St. Andrews, Scotland, United Kingdom) (UIST ’13). Association for Computing Machinery, New York, NY, USA, 417–426. https://doi.org/10.1145/2501988.2502032
[21]
Takuro Furumoto, Masahiro Fujiwara, Yasutoshi Makino, and Hiroyuki Shinoda. 2020. Balloon Interface for Midair Haptic Interaction. In SIGGRAPH Asia 2020 Emerging Technologies(Virtual Event, Republic of Korea) (SA ’20). Association for Computing Machinery, New York, NY, USA, Article 6, 2 pages. https://doi.org/10.1145/3415255.3422882
[22]
Antonio Gomes, Calvin Rubens, Sean Braley, and Roel Vertegaal. 2016. BitDrones: Towards Using 3D Nanocopter Displays as Interactive Self-Levitating Programmable Matter. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (San Jose, California, USA) (CHI ’16). Association for Computing Machinery, New York, NY, USA, 770–780. https://doi.org/10.1145/2858036.2858519
[23]
Mark Goulthorpe, Mark Burry, and Grant Dunlop. 2001. Aegis Hyposurface©: the bordering of university and practice. In Proceedings of the Twenty First Annual Conference of the Association for Computer-Aided Design in Architecture. ACADIA, Buffalo (New York, 344–349.
[24]
Pauline Gourlet and Thierry Dassé. 2017. Cairn: A Tangible Apparatus for Situated Data Collection, Visualization and Analysis. In Proceedings of the 2017 Conference on Designing Interactive Systems (Edinburgh, United Kingdom) (DIS ’17). Association for Computing Machinery, New York, NY, USA, 247–258. https://doi.org/10.1145/3064663.3064794
[25]
Saul Greenberg and Chester Fitchett. 2001. Phidgets: Easy Development of Physical Interfaces through Physical Widgets. In Proceedings of the 14th Annual ACM Symposium on User Interface Software and Technology(Orlando, Florida) (UIST ’01). Association for Computing Machinery, New York, NY, USA, 209–218. https://doi.org/10.1145/502348.502388
[26]
greyworld. 2004. The Source. Retrieved 01.03.2022 from https://greyworld.org/the-source/
[27]
John Hardy, Christian Weichel, Faisal Taher, John Vidler, and Jason Alexander. 2015. ShapeClip: Towards Rapid Prototyping with Shape-Changing Displays for Designers. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (Seoul, Republic of Korea) (CHI ’15). Association for Computing Machinery, New York, NY, USA, 19–28. https://doi.org/10.1145/2702123.2702599
[28]
Hypersonic. 2014. Breaking Wave for Biogen-Idec, Inc. Retrieved 01.03.2022 from https://www.hypersonic.cc/art#/breaking-wave/
[29]
Hiroshi Ishii, Daniel Leithinger, Sean Follmer, Amit Zoran, Philipp Schoessler, and Jared Counts. 2015. TRANSFORM: Embodiment of “Radical Atoms” at Milano Design Week. In Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems (Seoul, Republic of Korea) (CHI EA ’15). Association for Computing Machinery, New York, NY, USA, 687–694. https://doi.org/10.1145/2702613.2702969
[30]
Yvonne Jansen and Pierre Dragicevic. 2013. An Interaction Model for Visualizations Beyond The Desktop. IEEE Transactions on Visualization and Computer Graphics 19, 12(2013), 2396–2405. https://doi.org/10.1109/TVCG.2013.134
[31]
Yvonne Jansen, Pierre Dragicevic, and Jean-Daniel Fekete. 2013. Evaluating the Efficiency of Physical Visualizations. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Paris, France) (CHI ’13). Association for Computing Machinery, New York, NY, USA, 2593–2602. https://doi.org/10.1145/2470654.2481359
[32]
Yvonne Jansen, Pierre Dragicevic, Petra Isenberg, Jason Alexander, Abhijit Karnik, Johan Kildal, Sriram Subramanian, and Kasper Hornbæk. 2015. Opportunities and Challenges for Data Physicalization. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (Seoul, Republic of Korea) (CHI ’15). Association for Computing Machinery, New York, NY, USA, 3227–3236. https://doi.org/10.1145/2702123.2702180
[33]
Maria Karyda, Danielle Wilde, and Mette Gislev Kjærsgaard. 2021. Narrative Physicalization: Supporting Interactive Engagement With Personal Data. IEEE Computer Graphics and Applications 41, 1 (2021), 74–86. https://doi.org/10.1109/MCG.2020.3025078
[34]
Christiane Keller. 2009. Data Morphose. Retrieved 01.03.2022 from http://chrisikeller.de/portfolio_page/datamorphose/
[35]
Konstantin Klamka and Raimund Dachselt. 2015. Elasticcon: Elastic Controllers for Casual Interaction. In Proceedings of the 17th International Conference on Human-Computer Interaction with Mobile Devices and Services (Copenhagen, Denmark). ACM, New York, NY, USA, 410–419. https://doi.org/10.1145/2785830.2785849
[36]
Konstantin Klamka and Raimund Dachselt. 2018. ARCord: Visually Augmented Interactive Cords for Mobile Interaction. In Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI EA ’18). Association for Computing Machinery, New York, NY, USA, 1–6. https://doi.org/10.1145/3170427.3188456
[37]
Louise Krasniewicz. 2000. Magical Transformations and Metamorphosis in Two Cultures. In Meta Morphing: Visual Transformation and the Culture of Quick-Change, Vivian Carol Sobchack (Ed.). University of Minnesota Press, Minnesota, Chapter I.3, 41–58.
[38]
Bertus Kruger. 2015. Arduino CNC Shield – 100% GRBL Compatable. Retrieved 01.03.2022 from https://blog.protoneer.co.nz/arduino-cnc-shield/
[39]
D. Lakatos and H. Ishii. 2012. Towards Radical Atoms — Form-giving to transformable materials. In 2012 IEEE 3rd International Conference on Cognitive Infocommunications (CogInfoCom). IEEE, Kosice, Slovakia, 37–40. https://doi.org/10.1109/CogInfoCom.2012.6422023
[40]
Mathieu Le Goc, Pierre Dragicevic, Samuel Huron, and Jean-Daniel Fekete. 2015. Design Considerations for Composite Physical Visualizations. In Proceedings of the CHI Workshop on Exploring the Challenges of Making Data Physical. HAL, Seoul, South Korea, 4 pages. https://hal.inria.fr/hal-01138024
[41]
Mathieu Le Goc, Lawrence H. Kim, Ali Parsaei, Jean-Daniel Fekete, Pierre Dragicevic, and Sean Follmer. 2016. Zooids: Building Blocks for Swarm User Interfaces. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology (Tokyo, Japan) (UIST ’16). Association for Computing Machinery, New York, NY, USA, 97–109. https://doi.org/10.1145/2984511.2984547
[42]
Mathieu Le Goc, Charles Perin, and Sean Follmer. 2018. Embedded Personal Physicalizations. In Toward a Design Language for Data Physicalization, IEEE VIS. IEEE, Berlin, Germany, 4 pages. https://hal.archives-ouvertes.fr/hal-01910351
[43]
David Ledo, Steven Houben, Jo Vermeulen, Nicolai Marquardt, Lora Oehlberg, and Saul Greenberg. 2018. Evaluation Strategies for HCI Toolkit Research. Association for Computing Machinery, New York, NY, USA, 1–17. https://doi.org/10.1145/3173574.3173610
[44]
Jinha Lee, Rehmi Post, and Hiroshi Ishii. 2011. ZeroN: Mid-Air Tangible Interaction Enabled by Computer Controlled Magnetic Levitation. In Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology (Santa Barbara, California, USA) (UIST ’11). Association for Computing Machinery, New York, NY, USA, 327–336. https://doi.org/10.1145/2047196.2047239
[45]
Daniel Leithinger, Sean Follmer, Alex Olwal, and Hiroshi Ishii. 2014. Physical Telepresence: Shape Capture and Display for Embodied, Computer-Mediated Remote Collaboration. In Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology (Honolulu, Hawaii, USA) (UIST ’14). Association for Computing Machinery, New York, NY, USA, 461–470. https://doi.org/10.1145/2642918.2647377
[46]
Daniel Leithinger, Sean Follmer, Alex Olwal, Samuel Luescher, Akimitsu Hogge, Jinha Lee, and Hiroshi Ishii. 2013. Sublimate: State-Changing Virtual and Physical Rendering to Augment Interaction with Shape Displays. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Paris, France) (CHI ’13). Association for Computing Machinery, New York, NY, USA, 1441–1450. https://doi.org/10.1145/2470654.2466191
[47]
Daniel Leithinger and Hiroshi Ishii. 2010. Relief: A Scalable Actuated Shape Display. In Proceedings of the Fourth International Conference on Tangible, Embedded, and Embodied Interaction (Cambridge, Massachusetts, USA) (TEI ’10). Association for Computing Machinery, New York, NY, USA, 221–222. https://doi.org/10.1145/1709886.1709928
[48]
Daniel Leithinger, David Lakatos, Anthony DeVincenzi, Matthew Blackshaw, and Hiroshi Ishii. 2011. Direct and Gestural Interaction with Relief: A 2.5D Shape Display. In Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology (Santa Barbara, California, USA) (UIST ’11). Association for Computing Machinery, New York, NY, USA, 541–548. https://doi.org/10.1145/2047196.2047268
[49]
Lifesize. 2021. Kaptivo whiteboard. Retrieved 01.03.2022 from https://www.lifesize.com/en/meeting-solutions/digital-whiteboard/
[50]
David Lindlbauer, Jens Emil Grønbæk, Morten Birk, Kim Halskov, Marc Alexa, and Jörg Müller. 2016. Combining Shape-Changing Interfaces and Spatial Augmented Reality Enables Extended Object Appearance. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (San Jose, California, USA) (CHI ’16). Association for Computing Machinery, New York, NY, USA, 791–802. https://doi.org/10.1145/2858036.2858457
[51]
Siân E. Lindley, Anja Thieme, Alex S. Taylor, Vasilis Vlachokyriakos, Tim Regan, and David Sweeney. 2017. Surfacing Small Worlds through Data-In-Place. Computer Supported Cooperative Work (CSCW) 26, 1 (01 Apr 2017), 135–163. https://doi.org/10.1007/s10606-017-9263-3
[52]
P. Locher and C. Nodine. 1989. The Perceptual Value of Symmetry. In Symmetry 2, István Hargittai (Ed.). Pergamon, Amsterdam, 475–484. https://doi.org/10.1016/B978-0-08-037237-2.50039-8
[53]
Daphne Menheere, Evianne van Hartingsveldt, Mads Birkebæk, Steven Vos, and Carine Lallemand. 2021. Laina: Dynamic Data Physicalization for Slow Exercising Feedback. In Designing Interactive Systems Conference 2021 (Virtual Event, USA) (DIS ’21). Association for Computing Machinery, New York, NY, USA, 1015–1030. https://doi.org/10.1145/3461778.3462041
[54]
Microsoft. 2019. Microsoft HoloLens 2. Retrieved 01.03.2022 from https://www.microsoft.com/en-us/hololens
[55]
Rafael Morales, Asier Marzo, Sriram Subramanian, and Diego Martínez. 2019. LeviProps: Animating Levitated Optimized Fabric Structures Using Holographic Acoustic Tweezers. In Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology (New Orleans, LA, USA) (UIST ’19). Association for Computing Machinery, New York, NY, USA, 651–661. https://doi.org/10.1145/3332165.3347882
[56]
Sara Nabil, Aluna Everitt, Miriam Sturdee, Jason Alexander, Simon Bowen, Peter Wright, and David Kirk. 2018. ActuEating: Designing, Studying and Exploring Actuating Decorative Artefacts. In Proceedings of the 2018 Designing Interactive Systems Conference (Hong Kong, China) (DIS ’18). Association for Computing Machinery, New York, NY, USA, 327–339. https://doi.org/10.1145/3196709.3196761
[57]
Ken Nakagaki. 2020. Mechanical Shells: Physical Add-Ons for Extending and Reconfiguring the Interactivities of Actuated TUIs. In Adjunct Publication of the 33rd Annual ACM Symposium on User Interface Software and Technology (Virtual Event, USA) (UIST ’20 Adjunct). Association for Computing Machinery, New York, NY, USA, 151–156. https://doi.org/10.1145/3379350.3415801
[58]
Ken Nakagaki, Daniel Fitzgerald, Zhiyao (John) Ma, Luke Vink, Daniel Levine, and Hiroshi Ishii. 2019. InFORCE: Bi-Directional ‘Force’ Shape Display for Haptic Interaction. In Proceedings of the Thirteenth International Conference on Tangible, Embedded, and Embodied Interaction (Tempe, Arizona, USA) (TEI ’19). Association for Computing Machinery, New York, NY, USA, 615–623. https://doi.org/10.1145/3294109.3295621
[59]
Mie Nørgaard, Tim Merritt, Majken Kirkegaard Rasmussen, and Marianne Graves Petersen. 2013. Exploring the Design Space of Shape-Changing Objects: Imagined Physics. In Proceedings of the 6th International Conference on Designing Pleasurable Products and Interfaces (Newcastle upon Tyne, United Kingdom) (DPPI ’13). Association for Computing Machinery, New York, NY, USA, 251–260. https://doi.org/10.1145/2513506.2513533
[60]
Alex Olwal, Jon Moeller, Greg Priest-Dorman, Thad Starner, and Ben Carroll. 2018. I/O Braid: Scalable Touch-Sensitive Lighted Cords Using Spiraling, Repeating Sensing Textiles and Fiber Optics. In Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology (Berlin, Germany) (UIST ’18). Association for Computing Machinery, New York, NY, USA, 485–497. https://doi.org/10.1145/3242587.3242638
[61]
Themis Omirou, Asier Marzo, Sue Ann Seah, and Sriram Subramanian. 2015. LeviPath: Modular Acoustic Levitation for 3D Path Visualisations. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (Seoul, Republic of Korea) (CHI ’15). Association for Computing Machinery, New York, NY, USA, 309–312. https://doi.org/10.1145/2702123.2702333
[62]
Z. Pousman, J. Stasko, and M. Mateas. 2007. Casual Information Visualization: Depictions of Data in Everyday Life. IEEE Transactions on Visualization and Computer Graphics 13, 6 (Nov 2007), 1145–1152. https://doi.org/10.1109/TVCG.2007.70541
[63]
Hayes Solos Raffle, Amanda J. Parkes, and Hiroshi Ishii. 2004. Topobo: A Constructive Assembly System with Kinetic Memory. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Vienna, Austria) (CHI ’04). Association for Computing Machinery, New York, NY, USA, 647–654. https://doi.org/10.1145/985692.985774
[64]
Majken K. Rasmussen, Esben W. Pedersen, Marianne G. Petersen, and Kasper Hornbæk. 2012. Shape-Changing Interfaces: A Review of the Design Space and Open Research Questions. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Austin, Texas, USA) (CHI ’12). Association for Computing Machinery, New York, NY, USA, 735–744. https://doi.org/10.1145/2207676.2207781
[65]
Yvonne Rogers, William R. Hazlewood, Paul Marshall, Nick Dalton, and Susanna Hertrich. 2010. Ambient Influence: Can Twinkly Lights Lure and Abstract Representations Trigger Behavioral Change?. In Proceedings of the 12th ACM International Conference on Ubiquitous Computing (Copenhagen, Denmark) (UbiComp ’10). Association for Computing Machinery, New York, NY, USA, 261–270. https://doi.org/10.1145/1864349.1864372
[66]
Pedro de Almeida Sacramento, Ricardo dos Santos Ferreira, and Marcus Vinicius Alvim Andrade. 2019. Bezalel - Towards Low-Cost Pin-Based Shape Displays. In SIGGRAPH Asia 2019 Technical Briefs(Brisbane, QLD, Australia) (SA ’19). Association for Computing Machinery, New York, NY, USA, 106–109. https://doi.org/10.1145/3355088.3365144
[67]
Deepak Ranjan Sahoo, Takuto Nakamura, Asier Marzo, Themis Omirou, Michihiro Asakawa, and Sriram Subramanian. 2016. JOLED: A Mid-Air Display Based on Electrostatic Rotation of Levitated Janus Objects. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology (Tokyo, Japan) (UIST ’16). Association for Computing Machinery, New York, NY, USA, 437–448. https://doi.org/10.1145/2984511.2984549
[68]
Kim Sauvé, Saskia Bakker, and Steven Houben. 2020. Econundrum: Visualizing the Climate Impact of Dietary Choice through a Shared Data Sculpture. Association for Computing Machinery, New York, NY, USA, 1287–1300. https://doi.org/10.1145/3357236.3395509
[69]
Kim Sauvé, Saskia Bakker, and Steven Houben. 2020. Econundrum: Visualizing the Climate Impact of Dietary Choice through a Shared Data Sculpture. In Proceedings of the 2020 ACM Designing Interactive Systems Conference (Eindhoven, Netherlands) (DIS ’20). Association for Computing Machinery, New York, NY, USA, 1287–1300. https://doi.org/10.1145/3357236.3395509
[70]
S. A. Seah, B. W. Drinkwater, T. Carter, R. Malkin, and S. Subramanian. 2014. Correspondence: Dexterous ultrasonic levitation of millimeter-sized objects in air. IEEE Transactions on Ultrasonics, Ferroelectrics, and Frequency Control 61, 7 (July 2014), 1233–1236. https://doi.org/10.1109/TUFFC.2014.3022
[71]
Sue Ann Seah, Diego Martinez Plasencia, Peter D. Bennett, Abhijit Karnik, Vlad Stefan Otrocol, Jarrod Knibbe, Andy Cockburn, and Sriram Subramanian. 2014. SensaBubble: A Chrono-Sensory Mid-Air Display of Sight and Smell. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Toronto, Ontario, Canada) (CHI ’14). Association for Computing Machinery, New York, NY, USA, 2863–2872. https://doi.org/10.1145/2556288.2557087
[72]
Orit Shaer and Eva Hornecker. 2009. Tangible User Interfaces: Past, Present, and Future Directions. Foundations and Trends in Human-Computer Interaction 3 (01 2009), 1–137. https://doi.org/10.1561/1100000026
[73]
SMART. 2021. kapp 84 board. Retrieved 01.03.2022 from https://support.smarttech.com/docs/hardware/kapp/kapp/en/about/specifications/kapp-84.cshtml
[74]
sosolimited. 2016. Diffusion Choir. Retrieved 01.03.2022 from https://www.sosolimited.com/work/diffusion-choir/
[75]
Miriam Sturdee, John Hardy, Nick Dunn, and Jason Alexander. 2015. A Public Ideation of Shape-Changing Applications. In Proceedings of the 2015 International Conference on Interactive Tabletops & Surfaces (Madeira, Portugal) (ITS ’15). Association for Computing Machinery, New York, NY, USA, 219–228. https://doi.org/10.1145/2817721.2817734
[76]
Ryo Suzuki, Ryosuke Nakayama, Dan Liu, Yasuaki Kakehi, Mark D. Gross, and Daniel Leithinger. 2020. LiftTiles: Constructive Building Blocks for Prototyping Room-Scale Shape-Changing Interfaces. In Proceedings of the Fourteenth International Conference on Tangible, Embedded, and Embodied Interaction (Sydney NSW, Australia) (TEI ’20). Association for Computing Machinery, New York, NY, USA, 143–151. https://doi.org/10.1145/3374920.3374941
[77]
Christian Ferrara; Jon Mc Taggart. 2011. Pulse. Retrieved 01.03.2022 from https://cargocollective.com/Pulse
[78]
Faisal Taher, John Hardy, Abhijit Karnik, Christian Weichel, Yvonne Jansen, Kasper Hornbæk, and Jason Alexander. 2015. Exploring Interactions with Physically Dynamic Bar Charts. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (Seoul, Republic of Korea) (CHI ’15). Association for Computing Machinery, New York, NY, USA, 3237–3246. https://doi.org/10.1145/2702123.2702604
[79]
Faisal Taher, John Vidler, and Jason Alexander. 2017. A Characterization of Actuation Techniques for Generating Movement in Shape-Changing Interfaces. International Journal of Human–Computer Interaction 33, 5(2017), 385–398. https://doi.org/10.1080/10447318.2016.1250372
[80]
TAIT. 2010. Shanghai Spheres. Retrieved 01.03.2022 from https://www.taittowers.com/portfolio/shanghai-spheres-world-expo-shanghai-china/
[81]
Unity Technologies. 2021. Unity Real-Time Development Platform | 3D, 2D VR & AR Engine. Retrieved 01.03.2022 from https://unity.com/
[82]
John Tiab, Sebastian Boring, Paul Strohmeier, Anders Markussen, Jason Alexander, and Kasper Hornbæk. 2018. Tiltstacks: Composing Shape-Changing Interfaces Using Tilting and Stacking of Modules. In Proceedings of the 2018 International Conference on Advanced Visual Interfaces (Castiglione della Pescaia, Grosseto, Italy) (AVI ’18). Association for Computing Machinery, New York, NY, USA, Article 44, 5 pages. https://doi.org/10.1145/3206505.3206530
[83]
Yuki Uno, Hao Qiu, Toru Sai, Shunta Iguchi, Yota Mizutani, Takayuki Hoshi, Yoshihiro Kawahara, Yasuaki Kakehi, and Makoto Takamiya. 2018. Luciola: A Millimeter-Scale Light-Emitting Particle Moving in Mid-Air Based On Acoustic Levitation and Wireless Powering. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 1, 4, Article 166 (Jan. 2018), 17 pages. https://doi.org/10.1145/3161182
[84]
Leslie Carlson Vaughan. 1997. Understanding Movement. In Proceedings of the ACM SIGCHI Conference on Human Factors in Computing Systems (Atlanta, Georgia, USA) (CHI ’97). Association for Computing Machinery, New York, NY, USA, 548–549. https://doi.org/10.1145/258549.259028
[85]
Open Weather. 2021. Weather API - OpenWeatherMap. Retrieved 01.03.2022 from https://openweathermap.org/api
[86]
Mark Weiser. 1999. The Computer for the 21st Century. SIGMOBILE Mob. Comput. Commun. Rev. 3, 3 (July 1999), 3–11. https://doi.org/10.1145/329124.329126
[87]
WHITEvoid GmbH. 2021. Kinetic Lights - The Original DMX Power Winch System. Retrieved 01.03.2022 from https://www.kinetic-lights.com/
[88]
Wesley Willett, Yvonne Jansen, and Pierre Dragicevic. 2017. Embedded Data Representations. IEEE Transactions on Visualization and Computer Graphics 23, 1 (Jan 2017), 461–470. https://doi.org/10.1109/TVCG.2016.2598608
[89]
Xiuming Zhang, Tali Dekel, Tianfan Xue, Andrew Owens, Qiurui He, Jiajun Wu, Stefanie Mueller, and William T. Freeman. 2018. MoSculp: Interactive Visualization of Shape and Time. In Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology (Berlin, Germany) (UIST ’18). Association for Computing Machinery, New York, NY, USA, 275–285. https://doi.org/10.1145/3242587.3242592
[90]
Jack Zhao and Andrew Vande Moere. 2008. Embodiment in Data Sculpture: A Model of the Physical Visualization of Information. In Proceedings of the 3rd International Conference on Digital Interactive Media in Entertainment and Arts (Athens, Greece) (DIMEA ’08). Association for Computing Machinery, New York, NY, USA, 343–350. https://doi.org/10.1145/1413634.1413696

Cited By

View all
  • (2024)Knitting Interactive Spaces: Fabricating Data Physicalizations of Local Community Visitors with Circular Knitting MachinesProceedings of the Eighteenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3623509.3633359(1-14)Online publication date: 11-Feb-2024
  • (2024)Squishy, Yet Satisfying: Exploring Deformable Shapes' Cross-Modal Correspondences with Colours and EmotionsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3641952(1-20)Online publication date: 11-May-2024
  • (2024)Soft Growing Pin for High-Extension Shape-Changing Displays2024 IEEE 7th International Conference on Soft Robotics (RoboSoft)10.1109/RoboSoft60065.2024.10522001(650-656)Online publication date: 14-Apr-2024
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
CHI '22: Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems
April 2022
10459 pages
ISBN:9781450391573
DOI:10.1145/3491102
This work is licensed under a Creative Commons Attribution International 4.0 License.

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 29 April 2022

Check for updates

Author Tags

  1. Casual Visualization
  2. Data Physicalization
  3. Prototyping Platform
  4. Shape-Changing Interface
  5. Spatial Display
  6. Tangible Interaction

Qualifiers

  • Research-article
  • Research
  • Refereed limited

Funding Sources

Conference

CHI '22
Sponsor:
CHI '22: CHI Conference on Human Factors in Computing Systems
April 29 - May 5, 2022
LA, New Orleans, USA

Acceptance Rates

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI 2025
ACM CHI Conference on Human Factors in Computing Systems
April 26 - May 1, 2025
Yokohama , Japan

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)654
  • Downloads (Last 6 weeks)70
Reflects downloads up to 16 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2024)Knitting Interactive Spaces: Fabricating Data Physicalizations of Local Community Visitors with Circular Knitting MachinesProceedings of the Eighteenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3623509.3633359(1-14)Online publication date: 11-Feb-2024
  • (2024)Squishy, Yet Satisfying: Exploring Deformable Shapes' Cross-Modal Correspondences with Colours and EmotionsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3641952(1-20)Online publication date: 11-May-2024
  • (2024)Soft Growing Pin for High-Extension Shape-Changing Displays2024 IEEE 7th International Conference on Soft Robotics (RoboSoft)10.1109/RoboSoft60065.2024.10522001(650-656)Online publication date: 14-Apr-2024
  • (2024)ProgrammableGrass: A Shape-Changing Artificial Grass Display Adapted for Dynamic and Interactive Display FeaturesIEEE Access10.1109/ACCESS.2024.338091112(45654-45673)Online publication date: 2024
  • (2024)Eyebient Displays: Ambient Displays by Gaze GuidanceDistributed, Ambient and Pervasive Interactions10.1007/978-3-031-60012-8_21(336-346)Online publication date: 29-Jun-2024
  • (2023)Enhancing Color Scales for Active Data PhysicalizationsApplied Sciences10.3390/app1401016614:1(166)Online publication date: 24-Dec-2023
  • (2023)Chandelier: Interaction Design With Surrounding Mid-Air Tangible InterfaceAdjunct Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology10.1145/3586182.3616695(1-3)Online publication date: 29-Oct-2023
  • (2023)Masktrap: Designing and Identifying Gestures to Transform Mask Strap into an Input InterfaceProceedings of the 28th International Conference on Intelligent User Interfaces10.1145/3581641.3584062(762-775)Online publication date: 27-Mar-2023
  • (2023)AeroRigUI: Actuated TUIs for Spatial Interaction using Rigging Swarm Robots on Ceilings in Everyday SpaceProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581437(1-18)Online publication date: 19-Apr-2023
  • (2023)ThrowIO: Actuated TUIs that Facilitate “Throwing and Catching” Spatial Interaction with Overhanging Mobile Wheeled RobotsProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581267(1-17)Online publication date: 19-Apr-2023

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Login options

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media