VISMOCK: A Programmable Smocking Technique for Creating Interactive Data Physicalization
Pages 2341 - 2356
Abstract
Data physicalization is a research area that explores representing data attributes through manipulating the geometric and physical properties of tangible objects. We introduce VISMOCK, a data physicalization approach that leverages a fabric manipulation technique called “smocking”. VISMOCK supports the creation of interactive and dynamic data physi-calizations by extending the smocking technique with programmable components such as thermochromic pigments and shape memory alloys. Using a research-through-design methodology, we develop an initial design space for VISMOCK that shows how data can be represented using visual and tactile variables, as well as the affordances of VISMOCK. We demonstrate the generative power of our design space through four exemplars, created using VISMOCK. We use these exemplars to discuss the advantages and limitations of VISMOCK as a tool for data physicalization.
References
[1]
Noor Ali-Hasan, Diana Gavales, Andrew Peterson, and Matthew Raw. 2006. Fitster: social fitness information visualizer. In CHI’06 Extended Ab-stractson Human Factors in Computing Systems. 1795-1800.
[2]
S Sandra Bae, Takanori Fujiwara, Anders Ynner-man, Ellen Yi-Luen Do, Michael L Rivera, and Danielle Albers Szafir. 2023. A Computational Design Pipeline to Fabricate Sensing Network Physicalizations. IEEE Transactions on Visualization and Computer Graphics (2023).
[3]
S Sandra Bae, Clement Zheng, Mary Etta West, Ellen Yi-Luen Do, Samuel Huron, and Danielle Albers Szafir. 2022. Making data tangible: A cross-disciplinary design space for data physicalization. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems. 1-18.
[4]
Jacques Bertin. 1983. Semiology of graphics. University of Wisconsin press.
[5]
Jacques Bertin. 2011. Graphics and graphic information processing. Walter de Gruyter.
[6]
Joanna Berzowska and Marcelo Coelho. 2006. Smoks: the memory suits. In CHI’06 Extended Abstracts on Human Factors in Computing Systems. 538-543.
[7]
Alberto Boem, Kai Sasaki, and Shori Kano. 2017. Vital+ morph: A shape-changing interface for remote biometric monitoring. In Proceedings of the Eleventh International Conference on Tangible, Embedded, and Embodied Interaction. 503-509.
[8]
Andy Cockburn, Amy Karlson, and Benjamin B. Bederson. 2009. A Review of Overview+detail, Zooming, and Focus+context Interfaces. ACM Comput. Surv. 41, 1, Article 2 (jan 2009), 31 pages.
[9]
Foroozan Daneshzand, Charles Perin, and Sheel-agh Carpendale. 2022. KiriPhys: Exploring New Data Physicalization Opportunities. IEEE Transactions on Visualization and Computer Graphics 29, 1 (2022), 225-235.
[10]
Laura Devendorf, Joanne Lo, Noura Howell, Jung Lin Lee, Nan-Wei Gong, M Emre Karagozler, Shiho Fukuhara, Ivan Poupyrev, Eric Paulos, and Kimiko Ryokai. 2016. “ I don't Want to Wear a Screen” Probing Perceptions of and Possibilities for Dynamic Displays on Clothing. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. 6028-6039.
[11]
Pierre Dragicevic, Yvonne Jansen, and Andrew Vande Moere. 2020. Data physicalization. Handbook of Human Computer Interaction (2020), 1-51.
[12]
Adam Drogemuller, Andrew Cunningham, James A Walsh, James Baumeister, Ross T Smith, and Bruce H Thomas. 2021. Haptic and visual comprehension of a 2D graph layout through physicalisa-tion. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems.
[13]
Steven Drucker and Roland Fernandez. 2015. A unifying framework for animated and interactive unit visualizations. Microsoft Research 1 (2015).
[14]
Tamara Anna Efrat, Moran Mizrahi, and Amit Zoran. 2016. The hybrid bricolage: bridging parametric design with craft through algorithmic modularity. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. 5984-5995.
[15]
Niklas Elmqvist and Jean-Daniel Fekete. 2009. Hierarchical aggregation for information visualization: Overview, techniques, and design guidelines. IEEE transactions on visualization and computer graphics 16, 3 (2009), 439-454.
[16]
Niklas Elmqvist, Nathalie Henry, Yann Riche, and Jean-Daniel Fekete. 2008. Melange: space folding for multi-focus interaction. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 1333-1342.
[17]
Shreyosi Endow, Mohammad Abu Nasir Rakib, Anvay Srivastava, Sara Rastegarpouyani, and Cesar Torres. 2022. Embr: A Creative Framework for Hand Embroidered Liquid Crystal Textile Displays. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems. 1-14.
[18]
Marinella Ferrara, Murat Bengisu, Marinella Ferrara, and Murat Bengisu. 2014. Materials that change color. Springer.
[19]
Ebba Fransén Waldhör, Pauline Vierne, Paul Seidler, Berit Greinke, and Katharina Bredies. 2017. E-textile production of wearable ambient notification devices. In Proceedings of the 2017 ACM Conference Companion Publication on Designing Interactive Systems. 309-312.
[20]
Rex Hartson. 2003. Cognitive, physical, sensory, and functional affordances in interaction design. Behaviour & information technology 22, 5 (2003), 315-338.
[21]
Anja Hertenberger, Barbro Scholz, Beam Con-trechoc, Becky Stewart, Ebru Kurbak, Hannah Perner-Wilson, Irene Posch, Isabel Cabral, Jie Qi, Katharina Childs, . 2014. 2013 e-textile swatchbook exchange: the importance of sharing physical work. In Proceedings of the 2014 ACM international symposium on wearable computers: Adjunct program. 77-81.
[22]
Trevor Hogan and Eva Hornecker. 2013. In touch with space: embodying live data for tangible interaction. In Proceedings of the 7th international conference on tangible, embedded and embodied interaction. 275-278.
[23]
Trevor Hogan and Eva Hornecker. 2017. Towards a design space for multisensory data representation. Interacting with Computers 29, 2 (2017), 147-167.
[24]
Michael Holroyd, Ilya Baran, Jason Lawrence, and Wojciech Matusik. 2011. Computing and fabricating multilayer models. In Proceedings of the 2011 SIGGRAPH Asia Conference. 1-8.
[25]
Eva Hornecker, Trevor Hogan, Uta Hinrichs, and Rosa van Koningsbruggen. 2023. A Design Vocabulary for Data Physicalization. ACM Transactions on Computer-Human Interaction (2023).
[26]
Samuel Huron, Romain Vuillemot, and JeanDaniel Fekete. 2013. Visual sedimentation. IEEE Transactions on Visualization and Computer Graphics 19, 12 (2013), 2446-2455.
[27]
Yvonne Jansen, Pierre Dragicevic, Petra Isenberg, Jason Alexander, Abhijit Karnik, Johan Kildal, Sriram Subramanian, and Kasper Hornbsk. 2015. Opportunities and challenges for data physicalization. In Proceedings of the 33 rd Annual ACM Conference on Human Factors in Computing Systems. 3227-3236.
[28]
Mengqi Jiang, Vijayakumar Nanjappan, Hai-Ning Liang, and Martijn ten Bhõmer. 2022. GesFabri: Exploring Affordances and Experience of Textile Interfaces for Gesture-based Interaction. Proceedings of the ACM on Human-Computer Interaction 6, EICS (2022), 1-23.
[29]
Ruby Joseph, Kaur Prabhjot, Mehtab Shazia, . 2011. Lattice smocking techniques: an innovative approach to smocking. Asian Journal of Home Science 6, 1 (2011), 5-11.
[30]
Somi Ju, Kyung-Ryong Lee, Subin Kim, and Young-Woo Park. 2019. Bookly: an interactive everyday artifact showing the time of physically accumulated reading activity. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. 1-8.
[31]
Viirj Kan, Katsuya Fujii, Judith Amores, Chang Long Zhu Jin, Pattie Maes, and Hiroshi Ishii. 2015. Social textiles: Social affordances and icebreaking interactions through wearable social messaging. In Proceedings of the Ninth International Conference on Tangible, Embedded, and Embodied Interaction. 619-624.
[32]
Maria Karyda, Danielle Wilde, and Mette Gislev Kjsrsgaard. 2020. Narrative physicalization: Supporting interactive engagement with personal data. IEEE Computer Graphics and Applications 41, 1 (2020), 74-86.
[33]
Pouya M Khorsandi, Lee Jones, Vandad Davood-nia, Timothy J Lampen, Aliya Conrad, Ali Etemad, and Sara Nabil. 2023. FabriCar: Enriching the User Experience of In-Car Media Interactions with Ubiquitous Vehicle Interiors using E-textile Sensors. In Proceedings of the 2023 ACM Designing Interactive Systems Conference. 1438-1456.
[34]
Sang Jin Kim, Sang Un Kim, Chi Cuong Vu, and Joo Yong Kim. 2023. Improved heating method for shape-memory alloy using carbon nanotube and silver paste. Fashion and Textiles 10, 1 (2023), 16.
[35]
Abiodun Komolafe, Bahareh Zaghari, Russel Torah, Alex S Weddell, Hamideh Khanbareh, Zois Michail Tsikriteas, Mark Vousden, Mahmoud Wagih,Ulises Tronco Jurado, Junjie Shi, 2021. E-textile technology review-from materials to application. Ieee Access 9 (2021), 97152-97179.
[36]
Pin-Sung Ku, Kunpeng Huang, and Cindy Hsin-Liu Kao. 2022. Patch-O: Deformable Woven Patches for On-body Actuation. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems. 1-12.
[37]
Carine Lallemand and Maud Oomen. 2022. The Candy Workshop: Supporting Rich Sensory Modalities in Constructive Data Physicalization. In CHI Conference on Human Factors in Computing Systems Extended Abstracts. 1-7.
[38]
Ricardo Langner, Lonni Besancon, Christopher Collins, Tim Dwyer, Petra Isenberg, Tobias Isenberg, Bongshin Lee, Charles Perin, and Christian Tominski. 2021. Mobile Data Visualization. Chapman and Hall/CRC, Chapter An Introduction to Mobile Data Visualization.
[39]
Mathieu Le Goc, Lawrence H Kim, Ali Parsaei, Jean-Daniel Fekete, Pierre Dragicevic, and Sean Follmer. 2016. Zooids: Building blocks for swarm user interfaces. In Proceedings of the 29th annual symposium on user interface software and technology. 97-109.
[40]
Mathieu Le Goc, Charles Perin, and Sean Follmer. 2018. Embedded Personal Physicalizations. In Toward a Design Language for Data Physicalization, IEEE VIS.
[41]
Mathieu Le Goc, Charles Perin, Sean Follmer, Jean-Daniel Fekete, and Pierre Dragicevic. 2018. Dynamic composite data physicalization using wheeled micro-robots. IEEE transactions on visualization and computer graphics 25, 1 (2018), 737-747.
[42]
David Ledo, Steven Houben, Jo Vermeulen, Nicolai Marquardt, Lora Oehlberg, and Saul Green-berg. 2018. Evaluation strategies for HCI toolkit research. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. 1-17.
[43]
Kyung-Ryong Lee, Somi Ju, Temirlan Dzhoroev, Geonil Goh, Moon-Hwan Lee, and Young-Woo Park. 2020. DayClo: an everyday table clock providing interaction with personal schedule data for self-reflection. In Proceedings of the 2020 ACM Designing Interactive Systems Confer-ence.1793-1806.
[44]
Kyung-Ryong Lee, Beom Kim, Junyoung Kim, Hwajung Hong, and Young-Woo Park. 2021. ADIO: An interactive artifact physically representing the intangible digital audiobook listening experience in everyday living spaces. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. 1-12.
[45]
Christian Lexcellent, Sylvain Leclercq, Bertrand Gabry, and Gilles Bourbon. 2000. The two way shape memory effect of shape memory alloys: an experimental study and a phenomenological model. International Journal of Plasticity 16, 10-11 (2000), 1155-1168
[46]
Malin Lind. 2019. Smocked patterns: An exploration of jacquard woven patterns and smocking techniques for a spatial textile design context.
[47]
Guanhong Liu, Tianyu Yu, Zhihao Yao, Haiqing Xu, Yunyi Zhang, Xuhai Xu, Xiaomeng Xu, Mingyue Gao, Qirui Sun, Tingliang Zhang, . 2022. ViviPaint: Creating Dynamic Painting with a Thermochromic Toolkit. Multimodal Technologies and Interaction 6, 8 (2022), 63.
[48]
Sarah Ljungdahl. 2018. smock x knit: Exploring the possibility of shape in knitwear by looking at theaesthetic properties of smocking, drawing inspiration from sportswear. University of Boras. https://urn.kb.se/resolve?urn=urn%3Anbn%3Ase %3Ahb%3Adiva-14890.
[49]
Qiuyu Lu, Haiqing Xu, Yijie Guo, Joey Yu Wang, and Lining Yao. 2023. Fluidic Computation Kit: Towards Electronic-free Shape-changing Interfaces. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. 1-21.
[50]
Olfat Mansour. 2020. Aesthetics of Smocking Stitches in Zero-Waste Innovative Fashion Design. International Design Journal 10, 1 (2020), 381-399.
[51]
Matthew Mauriello, Michael Gubbels, and Jon E Froehlich. 2014. Social fabric fitness: the design and evaluation of wearable E-textile displays to support group running. In Proceedings of the SIGCHIConference on Human Factors in Computing Systems. 2833-2842.
[52]
Sarah Mennicken, AJ Bernheim Brush, Asta Rose-way, and James Scott. 2014. Finding roles for interactive furniture in homes with EmotoCouch. In Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing: Adjunct Publication. 923-930.
[53]
Tamara Munzner. 2014. Visualization analysis and design. CRC press.
[54]
Sara Nabil, Aluna Everitt, Miriam Sturdee, Jason Alexander, Simon Bowen, Peter Wright, and David Kirk. 2018. ActuEating: Designing, studying and exploring actuating decorative artefacts. In Proceedings of the 2018 Designing Interactive Systems Conference. 327-339.
[55]
Sara Nabil and David Kirk. 2019. Interactive Interior Design and Personal Data. People, Personal Data and the Built Environment (2019), 103-122.
[56]
Sara Nabil, Jan Kucera, Nikoletta Karastathi, David S Kirk, and Peter Wright. 2019. Seamless seams: Crafting techniques for embedding fabrics with interactive actuation. In Proceedings of the 2019 on Designing Interactive Systems Conference. 987-999.
[57]
Leyla Norooz, Matthew Louis Mauriello, Anita Jorgensen, Brenna McNally, and Jon E Froehlich. 2015. BodyVis: A new approach to body learning through wearable sensing and visualization. In Proceedings of the 33 rd Annual ACM Conference on Human Factors in Computing Systems. 1025-1034.
[58]
Deokgun Park, Steven M Drucker, Roland Fernandez, and Niklas Elmqvist. 2017. Atom: A grammar for unit visualizations. IEEE transactions on visualization and computer graphics 24, 12 (2017), 3032-3043.
[59]
Jesse Pepping, Sarah Scholte, Marnix Van Wij-land, Milan De Meij, Günter Wallner, and Regina Bernhaupt. 2020. Motiis: Fostering Parents’ Awareness of their Adolescents Emotional Experiences during Gaming. In Proceedings of the 11th Nordic Conference on Human-Computer Interaction: Shaping Experiences, Shaping Society. 1-11.
[60]
Charles Perin. 2021. What Students Learn With Personal Data Physicalization. IEEE Computer Graphics and Applications 41, 6 (2021), 48-58. https://doi.org/10.1109/MCG.2021.3115417
[61]
Ivan Poupyrev, Nan-Wei Gong, Shiho Fukuhara, Mustafa Emre Karagozler, Carsten Schwesig, and Karen E Robinson. 2016. Project Jacquard: interactive digital textiles at scale. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. 4216-4227.
[62]
Purnendu, Sasha M Novack, Eric Acome, Christoph Keplinger, Mirela Alistar, Mark D Gross, Carson Bruns, and Daniel Leithinger. 2021. Electriflow:Soft Electrohydraulic Building Blocks for Prototyping Shape-changing Interfaces. In Designing Interactive Systems Conference 2021. 1280-1290.
[63]
Andrew Saunders and Gregory Epps. 2016. Robotic lattice smock: a method for transposing pliable textile smocking techniques through robotic curved folding and bending of sheet metal. Robotic Fabrication in Architecture, Art and Design 2016 (2016), 78-91.
[64]
Kim Sauvé, Saskia Bakker, Nicolai Marquardt, and Steven Houben. 2020. LOOP: Exploring phys-icalization of activity tracking data. In Proceedings of the 11th nordic conference on human-computer interaction: shaping experiences, shaping society. 1-12.
[65]
Kim Sauvé, Argenis Ramirez Gomez, and Steven Houben. 2022. Put a Label On It! Approaches for Constructing and Contextualizing Bar Chart Physicalizations. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems. 1-15.
[66]
Yingli Shi, Chengjun Wang, Yafei Yin, Yuhang Li, Yufeng Xing, and Jizhou Song. 2019. Functional soft composites as thermal protecting substratesfor wearable electronics. Advanced Functional Materials 29, 45 (2019), 1905470.
[67]
Samuel Silva, Beatriz Sousa Santos, and Joaquim Madeira. 2011. Using color in visualization: A survey. Computers & Graphics 35, 2 (2011), 320-333.
[68]
Ruth Singer. 2013. Fabric manipulation: 150 creative sewing techniques. David & Charles.
[69]
AYN Sofia, DM Elzey, and HNG Wadley. 2008. Two-way antagonistic shape actuation based on the one-way shape memory effect. Journal of Intelligent Material Systems and Structures 19, 9 (2008), 1017-1027.
[70]
Simon Stusak, Andreas Butz, and Aurèlien Tabard. 2018. Variables for Data Physicalization Units. Toward a Design Language for Data Physicalization, IEEE VIS. (2018).
[71]
Saiganesh Swaminathan, Conglei Shi, Yvonne Jansen, Pierre Dragicevic, Lora A Oehlberg, and Jean-Daniel Fekete. 2014. Supporting the design and fabrication of physical visualizations. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 3845-3854.
[72]
Faisal Taher, John Hardy, Abhijit Karnik, Christian Weichel, Yvonne Jansen, Kasper Hornbsk, and Jason Alexander. 2015. Exploring interactions with physically dynamic bar charts. In Proceedings of the 33 rd annual acm conference on human factors in computing systems. 3237-3246.
[73]
Anne Theurel, Arnaud Witt, Philippe Claudet, Yvette Hatwell, and Edouard Gentaz. 2013. Tactile picture recognition by early blind children: the effect of illustration technique. Journal of experimental psychology: Applied 19, 3 (2013), 233.
[74]
Cesar Torres, Jessica Chang, Advaita Patel, and Eric Paulos. 2019. Phosphenes: Crafting resistive heaters within thermoreactive composites. In Proceedings of the 2019 on Designing Interactive Systems Conference. 907-919.
[75]
Annemiek Veldhuis, Rong-Hao Liang, and Tilde Bekker. 2020. CoDa: Collaborative data interpretation through an interactive tangible scatterplot. In Proceedings of the Fourteenth International Conference on Tangible, Embedded, and Embodied Interaction. 323-336.
[76]
Akira Wakita and Midori Shibutani. 2006. Mosaic textile: wearable ambient display with non-emissive color-changing modules. In Proceedings of the 2006 ACM SIGCHI international conference on Advances in computer entertainment technology. 48-es.
[77]
Weiyun Wang, Xianghua Ding, and Ilyena Hirskyj-Douglas. 2023. Everyday Space as an Interface for Health Data Engagement: Designing Tangible Displays of Stress Data. In Proceedings of the 2023 ACM Designing Interactive Systems Conference. 1648-1659.
[78]
Kentaro Yasu. 2022. MagneShape: A Nonelectrical Pin-Based Shape-Changing Display. In Proceedings of the 35th Annual ACM Symposium on User Interface Software and Technology. 1-12.
[79]
Tianyu Yu, Weiye Xu, Haiqing Xu, Guanhong Liu, Chang Liu, Guanyun Wang, and Haipeng Mi. 2023. Thermotion: Design and Fabrication of Thermofluidic Composites for Animation Effects on Object Surfaces. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. 1-19.
[80]
Yijun Zhao, Yong Shen, Xiaoqing Wang, Jiacheng Cao, Shang Xia, Fangtian Ying, and Guanyun Wang. 2021. PneuMat: Pneumatic Interaction System for Infant Sleep Safety Using Shape-Changing Interfaces. In Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems. 1-7.
[81]
John Zimmerman and Jodi Forlizzi. 2014. Research through design in HCI. In Ways of Knowing in HCI. Springer, 167-189.
[82]
John Zimmerman, Jodi Forlizzi, and Shelley Even-son. 2007. Research through design as a method for interaction design research in HCI. In Proceedings of the SIGCHI conference on Human factors in computing systems. 493-502.
Index Terms
- VISMOCK: A Programmable Smocking Technique for Creating Interactive Data Physicalization
Index terms have been assigned to the content through auto-classification.
Recommendations
Making Data Tangible: A Cross-disciplinary Design Space for Data Physicalization
CHI '22: Proceedings of the 2022 CHI Conference on Human Factors in Computing SystemsDesigning a data physicalization requires a myriad of different considerations. Despite the cross-disciplinary nature of these considerations, research currently lacks a synthesis across the different communities data physicalization sits upon, ...
Opportunities and Challenges for Data Physicalization
CHI '15: Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing SystemsPhysical representations of data have existed for thousands of years. Yet it is now that advances in digital fabrication, actuated tangible interfaces, and shape-changing displays are spurring an emerging area of research that we call Data ...
Tangible Data, explorations in data physicalization
TEI '16: Proceedings of the TEI '16: Tenth International Conference on Tangible, Embedded, and Embodied InteractionHumans have represented data in many forms for thousands of years, yet the main sensory channel we use to perceive these representations today still remains largely exclusive to sight. Recent developments, such as advances in digital fabrication, ...
Comments
Information & Contributors
Information
Published In
July 2024
3616 pages
ISBN:9798400705830
DOI:10.1145/3643834
Copyright © 2024 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 01 July 2024
Check for updates
Qualifiers
- Research-article
- Research
- Refereed limited
Funding Sources
- NSERC
Conference
DIS '24
Sponsor:
Acceptance Rates
Overall Acceptance Rate 1,158 of 4,684 submissions, 25%
Upcoming Conference
DIS '25
- Sponsor:
- sigchi
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 327Total Downloads
- Downloads (Last 12 months)327
- Downloads (Last 6 weeks)26
Reflects downloads up to 01 Mar 2025
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in