research-article

SCI-FI: Shape-Changing Interfaces, Future Interactions

Authors:

Giovanni Maria Troiano,

Youn-Kyung LimAuthors Info & Claims

NordiCHI '16: Proceedings of the 9th Nordic Conference on Human-Computer Interaction

Article No.: 45, Pages 1 - 10

https://doi.org/10.1145/2971485.2971489

Published: 23 October 2016 Publication History

Abstract

Shape-changing interfaces (SCI) are rapidly evolving and creating new interaction paradigms in human-computer interaction (HCI). However, empirical research in SCI is still bound to present technological limitations and existing prototypes can only show a limited number of potential applications for shape change. In this paper we attempt to broaden the pool of examples of what shape change may be good for by investigating SCI using Science Fiction (Sci-Fi) movies. We look at 340 Sci-Fi movies to identify instances of SCI and analyze their behavioral patterns and the context in which they are used. The result of our analysis presents four emerging behavioral patterns of shape change: (1) Reconfiguration, (2) Transformation, (3) Adaptation, and (4) Physicalization. We report a selection of SCI instances from Sci-Fi movies, which show how these behavioral patterns model functionalities of shape change and what they can do. Finally, we conclude by providing a discussion on how our results can inspire the design of SCI.

References

[1]

Ahmaniemi, T.T., Kildal, J., and Haveri, M. 2014. What is a Device Bend Gesture Really Good for? In CHI'14. Conference on Human Factors in Computing Systems, ACM, New York, NY, USA, 3503--3512.

Digital Library

[2]

Blythe, M.A. and Wright, P.C. 2006. Pastiche Scenarios: Fiction As a Resource for User Centred Design. Interact. Comput. 18, 5: 1139--1164.

Digital Library

[3]

Butler, Z., Fitch, R., Kotay, K., and Rus, D. 2002. Distributed Systems of Self-reconfiguring Robots. ACM SIGGRAPH 2002 Conference Abstracts and Applications, ACM, 69--69.

Digital Library

[4]

Drury, J.L., Yanco, H.A., Howell, W., Minten, B., and Casper, J. 2006. Changing Shape: Improving Situation Awareness for a Polymorphic Robot. Proceedings of the 1st ACM SIGCHI/SIGART Conference on Human-robot Interaction, ACM, 72--79.

Digital Library

[5]

Figueiredo, L.S., Gonçalves Maciel Pinheiro, M.G.M., Vilar Neto, E.X.C., and Teichrieb, V. 2015. An Open Catalog of Hand Gestures from Sci-Fi Movies. Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems, ACM, 1319--1324.

Digital Library

[6]

Follmer, S., Leithinger, D., Olwal, A., Cheng, N., and Ishii, H. 2012. Jamming user interfaces: programmable particle stiffness and sensing for malleable and shape-changing devices. Proceedings of the 25th annual ACM symposium on User interface software and technology, 519--528.

Digital Library

[7]

Follmer, S., Leithinger, D., Olwal, A., Hogge, A., and Ishii, H. 2013. inFORM: Dynamic Physical Affordances and Constraints Through Shape and Object Actuation. Proceedings of the 26th Annual ACM Symposium on User Interface Software and Technology, ACM, 417--426.

Digital Library

[8]

Gomes, A., Nesbitt, A., and Vertegaal, R. 2013. MorePhone: An Actuated Shape Changing Flexible Smartphone. In Proc. CHI '13 Extended Abstracts on Human Factors in Computing Systems, ACM, New York, NY, USA, 2879--2880.

Digital Library

[9]

Gomes, A. and Vertegaal, R. 2014. Paperfold: A Shape Changing Mobile Device with Multiple Reconfigurable Electrophoretic Magnetic Display Tiles. CHI '14 Extended Abstracts on Human Factors in Computing Systems, ACM, 535--538.

Digital Library

[10]

Greenberg, S., Boring, S., Vermeulen, J., and Dostal, J. 2014. Dark Patterns in Proxemic Interactions: A Critical Perspective. Proceedings of the 2014 Conference on Designing Interactive Systems, ACM, 523--532.

Digital Library

[11]

Harrison, C. and Hudson, S.E. 2009. Providing dynamically changeable physical buttons on a visual display. Proceedings of the 27th international conference on Human factors in computing systems -CHI '09, 299--270.

Digital Library

[12]

Hemmert, F., Löwe, M., Wohlauf, A., and Joost, G. 2013. Animate Mobiles: Proxemically Reactive Posture Actuation As a Means of Relational Interaction with Mobile Phones. Proceedings of the 7th International Conference on Tangible, Embedded and Embodied Interaction, ACM, 267--270.

Digital Library

[13]

Horev, O. 2006. Talking to the Hand: An exploration into shape shifting objects and morphing interfaces.

[14]

Iio, J., Iizuka, S., and Matsubara, H. 2014. The Database on Near-Future Technologies for User Interface Design from SciFi Movies. In Design, User Experience, and Usability. Theories, Methods, and Tools for Designing the User Experience, Aaron Marcus (ed.). Springer International Publishing, 572--579.

[15]

Ishii, H., Lakatos, D., Bonanni, L., and Labrune, J.-B. 2012. Radical atoms: beyond tangible bits, toward transformable materials. Interactions 19, 1: 38--51.

Digital Library

[16]

Jansen, Y., Dragicevic, P., Isenberg, P., et al. 2015. Opportunities and Challenges for Data Physicalization. Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, ACM, 3227--3236.

Digital Library

[17]

Khalilbeigi, M., Lissermann, R., Kleine, W., and Steimle, J. 2012. FoldMe: Interacting with Double-sided Foldable Displays. Proceedings of the Sixth International Conference on Tangible, Embedded and Embodied Interaction, ACM, 33--40.

Digital Library

[18]

Kildal, J., Paasovaara, S., and Aaltonen, V. 2012. 2012. Kinetic Device: Designing Interactions with a Deformable Mobile Interface. In CHI'12 Extended Abstracts on Human Factors in Computing Systems, ACM, New York, NY, USA, 1871--1876.

Digital Library

[19]

Kurosu, M. 2014. User Interfaces That Appeared in SciFi Movies and Their Reality. In Design, User Experience, and Usability. Theories, Methods, and Tools for Designing the User Experience, Aaron Marcus (ed.). Springer International Publishing, 580--588.

[20]

Lahey, B., Girouard, A., Burleson, W., and Vertegaal, R. 2011. PaperPhone: understanding the use of bend gestures in mobile devices with flexible electronic paper displays. In Proc. CHI'11, ACM, New York, NY, USA, 1303--1312.

Digital Library

[21]

Lee, N., Kim, J.-W., Lee, J., Shin, M., and Lee, W. 2012. MoleBot: a robotic creature based on physical transformability. Proceedings of the 2012 Virtual Reality International Conference, 17.

Digital Library

[22]

Lee, N., Lee, Y.H., Chung, J., et al. 2014. Shape-changing Robot for Stroke Rehabilitation. Proceedings of the 2014 Conference on Designing Interactive Systems, ACM, 325--334.

Digital Library

[23]

Leithinger, D. and Ishii, H. 2010. Relief: a scalable actuated shape display. Proceedings of the fourth international conference on Tangible, embedded, and embodied interaction, 221--222.

Digital Library

[24]

Nijholt, A., Giusti, L., Minuto, A., and Marti, P. 2012. Smart material interfaces: a material step to the future. Proceedings of the 14th ACM international conference on Multimodal interaction, ACM, 615--616.

Digital Library

[25]

Parkes, A. and Ishii, H. 2010. Bosu: A Physical Programmable Design Tool for Transformability with Soft Mechanics. Proceedings of the 8th ACM Conference on Designing Interactive Systems - DIS '10, 189--198.

Digital Library

[26]

Park, J., Park, Y.-W., and Nam, T.-J. 2014. Wrigglo: Shape-changing Peripheral for Interpersonal Mobile Communication. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, ACM, 3973--3976.

Digital Library

[27]

Park, Y.-W., Park, J., and Nam, T.-J. 2015. The Trial of Bendi in a Coffeehouse: Use of a Shape-Changing Device for a Tactile-Visual Phone Conversation. In Proc. CHI'15 Conference on Human Factors in Computing Systems, ACM, New York, NY, USA, 2181--2190.

Digital Library

[28]

Pedersen, E.W., Subramanian, S., and Hornbæk, K. 2014. Is My Phone Alive?: A Large-scale Study of Shape Change in Handheld Devices Using Videos. In Proc. CHI'14 Conference on Human Factors in Computing Systems, ACM, New York, NY, USA, 2579--2588.

Digital Library

[29]

Perovich, L., Mothersill, P., and Farah, J.B. 2013. Awakened Apparel: Embedded Soft Actuators for Expressive Fashion and Functional Garments. Proceedings of the 8th International Conference on Tangible, Embedded and Embodied Interaction, ACM, 77--80.

Digital Library

[30]

Rasmussen, M.K., Pedersen, E.W., Petersen, M.G., and Hornbæk, K. 2012. Shape-changing interfaces: a review of the design space and open research questions. CHI '12, ACM, 735--744.

Digital Library

[31]

Roudaut, A., Karnik, A., Löchtefeld, M., and Subramanian, S. 2013. Morphees: Toward High "Shape Resolution" in Self-actuated Flexible Mobile Devices. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, ACM, 593--602.

Digital Library

[32]

Rus, D., Butler, Z., Kotay, K., and Vona, M. Self-Reconfiguring Robots.

[33]

Schmitz, M., Endres, C., and Butz, A. 2007. A Survey of Human-computer Interaction Design in Science Fiction Movies. Proceedings of the 2Nd International Conference on INtelligent TEchnologies for Interactive enterTAINment, ICST (Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering), 7:1--7:10.

Digital Library

[34]

Shedroff, N. and Noessel, C. 2012. Make It So: Learning from Sci-fi Interfaces. Proceedings of the International Working Conference on Advanced Visual Interfaces, ACM, 7--8.

Digital Library

[35]

Soegaard, M. and Dam, R.F. 2011. Semi-structured Qualitative Studies. In The Encyclopedia of Human-Computer Interaction (2nd Ed.). The Interaction Design Fundation.

[36]

Taher, F., Hardy, J., Karnik, A., et al. 2015. Exploring Interactions with Physically Dynamic Bar Charts. Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, ACM, 3237--3246.

Digital Library

[37]

Tanenbaum, J., Tanenbaum, K., and Wakkary, R. 2012. Design Fictions. Proceedings of the Sixth International Conference on Tangible, Embedded and Embodied Interaction, ACM, 347--350.

Digital Library

[38]

Togler, J., Hemmert, F., and Wettach, R. 2009. Living Interfaces: The Thrifty Faucet. Proceedings of the 3rd International Conference on Tangible and Embedded Interaction, ACM, 43--44.

Digital Library

[39]

Troiano, G.M., Pedersen, E.W., and Hornbæk, K. 2015. Deformable Interfaces for Performing Music. In Proc. CHI'15 ACM Conference on Human Factors in Computing Systems, ACM, New York, NY, USA, 377--386.

Digital Library

[40]

Troiano, G.M., Pedersen, E.W., and Hornbæk, K. 2014. User-defined Gestures for Elastic, Deformable Displays. In Proc. AVI'14 International Working Conference on Advanced Visual Interfaces, ACM, New York, NY, USA, 1--8.

Digital Library

[41]

Vanderloock, K., Vanden Abeele, V., Suykens, J.A.K., and Geurts, L. 2013. The Skweezee System: Enabling the Design and the Programming of Squeeze Interactions. In Proc. UIST'13. Annual ACM Symposium on User Interface Software and Technology, ACM, New York, NY, USA, 521--530.

Digital Library

[42]

Vink, L., Kan, V., Nakagaki, K., et al. 2015. TRANSFORM As Adaptive and Dynamic Furniture. Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems, ACM, 183--183.

Digital Library

[43]

Wakita, A. and Nakano, A. 2012. Blob manipulation. Proceedings of the Sixth International Conference on Tangible, Embedded and Embodied Interaction, ACM, 299--302.

Digital Library

[44]

Warren, K., Lo, J., Vadgama, V., and Girouard, A. 2013. 2013. Bending the rules: bend gesture classification for flexible displays. In Proc. CHI'13, ACM, New York, NY, USA, 607--610.

Digital Library

[45]

Yao, L., Niiyama, R., Ou, J., Follmer, S., Della Silva, C., and Ishii, H. 2013. PneUI: Pneumatically Actuated Soft Composite Materials for Shape Changing Interfaces. Proceedings of the 26th Annual ACM Symposium on User Interface Software and Technology, ACM, 13--22.

Digital Library

[46]

Yao, L., Ou, J., Cheng, C.-Y., et al. 2015. bioLogic: Natto Cells As Nanoactuators for Shape Changing Interfaces. Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, ACM, 1--10.

Digital Library

[47]

Ye, Z. and Khalid, H. 2010. Cobra: flexible displays for mobilegaming scenarios. In Proc. CHI'10, ACM, New York, NY, USA, 4363--4368.

Digital Library

[48]

Design Fiction: A Short Essay on Design, Science, Fact and Fiction | Near Future Laboratory.

[49]

ART+COM Studios | Kinetic Sculpture --- The Shapes of Things to Come.

Cited By

Prpa MTroiano GYao BLi TWang DGu HFarzan RLópez CCardoso Llach DQuercia DMustafa MNiu SWong-Villacrés M(2024)Challenges and Opportunities of LLM-Based Synthetic Personae and Data in HCICompanion Publication of the 2024 Conference on Computer-Supported Cooperative Work and Social Computing10.1145/3678884.3681826(716-719)Online publication date: 11-Nov-2024
https://dl.acm.org/doi/10.1145/3678884.3681826
Alsebayel GTroiano GHarteveld C(2024)"I Believe the Baby in the Picture is My Baby": User Experiences with Commercial Pregnancy AppsProceedings of the ACM on Human-Computer Interaction10.1145/36765118:MHCI(1-28)Online publication date: 24-Sep-2024
https://dl.acm.org/doi/10.1145/3676511
Prpa MTroiano GWood MCoady Y(2024)Challenges and Opportunities of LLM-Based Synthetic Personae and Data in HCIExtended Abstracts of the CHI Conference on Human Factors in Computing Systems10.1145/3613905.3636293(1-5)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613905.3636293
Show More Cited By

Index Terms

SCI-FI: Shape-Changing Interfaces, Future Interactions
1. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

KirigamiTable: Designing for Proxemic Transitions with a Shape-Changing Tabletop
CHI '20: Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems

A core challenge in tabletop research is to support transitions between individual activities and team work. Shape-changing tabletops open up new opportunities for addressing this challenge. However, interaction design for shape-changing furniture is in ...
Tangible Interfaces and Interactions in Sci-Fi Movies: A Glimpse at the Possible Future of TUIs through Fictional Tangible Systems
TEI '20: Proceedings of the Fourteenth International Conference on Tangible, Embedded, and Embodied Interaction

Science-Fiction (Sci-Fi) movies have long been a frontier in showcasing futuristic computer interfaces and their associated interactions. Unconstrained by technological limitations, they are free to depict the most imaginative systems, including ...
Magnetic interaction with devices: a pilot study on mobile gaming
NordiCHI '14: Proceedings of the 8th Nordic Conference on Human-Computer Interaction: Fun, Fast, Foundational

This work-in-progress paper presents a study of interaction techniques for mobile devices, with a focus on gaming scenarios. We introduce and explore usability and performance aspects of a novel compass-based control for tangible around-device ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

NordiCHI '16: Proceedings of the 9th Nordic Conference on Human-Computer Interaction

October 2016

1045 pages

ISBN:9781450347631

DOI:10.1145/2971485

General Chairs:
Staffan Björk
University of Gothenburg
,
Eva Eriksson
Chalmers University of Technology
,
Program Chairs:
Morten Fjeld
Chalmers University of Technology
,
Susanne Bødker
University of Aarhus
,
Publications Chairs:
Wolmet Barendregt
University of Gothenburg
,
Mohammad Obaid
Chalmers University of Technology

Copyright © 2016 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

In-Cooperation

Chalmers University of Technology
SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 23 October 2016

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

NordiCHI '16

NordiCHI '16: 9th Nordic Conference on Human-Computer Interaction

October 23 - 27, 2016

Gothenburg, Sweden

Acceptance Rates

NordiCHI '16 Paper Acceptance Rate 58 of 231 submissions, 25%;

Overall Acceptance Rate 379 of 1,572 submissions, 24%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

30
Total Citations
View Citations
904
Total Downloads

Downloads (Last 12 months)89
Downloads (Last 6 weeks)5

Reflects downloads up to 03 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Prpa MTroiano GYao BLi TWang DGu HFarzan RLópez CCardoso Llach DQuercia DMustafa MNiu SWong-Villacrés M(2024)Challenges and Opportunities of LLM-Based Synthetic Personae and Data in HCICompanion Publication of the 2024 Conference on Computer-Supported Cooperative Work and Social Computing10.1145/3678884.3681826(716-719)Online publication date: 11-Nov-2024
https://dl.acm.org/doi/10.1145/3678884.3681826
Alsebayel GTroiano GHarteveld C(2024)"I Believe the Baby in the Picture is My Baby": User Experiences with Commercial Pregnancy AppsProceedings of the ACM on Human-Computer Interaction10.1145/36765118:MHCI(1-28)Online publication date: 24-Sep-2024
https://dl.acm.org/doi/10.1145/3676511
Prpa MTroiano GWood MCoady Y(2024)Challenges and Opportunities of LLM-Based Synthetic Personae and Data in HCIExtended Abstracts of the CHI Conference on Human Factors in Computing Systems10.1145/3613905.3636293(1-5)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613905.3636293
Krings KBohn NHille NLudwig T(2023)“What if everyone is able to program?” – Exploring the Role of Software Development in Science FictionProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581436(1-13)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581436
Han BBuchanan GMckay D(2022)Learning in the PanopticonProceedings of the 34th Australian Conference on Human-Computer Interaction10.1145/3572921.3572937(9-21)Online publication date: 29-Nov-2022
https://dl.acm.org/doi/10.1145/3572921.3572937
Villarreal-Narvaez SSluÿters AVanderdonckt JMbaki Luzayisu E(2022)Theoretically-Defined vs. User-Defined Squeeze GesturesProceedings of the ACM on Human-Computer Interaction10.1145/35678056:ISS(73-102)Online publication date: 14-Nov-2022
https://dl.acm.org/doi/10.1145/3567805
Willett WAseniero BCarpendale SDragicevic PJansen YOehlberg LIsenberg P(2022)Perception! Immersion! Empowerment! Superpowers as Inspiration for VisualizationIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2021.311484428:1(22-32)Online publication date: Jan-2022
https://doi.org/10.1109/TVCG.2021.3114844
Osawa HMiyamoto DHase SSaijo RFukuchi KMiyake Y(2022)Visions of Artificial Intelligence and Robots in Science Fiction: a computational analysisInternational Journal of Social Robotics10.1007/s12369-022-00876-z14:10(2123-2133)Online publication date: 18-Jul-2022
https://doi.org/10.1007/s12369-022-00876-z
Jordan PSilva P(2022)Charting Science Fiction in Computer Science LiteratureIntelligent Technologies for Interactive Entertainment10.1007/978-3-030-99188-3_7(100-126)Online publication date: 25-Mar-2022
https://doi.org/10.1007/978-3-030-99188-3_7
Brun DJordan PHakkila J(2021)Demonstrating a Memory Orb — Cylindrical Device Inspired by Science FictionProceedings of the 20th International Conference on Mobile and Ubiquitous Multimedia10.1145/3490632.3497873(239-241)Online publication date: 5-Dec-2021
https://dl.acm.org/doi/10.1145/3490632.3497873
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten