research-article

Magicscroll: a rollable display device with flexible screen real estate and gestural input

Authors:

Lahiru Lakmal Priyadarshana,

Juan Pablo Carrascal,

Roel VertegaalAuthors Info & Claims

MobileHCI '18: Proceedings of the 20th International Conference on Human-Computer Interaction with Mobile Devices and Services

Article No.: 6, Pages 1 - 11

https://doi.org/10.1145/3229434.3229442

Published: 03 September 2018 Publication History

Abstract

We present MagicScroll, a rollable tablet with 2 concatenated flexible multitouch displays, actuated scrollwheels and gestural input. When rolled up, MagicScroll can be used as a rolodex, smartphone, expressive messaging interface or gestural controller. When extended, it provides full access to its 7.5" high-resolution multitouch display, providing the display functionality of a tablet device. We believe that the cylindrical shape in the rolled-up configuration facilitates gestural interaction, while its shape changing and input capabilities allow the navigation of continuous information streams and provide focus plus context functionality. We investigated the gestural affordances of MagicScroll in its rolled-up configuration by means of an elicitation study.

References

[1]

Sheldon Andrews, Javier Mora, Jochen Lang, and Won Sook Lee. 2006. Hapticast: a physically-based 3D game with haptic feedback. Proceedings of FuturePlay (2006).

[2]

Patrick Baudisch, Nathaniel Good, and Paul Stewart. Focus Plus Context Screens: Combining Display Technology with Visualization Techniques. In Proc. UIST'01, 31--40.

Digital Library

[3]

Joel F Bartlett. 2000. Rock'n'Scroll is here to stay {user interface}. IEEE Computer Graphics and Applications 20, 3 (2000), 40--45.

Digital Library

[4]

Xiang Cao and Ravin Balakrishnan. 2003. VisionWand: Interaction Techniques for Large Displays Using a Passive Wand Tracked in 3D. In Proceedings of the 16th Annual ACM Symposium on User Interface Software and Technology (UIST '03). ACM, New York, NY, USA, 173--182.

Digital Library

[5]

Jessica R. Cauchard, Jane L. E, Kevin Y. Zhai, and James A. Landay. 2015. Drone & Me: An Exploration into Natural Human-drone Interaction. In Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp '15). ACM, New York, NY, USA, 361--365.

Digital Library

[6]

Nicholas Chen, Francois Guimbretiere, Morgan Dixon, Cassandra Lewis, and Maneesh Agrawala. Navigation Techniques for Dual-display e-Book Readers. In Proc. CHI'08, 1779--1788.

Digital Library

[7]

Chinese Handscrolls. Retrieved from http://www.metmuseum.org/toah/hd/chhs/hd_chhs.htm

[8]

Sony Corp - www.sony.co.uk/product/sony-tablet-p

[9]

Readius - https://wiki.mobileread.com/wiki/Readius

[10]

Antonio Gomes and Roel Vertegaal. PaperFold: Evaluating Shape Changes for Viewport Transformations in Foldable Thin-Film Display Devices. In Proc TEI'15, 153--160.

Digital Library

[11]

Jukka Häkkinen, Monika Pölönen, Marja Salmimaa, and Jukka Hautanen. Reading experience with curved handheld displays. Journal of the Society for Information Display 16, 11: 1099--1103.

[12]

Beverly L. Harrison, Kenneth P. Fishkin, Anuj Gujar, Carlos Mochon, and Roy Want. 1998. Squeeze Me, Hold Me, Tilt Me! An Exploration of Manipulative User Interfaces. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '98). ACM Press/Addison-Wesley Publishing Co., New York, NY, USA, 17--24.

Digital Library

[13]

Ken Hinckley, Morgan Dixon, Raman Sarin, Francois Guimbretiere, and Ravin Balakrishnan. Codex: a dual screen tablet computer. In Proc. CHI'09, 1933--1942.

Digital Library

[14]

Ken Hinckley, Jeff Pierce, Mike Sinclair, and Eric Horvitz. 2000. Sensing techniques for mobile interaction. In Proceedings of the 13th annual ACM symposium on User interface software and technology. ACM, 91--100.

Digital Library

[15]

Ken Hinckley, Edward Cutrell, Steve Bathiche, and Tim Muss. 2002. Quantitative analysis of scrolling techniques. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '02). ACM, New York, NY, USA, 65--72.

Digital Library

[16]

David Holman, Roel Vertegaal, Mark Altosaar, Nikolaus Troje, and Derek Johns. PaperWindows: Interaction Techniques for Digital Paper. In Proc. CHI'05, 591--599.

Digital Library

[17]

Jack Kerouac. 1957. On the Road. Viking Press.

[18]

Mohammadreza Khalilbeigi, Roman Lissermann, Wolfgang Kleine, and Jürgen Steimle. FoldMe: Interacting with Double-sided Foldable Displays. In Proc. TEI'12, 33--40.

Digital Library

[19]

Mohammadreza Khalilbeigi, Roman Lissermann, Max Mühlhäuser, and Jürgen Steimle. Xpaaand. In Proc. CHI'11, 2729--2732.

Digital Library

[20]

Johnny C. Lee, Scott E. Hudson, and Edward Tse. Foldable Interactive Displays. In Proc UIST'08, 287--290.

Digital Library

[21]

Sang-Su Lee, Sohyun Kim, Bopil Jin, et al. How Users Manipulate Deformable Displays As Input Devices. In Proc. CHI'10, 1647--1656.

Digital Library

[22]

Daniel Leithinger, Sean Follmer, Alex Olwal, and Hiroshi Ishii. 2014. Physical telepresence: shape capture and display for embodied, computer-mediated remote collaboration. In Proc UIST'14. ACM, New York, NY, USA, 461--470.

Digital Library

[23]

Max V Mathews. 1991. The radio baton and conductor program, or: Pitch, the most important and least expressive part of music. Computer Music Journal 15, 4 (1991), 37--46.

[24]

Ken Nakagaki, Chikara Inamura, Pasquale Totaro, Thariq Shihipar, Chantine Akikyama, Yin Shuang, and Hiroshi Ishii. 2015. Linked-Stick: Conveying a Physical Experience Using a Shape-Shifting Stick. In Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA '15). ACM, New York, NY, USA, 1609--1614.

Digital Library

[25]

Donald A Norman. 1999. Affordance, Conventions, and Design. Interactions 6, 3: 38--43.

Digital Library

[26]

Jun Rekimoto. SmartSkin: An Infrastructure for Freehand Manipulation on Interactive Surfaces. In Proc. CHI '02, 113--120.

Digital Library

[27]

Clément Pillias, Shuo Hsiu Hsu, and Pierre Cubaud. 2013. Reading with a Digital Roll. In Proc. CHI EA '13, 1377--1382.

Digital Library

[28]

Lahiru Lakmal Priyadarshana, Victoria Porter, Juan Pablo Carrascal, Aaron Visser, and Roel Vertegaal. 2016. MagicWand. In Proc. CHI EA '16, 3762--3765.

[29]

Majken K. Rasmussen, Esben W. Pedersen, Marianne G. Petersen, and Kasper Hornbæk. 2012. Shape-changing Interfaces: A Review of the Design Space and Open Research Questions. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '12). ACM, New York, NY, USA, 735--744.

Digital Library

[30]

Jun Rekimoto. 1996. Tilting operations for small screen interfaces. In Proceedings of the 9th annual ACM symposium on User interface software and technology. ACM, 167--168.

Digital Library

[31]

Valkyrie Savage, Xiaohan Zhang, and Björn Hartmann. Midas: Fabricating Custom Capacitive Touch Sensors to Prototype Interactive Objects. In Proc. UIST '12, 579--588

Digital Library

[32]

Radu-Daniel Vatavu and Ionut-Alexandru Zaiti. 2014. Leap Gestures for TV: Insights from an Elicitation Study. In Proceedings of the 2014 ACM International Conference on Interactive Experiences for TV and Online Video (TVX '14). ACM, New York, NY, USA, 131--138.

Digital Library

[33]

Jaime Ruiz, Yang Li, and Edward Lank. 2011. User-defined Motion Gestures for Mobile Interaction. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '11). ACM, New York, NY, USA, 197--206.

Digital Library

[34]

Abigail J Sellen and Richard H R Harper. 2003. The myth of the paperless office. MIT press.

Digital Library

[35]

David Small and Hiroshi Ishii. Design of Spatially Aware Graspable Displays. In Proc. CHI EA '97, 367--368.

Digital Library

[36]

Chris Harrison, Hrvoje Benko, and Andrew D. Wilson. OmniTouch: wearable multitouch interaction everywhere. In Proc. UIST'11, 441--450.

Digital Library

[37]

Sensable. Phantom Omni. http://www.dentsable.com/haptic-phantom-omni.htm. (Accessed on 09/14/2016).

[38]

Paul Strohmeier, Jesse Burstyn, Juan Pablo Carrascal, Vincent Levesque, and Roel Vertegaal. ReFlex: A Flexible Smartphone with Active Haptic Feedback for Bend Input. In Proc. TEI'16, 185--192.

Digital Library

[39]

Aneesh P Tarun, Peng Wang, Audrey Girouard, Paul Strohmeier, Derek Reilly, and Roel Vertegaal. PaperTab: An Electronic Paper Computer with Multiple Large Flexible Electrophoretic Displays. In Proc. CHI'13, 3131--3134.

Digital Library

[40]

Unknown. Dead Sea Scrolls. 408 BCE to 318 CE, Cumran Caves.

[41]

Roel Vertegaal and Ivan Poupyrev. 2008. Introduction to Organic User Interfaces. Communications of the ACM 51, 6.

Digital Library

[42]

Ivan Poupyrev, Henry Newton-Dunn, and Olivier Bau. 2006. D20: Interaction with Multifaceted Display Devices. In CHI '06 Extended Abstracts on Human Factors in Computing Systems (CHI EA '06). ACM, New York, NY, USA, 1241--1246.

Digital Library

[43]

Ilya Rosenberg and Ken Perlin. The UnMousePad: An Interpolating Multi-Touch Force-Sensing Input Pad. In ACM SIGGRAPH'09, Article 65.

Digital Library

[44]

Andrew Wilson and Steven Shafer. 2003. XWand: UI for Intelligent Spaces. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '03). ACM, New York, NY, USA, 545--552.

Digital Library

[45]

Graham Wilson and Stephen A. Brewster. 2017. Multi-moji: Combining Thermal, Vibrotactile & Visual Stimuli to Expand the Affective Range of Feedback. In Proc. CHI'17. ACM, New York, NY, USA, 1743--1755.

Digital Library

[46]

Jacob O. Wobbrock, Htet Htet Aung, Brandon Rothrock, and Brad A. Myers. 2005. Maximizing the Guessability of Symbolic Input. In CHI '05 Extended Abstracts on Human Factors in Computing Systems (CHI EA '05). ACM, New York, NY, USA, 1869--1872.

Digital Library

[47]

Jacob O. Wobbrock, Meredith Ringel Morris, and Andrew D. Wilson. 2009. User-defined Gestures for Surface Computing. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '09). ACM, New York, NY, USA, 1083--1092.

Digital Library

[48]

Andreas Butz, Markus Groß, and Antonio Krüger. TUISTER: a tangible UI for hierarchical structures. In Proc. IUI'04, 223--225.

Digital Library

[49]

Kent Lyons, David Nguyen, Daniel Ashbrook, and Sean White. Facet: a multi-segment wrist worn system. In Proc. UIST'12, 123--130.

Digital Library

[50]

Rolodex. Retrieved from: https://en.wikipedia.org/wiki/Rolodex.

[51]

Kenton O'Hara, Abigail Sellen, and Richard Bentley. Supporting memory for spatial location while reading from small displays. In Proc. CHI EA'99, 220--221.

Digital Library

Cited By

Wu MJian MZhang JYang L(2025)Optimizing bendability of flexible electronic devices using a neutral layer strategyMoore and More10.1007/s44275-024-00019-82:1Online publication date: 8-Jan-2025
https://doi.org/10.1007/s44275-024-00019-8
Selvamuthu MAbe KTadakuma KTadakuma R(2024)Flexible Omnidirectional Driving Gear Mechanism with Adaptation over Arbitrary Curvatures2024 IEEE International Conference on Robotics and Automation (ICRA)10.1109/ICRA57147.2024.10609984(197-203)Online publication date: 13-May-2024
https://doi.org/10.1109/ICRA57147.2024.10609984
Villarreal-Narvaez SSluÿters AVanderdonckt JVatavu R(2023)Brave New GES World: A Systematic Literature Review of Gestures and Referents in Gesture Elicitation StudiesACM Computing Surveys10.1145/363645856:5(1-55)Online publication date: 7-Dec-2023
https://dl.acm.org/doi/10.1145/3636458
Show More Cited By

Recommendations

Xpaaand: interaction techniques for rollable displays
CHI '11: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

We present a device concept and a prototype of a future mobile device. By featuring a rollable display, its display size and its form factor can be dynamically changed. Moreover, we investigate how physical resizing of the display can be used as an ...
Inflated roly-poly
TEI '12: Proceedings of the Sixth International Conference on Tangible, Embedded and Embodied Interaction

We present an air-contained display medium that can be directly deformed and spatially moved by various physical interaction techniques for interactive games. We first investigated familiar objects in our everyday lives that allow users to easily ...
When mobile phones expand into handheld tabletops
CHI EA '12: CHI '12 Extended Abstracts on Human Factors in Computing Systems

Future mobile devices that feature a rollout display will be able to act as a relatively large interactive surface on-the-go. This will allow for novel collaborative usages in mobile settings. In this paper, we explore several dimensions of the design ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

MobileHCI '18: Proceedings of the 20th International Conference on Human-Computer Interaction with Mobile Devices and Services

September 2018

552 pages

ISBN:9781450358989

DOI:10.1145/3229434

General Chairs:
Lynne Bailie,
Nuria Oliver

Copyright © 2018 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 03 September 2018

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

MobileHCI '18

Sponsor:

SIGCHI

MobileHCI '18: 20th International Conference on Human-Computer Interaction with Mobile Devices and Services

September 3 - 6, 2018

Barcelona, Spain

Acceptance Rates

Overall Acceptance Rate 202 of 906 submissions, 22%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

13
Total Citations
View Citations
523
Total Downloads

Downloads (Last 12 months)45
Downloads (Last 6 weeks)6

Reflects downloads up to 25 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Wu MJian MZhang JYang L(2025)Optimizing bendability of flexible electronic devices using a neutral layer strategyMoore and More10.1007/s44275-024-00019-82:1Online publication date: 8-Jan-2025
Selvamuthu MAbe KTadakuma KTadakuma R(2024)Flexible Omnidirectional Driving Gear Mechanism with Adaptation over Arbitrary Curvatures2024 IEEE International Conference on Robotics and Automation (ICRA)10.1109/ICRA57147.2024.10609984(197-203)Online publication date: 13-May-2024
Villarreal-Narvaez SSluÿters AVanderdonckt JVatavu R(2023)Brave New GES World: A Systematic Literature Review of Gestures and Referents in Gesture Elicitation StudiesACM Computing Surveys10.1145/363645856:5(1-55)Online publication date: 7-Dec-2023
Pruszko LGu HBourgeois JLaurillau YCoutrix C(2023)Modular Tangible User Interfaces: Impact of Module Shape and Bonding Strength on InteractionProceedings of the Seventeenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3569009.3572731(1-15)Online publication date: 26-Feb-2023
Serrano MFinch JIrani PLucero ARoudaut A(2022)Mold-It: Understanding how Physical Shapes affect Interaction with Handheld Freeform DevicesProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3502022(1-14)Online publication date: 29-Apr-2022
Ullmer BShaer OMazalek AHummels C(2022)Weaving Fire into FormundefinedOnline publication date: 20-Jul-2022
Heo YChoi DKim DKim S(2021)Flexible Vibrotactile Actuator Based on Dielectric Elastomer for Smart Handheld DevicesApplied Sciences10.3390/app11241202011:24(12020)Online publication date: 17-Dec-2021
Brun DJordan PHakkila J(2021)Demonstrating a Memory Orb — Cylindrical Device Inspired by Science FictionProceedings of the 20th International Conference on Mobile and Ubiquitous Multimedia10.1145/3490632.3497873(239-241)Online publication date: 5-Dec-2021
Moran-Ledesma MSchneider OHancock M(2021)User-Defined Gestures with Physical Props in Virtual RealityProceedings of the ACM on Human-Computer Interaction10.1145/34869545:ISS(1-23)Online publication date: 5-Nov-2021
Klamka KDachselt R(2021)Bendable Color ePaper Displays for Novel Wearable Applications and Mobile VisualizationAdjunct Proceedings of the 34th Annual ACM Symposium on User Interface Software and Technology10.1145/3474349.3480213(6-10)Online publication date: 10-Oct-2021
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten