skip to main content
10.1145/3024969.3024970acmconferencesArticle/Chapter ViewAbstractPublication PagesteiConference Proceedingsconference-collections
research-article

Bendy: Exploring Mobile Gaming with Flexible Devices

Published: 20 March 2017 Publication History

Abstract

We explore the use of bend gestures in gaming with flexible devices and investigate the size differences between smartphones and tablets. We conducted a study asking users to select bend gestures for nine tasks derived from gaming, grouped by navigation, action, and deformation. Our results suggest pairing opposing tasks, such as navigating left and right, by gesture location. We saw low consensus for action tasks, and strong association between the location of the gestures and the location of the visual, relating to the Simon Effect. We suggest guidelines for the design of game controls for flexible devices. We implemented the proposed gestures into six games using an interactive flexible prototype in our second study. Our results are similar between sizes, yet with an overall user preference for the smaller prototype. We observed that hand positioning is an important usability issue to consider when designing flexible devices.

Supplementary Material

suppl.mov (teifp107-file3.mp4)
Supplemental video

References

[1]
Teemu T. Ahmaniemi, Johan Kildal, and Merja Haveri. 2014. What is a device bend gesture really good for? Proceedings of the ACM conference on Human factors in computing systems, 3503--3512.
[2]
Atari. 1972. Pong. Game {Various}. (November 29, 1972). Atari, Sunnyvale, CA, USA.
[3]
Atari Arcade. 1976. Breakout. Game {Various}. (April 1976). Atari, Sunnyvale, CA, USA.
[4]
Kevin Browne and Christopher Anand. 2012. An empirical evaluation of user interfaces for a mobile video game. Entertainment Computing 3, 1: 1--10.
[5]
Fadi Chehimi and Paul Coulton. 2008. Motion controlled mobile 3D multiplayer gaming. Proceedings of the 2008 International Conference in Advances on Computer Entertainment Technology ACE '08, 267.
[6]
Farshad Daliri and Audrey Girouard. 2016. Visual Feedforward Guides for Performing Bend Gestures on Deformable Prototypes. Graphics Interfaces 2016, 1--8.
[7]
David Holman and Roel Vertegaal. 2008. Organic User Interfaces?: Design Computer in Any Way, Shape, or Form. Communications of the ACM 51, 6.
[8]
Hiroshi Ishii. 2008. The tangible user interface and its evolution. Communications of the ACM 51, 6: 32.
[9]
Robert JK Jacob, Audrey Girouard, Leanne M Hirshfield, et al. 2008. Reality-based interaction: a framework for post-WIMP interfaces. Proceeding of the twenty-sixth annual CHI conference on Human factors in computing systems CHI '08, ACM Press, 201.
[10]
Martin Kaltenbrunner and Ross Bencina. 2007. reacTIVision: A Computer-Vision Framework for Table- Based Tangible Interaction. Proceedings of the 1st international conference on Tangible and embedded interaction - TEI '07, ACM Press, 69.
[11]
Johan Kildal, Andrés Lucero, and Marion Boberg. 2013. Twisting Touch?: Combining Deformation and Touch as Input within the Same Interaction Cycle on Handheld Devices. Proceedings of the 15th international conference on Human-computer interaction with mobile devices and services MobileHCI '13, 237.
[12]
Johan Kildal, Susanna Paasovaara, and Viljakaisa Aaltonen. 2012. Kinetic device: Designing Interactions with a Deformable Mobile Interface. ACM SIGCHI conference on Human Factors in Computing Systems Extended Abstracts, 1871.
[13]
Johan Kildal and Graham Wilson. 2012. Feeling it: the roles of stiffness, deformation range and feedback in the control of deformable ui. Proceedings of the 14th ACM international conference on Multimodal interaction ICMI '12, ACM Press, 393.
[14]
Byron Lahey, Audrey Girouard, Winslow Burleson, and Roel Vertegaal. 2011. PaperPhone: Understanding the Use of Bend Gestures in Mobile Devices with Flexible Electronic Paper Displays. ACM SIGCHI Conference on Human Factors in Computing Systems, 1303.
[15]
Sang-Su Lee, Sohyun Kim, Bipil Jin, et al. 2010. How users manipulate deformable displays as input devices. SIGCHI Conference on Human Factors in Computing Systems, 1647--1656.
[16]
Sang-su Lee, Youn-kyung Lim, and Kun-Pyo Lee. 2012. Exploring the effects of size on deformable user interfaces. Proceedings of the 14th international conference on Human-computer interaction with mobile devices and services companion - MobileHCI '12, ACM Press, 89.
[17]
Jessica Lo and Audrey Girouard. 2014. Fabricating Bendy: Design and Development of Deformable Prototypes. IEEE Pervasive Computing Special Issue on Fabrication and Printing 13, 3: 40--46.
[18]
Namco. 1980. Pacman. Game {Various}. (May 22, 1980). Namco, Tokyo, Japan.
[19]
Vinh Nguyen, Pramod Kumar, Sang Ho Yoon, Ansh Verma, and Karthik Ramani. 2015. SOFTii?: Soft Tangible Interface for Continuous Control of Virtual Objects with Pressure-based Input. Proceedings of the Ninth International Conference on Tangible, Embedded, and Embodied Interaction - TEI '15, ACM Press, 539--544.
[20]
Vinh P. Nguyen, Sang Ho Yoon, Ansh Verma, and Karthik Ramani. 2014. BendID: Flexible Interface for Localized Deformation Recognition. UbiComp 2014: 553--557.
[21]
Alexey Pajitnov and Vladimir Pokhilko. 1984. Tetris. Game {NES}. (6 June 1984). Nintendo, Kyoto, Japan.
[22]
Plastic World. 2016. Alumilite Flex 30. Retrieved January 19, 2016 from http://plasticworld.ca/store/index.php?main_page=p roduct_info&cPath=7_43&products_id=152
[23]
Robert W Proctor and T.G. Reeve. 1989. Stimulusresponse compatibility: An intergrated perspective. Elsevier.
[24]
Rovio Mobile. Angry Birds. Game. (11 December 2009). Rovio Entertainment, Keilaniemi, Espoo, Finland.
[25]
Carsten Schwesig, Ivan Poupyrev, and Eijiro Mori. 2004. Gummi: A Bendable Computer. Proceedings of the 2004 conference on Human factors in computing systems CHI '04, 263--270.
[26]
J. Richard Simon. 1969. Reactions toward the source of stimulation. J Exp Psychology 8, 1: 174--176.
[27]
Jürgen Steimle, Andreas Jordt, and Pattie Maes. 2013. Flexpad. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems CHI '13, ACM Press, 237.
[28]
Paul Strohmeier, Jesse Burstyn, Juan Pablo Carrascal, Vincent Levesque, and Roel Vertegaal. 2016. ReFlex: A Flexible Smartphone with Active Haptic Feedback for Bend Input. Proceedings of the TEI '16: Tenth International Conference on Tangible, Embedded, and Embodied Interaction, 185--192.
[29]
Taito Corporation. 1978. Space Invaders. Game {Various}. (July 1978). Taito, Tokyo, Japan.
[30]
Aneesh Tarun, Peng Wang, Paul Strohmeier, Audrey Girouard, Derek Reilly, and Roel Vertegaal. 2013. PaperTab: Tablets as Thin and Flexible as Paper. CHI '13 Extended Abstracts on Human Factors in Computing Systems on CHI EA '13, 2881.
[31]
The Nielsen Company. 2011. The State Of Mobile Apps.
[32]
Giovanni Maria Troiano, Esben Warming Pedersen, and Kasper Hornbæk. 2015. Deformable Interfaces for Performing Music. Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems CHI '15, ACM Press, 377--386.
[33]
Daniel Vogel and Patrick Baudisch. 2007. Shift: a technique for operating pen-based interfaces using touch. Proceedings of the SIGCHI conference on Human factors in computing systems CHI '07, ACM Press, 657.
[34]
Kristen Warren, Jessica Lo, Vaibhav Vadgama, and Audrey Girouard. 2013. Bending the rules: Bend Gesture Classification for Flexible Displays. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems CHI '13, 607.
[35]
Jun-ichiro Watanabe, Arito Mochizuki, and Youichi Horry. 2008. Bookisheet: Bendable Device for Browsing Content Using the Metaphor of Leafing Through the Pages. Proceedings of the 10th international conference on Ubiquitous computing UbiComp '08, 360.
[36]
Doug Wightman, Tim Ginn, and Roel Vertegaal. 2011. BendFlip: Examining Input Techniques for Electronic Book Readers with Flexible Form Factors. In Proceeding INTERACT'11 Proceedings of the 13th IFIP TC 13 international conference on Human-computer interaction. 117--133.
[37]
Jacob O. Wobbrock, Meredith Ringel Morris, and Andrew D. Wilson. 2009. User-defined gestures for surface computing. Proceedings of the 27th international conference on Human factors in computing systems CHI 09, ACM Press, 1083.
[38]
Zi Ye and Hammad Khalid. 2010. Cobra: Flexible Displays for Mobile Gaming Scenarios. Proceedings of the 28th of the international conference extended abstracts on Human factors in computing systems CHI EA '10, 4363.
[39]
Loutfouz Zaman, Daniel Natapov, and Robert J. Teather. 2010. Touchscreens vs. traditional controllers in handheld gaming. Proc. Futureplay: 183.

Cited By

View all
  • (2024)BendAide: A Deformable Interface to Augment Touchscreen Mobile DevicesProceedings of the 50th Graphics Interface Conference10.1145/3670947.3670960(1-10)Online publication date: 3-Jun-2024
  • (2024)Single-handed Folding Interactions with a Modified Clamshell Flip PhoneProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642554(1-14)Online publication date: 11-May-2024
  • (2023)Brave New GES World: A Systematic Literature Review of Gestures and Referents in Gesture Elicitation StudiesACM Computing Surveys10.1145/363645856:5(1-55)Online publication date: 7-Dec-2023
  • Show More Cited By

Index Terms

  1. Bendy: Exploring Mobile Gaming with Flexible Devices

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    TEI '17: Proceedings of the Eleventh International Conference on Tangible, Embedded, and Embodied Interaction
    March 2017
    806 pages
    ISBN:9781450346764
    DOI:10.1145/3024969
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 20 March 2017

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. bend gestures
    2. deformable prototype
    3. deformable user interface
    4. flexible display
    5. mobile games

    Qualifiers

    • Research-article

    Funding Sources

    Conference

    TEI '17
    Sponsor:

    Acceptance Rates

    TEI '17 Paper Acceptance Rate 41 of 151 submissions, 27%;
    Overall Acceptance Rate 393 of 1,367 submissions, 29%

    Upcoming Conference

    TEI '25

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)17
    • Downloads (Last 6 weeks)2
    Reflects downloads up to 15 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)BendAide: A Deformable Interface to Augment Touchscreen Mobile DevicesProceedings of the 50th Graphics Interface Conference10.1145/3670947.3670960(1-10)Online publication date: 3-Jun-2024
    • (2024)Single-handed Folding Interactions with a Modified Clamshell Flip PhoneProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642554(1-14)Online publication date: 11-May-2024
    • (2023)Brave New GES World: A Systematic Literature Review of Gestures and Referents in Gesture Elicitation StudiesACM Computing Surveys10.1145/363645856:5(1-55)Online publication date: 7-Dec-2023
    • (2023)Exploring Long-Term Mediated Relations with a Shape-Changing Thing: A Field Study of coMorphing StoolProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581140(1-14)Online publication date: 19-Apr-2023
    • (2023)Investigating user performance and preference for two magnitude levels of size and angle of bend on a smartphone-sized flexible deviceBehaviour & Information Technology10.1080/0144929X.2023.2245062(1-27)Online publication date: 13-Sep-2023
    • (2021)Flexible Vibrotactile Actuator Based on Dielectric Elastomer for Smart Handheld DevicesApplied Sciences10.3390/app11241202011:24(12020)Online publication date: 17-Dec-2021
    • (2021)Gesture Action Mapping for Deformation-based One-handed Landscape Mode Interaction with Flexible Smartphone-sized DevicesProceedings of the 12th Indian Conference on Human-Computer Interaction10.1145/3506469.3506470(1-10)Online publication date: 19-Nov-2021
    • (2021)Transtexture Lamp: Composing a Deformable Device as a Computational WholeProceedings of the 2021 ACM Designing Interactive Systems Conference10.1145/3461778.3462061(1291-1300)Online publication date: 28-Jun-2021
    • (2021)User-defined Bend Gesture Completion Strategies for Discrete and Continuous InputsHuman-Computer Interaction – INTERACT 202110.1007/978-3-030-85613-7_14(192-202)Online publication date: 26-Aug-2021
    • (2020)Towards Rapid Prototyping of Foldable Graphical User Interfaces with FlectoProceedings of the ACM on Human-Computer Interaction10.1145/34273224:ISS(1-33)Online publication date: 4-Nov-2020
    • Show More Cited By

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media