skip to main content
10.1145/2669485.2669507acmconferencesArticle/Chapter ViewAbstractPublication PagesissConference Proceedingsconference-collections
research-article

SleeD: Using a Sleeve Display to Interact with Touch-sensitive Display Walls

Published: 16 November 2014 Publication History

Abstract

We present SleeD, a touch-sensitive Sleeve Display that facilitates interaction with multi-touch display walls. Large vertical displays allow multiple users to interact effectively with complex data but are inherently public. Also, they generally cannot present an interface adapted to the individual user. The combination with an arm-mounted, interactive display allows complex personalized interactions. In contrast to hand-held devices, both hands remain free for interacting with the wall. We discuss different levels of coupling between wearable and wall and propose novel user interface techniques that support user-specific interfaces, data transfer, and arbitrary personal views. In an iterative development process, we built a mock-up using a bendable e-Ink display and a fully functional prototype based on an arm-mounted smartphone. In addition, we developed several applications that showcase the techniques presented. An observational study we conducted demonstrates the high potential of our concepts.

Supplementary Material

JPG File (its0167.jpg)
MP4 File (its0167.mp4)
Supplemental video

References

[1]
Adachi, T., Koura, S., Shibata, F., and Kimura, A. Forearm menu: Using forearm as menu widget on tabletop system. In Proc. ITS, ACM (2013), 333--336.
[2]
Andrews, C., Endert, A., Yost, B., and North, C. Information visualization on large, high-resolution displays: Issues, challenges, and opportunities. Information Visualization 10, 4 (2011), 341--355.
[3]
Ashbrook, D. L., Clawson, J. R., Lyons, K., Starner, T. E., and Patel, N. Quickdraw: The impact of mobility and on-body placement on device access time. In Proc. CHI, ACM (2008), 219--222.
[4]
Balakrishnan, R., and Hinckley, K. The role of kinesthetic reference frames in two-handed input performance. In Proc. UIST, ACM (1999), 171--178.
[5]
Ball, R., North, C., and Bowman, D. A. Move to improve: promoting physical navigation to increase user performance with large displays. In Proc. CHI, ACM (2007), 191--200.
[6]
Beaudouin-Lafon, M., Huot, S., Nancel, M., Mackay, W., Pietriga, E., Primet, R., Wagner, J., Chapuis, O., Pillias, C., Eagan, J., Gjerlufsen, T., and Klokmose, C. Multisurface interaction in the wild room. Computer 45, 4 (Apr. 2012), 48--56.
[7]
Bier, E. A., Stone, M. C., Pier, K., Buxton, W., and DeRose, T. D. Toolglass and magic lenses: the see-through interface. In Proc., SIGGRAPH, ACM (1993), 73--80.
[8]
Chen, X. A., Grossman, T., Wigdor, D. J., and Fitzmaurice, G. Duet: Exploring joint interactions on a smart phone and a smart watch. In Proc. CHI, ACM (2014), 159--168.
[9]
Daiber, F., Gehring, S., Löchtefeld, M., and Krüger, A. TouchPosing: multi-modal interaction with geospatial data. In Proc. MUM, ACM (2012), 8:1--8:4.
[10]
Geller, T. The promise of flexible displays. Commun. ACM 54, 6 (June 2011), 16--18.
[11]
Haller, M., Leitner, J., Seifried, T., Wallace, J. R., Scott, S. D., Richter, C., Brandl, P., Gokcezade, A., and Hunter, S. The NiCE discussion room: Integrating paper and digital media to support co-located group meetings. In Proc. CHI, ACM (2010), 609--618.
[12]
Harrison, C., Tan, D., and Morris, D. Skinput: appropriating the body as an input surface. In Proc. CHI, ACM (2010), 453--462.
[13]
Holz, C., and Baudisch, P. Fiberio: A touchscreen that senses fingerprints. In Proc. UIST, ACM (2013), 41--50.
[14]
Jota, R., Nacenta, M. A., Jorge, J. A., Carpendale, S., and Greenberg, S. A comparison of ray pointing techniques for very large displays. In Proc. Graphics Interface, CIPS (2010), 269--276.
[15]
Krueger, M. W., Gionfriddo, T., and Hinrichsen, K. Videoplace -- an artificial reality. In Proc. CHI, ACM (1985), 35--40.
[16]
Lin, S.-Y., Su, C.-H., Cheng, K.-Y., Liang, R.-H., Kuo, T.-H., and Chen, B.-Y. Pub - point upon body: exploring eyes-free interaction and methods on an arm. In Proc. UIST, ACM (2011), 481--488.
[17]
Lyons, K., Nguyen, D., Ashbrook, D., and White, S. Facet: a multi-segment wrist worn system. In Proc. UIST, ACM (2012), 123--130.
[18]
Martin, T. L. Time and time again: Parallels in the development of the watch and the wearable computer. In Proc. ISWC (2002), 5--14.
[19]
Meyer, T., and Schmidt, D. IdWristbands: IR-based user identification on multi-touch surfaces. In Proc. ITS, ACM (2010), 277--278.
[20]
Nancel, M., Chapuis, O., Pietriga, E., Yang, X.-D., Irani, P. P., and Beaudouin-Lafon, M. High-precision pointing on large wall displays using small handheld devices. In Proc. CHI, ACM (2013), 831--840.
[21]
Nancel, M., Wagner, J., Pietriga, E., Chapuis, O., and Mackay, W. Mid-air pan-and-zoom on wall-sized displays. In Proc. CHI, ACM (2011), 177--186.
[22]
Olberding, S., Yeo, K. P., Nanayakkara, S., and Steimle, J. AugmentedForearm: exploring the design space of a display-enhanced forearm. In Proc. Augmented Human, ACM (2013), 9--12.
[23]
Pierce, J. S., Conway, M., van Dantzich, M., and Robertson, G. Toolspaces and glances: storing, accessing, and retrieving objects in 3d desktop applications. In Proc. I3D, ACM (1999), 163--168.
[24]
Rashid, U., Nacenta, M. A., and Quigley, A. The cost of display switching: a comparison of mobile, large display and hybrid ui configurations. In Proc. AVI, ACM (2012), 99--106.
[25]
Rekimoto, J. A multiple device approach for supporting whiteboard-based interactions. In Proc. CHI, ACM (1998), 344--351.
[26]
Schmidt, D., Sas, C., and Gellersen, H. Personal clipboards for individual copy-and-paste on shared multi-user surfaces. In Proc. CHI, ACM (2013), 3335--3344.
[27]
Schmidt, D., Seifert, J., Rukzio, E., and Gellersen, H. A cross-device interaction style for mobiles and surfaces. In Proc. DIS, ACM (2012), 318--327.
[28]
Seifert, J., Bayer, A., and Rukzio, E. PointerPhone: Using mobile phones for direct pointing interactions with remote displays. In Human-Computer Interaction-INTERACT 2013. Springer, 2013, 18--35.
[29]
Spindler, M., Cheung, V., and Dachselt, R. Dynamic tangible user interface palettes. In Human-Computer Interaction-INTERACT 2013. Springer, 2013, 159--176.
[30]
Stein, R., Ferrero, S., Hetfield, M., Quinn, A., and Krichever, M. Development of a commercially successful wearable data collection system. In Proc. ISWC (1998), 18--24.
[31]
Tarun, A. P., Lahey, B., Girouard, A., Burleson, W., and Vertegaal, R. Snaplet: Using body shape to inform function in mobile flexible display devices. In Proc. CHI Extended Abstracts, ACM (2011), 329--334.
[32]
Thomas, B., Grimmer, K., Zucco, J., and Milanese, S. Where does the mouse go? An investigation into the placement of a body-attached touchpad mouse for wearable computers. Personal Ubiquitous Comput. 6, 2 (Jan. 2002), 97--112.
[33]
Voida, S., Tobiasz, M., Stromer, J., Isenberg, P., and Carpendale, S. Getting practical with interactive tabletop displays: designing for dense data, "fat fingers," diverse interactions, and face-to-face collaboration. In Proc. ITS, ACM (2009), 109--116.
[34]
Wagner, J., Nancel, M., Gustafson, S. G., Huot, S., and Mackay, W. E. Body-centric design space for multi-surface interaction. In Proc. CHI, ACM (2013), 1299--1308.

Cited By

View all
  • (2024)Interactive Visualization on Large High‐Resolution Displays: A SurveyComputer Graphics Forum10.1111/cgf.1500143:6Online publication date: 30-Apr-2024
  • (2024)Dual-Thumb pointing and command selection techniques for tabletsInternational Journal of Human-Computer Studies10.1016/j.ijhcs.2023.103203184:COnline publication date: 1-Apr-2024
  • (2023)Soft-Touch or Hard-Touch: Quantifying Touches through A New System Focusing on A Pool Touchpad for Measuring Timing of SwimmersProceedings of the 10th International Conference on Networking, Systems and Security10.1145/3629188.3629194(51-60)Online publication date: 21-Dec-2023
  • Show More Cited By

Index Terms

  1. SleeD: Using a Sleeve Display to Interact with Touch-sensitive Display Walls

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    ITS '14: Proceedings of the Ninth ACM International Conference on Interactive Tabletops and Surfaces
    November 2014
    524 pages
    ISBN:9781450325875
    DOI:10.1145/2669485
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 16 November 2014

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. arm display
    2. collaboration
    3. display wall
    4. information visualization
    5. multi-touch
    6. multi-user
    7. wearable display

    Qualifiers

    • Research-article

    Funding Sources

    Conference

    ITS '14
    Sponsor:
    ITS '14: Interactive Tabletops and Surfaces
    November 16 - 19, 2014
    Dresden, Germany

    Acceptance Rates

    ITS '14 Paper Acceptance Rate 31 of 112 submissions, 28%;
    Overall Acceptance Rate 119 of 418 submissions, 28%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)24
    • Downloads (Last 6 weeks)2
    Reflects downloads up to 16 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)Interactive Visualization on Large High‐Resolution Displays: A SurveyComputer Graphics Forum10.1111/cgf.1500143:6Online publication date: 30-Apr-2024
    • (2024)Dual-Thumb pointing and command selection techniques for tabletsInternational Journal of Human-Computer Studies10.1016/j.ijhcs.2023.103203184:COnline publication date: 1-Apr-2024
    • (2023)Soft-Touch or Hard-Touch: Quantifying Touches through A New System Focusing on A Pool Touchpad for Measuring Timing of SwimmersProceedings of the 10th International Conference on Networking, Systems and Security10.1145/3629188.3629194(51-60)Online publication date: 21-Dec-2023
    • (2023)SurfAirs: Surface + Mid-air Input for Large Vertical DisplaysProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580877(1-15)Online publication date: 19-Apr-2023
    • (2023)Desiderata for Intelligent Maps: A Multiperspective CompilationDesiderata für intelligente Karten: Eine multiperspektivische ZusammenstellungKN - Journal of Cartography and Geographic Information10.1007/s42489-023-00142-w73:3(183-198)Online publication date: 17-Jun-2023
    • (2022)Understanding and Creating Spatial Interactions with Distant Displays Enabled by Unmodified Off-The-Shelf SmartphonesMultimodal Technologies and Interaction10.3390/mti61000946:10(94)Online publication date: 19-Oct-2022
    • (2022)Interactive Public Displays and Wheelchair Users: Between Direct, Personal and Indirect, Assisted InteractionProceedings of the 35th Annual ACM Symposium on User Interface Software and Technology10.1145/3526113.3545662(1-17)Online publication date: 29-Oct-2022
    • (2021)A Smartphone-Based Cursor Position System in Cross-Device Interaction Using Machine Learning TechniquesSensors10.3390/s2105166521:5(1665)Online publication date: 28-Feb-2021
    • (2021)Enabling Multi-Material 3D Printing for Designing and Rapid Prototyping of Deformable and Interactive WearablesProceedings of the 20th International Conference on Mobile and Ubiquitous Multimedia10.1145/3490632.3490635(1-11)Online publication date: 5-Dec-2021
    • (2021)Bendable Color ePaper Displays for Novel Wearable Applications and Mobile VisualizationAdjunct Proceedings of the 34th Annual ACM Symposium on User Interface Software and Technology10.1145/3474349.3480213(6-10)Online publication date: 10-Oct-2021
    • Show More Cited By

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media