note

Skeletons and Silhouettes: Comparing User Representations at a Gesture-based Large Display

Authors:

Christopher Ackad,

Martin Tomitsch,

Judy KayAuthors Info & Claims

CHI '16: Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems

Pages 2343 - 2347

https://doi.org/10.1145/2858036.2858427

Published: 07 May 2016 Publication History

Abstract

Mid-air gestures offer a promising way to interact with large public displays. User representations are important to attract people to such displays, convey interactivity and provide meaningful gesture feedback. We evaluated two forms of user representation, an abstract skeleton and a silhouette, at a large public information display. Results from 56 days, with 190 sessions involving 483 detected people, indicate the silhouette attracted more passers-by to interact and, of these, more engaged in serious browsing interactions. By contrast, the skeleton representation had more playful interactions. Our work contributes to the understanding of the implications of these choices of user representation.

Supplementary Material

ZIP File (pn1968-file4.zip)

pn1968-file4.zip

Download
.57 KB

suppl.mov (pn1968-file3.mp4)

Supplemental video

Download
65.97 MB

MP4 File (p2343-ackad.mp4)

Download
130.87 MB

References

[1]

Christopher Ackad, Andrew Clayphan, Martin Tomitsch, and Judy Kay. 2015. An In-the-wild Study of Learning Mid-air Gestures to Browse Hierarchical Information at a Large Interactive Public Display. In Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp '15). ACM, New York, NY, USA, 1227--1238.

Digital Library

[2]

Christopher Ackad, Rainer Wasinger, Richard Gluga, Judy Kay, and Martin Tomitsch. 2013. Measuring Interactivity at an Interactive Public Information Display. In Proceedings of the 25th Australian Computer-Human Interaction Conference: Augmentation, Application, Innovation, Collaboration (OzCHI '13). ACM, New York, NY, USA, 329--332.

Digital Library

[3]

Ville Makela, Tomi Heimonen, Matti Luhtala, and Markku Turunen. 2014b. Information wall: evaluation of a gesture-controlled public display. In Proceedings of the 13th International Conference on Mobile and Ubiquitous Multimedia (MUM '14). ACM, ACM, New York, NY, USA, 228--231.

Digital Library

[4]

Ville Makela, Tomi Heimonen, and Markku Turunen. 2014a. Magnetic Cursor: Improving Target Selection in Freehand Pointing Interfaces. In Proceedings of The International Symposium on Pervasive Displays (PerDis '14). ACM, New York, NY, USA, 112:112--112:117.

Digital Library

[5]

Robert W Mitchell. 1993. Mental models of mirror-self-recognition: Two theories. New Ideas in Psychology 11, 3 (1993), 295--325.

[6]

Jorg Muller, Dieter Eberle, and Konrad Tollmar. 2014. Communiplay: a field study of a public display mediaspace. In Proceedings of the 32nd annual ACM conference on Human factors in computing systems CHI '14. ACM, 1415--1424.

Digital Library

[7]

Jorg Muller, Robert Walter, Gilles Bailly, Michael Nischt, and Florian Alt. 2012. Looking Glass: A Field Study on Noticing Interactivity of a Shop Window. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI). ACM, New York, NY, USA, 297--306.

Digital Library

[8]

Gonzalo Parra, Robin De Croon, Joris Klerkx, and Erik Duval. 2014. Quantifying the Interaction Stages of a Public Display Campaign in the Wild. In Proceedings of the 8th Nordic Conference on Human-Computer Interaction: Fun, Fast, Foundational (NordiCHI '14). ACM, New York, NY, USA, 757--760.

Digital Library

[9]

Garth Shoemaker, Anthony Tang, and Kellogg S Booth. 2007. Shadow Reaching: A New Perspective on Interaction for Large Displays. In Proceedings of the 20th Annual ACM Symposium on User Interface Software and Technology (UIST '07). ACM, New York, NY, USA, 53--56.

Digital Library

[10]

Maurice Ten Koppel, Gilles Bailly, Jorg Muller, and Robert Walter. 2012. Chained displays: Configurations of Public Displays Can Be Used to Influence Actor-, Audience-, and Passer-By Behavior. In Proceedings of the 2012 ACM annual conference on Human Factors in Computing Systems CHI '12 (CHI '12). ACM Press, New York, New York, USA, 317.

Digital Library

[11]

Martin Tomitsch, Christopher Ackad, Oliver Dawson, Luke Hespanhol, and Judy Kay. 2014. Who Cares About the Content? An Analysis of Playful Behaviour at a Public Display. In Proceedings of The International Symposium on Pervasive Displays (PerDis '14). ACM, ACM, New York, NY, USA, 160--165.

Digital Library

[12]

Nina Valkanova, Robert Walter, Andrew Vande Moere, and Jorg Muller. 2014. MyPosition: sparking civic discourse by a public interactive poll visualization. In Proceedings of the 17th ACM conference on Computer supported cooperative work & social computing CSCW '14. ACM, 1323--1332.

Digital Library

[13]

Robert Walter, Gilles Bailly, and Jorg Muller. 2013. StrikeAPose: Revealing Mid-air Gestures on Public Displays. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '13). ACM, New York, NY, USA, 841--850.

Digital Library

[14]

Robert Walter, Gilles Bailly, Nina Valkanova, and Jorg Muller. 2014. Cuenesics: using mid-air gestures to select items on interactive public displays. In Proceedings of the 16th international conference on Human-computer interaction with mobile devices & services - MobileHCI '14. ACM, 299--308.

Digital Library

[15]

Robert Walter, Andreas Bulling, David Lindlbauer, Martin Schuessler, and Jorg Muller. 2015. Analyzing Visual Attention During Whole Body Interaction with Public Displays. In Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp '15). ACM, New York, NY, USA, 1263--1267.

Digital Library

Cited By

Friedman ACafaro F(2024)Designing Gestures for Data Exploration with Public Displays via Identification StudiesInformation10.3390/info1506029215:6(292)Online publication date: 21-May-2024
https://doi.org/10.3390/info15060292
Tanaka KOkafuji YIwamoto T(2024)Popping-Up Poster: A Pin-Based Promotional Poster Device for Engaging Customers through Physical Shape TransformationProceedings of the ACM on Human-Computer Interaction10.1145/36981388:ISS(283-300)Online publication date: 24-Oct-2024
https://dl.acm.org/doi/10.1145/3698138
Cho SKim YJang JHwang I(2023)AI-to-Human ActuationProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/35808127:1(1-32)Online publication date: 28-Mar-2023
https://dl.acm.org/doi/10.1145/3580812
Show More Cited By

Index Terms

Skeletons and Silhouettes: Comparing User Representations at a Gesture-based Large Display
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction devices
      1. Touch screens
    2. Interaction paradigms
      1. Graphical user interfaces
  2. Interaction design
    1. Interaction design process and methods
      1. User centered design

Recommendations

Who cares about the Content? An Analysis of Playful Behaviour at a Public Display
PerDis '14: Proceedings of The International Symposium on Pervasive Displays

In this paper, we report on a field deployment study of a public interactive display, in which we observed a surprising number of interactions that seemed to be more concerned about playing 'with' the display rather than exploring its content. The ...
Looking glass: a field study on noticing interactivity of a shop window
CHI '12: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

In this paper we present our findings from a lab and a field study investigating how passers-by notice the interactivity of public displays. We designed an interactive installation that uses visual feedback to the incidental movements of passers-by to ...
Analyzing visual attention during whole body interaction with public displays
UbiComp '15: Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing

While whole body interaction can enrich user experience on public displays, it remains unclear how common visualizations of user representations impact users' ability to perceive content on the display. In this work we use a head-mounted eye tracker to ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '16: Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems

May 2016

6108 pages

ISBN:9781450333627

DOI:10.1145/2858036

General Chairs:
Jofish Kaye
Yahoo
,
Allison Druin
University of Maryland / National Park Service
,
Program Chairs:
Cliff Lampe
University of Michigan
,
Dan Morris
Microsoft
,
Juan Pablo Hourcade
University of Iowa

Copyright © 2016 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 07 May 2016

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Badges

Honorable Mention

Author Tags

Qualifiers

Note

Funding Sources

Faculty of Engineering University of Sydney
Smart Services CRC

Conference

CHI'16

Sponsor:

SIGCHI

CHI'16: CHI Conference on Human Factors in Computing Systems

May 7 - 12, 2016

California, San Jose, USA

Acceptance Rates

CHI '16 Paper Acceptance Rate 565 of 2,435 submissions, 23%;

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI 2025

Sponsor:
sigchi

ACM CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

33
Total Citations
View Citations
570
Total Downloads

Downloads (Last 12 months)23
Downloads (Last 6 weeks)1

Reflects downloads up to 05 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Friedman ACafaro F(2024)Designing Gestures for Data Exploration with Public Displays via Identification StudiesInformation10.3390/info1506029215:6(292)Online publication date: 21-May-2024
https://doi.org/10.3390/info15060292
Tanaka KOkafuji YIwamoto T(2024)Popping-Up Poster: A Pin-Based Promotional Poster Device for Engaging Customers through Physical Shape TransformationProceedings of the ACM on Human-Computer Interaction10.1145/36981388:ISS(283-300)Online publication date: 24-Oct-2024
https://dl.acm.org/doi/10.1145/3698138
Cho SKim YJang JHwang I(2023)AI-to-Human ActuationProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/35808127:1(1-32)Online publication date: 28-Mar-2023
https://dl.acm.org/doi/10.1145/3580812
Nguyen BHan JHouben MBayoumi YVande Moere A(2023)Engaging Passers-by with Rhythm: Applying Feedforward Learning to a Xylophonic Media Architecture FacadeProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580761(1-21)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3580761
Gentile VFarzand HBonaccorso SRocchesso DMalizia AKhamis MSorce S(2023)User-Centered Evaluation of Different Configurations of a Touchless Gestural Interface for Interactive DisplaysHuman-Computer Interaction – INTERACT 202310.1007/978-3-031-42280-5_32(501-520)Online publication date: 25-Aug-2023
https://doi.org/10.1007/978-3-031-42280-5_32
Wang XChen WWang F(2023)Visual Human–Computer Interactions for Intelligent VehiclesHandbook of Human‐Machine Systems10.1002/9781119863663.ch17(193-202)Online publication date: 7-Jul-2023
https://doi.org/10.1002/9781119863663.ch17
Jones MVon Feldt MAndrus N(2022)Outside Where? A Survey of Climates and Built Environments in Studies of HCI outdoorsProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3507656(1-15)Online publication date: 29-Apr-2022
https://dl.acm.org/doi/10.1145/3491102.3507656
Mäkelä VWinter JSchwab JKoch MAlt F(2022)Pandemic Displays: Considering Hygiene on Public Touchscreens in the Post-Pandemic EraProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3501937(1-12)Online publication date: 29-Apr-2022
https://dl.acm.org/doi/10.1145/3491102.3501937
Kay J(2022)Grand Challenges for Pervasive Technology to Transform Pervasive EducationIEEE Pervasive Computing10.1109/MPRV.2022.319910421:3(32-41)Online publication date: 1-Jul-2022
https://doi.org/10.1109/MPRV.2022.3199104
Cafaro FRoberts J(2021)Data through Movement: Designing Embodied Human-Data Interaction for Informal LearningSynthesis Lectures on Visualization10.2200/S01104ED1V01Y202105VIS0138:3(1-127)Online publication date: 8-Aug-2021
https://doi.org/10.2200/S01104ED1V01Y202105VIS013
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten