skip to main content
10.1145/3025453.3026006acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
research-article

GIAnT: Visualizing Group Interaction at Large Wall Displays

Published: 02 May 2017 Publication History

Abstract

Large interactive displays are increasingly important and a relevant research topic, and several studies have focused on wall interaction. However, in many cases, thorough user studies currently require time-consuming video analysis and coding. We present the Group Interaction Analysis Toolkit GIAnT, which provides a rich set of visualizations supporting investigation of multi-user interaction at large display walls. GIAnT focuses on visualizing time periods, making it possible to gain overview-level insights quickly. The toolkit is designed to be extensible and features several carefully crafted visualizations: A novel timeline visualization shows movement in front of the wall over time, a wall visualization shows interactions on the wall and gaze data, and a floor visualization displays user positions. In addition, GIAnT shows the captured video stream along with basic statistics. We validate our tool by analyzing how it supports investigating major research topics and by practical use in evaluating a cooperative game.

Supplementary Material

suppl.mov (pn4502.mp4)
Supplemental video
suppl.mov (pn4502p.mp4)
Supplemental video
MP4 File (p2639-von-zadow.mp4)

References

[1]
Christopher Andrews, Alex Endert, Beth Yost, and Chris North. 2011. Information Visualization on Large, High-resolution Displays: Issues, Challenges, and Opportunities. Information Visualization 10, 4 (Oct. 2011), 341--355.
[2]
Christopher Andrews and Chris North. 2013. The Impact of Physical Navigation on Spatial Organization for Sensemaking. IEEE Transactions on Visualization and Computer Graphics 19, 12 (2013), 2207--2216.
[3]
Alec Azad, Jaime Ruiz, Daniel Vogel, Mark Hancock, and Edward Lank. 2012. Territoriality and Behaviour on and Around Large Vertical Publicly-shared Displays. In Proceedings of the Designing Interactive Systems Conference (DIS '12). ACM, NY, NY, USA, 468--477.
[4]
Robert Ball and Chris North. 2008. The Effects of Peripheral Vision and Physical Navigation on Large Scale Visualization. In Proceedings of Graphics Interface 2008 (GI '08). Canadian Information Processing Society, Toronto, Ont., Canada, Canada, 9--16.
[5]
Till Ballendat, Nicolai Marquardt, and Saul Greenberg. 2010. Proxemic Interaction: Designing for a Proximity and Orientation-aware Environment. In Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces (ITS '10). ACM, NY, NY, USA, 121--130.
[6]
Jeremy P. Birnholtz, Tovi Grossman, Clarissa Mak, and Ravin Balakrishnan. 2007. An Exploratory Study of Input Configuration and Group Process in a Negotiation Task Using a Large Display. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '07). ACM, NY, NY, USA, 91--100.
[7]
Andrew Bragdon, Rob DeLine, Ken Hinckley, and Meredith Ringel Morris. 2011. Code Space: Touch + Air Gesture Hybrid Interactions for Supporting Developer Meetings. In Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces (ITS '11). ACM, NY, NY, USA, 212--221.
[8]
Brandon Burr. 2006. VACA: A Tool for Qualitative Video Analysis. In CHI '06 Extended Abstracts on Human Factors in Computing Systems (CHI EA '06). ACM, NY, NY, USA, 622--627.
[9]
Andrew Clayphan, Roberto Martinez-Maldonado, Martin Tomitsch, Susan Atkinson, and Judy Kay. 2016. An In-the-Wild Study of Learning to Brainstorm: Comparing Cards, Tabletops and Wall Displays in the Classroom. Interacting with Computers (2016), 1--23.
[10]
Raimund Dachselt and Robert Buchholz. 2008. Throw and Tilt -- Seamless Interaction across Devices Using Mobile Phone Gestures. In Proceedings of the 2nd Workshop on Mobile and Embedded Interactive Systems (Lecture Notes in Informatics Series (LNI)). Gesellschaft für Informatik e.V. (GI), 272--278.
[11]
Adam Fouse, Nadir Weibel, Edwin Hutchins, and James D. Hollan. 2011. ChronoViz: A System for Supporting Navigation of Time-coded Data. In CHI '11 Extended Abstracts on Human Factors in Computing Systems (CHI EA '11). ACM, NY, NY, USA, 299--304.
[12]
T.C. Nicholas Graham, Irina Schumann, Mrunal Patel, Quentin Bellay, and Raimund Dachselt. 2013. Villains, Architects and Micro-managers: What Tabula Rasa Teaches Us About Game Orchestration. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '13). ACM, NY, NY, USA, 705--714.
[13]
Carl Gutwin and Saul Greenberg. 2002. A Descriptive Framework of Workspace Awareness for Real-Time Groupware. Computer Supported Collaborative Work 11, 3 (Nov. 2002), 411--446.
[14]
Joey Hagedorn, Joshua Hailpern, and Karrie G. Karahalios. 2008. VCode and VData: Illustrating a New Framework for Supporting the Video Annotation Workflow. In Proceedings of the Working Conference on Advanced Visual Interfaces (AVI '08). ACM, NY, NY, USA, 317--321.
[15]
Edward T. Hall. 1966. The Hidden Dimension. Doubleday.
[16]
Michael Haller, Jakob Leitner, Thomas Seifried, James R. Wallace, Stacey D. Scott, Christoph Richter, Peter Brandl, Adam Gokcezade, and Seth Hunter. 2010. The NiCE Discussion Room: Integrating Paper and Digital Media to Support Co-Located Group Meetings. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '10). ACM, 609--618.
[17]
Cristian Hofmann, Nina Hollender, and Dieter W. Fellner. 2009. Workflow-Based Architecture for Collaborative Video Annotation. Springer Berlin Heidelberg, Berlin, Heidelberg, 33--42.
[18]
Petra Isenberg, Danyel Fisher, Sharoda A. Paul, Meredith Ringel Morris, Kori Inkpen, and Mary Czerwinski. 2012. Co-Located Collaborative Visual Analytics Around a Tabletop Display. IEEE Transactions on Visualization and Computer Graphics 18, 5 (May 2012), 689--702.
[19]
Mikkel R. Jakobsen and Kasper Hornbæk. 2014. Up Close and Personal: Collaborative Work on a High-resolution Multitouch Wall Display. ACM Transactions on Human-computer Interaction 21, 2, Article 11 (Feb. 2014), 34 pages.
[20]
Mikkel R. Jakobsen and Kasper Hornbæk. 2015. Is Moving Improving?: Some Effects of Locomotion in Wall-Display Interaction. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15). ACM, NY, NY, USA, 4169--4178.
[21]
Mikkel R. Jakobsen and Kasper Hornbæk. 2016. Negotiating for Space?: Collaborative Work Using a Wall Display with Mouse and Touch Input. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). ACM, NY, NY, USA, 2050--2061.
[22]
Ulrike Kister, Patrick Reipschläger, Fabrice Matulic, and Raimund Dachselt. 2015. BodyLenses: Embodied Magic Lenses and Personal Territories for Wall Displays. In Proceedings of the 2015 International Conference on Interactive Tabletops & Surfaces (ITS '15). ACM, NY, NY, USA, 117--126.
[23]
Ricardo Langner, Ulrich von Zadow, Tom Horak, Annett Mitschick, and Raimund Dachselt. 2016. Content Sharing Between Spatially-Aware Mobile Phones and Large Vertical Displays Supporting Collaborative Work. Springer International Publishing.
[24]
Walter S. Lasecki, Mitchell Gordon, Danai Koutra, Malte F. Jung, Steven P. Dow, and Jeffrey P. Bigham. 2014. Glance: Rapidly Coding Behavioral Video with the Crowd. In Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology (UIST '14). ACM, NY, NY, USA, 551--562.
[25]
Nicolai Marquardt, Ken Hinckley, and Saul Greenberg. 2012. Cross-device Interaction via Micro-mobility and F-formations. In Proceedings of the 25th Annual ACM Symposium on User Interface Software and Technology (UIST '12). ACM, NY, NY, USA, 13--22.
[26]
Nicolai Marquardt, Frederico Schardong, and Anthony Tang. 2015. EXCITE: EXploring Collaborative Interaction in Tracked Environments. In Proceedings of INTERACT 2015. Lecture Notes in Computer Science, Vol. 9297. Springer International Publishing, 89--97.
[27]
Roberto Martinez, Anthony Collins, Judy Kay, and Kalina Yacef. 2011. Who Did What? Who Said That?: Collaid: An Environment for Capturing Traces of Collaborative Learning at the Tabletop. In Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces (ITS '11). ACM, NY, NY, USA, 172--181.
[28]
Roshanak Zilouchian Moghaddam and Brian Bailey. 2011. VICPAM: A Visualization Tool for Examining Interaction Data in Multiple Display Environments. In Proceedings of the 2011 International Conference on Human Interface and the Management of Information Volume Part I (HI'11). Springer-Verlag, Berlin, Heidelberg, 278--287. http://dl.acm.org/citation.cfm?id=2027916.2027951
[29]
Jakob Nielsen and Kara Pernice. 2009. Eyetracking Web Usability (1st ed.). New Riders Publishing, Thousand Oaks, CA, USA.
[30]
Stacey D. Scott, S. Carpendale, and M. Inkpen. 2004. Territoriality in collaborative tabletop workspaces. In Proceedings of the 2004 ACM Conference on Computer Supported Cooperative Work (CSCW '04). ACM, 294--303.
[31]
Ben Shneiderman. 1996. The Eyes Have It: A Task by Data Type Taxonomy for Information Visualizations. In Proceedings of the 1996 IEEE Symposium on Visual Languages (VL '96). IEEE Computer Society, Washington, DC, USA, 336--343.
[32]
Samuel Silva, Beatriz Sousa Santos, and Joaquim Madeira. 2011. Using color in visualization: A survey. Computers & Graphics 35, 2 (2011), 320 -- 333.
[33]
Anthony Tang, Michel Pahud, Sheelagh Carpendale, and Bill Buxton. 2010. VisTACO: Visualizing Tabletop Collaboration. In ACM International Conference on Interactive Tabletops and Surfaces (ITS '10). ACM, NY, NY, USA, 29--38.
[34]
Ulrich von Zadow, Daniel Bösel, Duc Dung Dam, Anke Lehmann, Patrick Reipschläger, and Raimund Dachselt. 2016. Miners: Communication and Awareness in Collaborative Gaming at an Interactive Display Wall. In Proceedings of the 2016 ACM on Interactive Surfaces and Spaces (ISS '16). ACM, NY, NY, USA, 235--240.
[35]
Ulrich von Zadow, Wolfgang Büschel, Ricardo Langner, and Raimund Dachselt. 2014. SleeD: Using a Sleeve Display to Interact with Touch-sensitive Display Walls. In Proceedings of the Ninth ACM International Conference on Interactive Tabletops and Surfaces (ITS '14). ACM, NY, NY, USA, 129--138.
[36]
Ulrich von Zadow, Patrick Reipschläger, Daniel Bösel, Anita Sellent, and Raimund Dachselt. 2016. YouTouch! Low-Cost User Identification at an Interactive Display Wall. In Proceedings of the International Working Conference on Advanced Visual Interfaces (AVI '16). ACM, NY, NY, USA, 144--151.

Cited By

View all
  • (2024)Investigating the Gap: Gaze and Movement Analysis in Immersive EnvironmentsProceedings of the 2024 Symposium on Eye Tracking Research and Applications10.1145/3649902.3653522(1-7)Online publication date: 4-Jun-2024
  • (2023)Research on Human-Computer Interaction Technology of Large-Scale High-Resolution Display Wall SystemApplied Sciences10.3390/app1301059113:1(591)Online publication date: 1-Jan-2023
  • (2023)Side-by-Side vs Face-to-Face: Evaluating Colocated Collaboration via a Transparent Wall-sized DisplayProceedings of the ACM on Human-Computer Interaction10.1145/35796237:CSCW1(1-29)Online publication date: 16-Apr-2023
  • Show More Cited By

Index Terms

  1. GIAnT: Visualizing Group Interaction at Large Wall Displays

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    CHI '17: Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems
    May 2017
    7138 pages
    ISBN:9781450346559
    DOI:10.1145/3025453
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 02 May 2017

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. awareness
    2. collaborative work
    3. coupling
    4. multitouch
    5. physical navigation
    6. territoriality
    7. visual analysis
    8. visualization

    Qualifiers

    • Research-article

    Conference

    CHI '17
    Sponsor:

    Acceptance Rates

    CHI '17 Paper Acceptance Rate 600 of 2,400 submissions, 25%;
    Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

    Upcoming Conference

    CHI 2025
    ACM CHI Conference on Human Factors in Computing Systems
    April 26 - May 1, 2025
    Yokohama , Japan

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)61
    • Downloads (Last 6 weeks)6
    Reflects downloads up to 13 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)Investigating the Gap: Gaze and Movement Analysis in Immersive EnvironmentsProceedings of the 2024 Symposium on Eye Tracking Research and Applications10.1145/3649902.3653522(1-7)Online publication date: 4-Jun-2024
    • (2023)Research on Human-Computer Interaction Technology of Large-Scale High-Resolution Display Wall SystemApplied Sciences10.3390/app1301059113:1(591)Online publication date: 1-Jan-2023
    • (2023)Side-by-Side vs Face-to-Face: Evaluating Colocated Collaboration via a Transparent Wall-sized DisplayProceedings of the ACM on Human-Computer Interaction10.1145/35796237:CSCW1(1-29)Online publication date: 16-Apr-2023
    • (2023)AutoVis: Enabling Mixed-Immersive Analysis of Automotive User Interface Interaction StudiesProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580760(1-23)Online publication date: 19-Apr-2023
    • (2023)Pearl: Physical Environment based Augmented Reality Lenses for In-Situ Human Movement AnalysisProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580715(1-15)Online publication date: 19-Apr-2023
    • (2022)AvatAR: An Immersive Analysis Environment for Human Motion Data Combining Interactive 3D Avatars and TrajectoriesProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3517676(1-15)Online publication date: 29-Apr-2022
    • (2022)ReLive: Bridging In-Situ and Ex-Situ Visual Analytics for Analyzing Mixed Reality User StudiesProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3517550(1-20)Online publication date: 29-Apr-2022
    • (2021)ConAn: A Usable Tool for Multimodal Conversation AnalysisProceedings of the 2021 International Conference on Multimodal Interaction10.1145/3462244.3479886(341-351)Online publication date: 18-Oct-2021
    • (2021)Designing a Multi-Agent Occupant Simulation System to Support Facility Planning and Analysis for COVID-19Proceedings of the 2021 ACM Designing Interactive Systems Conference10.1145/3461778.3462030(15-30)Online publication date: 28-Jun-2021
    • (2021)Socio-Spatial ComfortProceedings of the ACM on Human-Computer Interaction10.1145/34329374:CSCW3(1-33)Online publication date: 5-Jan-2021
    • Show More Cited By

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media