skip to main content
10.1145/3623462.3624634acmotherconferencesArticle/Chapter ViewAbstractPublication PageskuiConference Proceedingsconference-collections
research-article

Exploratory Multimethod Evaluation of Experience and Behaviour in Large Public Total Media Situations

Published: 06 December 2023 Publication History

Abstract

Interactive large-scale media installations are difficult to evaluate the bigger the venue, larger the audience, more media elements, and shorter the presentation time. We report on a multi-method evaluation of one such event that combined standard evaluation methods (observation, interviews, etc.) and two novel exploratory methods (self-reflective spatial mapping and 5-word elicitation). We describe findings to demonstrate strength and weaknesses of methods when applied to a complex situation. Findings highlight the situation's richness and dynamics, but also inconsistence in results gained from the methods. Among other recommendations, we conclude that, for the time being, researchers should utilize inductive approaches, as we still lack a comprehensive set of strong concepts and dynamic patterns, which are needed to understand such situations better and to develop novel deductive methods for a more cost effective user experience evaluation of large public total media situations.

References

[1]
Imeh Akpan, Paul Marshall, Jon Bird, and Daniel Harrison. 2013. Exploring the effects of space and place on engagement with an interactive installation. In Proc. of SIGCHI. ACM. 2213-2222.
[2]
Florian Alt, Stefan Schneegaß, Albrecht Schmidt, Jörg Müller, and Nemanja Memarovic. 2012. How to evaluate public displays. In Proc. of PerDis '12. ACM, New York, NY, USA. 1-6.
[3]
Moritz Behrens, Nina Valkanova, Ava Fatah gen. Schieck, and Duncan P. Brumby. 2014. Smart Citizen Sentiment Dashboard: A Case Study Into Media Architectural Interfaces. In Proc. PerDis '14. ACM, New York, NY, USA. 19-24.
[4]
Harry Brignull, and Yvonne Rogers. 2003. Enticing people to interact with large public displays in public spaces. In Proc. of INTERACT. IOS Press. 17-24.
[5]
Martin Brynskov, Peter Dalsgaard, Tobias Ebsen, Jonas Fritsch, Kim Halskov, and Rune Nielsen. 2009. Staging Urban Interactions with Media Facades. In Proc. of IFIP TC 13. Springer. 154-167.
[6]
Sandy Claes, and Andrew Vande Moere. 2015. The Role of Tangible Interaction in Exploring Information on Public Visualization Displays. In Proc. of The 4th International Symposium on Pervasive Displays. ACM. 201-207.
[7]
Sandy Claes, Niels Wouters, Karin Slegers, and Andrew Vande Moere. 2015. Controlling In-the-Wild Evaluation Studies of Public Displays. In Proc. of the Conference on Human Factors in Computing Systems. ACM. 81-84.
[8]
Social User Experience Design Patterns. http://designingsocialinterfaces.com/patterns/Main_Page. Last accessed: 2017.
[9]
Peter Dalsgaard, Christian Dindler, and Kim Halskov. 2011. Understanding the Dynamics of Engaging Interaction in Public Spaces. In Proc. of INTERACT. 212.
[10]
Peter Dalsgaard, Kim Halskov, and Ole Sejer Iversen. 2016. Participation Gestalt: Analysing Participatory Qualities of Interaction in Public Space. In Proc. of CHI'16. ACM. 4435-4446.
[11]
Till Fastnacht, Patrick Tobias Fischer, Eva Hornecker, Sabine Zierold, Abraham Ornelas Aispuro, and Johannes Marschall. 2017. The hedonic value of sonnengarten: touching plants to trigger light. In Proc. of the 16th International Conference on Mobile and Ubiquitous Multimedia (MUM '17). Association for Computing Machinery, New York, NY, USA, 507–514.
[12]
Franz Dornseiff Der deutsche Wortschatz nach Sachgruppen. DeGruyter, 2004.
[13]
Patrick Tobias Fischer, Franziska Gerlach, Jenny Gonzalez Acuna, Daniel Pollack, Ingo Schäfer, Josephine Trautmann, and Eva Hornecker. 2014. Movable, Kick-/Flickable Light Fragments Eliciting Ad-hoc Interaction in Public Space. In Proc. of PerDis '14. ACM, New York, NY, USA. 50-55.
[14]
Patrick Tobias Fischer 2015. Castle-Sized Interfaces: An Interactive Façade Mapping. In Proc. of PerDis '15. ACM, New York, NY, USA. 91-97.
[15]
Patrick Tobias Fischer, and Eva Hornecker. 2012. Urban HCI: Spatial Aspects in the Design of Shared Encounters for Media Facades. In Proc. CHI '12. ACM, New York, NY, USA. 307 - 316.
[16]
Patrick Tobias Fischer, Eva Hornecker. 2017. Creating Shared Encounters Through Fixed and Movable Interfaces. In: Anton Nijholt(ed). Playable Cities. The City as a Digital Playground. Springer Singapore, pp. 163-185.
[17]
Claude Fortin, and Kate Hennessy. 2014. Unintentional Design: How Some Citizens Appropriated Megaphone in Public and Virtual Space. In Proc. of TEM 2014. 1-16.
[18]
Claude Fortin, Carman Neustaedter, and Kate Hennessy. 2014. The appropriation of a digital "speakers" corner: lessons learned from the deployment of megaphone. In Proc. of the DIS'14. ACM, NY, USA. 955-964.
[19]
Ekaterina Fuchkina, Patrick Tobias Fischer, Chinh Nguyen Tien, Anke von der Heide, and Eva Hornecker. 2016. In-situ versus simulation-based experience evaluation of media augmented urban environments. In Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing: Adjunct (UbiComp '16). Association for Computing Machinery, New York, NY, USA, 65–68.
[20]
Jan Gehl Life Between Buildings: Using Public Space. Island Press, 2011.
[21]
Marc Hassenzahl, Michael Burmester, and Franz Koller. 2003. AttrakDiff: Ein Fragebogen zur Messung wahrgenommener hedonischer und pragmatischer Qualität. In Proc. of M&C 2003: Interaktion in Bewegung. 187 - 196.
[22]
Luke Hespanhol, and Peter Dalsgaard. 2015. Social Interaction Design Patterns For Urban Media Architecture. In Proc. of Human-Computer Interaction – INTERACT 2015. Springer International Publishing. 596 - 613.
[23]
Luke Hespanhol, Martin Tomitsch, Ian McArthur, Joel Fredericks, Ronald Schroeter, and Marcus Foth. 2015. Situated interfaces for engaging citizens on the go. ACM interactions 23, 1, 40-45.
[24]
Ilya Kabakov, and Emilia Kabakov Über die 'totale' Installation: Total Installation. Hatje Cantz Verlag, 1995.
[25]
Joyce Vielhauer Kasmar The development of a usable lexicon of environmental descriptors. Cambridge University Press, City, 1988.
[26]
Wortschatz. http://corpora.informatik.uni-leipzig.de/de. Last accessed: 2016.
[27]
Designing Social Interfaces. http://www.designingsocialinterfaces.com/ patterns/Main_Page. Last accessed: 2016.
[28]
Nemanja Memarovic, Marc Langheinrich, Florian Alt, Ivan Elhart, Simo Hosio, and Elisa Rubegni. 2012. Using public displays to stimulate passive engagement, active engagement, and discovery in public spaces. In Proc. of MAB '12. ACM, New York, NY, USA. 55-64.
[29]
Daniel Michelis, and Jörg Müller. The Audience Funnel: Observations of Gesture Based Interaction with Multiple Large Displays in a City Center. International Journal Human-Computer Interaction, 27(6), 562-579, (2011).
[30]
Joerg Mueller, Robert Walter, Gilles Bailly, Michael Nischt, and Florian Alt. 2012. Looking Glass: A Field Study on Noticing Interactivity of Shop Windows. In Proc. of CHI '12. ACM, New York, NY, USA. 297 - 306.
[31]
Christian Nold Emotional Cartography - Technologies of the self, 2010.
[32]
Charles E. Osgood, Georg J. Suci, and Percy H. Tannenbaum. The Measurement of Meaning. University of Illinois Press, Urbana, Chicago and London, 1967.
[33]
Robert Plutchik Emotions and Life: Perspectives from Psychology, Biology and Evolution. American Psychological Association, 2003.
[34]
Stuart Reeves, Steve Benford, Claire O'Malley, and Mike Fraser. 2005. Designing the spectator experience. In Proc. CHI '05. ACM, New York, NY, USA.
[35]
Holly Robbins, and Katherine Isbister Playdates with Big Brother: Playfully Repurposing Surveillance Cameras to Build Communities. Surveillance & Society, 12(3), 448 - 458, (2014).
[36]
Petri Saarinen, Timo Partala, and Kaisa Väänänen-Vainio-Mattila. 2012. Visualize your spatial experience (VYSE): a method and a case study in an exhibition center. In Proc. NordiCHI '12. ACM. 486-495.
[37]
Angelique A. Scharine, and Michael K. McBeath Right-Handers and Americans Favor Turning to the Right. Human Factors and Ergonomics Society, 44(1), 248 - 256, (2002).
[38]
Ava Fatah gen. Schieck, Vassilis Kostakos, and Alan Penn Exploring Digital Encounters in the Public Arena. Springer, City, 2010.
[39]
Ava Fatah gen. Schieck, Holger Schnädelbach, Wallis Motta, Moritz Behrens, Steve North, Lei Ye, and Efstathia Kostopoulou. 2014. Screens in the Wild: Exploring the Potential of Networked Urban Screens for Communities and Culture. In Proc. of PerDis '14. ACM, New York, NY, USA. 166-167.
[40]
Jennifer G Sheridan, Alan Dix, Simon Lock, and Alice Bayliss Understanding Interaction in Ubiquitous Guerilla Performances in Playful Arenas. People and Computers, 3-18, (2005).
[41]
Shenando Stals, Michael Smyth, and Wijmand IJsselsteijn. 2013. Walking & Talking: Probing the Urban Lived Experience. In Proc. of NordiCHI '14. ACM, New York, NY, USA. 737-746.
[42]
GermaNet - An Introduction. http://www.sfs.uni-tuebingen.de/GermaNet/. Last accessed: 2016.
[43]
Nina Valkanova, Robert Walter, Andrew Vande Moere, and Jörg Müller. 2014. MyPosition: sparking civic discourse by a public interactive poll visualization. In Proc. of CSCW '14. ACM, New York, NY, USA. 1323-1332.
[44]
Alexander Wiethoff, Thomas Bauer, and Sven Gehring. 2014. Investigating multi-user interactions on interactive media facades. In Proc. of MAB '14. ACM, New York, NY, USA. 92-100.
[45]
Alexander Wiethoff, and Sven Gehring. 2012. Designing interaction with media façades: a case study. In Proc. of DIS '12. ACM, New York, NY, USA. 308-317.
[46]
Alexander Wiethoff, Jana Gerstberger, and Sven Gehring. 2015. StarLight - Exploring Embodied Interactions with Media Architecture and Public Audiences. In Proc. of PerDis '15. ACM, New York, NY, USA. 83-89.
[47]
Julie R. Williamson, and Daniel Sunden. 2015. Enter the Circle: Blending Spherical Displays and Playful Embedded Interaction in Public Spaces. In Proc. of PerDis '15. ACM. 195-200.
[48]
Julie R. Williamson, and John Williamson. 2014. Analysing Pedestrian Traffic Around Public Displays. In Proc. of PerDis '14. ACM. 13-18.
[49]
Katharine S. Willis, George Roussos, Konstantinos Chorianopulos, and Miriam Struppek Shared Encounters. Springer, City, 2010.
[50]
Krzysztof Wodiczko, Anke von der Heide, Patrick Tobias Fischer, Timm Burkhardt, Roy Müller, Lea Brugnoli, Hala Ghatasheh, Sebastian Schuster, Christian Paffrath, Muzaffar Ali, Mark Eisenberg, Michael Ohaya, Christian Rene Manzano Schlamp, David Leroy, Eva Hornecker, Wolfgang Sattler, and Liz Bachhuber. 2017. Die ermittler: a dialogue about displacement, refuge, and home. In Proceedings of the 16th International Conference on Mobile and Ubiquitous Multimedia (MUM '17). Association for Computing Machinery, New York, NY, USA, 527–533.
[51]
Niels Wouters, John Downs, Mitchell Harrop, Travis Cox, Eduardo Oliveira, Sarah Webber, Frank Vetere, and Andrew Vande Moere. 2016. Uncovering the Honeypot Effect: How Audiences Engage with Public Interactive Systems. In Proc. of DIS '16. ACM. 5-16.

Index Terms

  1. Exploratory Multimethod Evaluation of Experience and Behaviour in Large Public Total Media Situations

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Other conferences
    KUI '23: Proceedings of the 20th International Conference on Culture and Computer Science: Code and Materiality
    September 2023
    190 pages
    ISBN:9798400708367
    DOI:10.1145/3623462
    • Editors:
    • Lucas Fabian Olivero,
    • António Bandeira Araújo
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 06 December 2023

    Permissions

    Request permissions for this article.

    Check for updates

    Qualifiers

    • Research-article
    • Research
    • Refereed limited

    Conference

    KUI '23
    KUI '23: Culture and Computer Science
    September 28 - 29, 2023
    Lisbon, Portugal

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • 0
      Total Citations
    • 53
      Total Downloads
    • Downloads (Last 12 months)34
    • Downloads (Last 6 weeks)5
    Reflects downloads up to 23 Feb 2025

    Other Metrics

    Citations

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    HTML Format

    View this article in HTML Format.

    HTML Format

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media