Florian Alt
Stefan Schneegaß
Albrecht Schmidt
Jörg Müller
Nemanja Memarovic
ABSTRACT
After years in the lab, interactive public displays are finding their way into public spaces, shop windows, and public institutions. They are equipped with a multitude of sensors as well as (multi-) touch surfaces allowing not only the audience to be sensed, but also their effectiveness to be measured. The lack of generally accepted design guidelines for public displays and the fact that there are many different objectives (e.g., increasing attention, optimizing interaction times, finding the best interaction technique) make it a challenging task to pick the most suitable evaluation method. Based on a literature survey and our own experiences, this paper provides an overview of study types, paradigms, and methods for evaluation both in the lab and in the real world. Following a discussion of design challenges, we provide a set of guidelines for researchers and practitioners alike to be applied when evaluating public displays.
- Alt, F., Memarovic, N., Elhart, I., Bial, D., Schmidt, A., Langheinrich, M., Harboe, G., and Huang, E. Designing shared public display networks -- implications from today's paper-based notice areas. In Proc. of Pervasive 2011 (2011). Google Scholar
Digital Library
- Alt, F., Schmidt, A., and Evers, C. Mobile contextual display systems. In Adj. Proc. of HotMobile'09 (2009).Google Scholar
- Alt, F., Shirazi, A. S., Kubitza, T., Bial, D., Zaidan, F., Ortel, M., Zurmaar, B., Lewen, T., and Schmidt, A. Digifieds: Insights into deploying digital public notice areas in the wild. In Proc. of MUM'11 (Dec. 2011). Google ScholarDigital Library
- Ballagas, R., Rohs, M., and Sheridan, J. G. Sweep and point and shoot: phonecam-based interactions for large public displays. In CHI '05 EA, ACM (NY, USA, 2005). Google ScholarDigital Library
- Bangor, A., Kortum, P., and Miller, J. An empirical evaluation of the system usability scale. International Journal of Human-Computer Interaction 24, 6 (2008).Google ScholarCross Ref
- Beyer, G., Alt, F., Müller, J., Schmidt, A., Isakovic, K., Klose, S., Schiewe, M., and Haulsen, I. Audience behavior around large interactive cylindrical screens. In Proc. of CHI'11, ACM (New York, USA, 2011), 1021--1030. Google ScholarDigital Library
- Boring, S., Baur, D., Butz, A., Gustafson, S., and Baudisch, P. Touch projector: mobile interaction through video. In Proc. of CHI'10, ACM (New York, USA, 2010), 2287--2296. Google ScholarDigital Library
- Brignull, H., Izadi, S., Fitzpatrick, G., Rogers, Y., and Rodden, T. The introduction of a shared interactive surface into a communal space. In Proc. of CSCW '04, ACM (New York, NY, USA, 2004), 49--58. Google ScholarDigital Library
- Brignull, H., and Rogers, Y. Enticing people to interact with large public displays in public spaces. In Proc. of INTERACT'03, vol. 3 (2003), 17--24.Google Scholar
- Cheverst, K., Fitton, D., and Dix, A. Exploring the evolution of office door displays. Public and Situated Displays (2003).Google Scholar
- Cheverst, K., Taylor, N., Rouncefield, M., Galani, A., and Kray, C. The challenge of evaluating situated display based technology interventions designed to foster a sense of community. Proc. of USE'08 (2008), 1--5.Google Scholar
- Collomb, M., Hascoët, M., Baudisch, P., and Lee, B. Improving drag-and-drop on wall-size displays. In Proc. of GI '05 (2005), 25--32. Google ScholarDigital Library
- Fatah gen Schieck, A., Kostakos, V., and Penn, A. The urban screen as a socialising platform: exploring the role of place within the urban space.Google Scholar
- Hart, S., and Staveland, L. Development of nasa-tlx (task load index): Results of empirical and theoretical research. Human mental workload 1 (1988), 139--183.Google Scholar
- Huang, E. M., Koster, A., and Borchers, J. Overcoming assumptions and uncovering practices: When does the public really look at public displays? In Proc. of Pervasive'08, Springer-Verlag (Berlin, Heidelberg, 2008), 228--243. Google ScholarDigital Library
- Hutchinson, H., Mackay, W., Westerlund, B., Bederson, B. B., Druin, A., Plaisant, C., Beaudouin-Lafon, M., Conversy, S., Evans, H., Hansen, H., Roussel, N., and Eiderbäck, B. Technology probes: inspiring design for and with families. In Proc. of CHI'03, ACM (NY, USA, 2003), 17--24. Google ScholarDigital Library
- Jacucci, G., Morrison, A., Richard, G. T., Kleimola, J., Peltonen, P., Parisi, L., and Laitinen, T. Worlds of information: designing for engagement at a public multi-touch display. In Proc. of CHI '10, ACM (2010). Google ScholarDigital Library
- Khan, A., Matejka, J., Fitzmaurice, G., and Kurtenbach, G. Spotlight: directing users' attention on large displays. In Proc. of CHI '05, ACM (New York, USA, 2005), 791--798. Google ScholarDigital Library
- Lazar, J., Feng, J., and Hochheiser, H. Research methods in human-computer interaction. John Wiley & Sons Inc., 2009. Google ScholarDigital Library
- Mankoff, J., Dey, A. K., Hsieh, G., Kientz, J., Lederer, S., and Ames, M. Heuristic evaluation of ambient displays. In Proc. of CHI '03, ACM (New York, USA, 2003), 169--176. Google ScholarDigital Library
- Matthews, T. L., Rattenbury, T. L., and Carte, S. A. Defining, designing, and evaluating peripheral displays: An analysis using activity theory. HCI 22, 1--2 (2007), 221--261. Google ScholarDigital Library
- Memarovic, N., Elhart, I., and Langheinrich, M. Funsquare: First experiences with autopoiesic content. In Proc. of MUM'11 (Dec. 2011). Google ScholarDigital Library
- Meschtscherjakov, A., Reitberger, W., Mirlacher, T., Huber, H., and Tscheligi, M. Amiquin - an ambient mannequin for the shopping environment ambient intelligence. In Proc. of AmI'09. Springer Berlin/Heidelberg, 2009, 206--214. Google ScholarDigital Library
- Müller, J., Exeler, J., Buzeck, M., and Krüger, A. Reflectivesigns: Digital signs that adapt to audience attention. In Proc. of Pervasive'09, Springer (Berlin, 2009), 17--24. Google ScholarDigital Library
- Müller, J., Walter, R., Bailly, G., Nischt, M., and Alt, F. Looking glass: A field study on noticing interactivity of a shop window. In Proc. of CHI'12 (May 2012 (to appear)). Google ScholarDigital Library
- Müller, J., Wilmsmann, D., Exeler, J., Buzeck, M., Schmidt, A., Jay, T., and Krüger, A. Display blindness: The effect of expectations on attention towards digital signage. In Proc. of Pervasive'09, Springer-Verlag (2009), 1--8. Google ScholarDigital Library
- Nielsen, J. Usability engineering. Morgan Kaufmann, 1994. Google ScholarDigital Library
- Ojala, T., Kostakos, V., and Kukka, H. It's a jungle out there: Fantasy and reality of evaluating public displays in the wild. Large Displays in Urban Life 4 (2011), 1--4.Google Scholar
- Ojala, T., Kukka, H., Lindén, T., Heikkinen, T., Jurmu, M., Hosio, S., and Kruger, F. Ubi-hotspot 1.0: Large-scale long-term deployment of interactive public displays in a city center. In Proc. of ICIW'10, Ieee (2010), 285--294. Google ScholarDigital Library
- Peltonen, P., Kurvinen, E., Salovaara, A., Jacucci, G., Ilmonen, T., Evans, J., Oulasvirta, A., and Saarikko, P. It's mine, don't touch!: interactions at a large multi-touch display in a city centre. In Proc. of CHI'08, ACM (2008). Google ScholarDigital Library
- Redhead, F., and Brereton, M. Designing interaction for local communications: An urban screen study. In Proc. of INTERACT '09, Springer (Heidelberg, 2009), 457--460. Google ScholarDigital Library
- Rogers, Y., Hazlewood, W. R., Marshall, P., Dalton, N., and Hertrich, S. Ambient influence: can twinkly lights lure and abstract representations trigger behavioral change? In Proc. of Ubicomp '10, ACM (NY, USA, 2010), 261--270. Google ScholarDigital Library
- Schmidt, D., Chehimi, F., Rukzio, E., and Gellersen, H. Phonetouch: a technique for direct phone interaction on surfaces. In Proc. of UIST '10 (2010), 13--16. Google ScholarDigital Library
- Schrammel, J., Mattheiss, E., Döbelt, S., Paletta, L., Almer, A., and Tscheligi, M. Attentional behavior of users on the move towards pervasive advertising media. In Pervasive Advertising, J. Müller, F. Alt, and D. Michelis, Eds., Springer Limited London (2011).Google ScholarCross Ref
- Shoemaker, G. B. D., and Inkpen, K. M. Single display privacyware: augmenting public displays with private information. In Proc. of CHI '01, ACM (2001). Google ScholarDigital Library
- Storz, O., Friday, A., Davies, N., Finney, J., Sas, C., and Sheridan, J. Public ubiquitous computing systems: Lessons from the e-campus display deployments. Pervasive Computing, IEEE 5, 3 (2006), 40--47. Google ScholarDigital Library
- Vogel, D., and Balakrishnan, R. Interactive public ambient displays: transitioning from implicit to explicit, public to personal, interaction with multiple users. In Proc. of UIST'04, UIST '04, ACM (New York, NY, USA, 2004), 137--146. Google ScholarDigital Library
- Vogel, D., and Balakrishnan, R. Distant freehand pointing and clicking on very large, high resolution displays. In Proc. of UIST '05, ACM (New York, NY, USA, 2005), 33--42. Google ScholarDigital Library
- Wilson, A. D., and Benko, H. Combining multiple depth cameras and projectors for interactions on, above and between surfaces. In Proc. of UIST '10, ACM (NY, 2010). Google ScholarDigital Library
Index Terms
- How to evaluate public displays
Recommendations
Does the Public Still Look at Public Displays?: A Field Observation of Public Displays in the Wild
Public displays are widely used for displaying information in public space, such as shopping centres. They are typically programmed to display advertisements or general information about the space in which they are situated. Due to recent advances in ...
Tackling challenges of interactive public displays using gaze
UbiComp/ISWC'15 Adjunct: Adjunct Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2015 ACM International Symposium on Wearable ComputersFalling hardware prices led to a widespread use of public displays. Common interaction techniques for such displays currently include touch, mid-air, or smartphone-based interaction. While these techniques are well understood from a technical ...
3D mobile interactions for public displays
SA '14: SIGGRAPH Asia 2014 Mobile Graphics and Interactive ApplicationsWe propose the use of 3D mobile interactions as a way to give public displays viewers (users) new ways to collaborate among them with the public display. Getting and maintaining the user attention is one of the main struggles of public displays but ...
Comments