Jorge Goncalves
Denzil Ferreira
Vassilis Kostakos
ABSTRACT
This study is the first attempt to investigate altruistic use of interactive public displays in natural usage settings as a crowdsourcing mechanism. We test a non-paid crowdsourcing service on public displays with eight different motivation settings and analyse users' behavioural patterns and crowdsourcing performance (e.g., accuracy, time spent, tasks completed). The results show that altruistic use, such as for crowdsourcing, is feasible on public displays, and through the controlled use of motivational design and validation check mechanisms, performance can be improved. The results shed insights on three research challenges in the field: i) how does crowdsourcing performance on public displays compare to that of online crowdsourcing, ii) how to improve the quality of feedback collected from public displays which tends to be noisy, and iii) identify users' behavioural patterns towards crowdsourcing on public displays in natural usage settings.
- Alt, F., Shirazi, A., Schmidt, A., Kramer, U., Nawaz, Z. Location-based crowdsourcing: extending crowdsourcing to the real world. In Proc. NordiCHI '10, ACM (2010), 13--22. Google Scholar
Digital Library
- Ananny, M., Strohecker, C. TexTales: Creating interactive forums with urban publics. In: Foth, M. (Ed.) Handbook of Research on Urban Informatics: The Practice and Promise of the Real-Time City, IGI Global (2009), 68--86.Google Scholar
- Arslan, M., Singh, I., Singh, S., Madhyastha, H., Sundaresan, K., Krishnamurthy, S. Computing while charging: building a distributed computing infrastructure using smartphones. In Proc. CoNEXT '12, ACM (2012), 193--204. Google ScholarDigital Library
- Brignull, H., Rogers, Y. Enticing People to Interact with Large Public Displays in Public Spaces. In Proc. INTERACT '03 (2003), 17--24.Google Scholar
- Brown, B., Reeves, S., Sherwood, S. Into the wild: challenges and opportunities for field trial methods. In Proc. CHI'11, ACM (2011), 1657--1666. Google ScholarDigital Library
- Burke, J., Estrin, D., Hansen, M., Parker, A., Ramanathan, N., Reddy, S., Srivanstava, N. Participatory sensing. In Proc. WSW'06, ACM SENSYS (2006).Google Scholar
- Churchill, E., Nelson, L., Denoue, L., Hefman, J., Murphy, P. Sharing Multimedia Content with Public Displays: A Case Study. In Proc. DIS'04, ACM (2004), 7--16. Google ScholarDigital Library
- Eagle, N. txteagle: Mobile Crowdsourcing. In Proc. IDGD '09, Springer-Verlag (2009), 447--456. Google ScholarDigital Library
- Goncalves, J., Kostakos, V., Karapanos, E., Barreto, M., Camacho, T., Tomasic, A., Zimmerman, J. Citizen Motivation on the Go: The Role of Psychological Empowerment. Interacting with Computers, online first (2013).Google Scholar
- Google. The bright side of sitting in traffic: Crowdsourcing road congestion data. http://googleblog.blogspot.com/2009/08/bright-side-of-sitting-in-traffic.html (2009).Google Scholar
- Gupta, A., Thies, W., Cutrell, E., Balakrishnan, R. mClerk: enabling mobile crowdsourcing in developing regions. In Proc. CHI '12, ACM (2012), 1843--1852. Google ScholarDigital Library
- Horton, J., Chilton, L. The labor economics of paid crowdsourcing. In Proc. EC '10, ACM (2010), 209--218. Google ScholarDigital Library
- Hosio, S., Kostakos, V., Kukka, H., Jurmu, M., Riekki, J., Ojala, T. From School Food to Skate Parks in a few Clicks: Using Public Displays to Bootstrap Civic Engagement of the Young. In Proc. Pervasive 2012, Springer (2012), 425--442 (2012). Google ScholarDigital Library
- Hosio, S., Goncalves, J., Kostakos, V. Application Discoverability on Multipurpose Public Displays: Popularity Comes at a Price. In Proc. PerDis '13, ACM (2013), 31--36. Google ScholarDigital Library
- Ipeirotis, N. Demographics of Mechanical Turk (2010), http://archive.nyu.edu/bitstream/2451/29585/2/CeDER-10-0pdfGoogle Scholar
- Kandel, E., Lazear, E. P. Peer pressure and partnerships. Journal of Political Economy (1992), 801--817.Google Scholar
- Kaufmann, N., Schulze, T., Viet, D. More than fun and money. Worker Motivation in Crowdsourcing -- A Study on Mechanical Turk. In Proc. AMCIS'11 (2011).Google Scholar
- Kittur, A., Chi, E., Suh, B. Crowdsourcing user studies with Mechanical Turk. In Proc. CHI '08. ACM (2008), 453--456. Google ScholarDigital Library
- Kostakos, V., Kukka, H., Goncalves, J., Tselios, N., Ojala, T. Multipurpose public displays: How shortcut menus affect usage. IEEE Computer Graphics and Applications 33, 2 (2013), 50--57. Google ScholarDigital Library
- Kukka, H., Kostakos, V., Ojala, T., Ylipulli, J., Suopajarvi, T., Jurmu, M., Hosio, S. This Is Not Classified: Everyday Information Seeking and Encountering in Smart Urban Spaces. Personal and Ubiquitous Computing 17, 1 (2013), 15--27. Google ScholarDigital Library
- Kukka, H., Oja, H., Kostakos, V., Goncalves, J., Ojala, T. What Makes You Click: Exploring Visual Signals to Entice Interaction on Public Displays. In Proc. CHI'13, ACM (2013), 1699--1708. Google ScholarDigital Library
- Mashhadi, A., Capra, L. Quality control for real-time ubiquitous crowdsourcing. In Proc. UbiCrowd'11, ACM (2011), 5--8. Google ScholarDigital Library
- Müller, J., Wilmsmann, D., Exeler, J., Buzeck, M., Schmidt, A., Jay, T., Krüger, A. Display Blindness: The Effect of Expectations on Attention towards Digital Signage. In Proc. Pervasive 2009, Springer (2009), 1--8. Google ScholarDigital Library
- Narula, P., Gutheim, P., Rolnitzky, D., Kulkarni, A., and Hartmann, B. MobileWorks: A Mobile Crowdsourcing Platform for Workers at the Bottom of the Pyramid. In Proc. HCOMP '11 (2011).Google Scholar
- Paulos, E., Honicky, R. J., Hooker, B. Citizen Science: Enabling participatory urbanism. Handbook of Research on Urban Informatics, IGI Global (2009), 414--436.Google Scholar
- Quinn, A., Bederson, B. Human computation: a survey and taxonomy of a growing field. In Proc. CHI '11, ACM (2011), 1403--1412. Google ScholarDigital Library
- Rogstadius, J., Kostakos, V., Kittur, A., Smus, B., Laredo, J. Vukovic, M. An Assessment of Intrinsic and Extrinsic Motivation on Task Performance in Crowdsourcing Markets. In Proc. ICWSM'11, AAAI (2011), 321--328.Google Scholar
- Schwarz, O. Subjectual Visibility and the Negotiated Panopticon: on the Visibility-Economy of Online Digital Photography (2011).Google Scholar
- Väätäjä, H., Vainio, T., Sirkkunen, E., Salo, K. Crowdsourced news reporting: supporting news content creation with mobile phones. In Proc. MobileHCI '11, ACM (2011), 435--444. Google ScholarDigital Library
- von Ahn, L., Maurer, B., McMillen, C. Abraham, D., Blum, M. reCAPTCHA: Human-Based Character Recognition via Web Security Measures. Science 321, 5895 (2008), 1465--1468.Google Scholar
- Vukovic, M., Kumara, S., Greenshpan, O. Ubiquitous crowdsourcing. In Adj. Proc. Ubicomp '10, ACM (2010), 523--526. Google ScholarDigital Library
Index Terms
- Crowdsourcing on the spot: altruistic use of public displays, feasibility, performance, and behaviours
Recommendations
Older Adults’ Motivation and Engagement with Diverse Crowdsourcing Citizen Science Tasks
Human-Computer Interaction – INTERACT 2021AbstractIn this exploratory study we evaluated the engagement, performance and preferences of older adults who interacted with different citizen science tasks. Out of 40 projects recently active on the Zooniverse platform we selected top ones to be ...
"Why would anybody do this?": Understanding Older Adults' Motivations and Challenges in Crowd Work
CHI '16: Proceedings of the 2016 CHI Conference on Human Factors in Computing SystemsDiversifying participation in crowd work can benefit the worker and requester. Increasing numbers of older adults are online, but little is known about their awareness of or how they engage in mainstream crowd work. Through an online survey with 505 ...
Crowdsourcing the Disaster Management Cycle
Crowdsourcing is a communication platform that can be used during and after a disastrous event. Previous research in crisis crowdsourcing demonstrates its wide adoption for aiding response efforts by non-government organizations and public citizens. ...
Comments