Abstract
Microtasks expand ways for people to work, which we could not imagine in the past. When people have pockets of time, they can perform microtasks. This paper pursues this approach further by exploring the design of microtasks that interact with workers with audio and physical means only, without any visual representation. Such a task can be performed in situations where workers cannot use display devices. This paper shows that consistency in navigation is an important factor and proposes a principled framework that develops consistent non-visual microtasks. The experimental results with real-world workers show that the resultant task design allows them to produce better results than tasks without consistency.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsNotes
- 1.
AM Task Demo Video: https://bit.ly/2XrJnQf.
- 2.
Amazon Mechanical Turk: https://www.mturk.com.
- 3.
Kaggle: https://www.kaggle.com.
References
Abelson, R.P., Rosenberg, M.: Symbolic psycho-logic: a model of attitudinal cognition. Behav. Sci. 3, 1–8 (1958)
Aggarwal, P., et al.: A case study on the use of IVR systems by visually impaired people. In: The 3rd ACM Symposium on Computing for Development (2013)
Brehm, J.W., Cohen, A.R.: Explorations in Cognitive Dissonance. Wiley, New York (1962)
Cartwright, D., Harary, F.: Structural balance: a generalization of Heider’s theory. Psychol. Rev. 63, 277–293 (1956)
Christen, P.: Data Matching. Springer, Heidelberg (2012). https://doi.org/10.1007/978-3-642-31164-2
Corkrey, R., Parkinson, L.: Interactive voice response: review of studies 1989–2000. Behav. Res. Methods Instrum. Comput. 34, 342–353 (2002). https://doi.org/10.3758/BF03195462
D’Atri, E., Medaglia, C., Serbanati, A., Ceipidor, U.B., Panizzi, E., D’Atri, A.: A system to aid blind people in the mobility: a usability test and its results. In: 2nd International Conference on Systems (2007)
Donker, H., Klante, P., Gorny, P.: The design of auditory user interfaces for blind users. In: Proceedings of the Second Nordic Conference on Human-Computer Interaction (2002)
Elmagarmid, A.K., Ipeirotis, P.G., Verykios, V.S.: Duplicate record detection: a survey. TKDE 19, 1–16 (2007)
Festinger, L.: A Theory of Cognitive Dissonance. Row, Peterson, Evanston (1957)
Getoor, L., Machanavajjhala, A.: Entity resolution: theory, practice & open challenges. In: Proceedings of the VLDB Endowment (2012)
Gokhale, C., et al.: Corleone: hands-off crowdsourcing for entity matching. In: SIGMOD, pp. 601–612 (2014)
Heberlein, T.A., Black, J.S.: Cognitive consistency and environmental action. Environ. Behav. 13, 717–734 (1981)
Heider, F.: Attitudes and cognitive organization. J. Psychol. 21, 107–111 (1946)
Heider, F.: The Psychology of Interpersonal Relations. Wiley, New York (1958)
Hirth, M., HoBfeld, T., Tran-Gia, P.: Anatomy of a crowdsourcing platform - using the example of microworkers.com. In: Workshop on Future Internet and Next Generation Networks (2011)
Iwamoto, E., et al.: Passerby crowdsoucing: workers’ behavior and data quality management. In: Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, no. 4 (2018)
Jiang, L., Wang, Y., Hoffart, J., Weikum, G.: Crowdsourced entity markup. In: CrowdSem (2013)
Lahav, O., Schloerb, D., Kumar, S., Srinivasan, M.: A virtual environment for people who are blind - a usability study. J. Assist. Technol. 6(1), 38–52 (2012). https://doi.org/10.1108/17549451211214346
Marcus, A., Wu, E., Karger, D., Madden, S., Miller, R.: Human-powered sorts and joins. PVLDB 5, 13–24 (2011)
Mudgal, S., et al.: Deep learning for entity matching: a design space exploration. In: SIGMOD 2018 (2018)
Nengroo, A.S., Kuppusamy, K.S.: Accessible images (AIMS): a model to build self-describing images for assisting screen reader users. Univers. Access Inf. Soc. 17, 607–619 (2017). https://doi.org/10.1007/s10209-017-0607-z
Newcomb, T.M.: An approach to the study of communicative acts. Psychol. Rev. 60, 393–404 (1953)
Osgood, C.E., Tannenbaum, P.H.: The principle of congruity in the prediction of attitude change. Psychol. Rev. 62, 42–55 (1955)
Rahmanian, B., D.J.G.: User interface design for crowdsourcing systems. In: AVI (2014)
Rosenberg, M.J.: An Analysis of Affective-Cognitive Consistency. Yale University Press, New Haven (1960)
Sampath, H. A., R.R.I.B.: Conititively inspired task design to improve user performance on crowdsourcing platforms. In: CHI (2014)
Sanderson, P.M., Anderson, J., Watson, M.: Extending ecological interface design to auditory displays. In: Proceedings of the 2000 Annual Conference of the Computer-Human Interaction Special Interest Group (CHISIG) of the Ergonomics Society of Australia (OzCHI2000) (2000)
Shen, W., Li, X., Doan, A.: Constraint-based entity matching. In: AAAI 2005 (2005)
Simon, D., Snow, C.J., Read, S.J.: The redux of cognitive consistency theories: evidence judgments by constraint satisfaction. J. Pers. Soc. Psychol. 86, 814–837 (2004)
Wang, J., Kraska, T., Franklin, M.J., Feng, J.: Crowder: crowdsourcing entity resolution. In: VLDB, pp. 1483–1494 (2012)
Yin, M., Zhai, S.: The benefits of augmenting telephone voice menu navigation with visual browsing and search. In: CHI 2006, pp. 319–328 (2006)
Zyskowski, K., Morris, M., Bigham, J., Gray, M., Kane, S.: Accessible crowdwork? Understanding the value in and challenge of microtask employment for people with disabilities. In: Proceedings of the 18th ACM Conference on Computer-Supported Cooperative Work & Social Computing, CSCW 2015, pp. 1682–1693 (2015)
Acknowledgments
This work was partially supported by JST CREST Grant Number JPMJCR16E3 and JSPS KAKENHI Grant Number 17K20022, Japan.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Zhong, Y., Matsubara, M., Kobayashi, M., Morishima, A. (2020). Effects of Cognitive Consistency in Microtask Design with only Auditory Information. In: Antona, M., Stephanidis, C. (eds) Universal Access in Human-Computer Interaction. Applications and Practice. HCII 2020. Lecture Notes in Computer Science(), vol 12189. Springer, Cham. https://doi.org/10.1007/978-3-030-49108-6_33
Download citation
DOI: https://doi.org/10.1007/978-3-030-49108-6_33
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-49107-9
Online ISBN: 978-3-030-49108-6
eBook Packages: Computer ScienceComputer Science (R0)