Javier Fernández Serrano
ABSTRACT
Experimentation plays a major role in the development and validation of new theories in the field of human-computer interaction (HCI). In this paper, we address quantitative empirical studies, an approach that has become the standard methodology for conducting research in HCI. This research provides an in-depth review, gathering a representative and relatively extensive collection of primary studies. We aim to identify relevant research lines in HCI in which quantitative approaches have been employed in order to construct a consistent and comprehensive taxonomy of quantitative approaches and form a broad picture of the procedures, tools and techniques employed. A systematic mapping study methodology has been adopted to produce reliable results in a reproducible and agile manner.
- M. S. Andreasen, H. V. Nielsen, S. O. Schrø der, and J. Stage. What happened to remote usability testing? An Empirical Study of Three Methods. In Proceedings of the SIGCHI conference on Human factors in computing systems - CHI '07, page 1405, New York, New York, USA, Apr. 2007. ACM Press. Google Scholar
Digital Library
- D. Bolchini, F. Garzotto, and F. Sorce. Does Branding Need Web Usability? A Value-Oriented Empirical Study. In Proceedings of the 12th IFIP TC13 Conference on Human-Computer Interaction, pages 652--665. Springer-Verlag Berlin, 2009. Google ScholarDigital Library
- K. Browne and C. Anand. An empirical evaluation of user interfaces for a mobile video game. Entertainment Computing, 3(1):1--10, Jan. 2012.Google ScholarCross Ref
- D. Budgen, M. Turner, P. Brereton, and B. Kitchenham. Using Mapping Studies in Software Engineering. In Proceedings of the 20th Annual Workshop of the Psychology of Programming Interest Group (PPIG'08), volume 2, pages 195--204, Lancaster University, UK, 2008.Google Scholar
- A. G. Cass, C. S. T. Fernandes, and A. Polidore. An empirical evaluation of undo mechanisms. In Proceedings of the 4th Nordic conference on Human-computer interaction changing roles -NordiCHI '06, pages 19--27, New York, New York, USA, Oct. 2006. ACM Press. Google ScholarDigital Library
- J. W. Castro and S. T. Acuña. Differences between Traditional and Open Source Development Activities. In Proceedings of the 13th International Conference on Product-Focused Software Process Improvement, pages 131--144, 2012. Google ScholarDigital Library
- C. Conati and H. Maclaren. Empirically building and evaluating a probabilistic model of user affect. User Modeling and User-Adapted Interaction, 19(3):267--303, Jan. 2009. Google ScholarDigital Library
- G. Cortellessa, V. Giuliani, M. Scopelliti, and A. Cesta. Key Issues in Interactive Problem Solving: An Empirical Investigation on Users Attitude. In M. F. Costabile and F. Paternò, editors, Proceedings of the 10th IFIP TC13 International Conference on Human-Computer Interaction, volume 3585 of Lecture Notes in Computer Science, pages 657--670, Berlin, Heidelberg, Sept. 2005. Springer Berlin Heidelberg. Google ScholarDigital Library
- V. de Castro, M. Genero, E. Marcos, and M. Piattni. Empirical study to assess whether the use of routes facilitates the navigability of web information systems. IET Software, 5(6):528--542, 2011.Google ScholarCross Ref
- D. M. Dehn and S. Van Mulken. The impact of animated interface agents: a review of empirical research. International Journal of Human-Computer Studies, 52(1):1--22, Jan. 2000. Google ScholarDigital Library
- O. Dieste, N. Juristo, and M. D. Martínez. Software industry experiments: A systematic literature review. In Proceedings of the 1st International Workshop on Conducting Empirical Studies in Industry (CESI 2013), pages 2--8, 2013. Google ScholarDigital Library
- T. Dybå, V. B. Kampenes, and D. I. Sjøberg. A systematic review of statistical power in software engineering experiments. Information and Software Technology, 48(8):745--755, Aug. 2006.Google ScholarCross Ref
- X. Fang and C. W. Holsapple. An empirical study of web site navigation structures' impacts on web site usability. Decision Support Systems, 43(2):476--491, Mar. 2007. Google ScholarDigital Library
- F. Farhadi-Niaki, R. GhasemAghaei, and A. Arya. Empirical study of a vision-based depth-sensitive human-computer interaction system. In Proceedings of the 10th asia pacific conference on Computer human interaction - APCHI '12, pages 101--108, New York, New York, USA, Aug. 2012. ACM Press. Google ScholarDigital Library
- P. Germanakos, N. Tsianos, Z. Lekkas, C. Mourlas, M. Belk, and G. Samaras. Proposing Web Design Enhancements Based on Specific Cognitive Factors: An Empirical Evaluation. In 2009 IEEE/WIC/ACM International Joint Conference on Web Intelligence and Intelligent Agent Technology, pages 602--605. IEEE, Sept. 2009. Google ScholarDigital Library
- O. Grynszpan, J.-C. Martin, and J. Nadel. Multimedia interfaces for users with high functioning autism: An empirical investigation. International Journal of Human-Computer Studies, 66(8):628--639, Aug. 2008. Google ScholarDigital Library
- B. L. Harrison, G. Kurtenbach, and K. J. Vicente. An experimental evaluation of transparent user interface tools and information content. In Proceedings of the 8th Annual Symposium on User Interface Software and Technology, pages 81--90, 1995. Google ScholarDigital Library
- R. D. Johnson. An empirical investigation of sources of application-specific computer-self-efficacy and mediators of the efficacy-performance relationship. International Journal of Human-Computer Studies, 62(6):737--758, June 2005. Google ScholarDigital Library
- V. B. Kampenes, T. Dybå, J. E. Hannay, and D. I. Sjøberg. A systematic review of effect size in software engineering experiments. Information and Software Technology, 49(11-12):1073--1086, Nov. 2007. Google ScholarDigital Library
- D. J. Kim and C. K. Coursaris. A Meta-Analytical Review of Empirical Mobile Usability Studies. Journal of Usability Studies, 6(3):117--171, 2011. Google ScholarDigital Library
- J. Kim, J. Lee, and D. Choi. Designing emotionally evocative homepages: an empirical study of the quantitative relations between design factors and emotional dimensions. International Journal of Human-Computer Studies, 59(6):899--940, Dec. 2003. Google ScholarDigital Library
- B. Kitchenham. Procedures for Performing Systematic Reviews. Technical report, Keele University Technical Report TR/SE-0401 and NICTA Technical Report 0400011T.1, 2004.Google Scholar
- B. A. Kitchenham, S. L. Pfleeger, L. M. Pickard, P. W. Jones, D. C. Hoaglin, K. E. Emam, and J. Rosenberg. Preliminary Guidelines for Empirical Research in Software Engineering. IEEE Transactions on Software Engineering, 28(8):721--734, 2002. Google ScholarDigital Library
- T. Komatsu and S. Yamada. How Does the Agents' Appearance Affect Users' Interpretation of the Agents' Attitudes: Experimental Investigation on Expressing the Same Artificial Sounds From Agents With Different Appearances. International Journal of Human-Computer Interaction, 27(3):260--279, Feb. 2011.Google ScholarCross Ref
- M. L. A. Kunnath, R. A. Cornell, M. K. Kysilka, and L. Witta. An experimental research study on the effect of pictorial icons on a user-learner's performance. Computers in Human Behavior, 23(3):1454--1480, May 2007. Google ScholarDigital Library
- V. Tscherter, P. Ravasio, and S. Guttormsen-schär. The Qualitative Experiment in HCI: Definition, Occurrences, Value and Use. ACM Transactions on Computer-Human Interaction, V:1--24, 1986.Google Scholar
Index Terms
- A Review of Quantitative Empirical Approaches in Human-Computer Interaction
Recommendations
A Review of Augmented Reality-Based Human-Computer Interaction Applications of Gesture-Based Interaction
HCI International 2019 – Late Breaking PapersAbstractIn recent years, augmented reality (AR) is an extremely growing field in information technology, computer science, and computer engineering. Although there are many recent works that use augmented reality for different purposes, most of the ...
Introduction to Human-Computer Interaction
CHI EA '19: Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing SystemsThe objective of this course is to provide newcomers to Human-Computer Interaction (HCI) with an introduction and overview of the field. Attendees often include practitioners without a formal education in HCI, and those teaching HCI for the first time. ...
How is your user feeling? inferring emotion through human-computer interaction devices
Emotion can influence important user behaviors, including purchasing decisions, technology use, and customer loyalty. The ability to easily assess users' emotion during live system use therefore has practical significance for the design and improvement ...
Comments