Cited By
View all- Munoz Rivas ADavis HPedell S(2025)The People and the Fire Tree: Co-Designing a Bushfire Early Warning System to Meet the Sustainable Development GoalsUrban Planning10.17645/up.912510Online publication date: 27-Jan-2025
…and That's What Gets Results: HCI Methods in OzCHI Publications
Pages 144 - 152
Abstract
What is HCI as a discipline? There is little data available on the analytical and methodological practices of the HCI community, particularly in generalist venues. This paper builds on recent research that has started to examine OzCHI as an HCI venue. While other examinations of HCI venues have considered the relative popularity of research topics and themes, we examine the methods being adopted by OzCHI authors. This is the first paper for over a decade to examine the methodologies being used at an HCI venue. We present a description of the relative balance of qualitative and quantitative work at OzCHI, and a close examination of the relative prevalence of a range of research methods. We also examine the relationships between analytical approach and gender, geography and—relying on recent changes to OzCHI—paper length. We find that the qualitative-quantitative split is not gender neutral, and has impact on page length of a paper, but is not affected by geography. Drawing on these insights we provide advice and guidance for future OzCHI organisers, and a research agenda for better understanding HCI as a discipline.
References
[1]
1964. Jacobellis v. Ohio, 378 U.S. 184 (1964) U.S. Supreme Court.
[2]
Adams, A., Lunt, P., and Cairns, P., 2008. A qualititative approach to HCI research. In Research Methods in HCI Cambridge University Press.
[3]
Andersen, J.P., Nielsen, M.W., Simone, N.L., Lewiss, R.E., and Jagsi, R., 2020. COVID-19 medical papers have fewer women first authors than expected. eLife 9(2020/06/15), e58807. DOI= http://doi.org/10.7554/eLife.58807.
[4]
Bartneck, C. and Hu, J., 2009. Scientometric analysis of the CHI proceedings. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems Association for Computing Machinery, 699–708. DOI= http://dx.doi.org/10.1145/1518701.1518810.
[5]
Dix, A., Finlay, J., Abowd, G.D., and Beale, R., 2003. Human-computer interaction. Pearson Education.
[6]
Early, K., Hammer, J., Hofmann, M.K., Rode, J.A., Wong, A., and Mankoff, J., 2018. Understanding Gender Equity in Author Order Assignment. Proc. ACM Hum.-Comput. Interact. 2, CSCW, Article 46. DOI= http://doi.org/10.1145/3274315.
[7]
Fernandes, J.M., Costa, A., and Cortez, P., 2021. Author placement in Computer Science: a study based on the careers of ACM Fellows. Scientometrics(2021/05/23). DOI= http://doi.org/10.1007/s11192-021-04035-5.
[8]
Keyes, O., 2018. The Misgendering Machines: Trans/HCI Implications of Automatic Gender Recognition. Proc. ACM Hum.-Comput. Interact. 2, CSCW, Article 88. DOI= http://doi.org/10.1145/3274357.
[9]
King, M.M. and Frederickson, M.E., 2021. The Pandemic Penalty: The Gendered Effects of COVID-19 on Scientific Productivity. Socius 7(2021/01/01), 23780231211006977. DOI= http://doi.org/10.1177/23780231211006977.
[10]
Kjeldskov, J. and Paay, J., 2012. A longitudinal review of Mobile HCI research methods. In Proceedings of the Proceedings of the 14th international conference on Human-computer interaction with mobile devices and services (San Francisco, California, USA, 2012), Association for Computing Machinery, 69–78. DOI= http://dx.doi.org/10.1145/2371574.2371586.
[11]
Koumaditis, K. and Hussain, T., 2017. Human Computer Interaction Research Through the Lens of a Bibliometric Analysis. In Human-Computer Interaction. User Interface Design, Development and Multimodality, M. Kurosu Ed. Springer International Publishing, Cham, 23-37.
[12]
Krukowski, R.A., Jagsi, R., and Cardel, M.I., 2020. Academic Productivity Differences by Gender and Child Age in Science, Technology, Engineering, Mathematics, and Medicine Faculty During the COVID-19 Pandemic. Journal of Women's Health 30, 3 (2021/03/01), 341-347. DOI= http://doi.org/10.1089/jwh.2020.8710.
[13]
Lazar, J., Feng, J.H., and Hochheiser, H., 2017. Research methods in human-computer interaction. Morgan Kaufmann.
[14]
Liu, Y., Goncalves, J., Ferreira, D., Xiao, B., Hosio, S., and Kostakos, V., 2014. CHI 1994-2013: mapping two decades of intellectual progress through co-word analysis. In Proceedings of the Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Toronto, Ontario, Canada, 2014), Association for Computing Machinery, 3553–3562. DOI= http://dx.doi.org/10.1145/2556288.2556969.
[15]
Mannocci, A., Osborne, F., and Motta, E., 2019. The evolution of IJHCS and CHI: A quantitative analysis. International Journal of Human-Computer Studies 131(2019/11/01/), 23-40. DOI= https://doi.org/10.1016/j.ijhcs.2019.05.009.
[16]
McKay, D. and Buchanan, G., 2019. Shaking the Tree: Understanding Historic and Future Representation of Women at OzCHI. In (2019), 412-417. DOI= http://dx.doi.org/10.1145/3369457.3369504.
[17]
McKay, D. and Buchanan, G., 2020. Feed the Tree: Representation of Australia-based Academic Women at HCI Conferences. In Proceedings of the 32nd Australian Conference on Human-Computer Interaction (Sydney, NSW, Australia, 2020), Association for Computing Machinery, 263–269. DOI= http://dx.doi.org/10.1145/3441000.3441061.
[18]
McKay, D., Zhang, H., and Buchanan, G., 2022. Who am I, and who are you, and who are we? A Scientometric Analysis of Gender and Geography in HCI. In Proceedings of the ACM Conference on Computer-Human Interaction (SIGCHI) (New Orleans, 2022), ACM Press.
[19]
Meho, L.I. and Rogers, Y., 2008. Citation counting, citation ranking, and h-index of human-computer interaction researchers: A comparison of Scopus and Web of Science. Journal of the American Society for Information Science and Technology 59, 11 (2008/09/01), 1711-1726. DOI= https://doi.org/10.1002/asi.20874.
[20]
Mubin, O., Al Mahmud, A., and Ahmad, M., 2017. HCI down under: reflecting on a decade of the OzCHI conference. Scientometrics 112, 1 (2017/07/01), 367-382. DOI= http://doi.org/10.1007/s11192-017-2293-2.
[21]
Mubin, O., Tejlavwala, D., Arsalan, M., Ahmad, M., and Simoff, S., 2018. An assessment into the characteristics of award winning papers at CHI. Scientometrics 116, 2 (2018/08/01), 1181-1201. DOI= http://doi.org/10.1007/s11192-018-2778-7.
[22]
Nichols, D.M. and Cunningham, S.J., 2015. A scientometric analysis of 15 years of CHINZ conferences. In Proceedings of the Proceedings of the 15th New Zealand Conference on Human-Computer Interaction (Hamilton, New Zealand, 2015), Association for Computing Machinery, 73–80. DOI= http://dx.doi.org/10.1145/2808047.2808060.
[23]
Padilla, S., Methven, T.S., and Chantler, M.J., 2014. Is British HCI Important? A topic-based comparison with CHI. In Proceedings of the Proceedings of the 28th International BCS Human Computer Interaction Conference on HCI 2014 - Sand, Sea and Sky - Holiday HCI (Southport, UK, 2014), BCS, 365–370. DOI= http://dx.doi.org/10.14236/ewic/hci2014.35.
[24]
Pinho-Gomes, A.-C., Peters, S., Thompson, K., Hockham, C., Ripullone, K., Woodward, M., and Carcel, C., 2020. Where are the women? Gender inequalities in COVID-19 research authorship. BMJ Global Health 5, 7, e002922. DOI= http://doi.org/10.1136/bmjgh-2020-002922.
[25]
Power, K., 2020. The COVID-19 pandemic has increased the care burden of women and families. Sustainability: Science, Practice and Policy 16, 1 (2020/12/10), 67-73. DOI= http://doi.org/10.1080/15487733.2020.1776561.
[26]
Pratt, M.G., 2007. Fitting Oval Pegs Into Round Holes: Tensions in Evaluating and Publishing Qualitative Research in Top-Tier North American Journals. Organizational Research Methods 11, 3 (2008/07/01), 481-509. DOI= http://doi.org/10.1177/1094428107303349.
[27]
Pratt, M.G. and Bonaccio, S., 2016. Qualitative Research in I-O Psychology: Maps, Myths, and Moving Forward. Industrial and Organizational Psychology 9, 4, 693-715. DOI= http://doi.org/10.1017/iop.2016.92.
[28]
Preece, J., Sharp, H., and Rogers, Y., 2015. Interaction Design. Wiley.
[29]
Sandnes, F.E., 2021. A bibliometric study of human–computer interaction research activity in the Nordic-Baltic Eight countries. Scientometrics 126, 6 (2021/06/01), 4733-4767. DOI= http://doi.org/10.1007/s11192-021-03940-z.
[30]
Sharp, H., Preece, J., and Rogers, Y., 2019. Interaction Design. Wiley.
[31]
Sidhu, K., Jones, R., and Stevenson, F., 2017. Publishing qualitative research in medical journals. British Journal of General Practice 67, 658, 229. DOI= http://doi.org/10.3399/bjgp17X690821.
[32]
Soegaard, M. and Dam, R.F., 2014. Encyclopedia of human computer interaction. Interaction Design Foundation.
[33]
Tomkins, A., Zhang, M., and Heavlin, W.D., 2017. Reviewer bias in single- versus double-blind peer review. Proceedings of the National Academy of Sciences 114, 48, 12708. DOI= http://doi.org/10.1073/pnas.1707323114.
[34]
Wang, D. and Xu, Z., 2020. Bibliometric analysis of the core thesis system of Interaction Design Research on Human-Computer Interaction. In 2020 International Conference on Big Data and Social Sciences (ICBDSS), 101-105. DOI= http://doi.org/10.1109/ICBDSS51270.2020.00031.
[35]
Wang, L.L., Mack, K., McDonnell, E.J., Jain, D., Findlater, L., and Froehlich, J.E., 2021. A bibliometric analysis of citation diversity in accessibility and HCI research. In Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems Association for Computing Machinery, Article 448. DOI= http://dx.doi.org/10.1145/3411763.3451618.
[36]
Wang, L.L., Stanovsky, G., Weihs, L., and Etzioni, O., 2021. Gender trends in computer science authorship. Commun. ACM 64, 3, 78–84. DOI= http://doi.org/10.1145/3430803.
[37]
Way, S.F., Larremore, D.B., and Clauset, A., 2016. Gender, Productivity, and Prestige in Computer Science Faculty Hiring Networks. In Proceedings of the Proceedings of the 25th International Conference on World Wide Web (Montréal, Québec, Canada, 2016), International World Wide Web Conferences Steering Committee, 1169–1179. DOI= http://dx.doi.org/10.1145/2872427.2883073.
[38]
West, J.D., Jacquet, J., King, M.M., Correll, S.J., and Bergstrom, C.T., 2013. The role of gender in scholarly authorship. PLOS ONE 8, 7, e66212.
[39]
Xie, J., Gong, K., Cheng, Y., and Ke, Q., 2019. The correlation between paper length and citations: a meta-analysis. Scientometrics 118, 3 (2019/03/01), 763-786. DOI= http://doi.org/10.1007/s11192-019-03015-0.
[40]
Zhang, P. and Li, N., 2004. An assessment of human–computer interaction research in management information systems: topics and methods. Computers in Human Behavior 20, 2 (2004/03/01/), 125-147. DOI= https://doi.org/10.1016/j.chb.2003.10.011.
Index Terms
- …and That's What Gets Results: HCI Methods in OzCHI Publications
Recommendations
A theoretical agenda for feminist HCI
HCI has a complex and often ambivalent attitude towards the issue of gender and interactive systems. Here I discuss three dominant paradigms for treating gender in HCI, and discuss their limitations. Next, I will present the theoretical perspectives on ...
Feminist HCI: taking stock and outlining an agenda for design
CHI '10: Proceedings of the SIGCHI Conference on Human Factors in Computing SystemsFeminism is a natural ally to interaction design, due to its central commitments to issues such as agency, fulfillment, identity, equity, empowerment, and social justice. In this paper, I summarize the state of the art of feminism in HCI and propose ...
Incommensurable Writings - Examining the Status of Gender Difference Within HCI Coding Practices
Proceedings, Part II, of the 4th International Conference on Design, User Experience, and Usability: Users and Interactions - Volume 9187Gender relations are reproduced both within HCI development processes as well as within contexts of use. Hence, theorising the subject of gender becomes part of the responsibility of HCI as a form of practice. The fledgling subfield of feminist HCI has ...
Comments
Information & Contributors
Information
Published In
November 2021
361 pages
ISBN:9781450395984
DOI:10.1145/3520495
Copyright © 2021 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 15 September 2022
Check for updates
Author Tags
Qualifiers
- Research-article
- Research
- Refereed limited
Conference
OzCHI '21
OzCHI '21: 33rd Australian Conference on Human-Computer Interaction
November 30 - December 2, 2021
VIC, Melbourne, Australia
Acceptance Rates
Overall Acceptance Rate 362 of 729 submissions, 50%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- View Citations1Total Citations
- 58Total Downloads
- Downloads (Last 12 months)25
- Downloads (Last 6 weeks)3
Reflects downloads up to 05 Mar 2025
Other Metrics
Citations
Cited By
View all- Munoz Rivas ADavis HPedell S(2025)The People and the Fire Tree: Co-Designing a Bushfire Early Warning System to Meet the Sustainable Development GoalsUrban Planning10.17645/up.912510Online publication date: 27-Jan-2025
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign inFull Access
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderHTML Format
View this article in HTML Format.
HTML Format