ABSTRACT
At CHI2011 we ran a panel on how the CHI community handles the replicability of research and the reproducibility of findings. Careful scientific scholarship should build on firm foundations, which includes re-examining old evidences in the face of new findings. Yet, as a community that strives for novelty, we have very little motivation to look back and reconsider the validity of previous work. Thus, for CHI2013 we are planning a new venue, where replicated studies can be submitted, presented, and discussed. For CHI2012, we propose a SIG to discuss the preparations for how RepliCHI will work in its first year. We invite participation from those interested in setting an agenda for facilitating replication in HCI, including those who have begun using replication as a teaching method since RepliCHI at CHI2011.
- Buie, E. A. and Jain, J., CHI 2011 user experience community SIG: the role of UX work in SIGCHI. In Ext. Abstracts CHI'11 (SIG), 687--688. 2011. Google ScholarDigital Library
- Cleverdon, C. W., Mills, J. and Keen, M. Factors determining the performance of indexing systems. Aslib Cranfield Research Project, Cranfield, England, 1966.Google Scholar
- Freese, J., Replication Standards for Quantitative Social Science. Sociological Methods & Research, 36(2), 153--172. 2007.Google Scholar
- Harman, D. K., The TREC conferences. Morgan Kaufmann Multimedia Information And Systems Series 247--256. 1997. Google ScholarDigital Library
- Jones, R., Kumar, R., Pang, B. and Tomkins, A., "I know what you did last summer": query logs and user privacy. In Proc. CIKM'07, ACM, 909--914. 2007. Google ScholarDigital Library
- King, G., Replication, Replication. PS: Political Science and Politics, 28(3), 444--452. 1995.Google ScholarCross Ref
- Medlock, M., Wixon, D., Terrano, M., Romero, R. and Fulton, B., Using the RITE method to improve products; a definition and a case study. In Usability Professionals Association. 2002.Google Scholar
- Wilson, M. L., Mackay, W., Chi, E., Bernstein, M., Russell, D. and Thimbleby, H., RepliCHI - CHI should be replicating and validating results more: discuss. In Ext. Abstracts CHI'11, 463--466. 2011. Google ScholarDigital Library
Index Terms
RepliCHI SIG: from a panel to a new submission venue for replication
Recommendations
RepliCHI - CHI should be replicating and validating results more: discuss
CHI EA '11: CHI '11 Extended Abstracts on Human Factors in Computing SystemsThe replication of research findings is a cornerstone of good science. Replication confirms results, strengthens research, and makes sure progress is based on solid foundations. CHI, however, rewards novelty and is focused on new results. As a community,...
RepliCHI: the workshop II
CHI EA '14: CHI '14 Extended Abstracts on Human Factors in Computing SystemsThe replication or recreation of research is a core part of many disciplines. Yet unlike many other disciplines, like medicine, physics, or mathematics, we have almost no drive and barely any reason to consider investigating the work of other HCI ...
CCI SIG: Interactive Childhood - Crossing Cultures and Continents
CHI EA '15: Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing SystemsChild Computer Interaction is a community within CHI that has been steadily growing. It hosts its own annual IDC conference and is a highly recognizable and vibrant contributor to the ACM CHI conference. In 2015, the CCI SIG aims to take advantage of ...
Comments