skip to main content
10.1145/2212776.2212419acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
extended-abstract

RepliCHI SIG: from a panel to a new submission venue for replication

Authors Info & Claims
Published:05 May 2012Publication History

ABSTRACT

At CHI2011 we ran a panel on how the CHI community handles the replicability of research and the reproducibility of findings. Careful scientific scholarship should build on firm foundations, which includes re-examining old evidences in the face of new findings. Yet, as a community that strives for novelty, we have very little motivation to look back and reconsider the validity of previous work. Thus, for CHI2013 we are planning a new venue, where replicated studies can be submitted, presented, and discussed. For CHI2012, we propose a SIG to discuss the preparations for how RepliCHI will work in its first year. We invite participation from those interested in setting an agenda for facilitating replication in HCI, including those who have begun using replication as a teaching method since RepliCHI at CHI2011.

References

  1. Buie, E. A. and Jain, J., CHI 2011 user experience community SIG: the role of UX work in SIGCHI. In Ext. Abstracts CHI'11 (SIG), 687--688. 2011. Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. Cleverdon, C. W., Mills, J. and Keen, M. Factors determining the performance of indexing systems. Aslib Cranfield Research Project, Cranfield, England, 1966.Google ScholarGoogle Scholar
  3. Freese, J., Replication Standards for Quantitative Social Science. Sociological Methods & Research, 36(2), 153--172. 2007.Google ScholarGoogle Scholar
  4. Harman, D. K., The TREC conferences. Morgan Kaufmann Multimedia Information And Systems Series 247--256. 1997. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Jones, R., Kumar, R., Pang, B. and Tomkins, A., "I know what you did last summer": query logs and user privacy. In Proc. CIKM'07, ACM, 909--914. 2007. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. King, G., Replication, Replication. PS: Political Science and Politics, 28(3), 444--452. 1995.Google ScholarGoogle ScholarCross RefCross Ref
  7. Medlock, M., Wixon, D., Terrano, M., Romero, R. and Fulton, B., Using the RITE method to improve products; a definition and a case study. In Usability Professionals Association. 2002.Google ScholarGoogle Scholar
  8. Wilson, M. L., Mackay, W., Chi, E., Bernstein, M., Russell, D. and Thimbleby, H., RepliCHI - CHI should be replicating and validating results more: discuss. In Ext. Abstracts CHI'11, 463--466. 2011. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. RepliCHI SIG: from a panel to a new submission venue for replication

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader