skip to main content
10.1145/2325296.2325372acmconferencesArticle/Chapter ViewAbstractPublication PagesiticseConference Proceedingsconference-collections
research-article

User interface evaluation by novices

Published:03 July 2012Publication History

ABSTRACT

This study examines the extent to which novice computing students with minimal computer science coursework and no training in user interface (UI) evaluation consider UI concepts such as usability, user experience, and the context in which software will be used when evaluating an interface. In analyzing the responses of 149 novice computer science students who were asked to evaluate two interfaces for converting temperatures between Fahrenheit and Celsius, we observed that students generally considered usability and user experience factors, but were less likely to consider context. For educators, this exact task could be given to a class in order to initiate discussion of user-centered design; the study also provides a framework for structuring the discussion. More generally, the results of this study provide insight into some opportunities and challenges in teaching good interface design and evaluation skills.

References

  1. Ben-Ari, M. Constructivism in computer science education. Journal of Computers in Mathematics and Science Teaching, 20(1):45--73, 2001. Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. Bransford, J. D., Brown, A. L., and Cocking, R. R., editors. How People Learn: Brain, Mind, Experience, and School. National Academy Press, Washington, DC, expanded edition, 2000.Google ScholarGoogle Scholar
  3. Bruner, J. The process of education. Harvard University Press, Cambridge, MA, 1960.Google ScholarGoogle Scholar
  4. Chen, T.-Y., Lewandowski, G., McCartney, R., Sanders K., and Simon, B. Commonsense computing: using student sorting abilities to improve instruction. In Proc. SIGCSE '07, ACM Press (2007), 276--280. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Jeffries, R., Miller, J. R., Wharton, C., and Uyeda, K. User interface evaluation in the real world: a comparison of four techniques. In Proc. CHI '91, ACM Press (1991), 119--124. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Lewandowski, G., Bouvier, D., Chen, T.-Y., McCartney, R., Sanders, K., Simon, B., and VanDeGrift, T. Commonsense understanding of concurrency: computing students and concert tickets. Communications of the ACM, 53(7): 60--70, 2010. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. McCartney, R., Bouvier, D., Chen, T.-Y., Lewandowski, G., Sanders, K., Simon, B., and VanDeGrift, T. Commonsense computing (episode 5): algorithm efficiency and balloon testing. In Proc. ICER '09, ACM Press (2009), 51--62. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Nielsen, J. and Molich, R. Heuristic evaluation of user interfaces. In Proc. CHI '90, ACM Press (1990), 249--256. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Perkins, D. The many faces of constructivism, Educational Leadership 57(3):6--11, 1999.Google ScholarGoogle Scholar
  10. Raskin, J. The Humane Interface: New Directions for Designing Interactive Systems. Addison-Wesley Professional, 2000. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. Schwill, A. Fundamental ideas of computer science. Bull. European Association for Theoretical Computer Science, 53:274--295, 1994.Google ScholarGoogle Scholar
  12. Sharp, H., Rogers, Y., and Preece, J. Interaction Design: beyond human-computer interaction, 2nd edition. Wiley, 2007. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. Simon, B., Bouvier, D., Chen, T.-Y., Lewandowski, G., McCartney, R., and Sanders, K. Commonsense computing (episode 4): Debugging. Computer Science Education, 18(2):117--133, 2008.Google ScholarGoogle ScholarCross RefCross Ref
  14. Simon, B., Chen, T.-Y., Lewandowski, G., McCartney, R., and Sanders, K. Commonsense computing: what students know before we teach (episode 1: sorting). In Proc. ICER '06, ACM Press (2006), 29--40. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Zander, C., Boustedt, J., McCartney, R., Mostrom, J.-E., Sanders, K., and Thomas, L. Student transformations: are they computer scientists yet? In Proc. ICER '09, ACM Press (2009), 129--140.. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. User interface evaluation by novices

      Recommendations

      Comments

      Login options

      Check if you have access through your login credentials or your institution to get full access on this article.

      Sign in
      • Published in

        cover image ACM Conferences
        ITiCSE '12: Proceedings of the 17th ACM annual conference on Innovation and technology in computer science education
        July 2012
        424 pages
        ISBN:9781450312462
        DOI:10.1145/2325296

        Copyright © 2012 ACM

        Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        • Published: 3 July 2012

        Permissions

        Request permissions about this article.

        Request Permissions

        Check for updates

        Qualifiers

        • research-article

        Acceptance Rates

        Overall Acceptance Rate552of1,613submissions,34%

        Upcoming Conference

        ITiCSE 2024

      PDF Format

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader