skip to main content
10.1145/1028014.1028072acmotherconferencesArticle/Chapter ViewAbstractPublication PagesnordichiConference Proceedingsconference-collections
Article

Proportional search interface usability measures

Published: 23 October 2004 Publication History

Abstract

Speed, accuracy, and subjective satisfaction are the most common measures for evaluating the usability of search user interfaces. However, these measures do not facilitate comparisons optimally and they leave some important aspects of search user interfaces uncovered. We propose new, proportional measures to supplement the current ones. <i>Search speed</i> is a normalized measure for the speed of a search user interface expressed in answers per minute. <i>Qualified search speed</i> reveals the trade-off between speed and accuracy while <i>immediate search accuracy</i> addresses the need to measure success in typical web search behavior where only the first few results are interesting. The proposed measures are evaluated by applying them to raw data from two studies and comparing them to earlier measures. The evaluations indicate that they have desirable features.

References

[1]
Dennis, S., Bruza, P., McArthur, R. Web Searching: A Process-Oriented Experimental Study of Three Interactive Search Paradigms. Journal of the American Society for Information Science and Technology, Vol. 53, No. 2, 2002, 120--133.
[2]
Dumais, S., Cutrell, E., Chen, H. Optimizing Search by Showing Results in Context. Proceedings of ACM CHI'01 (Seattle, USA), ACM Press, 2001, 277--284.
[3]
Frøkjær, E., Hertzum, M., Hornbæk, K. Measuring Usability: Are Effectiveness, Efficiency, and Satisfaction Really Correlated? Proceedings of ACM CHI'2000 (The Hague, Netherlands), ACM Press, 2000, 345--352.
[4]
ISO 9241--11: Ergonomic requirements for office work with visual display terminals (VDTs) - Part 11: Guidance on usability, International Organization for Standardization, March 1998.
[5]
Pirolli, P. and Card, S. Information Foraging. Psychological Review, 1999, Vol. 106, No. 4, 643--675.
[6]
Pirolli, P., Schank, P., Hearst, M., Diehl, C. Scatter/Gather Browsing Communicates the Topic Structure of a Very Large Text Collection. Proceedings of ACM CHI'96 (Vancouver, Canada), ACM Press, 1996, 213--220.
[7]
Pratt, W., Fagan, L. The Usefulness of Dynamically Categorizing Search Results. Journal of the American Medical Informatics Association, Vol. 7, No. 6, Nov/Dec 2000, 605--617.
[8]
Saracevic, T. Evaluation of Evaluation in Information Retrieval. Proceedings of ACM SIGIR'95 (Seattle, USA), ACM Press, 1995, 138--146.
[9]
Sebrechts, M., Vasilakis, J., Miller, M., Cugini, J., Laskowski, S. Visualization of Search Results: A Comparative Evaluation of Text, 2D, and 3D Interfaces. Proceedings of ACM SIGIR'99 (Berkeley, USA), ACM Press, 1999.
[10]
Shneiderman, B., Byrd, D., Croft, B. Clarifying Search: A User-Interface Framework for Text Searches. D-Lib Magazine, January 1997.
[11]
Spink, A., Wolfram, D., Jansen, M., and Saracevic, T.: Searching the Web: The Public and Their Queries. Journal of the American Society for Information Science and Technology, 2001, Vol. 52, No. 6, 226--234.
[12]
Veerasamy, A., Belkin, N. Evaluation of a Tool for Visualization of Information Retrieval Results. Proceedings of ACM SIGIR'96 (Zurich, Switzerland), ACM Press, 1996, 85--92.
[13]
Veerasamy, A., Heikes, R. Effectiveness of a Graphical Display of Retrieval Results. Proceedings of ACM SIGIR'97 (Philadelphia, USA), ACM Press, 1997, 236--244.
[14]
Zhai, S. On the validity of Throughput as a Characteristic of Computer Input. IBM Research Report, RJ 10253, IBM Research Division. August 2002.

Cited By

View all
  • (2010)Evaluating interfaces for government metasearchProceedings of the third symposium on Information interaction in context10.1145/1840784.1840796(65-74)Online publication date: 18-Aug-2010
  • (2009)An aspectual interface for supporting complex search tasksProceedings of the 32nd international ACM SIGIR conference on Research and development in information retrieval10.1145/1571941.1572007(379-386)Online publication date: 19-Jul-2009
  • (2008)Controlling the complexity in comparing search user interfaces via user studiesInformation Processing and Management: an International Journal10.1016/j.ipm.2007.02.00644:1(82-91)Online publication date: 1-Jan-2008
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences
NordiCHI '04: Proceedings of the third Nordic conference on Human-computer interaction
October 2004
472 pages
ISBN:1581138571
DOI:10.1145/1028014
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 23 October 2004

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. accuracy
  2. search user interface
  3. speed
  4. usability evaluation
  5. usability measure

Qualifiers

  • Article

Conference

NordiCHI04
NordiCHI04: NordiCHI 2004
October 23 - 27, 2004
Tampere, Finland

Acceptance Rates

Overall Acceptance Rate 379 of 1,572 submissions, 24%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)5
  • Downloads (Last 6 weeks)0
Reflects downloads up to 12 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2010)Evaluating interfaces for government metasearchProceedings of the third symposium on Information interaction in context10.1145/1840784.1840796(65-74)Online publication date: 18-Aug-2010
  • (2009)An aspectual interface for supporting complex search tasksProceedings of the 32nd international ACM SIGIR conference on Research and development in information retrieval10.1145/1571941.1572007(379-386)Online publication date: 19-Jul-2009
  • (2008)Controlling the complexity in comparing search user interfaces via user studiesInformation Processing and Management: an International Journal10.1016/j.ipm.2007.02.00644:1(82-91)Online publication date: 1-Jan-2008
  • (2007)Mobile findexProceedings of the 9th international conference on Human computer interaction with mobile devices and services10.1145/1377999.1378045(397-404)Online publication date: 9-Sep-2007
  • (2006) f KWIC: Frequency‐based keyword‐in‐context index for filtering Web search results Journal of the American Society for Information Science and Technology10.1002/asi.2033857:12(1606-1615)Online publication date: 8-Aug-2006
  • (2005)Optimizing the number of search result categoriesCHI '05 Extended Abstracts on Human Factors in Computing Systems10.1145/1056808.1056955(1517-1520)Online publication date: 2-Apr-2005
  • (2005)FindexInteracting with Computers10.1016/j.intcom.2005.01.00117:2(187-206)Online publication date: 1-Mar-2005

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media