skip to main content
10.1145/1358628.1358955acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
technical-note

BELIV'08: Beyond time and errors: novel evaluation methods for information visualization

Published: 05 April 2008 Publication History

Abstract

Information visualization systems allow users to produce insights, innovations and discoveries. Evaluating such tools is a challenging task and the goal of BELIV'08 is to make a step ahead in the comprehension of such a complex activity. Current evaluation methods exhibit noticeable limitations and researchers in the area experiment some frustration with evaluation processes that are time consuming and too often leading to unsatisfactory results. The most used evaluation metrics such as task time completion and number of errors appear insufficient to quantify the quality of an information visualization system; thus the name of the workshop: "beyond time and errors".

References

[1]
Readings In Information Visualization: Using Vision to Think, Stuart K. Card, Jock D. Mackinlay, and Ben Shneiderman, Morgan Kaufmann Publishers, San Francisco
[2]
Purvi Saraiya, Chris North, Karen Duca, "An Insight-based Longitudinal Study of Visual Analytics", IEEE Transactions on Visualization and Computer Graphics, 12, 6 (Nov. 2006), 1511--1522.
[3]
Shneiderman. Creating creativity: user interfaces for supporting innovation. ACM Trans. Comput.-Hum. Interact. 7, 1 (Mar. 2000), 114--138.
[4]
Catherine Plaisant. The challenge of information visualization evaluation. In AVI'04: Proceedings of the working conference on Advanced visual interfaces, pages 109--116, New York, NY, USA, 2004. ACM Press.
[5]
Ginny Redish. Expanding Usability Testing to Evaluate Complex Systems. Journal of Usability Studies, 2, 3, (2007).
[6]
Jean Scholtz. Beyond usability: Evaluation aspects of visual analytic environments, Proceedings of the IEEE Symposium on Visual Analytics Science and Technology, pp. 145--150
[7]
Bertini, C. Plaisant, G. Santucci - BELIV '06: Beyond Time and Errors; Novel Evaluation Methods for Information Visualization - ACM interactions magazine May+June 2007

Cited By

View all
  • (2024)The Arrangement of Marks Impacts Afforded Messages: Ordering, Partitioning, Spacing, and Coloring in Bar ChartsIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2023.332659030:1(1008-1018)Online publication date: 1-Jan-2024
  • (2023)Improving Evaluation Using Visualization Decision-Making Models: A Practical GuideVisualization Psychology10.1007/978-3-031-34738-2_4(85-107)Online publication date: 7-Nov-2023
  • (2022)Visualization overview: Using modern text mining techniques to provide insight into visualization research practice2022 26th International Conference Information Visualisation (IV)10.1109/IV56949.2022.00026(104-113)Online publication date: Jul-2022
  • Show More Cited By

Index Terms

  1. BELIV'08: Beyond time and errors: novel evaluation methods for information visualization

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    CHI EA '08: CHI '08 Extended Abstracts on Human Factors in Computing Systems
    April 2008
    2035 pages
    ISBN:9781605580128
    DOI:10.1145/1358628
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 05 April 2008

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. evaluation
    2. information visualization

    Qualifiers

    • Technical-note

    Conference

    CHI '08
    Sponsor:

    Acceptance Rates

    Overall Acceptance Rate 6,164 of 23,696 submissions, 26%

    Upcoming Conference

    CHI 2025
    ACM CHI Conference on Human Factors in Computing Systems
    April 26 - May 1, 2025
    Yokohama , Japan

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)8
    • Downloads (Last 6 weeks)0
    Reflects downloads up to 16 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)The Arrangement of Marks Impacts Afforded Messages: Ordering, Partitioning, Spacing, and Coloring in Bar ChartsIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2023.332659030:1(1008-1018)Online publication date: 1-Jan-2024
    • (2023)Improving Evaluation Using Visualization Decision-Making Models: A Practical GuideVisualization Psychology10.1007/978-3-031-34738-2_4(85-107)Online publication date: 7-Nov-2023
    • (2022)Visualization overview: Using modern text mining techniques to provide insight into visualization research practice2022 26th International Conference Information Visualisation (IV)10.1109/IV56949.2022.00026(104-113)Online publication date: Jul-2022
    • (2019)Health timeline: an insight-based study of a timeline visualization of clinical dataBMC Medical Informatics and Decision Making10.1186/s12911-019-0885-x19:1Online publication date: 22-Aug-2019
    • (2018)Interpretive Impacts of Text VisualizationACM Transactions on Computer-Human Interaction10.1145/321435325:4(1-26)Online publication date: 9-Aug-2018
    • (2017)The goods, the bads and the uglies: Supporting decisions in malware detection through visual analytics2017 IEEE Symposium on Visualization for Cyber Security (VizSec)10.1109/VIZSEC.2017.8062199(1-8)Online publication date: Oct-2017
    • (2017)CRUMBS: A cyber security framework browser2017 IEEE Symposium on Visualization for Cyber Security (VizSec)10.1109/VIZSEC.2017.8062194(1-8)Online publication date: Oct-2017
    • (2016)A Survey on Interaction Log Analysis for Evaluating Exploratory VisualizationsProceedings of the Sixth Workshop on Beyond Time and Errors on Novel Evaluation Methods for Visualization10.1145/2993901.2993912(62-69)Online publication date: 24-Oct-2016
    • (2014)Using Metrics of Curation to Evaluate Information-Based IdeationACM Transactions on Computer-Human Interaction10.1145/259167721:3(1-48)Online publication date: 30-Jun-2014
    • (2013)Evaluation methods for creativity support environmentsCHI '13 Extended Abstracts on Human Factors in Computing Systems10.1145/2468356.2479670(3295-3298)Online publication date: 27-Apr-2013
    • Show More Cited By

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media