skip to main content
10.1145/3377325.3377529acmconferencesArticle/Chapter ViewAbstractPublication PagesiuiConference Proceedingsconference-collections
short-paper

An analytical framework for formulating metrics for evaluating multi-dimensional time-series data

Published: 17 March 2020 Publication History

Abstract

This paper proposes a visual analytics framework for formulating metrics for evaluating multi-dimensional time-series data. Multidimensional time-series data has been collected and utilized in different domains. We believe evaluation metrics play an important role in utilizing those data, such as decision making and labeling training data used in machine learning. However, it is a difficult task for even domain experts to formulate metrics. To support the process of formulating metrics, the proposed framework represents metrics as a linear combination of data attributes, and provides a means for formulating it through interactive data exploration. A prototype interface that visualizes target data as an animated scatter plot was implemented. Through this interface, several visualized objects can be directly manipulated: a node and a trajectory of an instance, and a convex hull as the group of nodes and trajectories. Linear combinations of attributes are adjusted in accordance with the manipulation of different objects' types by the user. The effectiveness of the proposed framework was demonstrated through two application examples with real-world data.

References

[1]
Wolfgang Aigner, Silvia Miksch, Wolfgang Müller, Heidrun Schumann, and Christian Tominski. 2007. Visualizing Time-Oriented Data - A Systematic View. Computers & Graphics 31, 3 (2007), 401--409.
[2]
Jim Albert. 2010. Sabermetrics: The Past, the Present, and the Future. In Mathematics and Sports, Joseph A. Gallian (Ed.). Mathematical Association of America, 3--14.
[3]
Richard Arias-Hernandez, Linda T. Kaastra, Tara M. Green, and Brian Fisher. 2011. Pair Analytics: Capturing Reasoning Processes in Collaborative Visual Analytics. In Proceedings of 44th Hawaii International Conference on System Sciences (HICSS '11). 1--10.
[4]
Jürgen Bernard, David Sessler, Tobias Ruppert, James Davey, Arjan Kuijper, and Jörn Kohlhammer. 2014. User-Based Visual-Interactive Similarity Definition for Mixed Data Objects - Concept and First Implementation. In Proceedings of 22nd International Conference in Central Europe on Computer Graphics, Visualization and Computer Vision (WSCG'14). 329--338.
[5]
Albert C. Chen and Xin Fu. 2017. Data + Intuition: A Hybrid Approach to Developing Product North Star Metrics. In Proceedings of the 26th International Conference on World Wide Web Companion (WWW'17). International World Wide Web Conferences Steering Committee, 617--625.
[6]
Alex Endert. 2014. Semantic Interaction for Visual Analytics: Toward Coupling Cognition and Computation. IEEE Computer Graphics and Applications 34, 4 (2014), 8--15.
[7]
Alex Endert, Remco Chang, Chris North, and Michelle Zhou. 2015. Semantic Interaction: Coupling Cognition and Computation through Usable Interactive Analytics. IEEE Computer Graphics and Applications 35, 4 (2015), 94--99.
[8]
Michael Gleicher. 2013. Explainers: Expert Explorations with Crafted Projections. IEEE Transactions on Visualization and Computer Graphics 19, 12 (2013), 2042--2051.
[9]
John F. Helliwell, Richard Layard, and Jeffrey D. Sachs. 2018. World Happiness Report 2018. https://worldhappiness.report/ed/2018/.
[10]
John F. Helliwell, Richard Layard, and Jeffrey D.Sachs. last modified in 2019. World Happiness Report. Retrieved Sep 20, 2019 from https://worldhappiness.report
[11]
Daniel A. Keim, Florian Mansmann, Jörn Schneidewind, Jim Thomas, and Hartmut Ziegler. 2008. Visual Analytics: Scope and Challenges. In Visual Data Mining: Theory, Techniques and Tools for Visual Analytics, Simeon J. Simoff, Michael H. Böhlen, and Arturas Mazeika (Eds.). Springer, 76--90.
[12]
Hannah Kim, Jaegul Choo, Haesun Park, and Alex Endert. 2016. InterAxis: Steering Scatterplot Axes via Observation-Level Interaction. IEEE Transactions on Visualization and Computer Graphics 22, 1 (2016), 131--140.
[13]
Brittany Kondo and Christopher Collins. 2014. DimpVis: Exploring Time-varying Information Visualizations by Direct Manipulation. IEEE Transactions on Visualization and Computer Graphics 20, 12 (2014), 2003--2012.
[14]
Simone Kriglstein, Margit Pohl, and Michael Smuc. 2014. Pep Up Your Time Machine: Recommendations for the Design of Information Visualizations of Time-Dependent Data. In Handbook of Human Centric Visualization, Weidong Huang (Ed.). Springer New York, New York, NY, 203--225.
[15]
Sports Reference LLC. last modified in 2019. Baseball-Reference.com - Major League Statistics and Information. Retrieved Sep 20, 2019 from https://www.baseball-reference.com/
[16]
Dominik Sacha, Michael Sedlmair, Leishi Zhang, John A. Lee, Jaakko Peltonen, Daniel Weiskopf, Stephen C. North, and Daniel A. Keim. 2017. What You See is What You Can Change: Human-Centered Machine Learning by Interactive Visualization. Neurocomputing 268 (2017), 164 -- 175.
[17]
Dominik Sacha, Leishi Zhang, Michael Sedlmair, John A. Lee, Jaakko Peltonen, Daniel Weiskopf, Stephen C. North, and Daniel A. Keim. 2017. Visual Interaction with Dimensionality Reduction: A Structured Literature Analysis. IEEE Transactions on Visualization and Computer Graphics 23, 1 (2017), 241--250.
[18]
Tobias Schreck and Christian Panse. 2007. A New Metaphor for Projection-based Visual Analysis and Data Exploration. In Visualization and Data Analysis 2007. International Society for Optics and Photonics, 64950L.
[19]
Emily Wall, Subhajit Das, Ravish Chawla, Bharath Kalidindi, Eli T. Brown, and Alex Endert. 2018. Podium: Ranking Data Using Mixed-Initiative Visual Analytics. IEEE Transactions on Visualization and Computer Graphics 24, 1 (2018), 288--297.

Cited By

View all
  • (2021)A Visual Analytics Interface for Formulating Evaluation Metrics of Multi-Dimensional Time-Series DataIEEE Access10.1109/ACCESS.2021.30986219(102783-102800)Online publication date: 2021

Index Terms

  1. An analytical framework for formulating metrics for evaluating multi-dimensional time-series data

      Recommendations

      Comments

      Information & Contributors

      Information

      Published In

      cover image ACM Conferences
      IUI '20: Proceedings of the 25th International Conference on Intelligent User Interfaces
      March 2020
      607 pages
      ISBN:9781450371186
      DOI:10.1145/3377325
      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Sponsors

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 17 March 2020

      Permissions

      Request permissions for this article.

      Check for updates

      Author Tags

      1. dimensionality reduction
      2. evaluation metrics
      3. semantic interaction
      4. time-series data
      5. visual analytics

      Qualifiers

      • Short-paper

      Conference

      IUI '20
      Sponsor:

      Acceptance Rates

      Overall Acceptance Rate 746 of 2,811 submissions, 27%

      Upcoming Conference

      IUI '25

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)8
      • Downloads (Last 6 weeks)1
      Reflects downloads up to 01 Mar 2025

      Other Metrics

      Citations

      Cited By

      View all
      • (2021)A Visual Analytics Interface for Formulating Evaluation Metrics of Multi-Dimensional Time-Series DataIEEE Access10.1109/ACCESS.2021.30986219(102783-102800)Online publication date: 2021

      View Options

      Login options

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      Figures

      Tables

      Media

      Share

      Share

      Share this Publication link

      Share on social media