skip to main content
10.1145/3002151.3002155acmconferencesArticle/Chapter ViewAbstractPublication Pagessiggraph-asiaConference Proceedingsconference-collections
research-article

Animated narrative visualization for video clickstream data

Published: 28 November 2016 Publication History

Abstract

Video clickstream data are important for understanding user behaviors and improving online video services. Various visual analytics techniques have been proposed to explore patterns in these data. However, those techniques are mainly developed for analysis and do not sufficiently support presentations. It is still difficult for data analysts to convey their findings to an audience without prior knowledge. In this paper, we propose to use animated narrative visualization to present video clickstream data. Compared with traditional methods which directly turn click events into animations, our animated narrative visualization focuses on conveying the patterns in the data to a general audience and adopts two novel designs, non-linear time mapping and foreshadowing, to make the presentation more engaging and interesting. Our non-linear time mapping method keeps the interesting parts as the focus of the animation while compressing the uninteresting parts as the context. The foreshadowing techniques can engage the audience and alert them to the events in the animation. Our user study indicates the effectiveness of our system and provides guidelines for the design of similar systems.

References

[1]
Aguiar, E., Nagrecha, S., and Chawla, N. V. 2015. Predicting online video engagement using clickstreams. In Data Science and Advanced Analytics (DSAA), 2015. 36678 2015. IEEE International Conference on, IEEE, 1--10.
[2]
Aigner, W., Miksch, S., Müller, W., Schumann, H., and Tominski, C. 2007. Visualizing time-oriented dataa systematic view. Computers & Graphics 31, 3, 401--409.
[3]
Amini, F., Henry Riche, N., Lee, B., Hurter, C., and Irani, P. 2015. Understanding data videos: Looking at narrative visualization through the cinematography lens. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, ACM, 1459--1468.
[4]
Bach, B., Pietriga, E., and Fekete, J.-D. 2014. Graphdiaries: animated transitions andtemporal navigation for dynamic networks. Visualization and Computer Graphics, IEEE Transactions on 20, 5, 740--754.
[5]
Beal, C. R., and Cohen, P. R. 2008. Temporal data mining for educational applications. In PRICAI 2008: Trends in Artificial Intelligence. Springer, 66--77.
[6]
Bordwell, D., Thompson, K., and Ashton, J. 1997. Film art: An introduction, vol. 7. McGraw-Hill New York.
[7]
Chorianopoulos, K. 2013. Collective intelligence within web video. Human-centric Computing and Information Sciences 3, 1, 1--16.
[8]
Dachselt, R., and Weiland, M. 2006. Timezoom: a flexible detail and context timeline. In CHI'06 Extended Abstracts on Human Factors in Computing Systems, ACM, 682--687.
[9]
Dragicevic, P., Bezerianos, A., Javed, W., Elmqvist, N., and Fekete, J.-D. 2011. Temporal distortion for animated transitions. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, ACM, 2009--2018.
[10]
Foreshadowing.org, 2016. Types of foreshadowing. http://foreshadowing.org/types-of-foreshadowing.html. Retrived on April 27th, 2016.
[11]
Fulda, J., Brehmer, M., and Munzner, T. 2016. Time-linecurator: Interactive authoring of visual timelines from unstructured text. Visualization and Computer Graphics, IEEE Transactions on 22, 1, 300--309.
[12]
Gratzl, S., Lex, A., Gehlenborg, N., Cosgrove, N., and Streit, M. 2016. From visual exploration to storytelling and back again. bioRxiv, 049585.
[13]
Heer, J., and Robertson, G. G. 2007. Animated transitions in statistical data graphics. Visualization and Computer Graphics, IEEE Transactions on 13, 6, 1240--1247.
[14]
Hou, X., and Zhang, L. 2007. Saliency detection: A spectral residual approach. In Computer Vision and Pattern Recognition, 2007. CVPR'07. IEEE Conference on, IEEE, 1--8.
[15]
Huron, S., Vuillemot, R., and Fekete, J.-D. 2013. Visual sedimentation. Visualization and Computer Graphics, IEEE Transactions on 19, 12, 2446--2455.
[16]
Lee, J., Podlaseck, M., Schonberg, E., and Hoch, R. 2001. Visualization and analysis of clickstream data of online stores for understanding web merchandising. In Applications of Data Mining to Electronic Commerce. Springer, 59--84.
[17]
McKee, R. 1997. Substance, Structure, Style, and the Principles of Screenwriting. New York: HarperCollins.
[18]
Mediacollege, 2016. Manipulating time in video production. http://www.mediacollege.com/video/editing/. Retrieved on March 10th, 2016.
[19]
Montgomery, A. L., Li, S., Srinivasan, K., and Liechty, J. C. 2004. Modeling online browsing and path analysis using clickstream data. Marketing Science 23, 4, 579--595.
[20]
Nguyen, P. H., Xu, K., Walker, R., and Wong, B. 2014. Schemaline: Timeline visualization for sensemaking. In Information Visualisation (IV), 2014 18th International Conference on, IEEE, 225--233.
[21]
Riedl, M. O., and Young, R. M. 2010. Narrative planning: Balancing plot and character. Journal of Artificial Intelligence Research 39, 1, 217--268.
[22]
Robertson, G., Fernandez, R., Fisher, D., Lee, B., and Stasko, J. 2008. Effectiveness of animation in trend visualization. Visualization and Computer Graphics, IEEE Transactions on 14, 6, 1325--1332.
[23]
Rosling, H. 2009. Gapminder. GapMinder Foundation http://www.gapminder.org, 91.
[24]
Segel, E., and Heer, J. 2010. Narrative visualization: Telling stories with data. Visualization and Computer Graphics, IEEE Transactions on 16, 6, 1139--1148.
[25]
Shi, C., Fu, S., Chen, Q., and Qu, H. 2015. Vismooc: Visualizing video clickstream data from massive open online courses. In Visualization Symposium (PacificVis), 2015 IEEE Pacific, IEEE, 159--166.
[26]
Sigovan, C., Muelder, C. W., and Ma, K.-L. 2013. Visualizing large-scale parallel communication traces using a particle animation technique. In Computer Graphics Forum, vol. 32, Wiley Online Library, 141--150.
[27]
Thomas, F., Johnston, O., and Thomas, F. 1995. The illusion of life: Disney animation. Hyperion New York.
[28]
Tversky, B., Morrison, J. B., and Betrancourt, M. 2002. Animation: can it facilitate? International journal of humancomputer studies 57, 4, 247--262.
[29]
Waldner, M., Le Muzic, M., Bernhard, M., Purgathofer, W., and Viola, I. 2014. Attractive flicker - guiding attention in dynamic narrative visualizations. Visualization and Computer Graphics, IEEE Transactions on 20, 12, 2456--2465.
[30]
Wei, J., Shen, Z., Sundaresan, N., and Ma, K.-L. 2012. Visual cluster exploration of web clickstream data. In Visual Analytics Science and Technology (VAST), 2012 IEEE Conference on, IEEE, 3--12.
[31]
Zhao, J., Drucker, S. M., Fisher, D., and Brinkman, D. 2012. Timeslice: Interactive faceted browsing of timeline data. In Proceedings of the International Working Conference on Advanced Visual Interfaces, ACM, 433--436.

Cited By

View all
  • (2024)How Does Automation Shape the Process of Narrative Visualization: A Survey of ToolsIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2023.326132030:8(4429-4448)Online publication date: 1-Aug-2024
  • (2022)A Survey on Visual Analysis of Massive Open Online Courses (MOOC) DataJournal of Computer-Aided Design & Computer Graphics10.3724/SP.J.1089.2022.1953634:06(830-840)Online publication date: 2-Dec-2022
  • (2022)Investigating the Role and Interplay of Narrations and Animations in Data VideosComputer Graphics Forum10.1111/cgf.1456041:3(527-539)Online publication date: 12-Aug-2022
  • Show More Cited By

Index Terms

  1. Animated narrative visualization for video clickstream data

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    SA '16: SIGGRAPH ASIA 2016 Symposium on Visualization
    November 2016
    129 pages
    ISBN:9781450345477
    DOI:10.1145/3002151
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 28 November 2016

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. animated visualization
    2. clickstream data
    3. data storytelling
    4. narrative visualization

    Qualifiers

    • Research-article

    Funding Sources

    • Innovation Technology Fund of Hong Kong
    • National Basic Research Program of China (973 Program)

    Conference

    SA '16
    Sponsor:
    SA '16: SIGGRAPH Asia 2016
    December 5 - 8, 2016
    Macau

    Acceptance Rates

    Overall Acceptance Rate 178 of 869 submissions, 20%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)43
    • Downloads (Last 6 weeks)5
    Reflects downloads up to 25 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)How Does Automation Shape the Process of Narrative Visualization: A Survey of ToolsIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2023.326132030:8(4429-4448)Online publication date: 1-Aug-2024
    • (2022)A Survey on Visual Analysis of Massive Open Online Courses (MOOC) DataJournal of Computer-Aided Design & Computer Graphics10.3724/SP.J.1089.2022.1953634:06(830-840)Online publication date: 2-Dec-2022
    • (2022)Investigating the Role and Interplay of Narrations and Animations in Data VideosComputer Graphics Forum10.1111/cgf.1456041:3(527-539)Online publication date: 12-Aug-2022
    • (2022)DanmuVis: Visualizing Danmu Content Dynamics and Associated Viewer Behaviors in Online VideosComputer Graphics Forum10.1111/cgf.1455241:3(429-440)Online publication date: 12-Aug-2022
    • (2022)Towards a better understanding of the role of visualization in online learning: A reviewVisual Informatics10.1016/j.visinf.2022.09.0026:4(22-33)Online publication date: Dec-2022
    • (2021)The Usefulness of Video Learning Analytics in Small Scale E-Learning ScenariosApplied Sciences10.3390/app11211036611:21(10366)Online publication date: 4-Nov-2021
    • (2021)Animated Presentation of Static Infographics with InfoMotionComputer Graphics Forum10.1111/cgf.1432540:3(507-518)Online publication date: 29-Jun-2021
    • (2020)MaraVis: Representation and Coordinated Intervention of Medical Encounters in Urban MarathonProceedings of the 2020 CHI Conference on Human Factors in Computing Systems10.1145/3313831.3376281(1-12)Online publication date: 21-Apr-2020
    • (2020)SEEVis: A Smart Emergency Evacuation Plan Visualization System with Data‐Driven Shot DesignsComputer Graphics Forum10.1111/cgf.1399939:3(523-535)Online publication date: 18-Jul-2020
    • (2020)Improving Engagement of Animated Visualization with Visual Foreshadowing2020 IEEE Visualization Conference (VIS)10.1109/VIS47514.2020.00035(141-145)Online publication date: Oct-2020
    • Show More Cited By

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media