Abstract
Short-form videos are an increasingly prevalent medium for storytelling in journalism and marketing, of which information can be greatly enhanced by animated data visualizations. However, there is no prior research that systematically investigates how to augment such short videos with data visualizations in an effective way. We conducted a design workshop with experienced video, animation designers and visualization experts to discuss principles and practices for augmenting short-form videos with data visualizations. After the workshop, we summarized the participants’ design considerations and proposed 20 design guidelines. We further collected design purposes of the participants and associated these purposes with the guidelines. Finally, we conducted a crowd-sourcing study and a task-based evaluation to validate the effectiveness and usability of the guidelines. Results indicate that our guidelines can significantly improve the videos accompanied with data visualizations and help novices easily obtain desired knowledge when augmenting videos.
Graphic abstract
Similar content being viewed by others
References
Amazon (2005) Amazon mechanical turk. https://www.mturk.com/. Accessed 1 Aug 2018
Amini F, Henry Riche N, Lee B, Hurter C, Irani P (2015) Understanding data videos: Looking at narrative visualization through the cinematography lens. In: Proceedings of the ACM conference on human factors in computing systems, pp 1459–1468
Amini F, Riche NH, Lee B, Monroy-Hernandez A, Irani P (2017) Authoring data-driven videos with dataclips. IEEE Trans Vis Comput Graph 23(1):501–510
Amini F, Riche NH, Lee B, Leboe-McGowan J, Irani P (2018) Hooked on data videos: assessing the effect of animation and pictographs on viewer engagement. In: Proceedings of the international conference on advanced visual interfaces, pp 1–9
Bach B, Pietriga E, Fekete J, Bach B, Pietriga E, Fekete J, Member S (2014) Navigation for dynamic networks graphdiaries: animated transitions and temporal navigation for dynamic networks. IEEE Trans Vis Comput Graph 20(5):740–754
Bach B, Kerracher N, Hall KW, Carpendale S, Kennedy J, Henry Riche N (2016) Telling stories about dynamic networks with graph comics. In: Proceedings of the ACM conference on human factors in computing systems, pp 3670–3682
Bach B, Riche NH, Carpendale S, Pfister H (2017) The emerging genre of data comics. IEEE Comput Graph Appl 38(3):6–13
Bach B, Wang Z, Farinella M, Murray-Rust D, Henry Riche N (2018) Design patterns for data comics. In: Proceedings of the ACM conference on human factors in computing systems, pp 1–12
Borgo R, Kehrer J, Chung DHS, Maguire E, Laramee RS, Hauser H, Ward M, Chen M (2013) Glyph-based visualization: foundations, design guidelines, techniques and applications. Eurographics State of the Art Reports, pp 39–63
Chevalier F, Riche N, Plaisant C (2016) Animations 25 Years Later: New Roles and Opportunities. In: Proceedings of the international working conference on advanced visual interfaces, pp 280–287
Felberbaum Y, Lanir J (2018) Better understanding of foot gestures: an elicitation study. ACM, New York, p 334
Fisher D (2010) Animation for visualization: opportunities and drawbacks. In: Beautiful visualization. O'Reilly Media, pp 329–352
Foundation ID (2018) Design guidelines. https://www.interaction-design.org/literature/topics/design-guidelines. Accessed 1 Aug 2018
Hanington B, Martin B (2012) Affinity diagramming. In: Universal methods of design, pp 12–14. Rockport Publishers
Heer J, Bostock M (2010) Crowdsourcing graphical perception: using mechanical turk to assess visualization design. In: Proceedings of the ACM conference on human factors in computing systems, ACM, pp 203–212
Heer J, Robertson GG (2007) Animated transitions in statistical data graphics. IEEE Trans Vis Comput Graph 13(6):1240–1247
Heiser J, Phan D, Agrawala M, Tversky B, Hanrahan P (2004) Identification and validation of cognitive design principles for automated generation of assembly instructions. In: Proceedings of the working conference on advanced visual interfaces, ACM, pp 311–319
Hoffswell J, Satyanarayan A, Heer J (2018) Augmenting code with in situ visualizations to aid program understanding. In: Proceedings of the 2018 CHI conference on human factors in computing systems, ACM, p 532
Hullman J, Diakopoulos N (2011) Visualization rhetoric: framing effects in narrative visualization. IEEE Trans Vis Comput Graph 17(12):2231–2240
Hullman J, Drucker S, Henry Riche N, Lee B, Fisher D, Adar E (2013) A deeper understanding of sequence in narrative visualization. IEEE Trans Vis Comput Graph 19(12):2406–2415
Huron S, Vuillemot R, Fekete JD (2013) Visual sedimentation. IEEE Trans Vis Comput Graph 19(12):2446–2455
Inc A (1993) Adobe after effects. https://www.adobe.com/products/aftereffects.html. Accessed 1 Aug 2018
Inc A (2003) Adobe premiere. https://www.adobe.com/products/premiere.html. Accessed 1 Aug 2018
Kosara R, Mackinlay J (2013) Storytelling: the next step for visualization. IEEE Comput 46(5):44–50
Lee B, Riche NH, Isenberg P, Carpendale S (2015) More than telling a story: transforming data into visually shared stories. IEEE Comput Graph Appl 35(5):84–90
Li C, Lv P, Manocha D, Wang H, Li Y, Zhou B, Xu M (2019) ACSEE: antagonistic crowd simulation model with emotional contagion and evolutionary game. In: IEEE transactions on affective computing (to appear)
Lidwell W, Holden K, Butler J (2010a) Readability. In: Universal principles of design, pp 198–199. Rockport Publishers
Lidwell W, Holden K, Butler J (2010b) Priming. In: Universal principles of design, pp 186–187. Rockport Publishers
Lidwell W, Holden K, Butler J (2010c) Fitts’ Law. In: Universal principles of design, pp 98–99. Rockport Publishers
Lidwell W, Holden K, Butler J (2010d) Proximity. In: Universal principles of design, pp 196–197. Rockport Publishers
Lidwell W, Holden K, Butler J (2010e) Inference effects. In: Universal principles of design, pp 138–139. Rockport Publishers
Lidwell W, Holden K, Butler J (2010f) Serial position effect. In: Universal principles of design, pp 220–221. Rockport Publishers
Lidwell W, Holden K, Butler J (2010g) Consistency. In: Universal principles of design, pp 56–57. Rockport Publishers
Liu S, Yin J, Wang X, Cui W, Cao K, Pei J (2016) Online visual analytics of text streams. IEEE Trans Vis Comput Graph 22(11):2451–2466
Robertson G, Fernandez R, Fisher D, Lee B, Stasko J (2008) Effectiveness of animation in trend visualization. IEEE Trans Vis Comput Graph 14(6):1325–1332
Rufiange S, McGuffin MJ (2013) DiffAni: visualizing dynamic graphs with a hybrid of difference maps and animation. IEEE Trans Vis Comput Graph 19(12):2556–2565
Seckler M, Heinz S, Bargas-Avila JA, Opwis K, Tuch AN (2014) Designing usable web forms—empirical evaluation of web form improvement guidelines. In: Proceedings of the ACM conference on human factors in computing systems, pp 1275–1284
Segel E, Heer J (2010) Narrative visualization: telling stories with data. IEEE Trans Vis Comput Graph 16(6):1139–1148
Singh DP, Lisle L, Murali T, Luther K (2018) Crowdlayout: crowdsourced design and evaluation of biological network visualizations. In: Proceedings of the ACM conference on human factors in computing systems, ACM, pp 1–14
Tang T, Rubab S, Lai J, Cui W, Yu L, Wu Y (2019) iStoryline: effective convergence to hand-drawn storylines. IEEE Trans Vis Comput Graph 25(1):769–778
Tversky B, Morrison JB, Betrancourt M (2002) Animation: Can it facilitate? Int J Hum Comput Stud Schnotz Kulhavy 57:247–262
Van Welie M, Van Der Veer GC, Eliëns A (2001) Patterns as tools for user interface design. In: Tools for Working with Guidelines, pp 313–324
Wang Y, Chen Z, Ma X, Luo Q, Qu H (2016) Animated Narrative Visualization for Video Clickstream Data. In: Proceedings of Siggraph Asia symposium on visualization, pp 1–8
Weng D, Chen R, Deng Z, Wu F, Chen J, Wu Y (2019) SRVis: towards better spatial integration in ranking visualization. IEEE Trans Vis Comput Graph 25(1):459–469
Wu Y, Cao N, Gotz D, Tan YP, Keim DA (2016) A survey on visual analytics of social media data. IEEE Trans Multimed 18(11):2135–2148
Wu Y, Chen Z, Sun G, Xie X, Cao N, Liu S, Cui W (2018) StreamExplorer: a multi-stage system for visually exploring events in social streams. IEEE Trans Vis Comput Graph 24(10):2758–2772
Xie X, Cai X, Zhou J, Cao N, Wu Y (2019) A semantic-based method for visualizing large image collections. IEEE Trans Vis Comput Graph 25(7):2362–2377
Xu M, Li C, Lv P, Lin N, Hou R, Zhou B (2017) An efficient method of crowd aggregation computation in public areas. IEEE Trans Circuits Syst Video Technol 28(10):2814–2825
Xu M, Su H, Li Y, Li X, Liao J, Niu J, Lv P, Zhou B (2019a) Stylized aesthetic QR code. IEEE Trans Multimed 21(8):1960–1970
Xu M, Xie X, Lv P, Niu J, Wang H, Li C, Zhu R, Deng Z, Zhou B (2019b) Crowd behavior simulation with emotional contagion in unexpected multihazard situations. In: IEEE transactions on systems, man, and cybernetics: systems (to appear)
Xue J, Yin H, Lv P, Xu M, Li Y (2019) Crowd queuing simulation with an improved emotional contagion model. Sci China Inf Sci 62(4):44101
Zhou Z (2019) Abductive learning: towards bridging machine learning and logical reasoning. Sci China Inf Sci 62(7):76101
Acknowledgements
The work was supported by NSFC (61761136020), NSFC-Zhejiang Joint Fund for the Integration of Industrialization and Informatization (U1609217), Zhejiang Provincial Natural Science Foundation (LR18F020001) and the 100 Talents Program of Zhejiang University. This Project was also supported by Alibaba Group.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Tang, T., Tang, J., Hong, J. et al. Design guidelines for augmenting short-form videos using animated data visualizations. J Vis 23, 707–720 (2020). https://doi.org/10.1007/s12650-020-00644-z
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12650-020-00644-z