Abstract
By encoding semantic relations into relative positions, word clouds have shown the capability to deliver richer messages than purely visualizing word frequencies. Existing studies mainly focus on layout algorithms that cluster related words, preserve temporal coherence, and optimize spatial shapes. However, they cannot fully convey multiple relations among words and their evolvement through relative positions and static representations. In this paper, we explore animated word clouds that take advantage of storytelling strategies to present interactions between words and show the dynamic process of content changes, thus communicating the underlying stories. We initially create several exemplars of animated word clouds with designers through a structured iterative design process. These exemplars lead to a preliminary design space that distills essential narrative elements with design choices. Based on the design space, we develop a prototype tool, DancingWords, which provides story-oriented interactions and automatic layouts for users to generate animated word clouds. We evaluate the expressiveness and usefulness of our system through several example animated stories and a usability study with general users. The results show that DancingWords allows users to produce appealing storytelling videos easily and quickly for communication.
Graphic abstract
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Amini F, Riche NH, Lee B, Hurter C, Irani P (2015) Understanding data videos: looking at narrative visualization through the cinematography lens. In: Proceedings of the ACM conference on human factors in computing systems, pp 1459–1468. https://doi.org/10.1145/2702123.2702431
Amini F, Riche NH, Lee B, Monroy-Hernández A, Irani P (2017) Authoring data-driven videos with DataClips. IEEE Trans Vis Comput Graph 23(1):501–510. https://doi.org/10.1109/TVCG.2016.2598647
Amini F, Riche NH, Lee B, Leboe-McGowan J, Irani P (2018) Hooked on data videos: assessing the effect of animation and pictographs on viewer engagement. In: Proceedings of the international conference on advanced visual interfaces, pp 21:1–21:9. https://doi.org/10.1145/3206505.3206552
Bach B, Kerracher N, Hall KW, Carpendale S, Kennedy J, Riche NH (2016) Telling stories about dynamic networks with graph comics. In: Proceedings of the ACM conference on human factors in computing systems, pp 3670–3682. https://doi.org/10.1145/2858036.2858387
Bal M (2009) Narratology: introduction to the theory of narrative, 3rd edn. University of Toronto Press, Toronto
Barth L, Fabrikant SI, Kobourov SG, Lubiw A, Nöllenburg M, Okamoto Y, Pupyrev S, Squarcella C, Ueckerdt T, Wolff A (2014) Semantic word cloud representations: hardness and approximation algorithms. In: LATIN: theoretical informatics-Latin American symposium, vol 8392, pp 514–525. https://doi.org/10.1007/978-3-642-54423-1_45
Bateman S, Mandryk RL, Gutwin C, Genest A, McDine D, Brooks CA (2010) Useful junk? The effects of visual embellishment on comprehension and memorability of charts. In: Proceedings of the ACM conference on human factors in computing systems, pp 2573–2582. https://doi.org/10.1145/1753326.1753716
Blazer L (2016) Animated storytelling: simple steps for creating animation and motion graphics. Peachpit Press, Berkely
Brehmer M, Lee B, Bach B, Riche NH, Munzner T (2017) Timelines revisited: a design space and considerations for expressive storytelling. IEEE Trans Vis Comput Graph 23(9):2151–2164
Bulterman DCA, Hardman L (2005) Structured multimedia authoring. ACM Tran Multimed Comput Commun Appl 1(1):89–109. https://doi.org/10.1145/1047936.1047943
Cao R, Dey S, Cunningham A, Walsh J, Smith RT, Zucco JE, Thomas BH (2020) Examining the use of narrative constructs in data videos. Vis Inform 4(1):8–22. https://doi.org/10.1016/j.visinf.2019.12.002
Chawla P, Hazarika S, Shen H (2020) Token-wise sentiment decomposition for ConvNet: visualizing a sentiment classifier. Vis Inform 4(2):132–141. https://doi.org/10.1016/j.visinf.2020.04.006
Chi M, Lin S, Chen S, Lin C, Lee T (2015) Morphable word clouds for time-varying text data visualization. IEEE Trans Vis Comput Graph 21(12):1415–1426. https://doi.org/10.1109/TVCG.2015.2440241
Coulter CA, Smith ML (2009) The construction zone: literary elements in narrative research. Educ Res 38(8):577–590. https://doi.org/10.3102/0013189X09353787
Cui W, Wu Y, Liu S, Wei F, Zhou MX, Qu H (2010) Context-preserving dynamic word cloud visualization. In: Proceedings of IEEE Pacific visualization symposium, pp 121–128. https://doi.org/10.1109/PACIFICVIS.2010.5429600
Felix C, Franconeri S, Bertini E (2018) Taking word clouds apart: an empirical investigation of the design space for keyword summaries. IEEE Trans Vis Comput Graph 24(1):657–666. https://doi.org/10.1109/TVCG.2017.2746018
Hearst M, Pedersen E, Patil LP, Lee E, Laskowski P, Franconeri S (2019) An evaluation of semantically grouped word cloud designs. In: IEEE transactions on visualization and computer graphics, p 1
Heer J, Robertson GG (2007) Animated transitions in statistical data graphics. IEEE Trans Vis Comput Graph 13(6):1240–1247. https://doi.org/10.1109/TVCG.2007.70539
Hu M, Wongsuphasawat K, Stasko J (2017) Visualizing social media content with SentenTree. IEEE Trans Vis Comput Graph 23(1):621–630
Kerzner E, Goodwin S, Dykes J, Jones S, Meyer MD (2019) A framework for creative visualization-opportunities workshops. IEEE Trans Vis Comput Graph 25(1):748–758. https://doi.org/10.1109/TVCG.2018.2865241
Kim NW, Schweickart E, Liu Z, Dontcheva M, Li W, Popovic J, Pfister H (2017) Data-driven guides: supporting expressive design for information graphics. IEEE Trans Vis Comput Graph 23(1):491–500. https://doi.org/10.1109/TVCG.2016.2598620
Kim NW, Riche NH, Bach B, Xu G, Brehmer M, Hinckley K, Pahud M, Xia H, McGuffin MJ, Pfister H (2019) DataToon: drawing dynamic network comics with pen + touch interaction. pp 1–12. https://doi.org/10.1145/3290605.3300335
Latif S, Beck F (2019) Interactive map reports summarizing bivariate geographic data. Vis Inform 3(1):27–37. https://doi.org/10.1016/j.visinf.2019.03.004
Li C, Dong X, Yuan X (2018) Metro-Wordle: an interactive visualization for urban text distributions based on wordle. Vis Inform 2(1):50–59. https://doi.org/10.1016/j.visinf.2018.04.006
Lu J, Wang J, Ye H, Gu Y, Ding Z, Xu M, Chen W (2020) Illustrating changes in time-series data with data video. IEEE Comput Graph Appl 40(2):18–31
Mascelli JV (2005) The Five C’s of cinematography: motion picture filming techniques, 1st edn. Silman-James Press, Hollywood
Max W (1923) Untersuchungen zur lehre von der gestalt. Psycol Forsch 3:301–350
Mei H, Chen W, Ma Y, Guan H, Hu W (2018a) VisComposer: a visual programmable composition environment for information visualization. Vis Inform 2(1):71–81. https://doi.org/10.1016/j.visinf.2018.04.008
Mei H, Ma Y, Wei Y, Chen W (2018b) The design space of construction tools for information visualization: a survey. J Vis Lang Comput 44:120–132. https://doi.org/10.1016/j.jvlc.2017.10.001
Onoue Y, Kukimoto N, Sakamoto N, Koyamada K (2016) E-Grid: a visual analytics system for evaluation structures. J Vis 19(4):753–768. https://doi.org/10.1007/s12650-015-0342-6
Palmer SE (1992) Common region: a new principle of perceptual grouping. Cogn Psychol 24(3):436–447. https://doi.org/10.1016/0010-0285(92)90014-S
Segel E, Heer J (2010) Narrative visualization: telling stories with data. IEEE Trans Vis Comput Graph 16(6):1139–1148. https://doi.org/10.1109/TVCG.2010.179
Tang T, Tang J, Hong J, Yu L, Ren P, Wu Y (2020) Design guidelines for augmenting short-form videos using animated data visualizations. J Vis. https://doi.org/10.1007/s12650-020-00644-z
Thomas F, Johnston O (1995) The illusion of life: Disney animation. Hyperion, New York
Tversky B, Morrison JB, Bétrancourt M (2002) Animation: can it facilitate? Int J Hum Comput Stud 57(4):247–262. https://doi.org/10.1006/ijhc.2002.1017
Viégas FB, Wattenberg M (2008) Timelines: tag clouds and the case for vernacular visualization. Interactions 15(4):49–52. https://doi.org/10.1145/1374489.1374501
Viégas FB, Wattenberg M, Feinberg J (2009) Participatory visualization with wordle. IEEE Trans Vis Comput Graph 15(6):1137–1144. https://doi.org/10.1109/TVCG.2009.171
Wang Y, Chu X, Bao C, Zhu L, Deussen O, Chen B, Sedlmair M (2018a) EdWordle: consistency-preserving word cloud editing. IEEE Trans Vis Comput Graph 24(1):647–656. https://doi.org/10.1109/TVCG.2017.2745859
Wang Y, Zhang H, Huang H, Chen X, Yin Q, Hou Z, Zhang D, Luo Q, Qu H (2018b) InfoNice: easy creation of information graphics. In: Proceedings of the ACM conference on human factors in computing systems, pp 335:1–335:12. https://doi.org/10.1145/3173574.3173909
Wang Y, Chu X, Zhang K, Bao C, Li X, Zhang J, Fu C, Hurter C, Deussen O, Lee B (2020) ShapeWordle: tailoring wordles using shape-aware archimedean spirals. IEEE Trans Vis Comput Graph 26(1):991–1000
Wattenberg M, Vigas FB (2008) The word tree, an interactive visual concordance. IEEE Trans Vis Comput Graph 14(6):1221–1228
Wong J, Zhang X (2018) MessageLens: a visual analytics system to support multifaceted exploration of MOOC forum discussions. Vis Inform 2(1):37–49. https://doi.org/10.1016/j.visinf.2018.04.005
Wor (2020) Word art website. https://wordart.com. Accessed 1 May 2020
Wu Y, Provan T, Wei F, Liu S, Ma K (2011) Semantic-preserving word clouds by seam carving. Comput Graph Forum 30(3):741–750. https://doi.org/10.1111/j.1467-8659.2011.01923.x
Xia J, Chen W, Hou Y, Hu W, Huang X, Ebert DS (2016) DimScanner: a relation-based visual exploration approach towards data dimension inspection. In: IEEE conference on visual analytics science and technology (VAST), pp 81–90. https://doi.org/10.1109/VAST.2016.7883514
Yang Y, Yao Q, Qu H (2017) VISTopic: a visual analytics system for making sense of large document collections using hierarchical topic modeling. Vis Inform 1(1):40–47. https://doi.org/10.1016/j.visinf.2017.01.005
Zhou Z (2019) Abductive learning: towards bridging machine learning and logical reasoning. Sci China Inf Sci 62(7):76101:1–76101:3. https://doi.org/10.1007/s11432-018-9801-4
Acknowledgements
The work was supported by NSFC (61761136020), NSFC-Zhejiang Joint Fund for the Integration of Industrialization and Informatization (U1609217), Zhejiang Provincial Natural Science Foundation (LR18F020001). This project was also partially funded by HKUST SSC grant F0707 and Microsoft Research Asia (FY20-Research-Sponsorship-252 and No. MRA19EG02).
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Shu, X., Wu, J., Wu, X. et al. DancingWords: exploring animated word clouds to tell stories. J Vis 24, 85–100 (2021). https://doi.org/10.1007/s12650-020-00689-0
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12650-020-00689-0