Min Lu
Hanspeter Pfister
Hui Huang
ABSTRACT
Infographics are engaging visual representations that tell an informative story using a fusion of data and graphical elements. The large variety of infographic design poses a challenge for their high-level analysis. We use the concept of Visual Information Flow (VIF), which is the underlying semantic structure that links graphical elements to convey the information and story to the user. To explore VIF, we collected a repository of over 13K infographics. We use a deep neural network to identify visual elements related to information, agnostic to their various artistic appearances. We construct the VIF by automatically chaining these visual elements together based on Gestalt principles. Using this analysis, we characterize the VIF design space by a taxonomy of 12 different design patterns. Exploring in a real-world infographic dataset, we discuss the design space and potentials of VIF in light of this taxonomy.
Supplemental Material
- Fereshteh Amini, Nathalie Henry Riche, Bongshin Lee, Andres Monroy-Hernandez, and Pourang Irani. 2017. Authoring data-driven videos with dataclips. IEEE transactions on visualization and computer graphics 23, 1 (2017), 501--510.Google Scholar
- Benjamin Bach, Zezhong Wang, Matteo Farinella, Dave Murray-Rust, and Nathalie Henry Riche. 2018. Design Patterns for Data Comics. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). ACM, Article 38, 12 pages.Google ScholarDigital Library
- Scott Bateman, Regan L Mandryk, Carl Gutwin, Aaron Genest, David McDine, and Christopher Brooks. 2010. Useful junk?: the effects of visual embellishment on comprehension and memorability of charts. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 2573--2582.Google ScholarDigital Library
- Jacci Howard Bear. 2019. Find Out If Your Page Layout Is in Balance. https://www.lifewire.com/balance-in-design-1078231. (February 02 2019). Bear2019.Google Scholar
- Michelle A Borkin, Azalea A Vo, Zoya Bylinskii, Phillip Isola, Shashank Sunkavalli, Aude Oliva, and Hanspeter Pfister. 2013. What makes a visualization memorable? IEEE Transactions on Visualization and Computer Graphics 19, 12 (2013), 2306--2315.Google ScholarDigital Library
- Steven Bradley. 2015. Design Principles: Compositional Flow And Rhythm. https://www.smashingmagazine.com/2015/04/designprinciples-compositional-flow-and-rhythm/. (April 29 2015). Bradley2015.Google Scholar
- Jean M Brechman. 2010. Narrative "flow": A model of narrative processing and its impact on information processing, knowledge acquisition and persuasion. (2010).Google Scholar
- M. Brehmer, B. Lee, B. Bach, N. H. Riche, and T. Munzner. 2017. Timelines Revisited: A Design Space and Considerations for Expressive Storytelling. IEEE Transactions on Visualization and Computer Graphics 23, 9 (Sep. 2017), 2151--2164.Google ScholarDigital Library
- Zoya Bylinskii, Sami Alsheikh, Spandan Madan, Adria Recasens, Kimberli Zhong, Hanspeter Pfister, Fredo Durand, and Aude Oliva. 2017a. Understanding infographics through textual and visual tag prediction. arXiv preprint arXiv:1709.09215 (2017).Google Scholar
- Zoya Bylinskii, Nam Wook Kim, Peter O'Donovan, Sami Alsheikh, Spandan Madan, Hanspeter Pfister, Fredo Durand, Bryan Russell, and Aaron Hertzmann. 2017b. Learning visual importance for graphic designs and data visualizations. In Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology. ACM, 57--69.Google ScholarDigital Library
- Zhutian Chen, Yun Wang, Qianwen Wang, Yong Wang, and Huamin Qu. 2019. Towards Automated Infographic Design: Deep Learning-based Auto-Extraction of Extensible Timeline. IEEE transactions on visualization and computer graphics 26, 1 (2019), 917--926.Google Scholar
- Laurens Van Der Maaten and Geoffrey E Hinton. 2008. Visualizing Data using t-SNE. Journal of Machine Learning Research 9 (2008), 2579--2605.Google Scholar
- Agné Desolneux, Lionel Moisan, and Jean-Michel Morel. 2004. Gestalt theory and computer vision. (2004), 71--101.Google Scholar
- Martin Ester, Hans-Peter Kriegel, Jörg Sander, Xiaowei Xu, and others. 1996. A density-based algorithm for discovering clusters in large spatial databases with noise.. In Kdd, Vol. 96. 226--231.Google ScholarDigital Library
- Johanna Fulda, Matthew Brehmel, and Tamara Munzner. 2016. Timelinecurator: Interactive authoring of visual timelines from unstructured text. IEEE transactions on visualization and computer graphics 22, 1 (2016), 300--309.Google Scholar
- Ross Girshick. 2015. Fast r-cnn. In Proceedings of the IEEE international conference on computer vision. 1440--1448.Google ScholarDigital Library
- Steve Haroz, Robert Kosara, and Steven L Franconeri. 2015. Isotype visualization: Working memory, performance, and engagement with pictographs. In Proceedings of the 33rd annual ACM conference on human factors in computing systems. ACM, 1191--1200.Google ScholarDigital Library
- Lane Harrison, Katharina Reinecke, and Remco Chang. 2015. Infographic aesthetics: Designing for the first impression. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems. ACM, 1187--1190.Google ScholarDigital Library
- Jeffrey Heer and George Robertson. 2007. Animated transitions in statistical data graphics. IEEE transactions on visualization and computer graphics 13, 6 (2007), 1240--1247.Google ScholarDigital Library
- Weiyin Hong, James YL Thong, and Kar Yan Tam. 2004. Does animation attract online users' attention? The effects of flash on information search performance and perceptions. Information Systems Research 15, 1 (2004), 60--86.Google ScholarDigital Library
- Jessica Hullman, Steven Drucker, Nathalie Henry Riche, Bongshin Lee, Danyel Fisher, and Eytan Adar. 2013. A Deeper Understanding of Sequence in Narrative Visualization. IEEE Transactions on Visualization and Computer Graphics 19, 12 (Dec. 2013), 2406--2415.Google ScholarDigital Library
- Ian Jolliffe. 2011. Principal component analysis. In International encyclopedia of statistical science. Springer, 1094--1096.Google Scholar
- Nam Wook Kim, Zoya Bylinskii, Michelle A Borkin, Krzysztof Z Gajos, Aude Oliva, Fredo Durand, and Hanspeter Pfister. 2017. BubbleView: an interface for crowdsourcing image importance maps and tracking visual attention. ACM Transactions on Computer-Human Interaction (TOCHI) 24, 5 (2017), 36.Google ScholarDigital Library
- Nam Wook Kim, Eston Schweickart, Zhicheng Liu, Mira Dontcheva, Wilmot Li, Jovan Popovic, and Hanspeter Pfister. 2016. Data-driven guides: Supporting expressive design for information graphics. IEEE transactions on visualization and computer graphics 23, 1 (2016), 491--500.Google Scholar
- Ranjitha Kumar, Arvind Satyanarayan, Cesar Torres, Maxine Lim, Salman Ahmad, Scott R Klemmer, and Jerry O Talton. 2013. Webzeitgeist: design mining the web. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 3083--3092.Google ScholarDigital Library
- Bongshin Lee, Rubaiat Habib Kazi, and Greg Smith. 2013. SketchStory: Telling more engaging stories with data through freeform sketching. IEEE Transactions on Visualization and Computer Graphics 19, 12 (2013), 2416--2425.Google ScholarDigital Library
- Thomas F Liu, Mark Craft, Jason Situ, Ersin Yumer, Radomir Mech, and Ranjitha Kumar. 2018a. Learning Design Semantics for Mobile Apps. In The 31st Annual ACM Symposium on User Interface Software and Technology. ACM, 569--579.Google Scholar
- Wei Liu, Dragomir Anguelov, Dumitru Erhan, Christian Szegedy, Scott Reed, Cheng-Yang Fu, and Alexander C Berg. 2016. Ssd: Single shot multibox detector. In European conference on computer vision. Springer, 21--37.Google ScholarCross Ref
- Zhicheng Liu, John Thompson, Alan Wilson, Mira Dontcheva, James Delorey, Sam Grigg, Bernard Kerr, and John Stasko. 2018b. Data Illustrator: Augmenting Vector Design Tools with Lazy Data Binding for Expressive Visualization Authoring. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). ACM, Article 123, 13 pages.Google ScholarDigital Library
- Sean McKenna, N Henry Riche, Bongshin Lee, Jeremy Boy, and M Meyer. 2017. Visual narrative flow: Exploring factors shaping data visualization story reading experiences. In Computer Graphics Forum, Vol. 36. Wiley Online Library, 377--387.Google Scholar
- Joseph Redmon, Santosh Divvala, Ross Girshick, and Ali Farhadi. 2016. You only look once: Unified, real-time object detection. In Proceedings of the IEEE conference on computer vision and pattern recognition. 779--788.Google ScholarCross Ref
- Babak Saleh, Mira Dontcheva, Aaron Hertzmann, and Zhicheng Liu. 2015. Learning Style Similarity for Searching Infographics. In Proceedings of the 41st Graphics Interface Conference (GI '15). 59--64.Google ScholarDigital Library
- Arvind Satyanarayan and Jeffrey Heer. 2014. Authoring Narrative Visualizations with Ellipsis. Computer Graphics Forum 33 (2014), 361--370.Google ScholarCross Ref
- Edward Segel and Jeffrey Heer. 2010. Narrative visualization: Telling stories with data. IEEE transactions on visualization and computer graphics 16, 6 (2010), 1139--1148.Google ScholarDigital Library
- Teo Siang. 2019. The Building Blocks of Visual Design. https://www.interaction-design.org/literature/article/thebuilding-blocks-of-visual-design. (March 2019).Google Scholar
- Martin van den Berg, Michael Kubovy, and James A Schirillo. 2011. Grouping by regularity and the perception of illumination. Vision research 51, 12 (2011), 1360--1371.Google Scholar
- Yun Wang, Haidong Zhang, He Huang, Xi Chen, Qiufeng Yin, Zhitao Hou, Dongmei Zhang, Qiong Luo, and Huamin Qu. 2018. InfoNice: Easy creation of information graphics. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. ACM, 335.Google ScholarDigital Library
- Nanxuan Zhao, Ying Cao, and Rynson WH Lau. 2018. What characterizes personalities of graphic designs? ACM Transactions on Graphics (TOG) 37, 4 (2018), 116.Google ScholarDigital Library
Index Terms
- Exploring Visual Information Flows in Infographics
Recommendations
InfoNice: Easy Creation of Information Graphics
CHI '18: Proceedings of the 2018 CHI Conference on Human Factors in Computing SystemsInformation graphics are widely used to convey messages and present insights in data effectively. However, creating expressive data-driven infographics remains a great challenge for general users without design expertise. We present InfoNice, a ...
A system for understanding imaged infographics and its applications
DocEng '07: Proceedings of the 2007 ACM symposium on Document engineeringInformation graphics, or infographics, are visual representations of information, data or knowledge. Understanding of infographics in documents is a relatively new research problem, which becomes more challenging when infographics appear as raster ...
Enhancing Infographics Based on Symmetry Saliency
VINCI '16: Proceedings of the 9th International Symposium on Visual Information Communication and InteractionImage saliency is a biologically inspired concept for characterizing visual conspicuity of individual features in natural images, and provides us with a useful insight into the mechanism for directing instant visual attention from viewers. Nevertheless, ...
Comments