Ao Dong
ABSTRACT
Many visual analytics have been developed for examining scientific publications comprising wealthy data such as authors and citations. The studies provide unprecedented insights on a variety of applications, e.g., literature review and collaboration analysis. However, visual information (i.e., figures) that are widely employed for storytelling and methods description are often neglected. We present VIStory, an interactive storyboard for exploring visual information in scientific publications. We harvest the data using an automatic figure extraction method, resulting in a large corpora of figures. Each figure contains various attributes such as dominant color and width/height ratio, together with faceted metadata of the publication including venues, authors, and keywords. To depict these information, we develop an intuitive interface consisting of three components: 1) Faceted View enables efficient query by publication metadata, benefiting from a nested table structure, 2) Storyboard View arranges paper rings -- a well-designed glyph for depicting figure attributes, in a themeriver layout to reveal temporal trends, and 3) Endgame View presents a highlighted figure together with the publication metadata. The system is especially useful for scientific publications containing substantial visual information, such as the visualization publications. We demonstrate the effectiveness of our approach using two case studies conducted on past ten-year IEEE VIS publications in 2009 - 2018.
- M. A. Borkin, Z. Bylinskii, N. W. Kim, C. M. Bainbridge, C. S. Yeh, D. Borkin, H. Pfister, and A. Oliva. 2016. Beyond Memorability: Visualization Recognition and Recall. IEEE Transactions on Visualization and Computer Graphics 22, 1 (2016), 519--528. https://doi.org/10.1109/TVCG.2015.2467732Google Scholar
Digital Library
- M. A. Borkin, A. A. Vo, Z. Bylinskii, P. Isola, S. Sunkavalli, A. Oliva, and H. Pfister. 2013. What Makes a Visualization Memorable? IEEE Transactions on Visualization and Computer Graphics 19, 12 (2013), 2306--2315. https://doi.org/10.1109/TVCG. 2013.234Google ScholarDigital Library
- M. Chen, D. Ebert, H. Hagen, R. S. Laramee, R. van Liere, K. L. Ma, W. Ribarsky, G. Scheuermann, and D. Silver. 2009. Data, Information, and Knowledge in Visualization. IEEE Computer Graphics and Applications 29, 1 (2009), 12--19. https://doi.org/10.1109/MCG.2009.6Google ScholarCross Ref
- J.K. Chou and C. K. Yang. 2011. PaperVis: Literature Review Made Easy. Computer Graphics Forum 30, 3 (2011), 721-730. https://doi.org/10.1111/j.1467-8659.2011.01921.xGoogle ScholarDigital Library
- P. van der Corput and J. J. van Wijk. 2016. ICLIC: Interactive categorization of large image collections. In Proceedings of IEEE Pacific Visualization Symposium (PacificVis). 152--159. https://doi.org/10.1109/PACIFICVIS.2016.7465263Google ScholarCross Ref
- Danilo M. Eler, Marcel Y. Nakazaki, Fernando V. Paulovich, Davi P. Santos, Gabriel F. Andery, Maria Cristina F. Oliveira, João Batista Neto, and Rosane Minghim. 2009. Visual analysis of image collections. The Visual Computer 25, 10 (2009), 923-937. https://doi.org/10.1007/s00371-009-0368-7Google ScholarDigital Library
- P. Federico, F. Heimerl, S. Koch, and S. Miksch. 2017. A Survey on Visual Approaches for Analyzing Scientific Literature and Patents. IEEE Transactions on Visualization and Computer Graphics 23, 9 (2017), 2179--2198. https://doi.org/10.1109/TVCG.2016.2610422Google ScholarDigital Library
- Susan Havre, Beth Hetzler, and Lucy Nowell. 2000. ThemeRiver: Visualizing theme changes over time. In Proceedings of IEEE Symposium on Information Visualization. 115--123. https://doi.org/10.1109/INFVIS.2000.885098Google ScholarCross Ref
- I. T. Hawryszkiewycz. 1984. Database analysis and design. Science Research Associates.Google Scholar
- Paul Heckbert. 1982. Color Image Quantization for Frame Buffer Display. SIG GRAPH Comput. Graph. 16, 3 (1982), 297--307. https://doi.org/10.1145/965145.801294Google ScholarDigital Library
- F. Heimerl, Q. Han, S. Koch, and T. Ertl. 2016. CiteRivers: Visual Analytics of Citation Patterns. IEEE Transactions on Visualization and Computer Graphics 22, 1 (2016), 190--199. https://doi.org/10.1109/TVCG.2015.2467621Google ScholarDigital Library
- P. Isenberg, F. Heimerl, S. Koch, T. Isenberg, P. Xu, C. D. Stolper, M. Sedlmair, J. Chen, T. Möller, and J. Stasko. 2017. Vispubdata.org: A Metadata Collection About IEEE Visualization (VIS) Publications. IEEE Transactions on Visualization and Computer Graphics 23, 9 (2017), 2199--2206. https://doi.org/10.1109/TVCG.2016.2615308Google ScholarDigital Library
- P. Isenberg, T. Isenberg, M. Sedlmair, J. Chen, and T. Möller. 2017. Visualization as Seen through its Research Paper Keywords. IEEE Transactions on Visualization and Computer Graphics 23, 1 (2017), 771--780. https://doi.org/10.1109/TVCG.2016.2598827Google ScholarDigital Library
- H. Jänicke and M. Chen. 2010. A Salience-based Quality Metric for Visualization. Computer Graphics Forum 29, 3 (2010), 1183-1192. https://doi.org/10.1111/j.1467-8659.2009.01667.xGoogle ScholarDigital Library
- P. Joia, D. Coimbra, J. A. Cuminato, F. V. Paulovich, and L. G. Nonato. 2011. Local Affine Multidimensional Projection. IEEE Transactions on Visualization and Computer Graphics 17, 12 (2011), 2563--2571. https://doi.org/10.1109/TVCG.2011.220Google ScholarDigital Library
- Daniel Keim, Gennady Andrienko, Jean-Daniel Fekete, Carsten Görg, Jörn Kohlhammer, and Guy Melançon. 2008. Visual Analytics: Definition, Process, and Challenges. Lecture Notes in Computer Science, Vol. 4950. Springer Berlin Heidelberg, 154--175.Google Scholar
- K. Kucher and A. Kerren. 2015. Text visualization techniques: Taxonomy, visual survey, and community insights. In Proceedings of IEEE Pacific Visualization Symposium (PacificVis). 117--121. https://doi.org/10.1109/PACIFICVIS.2015.7156366Google ScholarCross Ref
- S. Latif and F. Beck. 2018. VIS Author Profiles: Interactive Descriptions of Publication Records Combining Text and Visualization. IEEE Transactions on Visualization and Computer Graphics (2018), 1--1. https://doi.org/10.1109/TVCG.2018.2865022Google ScholarDigital Library
- Y. Liang, X. Wang, S. Zhang, S. Hu, and S. Liu. 2018. PhotoRecomposer: Interactive Photo Recomposition by Cropping. IEEE Transactions on Visualization and Computer Graphics 24, 10 (2018), 2728--2742. https://doi.org/10.1109/TVCG.2017.2764895Google ScholarDigital Library
- J. Marino and A. Kaufman. 2016. Planar Visualization of Treelike Structures. IEEE Transactions on Visualization and Computer Graphics 22, 1 (2016), 906--915. https://doi.org/10.1109/TVCG.2015.2467413Google ScholarDigital Library
- L. E. Matzen, M. J. Haass, K. M. Divis, Z. Wang, and A. T. Wilson. 2018. Data Visualization Saliency Model: A Tool for Evaluating Abstract Data Visualizations. IEEE Transactions on Visualization and Computer Graphics 24, 1 (2018), 563--573. https://doi.org/10.1109/TVCG.2017.2743939Google ScholarCross Ref
- William Plant and Gerald Schaefer. 2011. Visualisation and Browsing of Image Databases. Springer Berlin Heidelberg, Berlin, Heidelberg, 3-57. https://doi.org/10.1007/978-3-642-19551-8_1Google Scholar
- J. F. Rodrigues, A. J. M. Traina, M. C. F. de Oliveira, and C. Traina. 2006. Reviewing Data Visualization: an Analytical Taxonomical Study. In Proceedings of Tenth International Conference on Information Visualisation. 713--720. https://doi.org/10.1109/IV.2006.94Google ScholarDigital Library
- H.J. Schulz. 2011. Treevis.net: A Tree Visualization Reference. IEEE Computer Graphics and Applications 31, 6 (2011), 11--15. https://doi.org/10.1109/MCG.2011.103Google ScholarDigital Library
- Qiaomu Shen, Wei Zeng, Yu Ye, Stefan Mueller Arisona, Simon Schubiger, Remo Burkhard, and Huamin Qu. 2018. StreetVizor: Visual Exploration of Human-Scale Urban Forms Based on Street Views. IEEE Transactions on Visualization and Computer Graphics 24, 1 (2018), 1004 - 1013. https://doi.org/10.1109/TVCG.2017.2744159Google ScholarCross Ref
- B Shneiderman. 1996. The eyes have it: a task by data type taxonomy for information visualizations. In Proceedings of IEEE Symposium on Visual Languages. IEEE, 336 - 343. https://doi.org/10.1109/VL.1996.545307Google ScholarCross Ref
- H. Strobelt, D. Oelke, C. Rohrdantz, A. Stoffel, D. A. Keim, and O. Deussen. 2009. Document Cards: A Top Trumps Visualization for Documents. IEEE Transactions on Visualization and Computer Graphics 15, 6 (2009), 1145--1152. https://doi.org/10.1109/TVCG.2009.139Google ScholarDigital Library
- L. Tan, Y. Song, S. Liu, and L. Xie. 2012. ImageHive: Interactive Content-Aware Image Summarization. IEEE Computer Graphics and Applications 32, 1 (2012), 46--55. https://doi.org/10.1109/MCG.2011.89Google ScholarDigital Library
- Paul van der Corput and Jarke J. van Wijk. 2017. Comparing Personal Image Collections with PICTuReVis. Computer Graphics Forum 36, 3 (2017), 295--304. https://doi.org/10.1111/cgf.13188Google ScholarDigital Library
- Yanhong Wu, Naveen Pitipornvivat, Jian Zhao, Sixiao Yang, Guowei Huang, and Huamin Qu. 2015. egoSlider: Visual Analysis of Egocentric Network Evolution. IEEE Transactions on Visualization and Computer Graphics 22, 1 (2015), 260 - 269. https://doi.org/10.1109/TVCG.2015.2468151Google ScholarDigital Library
- X. Xie, X. Cai, J. Zhou, N. Cao, and Y. Wu. 2018. A Semantic-based Method for Visualizing Large Image Collections. IEEE Transactions on Visualization and Computer Graphics (2018), 1--1. https://doi.org/10.1109/TVCG.2018.2835485Google Scholar
- J. Yang, J. Fan, D. Hubball, Y. Gao, H. Luo, W. Ribarsky, and M. Ward. 2006. Semantic Image Browser: Bridging Information Visualization with Automated Intelligent Image Analysis. In Proceedings of IEEE Symposium On Visual Analytics Science And Technology. 191--198. https://doi.org/10.1109/VAST.2006.261425Google Scholar
- Ka-Ping Yee, Kirsten Swearingen, Kevin Li, and Marti Hearst. 2003. Faceted metadata for image search and browsing. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 642681, 401--408. https://doi.org/10.1145/642611.642681Google ScholarDigital Library
Index Terms
- VIStory: Interactive Storyboard for Exploring Visual Information in Scientific Publications
Recommendations
VIStory: interactive storyboard for exploring visual information in scientific publications
AbstractMany visual analytics have been developed for examining scientific publications comprising wealthy data such as authors and citations. The studies provide unprecedented insights on a variety of applications, e.g., literature review and ...
FacetMap: A Scalable Search and Browse Visualization
The dominant paradigm for searching and browsing large data stores is text-based: presenting a scrollable list of search results in response to textual search term input. While this works well for the Web, there is opportunity for improvement in the ...
Document visualization: an overview of current research
As the number of sources and quantity of document information explodes, efficient and intuitive visualization tools are desperately needed to assist users in understanding the contents and features of a document, while discovering hidden information. ...
Comments