Abstract
Layout design for multiple-view visualization (MV) concerns primarily how to arrange views in layouts that are geometrically and topologically plausible. Guidelines for MV layout design suggest considerations on various design factors, including view (e.g., bar and line charts), viewport (e.g., mobile vs. desktop), and coordination (e.g., exploration vs. comparison), along with expertise and preference of the designer. Recent studies have revealed the diverse space of MV layout design via statistical analysis on empirical MVs, yet neglect the effects of those design factors. To address the gap, this work proposes to model the effects of design factors on MV layouts via Bayesian probabilistic inference. Specifically, we access three important properties of MV layout, i.e., maximum area ratio and weighted average aspect ratio as geometric metrics, and layout topology as a topological metric. We update the posterior probability of layout metrics given design factors by penetrating MVs from recent visualization publications. The analyses reveal many insightful MV layout design patterns, such as views in coordination type of comparison exhibit more balanced area ratio, while those for exploration are more scattered. This work makes a prominent starting point for a thorough understanding of MV layout design patterns. On the basis, we discuss how practitioners can use Bayesian inference approach for future research on finer-annotated visualization datasets and more comprehensive design factors and properties.
Graphic Abstract
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Al-maneea HM, Roberts JC (2019) Towards quantifying multiple view layouts in visualisation as seen from research publications. pp 121–121. https://doi.org/10.1109/VISUAL.2019.8933655
Bederson BB, Shneiderman B, Wattenberg M (2002) Ordered and quantum treemaps: making effective use of 2D space to display hierarchies. ACM Trans Graph 21(4):833–854. https://doi.org/10.1145/571647.571649
Borkin MA, Vo AA, Bylinskii Z, Isola P, Sunkavalli S, Oliva A, Pfister H (2013) What makes a visualization memorable? IEEE Trans Vis Comput Graph 19(12):2306–2315. https://doi.org/10.1109/TVCG.2013.234
Brehmer M, Lee B, Isenberg P, Choe EK (2019) Visualizing ranges over time on mobile phones: a task-based crowdsourced evaluation. IEEE Trans Vis Comput Graph 25(1):619–629. https://doi.org/10.1109/TVCG.2018.2865234
Card SK, Mackinlay JD, Shneiderman B (1999) Readings in information visualization: using vision to think. Morgan Kaufmann, Burlington
Chen J, Ling M, Li R, Isenberg P, Isenberg T, Sedlmair M, Moller T, Laramee RS, Shen HW, Wunsche K, Wang Q (2021a) VIS30K: a collection of figures and tables from IEEE visualization conference publications. IEEE Trans Vis Comput Graph. https://doi.org/10.1109/TVCG.2021.3054916
Chen R, Shu X, Chen J, Weng D, Tang J, Fu S, Wu Y (2021b) Nebula: a coordinating grammar of graphics. IEEE Trans Vis Comput Graph. https://doi.org/10.1109/TVCG.2021.3076222
Chen X, Zeng W, Lin Y, AI-maneea HM, Roberts J, Chang R, (2021c) Composition and configuration patterns in multiple-view visualizations. IEEE Trans Vis Comput Graph 27(2):1514–1524. https://doi.org/10.1109/TVCG.2020.3030338
Deka B, Huang Z, Kumar R (2016) ERICA: interaction mining mobile apps. In: Proceedings of the 29th annual symposium on user interface software and technology, pp 767–776. https://doi.org/10.1145/2984511.2984581
Dudley JJ, Jacques JT, Kristensson PO (2019) Crowdsourcing interface feature design with bayesian optimization. In: Proceedings of the 2019 chi conference on human factors in computing systems, pp 252:1–12. https://doi.org/10.1145/3290605.3300482
Gleicher M, Albers D, Walker R, Jusufi I, Hansen CD, Roberts JC (2011) Visual comparison for information visualization. Inf Vis 10(4):289–309. https://doi.org/10.1177/1473871611416549
Grammel L, Tory M, Storey M (2010) How information visualization novices construct visualizations. IEEE Trans Vis Comput Graph 16(6):943–952. https://doi.org/10.1109/TVCG.2010.164
Heer J, van Ham F, Carpendale S, Weaver C, Isenberg P (2008) Creation and collaboration: engaging new audiences for information visualization. In: Information visualization, pp 92–133. https://doi.org/10.1007/978-3-540-70956-5_5
Horak T, Mathisen A, Klokmose CN, Dachselt R, Elmqvist N (2019) Vistribute: Distributing interactive visualizations in dynamic multi-device setups. In: Proceedings of the 2019 CHI conference on human factors in computing systems, pp 616: 1–13. https://doi.org/10.1145/3290605.3300846
Kim H, Moritz D, Hullman J (2021) Design patterns and trade-offs in responsive visualization for communication. Comput Graph Forum 40(3):459–470. https://doi.org/10.1111/cgf.14321
Kister U, Klamka K, Tominski C, Dachselt R (2017) GraSp: combining spatially-aware mobile devices and a display wall for graph visualization and interaction. Comput Graph Forum 36(3):503–514. https://doi.org/10.1111/cgf.13206
Langner R, Horak T, Dachselt R (2018) VisTiles: coordinating and combining co-located mobile devices for visual data exploration. IEEE Trans Vis Comput Graph 24(1):626–636. https://doi.org/10.1109/tvcg.2017.2744019
Langner R, Kister U, Dachselt R (2019) Multiple coordinated views at large displays for multiple users: empirical findings on user behavior, movements, and distances. IEEE Trans Vis Comput Graph 25(1):608–618. https://doi.org/10.1109/TVCG.2018.2865235
Lee C, Kim S, Han D, Yang H, Park YW, Kwon BC, Ko S (2020) GUIComp: a GUI design assistant with real-time, multi-faceted feedback. In: Proceedings of the 2020 CHI conference on human factors in computing systems, pp 1–13. https://doi.org/10.1145/3313831.3376327
Lohse GL, Biolsi K, Walker N, Rueter HH (1994) A classification of visual representations. Commun ACM 37(12):36–50. https://doi.org/10.1145/198366.198376
Lu M, Wang C, Lanir J, Zhao N, Pfister H, Cohen-Or D, Huang H (2020) Exploring visual information flows in infographics. In: Proceedings of the 2020 CHI conference on human factors in computing systems, pp 1–12. https://doi.org/10.1145/3313831.3376263
L’Yi S, Jo J, Seo J (2021) Comparative layouts revisited: design space, guidelines, and future directions. IEEE Trans Vis Comput Graph 27(2):1525–1535. https://doi.org/10.1109/TVCG.2020.3030419
Michalek J, Choudhary R, Papalambros P (2002) Architectural layout design optimization. Eng Optim 34:461–484. https://doi.org/10.1080/03052150214016
North C, Shneiderman B (1997) A taxonomy of multiple window coordinations. Technical report
Pan J, Chen W, Zhao X, Zhou S, Zeng W, Zhu M, Chen J, Fu S, Wu Y (2021) Exemplar-based layout fine-tuning for node-link diagrams. IEEE Trans Vis Comput Graph 27(2):1655–1665. https://doi.org/10.1109/TVCG.2020.3030393
Perhac J, Zeng W, Asada S, Burkhard R, Mueller Arisona S, Schubiger S, Klein B (2017) Urban fusion: visualizing urban data fused with social feeds via a game engine. In: Proceedings of 21st international conference on information visualisation, pp 312–317. https://doi.org/10.1109/iV.2017.33
Pretorius AJ, van Wijk JJ (2009) What does the user want to see? What do the data want to be? Inf Vis 8(3):153–166. https://doi.org/10.1057/ivs.2009.13
Qin X, Luo Y, Tang N, Li G (2020) Making data visualization more efficient and effective: a survey. VLDB J 29(1):93–117. https://doi.org/10.1007/s00778-019-00588-3
Qu Z, Hullman J (2018) Keeping multiple views consistent: constraints, validations, and exceptions in visualization authoring. IEEE Trans Vis Comput Graph 24(1):468–477. https://doi.org/10.1109/tvcg.2017.2744198
Roberts JC (2007) State of the art: Coordinated multiple views in exploratory visualization. In: Proceedings of international conference on coordinated and multiple views in exploratory visualization (CMV 2007), pp 61–71. https://doi.org/10.1109/CMV.2007.20
Roberts JC, Ritsos PD, Badam SK, Brodbeck D, Kennedy J, Elmqvist N (2014) Visualization beyond the desktop-the next big thing. IEEE Comput Graph Appl 34(6):26–34. https://doi.org/10.1109/MCG.2014.82
Sadana R, Stasko J (2016) Designing multiple coordinated visualizations for tablets. Comput Graph Forum 35(3):261–270. https://doi.org/10.1111/cgf.12902
Scherr M (2008) Multiple and coordinated views in information visualization. Trends Inf Vis 38:1–33
Shen Q, Zeng W, Ye Y, Mueller Arisona S, Schubiger S, Burkhard R, Qu H (2018) StreetVizor: visual exploration of human-scale urban forms based on street views. IEEE Trans Vis Comput Graph 24(1):1004–1013. https://doi.org/10.1109/TVCG.2017.2744159
Shneiderman B (1996) The eyes have it: a task by data type taxonomy for information visualizations. In: Proceedings of IEEE symposium on visual languages, pp 336–343. https://doi.org/10.1016/B978-155860915-0/50046-9
Swearngin A, Dontcheva M, Li W, Brandt J, Dixon M, Ko AJ (2018) Rewire: interface design assistance from examples. In: Proceedings of the 2018 CHI conference on human factors in computing systems, pp 1–12. https://doi.org/10.1145/3173574.3174078
Talton J, Yang L, Kumar R, Lim M, Goodman N, Měch R (2012) Learning design patterns with Bayesian grammar induction. In: Proceedings of the 25th annual ACM symposium on user interface software and technology, pp 63–74. https://doi.org/10.1145/2380116.2380127
Wang Baldonado MQ, Woodruff A, Kuchinsky A (2000) Guidelines for using multiple views in information visualization. In: Proceedings of the working conference on advanced visual interfaces, pp 110–119. https://doi.org/10.1145/345513.345271
Wu W, Fan L, Liu L, Wonka P (2018) MIQP-based layout design for building interiors. Comput Graph Forum 37(2):511–521. https://doi.org/10.1111/cgf.13380
Wu A, Tong W, Dwyer T, Lee B, Isenberg P, Qu H (2020) MobileVisFixer: tailoring web visualizations for mobile phones leveraging an explainable reinforcement learning framework. IEEE Trans Vis Comput Graph 27(2):464–474. https://doi.org/10.1109/TVCG.2020.3030423
Xia JZ, Chen T, Zhang L, Chen W, Chen Y, Zhang X, Xie C, Schreck T (2020a) SMAP: A joint dimensionality reduction scheme for secure multi-party visualization. In: Proceedings of IEEE conference on visual analytics science and technology (VAST), pp 107–118. https://doi.org/10.1109/VAST50239.2020.00015
Xia JZ, Zhang YH, Ye H, Wang Y, Jiang G, Zhao Y, Xie C, Kui XY, Liao SH, Wang WP (2020b) SuPoolVisor: a visual analytics system for mining pool surveillance. Front Inf Technol Electron Eng 21:507–523. https://doi.org/10.1631/FITEE.1900532
Yang YL, Wang J, Vouga E, Wonka P (2013) Urban pattern: layout design by hierarchical domain splitting. ACM Trans Graph 32(6):1–12. https://doi.org/10.1145/2508363.2508405
Zeng W, Ye Y (2018) VitalVizor: a visual analytics system for studying urban vitality. IEEE Comput Graph Appl 38(5):38–53. https://doi.org/10.1109/MCG.2018.053491730
Zeng W, Dong A, Chen X, Cheng Z (2021a) VIStory: interactive storyboard for exploring visual information in scientific publications. J Vis 24(1):69–84. https://doi.org/10.1007/s12650-020-00688-1
Zeng W, Lin C, Lin J, Jiang J, Xia J, Turkay C, Chen W (2021b) Revisiting the modifiable areal unit problem in deep traffic prediction with visual analytics. IEEE Trans Vis Comput Graph 27(2):839–848. https://doi.org/10.1109/TVCG.2020.3030410
Zhang C, Zeng W, Liu L (2021) UrbanVR: an immersive analytics system for context-aware urban design. Comput Graph 99:128–138. https://doi.org/10.1016/j.cag.2021.07.006
Acknowledgements
The authors wish to thank the reviewers for their valuable comments. This work is supported by Guangdong Basic and Applied Basic Research Foundation (2021A1515011700).
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Shao, L., Chu, Z., Chen, X. et al. Modeling layout design for multiple-view visualization via Bayesian inference. J Vis 24, 1237–1252 (2021). https://doi.org/10.1007/s12650-021-00781-z
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12650-021-00781-z