Abstract
In this chapter we seek to elevate the role of the human in human-machine cooperative analysis through a careful consideration of immersive design principles. We consider both strategic immersion through more accessible systems as well as enhanced understanding and control through immersive interfaces that enable rapid workflows. We extend the classic sensemaking loop from visual analytics to incorporate multiple views, scenarios, people, and computational agents. We consider both sides of machine/human collaboration: allowing the human to more fluidly control the machine process; and also allowing the human to understand the results, derive insights and continue the analytic cycle. We also consider system and algorithmic implications of enabling real-time control and feedback in immersive human-centered computational analytics.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Adams, E.: The designer’s notebook: Postmodernism and the 3 types of immersion (2004). http://www.gamasutra.com/view/feature/130531/the_designers_notebook_.php
Andrews, C., Endert, A., North, C.: Space to think: large high-resolution displays for sensemaking. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 55–64. ACM (2010)
Bavoil, L., et al.: Vistrails: enabling interactive multiple-view visualizations. In: IEEE Visualization, VIS 2005, pp. 135–142, October 2005. https://doi.org/10.1109/VISUAL.2005.1532788
Bradel, L., North, C., House, L., Leman, S.: Multi-model semantic interaction for text analytics. In: 2014 IEEE Conference on Visual Analytics Science and Technology (VAST), pp. 163–172, October 2014. https://doi.org/10.1109/VAST.2014.7042492
Card, S.K., Mackinlay, J.D., Shneiderman, B.: Readings in Information Visualization: Using Vision to Think. Morgan Kaufmann, San Francisco (1999)
Card, S.K., Robertson, G.G., Mackinlay, J.D.: The information visualizer, an information workspace. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 181–186. ACM (1991)
Carmack, J.: Latency mitigation strategies (2013). https://www.twentymilliseconds.com/post/latency-mitigation-strategies/
Ceneda, D., et al.: Characterizing guidance in visual analytics. IEEE Trans. Vis. Comput. Graph. 23(1), 111–120 (2017). https://doi.org/10.1109/TVCG.2016.2598468
Cernea, D., Ebert, A., Kerren, A.: A study of emotion-triggered adaptation methods for interactive visualization. In: UMAP 2013 Extended Proceedings: Late-Breaking Results, Project Papers and Workshop Proceedings of the 21st Conference on User Modeling, Adaptation, and Personalization. CEUR workshop proceedings, vol. 997, pp. 9–16. CEUR-WS.org (2013)
Chen, X., Self, J.Z., House, L., North, C.: Be the data: a new approach for immersive analytics. In: IEEE Virtual Reality Workshop on Immersive Analytics (2016)
Choo, J., Lee, C., Reddy, C.K., Park, H.: Utopian: user-driven topic modeling based on interactive nonnegative matrix factorization. IEEE Trans. Vis. Comput. Graph. 19(12), 1992–2001 (2013)
Chuang, J., Ramage, D., Manning, C., Heer, J.: Interpretation and trust: designing model-driven visualizations for text analysis. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 443–452. ACM (2012)
Chung, H., North, C., Joshi, S., Chen, J.: Four considerations for supporting visual analysis in display ecologies. In: 2015 IEEE Conference on Visual Analytics Science and Technology (VAST), pp. 33–40, October 2015
Collins, C., Carpendale, S.: Vislink: revealing relationships amongst visualizations. IEEE Trans. Vis. Comput. Graph. 13(6), 1192–1199 (2007). https://doi.org/10.1109/TVCG.2007.70521
Darragh, J.J., Witten, I.H.: Adaptive predictive text generation and the reactive keyboard. Interact. Comput. 3(1), 27–50 (1991)
Doleisch, H.: SimVis: interactive visual analysis of large and time-dependent 3D simulation data. In: Proceedings of the 39th Conference on Winter Simulation: 40 Years! The Best Is Yet to Come, pp. 712–720. IEEE Press (2007)
Endert, A., Han, C., Maiti, D., House, L., Leman, S., North, C.: Observation-level interaction with statistical models for visual analytics. In: 2011 IEEE Conference on Visual Analytics Science and Technology (VAST), pp. 121–130, October 2011
Endert, A., Fiaux, P., North, C.: Semantic interaction for sensemaking: inferring analytical reasoning for model steering. IEEE Trans. Vis. Comput. Graph. 18(12), 2879–2888 (2012)
Endert, A., Fox, S., Maiti, D., North, C.: The semantics of clustering: analysis of user-generated spatializations of text documents. In: Proceedings of the International Working Conference on Advanced Visual Interfaces, pp. 555–562. ACM (2012)
Endert, A., Hossain, M.S., Ramakrishnan, N., North, C., Fiaux, P., Andrews, C.: The human is the loop: new directions for visual analytics. J. Intell. Inf. Syst. 43(3), 411–435 (2014)
Fisher, D., Popov, I., Drucker, S., Schraefel, M.: Trust me, I’m partially right: incremental visualization lets analysts explore large datasets faster. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 1673–1682. ACM (2012)
Goodwin, S., Mears, C., Dwyer, T., de la Banda, M.G., Tack, G., Wallace, M.: What do constraint programming users want to see? Exploring the role of visualisation in profiling of models and search. IEEE Trans. Vis. Comput. Graph. 23(1), 281–290 (2017)
Heer, J., Mackinlay, J., Stolte, C., Agrawala, M.: Graphical histories for visualization: supporting analysis, communication, and evaluation. IEEE Trans. Vis. Comput. Graph. 14(6), 1189–1196 (2008). https://doi.org/10.1109/TVCG.2008.137
Heer, J., Shneiderman, B.: Interactive dynamics for visual analysis. Commun. ACM 55(4), 45–54 (2012). https://doi.org/10.1145/2133806.2133821
Heine, C., et al.: A survey of topology-based methods in visualization. Comput. Graph. Forum 35(3), 643–667 (2016)
Heun, V., von Kapri, A., Maes, P.: Perifoveal display: combining foveal and peripheral vision in one visualization. In: Proceedings of the 2012 ACM Conference on Ubiquitous Computing, UbiComp 2012, pp. 1150–1155. ACM (2012)
Hollan, J., Hutchins, E., Kirsh, D.: Distributed cognition: toward a new foundation for human-computer interaction research. ACM Trans. Comput. Hum. Interact. 7(2), 174–196 (2000)
Isenberg, P., Elmqvist, N., Scholtz, J., Cernea, D., Ma, K.L., Hagen, H.: Collaborative visualization: definition, challenges, and research agenda. Inf. Vis. 10(4), 310–326 (2011). https://doi.org/10.1177/1473871611412817
Jänicke, H., Böttinger, M., Tricoche, X., Scheuermann, G.: Automatic detection and visualization of distinctive structures in 3D unsteady multi-fields. Comput. Graph. Forum 27(3), 767–774 (2008)
Kerren, A., Schreiber, F.: Toward the role of interaction in visual analytics. In: Proceedings of the Winter Simulation Conference, WSC 2012, pp. 420:1–420:13 (2012). http://dl.acm.org/citation.cfm?id=2429759.2430303
Liu, J., Dwyer, T., Marriott, K., Millar, J., Haworth, A.: Understanding the relationship between interactive optimisation and visual analytics in the context of prostate brachytherapy. IEEE Trans. Vis. Comput. Graph. 24(1), 319–329 (2018)
Liu, Y., Jin, R., Jain, A.K.: Boostcluster: boosting clustering by pairwise constraints. In: Proceedings of the 13th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 450–459. ACM (2007)
MacKay, W.E.: Is paper safer? The role of paper flight strips in air traffic control. ACM Trans. Comput. Hum. Inter. 6(4), 311–340 (1999)
Mahyar, N., Tory, M.: Supporting communication and coordination in collaborative sensemaking. IEEE Trans. Vis. Comput. Graph. 20(12), 1633–1642 (2014). https://doi.org/10.1109/TVCG.2014.2346573
Makonin, S., McVeigh, D., Stuerzlinger, W., Tran, K., Popowich, F.: Mixed-initiative for big data: the intersection of human + visual analytics + prediction. In: 2016 49th Hawaii International Conference on System Sciences (HICSS), pp. 1427–1436. IEEE (2016)
McCrickard, D.S., Chewar, C.M., Somervell, J.P., Ndiwalana, A.: A model for notification systems evaluation-assessing user goals for multitasking activity. ACM Trans. Comput. Hum. Interact. (TOCHI) 10(4), 312–338 (2003)
Meignan, D., Knust, S., Frayret, J.M., Pesant, G., Gaud, N.: A review and taxonomy of interactive optimization methods in operations research. ACM Trans. Interact. Intell. Syst. (TiiS) 5(3), 17 (2015)
Miller, R.B.: Response time in man-computer conversational transactions. In: Proceedings of the December 9–11, 1968, Fall Joint Computer Conference, Part I, pp. 267–277. ACM (1968)
Ng, A., Lepinski, J., Wigdor, D., Sanders, S., Dietz, P.: Designing for low-latency direct-touch input. In: Proceedings of the 25th Annual ACM Symposium on User Interface Software and Technology, pp. 453–464. ACM (2012)
Nielsen, J.: Usability Engineering. Elsevier, Amsterdam (1994)
Nielsen, J.: Web-based application response time (2014). https://www.nngroup.com/articles/response-times-3-important-limits/
North, C., et al.: Understanding multi-touch manipulation for surface computing. In: Gross, T., et al. (eds.) INTERACT 2009, Part II. LNCS, vol. 5727, pp. 236–249. Springer, Heidelberg (2009). https://doi.org/10.1007/978-3-642-03658-3_31
Peck, S.M., North, C., Bowman, D.: A multiscale interaction technique for large, high-resolution displays. In: 2009 IEEE Symposium on 3D User Interfaces, pp. 31–38, March 2009
Pirolli, P., Card, S.: The sensemaking process and leverage points for analyst technology as identified through cognitive task analysis. In: Proceedings of International Conference on Intelligence Analysis, vol. 5, pp. 2–4 (2005)
Ragan, E.D., Endert, A., Sanyal, J., Chen, J.: Characterizing provenance in visualization and data analysis: an organizational framework of provenance types and purposes. IEEE Trans. Vis. Comput. Graph. 22(1), 31–40 (2016). https://doi.org/10.1109/TVCG.2015.2467551
Ragan, E.D., Sowndararajan, A., Kopper, R., Bowman, D.A.: The effects of higher levels of immersion on procedure memorization performance and implications for educational virtual environments. Presence Teleop. Virt. Environ. 19(6), 527–543 (2010)
Salzbrunn, T., Garth, C., Scheuermann, G., Meyer, J.: Pathline predicates and unsteady flow structures. Vis. Comput. 24(12), 1039–1051 (2008)
Sauer, F., Zhang, Y., Wang, W., Ethier, S., Ma, K.L.: Visualization techniques for studying large-scale flow fields from fusion simulations. IEEE Comput. Sci. Eng. 18(2), 68–77 (2016)
Shipman, F.M., Marshall, C.C.: Formality considered harmful: experiences, emerging themes, and directions on the use of formal representations in interactive systems. Comput. Support. Coop. Work (CSCW) 8(4), 333–352 (1999)
Silva, J.A., Faria, E.R., Barros, R.C., Hruschka, E.R., de Carvalho, A.C., Gama, J.: Data stream clustering: a survey. ACM Comput. Surv. (CSUR) 46(1), 13 (2013)
Simmhan, Y.L., Plale, B., Gannon, D., Marru, S.: Performance evaluation of the karma provenance framework for scientific workflows. In: Moreau, L., Foster, I. (eds.) IPAW 2006. LNCS, vol. 4145, pp. 222–236. Springer, Heidelberg (2006). https://doi.org/10.1007/11890850_23
Stahnke, J., Dörk, M., Müller, B., Thom, A.: Probing projections: interaction techniques for interpreting arrangements and errors of dimensionality reductions. IEEE Trans. Vis. Comput. Graph. 22(1), 629–638 (2016)
Streit, M., Schulz, H.J., Lex, A., Schmalstieg, D., Schumann, H.: Model-driven design for the visual analysis of heterogeneous data. IEEE Trans. Vis. Comput. Graph. 18(6), 998–1010 (2012). https://doi.org/10.1109/TVCG.2011.108
Tatu, A., et al.: Subspace search and visualization to make sense of alternative clusterings in high-dimensional data. In: IEEE Conference on Visual Analytics Science and Technology (VAST), pp. 63–72. IEEE (2012)
Thieke, C., et al.: A new concept for interactive radiotherapy planning with multicriteria optimization: first clinical evaluation. Radiother. Oncol. 85(2), 292–298 (2007)
Van Wijk, J.J., Nuij, W.A.A.: Smooth and efficient zooming and panning. In: Proceedings of the Ninth Annual IEEE Conference on Information Visualization, INFOVIS 2003, pp. 15–22. IEEE Computer Society (2003)
Wongsuphasawat, K., Moritz, D., Anand, A., Mackinlay, J., Howe, B., Heer, J.: Voyager: exploratory analysis via faceted browsing of visualization recommendations. IEEE Trans. Vis. Comput. Graph. 22(1), 649–658 (2016)
Zaman, L., et al.: GEM-NI: a system for creating and managing alternatives in generative design. In: Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, pp. 1201–1210. ACM (2015)
Zimmer, B., Kerren, A.: Ongrax: a web-based system for the collaborative visual analysis of graphs. J. Graph Algorithm. Appl. 21(1), 5–27 (2017). https://doi.org/10.7155/jgaa.00399
Cetin, G., Stuerzlinger, W., Dill, J.: Visual analytics on large displays: exploring user spatialization and how size and resolution affect task performance. In: IEEE Symposium on Big Data Visual Analytics (BDVA 2018), 10 p. (2018, to appear)
El Meseery, M., Wu, Y., Stuerzlinger, W.: Multiple workspaces in visual analytics In: IEEE Symposium on Big Data Visual Analytics (BDVA 2018), 12 p. (2018, to appear)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2018 Springer Nature Switzerland AG
About this chapter
Cite this chapter
Stuerzlinger, W., Dwyer, T., Drucker, S., Görg, C., North, C., Scheuermann, G. (2018). Immersive Human-Centered Computational Analytics. In: Marriott, K., et al. Immersive Analytics. Lecture Notes in Computer Science(), vol 11190. Springer, Cham. https://doi.org/10.1007/978-3-030-01388-2_5
Download citation
DOI: https://doi.org/10.1007/978-3-030-01388-2_5
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-01387-5
Online ISBN: 978-3-030-01388-2
eBook Packages: Computer ScienceComputer Science (R0)