Michael Correll
Dominik Moritz
Jeffrey Heer
ABSTRACT
Understanding uncertainty is critical for many analytical tasks. One common approach is to encode data values and uncertainty values independently, using two visual variables. These resulting bivariate maps can be difficult to interpret, and interference between visual channels can reduce the discriminability of marks. To address this issue, we contribute Value-Suppressing Uncertainty Palettes (VSUPs). VSUPs allocate larger ranges of a visual channel to data when uncertainty is low, and smaller ranges when uncertainty is high. This non-uniform budgeting of the visual channels makes more economical use of the limited visual encoding space when uncertainty is low, and encourages more cautious decision-making when uncertainty is high. We demonstrate several examples of VSUPs, and present a crowdsourced evaluation showing that, compared to traditional bivariate maps, VSUPs encourage people to more heavily weight uncertainty information in decision-making tasks.
- Jürgen Bernard, Martin Steiger, Sebastian Mittelstädt, Simon Thum, Daniel Keim, and Jörn Kohlhammer. 2015. A survey and task-based quality assessment of static 2D colormaps. In SPIE/IS&T Electronic Imaging. International Society for Optics and Photonics, 93970M--93970M.Google Scholar
- David Borland and Russell M Taylor II. 2007. Rainbow color map (still) considered harmful. IEEE Computer Graphics and Applications 27, 2 (2007). Google ScholarDigital Library
- Michael Bostock, Vadim Ogievetsky, and Jeffrey Heer. 2011. D3 data-driven documents. IEEE Transactions on Visualization and Computer Graphics 17, 12 (2011), 2301--2309. Google ScholarDigital Library
- Nadia Boukhelifa, Anastasia Bezerianos, Tobias Isenberg, and Jean-Daniel Fekete. 2012. Evaluating sketchiness as a visual variable for the depiction of qualitative uncertainty. IEEE Transactions on Visualization and Computer Graphics 18, 12 (2012), 2769--2778. Google ScholarDigital Library
- Nadia Boukhelifa and David John Duke. 2009. Uncertainty visualization: why might it fail?. In CHI'09 Extended Abstracts on Human Factors in Computing Systems. ACM, 4051--4056. Google ScholarDigital Library
- Ken Brodlie, Rodolfo Allendes Osorio, and Adriano Lopes. 2012. A review of uncertainty in data visualization. In Expanding the frontiers of visual analytics and visualization. Springer, 81--109.Google Scholar
- Barbara Buttenfield and M Kate Beard. 1994. Graphical and geographical components of data quality. Visualization in geographic information systems (1994), 150--157.Google Scholar
- Michael Correll, Adam L Bailey, Alper Sarikaya, David H O'Connor, and Michael Gleicher. 2015. LayerCake: a tool for the visual comparison of viral deep sequencing data. Bioinformatics (2015), btv407.Google Scholar
- Michael Correll, Subhadip Ghosh, David O'Connor, and Michael Gleicher. 2011. Visualizing virus population variability from next generation sequencing data. In 2011 IEEE Symposium on Biological Data Visualization (BioVis). IEEE, 135--142. Google ScholarDigital Library
- Michael Correll and Michael Gleicher. 2014. Error bars considered harmful: Exploring alternate encodings for mean and error. IEEE Transactions on Visualization and Computer Graphics 20, 12 (2014), 2142--2151.Google ScholarCross Ref
- Michael Correll and Jeffrey Heer. 2017. Surprise! Bayesian Weighting for De-Biasing Thematic Maps. IEEE Transactions on Visualization and Computer Graphics 23, 1 (2017), 651--660. Google ScholarDigital Library
- Jonathan Cox, Donald House, and Michael Lindell. 2013. Visualizing uncertainty in predicted hurricane tracks. International Journal for Uncertainty Quantification 3, 2 (2013).Google ScholarCross Ref
- Michael W Dobson. 1973. Choropleth maps without class intervals?: a comment. Geographical Analysis 5, 4 (1973), 358--360.Google ScholarCross Ref
- Richard Dunn. 1989. A dynamic approach to two-variable color mapping. The American Statistician 43, 4 (1989), 245--252.Google Scholar
- W. R. Garner and G. L. Felfoldy. 1970. Integrality of stimulus dimensions in various types of information processing. Cognitive Psychology 1, 3 (1970), 225--241.Google ScholarCross Ref
- Michael Gleicher, Danielle Albers, Rick Walker, Ilir Jusufi, Charles D Hansen, and Jonathan C Roberts. 2011. Visual comparison for information visualization. Information Visualization 10, 4 (2011), 289--309. Google ScholarDigital Library
- N Goldstein. 1994. The Associated Press Stylebook and Libel Manual. Fully Revised and Updated. ERIC.Google Scholar
- Miriam Greis, Passant El Agroudy, Hendrik Schuff, Tonja Machulla, and Albrecht Schmidt. 2016. Decision-Making under Uncertainty: How the Amount of Presented Uncertainty Influences User Behavior. In Proceedings of the 9th Nordic Conference on Human-Computer Interaction. ACM, 52. Google ScholarDigital Library
- Miriam Greis, Jessica Hullman, Michael Correll, Matthew Kay, and Orit Shaer. 2017. Designing for Uncertainty in HCI: When Does Uncertainty Help?. In Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems. ACM, 593--600. Google ScholarDigital Library
- Henning Griethe, Heidrun Schumann, and others. 2006. The visualization of uncertain data: Methods and problems. In SimVis. 143--156.Google Scholar
- LeGrand H Hardy, Gertrude Rand, and M Catherine Rittler. 1945. Tests for the detection and analysis of color-blindness. I. The Ishihara test: an evaluation. JOSA 35, 4 (1945), 268--275.Google ScholarCross Ref
- Mark Harrower and Cynthia A Brewer. 2003. ColorBrewer. org: an online tool for selecting colour schemes for maps. The Cartographic Journal 40, 1 (2003), 27--37.Google ScholarCross Ref
- Tomislav Hengl and Norair Toomanian. 2006. Maps are not what they seem: representing uncertainty in soil-property maps. In Proc. Accuracy. 805--813.Google Scholar
- Jessica Hullman, Paul Resnick, and Eytan Adar. 2015. Hypothetical outcome plots outperform error bars and violin plots for inferences about reliability of variable ordering. PloS one 10, 11 (2015), e0142444.Google ScholarCross Ref
- Daniel Kahneman and Amos Tversky. 1979. Prospect theory: An analysis of decision under risk. Econometrica: Journal of the econometric society (1979), 263--291.Google Scholar
- Lydia R Lucchesi and Christopher K Wikle. 2017. Visualizing uncertainty in areal data with bivariate choropleth maps, map pixelation and glyph rotation. Stat (2017).Google Scholar
- Alan M MacEachren, Robert E Roth, James O'Brien, Bonan Li, Derek Swingley, and Mark Gahegan. 2012. Visual semiotics & uncertainty visualization: An empirical study. IEEE Transactions on Visualization and Computer Graphics 18, 12 (2012), 2496--2505. Google ScholarDigital Library
- Jock Mackinlay. 1986. Automating the design of graphical presentations of relational information. Acm Transactions On Graphics (Tog) 5, 2 (1986), 110--141. Google ScholarDigital Library
- Carter A Mandrik and Yeqing Bao. 2005. Exploring the concept and measurement of general risk aversion. NA-Advances in Consumer Research Volume 32 (2005).Google Scholar
- Leonard Mlodinow. 2009. The drunkard's walk: How randomness rules our lives. Vintage. 81--104 pages.Google Scholar
- Dominik Moritz, Danyel Fisher, Bolin Ding, and Chi Wang. 2017. Trust, but Verify: Optimistic Visualizations of Approximate Queries for Exploring Big Data. In Proceedings of the 33rd annual ACM conference on Human factors in computing systems. ACM. Google ScholarDigital Library
- Jean-Claude Muller. 1979. Perception of Continuously Shaded Maps. Annals of the Association of American Geographers 69, 2 (1979), 240--249.Google ScholarCross Ref
- Bureau of Transportation Statistics. 2016. Airline Delays, Cancellations and Tarmac Times. (2016). http://www.rita.dot.gov/bts/data_and_statistics/by_mode/airline_and_airports/airline_delay.htmlGoogle Scholar
- Lace Padilla, P Samuel Quinan, Miriah Meyer, and Sarah H Creem-Regehr. 2017. Evaluating the Impact of Binning 2D Scalar Fields. IEEE Transactions on Visualization and Computer Graphics 23, 1 (2017), 431--440. Google ScholarDigital Library
- Maria Riveiro. 2007. Evaluation of uncertainty visualization techniques for information fusion. In 10th International Conference on Information Fusion. IEEE, 1--8.Google ScholarCross Ref
- Philip K Robertson and John F O'Callaghan. 1986. The generation of color sequences for univariate and bivariate mapping. IEEE Computer Graphics and Applications 6, 2 (1986), 24--32. Google ScholarDigital Library
- Bernice E Rogowitz and Alan D Kalvin. 2001. The "Which Blair Project": a quick visual method for evaluating perceptual color maps. In Visualization, 2001. VIS'01. Proceedings. IEEE, 183--556. Google ScholarDigital Library
- Bernice E Rogowitz, Lloyd A Treinish, Steve Bryson, and others. 1996. How not to lie with visualization. Computers in Physics 10, 3 (1996), 268--273. Google ScholarDigital Library
- Robert E Roth, Andrew W Woodruff, and Zachary F Johnson. 2010. Value-by-alpha maps: An alternative technique to the cartogram. The Cartographic Journal 47, 2 (2010), 130--140.Google ScholarCross Ref
- Maureen Stone, Danielle Albers Szafir, and Vidya Setlur. 2014. An engineering model for color difference as a function of size. In Color and Imaging Conference, Vol. 2014. Society for Imaging Science and Technology, 253--258.Google Scholar
- Nassim Nicholas Taleb and Mark Blyth. 2011. The black swan of Cairo: How suppressing volatility makes the world less predictable and more dangerous. Foreign Affairs (2011), 33--39.Google Scholar
- Judi Thomson, Elizabeth Hetzler, Alan MacEachren, Mark Gahegan, and Misha Pavel. 2005. A typology for visualizing uncertainty. In Electronic Imaging 2005. International Society for Optics and Photonics, 146--157.Google Scholar
- Bruce E Trumbo. 1981. A theory for coloring bivariate statistical maps. The American Statistician 35, 4 (1981), 220--226.Google ScholarCross Ref
- Archie Tse. 2016. Why We Are Doing Fewer Interactives. (2016). https://github.com/archietse/malofiej-2016/ blob/master/tse-malofiej-2016-slides.pdf Malofiej.Google Scholar
- Amos Tversky and Daniel Kahneman. 1985. The framing of decisions and the psychology of choice. In Environmental Impact Assessment, Technology Assessment, and Risk Analysis. Springer, 107--129.Google Scholar
- Stéfan van der Walt and Nathaniel Smith. 2015. mpl colormaps. https://bids.github.io/colormap/, (2015).Google Scholar
- Howard Wainer and Carl M Francolini. 1980. An Empirical Inquiry Concerning Human Understanding of Two-Variable Color Maps. American Statistician (1980), 81--93.Google Scholar
- Colin Ware. 1988. Color sequences for univariate maps: Theory, experiments and principles. IEEE Computer Graphics and Applications 8, 5 (1988), 41--49. Google ScholarDigital Library
- Colin Ware. 2009. Quantitative texton sequences for legible bivariate maps. IEEE Transactions on Visualization and Computer Graphics 15, 6 (2009). Google ScholarDigital Library
- Colin Ware. 2012. Information visualization: perception for design. Elsevier. Google ScholarDigital Library
- Wikipedia. 2017. Statewide opinion polling for the United States presidential election, 2016. (2017). https: //en.wikipedia.org/wiki/Statewide_opinion_polling_for_the_United_States_presidential_election,_2016Google Scholar
Index Terms
- Value-Suppressing Uncertainty Palettes
Recommendations
Special Section on Uncertainty and Parameter Space Analysis in Visualization: Uncertainty estimation and visualization in probabilistic segmentation
Probabilistic segmentation is concerned with handling imperfections of image segmentation algorithms. They assign to each voxel and each segment a probability that the voxel belongs to the segment. This is often the starting point for estimating and ...
A Spreadsheet Approach to Facilitate Visualization of Uncertainty in Information
Information uncertainty is inherent in many problems and is often subtle and complicated to understand. While visualization is a powerful means for exploring and understanding information, information uncertainty visualization is ad hoc and not ...
Revealing uncertainty for information visualization
AVI '08: Proceedings of the working conference on Advanced visual interfacesUncertainty in data occurs in domains ranging from natural science to medicine to computer science. By developing ways to include uncertainty in our information visualizations we can provide more accurate visual depictions of critical datasets. One ...
Comments