skip to main content
10.1145/3554944.3554947acmotherconferencesArticle/Chapter ViewAbstractPublication PagesvinciConference Proceedingsconference-collections
research-article

Accelerating GPU Rendering of 2D Visualizations Using Resolution Scaling and Temporal Reconstruction

Published: 31 October 2022 Publication History

Abstract

Data visualization relies on efficient rendering to allow users to interactively explore and understand their data. However, achieving interactive frame rates is often challenging, especially for high-resolution displays or large datasets. In computer graphics, several methods temporally reconstruct full-resolution images from multiple consecutive lower-resolution frames. Besides providing temporal image stability, they amortize the rendering costs over multiple frames and thus improve the minimum frame rate. We present a method that adopts this idea to accelerate 2D information visualization, without requiring any changes to the rendering itself. By exploiting properties of orthographic projection, our method significantly improves rendering performance while minimizing the loss of image quality during camera manipulation. For static scenes, it quickly converges to the full-resolution image. We discuss the characteristics of our method concerning rendering performance and image quality and the corresponding trade-offs. Finally, we present extensive rendering benchmarks to examine real-world performance for examples of parallel coordinates and scatterplot matrix visualizations, and discuss appropriate application scenarios and contraindications for usage.

Supplementary Material

Benchmark results for Parallel Coordinates Plot (PCP) renderer and Scatterplot Matrix (SPLOM) renderer (a8-supplements.zip)
MP4 File (vinci22-2.mp4)
Supplemental video

References

[1]
Stephen J. Adelson and Larry F. Hodges. 1995. Generating exact ray-traced animation frames by reprojection. IEEE Computer Graphics and Applications 15, 3 (May 1995), 43–52. https://doi.org/10.1109/38.376612
[2]
Advanced Micro Devices. 2021. FidelityFX Super Resolution 1.0 (FSR). Retrieved April 27, 2022 from https://github.com/GPUOpen-Effects/FidelityFX-FSR
[3]
Dheeru Dua and Casey Graff. 2017. UCI Machine Learning Repository. http://archive.ics.uci.edu/ml
[4]
Steffen Frey, Filip Sadlo, Kwan-Liu Ma, and Thomas Ertl. 2014. Interactive Progressive Visualization with Space-Time Error Control. IEEE Transactions on Visualization and Computer Graphics 20, 12 (Dec. 2014), 2397–2406. https://doi.org/10.1109/tvcg.2014.2346319
[5]
Patrick Gralka, Michael Becher, Matthias Braun, Florian Frieß, Christoph Müller, Tobias Rau, Karsten Schatz, Christoph Schulz, Michael Krone, Guido Reina, and Thomas Ertl. 2019. MegaMol – A Comprehensive Prototyping Framework for Visualizations. The European Physical Journal Special Topics 227, 14 (Mar 2019), 1817–1829. https://doi.org/10.1140/epjst/e2019-800167-5
[6]
Moritz Heinemann, Steffen Frey, Gleb Tkachev, Alexander Straub, Filip Sadlo, and Thomas Ertl. 2021. Visual analysis of droplet dynamics in large-scale multiphase spray simulations. Journal of Visualization 24, 5 (May 2021), 943–961. https://doi.org/10.1007/s12650-021-00750-6
[7]
J. Heinrich, S. Bachthaler, and D. Weiskopf. 2011. Progressive Splatting of Continuous Scatterplots and Parallel Coordinates. Computer Graphics Forum 30, 3 (June 2011), 653–662. https://doi.org/10.1111/j.1467-8659.2011.01914.x
[8]
Brian Karis. 2014. High-Quality Temporal Supersampling. Retrieved April 21, 2022 from http://advances.realtimerendering.com/s2014/#_HIGH-QUALITY_TEMPORAL_SUPERSAMPLING
[9]
Christian Kelleter, Timon Burghardt, Hansgeorg Binz, Lucio Blandini, and Werner Sobek. 2020. Adaptive Concrete Beams Equipped With Integrated Fluidic Actuators. Frontiers in Built Environment 6 (July 2020), 1–13. https://doi.org/10.3389/fbuil.2020.00091
[10]
Daniel Limberger, Karsten Tausche, Johannes Linke, and Jürgen Döllner. 2018. Progressive Rendering Using Multi-frame Sampling. In GPU Pro 360: Guide to Rendering, Wolfgang Engel (Ed.). A K Peters/CRC Press, Chapter 32, 537–553. https://doi.org/10.1201/9781351261524
[11]
Edward Liu. 2020. DLSS 2.0 - Image reconstruction for real-time rendering with deep learning. Retrieved April 21, 2022 from http://behindthepixels.io/assets/files/DLSS2.0.pdf
[12]
Elek Ludvigh and James W. Miller. 1958. Study of Visual Acuity during the Ocular Pursuit of Moving Test Objects I Introduction*. Journal of the Optical Society of America 48, 11 (Nov. 1958), 799–802. https://doi.org/10.1364/josa.48.000799
[13]
Jalal El Mansouri. 2016. Rendering ’Rainbow Six Siege’. Retrieved April 21, 2022 from https://www.gdcvault.com/play/1022990/Rendering-Rainbow-Six-Siege
[14]
Trapper Mcferron and Adam Lake. 2018. Checkerboard Rendering for Real-Time Upscaling on Intel Integrated Graphics. Technical Report.
[15]
James W. Miller. 1958. Study of Visual Acuity during the Ocular Pursuit of Moving Test Objects II Effects of Direction of Movement, Relative Movement, and Illumination*. Journal of the Optical Society of America 48, 11 (Nov. 1958), 803–808. https://doi.org/10.1364/josa.48.000803
[16]
Kaloian Petkov and Arie E. Kaufman. 2016. Frameless Volume Visualization. IEEE Transactions on Visualization and Computer Graphics 22, 2 (Feb. 2016), 1076–1087. https://doi.org/10.1109/tvcg.2015.2440262
[17]
Daniel Scherzer, Lei Yang, Oliver Mattausch, Diego Nehab, Pedro V. Sander, Michael Wimmer, and Elmar Eisemann. 2011. A Survey on Temporal Coherence Methods in Real-Time Rendering, N. John and B. Wyvill (Eds.). Eurographics 2011 - State of the Art Reports, 101–126. https://doi.org/10.2312/EG2011/STARS/101-126
[18]
B. Shneiderman and C. Plaisant. 2010. Designing the User Interface: Strategies for Effective Human-computer Interaction. Addison-Wesley.
[19]
Z. Wang, A.C. Bovik, H.R. Sheikh, and E.P. Simoncelli. 2004. Image Quality Assessment: From Error Visibility to Structural Similarity. IEEE Transactions on Image Processing 13, 4 (April 2004), 600–612. https://doi.org/10.1109/tip.2003.819861
[20]
Kai Xiao, Gabor Liktor, and Karthik Vaidyanathan. 2018. Coarse pixel shading with temporal supersampling. In Proceedings of the ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games. ACM, 1–7. https://doi.org/10.1145/3190834.3190850
[21]
Lei Xiao, Salah Nouri, Matt Chapman, Alexander Fix, Douglas Lanman, and Anton Kaplanyan. 2020. Neural supersampling for real-time rendering. ACM Transactions on Graphics 39, 4 (Aug. 2020), 142:1––142:12. https://doi.org/10.1145/3386569.3392376
[22]
Lei Yang, Shiqiu Liu, and Marco Salvi. 2020. A Survey of Temporal Antialiasing Techniques. Computer Graphics Forum 39, 2 (May 2020), 607–621. https://doi.org/10.1111/cgf.14018
[23]
Lei Yang, Diego Nehab, Pedro V. Sander, Pitchaya Sitthi-amorn, Jason Lawrence, and Hugues Hoppe. 2009. Amortized supersampling. ACM Transactions on Graphics 28, 5 (Dec. 2009), 1–12. https://doi.org/10.1145/1618452.1618481

Cited By

View all
  • (2023)Accelerated 2D visualization using adaptive resolution scaling and temporal reconstructionJournal of Visualization10.1007/s12650-023-00925-326:5(1155-1172)Online publication date: 8-Jul-2023

Index Terms

  1. Accelerating GPU Rendering of 2D Visualizations Using Resolution Scaling and Temporal Reconstruction

      Recommendations

      Comments

      Information & Contributors

      Information

      Published In

      cover image ACM Other conferences
      VINCI '22: Proceedings of the 15th International Symposium on Visual Information Communication and Interaction
      August 2022
      136 pages
      ISBN:9781450398060
      DOI:10.1145/3554944
      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 31 October 2022

      Permissions

      Request permissions for this article.

      Check for updates

      Author Tags

      1. GPU rendering
      2. Information visualization
      3. amortized rendering

      Qualifiers

      • Research-article
      • Research
      • Refereed limited

      Funding Sources

      Conference

      VINCI'22

      Acceptance Rates

      Overall Acceptance Rate 71 of 193 submissions, 37%

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)34
      • Downloads (Last 6 weeks)3
      Reflects downloads up to 19 Feb 2025

      Other Metrics

      Citations

      Cited By

      View all
      • (2023)Accelerated 2D visualization using adaptive resolution scaling and temporal reconstructionJournal of Visualization10.1007/s12650-023-00925-326:5(1155-1172)Online publication date: 8-Jul-2023

      View Options

      Login options

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      HTML Format

      View this article in HTML Format.

      HTML Format

      Figures

      Tables

      Media

      Share

      Share

      Share this Publication link

      Share on social media