Data Reduction Techniques for Simulation, Visualization and Data Analysis

Li, Shaomeng; Marsaglia, Nicole; Garth, Christoph; Woodring, Jonathan; Clyne, John; Childs, Hank

doi:10.1111/cgf.13336

Title: Data Reduction Techniques for Simulation, Visualization and Data Analysis

Journal Article · Fri Mar 30 00:00:00 EDT 2018 · Computer Graphics Forum

DOI:https://doi.org/10.1111/cgf.13336· OSTI ID:1463451

^[1]; Marsaglia, Nicole ^[2]; Garth, Christoph ^[3]; Woodring, Jonathan ^[4]; Clyne, John ^[5]; Childs, Hank ^[2]

National Center for Atmospheric Research, Boulder, CO (United States); Univ. of Oregon, Eugene, OR (United States)
Univ. of Oregon, Eugene, OR (United States)
Univ. of Kaiserslautern (Germany)
Los Alamos National Lab. (LANL), Los Alamos, NM (United States)
National Center for Atmospheric Research, Boulder, CO (United States)

Data reduction is increasingly being applied to scientific data for numerical simulations, scientific visualizations, and data analyses. It is most often used to lower I/O and storage costs, and sometimes to lower in-memory data size as well. With this work, we consider five categories of data reduction techniques based on their information loss: 1) truly lossless, 2) near lossless, 3) lossy, 4) mesh reduction, and 5) derived representations. We then survey available techniques in each of these categories, summarize their properties from a practical point of view, and discuss relative merits within a category. We believe, in total, this work will enable simulation scientists and visualization/data analysis scientists to decide which data reduction techniques will be most helpful for their needs.

View Accepted Manuscript (DOE)

Cite

Export

Save

Research Organization:: Univ. of Oregon, Eugene, OR (United States); Los Alamos National Laboratory (LANL), Los Alamos, NM (United States)

Sponsoring Organization:: USDOE Office of Science (SC), Advanced Scientific Computing Research (ASCR)

Grant/Contract Number:: SC0010652

OSTI ID:: 1463451

Journal Information:: Computer Graphics Forum, Vol. 37, Issue 6; ISSN 0167-7055

Publisher:: WileyCopyright Statement

Country of Publication:: United States

Language:: English

Citation Metrics:

Cited by: 37 works

Citation information provided by
Web of Science

References (102)

Streaming Simplification of Tetrahedral Meshes Vo, Huy T.; Callahan, Steven P.; Lindstrom, Peter IEEE Transactions on Visualization and Computer Graphics, Vol. 13, Issue 1 https://doi.org/10.1109/TVCG.2007.21	journal	January 2007
In-situ Sampling of a Large-Scale Particle Simulation for Interactive Visualization and Analysis Woodring, J.; Ahrens, J.; Figg, J. Computer Graphics Forum, Vol. 30, Issue 3 https://doi.org/10.1111/j.1467-8659.2011.01964.x	journal	June 2011
Multidimensional Directional Filter Banks and Surfacelets Lu, Yue M.; Do, Minh N. IEEE Transactions on Image Processing, Vol. 16, Issue 4 https://doi.org/10.1109/TIP.2007.891785	journal	April 2007
Least squares quantization in PCM Lloyd, S. IEEE Transactions on Information Theory, Vol. 28, Issue 2 https://doi.org/10.1109/TIT.1982.1056489	journal	March 1982
Adaptive Multilinear Tensor Product Wavelets Weiss, Kenneth; Lindstrom, Peter IEEE Transactions on Visualization and Computer Graphics, Vol. 22, Issue 1 https://doi.org/10.1109/TVCG.2015.2467412	journal	January 2016
Volume rendering of DCT-based compressed 3D scalar data IEEE Transactions on Visualization and Computer Graphics, Vol. 1, Issue 1 https://doi.org/10.1109/2945.468390	journal	March 1995
Differential FCM: increasing value prediction accuracy by improving table usage efficiency Goeman, B.; Vandierendonck, H.; de Bosschere, K. HPCA-7 - 7th IEEE Symposium on High Performance Computer Architecture, Proceedings HPCA Seventh International Symposium on High-Performance Computer Architecture https://doi.org/10.1109/HPCA.2001.903264	conference	January 2001
Embedded image coding using zerotrees of wavelet coefficients Shapiro, J. M. IEEE Transactions on Signal Processing, Vol. 41, Issue 12 https://doi.org/10.1109/78.258085	journal	January 1993
Simplex and Diamond Hierarchies: Models and Applications Weiss, K.; De Floriani, L. Computer Graphics Forum, Vol. 30, Issue 8 https://doi.org/10.1111/j.1467-8659.2011.01853.x	journal	November 2011
Feature-Based Statistical Analysis of Combustion Simulation Data Bennett, Janine C.; Krishnamoorthy, Vaidyanathan IEEE Transactions on Visualization and Computer Graphics, Vol. 17, Issue 12 https://doi.org/10.1109/TVCG.2011.199	journal	December 2011
A Survey of Topology-based Methods in Visualization Heine, C.; Leitte, H.; Hlawitschka, M. Computer Graphics Forum, Vol. 35, Issue 3 https://doi.org/10.1111/cgf.12933	journal	June 2016
In Situ Methods, Infrastructures, and Applications on High Performance Computing Platforms Bauer, A. C.; Abbasi, H.; Ahrens, J. Computer Graphics Forum, Vol. 35, Issue 3 https://doi.org/10.1111/cgf.12930	journal	June 2016
Biorthogonal bases of compactly supported wavelets Cohen, A.; Daubechies, Ingrid; Feauveau, J. -C. Communications on Pure and Applied Mathematics, Vol. 45, Issue 5 https://doi.org/10.1002/cpa.3160450502	journal	June 1992
Efficient, Low-Complexity Image Coding With a Set-Partitioning Embedded Block Coder Pearlman, W. A.; Islam, A.; Nagaraj, N. IEEE Transactions on Circuits and Systems for Video Technology, Vol. 14, Issue 11 https://doi.org/10.1109/TCSVT.2004.835150	journal	November 2004
Interactive desktop analysis of high resolution simulations: application to turbulent plume dynamics and current sheet formation Clyne, John; Mininni, Pablo; Norton, Alan New Journal of Physics, Vol. 9, Issue 8 https://doi.org/10.1088/1367-2630/9/8/301	journal	August 2007
Rapid High Quality Compression of Volume Data for Visualization Nguyen, Ky Giang; Saupe, Dietmar Computer Graphics Forum, Vol. 20, Issue 3 https://doi.org/10.1111/1467-8659.00497	journal	September 2001
Wavelet Transforms That Map Integers to Integers Calderbank, A. R.; Daubechies, Ingrid; Sweldens, Wim Applied and Computational Harmonic Analysis, Vol. 5, Issue 3 https://doi.org/10.1006/acha.1997.0238	journal	July 1998
Wavelet-Based 3D Compression Scheme for Interactive Visualization of Very Large Volume Data Ihm, Insung; Park, Sanghun Computer Graphics Forum, Vol. 18, Issue 1 https://doi.org/10.1111/1467-8659.00298	journal	March 1999
Fast Discrete Curvelet Transforms Candès, Emmanuel; Demanet, Laurent; Donoho, David Multiscale Modeling & Simulation, Vol. 5, Issue 3 https://doi.org/10.1137/05064182X	journal	January 2006
An Information-Aware Framework for Exploring Multivariate Data Sets Biswas, Ayan; Dutta, Soumya IEEE Transactions on Visualization and Computer Graphics, Vol. 19, Issue 12 https://doi.org/10.1109/TVCG.2013.133	journal	December 2013
Arithmetic coding for data compression Witten, Ian H.; Neal, Radford M.; Cleary, John G. Communications of the ACM, Vol. 30, Issue 6 https://doi.org/10.1145/214762.214771	journal	June 1987
Generalized unstructured decimation [computer graphics] Renze, K. J.; Oliver, J. H. IEEE Computer Graphics and Applications, Vol. 16, Issue 6 https://doi.org/10.1109/38.544069	journal	January 1996
Fast and Efficient Compression of Floating-Point Data Lindstrom, Peter; Isenburg, Martin IEEE Transactions on Visualization and Computer Graphics, Vol. 12, Issue 5 https://doi.org/10.1109/TVCG.2006.143	journal	September 2006
ISABELA for effective in situ compression of scientific data: ISABELA FOR EFFECTIVE Lakshminarasimhan, Sriram; Shah, Neil; Ethier, Stephane Concurrency and Computation: Practice and Experience, Vol. 25, Issue 4 https://doi.org/10.1002/cpe.2887	journal	July 2012
Three-dimensional subband coding of video using the zero-tree method Chen, Yingwei; Pearlman, William A. Visual Communications and Image Processing '96, SPIE Proceedings https://doi.org/10.1117/12.233203	conference	February 1996
Compression of individual sequences via variable-rate coding Ziv, J.; Lempel, A. IEEE Transactions on Information Theory, Vol. 24, Issue 5 https://doi.org/10.1109/TIT.1978.1055934	journal	September 1978
Lossless compression of volume data Fowler, James E.; Yagel, Roni Proceedings of the 1994 symposium on Volume visualization - VVS '94 https://doi.org/10.1145/197938.197961	conference	January 1994
An Algorithm for Vector Quantizer Design Linde, Y.; Buzo, A.; Gray, R. IEEE Transactions on Communications, Vol. 28, Issue 1 https://doi.org/10.1109/TCOM.1980.1094577	journal	January 1980
A universal algorithm for sequential data compression Ziv, J.; Lempel, A. IEEE Transactions on Information Theory, Vol. 23, Issue 3 https://doi.org/10.1109/TIT.1977.1055714	journal	May 1977
Vector quantization for volume rendering Ning, Paul; Hesselink, Lambertus Proceedings of the 1992 workshop on Volume visualization - VVS '92 https://doi.org/10.1145/147130.147152	conference	January 1992
BTRFS: The Linux B-Tree Filesystem Rodeh, Ohad; Bacik, Josef; Mason, Chris ACM Transactions on Storage, Vol. 9, Issue 3 https://doi.org/10.1145/2501620.2501623	journal	August 2013
Adaptive Multiresolution Methods: Practical issues on Data Structures, Implementation and Parallelization Brix, K.; Melian, S.; Müller, S. ESAIM: Proceedings, Vol. 34 https://doi.org/10.1051/proc/201134003	journal	December 2011
Seismic data compression using high-dimensional wavelet transforms Villasenor, J. D.; Ergas, R. A.; Donoho, P. L. Proceedings of Data Compression Conference - DCC '96 https://doi.org/10.1109/DCC.1996.488345	conference	January 1996
A mathematical theory of communication Shannon, C. E. ACM SIGMOBILE Mobile Computing and Communications Review, Vol. 5, Issue 1 https://doi.org/10.1145/584091.584093	journal	January 2001
A Method for the Construction of Minimum-Redundancy Codes Huffman, David Proceedings of the IRE, Vol. 40, Issue 9 https://doi.org/10.1109/JRPROC.1952.273898	journal	September 1952
Simplification of tetrahedral meshes with error bounds Trotts, I. J.; Hamann, B.; Joy, K. I. IEEE Transactions on Visualization and Computer Graphics, Vol. 5, Issue 3 https://doi.org/10.1109/2945.795214	journal	January 1999
Parallel Tensor Compression for Large-Scale Scientific Data Austin, Woody; Ballard, Grey; Kolda, Tamara G. 2016 IEEE International Parallel and Distributed Processing Symposium (IPDPS) https://doi.org/10.1109/IPDPS.2016.67	conference	May 2016
A prototype discovery environment for analyzing and visualizing terascale turbulent fluid flow simulations Clyne, John; Rast, Mark Electronic Imaging 2005, SPIE Proceedings https://doi.org/10.1117/12.586032	conference	March 2005
Ueber die stetige Abbildung einer Line auf ein Fl�chenst�ck Hilbert, David Mathematische Annalen, Vol. 38, Issue 3 https://doi.org/10.1007/BF01199431	journal	September 1891
The predictability of data values Sazeides, Y.; Smith, J. E. Proceedings of 30th Annual International Symposium on Microarchitecture https://doi.org/10.1109/MICRO.1997.645815	conference	January 1997
Interactive Exploration and Analysis of Large-Scale Simulations Using Topology-Based Data Segmentation Bremer, P-T; Weber, G.; Tierny, J. IEEE Transactions on Visualization and Computer Graphics, Vol. 17, Issue 9 https://doi.org/10.1109/TVCG.2010.253	journal	September 2011
Lossy volume compression using Tucker truncation and thresholding Ballester-Ripoll, Rafael; Pajarola, Renato The Visual Computer, Vol. 32, Issue 11 https://doi.org/10.1007/s00371-015-1130-y	journal	May 2015
Quadric-based simplification in any dimension Garland, Michael; Zhou, Yuan ACM Transactions on Graphics, Vol. 24, Issue 2 https://doi.org/10.1145/1061347.1061350	journal	April 2005
Reducing disk storage of full-3D seismic waveform tomography (F3DT) through lossy online compression Lindstrom, Peter; Chen, Po; Lee, En-Jui Computers & Geosciences, Vol. 93 https://doi.org/10.1016/j.cageo.2016.04.009	journal	August 2016
Factoring wavelet transforms into lifting steps Daubechies, Ingrid; Sweldens, Wim The Journal of Fourier Analysis and Applications, Vol. 4, Issue 3 https://doi.org/10.1007/BF02476026	journal	May 1998
R-trees: a dynamic index structure for spatial searching Guttman, Antonin Proceedings of the 1984 ACM SIGMOD international conference on Management of data - SIGMOD '84 https://doi.org/10.1145/602259.602266	conference	January 1984
Visualization by Proxy: A Novel Framework for Deferred Interaction with Volume Data Tikhonova, A.; Correa, C. D. IEEE Transactions on Visualization and Computer Graphics, Vol. 16, Issue 6 https://doi.org/10.1109/TVCG.2010.215	journal	November 2010
Adaptive tetrapuzzles: efficient out-of-core construction and visualization of gigantic multiresolution polygonal models Cignoni, Paolo; Ganovelli, Fabio; Gobbetti, Enrico ACM Transactions on Graphics, Vol. 23, Issue 3 https://doi.org/10.1145/1015706.1015802	journal	August 2004
Compressed progressive meshes Pajarola, R.; Rossignac, J. IEEE Transactions on Visualization and Computer Graphics, Vol. 6, Issue 1 https://doi.org/10.1109/2945.841122	journal	January 2000
FPC: A High-Speed Compressor for Double-Precision Floating-Point Data Burtscher, Martin; Ratanaworabhan, Paruj IEEE Transactions on Computers, Vol. 58, Issue 1 https://doi.org/10.1109/TC.2008.131	journal	January 2009
The R*-tree: an efficient and robust access method for points and rectangles Beckmann, Norbert; Kriegel, Hans-Peter; Schneider, Ralf ACM SIGMOD Record, Vol. 19, Issue 2 https://doi.org/10.1145/93605.98741	journal	May 1990
Image-driven simplification Lindstrom, Peter; Turk, Greg ACM Transactions on Graphics, Vol. 19, Issue 3 https://doi.org/10.1145/353981.353995	journal	July 2000
ISOBAR Preconditioner for Effective and High-throughput Lossless Data Compression Schendel, Eric R.; Jin, Ye; Shah, Neil 2012 IEEE International Conference on Data Engineering (ICDE 2012), 2012 IEEE 28th International Conference on Data Engineering https://doi.org/10.1109/ICDE.2012.114	conference	April 2012
Three-Dimensional Embedded Subband Coding with Optimized Truncation (3-D ESCOT) Xu, Jizheng; Xiong, Zixiang; Li, Shipeng Applied and Computational Harmonic Analysis, Vol. 10, Issue 3 https://doi.org/10.1006/acha.2000.0345	journal	May 2001
Advanced techniques for high-quality multi-resolution volume rendering Guthe, S.; Strasser, W. Computers & Graphics, Vol. 28, Issue 1 https://doi.org/10.1016/j.cag.2003.10.018	journal	February 2004
Partitioning a Large Simulation as It Runs Myers, Kary; Lawrence, Earl; Fugate, Michael Technometrics, Vol. 58, Issue 3 https://doi.org/10.1080/00401706.2016.1158740	journal	July 2016
Four-dimensional wavelet compression of arbitrarily sized echocardiographic data IEEE Transactions on Medical Imaging, Vol. 21, Issue 9 https://doi.org/10.1109/TMI.2002.804424	journal	September 2002
A Combined Eulerian-Lagrangian Data Representation for Large-Scale Applications Sauer, Franz; Xie, Jinrong; Ma, Kwan-Liu IEEE Transactions on Visualization and Computer Graphics, Vol. 23, Issue 10 https://doi.org/10.1109/TVCG.2016.2620975	journal	October 2017
Explorable Volumetric Depth Images from Raycasting Frey, Steffen; Sadlo, Filip; Ertl, Thomas 2013 XXVI SIBGRAPI - Conference on Graphics, Patterns and Images (SIBGRAPI), 2013 XXVI Conference on Graphics, Patterns and Images https://doi.org/10.1109/SIBGRAPI.2013.26	conference	August 2013
Efficient query processing on unstructured tetrahedral meshes Papadomanolakis, Stratos; Ailamaki, Anastassia; Lopez, Julio C. Proceedings of the 2006 ACM SIGMOD international conference on Management of data - SIGMOD '06 https://doi.org/10.1145/1142473.1142535	conference	January 2006
Survey and analysis of multiresolution methods for turbulence data Pulido, Jesus; Livescu, Daniel; Woodring, Jonathan Computers & Fluids, Vol. 125 https://doi.org/10.1016/j.compfluid.2015.11.001	journal	February 2016
Organization and maintenance of large ordered indexes Bayer, R.; McCreight, E. M. Acta Informatica, Vol. 1, Issue 3 https://doi.org/10.1007/BF00288683	journal	January 1972
An Adaptive Prediction-Based Approach to Lossless Compression of Floating-Point Volume Data Fout, Nathaniel; Ma, Kwan-Liu IEEE Transactions on Visualization and Computer Graphics, Vol. 18, Issue 12 https://doi.org/10.1109/TVCG.2012.194	journal	December 2012
Discrete Cosine Transform Ahmed, N.; Natarajan, T.; Rao, K. R. IEEE Transactions on Computers, Vol. C-23, Issue 1 https://doi.org/10.1109/T-C.1974.223784	journal	January 1974
Fixed-Rate Compressed Floating-Point Arrays Lindstrom, Peter IEEE Transactions on Visualization and Computer Graphics, Vol. 20, Issue 12 https://doi.org/10.1109/TVCG.2014.2346458	journal	December 2014
Enabling Adaptive Scientific Workflows Via Trigger Detection Salloum, Maher; Bennett, Janine C.; Pinar, Ali Proceedings of the First Workshop on In Situ Infrastructures for Enabling Extreme-Scale Analysis and Visualization - ISAV2015 https://doi.org/10.1145/2828612.2828619	conference	January 2015
Interactive, Internet Delivery of Visualization via Structured Prerendered Multiresolution Imagery IEEE Transactions on Visualization and Computer Graphics, Vol. 14, Issue 2 https://doi.org/10.1109/TVCG.2007.70428	journal	March 2008
A parallel multiresolution volume rendering algorithm for large data visualization Gao, Jinzhu; Wang, Chaoli; Li, Liya Parallel Computing, Vol. 31, Issue 2 https://doi.org/10.1016/j.parco.2005.02.005	journal	February 2005
Query-Driven Visualization of Time-Varying Adaptive Mesh Refinement Data Gosink, L. J.; Anderson, J. C.; Bethel, E. W. IEEE Transactions on Visualization and Computer Graphics, Vol. 14, Issue 6 https://doi.org/10.1109/TVCG.2008.157	journal	November 2008
Decimation of triangle meshes Schroeder, William J.; Zarge, Jonathan A.; Lorensen, William E. ACM SIGGRAPH Computer Graphics, Vol. 26, Issue 2 https://doi.org/10.1145/142920.134010	journal	July 1992
Frequency domain volume rendering by the wavelet X-ray transform Westenberg, M. A.; Roerdink, J. B. T. M. IEEE Transactions on Image Processing, Vol. 9, Issue 7 https://doi.org/10.1109/83.847837	journal	July 2000
Lossless compression of predicted floating-point geometry Isenburg, Martin; Lindstrom, Peter; Snoeyink, Jack Computer-Aided Design, Vol. 37, Issue 8 https://doi.org/10.1016/j.cad.2004.09.015	journal	July 2005
Real-Time Synthesis of Compression Algorithms for Scientific Data Burtscher, Martin; Mukka, Hari; Yang, Annie SC16: International Conference for High Performance Computing, Networking, Storage and Analysis https://doi.org/10.1109/SC.2016.22	conference	November 2016
Bitmap index design and evaluation Chan, Chee-Yong; Ioannidis, Yannis E. ACM SIGMOD Record, Vol. 27, Issue 2 https://doi.org/10.1145/276305.276336	journal	June 1998
High performance scalable image compression with EBCOT Taubman, D. IEEE Transactions on Image Processing, Vol. 9, Issue 7 https://doi.org/10.1109/83.847830	journal	July 2000
An Image-Based Approach to Extreme Scale in Situ Visualization and Analysis Ahrens, James; Jourdain, Sebastien; OLeary, Patrick SC14: International Conference for High Performance Computing, Networking, Storage and Analysis https://doi.org/10.1109/SC.2014.40	conference	November 2014
Fast volume rendering of compressed data Ning, P.; Hesselink, L. Proceedings Visualization '93 https://doi.org/10.1109/VISUAL.1993.398845	conference	January 1993
The Visible Human Project Ackerman, M. J. Proceedings of the IEEE, Vol. 86, Issue 3 https://doi.org/10.1109/5.662875	journal	March 1998
Out-of-core compression and decompression of large n-dimensional scalar fields Ibarria, Lawrence; Lindstrom, Peter; Rossignac, Jarek Computer Graphics Forum, Vol. 22, Issue 3 https://doi.org/10.1111/1467-8659.00681	journal	September 2003
An Application of Multivariate Statistical Analysis for Query-Driven Visualization Gosink, L. J.; Garth, C.; Anderson, J. C. IEEE Transactions on Visualization and Computer Graphics, Vol. 17, Issue 3 https://doi.org/10.1109/TVCG.2010.80	journal	March 2011
Transparent in Situ Data Transformations in ADIOS Boyuka, David A.; Lakshminarasimham, Sriram; Zou, Xiaocheng 2014 14th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (CCGrid) https://doi.org/10.1109/CCGrid.2014.73	conference	May 2014
DEFLATE Compressed Data Format Specification version 1.3 Deutsch, P. https://doi.org/10.17487/rfc1951	report	May 1996
QccPack: an open-source software library for quantization, compression, and coding Fowler, James E. International Symposium on Optical Science and Technology, SPIE Proceedings https://doi.org/10.1117/12.411554	conference	December 2000
Direct rendering of Laplacian pyramid compressed volume data Ghavamnia, M. H.; Yang, X. D. Proceedings Visualization '95 https://doi.org/10.1109/VISUAL.1995.480812	conference	January 1995
Using feature importance metrics to detect events of interest in scientific computing applications Ling, Julia; Kegelmeyer, W. Philip; Aditya, Konduri 2017 IEEE 7th Symposium on Large Data Analysis and Visualization (LDAV) https://doi.org/10.1109/LDAV.2017.8231851	conference	October 2017
Spatiotemporal Wavelet Compression for Visualization of Scientific Simulation Data Li, Shaomeng; Sane, Sudhanshu; Orf, Leigh 2017 IEEE International Conference on Cluster Computing (CLUSTER) https://doi.org/10.1109/CLUSTER.2017.15	conference	September 2017
Significantly Improving Lossy Compression for Scientific Data Sets Based on Multidimensional Prediction and Error-Controlled Quantization Tao, Dingwen; Di, Sheng; Chen, Zizhong 2017 IEEE International Parallel and Distributed Processing Symposium (IPDPS) https://doi.org/10.1109/IPDPS.2017.115	conference	May 2017
Salient time steps selection from large scale time-varying data sets with dynamic time warping Tong, Xin; Lee, Teng-Yok; Shen, Han-Wei 2012 IEEE Symposium on Large Data Analysis and Visualization (LDAV) https://doi.org/10.1109/LDAV.2012.6378975	conference	October 2012
Wavelets applied to lossless compression and progressive transmission of floating point data in 3-D curvilinear grids Trott, A.; Moorhead, R.; McGinley, J. Proceedings of Seventh Annual IEEE Visualization '96 https://doi.org/10.1109/VISUAL.1996.568138	conference	January 1996
Revisiting wavelet compression for large-scale climate data using JPEG 2000 and ensuring data precision Woodring, Jonathan; Mniszewski, Susan; Brislawn, Christopher 2011 IEEE Symposium on Large Data Analysis and Visualization (LDAV) https://doi.org/10.1109/LDAV.2011.6092314	conference	October 2011
MPC: A Massively Parallel Compression Algorithm for Scientific Data Yang, Annie; Mukka, Hari; Hesaaraki, Farbod 2015 IEEE International Conference on Cluster Computing (CLUSTER) https://doi.org/10.1109/CLUSTER.2015.59	conference	September 2015
A Mathematical Theory of Communication Shannon, C. E. Bell System Technical Journal, Vol. 27, Issue 3 https://doi.org/10.1002/j.1538-7305.1948.tb01338.x	journal	July 1948
Adaptive tetrapuzzles: efficient out-of-core construction and visualization of gigantic multiresolution polygonal models Cignoni, Paolo; Ganovelli, Fabio; Gobbetti, Enrico ACM SIGGRAPH 2004 Papers on - SIGGRAPH '04 https://doi.org/10.1145/1186562.1015802	conference	January 2004
The R*-tree: an efficient and robust access method for points and rectangles Beckmann, Norbert; Kriegel, Hans-Peter; Schneider, Ralf Proceedings of the 1990 ACM SIGMOD international conference on Management of data - SIGMOD '90 https://doi.org/10.1145/93597.98741	conference	January 1990
Decimation of triangle meshes Schroeder, William J.; Zarge, Jonathan A.; Lorensen, William E. Proceedings of the 19th annual conference on Computer graphics and interactive techniques - SIGGRAPH '92 https://doi.org/10.1145/133994.134010	conference	January 1992
Bitmap index design and evaluation Chan, Chee-Yong; Ioannidis, Yannis E. Proceedings of the 1998 ACM SIGMOD international conference on Management of data - SIGMOD '98 https://doi.org/10.1145/276304.276336	conference	January 1998
A Mathematical Theory of Communication Shannon, C. E. Bell System Technical Journal, Vol. 27, Issue 4 https://doi.org/10.1002/j.1538-7305.1948.tb00917.x	journal	October 1948
A method for the construction of minimum-redundancy codes Huffman, David A. Resonance, Vol. 11, Issue 2 https://doi.org/10.1007/bf02837279	journal	February 2006
The Visible Human Project: a resource for education Ackerman, M. J. Academic Medicine, Vol. 74, Issue 6 https://doi.org/10.1097/00001888-199906000-00012	journal	January 1999
High performance scalable image compression with EBCOT Taubman, D. 6th International Conference on Image Processing (ICIP'99), Proceedings 1999 International Conference on Image Processing (Cat. 99CH36348) https://doi.org/10.1109/icip.1999.817132	conference	January 1999
Adaptive TetraPuzzles: efficient out-of-core construction and visualization of gigantic multiresolution polygonal models Cignoni, Paolo; Ganovelli, Fabio; Gobbetti, Enrico ACM SIGGRAPH ASIA 2008 courses on - SIGGRAPH Asia '08 https://doi.org/10.1145/1508044.1508077	conference	January 2008
Lossy volume compression using Tucker truncation and thresholding Ballester Ripoll, Rafael; Pajarola, Renato Springer https://doi.org/10.5167/uzh-125427	text	January 2016

Cited By (4)

Use cases of lossy compression for floating-point data in scientific data sets Cappello, Franck; Di, Sheng; Li, Sihuan The International Journal of High Performance Computing Applications, Vol. 33, Issue 6 https://doi.org/10.1177/1094342019853336	journal	May 2019
Is Smaller Always Better? - Evaluating Video Compression Techniques for Simulation Ensembles Ruediger, Patrick; Garth, Christoph; Hagen, Hans Schloss Dagstuhl - Leibniz-Zentrum für Informatik https://doi.org/10.4230/oasics.ipmvm.2020.10	text	January 2021
Visitation Graphs: Interactive Ensemble Visualization with Visitation Maps Lohfink, Anna-Pia; Garth, Christoph Schloss Dagstuhl - Leibniz-Zentrum für Informatik https://doi.org/10.4230/oasics.ipmvm.2020.4	text	January 2021
VAPOR: A Visualization Package Tailored to Analyze Simulation Data in Earth System Science Li, Shaomeng; Jaroszynski, Stanislaw; Pearse, Scott Atmosphere, Vol. 10, Issue 9 https://doi.org/10.3390/atmos10090488	journal	August 2019

Similar Records

ISABELA for effective in situ compression of scientific data: ISABELA FOR EFFECTIVE IN-SITU REDUCTION OF SPATIO-TEMPORAL DATA

Journal Article · Wed Jul 11 00:00:00 EDT 2012 · Concurrency and Computation. Practice and Experience · OSTI ID:1463451

Lakshminarasimhan, Sriram; Shah, Neil; Ethier, Stephane; +6 more

Evaluating lossy data compression on climate simulation data within a large ensemble

Journal Article · Wed Dec 07 00:00:00 EST 2016 · Geoscientific Model Development (Online) · OSTI ID:1463451

Baker, Allison H.; Hammerling, Dorit M.; Mickelson, Sheri A.; +12 more

Understanding and Modeling Lossy Compression Schemes on HPC Scientific Data

Conference · Tue May 01 00:00:00 EDT 2018 · OSTI ID:1463451

Lu, Tao; Liu, Qing Gary; He, Xubin; +8 more

Related Subjects

97 MATHEMATICS AND COMPUTING
data reduction techniques
simulation
data analysis
survey

Title: Data Reduction Techniques for Simulation, Visualization and Data Analysis

Citation Formats

References (102)

Cited By (4)

Similar Records

Related Subjects