skip to main content
OSTI.GOV title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Multilevel Techniques for Compression and Reduction of Scientific Data---The Multivariate Case

Journal Article · · SIAM Journal on Scientific Computing
DOI:https://doi.org/10.1137/18M1166651· OSTI ID:1570894
 [1];  [2];  [2]; ORCiD logo [3]
  1. Brown Univ., Providence, RI (United States); Oak Ridge National Lab. (ORNL), Oak Ridge, TN (United States)
  2. Brown Univ., Providence, RI (United States)
  3. Oak Ridge National Lab. (ORNL), Oak Ridge, TN (United States)

We develop a technique for multigrid adaptive reduction of data (MGARD). Special attention is given to the case of tensor product grids, where our approach permits the use of nonuniformly spaced grids in each direction, which can prove problematic for many types of data reduction methods. An important feature of our approach is the provision of guaranteed, computable bounds on the loss incurred by the reduction of the data. Many users are leery of lossy algorithms and will only consider using them provided that numerical bounds on the pointwise difference between the original and the reduced datasets are given. Accordingly, we develop techniques for bounding the loss measured in the $$L^{\infty}(\Omega)$$ norm, and we show that these bounds are realistic in the sense that they do not significantly overestimate the actual loss. Here, the resulting loss indicators are used to guide the adaptive reduction of the data so that the reduced dataset meets a user-prescribed tolerance or memory constraint. Illustrative numerical examples, including the reduction of data arising from the simulation of a nonlinear reaction-diffusion problem, a turbulent channel flow, and a climate simulation, are provided.

Research Organization:
Oak Ridge National Lab. (ORNL), Oak Ridge, TN (United States)
Sponsoring Organization:
USDOE Office of Science (SC), Advanced Scientific Computing Research (ASCR)
Grant/Contract Number:
AC05-00OR22725
OSTI ID:
1570894
Journal Information:
SIAM Journal on Scientific Computing, Vol. 41, Issue 2; ISSN 1064-8275
Publisher:
SIAMCopyright Statement
Country of Publication:
United States
Language:
English
Citation Metrics:
Cited by: 19 works
Citation information provided by
Web of Science

References (12)

Compression Using Lossless Decimation: Analysis and Application journal January 2017
Multilevel techniques for compression and reduction of scientific data—the univariate case journal November 2018
The hierarchical basis multigrid method journal July 1988
A basic norm equivalence for the theory of multilevel methods journal December 1993
The wavelet transform, time-frequency localization and signal analysis journal January 1990
Image compression using wavelets
  • Grgic, S.; Kers, K.; Grgic, M.
  • ISIE '99. IEEE International Symposium on Industrial Electronics, ISIE '99. Proceedings of the IEEE International Symposium on Industrial Electronics (Cat. No.99TH8465) https://doi.org/10.1109/ISIE.1999.801765
conference January 1999
Out-of-core compression and decompression of large n-dimensional scalar fields journal September 2003
Direct numerical simulation of turbulent channel flow up to journal June 2015
A public turbulence database cluster and applications to study Lagrangian evolution of velocity increments in turbulence journal January 2008
Fixed-Rate Compressed Floating-Point Arrays journal December 2014
Fast and Efficient Compression of Floating-Point Data journal September 2006
The JPEG still picture compression standard journal January 1992

Cited By (1)

Compression Challenges in Large Scale Partial Differential Equation Solvers journal September 2019

Similar Records

Multilevel Techniques for Compression and Reduction of Scientific Data-Quantitative Control of Accuracy in Derived Quantities
Journal Article · Wed Jul 03 00:00:00 EDT 2019 · SIAM Journal on Scientific Computing · OSTI ID:1570894

Performance Optimization for Relative-Error-Bounded Lossy Compression on Scientific Data
Journal Article · Mon Feb 10 00:00:00 EST 2020 · IEEE Transactions on Parallel and Distributed Systems · OSTI ID:1570894

Maintaining Trust in Reduction: Preserving the Accuracy of Quantities of Interest for Lossy Compression
Conference · Tue Mar 01 00:00:00 EST 2022 · OSTI ID:1570894