Adaptive Volumetric Data Compression Based on Implicit Neural Representation
Article No.: 1, Pages 1 - 8
Abstract
As a continuous representation function, implicit neural representation has found widespread applications in various research fields such as computer graphics and computer vision. In recent years, many researchers have utilized implicit neural representation for data compression. However, current data compression methods based on implicit neural representation face several challenges, with a critical issue being the inability to adaptively allocate network parameters based on the complex features in the data. This limitation leads to problems such as attention dispersion, decreased reconstruction quality, and increased training costs. To address this challenge, this paper draws inspiration from adaptive grid partitioning and proposes an adaptive volumetric compression method based on implicit neural representation. In this paper, octree is employed to conduct domain non-uniform decomposition of the data, and training a network model for data compression on each leaf node, allowing the network to focus attention on complex data regions during training. The block-wise training approach reduces training time and lowers training costs while achieving the same compression rate. Finally, the effectiveness of our proposed method has been demonstrated through several qualitative and quantitative experiments.
References
[1]
Eirikur Agustsson, David Minnen, Nick Johnston, Johannes Balle, Sung Jin Hwang, and George Toderici. 2020. Scale-space flow for end-to-end optimized video compression. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 8503–8512.
[2]
Johannes Ballé, David Minnen, Saurabh Singh, Sung Jin Hwang, and Nick Johnston. 2018. Variational image compression with a scale hyperprior. arXiv preprint arXiv:https://arXiv.org/abs/1802.01436 (2018).
[3]
Rafael Ballester-Ripoll, Peter Lindstrom, and Renato Pajarola. 2019. TTHRESH: Tensor compression for multidimensional visual data. IEEE transactions on visualization and computer graphics 26, 9 (2019), 2891–2903.
[4]
Rafael Ballester-Ripoll and Renato Pajarola. 2016. Lossy volume compression using Tucker truncation and thresholding. The Visual Computer 32 (2016), 1433–1446.
[5]
Matthew Berger, Jixian Li, and Joshua A Levine. 2018. A generative model for volume rendering. IEEE transactions on visualization and computer graphics 25, 4 (2018), 1636–1650.
[6]
Zongmin Cui, Peng Yue, Xiang Yi, and Jing Li. 2019. Research on non-uniform dynamic vehicle-mounted VLC with receiver spatial and angular diversity. In Proceedings of ICC 2019-2019 IEEE International Conference on Communications (ICC). 1–7.
[7]
Enrico Gobbetti, José Antonio Iglesias Guitián, and Fabio Marton. 2012. COVRA: A compression-domain output-sensitive volume rendering architecture based on a sparse representation of voxel blocks. In Proceedings of Computer Graphics Forum, Vol. 31. 1315–1324.
[8]
Stefan Guthe, Michael Wand, Julius Gonser, and Wolfgang Straßer. 2002. Interactive rendering of large volume data sets. In Proceedings of IEEE Visualization, 2002. VIS 2002.53–60.
[9]
Insung Ihm and Sanghun Park. 1999. Wavelet-based 3D compression scheme for interactive visualization of very large volume data. In Proceedings of Computer graphics forum, Vol. 18. 3–15.
[10]
Ruitian Li, Liang Deng, Zhe Dai, Jian Zhang, Jie Liu, and Gang Liu. 2023. A Data-Centric Approach for Efficient and Scalable CFD Implementation on Multi-GPUs Clusters. In Proceedings of International Conference on Parallel and Distributed Computing: Applications and Technologies. 93–104.
[11]
Xin Liang, Kai Zhao, Sheng Di, Sihuan Li, Robert Underwood, Ali M Gok, Jiannan Tian, Junjing Deng, Jon C Calhoun, Dingwen Tao, et al. 2022. Sz3: A modular framework for composing prediction-based error-bounded lossy compressors. IEEE Transactions on Big Data 9, 2 (2022), 485–498.
[12]
Guo Lu, Wanli Ouyang, Dong Xu, Xiaoyun Zhang, Chunlei Cai, and Zhiyong Gao. 2019. Dvc: An end-to-end deep video compression framework. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 11006–11015.
[13]
Yuzhe Lu, Kairong Jiang, Joshua A Levine, and Matthew Berger. 2021. Compressive neural representations of volumetric scalar fields. In Proceedings of Computer Graphics Forum, Vol. 40. 135–146.
[14]
Julien NP Martel, David B Lindell, Connor Z Lin, Eric R Chan, Marco Monteiro, and Gordon Wetzstein. 2021. Acorn: Adaptive coordinate networks for neural scene representation. ACM Transactions on Graphics 40, 4 (2021), 1–13.
[15]
Donald Meagher. 1982. Geometric modeling using octree encoding. Computer graphics and image processing 19, 2 (1982), 129–147.
[16]
Lars Mescheder, Michael Oechsle, Michael Niemeyer, Sebastian Nowozin, and Andreas Geiger. 2019. Occupancy networks: Learning 3d reconstruction in function space. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition. 4460–4470.
[17]
Ben Mildenhall, Pratul P Srinivasan, Matthew Tancik, Jonathan T Barron, Ravi Ramamoorthi, and Ren Ng. 2021. Nerf: Representing scenes as neural radiance fields for view synthesis. Commun. ACM 65, 1 (2021), 99–106.
[18]
David Minnen, Johannes Ballé, and George D Toderici. 2018. Joint autoregressive and hierarchical priors for learned image compression. In Proceedings of the 32nd International Conference on Neural Information Processing Systems. 10794–10803.
[19]
Shigeru Muraki. 1993. Volume data and wavelet transforms. IEEE Computer Graphics and applications 13, 4 (1993), 50–56.
[20]
Jeong Joon Park, Peter Florence, Julian Straub, Richard Newcombe, and Steven Lovegrove. 2019. Deepsdf: Learning continuous signed distance functions for shape representation. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition. 165–174.
[21]
Vincent Sitzmann, Michael Zollhöfer, and Gordon Wetzstein. 2019. Scene representation networks: Continuous 3d-structure-aware neural scene representations. In Proceedings of the 33rd International Conference on Neural Information Processing Systems. 1121–1132.
[22]
Jonathan Woodring, Susan Mniszewski, Christopher Brislawn, David DeMarle, and James Ahrens. 2011. Revisiting wavelet compression for large-scale climate data using JPEG 2000 and ensuring data precision. In Proceedings of 2011 IEEE symposium on large data analysis and visualization. 31–38.
[23]
Skylar W Wurster, Tianyu Xiong, Han-Wei Shen, Hanqi Guo, and Tom Peterka. 2024. Adaptively Placed Multi-Grid Scene Representation Networks for Large-Scale Data Visualization. IEEE Transactions on Visualization and Computer Graphics 30, 1 (2024), 965–974.
[24]
You Xie, Erik Franz, Mengyu Chu, and Nils Thuerey. 2018. tempoGAN: A temporally coherent, volumetric GAN for super-resolution fluid flow. ACM Transactions on Graphics (TOG) 37, 4 (2018), 1–15.
[25]
Runzhao Yang. 2023. TINC: Tree-structured Implicit Neural Compression. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 18517–18526.
[26]
Ren Yang, Fabian Mentzer, Luc Van Gool, and Radu Timofte. 2020. Learning for video compression with hierarchical quality and recurrent enhancement. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 6628–6637.
[27]
Ruihan Yang, Yibo Yang, Joseph Marino, and Stephan Mandt. 2020. Hierarchical autoregressive modeling for neural video compression. arXiv preprint arXiv:https://arXiv.org/abs/2010.10258 (2020).
[28]
Yibo Yang, Robert Bamler, and Stephan Mandt. 2020. Improving inference for neural image compression. Advances in Neural Information Processing Systems 33 (2020), 573–584.
[29]
Alex Yu, Ruilong Li, Matthew Tancik, Hao Li, Ren Ng, and Angjoo Kanazawa. 2021. Plenoctrees for real-time rendering of neural radiance fields. In Proceedings of the IEEE/CVF International Conference on Computer Vision. 5752–5761.
[30]
Jian Zhang, Zhe Dai, Ruitian Li, Liang Deng, Jie Liu, and Naichun Zhou. 2023. Acceleration of a Production-Level Unstructured Grid Finite Volume CFD Code on GPU. Applied Sciences 13, 10 (2023), 6193.
Index Terms
- Adaptive Volumetric Data Compression Based on Implicit Neural Representation
Recommendations
Dynamic Neural Networks for Adaptive Implicit Image Compression
Pattern Recognition and Computer VisionAbstractCompression with Implicit Neural Presentations (COIN) is a neural network image compression method based on multilayer perceptron (MLP). COIN encodes an image with an MLP that maps pixel positions to RGB values matching, the weights of the MLP are ...
Image Manipulation Detection with Implicit Neural Representation and Limited Supervision
Computer Vision – ECCV 2024AbstractImage Manipulation Detection (IMD) is becoming increasingly important as tampering technologies advance. However, most state-of-the-art (SoTA) methods require high-quality training datasets featuring image- and pixel-level annotations. The ...
CPE COIN++: Towards Optimized Implicit Neural Representation Compression Via Chebyshev Positional Encoding
Pattern Recognition and Computer VisionAbstractCOIN++ is a special variant of Implicit Neural Representation (INR), which encodes signals as modulations applied to the base INR network. It is becoming a promising method for applications in image compression. However, INR’s effectiveness is ...
Comments
Information & Contributors
Information
Published In
Copyright © 2024 Copyright held by the owner/author(s). Publication rights licensed to ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 11 December 2024
Check for updates
Author Tags
Qualifiers
- Research-article
Funding Sources
- National Natural Science Foundation of China
Conference
VINCI 2024
VINCI '24: The 17th International Symposium on Visual Information Communication and Interaction
December 11 - 13, 2024
Hsinchu, Taiwan
Acceptance Rates
Overall Acceptance Rate 71 of 193 submissions, 37%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 68Total Downloads
- Downloads (Last 12 months)68
- Downloads (Last 6 weeks)10
Reflects downloads up to 03 Mar 2025
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign inFull Access
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderFull Text
View this article in Full Text.
Full TextHTML Format
View this article in HTML Format.
HTML Format