Research on real-time denoising algorithm for hydrological data based on suspicious data caching mechanism
Pages 709 - 714
Abstract
Real time remote data collection and precise processing are the foundation for smart water conservancy to carry out business applications. This paper studies real-time denoising algorithms for hydrological monitoring data in the context of higher requirements for real-time and accurate data processing in smart water conservancy. Based on the analysis of current data noise types and characteristics, as well as the main denoising algorithms and their advantages and disadvantages, a real-time denoising algorithm based on suspicious data caching mechanism is proposed. Through theoretical analysis and practical application verification, this algorithm is progressiveness in terms of time consumption, space consumption, accuracy and adaptability.
References
[1]
China. 2021. The 14th Five Year Plan for National Economic and Social Development and the Outline of Vision Goals for 2035. Z.
[2]
Ministry of Water Resources. 2021. The 14th Five Year Plan for Smart Water Conservancy Construction. Z.
[3]
Yu CH, Yu HW, Zhang W. 2017. Research on the Integration and Update Mechanism of Massive Hydrological Management Data Information. J. Water Resources Informatization, 5: 6-11.
[4]
Xiao YJ, Su SX, Guo Y. 2016. An Intelligent monitoring and analysis system for water Ambient intelligence based on the Internet of Things. J. Microcomputer and Application, 35 (22): 102-104+107.
[5]
Du JF. 2019. Design and Implementation of a Aquaculture Water Quality Monitoring System Based on Internet of Things Technology. D. Dalian Ocean University.
[6]
XIA R, MENG K, QIAN F, WANG ZL, 2007. Online Wavelet Denoising via a Moving Window. J. Acta Automatic Sinica, 33(9):897-901.
[7]
Fang KB, Li J, Ke PC, Cheng LX. 2022. Energy consumption monitoring of laboratory computer room network based on GM-BP neural network. J. Computer Simulation, 39 (10): 430-434.
[8]
Wang L, Wang ZL. 2022. Distributed Hydrological Dynamic Monitoring and Early Warning System Based on the Internet of Things. J. Industrial Instrumentation and Automation Devices, 1:55-59.
[9]
Deng R, Huang GX, Yi J, Hu LL, LC, Chen H, Qiu HX. 2023. Practice of Integrating Hydrological Monitoring Data in Jiangxi Province. J. Jiangxi Water Conservancy Science and Technology, 49 (2): 130-134.
[10]
Wu ZY, Xu L, Tang YY, He H. 2020. Research progress on online flow monitoring methods at hydrological stations. J. Water Resources Protection, 36 (4): 1-4.
[11]
Sun ZY, Jin Q, Dai J. 2022. Design and Application of GNSS Flow Measurement System Platform Based on Hydrological Emergency Monitoring. J. Yangtze River, 53 (9): 222-225.
[12]
Li Y, Tie Y, Na S, Li SH, Wang Q. 2008. Research on denoising algorithm for tap water leakage detection based on LMS algorithm. J. Journal of Inner Mongolia University (Natural Science Edition), 39 (3): 172-176.
[13]
Li DS, Ma J, Rao Kf, Wang XY 1. 2023. Research on denoising methods for rainfall time series based on wavelet transform. J. Yangtze River, 54 (5): 127-133.
[14]
Jiang HG, Yang BH, Ao CLi, Zou LL. 2013. Auto electric logging signal denoising based on fast independent component analysis. J. Hydrology &Geological Engineering Geology, 40 (1): 29-33.
[15]
Li B, 2022. Research on Magnetic Resonance Data Denoising Method Based on Convolutional neural network. d. Jilin University, 5.
[16]
Du QF, Zhang SL, Zhang CX. 2022. A mud water balance shield tunneling speed prediction method based on mean filtering denoising and XGBoost algorithm. J. Modern Tunnel Technology, 59 (6): 14-23.
[17]
Guo FB, Yang ZL, Cheng DX, Su B, Liang S, Zhang K. 2023. Ultrasonic gas flow meter based on adaptive filtering algorithm. Instrument Technology and Sensors .J.3:24-31.
[18]
Jiang H, Wang FY, Wang XY, Li J, 2018. An improved wavelet threshold denoising method and its application in the field of meteorological instruments, Meteorological, Hydrological and Marine Instruments, 3:64-66.
[19]
Zhao L, Kang YY, Cheng JH, Wu MY. 2021. Centralized fault-tolerant Kalman filter filtering algorithm for integrated navigation. J. Journal of Harbin Engineering University, 42 (6): 845-849.
[20]
LIN JH. 2017. Cloud computing based system design for powergrid dispatching and control training simulation. J. Automationof electric power system, 41(14):164-170.
[21]
Sadda, Praneeth, Qarni, Taha. Real-Time Medical Video Denoising with Deep Learning: Application to Angiography. J. International journal of applied information systems. 2018, 5:22-28.
[22]
AlpaslanGoken, Cemkalyoncu Real-time impulse noise removal International. J. journal of applied information systems. 2020, 17:459-469.
[23]
XIE F. 2018. Design of real-time denoising processing system for virtualized cloudcomputing dynamic mobile data[J]. Modern Electronics Technique 2018, 41(22):17-20.
Index Terms
- Research on real-time denoising algorithm for hydrological data based on suspicious data caching mechanism
Recommendations
An Index with Caching Mechanism for Real-time Processing System
ICBDC '19: Proceedings of the 4th International Conference on Big Data and ComputingReal-time processing mode is becoming a mainstream technology in many domains. For example, real-time monitoring system can effectively improve the power engineering or the efficiency of the transport sector. On behalf of a data structure to accelerate ...
A Proposed Intelligent Denoising Technique for Spatial Video Denoising for Real-Time Applications
With the widespread use of videos in many fields of our lives, it becomes very important to develop new techniques for video denoising. Spatial video denoising using wavelet transform has been the focus of the current research, as it requires less ...
Lossless-constraint Denoising based Auto-encoders
In this paper, we address the poor generalization ability problem of traditional auto-encoder on noise data, and propose a Lossless-constraint Denoising (LD) method, which can enhance the anti-noise ability and robustness of auto-encoders. We ...
Comments
Information & Contributors
Information
Published In
June 2024
1206 pages
ISBN:9798400710247
DOI:10.1145/3690407
Copyright © 2024 Copyright held by the owner/author(s). Publication rights licensed to ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 24 October 2024
Check for updates
Author Tags
Qualifiers
- Research-article
Conference
CAIBDA 2024
CAIBDA 2024: 2024 4th International Conference on Artificial Intelligence, Big Data and Algorithms
June 21 - 23, 2024
Zhengzhou, China
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 9Total Downloads
- Downloads (Last 12 months)9
- Downloads (Last 6 weeks)2
Reflects downloads up to 02 Mar 2025
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign inFull Access
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderFull Text
View this article in Full Text.
Full TextHTML Format
View this article in HTML Format.
HTML Format