A method of cleaning data from IoT devices in Big data systems | IEEE Conference Publication | IEEE Xplore

A method of cleaning data from IoT devices in Big data systems


Abstract:

When retrieving data from IoT devices, errors in time series data often occur due to interference. Data with errors cannot be processed or saved in databases and warehous...Show More

Abstract:

When retrieving data from IoT devices, errors in time series data often occur due to interference. Data with errors cannot be processed or saved in databases and warehouses because it causes data inconsistency, conflicting with Big Data principles. Built-in mechanisms in databases are not always able to fix incorrect data. Manually correcting data for extensive collections is too time-consuming and costly. Therefore, there is a need for automatic data cleansing, especially time series. This article proposes our data cleaning method for time series based on a moving average. Test results show a slight improvement in the signal-to-noise ratio.
Date of Conference: 17-20 December 2022
Date Added to IEEE Xplore: 26 January 2023
ISBN Information:
Conference Location: Osaka, Japan

Contact IEEE to Subscribe

References

References is not available for this document.