Marco Heyden
Edouard Fouché
ABSTRACT
Today, the collection of decentralized data is a common scenario: smartphones store users’ messages locally, smart meters collect energy consumption data, and modern power tools monitor operator behavior. We identify different types of outliers in such data: local, global, and partition outliers. They contain valuable information, for example, about mistakes in operation. However, existing outlier detection approaches cannot distinguish between those types. Thus, we propose a “tandem” technique to join “local” and “federated” outlier detectors. Our core idea is to combine outlier detection on a single device with latent information about devices’ data to discriminate between different outlier types. To the best of our knowledge, our method is the first to achieve this. We evaluate our approach on publicly available synthetic and real-world data that we collect in a study with 15 participants operating power tools.
- M. Barandas, D. Folgado, 2020. TSFEL: Time Series Feature Extraction Library. SoftwareX (2020).Google Scholar
- Sourabh Bharti, K. K. Pattanaik, and Anshul Pandey. 2020. Contextual outlier detection for wireless sensor networks. JAIHC (2020).Google Scholar
- H. H. W. J. Bosman, G. Iacca, 2017. Spatial anomaly detection in sensor networks using neighborhood information. Inf. Fusion (2017).Google Scholar
- M. Dörr, J. Peters, and S. Matthiesen. 2021. Data-Driven Analysis of Human-Machine Systems – A Data Logger and Possible Use Cases for Field Studies with Cordless Power Tools. In IHIET.Google Scholar
- L. Fang and S. Dobson. 2014. Data Collection with In-network Fault Detection Based on Spatial Correlation. In ICCAC.Google Scholar
- M. Gabel, A. Schuster, and D. Keren. 2014. Communication-Efficient Distributed Variance Monitoring and Outlier Detection for Multivariate Time Series. In IPDPS.Google Scholar
- H. Kumarage, I. Khalil, 2013. Distributed anomaly detection for industrial wireless sensor networks based on fuzzy data modelling. JPDC (2013).Google Scholar
- H. Kumarage, I. Khalil, and Z. Tari. 2015. Granular Evaluation of Anomalies in Wireless Sensor Networks Using Dynamic Data Partitioning with an Entropy Criteria. IEEE Trans. Computers(2015).Google Scholar
- T. Luo and S. G. Nagarajan. 2018. Distributed Anomaly Detection Using Autoencoder Neural Networks in WSN for IoT. In ICC.Google Scholar
- B. McMahan, E. Moore, D. Ramage, S. Hampson, and B. Agüera y Arcas. 2017. Communication-Efficient Learning of Deep Networks from Decentralized Data. In AISTATS.Google Scholar
- R. Moghaddass and J. Wang. 2018. A Hierarchical Framework for Smart Grid Anomaly Detection Using Large-Scale Smart Meter Data. IEEE Trans. Smart Grid(2018).Google Scholar
- T. D. Nguyen, S. Marchal, 2019. DÏoT: A Federated Self-learning Anomaly Detection System for IoT. In ICDCS.Google Scholar
- D. Popovic, E. Fouché, and K. Böhm. 2019. Unsupervised Artificial Neural Networks for Outlier Detection in High-Dimensional Data. In ADBIS.Google Scholar
- J. Rabatel, S. Bringay, and P. Poncelet. 2011. Anomaly detection in monitoring sensor data for preventive maintenance. Expert Syst. Appl. (2011).Google Scholar
- R. A. Sater and A. B. Hamza. 2020. A Federated Learning Approach to Anomaly Detection in Smart Buildings. CoRR (2020).Google Scholar
- J. Schneible and A. Lu. 2017. Anomaly detection on the edge. In MILCOM.Google Scholar
- S. Singh, S. Bhardwaj, 2021. Anomaly Detection Using Federated Learning. In ICAIA.Google Scholar
- S. Suthaharan, M. Alzahrani, 2010. Labelled data collection for anomaly detection in wireless sensor networks. In ISSNIP.Google Scholar
- X.-Y. Xiao, W.-C. Peng, 2007. Using sensorranks for in-network detection of faulty readings in wireless sensor networks. In MobiDE.Google Scholar
- X. Yu, H. Lu, 2020. An adaptive method based on contextual anomaly detection in Internet of Things through wireless sensor networks. IJDSN (2020).Google Scholar
- K. Zhang, Y. Jiang, 2021. Federated Variational Learning for Anomaly Detection in Multivariate Time Series. CoRR abs/2108.08404(2021).Google Scholar
- Y. Zhang, N. Meratnia, and P. J. M. Havinga. 2010. Outlier Detection Techniques for Wireless Sensor Networks: A Survey. IEEE Commun. Surv. Tutorials(2010).Google ScholarDigital Library
- P. Zhao, M. Kurihara, 2017. Advanced correlation-based anomaly detection method for predictive maintenance. In ICPHM.Google Scholar
Index Terms
- Tandem Outlier Detectors for Decentralized Data
Recommendations
Enhancing Outlier Detection by an Outlier Indicator
Machine Learning and Data Mining in Pattern RecognitionAbstractOutlier detection is an important task in data mining and has high practical value in numerous applications such as astronomical observation, text detection, fraud detection and so on. At present, a large number of popular outlier detection ...
A novel outlier detecting algorithm based on the outlier turning points▪
AbstractOutlier detection is one of the hot research in data mining, and has been applied to various fields such as network anomaly detection, image abnormal analysis, etc. In recent years, many outlier detecting algorithms have been proposed. However, ...
Highlights- OTF Detect local outliers and outlier clusters simultaneously.
- OTF does not need to set neighborhood parameter k artificially.
- The distribution of density will not change dramatically.
- OTF aim to find outlier turning points, ...
Outlier detection based on rough sets theory
An outlier in a dataset is a point or a class of points that is considerably dissimilar to or inconsistent with the remainder of the data. Detection of outliers is important for many applications and has always attracted attention among data mining ...
Comments