Skip to main content

Outlier Detection Method of Environmental Streams Based on Kernel Density Estimation

  • Conference paper
  • First Online:

Part of the book series: Communications in Computer and Information Science ((CCIS,volume 501))

Abstract

Environmental monitoring is a typical application in wireless sensor networks (WSNs), the outlier detection of the sensor data streams is especially important. We put forward an outlier detection algorithm based on multidimensional kernel density estimation. Based on the hierarchical network model, the algorithm estimates the normal distribution model in the cluster head nodes with the latest data sample. Each distributed node computes the new data to identify the abnormal data by the kernel density estimation model. The proposed algorithm can compute the result online. It only spends little time to adjust the appropriate threshold to reduce its complexity. In addition, We also take the spatial and temporal correlation, multiple attribute correlation of sensor data into account, such that the result of outlier detection is very reliable. Theoretical analysis and simulation experimental results demonstrate that the outlier detection accuracy of the proposed algorithm is more than 98 % when the outlier rate p is within a reasonable range. With the increase of p, the outlier detection accuracy will decline gradually.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  1. Zhang, Y., Hamm, N.A.S., Meratnia, N.: Statistics-based Outlier Detection for Wireless Sensor Networks. J International Journal of Geographical Information Science. 26, 1373–1392 (2012)

    Article  Google Scholar 

  2. Zhang, Y., Meratnia, N., Havinga, P.: Outlier Detection Techniques for Wireless Sensor Networks: A Survey. J. Communications Surveys & Tutorials. 12, 159–170 (2010)

    Article  Google Scholar 

  3. Sheng, B., Li, Q., Mao, W.: Outlier Detection in Sensor Networks. In: 8th ACM International Symposium on Mobile Ad Hoc Networking and Computing, pp. 219–228. ACM press, Canada (2007)

    Google Scholar 

  4. Luo, X., Dong, M., Huang, Y.: On Distributed Fault-tolerant Detection in Wireless sensor networks. J. Computers, IEEE Transactions on 55, 58–70 (2006)

    Google Scholar 

  5. Ding, M., Chen, D., Xing, K.: Localized Fault-tolerant Event Boundary Detection in Sensor Networks. In: 24th Annual Joint Conference of the IEEE Computer and Communications Societies, pp. 902–913. IEEE press, Piscataway (2005)

    Google Scholar 

  6. Chen, J., Kher, S., Somani, A.: Distributed Fault Detection of Wireless Sensor Networks. In: 2006 Workshop on Dependability Issue in Wireless Ad Hoc Networks and Sensor Networks, pp. 65–72. ACM press, New York (2006)

    Google Scholar 

  7. Palpanas, T., Papadopoulos, D., Kalogeraki, V.: Distributed Deviation Detection in Sensor Networks. J. ACM SIGMOD Rec. 32, 77–82 (2003)

    Article  Google Scholar 

  8. Subramaniam, S., Palpanas, T., Papadopoulos, D.: Online outlier detection in sensor data using non-parametric models. In: 32nd International Conference on Very Large Data Bases, pp. 187–198. ACM press, Seoul (2006)

    Google Scholar 

  9. Babcock, B., Datar, M., Motwani, R.: Sampling from a moving window over streaming data. In: 13th Annual ACM-SIAM Symposium on Discrete Algorithms, pp. 633–634. ACM press, Germany (2002)

    Google Scholar 

  10. Boyinbode, O., Le, H., Takizawa, M.: A survey on clustering algorithms for wireless sensor networks. Int. J. Space-Based and Situated Comput. 1, 130–136 (2011)

    Article  Google Scholar 

Download references

Acknowledgments

This work was supported by the National Natural Science Foundations of China (Grant No. 61174023) and Zhejiang Provincial Natural Science Foundation of China (Grant No. Y1110791).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Guanghui Li .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2015 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Wu, P., Li, G., Zhu, H., Lu, W. (2015). Outlier Detection Method of Environmental Streams Based on Kernel Density Estimation. In: Sun, L., Ma, H., Fang, D., Niu, J., Wang, W. (eds) Advances in Wireless Sensor Networks. CWSN 2014. Communications in Computer and Information Science, vol 501. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-662-46981-1_45

Download citation

  • DOI: https://doi.org/10.1007/978-3-662-46981-1_45

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-662-46980-4

  • Online ISBN: 978-3-662-46981-1

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics