skip to main content
10.1145/3404555.3404636acmotherconferencesArticle/Chapter ViewAbstractPublication PagesiccaiConference Proceedingsconference-collections
research-article

A Distributed Anomaly Filtering Algorithm for Heterogeneous Data Based on City Computing

Published: 20 August 2020 Publication History

Abstract

In modern cities, numerous urban perception devices collect and release urban data all the time, but urban data may become abnormal due to environmental interference or artificial tampering. In view of the problem that urban data will face data anomalies, this paper designs a distributed gauss membership anomaly data filtering algorithm, and defines a set of extraction protocols suitable for heterogeneous data. Simulation results show that this algorithm can filter abnormal data in real time, improve the efficiency of urban computing and reduce the cost of network.

References

[1]
Atzori, L., Iera, A., and Morabito, G. 2010. The Internet of Things: A survey. Computer Networks, 54(15):2787--2805.
[2]
Henrik, B., Niels, O. B., Tobias, F., Kaj, G., Mikkel, B. K., Paul, L., and Markus, W. 2013. On heterogeneity in mobile sensing applications aiming at representative data collection. In Proceedings of the 2013 ACM conference on Pervasive and ubiquitous computing adjunct publication (UbiComp '13 Adjunct). Association for Computing Machinery, New York, NY, USA, 1087--1098. DOI=https://doi.org/10.1145/2494091.2499576
[3]
Farid, L., Ahcène, B., Rahim, K., Reinhardt, E., and Massinissa S. 2016. Faulty Data Detection in Wireless Sensor Networks Based on Copula Theory. In Proceedings of the International Conference on Big Data and Advanced Wireless Technologies (BDAW '16). Association for Computing Machinery, New York, NY, USA, Article 29, 1--7. DOI=https://doi.org/10.1145/3010089.3010114
[4]
Chen, P.S., Lin, S.C., Sun, C.H. 2015. Simple and effective method for detecting abnormal internet behaviors of mobile devices. Inf. Sci. 321, 193--204 (2015)
[5]
Pin, Z., Jing, X., Muazu, H., and Wen-Min, M. 2015. Access control research on data security in Cloud computing. 873--877. 10.1109/ICCT.2015.7399964.
[6]
Yu, Z., Licia, C., Ouri, Wolfson., and Hai, Y. 2014. Urban Computing: Concepts, Methodologies, and Applications. ACM Trans. Intell. Syst. Technol. 5, 3, Article 38 (September 2014), 55 pages. DOI=https://doi.org/10.1145/2629592
[7]
Jing, Z., et al. 2017. An evolutionary game for joint wireless and cloud resource allocation in mobile edge computing. 2017 9th International Conference on Wireless Communications and Signal Processing (WCSP), Nanjing, 2017, pp. 1--6.
[8]
Meng-Ting, L., Richard, Y., Ying-Lei, T., et al. 2018 Computation Offloading and Content Caching in Wireless Blockchain Networks with Mobile Edge Computing. IEEE Transactions on Vehicular Technology, 2018:1--1.
[9]
Zhang, J. 2012. Smarter outlier detection and deeper understanding of large-scale taxi trip records: a case study of NYC. Acm Sigkdd International Workshop on Urban Computing. ACM, 2012.
[10]
Lam, P., Wang, L., Ngan, H. Y. T., et al. 2017. Outlier Detection in Large-Scale Traffic Data by Naïve Bayes Method and Gaussian Mixture Model Method. Electronic Imaging. 2017.
[11]
Ghorbel, O., Ayadi, A., Loukil, K., et al. 2017. Classification data using outlier detection method. In Wireless sensor networks. 2017 13th International Wireless Communications and Mobile Computing Conference (IWCMC). IEEE, 2017.
[12]
Han-Chen, S., Ling-Da, W., Ying-Mei, W. 2005. Dispersed Featured Point Detection. Acta Simulata Systematica Sinica, 2005.
[13]
Deng, X., Jiang, P., Peng, X., and Mi, C. 2019. An Intelligent Outlier Detection Method with One Class Support Tucker Machine and Genetic Algorithm Toward Big Sensor Data in Internet of Things. In IEEE Transactions on Industrial Electronics, vol. 66, no. 6, pp. 4672--4683, June 2019.
[14]
Otey, M.E., Ghoting, A., and Parthasarathy, S. 2006. Fast Distributed Outlier Detection in Mixed-Attribute Data Sets. Data Min Knowl Disc 12, 203--228 (2006). https://doi.org/10.1007/s10618-005-0014-6
[15]
Shukla, M. and Kosta, Y. P. 2016. Empirical analysis and improvement of density-based clustering algorithm in data streams. 2016 International Conference on Inventive Computation Technologies (ICICT)., Coimbatore, 2016, pp. 1--4.
[16]
Yamei, L. and Renwu, Y. 2019. A Distributed Outlier Detection Algorithm Based on Density Clustering. Computer & Digital Engineering, 2019.
[17]
Xiao, D.Q., Feng, J.Z., Zhou, Q., and Yang, B. 2008. Gauss Reputation Framework for Sensor Networks. J. Commun. 2008, 29, 47--53.
[18]
http://db.csail.mit.edu/labdata/labdata.html

Cited By

View all
  • (2024)Distributed intelligence for IoT-based smart cities: a surveyNeural Computing and Applications10.1007/s00521-024-10136-y36:27(16621-16656)Online publication date: 22-Jul-2024

Index Terms

  1. A Distributed Anomaly Filtering Algorithm for Heterogeneous Data Based on City Computing

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Other conferences
    ICCAI '20: Proceedings of the 2020 6th International Conference on Computing and Artificial Intelligence
    April 2020
    563 pages
    ISBN:9781450377089
    DOI:10.1145/3404555
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

    In-Cooperation

    • University of Tsukuba: University of Tsukuba

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 20 August 2020

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. Urban computing
    2. abnormal filtering
    3. big data
    4. mobile edge computing
    5. the internet of things

    Qualifiers

    • Research-article
    • Research
    • Refereed limited

    Conference

    ICCAI '20

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)0
    • Downloads (Last 6 weeks)0
    Reflects downloads up to 27 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)Distributed intelligence for IoT-based smart cities: a surveyNeural Computing and Applications10.1007/s00521-024-10136-y36:27(16621-16656)Online publication date: 22-Jul-2024

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media