skip to main content
10.1145/3372454.3372478acmotherconferencesArticle/Chapter ViewAbstractPublication PagesicbdrConference Proceedingsconference-collections
research-article

Assessing Reliability of Big Data Stream for Smart City

Authors Info & Claims
Published:21 January 2020Publication History

ABSTRACT

Proliferation of IoT (Internet of Things) and sensor technology has expedited the realization of Smart City. To enable necessary functions, sensors distributed across the city generate a huge volume of stream data that are crucial for controlling Smart City devices. However, due to conditions such as wears and tears, battery drain, or malicious attacks, not all data are reliable even when they are accurately measured. These data could lead to invalid and devastating consequences (e.g., failed utility or transportation services). The assessment of data reliability is necessary and challenging especially for Smart City, as it has to keep up with velocity of big data stream to provide up-to-date results. Most research on data reliability has focused on data fusion and anomaly detection that lack a quantified measure of how much the data over a period of time are adequately reliable for decision-makings. This paper alleviates these issues and presents an online approach to assessing Big stream data reliability in a timely manner. By employing a well-studied evidence-based theory, our approach provides a computational framework that assesses data reliability in terms of belief likelihoods. The framework is lightweight and easy to scale, deeming fit for streaming data. We evaluate the approach using a real application of light sensing data of 1,323,298 instances. The preliminary results are consistent with logical rationales, confirming validity of the approach.

References

  1. Atzori, L., Iera, A., and Morabito, G. 2010. The internet of things: A survey. Computer networks. 54(15), 2787--2805.Google ScholarGoogle Scholar
  2. Array of Things. 2019. Array of Things Data Set and Specification Sheet. URL: https://aot-file-browser.plenar.io/data-sets/chicago-completeGoogle ScholarGoogle Scholar
  3. Jiang, W., Zhuang, M., and Xie, C. 2017. A reliability-based method to sensor data fusion. Sensors. 17(7), 1575.Google ScholarGoogle ScholarCross RefCross Ref
  4. Pollock, J. L. 1984. Reliability and justified belief. Canadian Journal of Philosophy. 14 (1): 103--114.Google ScholarGoogle ScholarCross RefCross Ref
  5. Rogova, G. L., and Nimier, V. 2004. Reliability in information fusion: literature survey. In Procs. of the 7th inter. conf. on information fusion. Vol. 2, pp. 1158--1165.Google ScholarGoogle Scholar
  6. Shafer, G. 1976. A Mathematical Theory of Evidence. Princeton University Press.Google ScholarGoogle Scholar
  7. Sheikh, A. A., Lbath, A., Warriach, E. U., and Felemban, E. 2015. A Predictive Data Reliability Method for Wireless Sensor Network Applications. In Inter. Conf. on Alg. and Arch. for Parallel Processing. 648--658. Springer, Cham.Google ScholarGoogle Scholar
  8. Wang, B., Zeng, C., and Wu, P. 2010. Evidence modeling based on sensor credibility. In 2010 Inter. Symp. on Comp.l Intelli. and Design, 2, 148--151. IEEE.Google ScholarGoogle Scholar
  9. Yuan, K., Xiao, F., Fei, L., Kang, B., and Deng, Y. 2016. Modeling sensor reliability in fault diagnosis based on evidence theory. Sensors. 16(1), 113.Google ScholarGoogle ScholarCross RefCross Ref
  10. Zhang, Y., Meratnia, N., and Havinga, P. J. 2010. Outlier detection techniques for wireless sensor networks: A survey. IEEE Com. Surveys and Tutorials, 12(2), 159--170.Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. Zhang, Z., Mehmood, A., Shu, L., Huo, Z., Zhang, Y., and Mukherjee, M. 2018. A survey on fault diagnosis in wireless sensor networks, IEEE Access, 6, 11349--1136Google ScholarGoogle ScholarCross RefCross Ref

Index Terms

  1. Assessing Reliability of Big Data Stream for Smart City

      Recommendations

      Comments

      Login options

      Check if you have access through your login credentials or your institution to get full access on this article.

      Sign in
      • Published in

        cover image ACM Other conferences
        ICBDR '19: Proceedings of the 3rd International Conference on Big Data Research
        November 2019
        192 pages
        ISBN:9781450372015
        DOI:10.1145/3372454

        Copyright © 2019 ACM

        Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        • Published: 21 January 2020

        Permissions

        Request permissions about this article.

        Request Permissions

        Check for updates

        Qualifiers

        • research-article
        • Research
        • Refereed limited

      PDF Format

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader