Skip to main content

A Deep Reinforcement Learning-Based Multi-objective Optimization for Crowdsensing-Based Air Quality Monitoring Systems

  • Conference paper
  • First Online:
Recent Challenges in Intelligent Information and Database Systems (ACIIDS 2023)

Part of the book series: Communications in Computer and Information Science ((CCIS,volume 1863))

Included in the following conference series:

  • 479 Accesses

Abstract

Global air pollution is becoming increasingly severe. In this context, monitoring air quality at all times and locations is necessary. Traditionally, air quality is monitored using stationary monitoring stations. However, this approach has an inherent shortcoming: limited monitoring locations. Crowdsensing-based air monitoring has recently emerged as a promising alternative that expands monitoring coverage in both temporal and spatial dimensions through the collaboration of numerous participants. Typically, participants in crowdsensing systems are compensated for the data they provide. One of the critical challenges in handling a crowdsensing system is minimizing the cost while guaranteeing the quality of the data collected. For crowdsensing-based air monitoring systems, data quality refers to the temporal and spatial coverage corresponding to the locations and times the data was collected. In this study, we propose a solution based on deep reinforcement learning that simultaneously optimizes two goals: maximizing coverage range and minimizing costs. Our proposed solution is one of the first attempts to optimize both of these objectives for crowdsensing-based air monitoring systems. Compared to other algorithms, experimental results indicate that the proposed solution can increase coverage by more than 30% and reduce cost by more than 70%.

N. D. Tran and M. C. Dao—The two authors contributed equally to this paper.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Air visual. https://www.airvisual.com/vietnam/hanoi. Accessed Sept. (2021)

  2. Chen, J., Yang, J.: Maximizing coverage quality with budget constrained in mobile crowd-sensing network for environmental monitoring applications. Sensors 19(10), 2399 (2019)

    Article  Google Scholar 

  3. Cherian, J., et al.: ParkGauge: gauging the occupancy of parking garages with crowdsensed parking characteristics. In: 2016 17th IEEE International Conference on Mobile Data Management (MDM), vol. 1, pp. 92–101 (2016)

    Google Scholar 

  4. Dinh, T.A.N., Nguyen, A.D., Nguyen, T.T., Nguyen, T.H., Le Nguyen, P.: Spatial-temporal coverage maximization in vehicle-based mobile crowdsensing for air quality monitoring. In: 2022 IEEE Wireless Communications and Networking Conference (WCNC), pp. 1449–1454. IEEE (2022)

    Google Scholar 

  5. Elhamshary, M., Youssef, M., Uchiyama, A., Yamaguchi, H., Higashino, T.: TransitLabel: a crowd-sensing system for automatic labeling of transit stations semantics. In: Proceedings of the 14th Annual International Conference on Mobile Systems, Applications, and Services, pp. 193–206 (2016)

    Google Scholar 

  6. Iqair. https://www.iqair.com/. Accessed Sept (2021)

  7. Kaelbling, L.P., Littman, M.L., Moore, A.W.: Reinforcement learning: a survey. J. Artif. Intell. Res. 4, 237–285 (1996)

    Article  Google Scholar 

  8. Lambey, V., Prasad, A.: A review on air quality measurement using an unmanned aerial vehicle. Water Air Soil Pollut. 232, 1–32 (2021)

    Article  Google Scholar 

  9. Mnih, V., et al.: Playing Atari with deep reinforcement learning. arXiv preprint arXiv:1312.5602 (2013)

  10. Sutton, R.S., Barto, A.G.: Reinforcement Learning: An Introduction. MIT press, Cambridge (2018)

    MATH  Google Scholar 

  11. Wang, C., et al.: Maximizing spatial-temporal coverage in mobile crowd-sensing based on public transports with predictable trajectory. Int. J. Distrib. Sens. Netw. 14(8), 1550147718795351 (2018)

    Article  Google Scholar 

  12. Watkins, C.J., Dayan, P.: Q-learning. Mach. Learn. 8, 279–292 (1992)

    Article  MATH  Google Scholar 

  13. Wu, D., et al.: When sharing economy meets IoT: towards fine-grained urban air quality monitoring through mobile crowdsensing on bike-share system. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 4(2), 1–26 (2020)

    Google Scholar 

  14. Zhang, M., et al.: Quality-aware sensing coverage in budget-constrained mobile crowdsensing networks. IEEE Trans. Veh. Technol. 65(9), 7698–7707 (2016)

    Article  Google Scholar 

Download references

Acknowledgement

This work was supported in part by the Japan Society for the Promotion of Science (JSPS) under Grant 20H0417, 23H03377. This research is also funded by Hanoi University of Science and Technology (HUST) under grant number T2022-PC-049, and partially supported by NAVER Corporation within the framework of collaboration with the International Research Center for Artificial Intelligence (BKAI), School of Information and Communication Technology, HUST under project NAVER.2022.DA07 and by Vingroup Joint Stock Company (Vingroup JSC), Vingroup, Vingroup Innovation Foundation (VINIF) under project code VINIF.2020.DA09.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Phi Le Nguyen .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Tran, N.D., Dao, M.C., Nguyen, T.H., Dinh, T.H.L., Nguyen, K., Nguyen, P.L. (2023). A Deep Reinforcement Learning-Based Multi-objective Optimization for Crowdsensing-Based Air Quality Monitoring Systems. In: Nguyen, N.T., et al. Recent Challenges in Intelligent Information and Database Systems. ACIIDS 2023. Communications in Computer and Information Science, vol 1863. Springer, Cham. https://doi.org/10.1007/978-3-031-42430-4_36

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-42430-4_36

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-42429-8

  • Online ISBN: 978-3-031-42430-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics