Abstract
Global air pollution is becoming increasingly severe. In this context, monitoring air quality at all times and locations is necessary. Traditionally, air quality is monitored using stationary monitoring stations. However, this approach has an inherent shortcoming: limited monitoring locations. Crowdsensing-based air monitoring has recently emerged as a promising alternative that expands monitoring coverage in both temporal and spatial dimensions through the collaboration of numerous participants. Typically, participants in crowdsensing systems are compensated for the data they provide. One of the critical challenges in handling a crowdsensing system is minimizing the cost while guaranteeing the quality of the data collected. For crowdsensing-based air monitoring systems, data quality refers to the temporal and spatial coverage corresponding to the locations and times the data was collected. In this study, we propose a solution based on deep reinforcement learning that simultaneously optimizes two goals: maximizing coverage range and minimizing costs. Our proposed solution is one of the first attempts to optimize both of these objectives for crowdsensing-based air monitoring systems. Compared to other algorithms, experimental results indicate that the proposed solution can increase coverage by more than 30% and reduce cost by more than 70%.
N. D. Tran and M. C. Dao—The two authors contributed equally to this paper.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Air visual. https://www.airvisual.com/vietnam/hanoi. Accessed Sept. (2021)
Chen, J., Yang, J.: Maximizing coverage quality with budget constrained in mobile crowd-sensing network for environmental monitoring applications. Sensors 19(10), 2399 (2019)
Cherian, J., et al.: ParkGauge: gauging the occupancy of parking garages with crowdsensed parking characteristics. In: 2016 17th IEEE International Conference on Mobile Data Management (MDM), vol. 1, pp. 92–101 (2016)
Dinh, T.A.N., Nguyen, A.D., Nguyen, T.T., Nguyen, T.H., Le Nguyen, P.: Spatial-temporal coverage maximization in vehicle-based mobile crowdsensing for air quality monitoring. In: 2022 IEEE Wireless Communications and Networking Conference (WCNC), pp. 1449–1454. IEEE (2022)
Elhamshary, M., Youssef, M., Uchiyama, A., Yamaguchi, H., Higashino, T.: TransitLabel: a crowd-sensing system for automatic labeling of transit stations semantics. In: Proceedings of the 14th Annual International Conference on Mobile Systems, Applications, and Services, pp. 193–206 (2016)
Iqair. https://www.iqair.com/. Accessed Sept (2021)
Kaelbling, L.P., Littman, M.L., Moore, A.W.: Reinforcement learning: a survey. J. Artif. Intell. Res. 4, 237–285 (1996)
Lambey, V., Prasad, A.: A review on air quality measurement using an unmanned aerial vehicle. Water Air Soil Pollut. 232, 1–32 (2021)
Mnih, V., et al.: Playing Atari with deep reinforcement learning. arXiv preprint arXiv:1312.5602 (2013)
Sutton, R.S., Barto, A.G.: Reinforcement Learning: An Introduction. MIT press, Cambridge (2018)
Wang, C., et al.: Maximizing spatial-temporal coverage in mobile crowd-sensing based on public transports with predictable trajectory. Int. J. Distrib. Sens. Netw. 14(8), 1550147718795351 (2018)
Watkins, C.J., Dayan, P.: Q-learning. Mach. Learn. 8, 279–292 (1992)
Wu, D., et al.: When sharing economy meets IoT: towards fine-grained urban air quality monitoring through mobile crowdsensing on bike-share system. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 4(2), 1–26 (2020)
Zhang, M., et al.: Quality-aware sensing coverage in budget-constrained mobile crowdsensing networks. IEEE Trans. Veh. Technol. 65(9), 7698–7707 (2016)
Acknowledgement
This work was supported in part by the Japan Society for the Promotion of Science (JSPS) under Grant 20H0417, 23H03377. This research is also funded by Hanoi University of Science and Technology (HUST) under grant number T2022-PC-049, and partially supported by NAVER Corporation within the framework of collaboration with the International Research Center for Artificial Intelligence (BKAI), School of Information and Communication Technology, HUST under project NAVER.2022.DA07 and by Vingroup Joint Stock Company (Vingroup JSC), Vingroup, Vingroup Innovation Foundation (VINIF) under project code VINIF.2020.DA09.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Tran, N.D., Dao, M.C., Nguyen, T.H., Dinh, T.H.L., Nguyen, K., Nguyen, P.L. (2023). A Deep Reinforcement Learning-Based Multi-objective Optimization for Crowdsensing-Based Air Quality Monitoring Systems. In: Nguyen, N.T., et al. Recent Challenges in Intelligent Information and Database Systems. ACIIDS 2023. Communications in Computer and Information Science, vol 1863. Springer, Cham. https://doi.org/10.1007/978-3-031-42430-4_36
Download citation
DOI: https://doi.org/10.1007/978-3-031-42430-4_36
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-42429-8
Online ISBN: 978-3-031-42430-4
eBook Packages: Computer ScienceComputer Science (R0)