Abstract
Public area monitoring will always be a key aspect of great concern. Its development has greatly promoted rapid innovation in many fields, such as public safety supervision, intelligent transportation analysis, and urban planning. Many researchers have made efforts on public area monitoring. However, most of these studies are based on the traditional monitoring perspective, which suffers high construction costs and is hard to update. In recent years, rapidly developing drone technology demonstrates superiority in convenience, flexibility, and low cost compared to traditional monitoring systems. Nevertheless, it is not widely employed in public area monitoring. Therefore, we build a framework for diversified aerial view data collection based on virtual scenes and name it as Synthetic Drone. To verify its effectiveness, we construct a virtual aerial view public safety monitoring dataset named SynthDrone. It contains 300 video clips under various scenes with annotations includes location, identification and depth etc. In addition, we also build a Depth Aware Target Distribution estimation Network (DATDNet) that takes cross-modal input data and orients multiple tasks in public safety monitoring. Based on the newly constructed dataset and DATDNet, we design experiments to verify their effectiveness and discuss the domain gap between synthetic and real-world data.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Administration, F.H.: Next generation simulation. https://ops.fhwa.dot.gov/trafficanalysistools/ngsim.htm
Bahmanyar, R., Vig, E., Reinartz, P.: MRCNet: crowd counting and density map estimation in aerial and ground imagery. arXiv preprint arXiv:1909.12743 (2019)
Blade, A.: Script hook v. http://www.dev-c.com/gtav/scripthookv/
Chan, A., Liang, Z., Vasconcelos, N.: Privacy preserving crowd monitoring: counting people without people models or tracking. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 1–7. IEEE (2008)
Chen, K., Loy, C., Gong, S., Xiang, T.: Feature mining for localised crowd counting. In: BMVC, p. 3 (2012)
Gao, J., Huang, Z., Lei, Y., Wang, J.Z., Wang, F.Y., Zhang, J.: S \(^2\) FPR: crowd counting via self-supervised coarse to fine feature pyramid ranking. arXiv preprint arXiv:2201.04819 (2022)
Gao, J., Lin, W., Zhao, B., Wang, D., Gao, C., Wen, J.: C\(\hat{\,}\) 3 framework: an open-source pytorch code for crowd counting. arXiv preprint arXiv:1907.02724 (2019)
Hermans, A., Beyer, L., Leibe, B.: In defense of the triplet loss for person re-identification. arXiv preprint arXiv:1703.07737 (2017)
IanKirwan, C.: Gtavisionexport. https://github.com/umautobots/GTAVisionExport/
Idrees, H., Saleemi, I., Seibert, C., Shah, M.: Multi-source multi-scale counting in extremely dense crowd images. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 2547–2554 (2013)
Idrees, H., et al.: Composition loss for counting, density map estimation and localization in dense crowds. In: Proceedings of the European Conference on Computer Vision, pp. 532–546 (2018)
Kang, D., Dhar, D., Chan, A.: Incorporating side information by adaptive convolution. In: The International Conference on Neural Information Processing Systems, pp. 3870–3880 (2017)
Khan, M.A., Menouar, H., Hamila, R.: DroneNet: crowd density estimation using Self-ONNs for drones. In: 2023 IEEE 20th Consumer Communications & Networking Conference (CCNC), pp. 455–460. IEEE (2023)
Krajewski, R., Bock, J., Kloeker, L., Eckstein, L.: The highD dataset: a drone dataset of naturalistic vehicle trajectories on German highways for validation of highly automated driving systems. In: International Conference on Intelligent Transportation Systems, pp. 2118–2125 (2018). https://doi.org/10.1109/ITSC.2018.8569552
Li, H., et al.: Video crowd localization with multifocus gaussian neighborhood attention and a large-scale benchmark. IEEE Trans. Image Process. 31, 6032–6047 (2022)
Li, W., Mahadevan, V., Vasconcelos, N.: Anomaly detection and localization in crowded scenes. IEEE Trans. Pattern Anal. Mach. Intell. 36(1), 18–32 (2013)
Li, X., Chen, M., Nie, F., Wang, Q.: Locality adaptive discriminant analysis. In: IJCAI, pp. 2201–2207 (2017)
Li, Y., Zhang, X., Chen, D.: CSRNet: dilated convolutional neural networks for understanding the highly congested scenes. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1091–1100 (2018)
Niu, G., Gu, J., Chen, Z.: Multi-object quantity estimation based on multi-view convolution neural network. Command Inf. Syst. Technol. 13(5), 71–79 (2022)
Park, E., Liu, W., Russakovsky, O., Deng, J., Li, F.F., Berg, A.: Large scale visual recognition challenge 2017 (2017)
Sindagi, V., Yasarla, R., Patel, V.M.: JHU-CROWD++: large-scale crowd counting dataset and a benchmark method. IEEE Trans. Pattern Anal. Mach. Intell. (2020)
Song, Q., et al.: To choose or to fuse? Scale selection for crowd counting. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 35, pp. 2576–2583 (2021)
Sun, Y., Cao, B., Zhu, P., Hu, Q.: Drone-based RGB-infrared cross-modality vehicle detection via uncertainty-aware learning. arXiv e-prints pp. arXiv-2003 (2020)
Tang, Z., Cai, Y., Wang, H.: Multi-sensor data fusion method based on adaptive weighting algorithm. Command Inf. Syst. Technol. 13(5), 66–70 (2022)
Wang, Q., Gao, J., Lin, W., Li, X.: NWPU-CROWD: a large-scale benchmark for crowd counting and localization. IEEE Trans. Pattern Anal. Mach. Intell. 43(6), 2141–2149 (2020)
Wang, Q., Gao, J., Lin, W., Yuan, Y.: Learning from synthetic data for crowd counting in the wild. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 8198–8207 (2019)
Wen, L., et al.: Detection, tracking, and counting meets drones in crowds: a benchmark. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 7812–7821 (2021)
Yan, Z., et al.: Perspective-guided convolution networks for crowd counting. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 952–961 (2019)
Zhang, C., Li, H., Wang, X., Yang, X.: Cross-scene crowd counting via deep convolutional neural networks. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 833–841 (2015)
Zhang, Y., Zhou, D., Chen, S., Gao, S., Ma, Y.: Single-image crowd counting via multi-column convolutional neural network. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 589–597 (2016)
Zhao, Z., Han, T., Gao, J., Wang, Q., Li, X.: A flow base bi-path network for cross-scene video crowd understanding in aerial view. In: Bartoli, A., Fusiello, A. (eds.) Computer Vision – ECCV 2020 Workshops. ECCV 2020. LNCS, vol. 12538, pp. 574–587. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-66823-5_34
Zhou, X., Wang, D., Krähenbühl, P.: Objects as points. arXiv preprint arXiv:1904.07850 (2019)
Zhu, P., et al.: Detection and tracking meet drones challenge. IEEE Trans. Pattern Anal. Mach. Intelli. 01, 1–1 (2021)
Author information
Authors and Affiliations
Corresponding authors
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2024 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Zhao, Z., Xie, K. (2024). Aerial Scene Understanding Based on Synthetic Data. In: Tan, Y., Shi, Y. (eds) Data Mining and Big Data. DMBD 2023. Communications in Computer and Information Science, vol 2018. Springer, Singapore. https://doi.org/10.1007/978-981-97-0844-4_11
Download citation
DOI: https://doi.org/10.1007/978-981-97-0844-4_11
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-97-0843-7
Online ISBN: 978-981-97-0844-4
eBook Packages: Computer ScienceComputer Science (R0)