Abstract
Using unmanned aerial vehicles (UAV) for large-scale scene sampling is a prevalent application in UAV vision. However, there are certain factors that can influence the quality of UAV sampling, such as the lack of texture details and drastic changes in scene geometry. One common factor is occlusion, which is a surface feature in 3D scenes that results in significant discontinuity on the scene surface, leading to transient noise and loss of local information. This can cause degradation in the performance of computer vision algorithms. To address these challenges, this paper proposes a UAV sampling method that takes into account occlusion. The method is based on the principle of quantizing occlusion information and improves the aerial light field (ALF) technology. It establishes a UAV ALF sampling model that considers scene occlusion information and calculates the minimum sampling rate of UAV sampling by deriving the exact expression of the spectrum. The proposed model is used to sample and reconstruct large-scale scenes in different occlusion environments. Experimental results demonstrate that the model effectively improves the reconstruction quality of large-scale scenes in occluded environments.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Yan, F., Xia, E., Li, Z., Zhou, Z.: Sampling-based path planning for high-quality aerial 3D reconstruction of urban scenes. Remote Sens. 13(5) (2021). https://doi.org/10.3390/rs13050989. https://www.mdpi.com/2072-4292/13/5/989
He, Y., Liang, Q., Lu, H., Chai, C.: Based on unmanned aerial vehicle real-scene 3D design and implementation of virtual simulation experiment system for mine smart supervision in large-scale applications. In: 2021 2nd International Conference on Information Science and Education (ICISE-IE), pp. 1406–1413. IEEE (2021)
Hermawan, S., Purnomo, J., Tjandra, D., Purnomo, Y.C.: The use of unmanned aerial vehicles (UAV) for reconstruction of topography and bathymetry maps: consideration for civil construction against coastal adaptation due to climate changing. In: MISEIC 2018 (2018)
Mancini, F., Dubbini, M., Gattelli, M., Stecchi, F., Fabbri, S., Gabbianelli, G.: Using unmanned aerial vehicles (UAV) for high-resolution reconstruction of topography: the structure from motion approach on coastal environments. Remote Sens. 5(12), 6880–6898 (2013)
Qiao, G., Yuan, X., Florinsky, I., Popov, S., He, Y., Li, H.: Topography reconstruction and evolution analysis of outlet glacier using data from unmanned aerial vehicles in Antarctica. Int. J. Appl. Earth Obs. Geoinf. 117, 103186 (2023)
Schedl, D.C., Kurmi, I., Bimber, O.: Search and rescue with airborne optical sectioning. Nat. Mach. Intell. 2(12), 783–790 (2020)
Khaloo, A., Lattanzi, D., Cunningham, K., Dell’Andrea, R., Riley, M.: Unmanned aerial vehicle inspection of the placer river trail bridge through image-based 3D modelling. Struct. Infrastruct. Eng. 1–13 (2018)
Liu, Y.F., Nie, X., Fan, J.S., Liu, X.G.: Image-based crack assessment of bridge piers using unmanned aerial vehicles and three-dimensional scene reconstruction. Comput.-Aided Civ. Infrastruct. Eng. 35(5), 511–529 (2020)
Prosekov, A.Y., Rada, A., Kuznetsov, A., Timofeev, A., Osintseva, M.: Environmental monitoring of endogenous fires based on thermal imaging and 3D mapping from an unmanned aerial vehicle. In: IOP Conference Series: Earth and Environmental Science, vol. 981, p. 042016. IOP Publishing (2022)
Carvajal-Ramírez, F., Navarro-Ortega, A.D., Agüera-Vega, F., Martínez-Carricondo, P., Mancini, F.: Virtual reconstruction of damaged archaeological sites based on unmanned aerial vehicle photogrammetry and 3D modelling. Study case of a Southeastern Iberia production area in the bronze age. Measurement 136, 225–236 (2019)
Guan, J., et al.: Full field-of-view pavement stereo reconstruction under dynamic traffic conditions: incorporating height-adaptive vehicle detection and multi-view occlusion optimization. Autom. Constr. 144, 104615 (2022)
Schneider, F.D., Kükenbrink, D., Schaepman, M.E., Schimel, D.S., Morsdorf, F.: Quantifying 3D structure and occlusion in dense tropical and temperate forests using close-range lidar. Agric. Forest Meteorol. 268, 249–257 (2019). https://doi.org/10.1016/j.agrformet.2019.01.033. https://www.sciencedirect.com/science/article/pii/S0168192319300267
Zhao, J., et al.: A wheat spike detection method in UAV images based on improved YOLOv5. Remote Sens. 13(16) (2021). https://doi.org/10.3390/rs13163095. https://www.mdpi.com/2072-4292/13/16/3095
Qi, Q., Hossain, M.M., Li, J.J., Zhang, B., Li, J., Xu, C.L.: Approach to reduce light field sampling redundancy for flame temperature reconstruction. Opt. Express 29(9), 13094–13114 (2021)
Gilliam, C., Dragotti, P.L., Brookes, M.: On the spectrum of the plenoptic function. IEEE Trans. Image Process. 23(2), 502–516 (2013)
Wu, G., Liu, Y., Fang, L., Chai, T.: Revisiting light field rendering with deep anti-aliasing neural network. IEEE Trans. Pattern Anal. Mach. Intell. 44(9), 5430–5444 (2021)
Adelson, E.H., Bergen, J.R., et al.: The plenoptic function and the elements of early vision. Comput. Models Vis. Process. 1(2), 3–20 (1991)
Zhu, C., Zhang, H., Liu, Q., Zhuang, Z., Yu, L.: A signal-processing framework for occlusion of 3D scene to improve the rendering quality of views. IEEE Trans. Image Process. 29, 8944–8959 (2020)
Durand, F., Holzschuch, N., Soler, C., Chan, E., Sillion, F.X.: A frequency analysis of light transport. ACM Trans. Graph. (TOG) 24(3), 1115–1126 (2005)
Buehler, C., Bosse, M., McMillan, L., Gortler, S., Cohen, M.: Unstructured Lumigraph rendering. In: Proceedings of the 28th Annual Conference on Computer Graphics and Interactive Techniques, pp. 425–432 (2001)
Liu, Q., Wang, Y., Wei, Y., Xie, L., Zhu, C., Zhou, R.: Spectral analysis of aerial light field for optimization sampling and rendering of unmanned aerial vehicle. In: 2022 IEEE International Conference on Visual Communications and Image Processing (VCIP), pp. 1–5. IEEE (2022)
Chai, J.X., Tong, X., Chan, S.C., Shum, H.Y.: Plenoptic sampling. In: Proceedings of the 27th Annual Conference on Computer Graphics and Interactive Techniques, SIGGRAPH 2000, pp. 307–318. ACM Press/Addison-Wesley Publishing Co., USA (2000). https://doi.org/10.1145/344779.344932
Bolles, R.C., Baker, H.H., Marimont, D.H.: Epipolarplane image analysis: an approach to determining structure from motion. Int. J. Comput. Vis. 1(1), 7–55 (1987)
Acknowledgment
This work was supported in part by National Natural Science Foundation of China (No. 62067003), in part by Culture and Art Science Planning Project of Jiangxi Province (No. YG2018042), in part by Humanities and Social Science Project of Jiangxi Province (No. JC18224).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2024 ICST Institute for Computer Sciences, Social Informatics and Telecommunications Engineering
About this paper
Cite this paper
Liu, Q., Yan, K., Wang, Y., Li, R., Luo, Y. (2024). An Occlusion Signal-Processing Framework Based on UAV Sampling for Improving Rendering Quality of Views. In: Wu, C., Chen, X., Feng, J., Wu, Z. (eds) Mobile Networks and Management. MONAMI 2023. Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering, vol 559. Springer, Cham. https://doi.org/10.1007/978-3-031-55471-1_1
Download citation
DOI: https://doi.org/10.1007/978-3-031-55471-1_1
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-55470-4
Online ISBN: 978-3-031-55471-1
eBook Packages: Computer ScienceComputer Science (R0)