Abstract
The fast and automatic façade extraction method is an important step to retrieve actual information about cities. It helps to maintain a public registry, may be used to examine the technical condition of buildings or in process of city planning. We propose an automatic method to detect and retrieve building façades from spherical images. Our method uses deep learning models trained on automatically labelled spherical images collected in the virtual city we have generated. Finally, we compare the proposed solution using three different deep learning models with a classic method. Our experiment revealed that the proposed approach has a similar or better performance than the current methods. Moreover, our solution works with unprepared data, while existing methods require data pre-processing.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Meixner, P., Wendel, A., Bischof, H., Leberl, F.: Building façade separation in vertical aerial images. In: Annals of the International Society for Photogrammetry, Remote Sensing and Spatial Information Sciences (ISPRS), pp. 239–243 (2012). https://doi.org/10.5194/isprsannals-I-3-239-2012
Wang, R., Xia, S.: Façade separation in ground-based LiDAR point clouds based on edges and windows. IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens. 12(3), 1041–1052 (2019)
Recky, M., Wendel, A., Leberl, F.: Façade segmentation in a multi-view scenario. In: International Conference on 3D Imaging, Modeling, Processing, Visualization and Transmission (3DIMPVT), pp. 358–365 (2011). https://doi.org/10.1109/3DIMPVT.2011.52
Sümer, E., Türker, M.: An automatic region growing based approach to extract façade textures from single ground-level building images. J. Geodesy Geoinf. 2(1), 9–17 (2013). https://doi.org/10.9733/jgg.061213.2
Wendel, A., Donoser, M., Bischof, H.: Unsupervised façade segmentation using repetitive patterns. In: Goesele, M., Roth, S., Kuijper, A., Schiele, B., Schindler, K. (eds.) DAGM 2010. LNCS, vol. 6376, pp. 51–60. Springer, Heidelberg (2010). https://doi.org/10.1007/978-3-642-15986-2_6
Hernández, J., Marcotegui, B.: Morphological segmentation of building façade images. In: 16th IEEE International Conference on Image Processing (ICIP), pp. 4029–4032 (2009). https://doi.org/10.1109/ICIP.2009.5413756
Eddins, S.: The watershed transform: strategies for image segmentation. https://www.mathworks.com/company/newsletters/articles/the-watershed-transform-strategies-for-image-segmentation.html. Accessed 15 Jan 2021
Szelinski, R.: Computer Vision: Algorithms and Applications. Springer, London (2011). https://doi.org/10.1007/978-1-84882-935-0
Hafiz, A.M., Bhat, G.M.: A survey on instance segmentation: state of the art. Int. J. Multimed. Inf. Retr. 9(3), 171–189 (2020). https://doi.org/10.1007/s13735-020-00195-x
Girshick, R.: Fast R-CNN. In: IEEE International Conference on Computer Vision (ICCV), pp. 1440–1448 (2015). https://doi.org/10.1109/ICCV.2015.169
He, K., Gkioxari, G., Dollár, P., Girshick, R.: Mask R-CNN. In: IEEE International Conference on Computer Vision (ICCV), pp. 2980–2988 (2017). https://doi.org/10.1109/ICCV.2017.322
Huang, Z., Huang, L., Gong, Y., Huang, C., Wang, X.: Mask scoring R-CNN. In: IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 6402–6411 (2019). https://doi.org/10.1109/CVPR.2019.00657
Bolya, D., Zhou, C., Xiao, F., Lee, Y.J.: YOLACT: real-time instance segmentation. In: IEEE/CVF International Conference on Computer Vision (ICCV), pp. 9156–9165 (2019). https://doi.org/10.1109/ICCV.2019.00925
Chen, X., Girshick, R., He, K., Dollar, P.: TensorMask: a foundation for dense object segmentation. In: IEEE/CVF International Conference on Computer Vision (ICCV), pp. 2061–2069 (2019). https://doi.org/10.1109/ICCV.2019.00215
Dutta, A., Zisserman, A.: The VIA annotation software for images, audio and video. In: Proceedings of the 27th ACM International Conference on Multimedia (MM 2019), pp. 2276–2279 (2019). https://doi.org/10.1145/3343031.3350535
Lin, T.-Y., et al.: Microsoft COCO: common objects in context. In: Fleet, D., Pajdla, T., Schiele, B., Tuytelaars, T. (eds.) ECCV 2014. LNCS, vol. 8693, pp. 740–755. Springer, Cham (2014). https://doi.org/10.1007/978-3-319-10602-1_48
Zhao, M., Wu, J.: Automatic building modeling based on CityEngine. J. Geomatics 42, 92–95 (2017). https://doi.org/10.14188/j.2095-6045.2015330
py360convert: https://github.com/sunset1995/py360convert. Accessed 15 Jan 2021
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Springer Nature Switzerland AG
About this paper
Cite this paper
Kutrzyński, M., Żak, B., Telec, Z., Trawiński, B. (2021). An Approach to Automatic Detection of Architectural Façades in Spherical Images. In: Nguyen, N.T., Chittayasothorn, S., Niyato, D., Trawiński, B. (eds) Intelligent Information and Database Systems. ACIIDS 2021. Lecture Notes in Computer Science(), vol 12672. Springer, Cham. https://doi.org/10.1007/978-3-030-73280-6_39
Download citation
DOI: https://doi.org/10.1007/978-3-030-73280-6_39
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-73279-0
Online ISBN: 978-3-030-73280-6
eBook Packages: Computer ScienceComputer Science (R0)