article

Image-based procedural modeling of facades

Authors:

Pascal Müller,

Luc Van GoolAuthors Info & Claims

ACM Transactions on Graphics (TOG), Volume 26, Issue 3

Pages 85 - es

https://doi.org/10.1145/1276377.1276484

Published: 29 July 2007 Publication History

Abstract

This paper describes algorithms to automatically derive 3D models of high visual quality from single facade images of arbitrary resolutions. We combine the procedural modeling pipeline of shape grammars with image analysis to derive a meaningful hierarchical facade subdivision. Our system gives rise to three exciting applications: urban reconstruction based on low resolution oblique aerial imagery, reconstruction of facades based on higher resolution ground-based imagery, and the automatic derivation of shape grammar rules from facade images to build a rule base for procedural modeling technology.

Supplementary Material

JPG File (pps084.jpg)

Download
27.09 KB

MP4 File (pps084.mp4)

Download
74.51 MB

References

[1]

Alegre, F., and Dellaert, F. 2004. A probabilistic approach to the semantic interpretation of building facades. In International Workshop on Vision Techniques Applied to the Rehabilitation of City Centres.

[2]

Bekins, D., and Aliaga, D. 2005. Build-by-number: Rearranging the real world to visualize novel architectural spaces. In IEEE Visualization.

[3]

Brenner, C., and Ripperda, N. 2006. Extraction of facades using rjM-CMC and constraint equations. In Photogrammetric Computer Vision, 155--160.

[4]

Debevec, P. E., Taylor, C. J., and Malik, J. 1996. Modeling and rendering architecture from photographs: A hybrid geometry- and image-based approach. In Proceedings of ACM SIGGRAPH 96, ACM Press, H. Rushmeier, Ed., 11--20.

Digital Library

[5]

Dick, A., Torr, P., Ruffle, S., and Cipolla, R. 2001. Combining single view recognition and multiple view stereo for architectural scenes. In ICCV, IEEE Computer Society, Los Alamitos, CA, 268--274.

[6]

Dick, A. R., Torr, P. H. S., and Cipolla, R. 2004. Modelling and interpretation of architecture from several images. International Journal of Computer Vision 60, 2, 111--134.

Digital Library

[7]

Duarte, J. 2002. Malagueira Grammar --- towards a tool for customizing Alvaro Siza's mass houses at Malagueira. PhD thesis, MIT School of Architecture and Planning.

[8]

Flemming, U. 1987. More than the sum of its parts: the grammar of queen anne houses. Environment and Planning B 14, 323--350.

[9]

Früh, C., and Zakhor, A. 2001. 3D model generation for cities using aerial photographs and ground level laser scans. In CVPR, IEEE Computer Society, 31--38.

[10]

Früh, C., and Zakhor, A. 2003. Constructing 3d city models by merging ground-based and airborne views. Computer Graphics and Applications (Nov.), 52--61.

Digital Library

[11]

Han, F., and Zhu, S.-C. 2005. Bottom-up/top-down image parsing by attribute graph grammar. In ICCV, IEEE Computer Society, Washington, DC, USA, 1778--1785.

Digital Library

[12]

Havemann, S. 2005. Generative Mesh Modeling. PhD thesis, TU Braunschweig.

[13]

Hu, J., You, S., and Neumann, U. 2006. Integrating lidar, aerial image and ground images for complete urban building modeling. In 3DPVT.

Digital Library

[14]

Jepson, W., Liggett, R., and Friedman, S. 1996. Virtual modeling of urban environments. PRESENCES 5, 1, 72--86.

Digital Library

[15]

Jojic, N., Frey, B., and Kannan, A. 2003. Epitomic analysis of appearance and shape. In ICCV, IEEE Computer Society, 34--41.

Digital Library

[16]

Karner, K., Bauer, J., Klaus, A., Leberl, F., and Grabner, M. 2001. Virtual habitat: Models of the urban outdoors. In Third International Workshop on Automatic Extraction of Man-Made Objects from Aerial and Space Imaging, 393--402.

[17]

Koning, H., and Eizenberg, J. 1981. The language of the prairie: Frank lloyd wrights prairie houses. Environment and Planning B 8, 295--323.

[18]

Kullback, S. 1959. Information theory and statistics. John Wiley and Sons., New York.

[19]

Lee, S. C., and Nevatia, R. 2003. Interactive 3D building modeling using a hierarchical representation. In International Workshop on Higher-Level Knowledge in 3D Modeling and Motion Analysis, IEEE Computer Society, 58--65.

Digital Library

[20]

Lee, S. C., and Nevatia, R. 2004. Extraction and integration of window in a 3D building model from ground view image. In CVPR, IEEE Computer Society, 113--120.

Digital Library

[21]

Lee, S. C., Jung, S. K., and Nevatia, R. 2002. Automatic integration of facade textures into 3D building models with a projective geometry based line clustering. Computer Graphics Forum 21, 3 (Sept.), 511--519.

[22]

Legakis, J., Dorsey, J., and Gortler, S. J. 2001. Feature-based cellular texturing for architectural models. In Proceedings of ACM SIGGRAPH 2001, ACM Press, E. Fiume, Ed., 309--316.

Digital Library

[23]

Liebowitz, D., and Zisserman, A. 1998. Metric rectification for perspective images of planes. In CVPR, IEEE Computer Society, 482--488.

Digital Library

[24]

Marvie, J.-E., Perret, J., and Bouatouch, K. 2005. The FL-system: a functional L-system for procedural geometric modeling. The Visual Computer 21, 5, 329--339.

Digital Library

[25]

Měch, R., and Prusinkiewicz, P. 1996. Visual models of plants interacting with their environment. In Proceedings of ACM SIGGRAPH 96, ACM Press, H. Rushmeier, Ed., 397--410.

Digital Library

[26]

Müller, P., Wonka, P., Haegler, S., Ulmer, A., and Van Gool, L. 2006. Procedural Modeling of Buildings. In Proceedings of ACM SIGGRAPH 2006 / ACM Transactions on Graphics, ACM Press, New York, NY, USA, vol. 25, 614--623.

Digital Library

[27]

Parish, Y. I. H., and Müller, P. 2001. Procedural modeling of cities. In Proceedings of ACM SIGGRAPH 2001, ACM Press, E. Fiume, Ed., 301--308.

Digital Library

[28]

Prusinkiewicz, P., and Lindenmayer, A. 1991. The Algorithmic Beauty of Plants. Springer Verlag.

Digital Library

[29]

Prusinkiewicz, P., James, M., and Měch, R. 1994. Synthetic topiary. In Proceedings of ACM SIGGRAPH 94, ACM Press, A. Glassner, Ed., 351--358.

Digital Library

[30]

Prusinkiewicz, P., Mündermann, P., Karwowski, R., and Lane, B. 2001. The use of positional information in the modeling of plants. In Proceedings of ACM SIGGRAPH 2001, ACM Press, E. Fiume, Ed., 289--300.

Digital Library

[31]

Ramamoorthi, R., and Arvo, J. 1999. Creating generative models from range images. In SIGGRAPH '99: Proceedings of the 26th annual conference on Computer graphics and interactive techniques, ACM Press/Addison-Wesley Publishing Co., New York, NY, USA, 195--204.

Digital Library

[32]

Realviz, 2007. Realviz ImageModeler V4.0 product information. http://www.realviz.com.

[33]

Ribarsky, W., Wasilewski, T., and Faust, N. 2002. From urban terrain models to visible cities. IEEE Computer Graphics & Applications 22, 4, 231--238.

Digital Library

[34]

Schindler, K., and Bauer, J. 2003. A model-based method for building reconstruction. In International Workshop on Higher-Level Knowledge in 3D Modeling and Motion Analysis, IEEE Computer Society, 74--82.

Digital Library

[35]

Stiny, G., and Mitchell, W. J. 1978. The palladian grammar. Environment and Planning B 5, 5--18.

[36]

Stiny, G. 1975. Pictorial and Formal Aspects of Shape and Shape Grammars. Birkhauser Verlag, Basel.

[37]

Stiny, G. 1982. Spatial relations and grammars. Environment and Planning B 9, 313--314.

[38]

Takase, Y., Sho, N., Sone, A., and Shimiya, K. 2003. Automatic generation of 3d city models and related applications. In International Archives of Photogrammetry, Remote Sensing and Spatial Information Sciences, 113--120.

[39]

Wang, X., Totaro, S., Taillandier, F., Hanson, A., and Teller, S. 2002. Recovering facade texture and microstructure from real-world images. In Proc. ISPRS Commission III Symposium on Photogrammetric Computer Vision, 381--386.

[40]

Wang, L., You, S., and Neumann, U. 2006. Large-scale urban modeling by combining ground level panoramic and aerial imagery. In 3DPVT.

Digital Library

[41]

Wells, W., Viola, P., Atsumi, H., Nakajima, S., and Kikinis, R., 1996. Multi-modal volume registration by maximization of mutual information.

[42]

Wonka, P., Wimmer, M., Sillion, F., and Ribarsky, W. 2003. Instant architecture. ACM Transactions on Graphics 22, 3, 669--677.

Digital Library

Cited By

Pinki Shekhawat KLal A(2025)Automated generation of floor plans with minimum bendsArtificial Intelligence for Engineering Design, Analysis and Manufacturing10.1017/S089006042400017939Online publication date: 4-Feb-2025
https://doi.org/10.1017/S0890060424000179
Escalada M(2024)Leveraging deep learning segmentation techniques and connected component analysis to automate high-level cost estimates of facade retrofits using 2D imagesVITRUVIO - International Journal of Architectural Technology and Sustainability10.4995/vitruvio-ijats.2024.224219:2Online publication date: 13-Dec-2024
https://doi.org/10.4995/vitruvio-ijats.2024.22421
Ogawa YNakamura RSato GMaeda HSekimoto Y(2024)End-to-End Framework for the Automatic Matching of Omnidirectional Street Images and Building Data and the Creation of 3D Building ModelsRemote Sensing10.3390/rs1611185816:11(1858)Online publication date: 23-May-2024
https://doi.org/10.3390/rs16111858
Show More Cited By

Index Terms

Image-based procedural modeling of facades
1. Computing methodologies
2. Theory of computation
  1. Formal languages and automata theory
    1. Formalisms
      1. Rewrite systems
    2. Grammars and context-free languages
  2. Randomness, geometry and discrete structures
    1. Computational geometry

Recommendations

Procedural modeling of buildings

CGA shape, a novel shape grammar for the procedural modeling of CG architecture, produces building shells with high visual quality and geometric detail. It produces extensive architectural models for computer games and movies, at low cost. Context ...
Procedural modeling of cities
SIGGRAPH '01: Proceedings of the 28th annual conference on Computer graphics and interactive techniques

Modeling a city poses a number of problems to computer graphics. Every urban area has a transportation network that follows population and environmental influences, and often a superimposed pattern plan. The buildings appearances follow historical, ...
Image-based procedural modeling of facades
SIGGRAPH '07: ACM SIGGRAPH 2007 papers

This paper describes algorithms to automatically derive 3D models of high visual quality from single facade images of arbitrary resolutions. We combine the procedural modeling pipeline of shape grammars with image analysis to derive a meaningful ...

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Graphics

ACM Transactions on Graphics Volume 26, Issue 3

July 2007

976 pages

ISSN:0730-0301

EISSN:1557-7368

DOI:10.1145/1276377

Issue’s Table of Contents

Copyright © 2007 ACM.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 29 July 2007

Published in TOG Volume 26, Issue 3

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

331
Total Citations
View Citations
2,963
Total Downloads

Downloads (Last 12 months)41
Downloads (Last 6 weeks)6

Reflects downloads up to 05 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Pinki Shekhawat KLal A(2025)Automated generation of floor plans with minimum bendsArtificial Intelligence for Engineering Design, Analysis and Manufacturing10.1017/S089006042400017939Online publication date: 4-Feb-2025
https://doi.org/10.1017/S0890060424000179
Escalada M(2024)Leveraging deep learning segmentation techniques and connected component analysis to automate high-level cost estimates of facade retrofits using 2D imagesVITRUVIO - International Journal of Architectural Technology and Sustainability10.4995/vitruvio-ijats.2024.224219:2Online publication date: 13-Dec-2024
https://doi.org/10.4995/vitruvio-ijats.2024.22421
Ogawa YNakamura RSato GMaeda HSekimoto Y(2024)End-to-End Framework for the Automatic Matching of Omnidirectional Street Images and Building Data and the Creation of 3D Building ModelsRemote Sensing10.3390/rs1611185816:11(1858)Online publication date: 23-May-2024
https://doi.org/10.3390/rs16111858
Huang SHu HZhu Q(2024) I 2 -FaçadeNet: An Illumination-invariant Façade Recognition Network Leveraging Sparsely Gated Mixture of Multi-color Space Experts for Aerial Oblique Imagery Photogrammetric Engineering & Remote Sensing10.14358/PERS.23-00033R290:1(21-31)Online publication date: 1-Jan-2024
https://doi.org/10.14358/PERS.23-00033R2
Hou JZhou JHe YHou BLi J(2024)Automatic reconstruction of semantic façade model of architectural heritageHeritage Science10.1186/s40494-024-01506-912:1Online publication date: 12-Nov-2024
https://doi.org/10.1186/s40494-024-01506-9
A LK C(2024)A comprehensive literature review and bibliometric analysis on shape grammar theory and applications in architectureInternational Journal of Architectural Computing10.1177/14780771241281809Online publication date: 18-Sep-2024
https://doi.org/10.1177/14780771241281809
Plocharski ASwidzinski JPorter-Sobieraj JMusialski P(2024)FaçAID: A Transformer Model for Neuro-Symbolic Facade ReconstructionSIGGRAPH Asia 2024 Conference Papers10.1145/3680528.3687657(1-11)Online publication date: 3-Dec-2024
https://dl.acm.org/doi/10.1145/3680528.3687657
Shang QHu HYu HXu BWang LZhu Q(2024)Semantic Image Translation for Repairing the Texture Defects of Building ModelsIEEE Transactions on Geoscience and Remote Sensing10.1109/TGRS.2023.333896262(1-20)Online publication date: 2024
https://doi.org/10.1109/TGRS.2023.3338962
Kutzias Dvon Mammen S(2024)Recent Advances in Procedural Generation of Buildings: From Diversity to IntegrationIEEE Transactions on Games10.1109/TG.2023.326250716:1(16-35)Online publication date: Mar-2024
https://doi.org/10.1109/TG.2023.3262507
Kookalani SParn EBrilakis IDirar STheofanous MFaramarzi AMahdavipour MFeng Q(2024)Trajectory of building and structural design automation from generative design towards the integration of deep generative models and optimization: A reviewJournal of Building Engineering10.1016/j.jobe.2024.11097297(110972)Online publication date: Nov-2024
https://doi.org/10.1016/j.jobe.2024.110972
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Issue’s Table of Contents