skip to main content
10.1145/3177148.3180081acmotherconferencesArticle/Chapter ViewAbstractPublication PagesmedpraiConference Proceedingsconference-collections
research-article

3D Building Synthesis Based on Images and Affine Invariant Salient Features

Published: 27 March 2018 Publication History

Abstract

In this paper, we introduce a method to synthesize and recognize buildings using a set of at least two 2D images taken from different views. Based on a coarse set of affine invariant salient feature points (corner points) on the images, a 3D high resolution building model is obtained in accordance with the observed images. Corresponding salient points are found using the ratio of triangle areas formed from a set of four consecutive ordered salient corresponding points that form two triangles. The order is obtained by finding the vertices of the convex hull of the salient points. The salient points are tessellated to form a high resolution triangular mesh with the appearance of a triangular patch in the image imported onto the personalized 3D model. With multiple images, all coordinates and appearance are reconstructed in accordance with the observed images. The 3D model reconstruction method allows for a 3D classification of a test building to one of many possible buildings stored in the database. The classification is based on a geometric 3D point cloud error. For buildings with very close 3D cloud errors, a further classification is achieved based on the mean squared error (MSE) on the appearance of corresponding points on the test and base models. Our method can also be used in localization when preloaded location information of each model in the database is stored, hence helping an observer navigate without a GPS system.

References

[1]
Bruno, F., et al., From 3D reconstruction to virtual reality: A complete methodology for digital archaeological exhibition. Journal of Cultural Heritage, 2010. 11(1): p. 42--49.
[2]
Overby, J., et al., Automatic 3D building reconstruction from airborne laser scanning and cadastral data using Hough transform. International Archives of Photogrammetry, Remote Sensing and Spatial Information Sciences, 2004. 34: p. 296--301.
[3]
Kada, M. and L. McKinley, 3D building reconstruction from LiDAR based on a cell decomposition approach. International Archives of Photogrammetry, Remote Sensing and Spatial Information Sciences, 2009. 38(Part 3): p. W4.
[4]
Suveg, I. and G. Vosselman, Reconstruction of 3D building models from aerial images and maps. ISPRS Journal of Photogrammetry and remote sensing, 2004. 58(3): p. 202--224.
[5]
Wu, C., et al. 2008, 3D model matching with viewpoint-invariant patches (VIP). in IEEE. In Conference of Computer Vision and Pattern Recognition (2008).
[6]
Schindler, K. and J. Bauer. A model-based method for building reconstruction. in Higher-Level Knowledge in 3D Modeling and Motion Analysis, 2003.
[7]
Zhang, W. and J. Kosecka. Localization based on building recognition. in Computer Vision and Pattern Recognition-Workshops (2005).
[8]
Fritz, G., et al., Building detection from mobile imagery using informative SIFT descriptors. Image Analysis, 2005: p. 284--287.
[9]
Lowe, D.G., Distinctive image features from scale-invariant keypoints. International journal of computer vision, 2004. 60(2): p. 91--110.
[10]
Zhang, C. and F.S. Cohen, 3-D face structure extraction and recognition from images using 3-D morphing and distance mapping. IEEE Transactions on Image Processing, 2002. 11(11): p. 1249--1259.
[11]
Liu Z. and Cohen F. S., "3D face reconstruction from image(s) based on gender and ethnicity models," CGVCVIP2017, Lisbon, Portugal (July 2017).

Cited By

View all
  • (2020)3D iris model and reader for iris identificationConcurrency and Computation: Practice and Experience10.1002/cpe.565333:12Online publication date: 6-Jan-2020
  • (2019)Content-based Image Retrieval System for Locating Building in Syiah Kuala University using Android Platform2019 2nd International Conference on Applied Information Technology and Innovation (ICAITI)10.1109/ICAITI48442.2019.8982132(146-151)Online publication date: Sep-2019
  • (2019)Iris Identification in 3DImage Analysis10.1007/978-3-030-20205-7_27(324-335)Online publication date: 12-May-2019

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences
MedPRAI '18: Proceedings of the 2nd Mediterranean Conference on Pattern Recognition and Artificial Intelligence
March 2018
135 pages
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

In-Cooperation

  • IAPR: International Association for Pattern Recognition

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 27 March 2018

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. 3D building reconstruction
  2. GPS
  3. invariants
  4. localization
  5. salient features

Qualifiers

  • Research-article
  • Research
  • Refereed limited

Conference

MedPRAI '18

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)1
  • Downloads (Last 6 weeks)0
Reflects downloads up to 17 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2020)3D iris model and reader for iris identificationConcurrency and Computation: Practice and Experience10.1002/cpe.565333:12Online publication date: 6-Jan-2020
  • (2019)Content-based Image Retrieval System for Locating Building in Syiah Kuala University using Android Platform2019 2nd International Conference on Applied Information Technology and Innovation (ICAITI)10.1109/ICAITI48442.2019.8982132(146-151)Online publication date: Sep-2019
  • (2019)Iris Identification in 3DImage Analysis10.1007/978-3-030-20205-7_27(324-335)Online publication date: 12-May-2019

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media