skip to main content
10.1145/3149808.3149810acmotherconferencesArticle/Chapter ViewAbstractPublication PagesgisConference Proceedingsconference-collections
research-article

An application of convolutional neural network in street image classification: the case study of london

Published:07 November 2017Publication History

ABSTRACT

Street frontage quality is an important element in urban design as it contributes to the interest, social life and success of public spaces. To collect the data needed to evaluate street frontage quality at the city or regional level using traditional survey method is both costly and time consuming. As a result, this research proposes a pipeline that uses convolutional neural network to classify the frontage of a street image through the case study of Greater London. A novelty of the research is it uses both Google streetview images and 3D-model generated streetview images for the classification. The benefit of this approach is that it can provide a framework to test different urban parameters to help evaluate future urban design projects. The research finds encouraging results in classifying urban frontage quality using deep learning models. This research also finds that augmenting the baseline model with images produced from a 3D-model can improve slightly the accuracy of the results. However these results should be taken as preliminary, where we acknowledge several limitations such as the lack of adversarial analysis, labeled data, or parameter tuning. Despite these limitations, the results of the proof-of-concept study is positive and carries great potential in the application of urban data analytics.

References

  1. L Chen, G Papandreou, I Kokkinos, K Murphy, and A.L. Yuille. 2014. Semantic image segmentatiom with deep convolutional nets and fully connected crfs. arXiv preprint arXiv:1412.7062 (2014).Google ScholarGoogle Scholar
  2. C Doersch, S Singh, C Wu, and W Hui. 2012. ACM Transactions on Graphics. What makes Paris look like Paris (2012).Google ScholarGoogle Scholar
  3. ESRI. 2013. http://www.esri.com/software/cityengine/. (2013).Google ScholarGoogle Scholar
  4. J Gehl. 1971. Life between buildings: Using public space. The Danish Architectural Press.Google ScholarGoogle Scholar
  5. J. Gehl. 2010. Cities for People. Island Press.Google ScholarGoogle Scholar
  6. R Girshick. 2015. Fast R-CNN. IEEE International Conference on Computer Vision (2015). Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Google. 2017. https://www.maps.google.com/. (2017). Accessed: 2017.Google ScholarGoogle Scholar
  8. E Heffernan, T Heffernan, and W Pan. 2014. The relationship between the quality of active frontages and public perceptions of public spaces. Urban Design international (2014).Google ScholarGoogle Scholar
  9. J. Jacobs. 1961. The Death and Life of Great American Cities. Random House Inc.Google ScholarGoogle Scholar
  10. Y Jia. 2012. Caffe: An open source convolution architecture for fast feature embedding. http://caffe.berkeleyvision.org. (2012). Accessed: 2016.Google ScholarGoogle Scholar
  11. A Krizhevsky, I Sutskever, and G.E Hinton. 2012. Imagenet classification with deep convolutional neural networks. Advances in neural information processing (2012). Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Y Li, M Paluri, J Rehg, and P Dollar. 2016. Unsupervised learning of edges. CVPR (2016).Google ScholarGoogle Scholar
  13. L Liu, E Silva, C Wu, and W Hui. 2017. A machine learning-based method for the large-scale evaluation of the urban environment. Computers, Environment and Urban Systems (2017).Google ScholarGoogle Scholar
  14. N. Naik, J. Philipoom, R. Raskar, and C.A. Hidalgo. 2014. StreetScore - Predicting the Perceived Safety of One Million Streetscapes. In CVPR Workshop on Web-scale Vision and Social Media. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Office of the Deputy Prime Minister. 2005. Safer Places: The Planning System and Crime Prevention. Home Office.Google ScholarGoogle Scholar
  16. C Seresinhe, T Preis, and S Moat. 2017. Using deep learning to quantify the beauty of oudoor plaes. Royal Society Open Science (2017).Google ScholarGoogle Scholar
  17. Streetscore. 2014. http://streetscore.media.mit.edu. (2014). Accessed: 2016-04-29.Google ScholarGoogle Scholar
  18. Llewelyn Davies Yeang and Homes Communities Agency. 2013. Urban Design Compendium. English Partnerships and The Housing Corporation.Google ScholarGoogle Scholar
  19. B Zhou, J Lapedriza, A Xiao, A Torralba, and A Oliva. 2014. Learning deep features for scene recognition using places database. Advances in neural information processing (2014). Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. An application of convolutional neural network in street image classification: the case study of london

        Recommendations

        Comments

        Login options

        Check if you have access through your login credentials or your institution to get full access on this article.

        Sign in
        • Published in

          cover image ACM Other conferences
          GeoAI '17: Proceedings of the 1st Workshop on Artificial Intelligence and Deep Learning for Geographic Knowledge Discovery
          November 2017
          57 pages
          ISBN:9781450354981
          DOI:10.1145/3149808

          Copyright © 2017 ACM

          Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

          Publisher

          Association for Computing Machinery

          New York, NY, United States

          Publication History

          • Published: 7 November 2017

          Permissions

          Request permissions about this article.

          Request Permissions

          Check for updates

          Qualifiers

          • research-article

          Acceptance Rates

          Overall Acceptance Rate17of25submissions,68%

        PDF Format

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader