skip to main content
10.1145/3474717.3484257acmconferencesArticle/Chapter ViewAbstractPublication PagesgisConference Proceedingsconference-collections
research-article

Attention-Based Spatial Interpolation for House Price Prediction

Authors Info & Claims
Published:04 November 2021Publication History

ABSTRACT

Estimating the market price of a house is important for many businesses such as real estate and mortgage lending companies. The price of a house depends not only on its structural features (e.g. area and number of bedrooms) but also on the spatial context where it is located. In this work we estimate the price of a house based solely on its structural features and the characteristics and price of its neighbors. For that, we propose a hybrid attention mechanism that weights neighbors based on their similarity to the house in terms of structural features and geographic location. For the structural features, we apply an euclidean-based attention and, for the geographic location, we propose an attention layer based on a radial basis function kernel. Those attention mechanisms are then used by a neural network regressor to predict the price of a house and to generate a vector representation of the house based on its implicit context: the house embedding, which can be used as a feature set by any regressor to perform house price prediction. We have performed an extensive experimental evaluation on real-world datasets that shows that: (1) regressors using house embedding obtained the best results on all 4 datasets, outperforming baseline models; (2) the learned house embedding improves the performance of the evaluated regressors in almost all scenarios in comparison to raw features; and (3) simple regressor models such as Linear Regression using house embedding achieved comparable results to more competitive algorithms (e.g. Random Forest and Xgboost).

References

  1. Dzmitry Bahdanau, Kyunghyun Cho, and Yoshua Bengio. 2015. Neural machine translation by jointly learning to align and translate. In 3rd International Conference on Learning Representations, ICLR 2015.Google ScholarGoogle Scholar
  2. Gleb Beliakov and Gang Li. 2012. Improving the speed and stability of the k-nearest neighbors method. Pattern Recognition Letters 33, 10 (2012), 1296--1301.Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. A. J. Bency, S. Rallapalli, R. K. Ganti, M. Srivatsa, and B. S. Manjunath. 2017. Beyond Spatial Auto-Regressive Models: Predicting Housing Prices with Satellite Imagery. In 2017 IEEE Winter Conference on Applications of Computer Vision (WACV). 320--329. https://doi.org/10.1109/WACV.2017.42Google ScholarGoogle Scholar
  4. James Bergstra, Brent Komer, Chris Eliasmith, Dan Yamins, and David Cox. 2015. Hyperopt: A Python library for model selection and hyperparameter optimization. Computational Science Discovery 8 (07 2015), 014008.Google ScholarGoogle Scholar
  5. Z. Bessinger and N.Jacobs. 2016. Quantifying curb appeal. In 2016 IEEE International Conference on Image Processing (ICIP). 4388--4392.Google ScholarGoogle ScholarCross RefCross Ref
  6. Christopher M. Bishop. 2006. Pattern Recognition and Machine Learning. Springer.Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Leo Breiman. 2001. Random Forests. Mach. Learn. 45, 1 (Oct. 2001), 5--32.Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Martin D Buhmann. 2003. Radial basis functions: theory and implementations. Vol. 12. Cambridge university press.Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Tianqi Chen and Carlos Guestrin. 2016. XGBoost: A Scalable Tree Boosting System. In Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (San Francisco, California, USA) (KDD '16). ACM, New York, NY, USA, 785--794.Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. François Chollet et al. 2015. Keras. https://keras.io.Google ScholarGoogle Scholar
  11. Sarkar Snigdha Sarathi Das, Mohammed Eunus Ali, Yuan-Fang Li, Yong-Bin Kang, and Timos Sellis. 2020. Boosting House Price Predictions using Geo-Spatial Network Embedding. CoRR abs/2009.00254 (2020). arXiv:2009.00254 https://arxiv.org/abs/2009.00254Google ScholarGoogle Scholar
  12. Matthias Feurer, Aaron Klein, Katharina Eggensperger, Jost Springenberg, Manuel Blum, and Frank Hutter. 2015. Efficient and Robust Automated Machine Learning. In Advances in Neural Information Processing Systems 28, C. Cortes, N.D.Lawrence, D. D. Lee, M. Sugiyama, and R. Garnett (Eds.). Curran Associates, Inc., 2962--2970.Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. Yanjie Fu, Hui Xiong, Yong Ge, Zijun Yao, Yu Zheng, and Zhi-Hua Zhou. 2014. Exploiting Geographic Dependencies for Real Estate Appraisal: A Mutual Perspective of Ranking and Clustering. In Proceedings of the 20th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (New York, New York, USA) (KDD '14). ACM, New York, NY, USA, 1047--1056. https://doi.org/10.1145/2623330.2623675Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Guolin Ke, Qi Meng, Thomas Finley, Taifeng Wang, Wei Chen, Weidong Ma, Qiwei Ye, and Tie-Yan Liu. 2017. LightGBM: A Highly Efficient Gradient Boosting Decision Tree. In NIPS.Google ScholarGoogle Scholar
  15. Diederik Kingma and Jimmy Ba. 2014. Adam: A Method for Stochastic Optimization. International Conference on Learning Representations (12 2014).Google ScholarGoogle Scholar
  16. Stephen Law, Brooks Paige, and Chris Russell. 2018. Take a look around: using street view and satellite images to estimate house prices. arXiv preprint arXiv:1807.07155 (2018).Google ScholarGoogle Scholar
  17. B. Liu, B. Mavrin, D. Niu, and L. Kong. 2016. House Price Modeling over Heterogeneous Regions with Hierarchical Spatial Functional Analysis. In 2016 IEEE 16th International Conference on Data Mining (ICDM). 1047--1052.Google ScholarGoogle Scholar
  18. G. Matheron. 1969. Le krigeage universel (Universal Kriging). Vol. 1. Ecole des Mines de Paris, Fontainebleau, 83 p.Google ScholarGoogle Scholar
  19. Gang Mei, Nengxiong Xu, and Liangliang Xu. 2016. Improving GPU-accelerated adaptive IDW interpolation algorithm using fast kNN search. SpringerPlus 5, 1 (2016), 1--22.Google ScholarGoogle ScholarCross RefCross Ref
  20. Lubos Mitas and Helena Mitasova. 1999. Spatial interpolation. Geographical information systems: principles, techniques, management and applications 1, 2 (1999).Google ScholarGoogle Scholar
  21. Edzer J. Pebesma. 2004. Multivariable geostatistics in S: the gstat package. Computers Geosciences 30 (2004), 683--691.Google ScholarGoogle ScholarCross RefCross Ref
  22. F. Pedregosa, G. Varoquaux, A. Gramfort, V. Michel, B. Thirion, O. Grisel, M. Blondel, P. Prettenhofer, R. Weiss, V. Dubourg, J. Vanderplas, A. Passos, D. Cournapeau, M. Brucher, M. Perrot, and E. Duchesnay. 2011. Scikit-learn: Machine Learning in Python. Journal of Machine Learning Research 12 (2011), 2825--2830.Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. Omid Poursaeed, Tomáš Matera, and Serge Belongie. 2018. Vision-based real estate price estimation. Machine Vision and Applications 29, 4 (01 May 2018), 667--676.Google ScholarGoogle Scholar
  24. Laura M. Sangalli, James O. Ramsay, and Timothy O. Ramsay. 2013. Spatial spline regression models. Journal of the Royal Statistical Society: Series B (Statistical Methodology) 75, 4 (2013), 681--703. https://doi.org/10.1111/rssb.12009 arXiv:https://rss.onlinelibrary.wiley.com/doi/pdf/10.1111/rssb.12009Google ScholarGoogle ScholarCross RefCross Ref
  25. M. Schuster and K. K. Paliwal. 1997. Bidirectional recurrent neural networks. IEEE Transactions on Signal Processing 45, 11 (Nov 1997), 2673--2681.Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. Donald Shepard. 1968. A Two-Dimensional Interpolation Function for Irregularly-Spaced Data. ACM National Conference 23 (01 1968), 517--524.Google ScholarGoogle ScholarDigital LibraryDigital Library
  27. Michael L Stein. 2012. Interpolation of spatial data: some theory for kriging. Springer Science & Business Media.Google ScholarGoogle Scholar
  28. Chris Tofallis. 2015. A better measure of relative prediction accuracy for model selection and model estimation. Journal of the Operational Research Society 66, 8 (2015), 1352--1362.Google ScholarGoogle ScholarCross RefCross Ref
  29. Pei-Ying Wang, Chiao-Ting Chen, Jain-Wun Su, Ting-Yun Wang, and Szu-Hao Huang. 2021. Deep Learning Model for House Price Prediction Using Heterogeneous Data Analysis Along With Joint Self-Attention Mechanism. IEEE Access 9 (2021), 55244--55259. https://doi.org/10.1109/ACCESS.2021.3071306Google ScholarGoogle ScholarCross RefCross Ref
  30. R Webster and M Oliver. 2007. Geostatistics for Environmental Scientists: Second Edition. Geostatistics for Environmental Scientists: Second Edition (01 2007).Google ScholarGoogle ScholarCross RefCross Ref
  31. Q. You, R. Pang, L. Cao, and J. Luo. 2017. Image-Based Appraisal of Real Estate Properties. IEEE Transactions on Multimedia 19, 12 (12 2017), 2751--2759.Google ScholarGoogle ScholarCross RefCross Ref

Index Terms

  1. Attention-Based Spatial Interpolation for House Price Prediction

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in
    • Published in

      cover image ACM Conferences
      SIGSPATIAL '21: Proceedings of the 29th International Conference on Advances in Geographic Information Systems
      November 2021
      700 pages
      ISBN:9781450386647
      DOI:10.1145/3474717

      Copyright © 2021 ACM

      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 4 November 2021

      Permissions

      Request permissions about this article.

      Request Permissions

      Check for updates

      Qualifiers

      • research-article
      • Research
      • Refereed limited

      Acceptance Rates

      Overall Acceptance Rate220of1,116submissions,20%

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader