ABSTRACT
Estimating the market price of a house is important for many businesses such as real estate and mortgage lending companies. The price of a house depends not only on its structural features (e.g. area and number of bedrooms) but also on the spatial context where it is located. In this work we estimate the price of a house based solely on its structural features and the characteristics and price of its neighbors. For that, we propose a hybrid attention mechanism that weights neighbors based on their similarity to the house in terms of structural features and geographic location. For the structural features, we apply an euclidean-based attention and, for the geographic location, we propose an attention layer based on a radial basis function kernel. Those attention mechanisms are then used by a neural network regressor to predict the price of a house and to generate a vector representation of the house based on its implicit context: the house embedding, which can be used as a feature set by any regressor to perform house price prediction. We have performed an extensive experimental evaluation on real-world datasets that shows that: (1) regressors using house embedding obtained the best results on all 4 datasets, outperforming baseline models; (2) the learned house embedding improves the performance of the evaluated regressors in almost all scenarios in comparison to raw features; and (3) simple regressor models such as Linear Regression using house embedding achieved comparable results to more competitive algorithms (e.g. Random Forest and Xgboost).
- Dzmitry Bahdanau, Kyunghyun Cho, and Yoshua Bengio. 2015. Neural machine translation by jointly learning to align and translate. In 3rd International Conference on Learning Representations, ICLR 2015.Google Scholar
- Gleb Beliakov and Gang Li. 2012. Improving the speed and stability of the k-nearest neighbors method. Pattern Recognition Letters 33, 10 (2012), 1296--1301.Google ScholarDigital Library
- A. J. Bency, S. Rallapalli, R. K. Ganti, M. Srivatsa, and B. S. Manjunath. 2017. Beyond Spatial Auto-Regressive Models: Predicting Housing Prices with Satellite Imagery. In 2017 IEEE Winter Conference on Applications of Computer Vision (WACV). 320--329. https://doi.org/10.1109/WACV.2017.42Google Scholar
- James Bergstra, Brent Komer, Chris Eliasmith, Dan Yamins, and David Cox. 2015. Hyperopt: A Python library for model selection and hyperparameter optimization. Computational Science Discovery 8 (07 2015), 014008.Google Scholar
- Z. Bessinger and N.Jacobs. 2016. Quantifying curb appeal. In 2016 IEEE International Conference on Image Processing (ICIP). 4388--4392.Google ScholarCross Ref
- Christopher M. Bishop. 2006. Pattern Recognition and Machine Learning. Springer.Google ScholarDigital Library
- Leo Breiman. 2001. Random Forests. Mach. Learn. 45, 1 (Oct. 2001), 5--32.Google ScholarDigital Library
- Martin D Buhmann. 2003. Radial basis functions: theory and implementations. Vol. 12. Cambridge university press.Google ScholarDigital Library
- Tianqi Chen and Carlos Guestrin. 2016. XGBoost: A Scalable Tree Boosting System. In Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (San Francisco, California, USA) (KDD '16). ACM, New York, NY, USA, 785--794.Google ScholarDigital Library
- François Chollet et al. 2015. Keras. https://keras.io.Google Scholar
- Sarkar Snigdha Sarathi Das, Mohammed Eunus Ali, Yuan-Fang Li, Yong-Bin Kang, and Timos Sellis. 2020. Boosting House Price Predictions using Geo-Spatial Network Embedding. CoRR abs/2009.00254 (2020). arXiv:2009.00254 https://arxiv.org/abs/2009.00254Google Scholar
- Matthias Feurer, Aaron Klein, Katharina Eggensperger, Jost Springenberg, Manuel Blum, and Frank Hutter. 2015. Efficient and Robust Automated Machine Learning. In Advances in Neural Information Processing Systems 28, C. Cortes, N.D.Lawrence, D. D. Lee, M. Sugiyama, and R. Garnett (Eds.). Curran Associates, Inc., 2962--2970.Google ScholarDigital Library
- Yanjie Fu, Hui Xiong, Yong Ge, Zijun Yao, Yu Zheng, and Zhi-Hua Zhou. 2014. Exploiting Geographic Dependencies for Real Estate Appraisal: A Mutual Perspective of Ranking and Clustering. In Proceedings of the 20th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (New York, New York, USA) (KDD '14). ACM, New York, NY, USA, 1047--1056. https://doi.org/10.1145/2623330.2623675Google ScholarDigital Library
- Guolin Ke, Qi Meng, Thomas Finley, Taifeng Wang, Wei Chen, Weidong Ma, Qiwei Ye, and Tie-Yan Liu. 2017. LightGBM: A Highly Efficient Gradient Boosting Decision Tree. In NIPS.Google Scholar
- Diederik Kingma and Jimmy Ba. 2014. Adam: A Method for Stochastic Optimization. International Conference on Learning Representations (12 2014).Google Scholar
- Stephen Law, Brooks Paige, and Chris Russell. 2018. Take a look around: using street view and satellite images to estimate house prices. arXiv preprint arXiv:1807.07155 (2018).Google Scholar
- B. Liu, B. Mavrin, D. Niu, and L. Kong. 2016. House Price Modeling over Heterogeneous Regions with Hierarchical Spatial Functional Analysis. In 2016 IEEE 16th International Conference on Data Mining (ICDM). 1047--1052.Google Scholar
- G. Matheron. 1969. Le krigeage universel (Universal Kriging). Vol. 1. Ecole des Mines de Paris, Fontainebleau, 83 p.Google Scholar
- Gang Mei, Nengxiong Xu, and Liangliang Xu. 2016. Improving GPU-accelerated adaptive IDW interpolation algorithm using fast kNN search. SpringerPlus 5, 1 (2016), 1--22.Google ScholarCross Ref
- Lubos Mitas and Helena Mitasova. 1999. Spatial interpolation. Geographical information systems: principles, techniques, management and applications 1, 2 (1999).Google Scholar
- Edzer J. Pebesma. 2004. Multivariable geostatistics in S: the gstat package. Computers Geosciences 30 (2004), 683--691.Google ScholarCross Ref
- F. Pedregosa, G. Varoquaux, A. Gramfort, V. Michel, B. Thirion, O. Grisel, M. Blondel, P. Prettenhofer, R. Weiss, V. Dubourg, J. Vanderplas, A. Passos, D. Cournapeau, M. Brucher, M. Perrot, and E. Duchesnay. 2011. Scikit-learn: Machine Learning in Python. Journal of Machine Learning Research 12 (2011), 2825--2830.Google ScholarDigital Library
- Omid Poursaeed, Tomáš Matera, and Serge Belongie. 2018. Vision-based real estate price estimation. Machine Vision and Applications 29, 4 (01 May 2018), 667--676.Google Scholar
- Laura M. Sangalli, James O. Ramsay, and Timothy O. Ramsay. 2013. Spatial spline regression models. Journal of the Royal Statistical Society: Series B (Statistical Methodology) 75, 4 (2013), 681--703. https://doi.org/10.1111/rssb.12009 arXiv:https://rss.onlinelibrary.wiley.com/doi/pdf/10.1111/rssb.12009Google ScholarCross Ref
- M. Schuster and K. K. Paliwal. 1997. Bidirectional recurrent neural networks. IEEE Transactions on Signal Processing 45, 11 (Nov 1997), 2673--2681.Google ScholarDigital Library
- Donald Shepard. 1968. A Two-Dimensional Interpolation Function for Irregularly-Spaced Data. ACM National Conference 23 (01 1968), 517--524.Google ScholarDigital Library
- Michael L Stein. 2012. Interpolation of spatial data: some theory for kriging. Springer Science & Business Media.Google Scholar
- Chris Tofallis. 2015. A better measure of relative prediction accuracy for model selection and model estimation. Journal of the Operational Research Society 66, 8 (2015), 1352--1362.Google ScholarCross Ref
- Pei-Ying Wang, Chiao-Ting Chen, Jain-Wun Su, Ting-Yun Wang, and Szu-Hao Huang. 2021. Deep Learning Model for House Price Prediction Using Heterogeneous Data Analysis Along With Joint Self-Attention Mechanism. IEEE Access 9 (2021), 55244--55259. https://doi.org/10.1109/ACCESS.2021.3071306Google ScholarCross Ref
- R Webster and M Oliver. 2007. Geostatistics for Environmental Scientists: Second Edition. Geostatistics for Environmental Scientists: Second Edition (01 2007).Google ScholarCross Ref
- Q. You, R. Pang, L. Cao, and J. Luo. 2017. Image-Based Appraisal of Real Estate Properties. IEEE Transactions on Multimedia 19, 12 (12 2017), 2751--2759.Google ScholarCross Ref
Index Terms
- Attention-Based Spatial Interpolation for House Price Prediction
Recommendations
House Price Prediction via Visual Cues and Estate Attributes
Advances in Visual ComputingAbstractThe price of a house depends on many factors, such as its size, location, amenities, surrounding establishments, and the season in which the house is being sold, just to name a few of them. As a seller, it is absolutely essential to price the ...
Improve the House Price Prediction Accuracy with a Stacked Generalization Ensemble Model
Internet of Vehicles. Technologies and Services Toward Smart CitiesAbstractHouse price prediction plays an important role in estate marketplace. Prediction future house price accurately can provide decision making support for home buyers. With the development of machine learning and AI technology, different machine ...
Attention-based BiLSTM model for stock price prediction
AIPR '22: Proceedings of the 2022 5th International Conference on Artificial Intelligence and Pattern RecognitionAbstract: Stock price prediction is a hot issue in the field of quantitative finance. Investors hope to discover the objective laws of stock price fluctuations from historical data, optimize their investment strategies, and avoid risks to obtain better ...
Comments