skip to main content
10.1145/3308558.3313667acmotherconferencesArticle/Chapter ViewAbstractPublication PageswwwConference Proceedingsconference-collections
research-article

Forecasting U.S. Domestic Migration Using Internet Search Queries

Published:13 May 2019Publication History

ABSTRACT

Roughly one in ten Americans move every year, bringing significant social and economic impact to both the places they move from and places they move to. We show that migration intent mined from internet search queries can forecast domestic migration and provide new insights beyond government data. We extract from a major search engine (Bing.com) 120 million raw queries with migration intent from 2014 to 2016, including origin and destination geographies, and the specific intent for migration such as whether the potential migration is housing or employment related. Using these queries, we map U.S. state level migration flows, validate them against government data, and demonstrate that adding search query-based metrics explains variance in migration prediction above robust baseline models. In addition, we show that the specific migration intent extracted from these queries unpack the differential demands of migrants with different demographic backgrounds and geographic interests. Examples include interactions between age, education, and income, and migration attributes such as buying versus renting housing and employment in technology versus manual labor job sectors. We discuss how local government, policy makers, and computational social scientists can benefit from this information.

References

  1. California Losing Residents Via Domestic Migration {EconTax Blog}. (????). https://lao.ca.gov/laoecontax/article/detail/265Google ScholarGoogle Scholar
  2. LinkedIn Workforce Report | United States | August 2018. (????). https://economicgraph.linkedin.com/resources/linkedin-workforce-report-august-2018Google ScholarGoogle Scholar
  3. Nikolaos Askitas and Klaus F Zimmermann. 2009. Google econometrics and unemployment forecasting. Applied Economics Quarterly55, 2 (2009), 107-120.Google ScholarGoogle Scholar
  4. Rene´ Böheim and Mark P Taylor. 2002. Tied down or room to move? Investigating the relationships between housing tenure, employment status and residential mobility in Britain. Scottish Journal of Political Economy49, 4 (2002), 369-392.Google ScholarGoogle Scholar
  5. Ilaria Bordino, Stefano Battiston, Guido Caldarelli, Matthieu Cristelli, Antti Ukkonen, and Ingmar Weber. 2012. Web search queries can predict stock market volumes. PloS one7, 7 (2012), e40014.Google ScholarGoogle Scholar
  6. Andrei Broder. 2002. A taxonomy of web search. In ACM Sigir forum, Vol. 36. ACM, 3-10. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Davide Buscaldi. 2011. Approaches to disambiguating toponyms. Sigspatial Special3, 2 (2011), 16-19. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Davide Buscaldi and Paolo Rosso. 2008. Map-based vs. knowledge-based toponym disambiguation. In Proceedings of the 5th Workshop on Geographic Information Retrieval. ACM, 19-22. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Gavin Cameron and John Muellbauer. 1998. The housing market and regional commuting and migration choices. Scottish Journal of Political Economy45, 4 (1998), 420-446.Google ScholarGoogle Scholar
  10. RJ Cebula and JE Payne. 2005. Net migration, economic opportunity and the quality of life, 1999-2000. International Review of Economics and Business52, 2(2005), 245-254.Google ScholarGoogle Scholar
  11. Richard J Cebula. 1979. The determinants of human migration. Lexington Books.Google ScholarGoogle Scholar
  12. Richard J Cebula, Gigi M Alexander, and others. 2006. Determinants of net interstate migration, 2000-2004. Journal of Regional Analysis and Policy36, 2 (2006), 116-123.Google ScholarGoogle Scholar
  13. Stevie Chancellor and Scott Counts. 2018. Measuring Employment Demand Using Internet Search Data. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. ACM, 122. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Alberta H Charney. 1993. Migration and the public sector: a survey. Regional Studies27, 4 (1993), 313-326.Google ScholarGoogle Scholar
  15. Yong Chen and Stuart S Rosenthal. 2008. Local amenities and life-cycle migration: Do people move for jobs or fun?Journal of Urban Economics64, 3 (2008), 519-537.Google ScholarGoogle Scholar
  16. Hyunyoung Choi and Hal Varian. 2012. Predicting the present with Google Trends. Economic Record88, s1 (2012), 2-9.Google ScholarGoogle Scholar
  17. Thomas J Courchene. 1974. Migration, income, and employment: Canada, 1965-68. CD Howe Research Institute.Google ScholarGoogle Scholar
  18. Silviu Cucerzan. 2007. Large-scale named entity disambiguation based on Wikipedia data. In Proceedings of the 2007 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning (EMNLP-CoNLL).Google ScholarGoogle Scholar
  19. Gordon B Dahl. 2002. Mobility and the return to education: Testing a Roy model with multiple markets. Econometrica70, 6 (2002), 2367-2420.Google ScholarGoogle Scholar
  20. Francesco D'Amuri and Juri Marcucci. 2010. 'Google it!'Forecasting the US unemployment rate with a Google job search index. (2010).Google ScholarGoogle Scholar
  21. J Paul Elhorst. 2010. Applied spatial econometrics: raising the bar. Spatial Economic Analysis5, 1 (2010), 9-28.Google ScholarGoogle Scholar
  22. Michael Ettredge, John Gerdes, and Gilbert Karuga. 2005. Using web-based search data to predict macroeconomic statistics. Commun. ACM48, 11 (2005), 87-92. Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. Riccardo Faini, Alessandra Venturini, and others. 1994. Migration and growth: the experience of Southern Europe. Technical Report. CEPR Discussion Papers.Google ScholarGoogle Scholar
  24. Lee Fiorio, Guy Abel, Jixuan Cai, Emilio Zagheni, Ingmar Weber, and Guillermo Vinue´. 2017. Using twitter data to estimate the relationship between short-term mobility and long-term migration. In Proceedings of the 2017 ACM on Web Science Conference. ACM, 103-110. Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. Sirius Fuller. 2018. Using American Community Survey Estimates and Margins of Error. (April 2018). https://www.census.gov/content/dam/Census/programs-surveys/acs/guidance/training-presentations/20180418_MOE.pdfGoogle ScholarGoogle Scholar
  26. US Census Bureau Geography. 2010 Geographic Terms and Concepts - Place. (????). https://www.census.gov/geo/reference/gtc/gtc_place.htmlGoogle ScholarGoogle Scholar
  27. Michael J Greenwood. 1969. An analysis of the determinants of geographic labor mobility in the United States. The review of Economics and Statistics(1969), 189-194.Google ScholarGoogle Scholar
  28. Michael J Greenwood. 1975. Research on internal migration in the United States: a survey. Journal of Economic Literature(1975), 397-433.Google ScholarGoogle Scholar
  29. Emily Gross. 2005. Internal revenue service area-to-area migration data: Strengths, limitations, and current trends. In Proceedings of the Section on Government Statistics. 2005.Google ScholarGoogle Scholar
  30. Andrew Henley. 1998. Residential mobility, housing equity and the labour market. The Economic Journal108, 447 (1998), 414-427.Google ScholarGoogle Scholar
  31. Lindsay M Howden and Julie A Meyer. 2010. Age and sex composition: 2010. 2010 Census Briefs, US Department of Commerce, Economics and Statistics Administration. US CENSUS BUREAU(2010).Google ScholarGoogle Scholar
  32. David Ihrke. Why Did You Move?: An Overview and Analysis of the Annual Social and Economic Supplement's Reason for Move Write-In Expansion. SEHSD-WP2016-22 (????). https://www.census.gov/library/working-papers/2016/demo/SEHSD-WP2016-22.htmlGoogle ScholarGoogle Scholar
  33. David Ihrke. 2014. Reason for Moving: 2012 to 2013. Current population reports. Washington, DC: US Census Bureau20 (2014), 574.Google ScholarGoogle Scholar
  34. David Ihrke. 2017. United States mover rate at a new record low. Census Blogs. Available at: https://www. census. gov/newsroom/blogs/randomsamplings/2017/01/mover-rate. html(2017).Google ScholarGoogle Scholar
  35. Richard Jackman and Savvas Savouri. 1992. Regional migration versus regional commuting: the identification of housing and employment flows. Scottish Journal of Political Economy39, 3 (1992), 272-287.Google ScholarGoogle Scholar
  36. Geraint Johnes and Thomas Hyclak. 1994. House prices, migration, and regional labor markets. Journal of Housing Economics3, 4 (1994), 312-329.Google ScholarGoogle ScholarCross RefCross Ref
  37. Kenneth M Johnson, Paul R Voss, Roger B Hammer, Glenn V Fuguitt, and Scott McNiven. 2005. Temporal and spatial variation in age-specific net migration in the United States. Demography42, 4 (2005), 791-812.Google ScholarGoogle Scholar
  38. John D Kasarda. 1988. Jobs, migration, and emerging urban mismatches. Urban change and poverty(1988), 148-198.Google ScholarGoogle Scholar
  39. John Kennan and James R Walker. 2011. The effect of expected income on individual migration decisions. Econometrica79, 1 (2011), 211-251.Google ScholarGoogle Scholar
  40. Sari Pekkala Kerr and William R Kerr. 2011. Economic impacts of immigration: A survey. Technical Report. National Bureau of Economic Research.Google ScholarGoogle Scholar
  41. Andy Kiersz. Here's how each US state's population changed between 2016 and 2017 because of people moving in and out. (????). https://www.businessinsider.com/state-domestic-migration-map-2016-to-2017-2018-1Google ScholarGoogle Scholar
  42. Robert J LaLonde and Robert H Topel. 1997. Economic impact of international migration and the economic performance of migrants. Handbook of population and family economics1 (1997), 799-850.Google ScholarGoogle Scholar
  43. Pierre Legendre. 1993. Spatial autocorrelation: trouble or new paradigm?Ecology74, 6 (1993), 1659-1673.Google ScholarGoogle Scholar
  44. Steven Manson, Jonathan Schroeder, David Van Riper, and Steven Ruggles. 2017. IPUMS National Historical Geographic Information System: Version 12.0 {Database}. Minneapolis: University of Minnesota(2017).Google ScholarGoogle Scholar
  45. Warren F Mazek and John Chang. 1972. The chicken or egg fowl-up in migration: comment. Southern Economic Journal(1972), 133-139.Google ScholarGoogle Scholar
  46. Nick McLaren and Rachana Shanbhogue. 2011. Using internet search data as economic indicators. (2011).Google ScholarGoogle Scholar
  47. Johnnatan Messias, Fabricio Benevenuto, Ingmar Weber, and Emilio Zagheni. 2016. From migration corridors to clusters: The value of Google+ data for migration studies. In Proceedings of the 2016 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining. IEEE Press, 421-428. Google ScholarGoogle ScholarDigital LibraryDigital Library
  48. Raven Molloy, Christopher L Smith, and Abigail Wozniak. 2011. Internal migration in the United States. Journal of Economic perspectives25, 3 (2011), 173-96.Google ScholarGoogle ScholarCross RefCross Ref
  49. Richard F Muth. 1971. Migration: chicken or egg?Southern Economic Journal(1971), 295-306.Google ScholarGoogle Scholar
  50. 2017-2018 Session of the Vermont State Senate. 2017. S.94, Act 257. An act relating to promoting remote work. (2017). http://www.leg.state.vt.us/jfo/fiscal_notes/2018_S_94_fiscal_note_house_commerce.pdfGoogle ScholarGoogle Scholar
  51. Adam Pasick. Facebook's big data glimpse at human migration and the growth of mega-cities. (????). https://qz.com/159279/facebooks-big-data-glimpse-at-human-migration-and-the-growth-of-mega-cities/Google ScholarGoogle Scholar
  52. Jaroslav Pavlicek and Ladislav Kristoufek. 2015. Nowcasting unemployment rates with google searches: Evidence from the visegrad group countries. PloS one10, 5 (2015), e0127084.Google ScholarGoogle Scholar
  53. William Petersen. 1969. Population. London: MacMillan Co.Google ScholarGoogle Scholar
  54. Tobias Preis, Helen Susannah Moat, and H Eugene Stanley. 2013. Quantifying trading behavior in financial markets using Google Trends. Scientific reports3(2013), 1684.Google ScholarGoogle Scholar
  55. Tobias Preis, Daniel Reith, and H Eugene Stanley. 2010. Complex dynamics of our economic life on different scales: insights from search engine query data. Philosophical Transactions of the Royal Society of London A: Mathematical, Physical and Engineering Sciences368, 1933 (2010), 5707-5719.Google ScholarGoogle Scholar
  56. Stephen M Renas and Rishi Kumar. 1978. The cost of living, labor market opportunities, and the migration decision: A case of misspecification?The Annals of regional science12, 2 (1978), 95-104.Google ScholarGoogle Scholar
  57. Aba Schwartz. 1976. Migration, age, and education. Journal of Political Economy84, 4, Part 1 (1976), 701-719.Google ScholarGoogle ScholarCross RefCross Ref
  58. Simon Sheather. 2009. A modern approach to regression with R. Springer Science & Business Media.Google ScholarGoogle Scholar
  59. Robert Shimer. 2007. Mismatch. American Economic Review97, 4 (2007), 1074-1101.Google ScholarGoogle Scholar
  60. David A Smith and Gregory Crane. 2001. Disambiguating geographic names in a historical digital library. In International Conference on Theory and Practice of Digital Libraries. Springer, 127-136. Google ScholarGoogle ScholarDigital LibraryDigital Library
  61. Paul M Sommers and Daniel B Suits. 1973. Analysis of net interstate migration. Southern Economic Journal(1973), 193-201.Google ScholarGoogle Scholar
  62. Donald N Steinnes. 1978. Causality and Migration: A Statistical Resolution of the” Chicken or Egg Fowl-up”. Southern Economic Journal(1978), 218-226.Google ScholarGoogle Scholar
  63. Lyman Stone. 2017. Reviewing the 2017 Census Population Estimates. (Dec. 2017). https://medium.com/migration-issues/reviewing-the-2017-census-population-estimates-62a8a9ad5d17Google ScholarGoogle Scholar
  64. James D Tarver and R Douglas McLeod. 1973. A test and modification of Zipf's hypothesis for predicting interstate migration. Demography10, 2 (1973), 259-275.Google ScholarGoogle Scholar
  65. Jacob Thebault-Spieker, Loren Terveen, and Brent Hecht. 2017. Toward a geographic understanding of the sharing economy: Systemic biases in UberX and TaskRabbit. ACM Transactions on Computer-Human Interaction (TOCHI)24, 3 (2017), 21. Google ScholarGoogle ScholarDigital LibraryDigital Library
  66. Antonio Toral and Rafael Munoz. 2006. A proposal to automatically build and maintain gazetteers for Named Entity Recognition by using Wikipedia. In Proceedings of the Workshop on NEW TEXT Wikis and blogs and other dynamic text sources.Google ScholarGoogle Scholar
  67. Ingmar Weber, Emilio Zagheni, and others. 2013. Studying inter-national mobility through IP geolocation. In Proceedings of the sixth ACM international conference on Web search and data mining. ACM, 265-274. Google ScholarGoogle ScholarDigital LibraryDigital Library
  68. Lynn Wu and Erik Brynjolfsson. 2015. The future of prediction: How Google searches foreshadow housing prices and sales. In Economic analysis of the digital economy. University of Chicago Press, 89-118.Google ScholarGoogle Scholar
  69. Jeffrey E Zabel. 2012. Migration, housing market, and labor market responses to employment shocks. Journal of Urban Economics72, 2-3 (2012), 267-284.Google ScholarGoogle Scholar
  70. Emilio Zagheni, Venkata Rama Kiran Garimella, Ingmar Weber, and others. 2014. Inferring international and internal migration patterns from twitter data. In Proceedings of the 23rd International Conference on World Wide Web. ACM, 439-444. Google ScholarGoogle ScholarDigital LibraryDigital Library
  71. Emilio Zagheni and Ingmar Weber. 2012. You are where you e-mail: using e-mail data to estimate international migration rates. In Proceedings of the 4th annual ACM web science conference. ACM, 348-351. Google ScholarGoogle ScholarDigital LibraryDigital Library

Recommendations

Comments

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Sign in
  • Published in

    cover image ACM Other conferences
    WWW '19: The World Wide Web Conference
    May 2019
    3620 pages
    ISBN:9781450366748
    DOI:10.1145/3308558

    Copyright © 2019 ACM

    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    • Published: 13 May 2019

    Permissions

    Request permissions about this article.

    Request Permissions

    Check for updates

    Qualifiers

    • research-article
    • Research
    • Refereed limited

    Acceptance Rates

    Overall Acceptance Rate1,899of8,196submissions,23%

PDF Format

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format .

View HTML Format