Skip to main content

Equipping Intelligent Agents with Commonsense Knowledge acquired from Search Query Logs: Results from an Exploratory Story

  • Chapter
Book cover Data Mining and Multi-agent Integration

Abstract

Access to knowledge about user goals represents a critical component for realizing the vision of intelligent agents acting upon user intent on the web. Yet, the manual acquisition of knowledge about user goals is costly and often infeasible. In a departure from existing approaches, this paper proposes Goal Mining as a novel perspective for knowledge acquisition. The research presented in this chapter makes the following contributions: (a) it presents Goal Mining as an emerging field of research and a corresponding automatic method for the acquisition of user goals from web corpora, in the case of this paper search query logs (b) it provides insights into the nature and some characteristics of these goals and (c) it shows that the goals acquired from query logs exhibit traits of a long tail distribution, thereby providing access to a broad range of user goals. Our results suggest that search query logs represent a viable, yet largely untapped resource for acquiring knowledge about explicit user goals.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Anderson C.: The Long Tail. Wired Magazine, (12) 10, 2004.

    Google Scholar 

  2. Baeza-Yates, R., Calderon-Benavides, L., Gonzalez-Caro, C.: The intention behind web queries. In String Processing and Information Retrieval (SPIRE’06), 98–109, 2006.

    Google Scholar 

  3. Broder, A.: A taxonomy of web search. In SIGIR Forum, vol. 36, no. 2, pp. 3–10, 2002.

    Article  Google Scholar 

  4. Cao, L., Luo, C., Zhang, C.: Agent-Mining Interaction: An Emerging Area. In Vladimir Gorodetsky; Chengqi Zhang; Victor A. Skormin & Longbing Cao, Springer, pp. 60–73, 2007.

    Google Scholar 

  5. Cohen J.: A coefficient of agreement for nominal scales. In Educational and Psychological Measurement, (20)1–37, 1960.

    Google Scholar 

  6. Davies, W.: ANIMALS: A Distributed, Heterogeneous Multi-Agent Learning System. MSc Thesis, University of Aberdeen, 1993.

    Google Scholar 

  7. Downey, D., Dumais, S., Liebling, D., Horvitz, E.: Understanding the relationship between searchers’ queries and information goals. In Proceedings of the International Conference on Information and Knowledge Management, ACM, New York, NY, USA, pp. 449–458, 2008.

    Google Scholar 

  8. Eslick, I. S.: Searching for commonsense, Master’s thesis, MIT, 2006.

    Google Scholar 

  9. He, K., Chang, Y., Lu, W.: Improving identification of latent user goals through search-result snippet classification. In Proceedings of the IEEE/WIC/ACM International Conference on Web Intelligence, IEEE Computer Society, Washington, DC, USA, pp. 683–686, 2007.

    Google Scholar 

  10. Hendler, J.: Where Are All the Intelligent Agents?. In Intelligent Systems, pp. 2–3, 2007.

    Google Scholar 

  11. Hui B., Yu E.: Extracting conceptual relationships from specialized documents. In Data And Knowledge Engineering, (54)1: 29–55, Elsevier, 2005.

    Google Scholar 

  12. Kirsh, D.: When is information explicitly represented? In Information, Language and Cognition - The Vancouver Studies in Cognitive Science., 340–365, UBC Press, 1990.

    Google Scholar 

  13. Lee, U., Liu, Z., Cho, J.: Automatic identification of user goals in Web search. In Proceedings of the 14th international conference on the World Wide Web (WWW ’05), ACM, New York, NY, USA, pp. 391–400, 2005.

    Google Scholar 

  14. Lenat, D. B.: CYC: a large-scale investment in knowledge infrastructure. In Communications of the ACM 38(11), 33–38, 1995.

    Article  Google Scholar 

  15. Liaskos S., Lapouchnian A., Yu, Y., Yu E., Mylopoulos J.: On goal-based variability acquisition and analysis. In Proceedings of the 14th IEEE International Requirements Engineering Conference (RE’06), Minneapolis, USA, 2006.

    Google Scholar 

  16. Lieberman, H., Smith, D., Teeters, A.: Common Consensus: a web-based game for collecting commonsense goals. In Proceedings of the Workshop on Common Sense and Intelligent User Interfaces held in conjunction with the 2007 International Conference on Intelligent User Interfaces (IUI 2007), 2007.

    Google Scholar 

  17. Liu, H., Singh, P.: ConceptNet - a practical commonsense reasoning tool-kit. In BT Technology Journal 22(4), 211–226, 2004.

    Article  MathSciNet  Google Scholar 

  18. Pasca M., Van Durme B., Garera N.: The role of documents vs. queries in extracting class attributes from text. In Proceedings of the International Conference on Information and Knowledge Management (CIKM’07), 485–494, ACM, New York, NY, USA, 2007.

    Google Scholar 

  19. Pass G., Chowdhury A., Torgeson C.: A picture of search. In Proceedings of the 1st International Conference on Scalable Information Systems, ACM Press New York, NY, USA, 2006.

    Google Scholar 

  20. Potts C., Takahashi K., Anton A. I.: Inquiry-based requirements analysis, 1994.

    Google Scholar 

  21. Regev G., Wegmann A.: Where do goals Come from: the underlying principles of goal-oriented requirements engineering. In Proceedings of the 13th International Conference on Requirements Engineering, 253–362, IEEE Computer Society, Washington DC, USA, 2005.

    Google Scholar 

  22. Rose, D. E., Levinson, D.: Understanding user goals in web search. In Proceedings of the 13th WWW, ACM, NY, USA, pp. 13–19, 2004.

    Google Scholar 

  23. Schank R.C., Abelson R.P.: Scripts, plans, goals, and understanding: an inquiry into human knowledge structures. Lawrence Erlbaum Associates, 1977.

    Google Scholar 

  24. Sian, S.: Extending Learning to Multiple Agents: Issues and a Model for Multi-Agent Machine Learning. In Proceedings of the European Workshop Sessions on Learning, Porto, Portugal, pp. 458–472, 1991.

    Google Scholar 

  25. Singh, P., Lin, T., Mueller, E., Lim, G., Perkins, T., Zhu, W.: Open mind common sense: knowledge acquisition from the general public. In Proceedings of the First International Conference on Ontologies, Databases, and Applications of Semantics for Large Scale Information Systems, Springer-Verlag London, UK,, pp. 1223–1237, 2002.

    Google Scholar 

  26. Strohmaier, M., Lux, M., Granitzer, M., Scheir, P., Liaskos, S., Yu, E.: How do users express goals on the web? - an exploration of intentional structures in web search. In International Workshop on Collaborative Knowledge Management for Web Information Systems We Know’07, in conjunction with WISE’07, Nancy, France, 2007.

    Google Scholar 

  27. Strohmaier, M., Prettenhofer, P., Kröll, M.: Acquiring explicit user goals from search query logs. In International Workshop on Agents and Data Mining Interaction ADMI’08, in conjunction with WI ’08, 2008.

    Google Scholar 

  28. Zhang, C., Zhang, Z., Cao, L.: Agents and Data Mining: Mutual Enhancement by Integration. In Autonomous Intelligent Systems: Agents and Data Mining, 50–61, 2005.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Markus Strohmaier .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2009 Springer Science+Business Media, LLC

About this chapter

Cite this chapter

Strohmaier, M., Kröll, M., Prettenhofer, P. (2009). Equipping Intelligent Agents with Commonsense Knowledge acquired from Search Query Logs: Results from an Exploratory Story. In: Cao, L. (eds) Data Mining and Multi-agent Integration. Springer, Boston, MA. https://doi.org/10.1007/978-1-4419-0522-2_11

Download citation

  • DOI: https://doi.org/10.1007/978-1-4419-0522-2_11

  • Publisher Name: Springer, Boston, MA

  • Print ISBN: 978-1-4419-0521-5

  • Online ISBN: 978-1-4419-0522-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics