Skip to main content

E.Coli Search: Self Replicating Agents for Web Based Information Retrieval

  • Conference paper

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 2690))

Abstract

Although search engines are often used for information retrieval (IR) from the World Wide Web (WWW), current search engine technology seems obsolete. The quality of query results from today’s search engines is unacceptable, creating a demand for new information search and retrieval techniques. The conventional IR methods often lack the flexibility to adapt to changes in the content of the WWW. This paper presents an overview of new developments in evolutionary and adaptive IR and proposes a system (E.Coli search) where an adaptive population of intelligent agents forage the web in search of relevant documents.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Aggarwal, C.C., Al-Garawi, F., Yu, P.S.: Intelligent Crawling on the World Wide Web with Arbitrary Predicates. In: WWW10 2001. ACM, Hong Kong (2001)

    Google Scholar 

  2. Albert, Jeong, Barabasi: Diameter of the World Wide Web. Nature 401(130) (1999)

    Google Scholar 

  3. Berry, M.W., Browne, M.: Understanding Search Engines Mathematical Modeling and Text Retrieval Society for Industrial and Applied Mathematics, Philadelphia (1999)

    Google Scholar 

  4. Blew, R.K.: Finding out About: a cognitive perspective on search engine technology. Cambridge University Press, Cambridge (2000)

    Google Scholar 

  5. Blockeel, H., Kosala, R.: Web Mining Research: A Survey SIGKDD Explorations. ACM SIGKDD (2000)

    Google Scholar 

  6. Bunde, A., Havlin, S. (eds.): Fractals in Science. Springer, Berlin (1994)

    MATH  Google Scholar 

  7. Chen, H., Chung, Y., Ramsey, M., Yang, C.: An intelligent personal spider (agent) for dynamic internet/intranet searching (1998)

    Google Scholar 

  8. De Bra, P.: Post Information retrieval in the world wide web: Making client-based searching feasible. In: Is’ International WWW Conference, Geneva (1994)

    Google Scholar 

  9. Kuscu, I.: An Adaptive Approach to Organizational Knowledge Management. Knowledge and Information: Journal of the KMCI 1(2) (2001)

    Google Scholar 

  10. Kim, Y.H., Kim, S., Eom, J.H., Zhang, B.-T.: Scai experiments on trec-9. In: Proceedings of the Ninth Text REtrieval Conference {TREC-9), pp. 392–399 (2000)

    Google Scholar 

  11. Kim, S., Zhang, B.-T.: Evolutionary learning of web document structure for information retrieval. In: Proceedings of the 2001 Congress on Evolutionary Computation CEC2001, COEX, World Trade Center, 159 Samseong-dong, Gangnam-gu, Seoul, Korea, May 27-30, pp. 1253–1260. IEEE Press, Los Alamitos (2001)

    Google Scholar 

  12. Pant, G., Menczer, F.: Myspiders: Evolve your own intelligent web crawlers. Autonomous Agents and Multi-Agent Systems 5(2), 221–229 (2002)

    Article  Google Scholar 

  13. Langton, C.G.: Artificial Life: The Proceedings of an Interdisciplinary Workshop on the Synthesis and Simulation of Living Systems. Addison-Wesley, Redwood City (1989)

    Google Scholar 

  14. Lawrence, S., Giles, C.L.: Accessibility and Distribution of Information on the Web. Nature 400(6740), 107–109 (1999)

    Article  Google Scholar 

  15. Levy, S.: Artificial Life The Quest for a New Creation Jonathan Cape, London (1992)

    Google Scholar 

  16. Maes, P.: Agents that Reduce Work and Information Overload. Communications of the ACM 37(7) (July 1994)

    Google Scholar 

  17. Menczer, F.: Complementing Search Engines with Online Web Mining Agents. Science. Elsevier, Amsterdam (2002)

    Google Scholar 

  18. Menczer, F., Richard, K.: Blew Adaptive Information Agents in Distributed Textual Environments. In: Agents 1998: Proceedings of the Second International Conference on Autonomous Agents, Minneapolis, MN. ACM, New York (1998)

    Google Scholar 

  19. Menczer, F., Richard, K.: Adaptive retrieval agents: Internalizing local context and scaling up to the web. Machine Learning 39(2/3), 203–242 (2000)

    Article  MATH  Google Scholar 

  20. Menczer, F., Richard, K.: Belew, W. Willuhn. Artificial life applied to adaptive information agents. In: AAAI Spring Symposium on Information Gathering (1995)

    Google Scholar 

  21. Moukas, A.: Amalthaea: Information discovery and filtering using a multiagent evolving ecosystem. In: Proceedings of the Conference on Practical Applications of Agents and Multiagent Technology (1996)

    Google Scholar 

  22. Moukas, A., Maes, P.: Amalthaea: An evolving multi-agent information filtering and discovery system for the WWW. Autonomous Agents and Multi-Agent Systems l(l), 59–88 (1998)

    Article  Google Scholar 

  23. Oh, J.C.: Cooperating search agents explore more than defecting search agents in the internet information access. In: Proceedings of the 2001 Congress on Evolutionary Computation CEC200I, COEX, World Trade Center, 159 Samseong-dong, Gangnam-gu, Seoul, Korea, May 27-30, pp. 1261–1268. IEEE Press, Los Alamitos (2001)

    Google Scholar 

  24. Pagliarini, L., Dolan, A., Menczer, F., Lund, H.H.: A Life meets web: Lessons learned. In: Virtual Worlds, pp. 156-167 (1998)

    Google Scholar 

  25. Pathak, P., Gordon, M., Fan, W.: Effective information retrieval using genetic algorithms based matching functions adaptation. In: HICSS (2000)

    Google Scholar 

  26. Pereira, F., Costa, E.: How learning improves the performance of evolutionary agents: a case study with an information retrieval system for a distributed environment

    Google Scholar 

  27. Pereira, F.B., Costa, E.: How adaptive agents learn to deal with incomplete queries in distributed information environments. In: Proc. of the 2000 Congress on Evolutionary Computation, pp. 1329–1336. IEEE Computer Society Press, Los Alamitos (2000)

    Google Scholar 

  28. Walker, R.L.: Assessment of the web using genetic programming. In: Banzhaf, W., Daida, J., Eiben, A.E., Garzon, M.H., Honavar, V., Jakiela, M., Smith, R.E. (eds.) Proceedings of the Genetic and Evolutionary Computation Conference, Orlando, Florida, USA, July 13-17, vol. 2, pp. 1750–1755. Morgan Kaufmann, San Francisco (1999)

    Google Scholar 

  29. Walker, R.L.: Dynamic load balancing model: Preliminary assessment of a biological model for a pseudo-search engine. In: SPDP: IEEE Symposium on Parallel and Distributed Processing. ACM Special Interest Group on Computer Architecture (S1GARCH). IEEE Computer Society, Los Alamitos (2000)

    Google Scholar 

  30. Walker, R.L.: Parallel clustering system using the methodologies of evolutionary computations. In: Proceedings of the 2001 Congress on Evolutionary Computation CEC 200I, COEX, World Trade Center, 159 Samseongdong, Gangnam-gu, Seoul, Korea, May 27-30, pp. 831-938. IEEE Press, Los Alamitos ( 2001)

    Google Scholar 

  31. Walker, R.L.: Search engine case study searching the web using genetic programming. In: Parallel Computing, vol. 7, Elsevier, Amsterdam (2001)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2003 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Mirikitani, D.T., Kushchu, I. (2003). E.Coli Search: Self Replicating Agents for Web Based Information Retrieval. In: Liu, J., Cheung, Ym., Yin, H. (eds) Intelligent Data Engineering and Automated Learning. IDEAL 2003. Lecture Notes in Computer Science, vol 2690. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-45080-1_84

Download citation

  • DOI: https://doi.org/10.1007/978-3-540-45080-1_84

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-40550-4

  • Online ISBN: 978-3-540-45080-1

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics