Skip to main content

Advertisement

Log in

A review of evolutionary and immune-inspired information filtering

  • Published:
Natural Computing Aims and scope Submit manuscript

Abstract

In recent years evolutionary and immune-inspired approaches have been applied to content-based and collaborative filtering. These biologically inspired approaches are well suited to problems like profile adaptation in content-based filtering and rating sparsity in collaborative filtering, due to their distributed and dynamic characteristics. In this paper we introduce the relevant concepts and algorithms and review the state of the art in evolutionary and immune-inspired information filtering. Our intention is to promote the interplay between information filtering and biologically inspired computing and boost developments in this emerging interdisciplinary field.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1

Similar content being viewed by others

Notes

  1. For a more general description of EAs see Eiben and Smith (2003).

  2. Other crossover techniques include uniform crossover and arithmetic crossover (Eiben and Smith 2003).

  3. For further details on the immune system the interested reader is referred to immunology textbooks, like Kirkwood and Lewis (1989).

  4. Textbooks in AIS include Dasgupta (1998), de Castro and Timmis (2002), and Tarakanov et al. (2003).

  5. In Table 1, “\(\surd\)” denotes the existence of a process, in the absence of further details.

  6. The nave Bayesian classifier “was adapted to intercept [continuous] user input in the same way as AISEC” (Secker et al. 2003).

  7. http://movielens.umn.edu.

  8. http://trec.nist.gov/data/t10_filtering/T10filter_guide.htm.

References

  • Baclace PE (1991) Personal information intake filtering. In: Bellcore information filtering workshop

  • Baclace PE (1992) Competitive agents for information filtering. Communications of the ACM 35(12):50–51

    Article  Google Scholar 

  • Balabanović M, Shoham Y (1997) Fab: content-based, collaborative recommendation. Communications of the ACM 40(3):66–72

    Article  Google Scholar 

  • Bersini H, Varela F (1990) Hints for adaptive problem solving gleaned from immune networks. In: PPSN, pp 343–354

  • Bersini H, Varela F (1994) The immune learning mechanisms: reinforcement, recruitment and their applications. In: Paton R (ed) Computing with biological metaphors. Chapman Hall, London, pp 166–192

    Google Scholar 

  • Bezerra GB, Barra TV, Ferreira HM, Knidel H, de Castro LN, Zuben FJV (2006) An immunological filter for spam. In: Bersini H, Carneiro J (eds) 5th international conference on artificial immune systems. Springer-Verlag, Berlin, pp 446–458

    Chapter  Google Scholar 

  • Billsus D, Pazzani M (1998) Learning collaborative information filters. In: 15th international conference on machine learning, pp 46–54

  • Branke J (2001) Evolutionary optimization in dynamic environments. Kluwer, Norwell, MA

    Google Scholar 

  • Breese JS, Heckerman D, Kadie C (1998) Empirical analysis of predictive algorithms for collaborative filtering. In: 14th conference on uncertainty in artificial intelligence. Morgan Kaufman, San Francisco, CA, pp 43–52

  • Burnet FM (1959) The clonal selection theory of acquired immunity. Cambridge University Press, Cambridge, UK

    Google Scholar 

  • Cayzer S, Aickelin U (2002) A recommender system based on the immune network. Technical Report HPL-2002-1, HP Laboratories Bristol

  • Cetintemel U, Franklin MJ, Giles CL (2000) Self-adaptive user profiles for large-scale data delivery. In: International conference on data engineering. San Diego, CA, pp 622–633

  • Chao DL, Forrest S (2003) Information immune systems. Genet Program Evol Mach 4(4):311–331

    Article  Google Scholar 

  • Ciesielski K, Wierzchoń SR, Klopotek MA (2006) An immune network for contextual text data clustering. In: Bersini H, Carneiro J (eds) Proceedings of the 5th internatioinal conference on artificial immune systems (ICARIS’06). Springer-Verlag, Berlin

    Google Scholar 

  • Dasgupta D (ed) (1998) Artificial immune systems and their applications. Springer-Verlag/GmbH & Co. K, Berlin/Heidelberg

  • Dawkins R (1990) The selfish gene. Oxford University Press, New York

    Google Scholar 

  • De Boer RJ, Perelson AS (1991) Size and connectivity as emergent properties of a developing immune network. J Theor Biol 149:381–424

    Article  Google Scholar 

  • de Castro LN, Timmis J (2002) Artificial immune systems: a new computational intelligence approach. Springer-Verlag, UK

    MATH  Google Scholar 

  • de Castro LN, Zuben FJV (2000) An evolutionary immune network for data clustering. In: Proceedings of the 6th Brazilian symposium on neural networks. IEEE Computer Society Press, Los Alamitos, CA, pp 84–89

  • Desjardins G, Godin R (2000) Combining relevance feedback and genetic algorithm in an internet information filtering engine. In: RIAO 2000

  • Eiben AE, Smith JE (2003) Introduction to evolutionary computing. Springer, Berlin

    MATH  Google Scholar 

  • Farmer JD, Packard NH, Perelson AS (1986) The immune system, adaptation, and machine learning. Physica 22D:187–204

    MathSciNet  Google Scholar 

  • Ferguson S (1995) BEAGLE: a genetic algorithm for information filter profile creation. Technical Report MH585, University of Alabama at Birmingham, http://www.cis.uab.edu/info/alumni/sf/Papers/CS692.report.html

  • Flake GW (1998) The computational beauty of nature: computer explorations of fractals, chaos, complex systems, and adaptation. The MIT Press, Cambridge, MA

    MATH  Google Scholar 

  • Forrest S, Perelson AS, Allen L, Cherukuri R (1994) Self-nonself discrimination in a computer. In: Proceedings of the 1994 IEEE symposium on research in security and privacy. IEEE Computer Society Press, Los Alamitos, CA, Oakland, CA, pp 202–212

  • Gaspar A, Collard P (1999) From GAs to artificial immune systems: improving adaptation in time dependent optimization. In: Angeline PJ, Michalewicz Z, Schoenauer M, Yao X, Zalzala A (eds) Proceedings of the congress on evolutionary computation, vol 3. IEEE Press, Mayflower Hotel, Washington DC, USA, pp 1859–1866

  • Gen M, Cheng R (1997) Genetic algorithms and engineering design. Wiley, New York

    Google Scholar 

  • Goldberg DE (1989) Genetic algorithms in search, optimization and machine learning. Addison-Wesley, Reading, MA

    MATH  Google Scholar 

  • Greensmith J, Cayzer S (2003) An artificial immune system approach to semantic document classification. In: Timmis J, Bentley P, Hart E (eds) 2nd international conference on artificial immune systems (ICARIS 2003). Springer, Edinburgh, UK, pp 136–146

    Google Scholar 

  • Hanani U, Shapira B, Shoval P (2001) Information filtering: overview of issues, research and systems. User Model User-Adapt Interact 11:203–259

    Article  MATH  Google Scholar 

  • Hofmeyr SA, Forrest S (2000) Architecture for an artificial immune system. Evol Comput 8(4):443–473

    Article  Google Scholar 

  • Holland JH (1975) Adaptation in natural and artificial systems. University of Michigan Press, Ann Arbor, MI

    Google Scholar 

  • Huang Z, Chen H, Zeng D (2004) Applying associative retrieval techniques to alleviate the sparsity problem in collaborative filtering. ACM Trans Inform Syst 22(1):116–142

    Article  Google Scholar 

  • Hull DA (1998) The TREC-7 Filtering Track: Description and Analysis. In: Voorhess EM, Harman DK (eds) The 7th Text Retrieval Conference (TREC-7). Gaithesrburg, MD, NIST Special Publication 500-242, pp 33–56

  • Hunt JE, Cooke DE (1996) Learning using an artificial immune system. J Netw Comput Appl 19:189–212

    Article  Google Scholar 

  • Jerne NK (1973) Towards a network theory of the immune system. Ann Immunol 125(C):373–389

    Google Scholar 

  • Jones WP, Furnas GW (1986) Pictures of relevance: a geometric analysis of similarity measures. J Am Soc Inform Sci 38(6):420–442

    Article  Google Scholar 

  • Kirkwood E, Lewis C (1989) Understanding medical immunology. Wiley, Chichester

    Google Scholar 

  • Lam W, Mukhopadhyay S, Mostafa J, Palakal M (1996) Detection of shifts in User interests for personalized information filtering. In: 19th annual international ACM SIGIR conference on research and development in information retrieval. Zurich, Switzerland, pp 317–325

  • Liang M, Qunxiu C, Cai L (2003) An improved framework for online adaptive information filtering. In: Dong G, Tang C, Wang W (eds) 4th international conference on advancesin web-age information management. pp 409–420

  • Maes P (1994) Agents that reduce work and information overload. Communications of the ACM 37(7):30–40

    Article  Google Scholar 

  • McElligott M, Sorensen (1994) An evolutionary connectionist approach to personal information filtering. In: 4th Irish neural networks conference ’94. University College Dublin, Ireland, pp 141–146

  • Menczer F (1997) ARACHNID: Adaptive retrieval agents choosing heuristic neighborhoods for information discovery. In: Machine learning: proceedings of the fourteenth international conference, pp 227–235

  • Menczer F, Belew R (1998). Adaptive information agents in distributed textual environments. In: 2nd international conference on autonomous agents. Minneapolis, MN, pp. 157–164

  • Menczer F, Monge AE (1999) Scalable web search by adaptive online agents: an InfoSpiders case study. In: Klusch M (ed) Intelligent information agents: agent-based information discovery and management on the internet. Springer-Verlag, Berlin, pp 323–347

    Google Scholar 

  • Miller MS, Drexler KE (2000) Markets and computation: agoric open systems. Technical Report, Agoric Inc

  • Mitchell M, Belew R (eds) (1996) adaptive individuals in evolving population models, Santa Fe Institute, Studies in the Sciences of Complexity. Addison-Wesley

  • Morrison T, Aickelin U (2002) An artificial immune system as a recommender for web sites. In: 1st international conference on artificial immune systems. pp 161–169

  • Moscato P (1989) On evolution, search, optimization, genetic algorithms and martial arts: towards memetic algorithms. Technical Report C3P Report 826, California Institute of Technology

  • Moukas A (1997) Amalthaea information discovery and filtering using a multiagent evolving ecosystem. Appl Artif Intell 11(5):437–457

    Article  Google Scholar 

  • Moukas A, Maes P (1998) Amalthaea: an evolving multi-agent information filtering and discovery system for the WWW. Auton Agents Multi-Agent Syst 1(1):59–88

    Article  Google Scholar 

  • Moukas A, Zacharia G, Maes P (1999) Amalthaea and histos: multiagent systems for WWW sites and reputation recommendations. In: Klusch M (ed) Intelligent information agents: agent-based information discovery and management on the Internet. Springer-Verlag, Berlin, pp 293–322

  • Nanas N, De Roeck A (2007) Multimodal dynamic optimisation: from evolutionary algorithms to artificial immune systems. In: Proceedings of the 6th international conference on artificial immune systems, pp 13–24

  • Nanas N, De Roeck A (2008) Autopoiesis, the immune system and adaptive information filtering. Natural Computing, in print, online: http://www.springerlink.com/content/u4t7151303626077

  • Nanas N, Uren V, De Roeck A, Domingue J (2004a) Beyond TREC’s filtering track. In: 4th international conference on language resources and evaluation (LREC 2004), pp 1651–1654

  • Nanas N, Uren V, Roeck AD, Domingue J (2004b) Nootropia: a self-organising agent for adaptive information filtering. Technical Report kmi-tr-138, Knowledge Media Institute. http://kmi.open.ac.uk/publications/pdf/kmi-04-2.pdf

  • Oard DW (1997) The state of the art in text filtering. User Model User-Adapt Interact: Int J 7(3):141–178

    Article  Google Scholar 

  • Oard DW, Marchionini (1996) A conceptual framework for text filtering. Technical Report CS-TR-3643, University of Maryland

  • Oda T, White T (2005) Immunity from spam: an analysis of an artificial immune system for junk email detection. In: International conference on artificial immune systems. pp 276–289

  • Perelson A, Oster G (1979) Theoretical studies of clonal selection: minimal antibody repertoire size and reliability of self-non-self discrimination. J Theor Biol 1:645–670

    Article  MathSciNet  Google Scholar 

  • Potter MA, Jong KAD (1998) The coevolution of antibodies for concept learning. In: Eiben AE, Bäck T (eds) 5th international conference on parallel problem solving from nature (PPSN V). Springer-Verlag, Amsterdam, pp 530–539

    Chapter  Google Scholar 

  • Rocchio J (1971) Relevance feedback in information retrieval, Chap. 14. Prentice-Hall Inc., Englewood Cliffs, NJ, pp 313–323

  • Rodgers JL, Nicewander WA (1988) Thirteen ways to look at the correlation coefficient. Am Stat 42:59–66

    Article  Google Scholar 

  • Salton G, McGill MJ (1983) Introduction to modern information retrieval. McGraw-Hill Inc., New York

    MATH  Google Scholar 

  • Schapire R, Singer Y, Singhal A (1998) Boosting and Rocchio applied to text filtering. In: 21st annual international ACM SIGIR conference on research and development in information retrieval. pp 215–223

  • Sebastiani F (2002) Machine learning in automated text categorization. ACM Comput Surv 34(1):1–47

    Article  Google Scholar 

  • Secker A, Freitas AA, Timmis J (2003) AISEC: an artificial immune system for e-mail classification. In: Sarker R, Reynolds R, Abbass H, Kay-Chen T, McKay R, Essam D, Gedeon T (eds) Congress on evolutionary computation. IEEE, Canberra, Australia, pp 131–139

  • Seo Y, Zhang B (2000) A reinforcement learning agent for personalized information filtering. In: Intelligent user interfaces. New Orleans, LA, pp 248–251

  • Sheth BD (1994) A learning approach to personalized information filtering. Master of Science, Massachusetts Institute of Technology

  • Simões AB, Costa E (2003) An immune system-based genetic algorithm to deal with dynamic environments: diversity and memory. In: Proceedings of the sixth international conference on neural networks and genetic algorithms (ICANNGA’03). Roanne, France, pp 168–174

  • Soboroff IM, Nicholas CK (2002) Related, but not relevant: content-based collaborative filtering in TREC-8. Inform Retr 5(2–3):189–208

    Article  Google Scholar 

  • Tarakanov AO, Skormin VA, Sokolova SP (2003) Immunocomputing: principles and applications. Springer Verlag, New York

    MATH  Google Scholar 

  • Tauritz DR (2002) Adaptive information filtering: concepts and algorithms. PhD thesis, Leiden University

  • Tauritz DR, Smorodkina E (2007) Greedy population sizing for evolutionary algorithms. In: IEEE congress on evolutionary computation (CEC 2007), Singapore, pp 2181–2187

  • Tauritz DR, Kok JN, Sprinkhuizen-Kuyper IG (2000) Adaptive information filtering using evolutionary computation. Inform Sci 122(2-4): 121–140

    Article  MATH  Google Scholar 

  • Tjoa AM, Höfferer M, Ehrentraut G, Untersmeyer P (1997) Applying evolutionary algorithms to the problem of information filtering. In: 8th international workshop on database and expert systems application. IEEE Computer Press, Toulouse, France, pp 450–458

  • Twycross J, Cayzer S (2002) An immune-based approach to document classification. Technical Report HPL-2002-292, HP Research, Bristol

  • Ujjin S, Bentley PJ (2002) Learning user preferences using evolution. In: 4th Asia-Pacific conference on simulated evolution and learning (SEAL’02), Singapore

  • Varela FJ, Coutinho A (1991) Second generation immune network. Immunol Today 12(5):159–166

    Google Scholar 

  • Vaz NM, Varela F (1978) Self and non-sense: an organism-centered approach to immunology. Med Hypotheses 4:231–267

    Article  Google Scholar 

  • Watkins AB, Boggess LC (2002) A resource limited artificial immune classifier. In: Congress on evolutionary computation, part of the 2002 IEEE world congress on computational intelligence. pp 926–931

  • Webb GI, Pazzani MJ, Billsus D (2001) Machine learning for user modeling. User Model User-Adapt Interact 11:19–29

    Article  MATH  Google Scholar 

  • Widyantoro DH, Loerger TR, Yen J (2001) Learning user interests dynamics with a three-descriptor representation. J Am Soc Inform Sci 52:212–225

    Article  Google Scholar 

  • Winiwarter W (1999) PEA—a Personal Email Assistant with evolutionary adaptation. Int J Inform Technol 5(1)

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Nikolaos Nanas.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Nanas, N., de Roeck, A. A review of evolutionary and immune-inspired information filtering. Nat Comput 9, 545–573 (2010). https://doi.org/10.1007/s11047-009-9126-z

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11047-009-9126-z

Keywords

Navigation