Baoping Zhang
Edward A. Fox
Marco Cristo
Pável Calado
ABSTRACT
This paper shows how citation-based information and structural content (e.g., title, abstract) can be combined to improve classification of text documents into predefined categories. We evaluate different measures of similarity -- five derived from the citation information of the collection, and three derived from the structural content -- and determine how they can be fused to improve classification effectiveness. To discover the best fusion framework, we apply Genetic Programming (GP) techniques. Our experiments with the ACM Computing Classification Scheme, using documents from the ACM Digital Library, indicate that GP can discover similarity functions superior to those based solely on a single type of evidence. Effectiveness of the similarity functions discovered through simple majority voting is better than that of content-based as well as combination-based Support Vector Machine classifiers. Experiments also were conducted to compare the performance between GP techniques and other fusion techniques such as Genetic Algorithms (GA) and linear fusion. Empirical results show that GP was able to discover better similarity functions than GA or other fusion techniques.
- R. Amsler. Application of citation-based automatic classification. Technical report, The University of Texas at Austin, Linguistics Research Center, Austin, TX, 1972.]]Google Scholar
- P. Calado, M. Cristo, E. S. de Moura, N. Ziviani, B. A. Ribeiro-Neto, and M. A. Gonçalves. Combining link-based and content-based methods for Web document classification. In Proc. of CIKM-03, pages 394--401, New Orleans, US, 2003.]] Google ScholarDigital Library
- S. Chakrabarti, B. Dom, and P. Indyk. Enhanced hypertext categorization using hyperlinks. In Proc. of SIGMOD, pages 307--318, Seattle, 1998.]] Google ScholarDigital Library
- S. M. Cheang, K. H. Lee, and K. S. Leung. Data classification using genetic parallel programming. In GECCO-03, volume 2724 of LNCS, pages 1918--1919, Chicago, 2003.]]Google Scholar
- CITIDEL. Computing and Information Technology Interactive Digital Educational Library, www.citidel.org, 2004.]]Google Scholar
- C. Clack, J. Farringdon, P. Lidwell, and T. Yu. Autonomous document classification for business. In AGENTS-97, pages 201--208, 1997.]] Google ScholarDigital Library
- D. Cohn and T. Hofmann. The missing link - a probabilistic model of document content and hypertext connectivity. In NIPS 13, pages 430--436. MIT Press, 2001.]]Google Scholar
- J. Dean and M. R. Henzinger. Finding related pages in the World Wide Web. Computer Networks, 31(11--16):1467--1479, 1999. Also in Proceedings of the 8th International World Wide Web Conference.]] Google ScholarDigital Library
- M. D. del Castillo and J. I. Serrano. A multistrategy approach for digital text categorization from imbalanced documents. SIGKDD, 6(1):70--79, 2004.]] Google ScholarDigital Library
- J. Eggermont, J. N. Kok, and W. A. Kosters. Genetic programming for data classification: Refining the search space. In Proc. of BNAIC-03, pages 123--130, Nijmegen, 2003.]]Google Scholar
- W. Fan, E. A. Fox, P. Pathak, and H. Wu. The effects of fitness functions on genetic programming-based ranking discovery for web search. JASIST, 55(7):628--636, 2004.]] Google ScholarDigital Library
- W. Fan, M. D. Gordon, and P. Pathak. Discovery of context-specific ranking functions for effective information retrieval using genetic programming. TKDE-04, 16(4):523--527, 2004.]] Google ScholarDigital Library
- W. Fan, M. D. Gordon, P. Pathak, W. Xi, and E. A. Fox. Ranking function optimization for effective web search by genetic programming: An empirical study. In Proc. of HICSS-04, pages 105--112, Hawaii, 2004.]] Google ScholarDigital Library
- M. Fisher and R. Everson. When are links useful? Experiments in text classification. In Proc. of ECIR-03, pages 41--56, 2003.]]Google ScholarCross Ref
- J. Furnkranz. Exploiting structural information for text classification on the WWW. In IDA-99, pages 487--498, 1999.]] Google ScholarDigital Library
- E. J. Glover, K. Tsioutsiouliklis, S. Lawrence, D. M. Pennock, and G. W. Flake. Using Web structure for classifying and describing Web pages. In Proc. of WWW-02, 2002.]] Google ScholarDigital Library
- M. Gordon. Probabilistic and genetic algorithms for document retrieval. CACM, 31(10):1208--1218, 1988.]] Google ScholarDigital Library
- J. H. Holland. Adaption in Natural and Artificial Systems. MIT Press, Cambridge, MA, 1992.]] Google ScholarDigital Library
- T. Joachims. Text categorization with support vector machines: learning with many relevant features. In Proc. of ECML-98, pages 137--142, Chemnitz, Germany, 1998.]] Google ScholarDigital Library
- T. Joachims, N. Cristianini, and J. Shawe-Taylor. Composite kernels for hypertext categorisation. In Proc. of ICML-01, pages 250--257, Williams College, US, 2001.]] Google Scholar
- N. Kampanya, R. Shen, S. Kim, C. North, and E. A. Fox. CitiViz: A visual user interface to the CITIDEL system. In Proc. of ECDL-04, pages 122--133, Bath, UK, 2004.]]Google ScholarCross Ref
- M. M. Kessler. Bibliographic coupling between scientific papers. American Documentation, 14(1):10--25, 1963.]]Google ScholarCross Ref
- J. K. Kishore, L. M. Patnaik, V. Mani, and V. K. Agrawal. Application of genetic programming for multicategory pattern classification. IEEE TEC-00, 4(3):242--258, 2000.]]Google Scholar
- J. K. Kishore, L. M. Patnaik, V. Mani, and V. K. Agrawal. Genetic programming based pattern classification with feature space partitioning. Information Sciences, 131(1-4):65--86, 2001.]] Google ScholarDigital Library
- J. R. Koza. Genetic programming: On the programming of computers by natural selection. MIT Press, Cambridge, 1992.]] Google ScholarDigital Library
- A. Krowne and E. A. Fox. An architecture for multischeming in digital libraries. In Proc. of ICADL-03, pages 563--577, Kuala Lumpur, Malaysia, 2003.]]Google ScholarCross Ref
- W. B. Langdon. Data Structures and Genetic Programming: Genetic Programming + Data Structures = Automatic Programming! Kluwer, Boston, 1998.]] Google ScholarDigital Library
- W. B. Langdon and R. Poli. Foundations of Genetic Programming. Springer-Verlag, New York, 2002.]] Google ScholarDigital Library
- S. Lawrence, C. L. Giles, and K. Bollacker. "Digital Libraries and Autonomous Citation Indexing". IEEE Computer, 32(6):67--71, 1999.]] Google ScholarDigital Library
- T. M. Mitchell. Machine learning. McGraw Hill, New York, US, 1996.]]Google ScholarDigital Library
- H.-J. Oh, S. H. Myaeng, and M.-H. Lee. A practical hypertext catergorization method using links and incrementally available class information. In Proc. of SIGIR, pages 264--271, 2000.]] Google ScholarDigital Library
- H. G. Small. Co-citation in the scientific literature: A new measure of relationship between two documents. JASIS, 24(4):265--269, 1973.]]Google ScholarCross Ref
- A. Sun, E.-P. Lim, and W.-K. Ng. Web classification using support vector machine. In Proc. of WIDM-02, pages 96--99, 2002.]] Google ScholarDigital Library
- Y. Yang. Expert network: effective and efficient learning from human decisions in text categorisation and retrieval. In Proc. of SIGIR-94, pages 13--22, Dublin, IE, 1994.]] Google ScholarDigital Library
- Y. Yang, S. Slattery, and R. Ghani. A study of approaches to hypertext categorization. JIIS, 18(2-3):219--241, 2002.]] Google ScholarDigital Library
- B. Zhang, M. A. Gonçalves, W. Fan, Y. Chen, E. A. Fox, P. Calado, and M. Cristo. Intelligent fusion of structural and citation-based evidence for text classification. Technical Report TR-04-16, Computer Science, Virginia Tech, 2004.]]Google Scholar
- B. Zhang, M. A. Gonçalves, and E. A. Fox. An OAI-based filtering service for CITIDEL from NDLTD. In Proc. of ICADL-03, pages 590--601, Kuala Lumpur, Malaysia, 2003.]]Google ScholarCross Ref
Index Terms
- Intelligent GP fusion from multiple sources for text classification
Recommendations
Intelligent fusion of structural and citation-based evidence for text classification
SIGIR '05: Proceedings of the 28th annual international ACM SIGIR conference on Research and development in information retrievalThis paper shows how different measures of similarity derived from the citation information and the structural content (e.g., title, abstract) of the collection can be fused to improve classification effectiveness. To discover the best fusion framework, ...
HMXT-GP: an information-theoretic approach to genetic programming that maintains diversity
SAC '11: Proceedings of the 2011 ACM Symposium on Applied ComputingThis paper applies a recent information--theoretic approach to controlling Genetic Algorithms (GAs) called HMXT to tree--based Genetic Programming (GP). HMXT, in a GA domain, requires the setting of selection thresholds in a population and the ...
Building boosted classification tree ensemble with genetic programming
GECCO '18: Proceedings of the Genetic and Evolutionary Computation Conference CompanionAdaptive boosting (AdaBoost) is a method for building classification ensemble, which combines multiple classifiers built in an iterative process of reweighting instances. This method proves to be a very effective classification method, therefore it was ...
Comments