ABSTRACT
Text searching, categorization, and summarization are important problems in information retrieval research. One of the most common approaches to text analysis is to exploit the term frequency-inverse document frequency (tf-idf) vector model, which is very effective and efficient in representing a large document through a small vector. The tf-idf approach has the crucial drawback that it only considers the text in terms of the structure of composition. However, each natural language has its own syntactic structure. Thus, it is not sufficient to replace the text with a set of important keywords without taking into account their relative relation to the thesis and meaning of the text. In this paper, we propose a text search model based on a keyword graph model, which is based on the cognitive process (writing) model. We show how to construct a keyword graph from a text by assigning edges between two vertices (keywords) if their regions of influence overlap. Our approach allows the use of the text as a query attribute. In our model, if a user wants to find text similar to a given query text in a large repository, the query document can be searched without selecting keywords. This query-by-example in text searching is an important contribution of our work. Experiments show that our keyword graph model is superior to the tf-idf model in clearly and effectively revealing the similarity between documents. Our experiments use more than 2,000 speeches obtained from the United States White House, and show that our approach is superior to prevalent text search methods in terms of accuracy of syntactic similarity and the semantic structure of object texts.
- R. Angelova and G. Weikum. Graph-based text classification: Learn from your neighbors. In Proc. ACM SIGIR, pages 485--492, 2006. Google ScholarDigital Library
- N. Azam and J. Yao. Comparison of term frequency and document frequency based feature selection metrics in text categorization. Expert Systems with Applications, 39: 4760--4768, 2012. Google ScholarDigital Library
- M. Bastian, S. Heymann, and M. Jacomy. Gephi: An open source software for exploring and manipulating networks. In Proc. of 3rd ICWSM, 2009.Google ScholarCross Ref
- N. L. Bigot, J.-M. Passerault, and T. Olive. Memory for words location in writing. Psychological Research, 73: 89--97, 2009.Google ScholarCross Ref
- J. A. Bullinaria and J. P. Levy. Extracting semantic representations from word co-occurrence statistics: Stop-lists, stemming and svd. Behavior Research Methods, 2012, 2010.Google Scholar
- H. Bunke and X. Jiang. Graph matching and similarity. International Series in Intelligent Technologies Volume, 15: 281--304, 2000. Google ScholarDigital Library
- W. B. Canvar and J. M. Trenkle. N-gram-based text categorization. In Proc. SDAIR, pages 161--175, 1994.Google Scholar
- J. Choi, S. Yi, and K. C. Lee. Analysis of keyword networks in MIS research and implications for predicting knowledge evolution. Information & Management, 48: 371--381, 2011. Google ScholarDigital Library
- C. Collins, S. Carpendale, and G. Penn. Graph similarity scoring and matching. Applied Mathematics Letters, 21: 86--94, 2008.Google ScholarCross Ref
- C. Collins, S. Carpendale, and G. Penn. Docuburst: Visualizing document content using language structure. Eurographics/ IEEE-VGTC Symposium on Visualization, 29: 1042--1046, 2009. Google ScholarDigital Library
- D. K. Elson, N. Dames, and K. R. McKeown. Extracting social networks from literary fiction. In Proc. of 48th ACL, pages 138--147, 2010. Google ScholarDigital Library
- G. Erkan and D. R. Radev. LexRank: Graph-based lexical centrality as salience in text summarization. Journal of Artificial Intelligence Research, 22: 457--479, 2004. Google ScholarCross Ref
- L. Flower and J. R. Hayes. A cognitive process theory of writing. College Composition and Communication, 32: 365--387, 1981.Google ScholarCross Ref
- A. Garg, P. Bhattacharyya, C. U. Martel, and S. F. Wu. Information flow and search in unstructed keyword based social networks. In Proc. CSE, pages 1074--1081, 2009. Google ScholarDigital Library
- Y. Guo, Z. Shao, and N. Hua. Automated text categorization based on content analysis with cognitive situation models. Information Sciences, 180: 613--630, 2010. Google ScholarDigital Library
- A. Hassan, A. A. Jbara, and D. Radev. Extracting signed social networks from text. In Proc. TextGraph, pages 6--14, 2010. Google ScholarDigital Library
- M. S. Hossain and R. A. Angryk. GDClust: A graph-based document clustering technique. In Proc. IEEE ICDM, pages 417--422, 2007. Google ScholarDigital Library
- C. Jiang, F. Coenen, R. Sanderson, and M. Zito. Text classification using graph mining-based feature extraction. Knowledge-Based Systems, 23: 302--308, 2010. Google ScholarDigital Library
- J.-Y. Jiang, S.-C. Tsai, and S.-J. Lee. FSKNN: Multi-label text categorization based on fuzzy similarity and k nearest neighbors. Expert Systems with Applications, 39: 2813--2821, 2012. Google ScholarDigital Library
- S. Jiang, G. Pang, M. Wu, and L. Kuang. An improved k-nearest-neighbor algorithm for text categorization. Expert Systems with Applications, 39: 1503--1509, 2012. Google ScholarDigital Library
- C. H. Li, J. C. Yang, and S. C. Park. Text categorization algorithms using semantic approaches, corpus-based thesaurus and WordNet. Expert Systems with Applications, 39: 765--772, 2012. Google ScholarDigital Library
- C. D. Manning, T. Grow, T. Grenager, J. Finkel, and J. Bauer. Stanford tokenizer.Google Scholar
- F. Sebastiani. Machine learning in automated text categorization. ACM Computing Surveys, 34(1): 1--47, 2002. Google ScholarDigital Library
- J. Seo, G.-M. Park, and H. G. Cho. Characteristic analysis of social network constructed from literary fiction(to appear). In Proc. Cyber World 2013, Japan, 2013. Google ScholarDigital Library
- J. K. Seo, G.-M. Park, S.-H. Kim, and H.-G. Cho. Characteristic analysis of social network constructed from literary fiction. In International Conference on Cyberworlds 2013, 2013. Google ScholarDigital Library
- S.-Y. Yang and V.-W. Soo. Extract conceptual graphs from plain texts in patent claims. Engineering Applications and Artificial Intelligence, 25: 874--887, 2012. Google ScholarDigital Library
- Y. Yang and X. Liu. A re-examination of text categorization methods. In Proc. SIGIR, pages 42--49, 1999. Google ScholarDigital Library
- Y. Yang and J. O. Pedersen. A comparative study on feature selection in text categorization. In Proc. ICML, pages 412--420, 1997. Google ScholarDigital Library
Recommendations
From Query-By-Keyword to Query-By-Example: LinkedIn Talent Search Approach
CIKM '17: Proceedings of the 2017 ACM on Conference on Information and Knowledge ManagementOne key challenge in talent search is to translate complex criteria of a hiring position into a search query, while it is relatively easy for a searcher to list examples of suitable candidates for a given position. To improve search e ciency, we propose ...
Finding competitive keywords from query logs to enhance search engine advertising
A novel method is proposed to find competitive keywords for search engine advertising.The method can explore the keyword associations and their topic information hidden in query logs to identify effective keywords for advertisers.Extensive experiments ...
Evaluation and Comparison of Entity based search Implied by SVM and Neural Network
ICTCS '16: Proceedings of the Second International Conference on Information and Communication Technology for Competitive StrategiesWith the increasing amounts of data generated in the cyber world the need for an efficient and robust technique has been felt. Keyword based search provides a solution for the problems mentioned before. Keyword search has been proven an effective ...
Comments