Welcome to the InfoSci Platform
Reference Hub3
Effective Technique to Reduce the Dimension of Text Data

Effective Technique to Reduce the Dimension of Text Data

D.S. Guru, K. Swarnalatha, N. Vinay Kumar, Basavaraj S. Anami
Copyright: © 2020 |Volume: 10 |Issue: 1 |Pages: 19
ISSN: 2155-6997|EISSN: 2155-6989|EISBN13: 9781799807353|DOI: 10.4018/IJCVIP.2020010104
Cite Article Cite Article

MLA

Guru, D.S., et al. "Effective Technique to Reduce the Dimension of Text Data." IJCVIP vol.10, no.1 2020: pp.67-85. http://doi.org/10.4018/IJCVIP.2020010104

APA

Guru, D., Swarnalatha, K., Kumar, N. V., & Anami, B. S. (2020). Effective Technique to Reduce the Dimension of Text Data. International Journal of Computer Vision and Image Processing (IJCVIP), 10(1), 67-85. http://doi.org/10.4018/IJCVIP.2020010104

Chicago

Guru, D.S., et al. "Effective Technique to Reduce the Dimension of Text Data," International Journal of Computer Vision and Image Processing (IJCVIP) 10, no.1: 67-85. http://doi.org/10.4018/IJCVIP.2020010104

Export Reference

Mendeley
Favorite Full-Issue Download

Abstract

In this article, features are selected using feature clustering and ranking of features for imbalanced text data. Initially the text documents are represented in lower dimension using the term class relevance (TCR) method. The class wise clustering is recommended to balance the documents in each class. Subsequently, the clusters are treated as classes and the documents of each cluster are represented in the lower dimensional form using the TCR again. The features are clustered and for each feature cluster the cluster representative is selected and these representatives are used as selected features of the documents. Hence, this proposed model reduces the dimension to a smaller number of features. For selecting the cluster representative, four feature evaluation methods are used and classification is done by using SVM classifier. The performance of the method is compared with the global feature ranking method. The experiment is conducted on two benchmark datasets the Reuters-21578 and the TDT2 dataset. The experimental results show that this method performs well when compared to the other existing works.

Request Access

You do not own this content. Please login to recommend this title to your institution's librarian or purchase it from the IGI Global bookstore.