Multi-Label Text Categorization Forecasting Probability Problem Using Support Vector Machine Techniques

Abstract

The pervasiveness of information available on the Internet means that increasing numbers of documents must be classified. Text categorization is not only undertaken by domain experts, but also by automatic text categorization systems. Therefore, a text categorization system with a multi-label classifier is necessary to process the large number of documents. In this study, a proposed multi-label text categorization system is developed to classify multi-label documents. Data mapping is performed to transform data from a high-dimensional space to a lower-dimensional space with paired SVM output values, thus lower the complexity of the computation. A pair-wise comparison approach is applied to set the membership function in each predicted class to judge all possible classified classes. Finally, the overlapped area of two classes is obtained from the decision function to determine where a document is classified. A comparative study is performed on multi-label approaches using Reuter’s data sets. The results of the empirical experiment indicate that the proposed multi-label text categorization system performs better than other methods in terms of overall performance indices. Additionally, the probability of 0.5 for model membership function is a good criterion to judge between correctly and incorrectly classified documents from the results of the empirical experiment.