Take full advantage of unlabeled data for sentiment classification
ISSN: 0368-492X
Article publication date: 3 January 2018
Issue publication date: 23 February 2018
Abstract
Purpose
As a foundational issue of social mining, sentiment classification suffered from a lack of unlabeled data. To enhance accuracy of classification with few labeled data, many semi-supervised algorithms had been proposed. These algorithms improved the classification performance when the labeled data are insufficient. However, precision and efficiency are difficult to be ensured at the same time in many semi-supervised methods. This paper aims to present a novel method for using unlabeled data in a more accurate and more efficient way.
Design/methodology/approach
First, the authors designed a boosting-based method for unlabeled data selection. The improved boosting-based method can choose unlabeled data which have the same distribution with the labeled data. The authors then proposed a novel strategy which can combine weak classifiers into strong classifiers that are more rational. Finally, a semi-supervised sentiment classification algorithm is given.
Findings
Experimental results demonstrate that the novel algorithm can achieve really high accuracy with low time consumption. It is helpful for achieving high-performance social network-related applications.
Research limitations/implications
The novel method needs a small labeled data set for semi-supervised learning. Maybe someday the authors can improve it to an unsupervised method.
Practical implications
The mentioned method can be used in text mining, image classification, audio processing and so on, and also in an unstructured data mining-related field. Overcome the problem of insufficient labeled data and achieve high precision using fewer computational time.
Social implications
Sentiment mining has wide applications in public opinion management, public security, market analysis, social network and related fields. Sentiment classification is the basis of sentiment mining.
Originality/value
According to what the authors have been informed, it is the first time transfer learning be introduced to AdaBoost for semi-supervised learning. Moreover, the improved AdaBoost uses a totally new mechanism for weighting.
Keywords
Acknowledgements
This work was supported in part by “Beijing Municipal Social Science Foundation” No. 16GLC067 and “Beijing Municipal Science and Technology Project”, no. D171100003317001 (Key technology research and development of Beijing animation derivatives personalized consumer service).
Citation
La, L., Cao, S. and Qin, L. (2018), "Take full advantage of unlabeled data for sentiment classification", Kybernetes, Vol. 47 No. 3, pp. 474-486. https://doi.org/10.1108/K-08-2016-0196
Publisher
:Emerald Publishing Limited
Copyright © 2017, Emerald Publishing Limited