To read this content please select one of the options below:

(excl. tax) 30 days to view and download

Take full advantage of unlabeled data for sentiment classification

Lei La, Shuyan Cao, Liangjuan Qin

Kybernetes

ISSN: 0368-492X

Article publication date: 3 January 2018

Issue publication date: 23 February 2018

271

Abstract

Purpose

As a foundational issue of social mining, sentiment classification suffered from a lack of unlabeled data. To enhance accuracy of classification with few labeled data, many semi-supervised algorithms had been proposed. These algorithms improved the classification performance when the labeled data are insufficient. However, precision and efficiency are difficult to be ensured at the same time in many semi-supervised methods. This paper aims to present a novel method for using unlabeled data in a more accurate and more efficient way.

Design/methodology/approach

First, the authors designed a boosting-based method for unlabeled data selection. The improved boosting-based method can choose unlabeled data which have the same distribution with the labeled data. The authors then proposed a novel strategy which can combine weak classifiers into strong classifiers that are more rational. Finally, a semi-supervised sentiment classification algorithm is given.

Findings

Experimental results demonstrate that the novel algorithm can achieve really high accuracy with low time consumption. It is helpful for achieving high-performance social network-related applications.

Research limitations/implications

The novel method needs a small labeled data set for semi-supervised learning. Maybe someday the authors can improve it to an unsupervised method.

Practical implications

The mentioned method can be used in text mining, image classification, audio processing and so on, and also in an unstructured data mining-related field. Overcome the problem of insufficient labeled data and achieve high precision using fewer computational time.

Social implications

Sentiment mining has wide applications in public opinion management, public security, market analysis, social network and related fields. Sentiment classification is the basis of sentiment mining.

Originality/value

According to what the authors have been informed, it is the first time transfer learning be introduced to AdaBoost for semi-supervised learning. Moreover, the improved AdaBoost uses a totally new mechanism for weighting.

Keywords

Acknowledgements

This work was supported in part by “Beijing Municipal Social Science Foundation” No. 16GLC067 and “Beijing Municipal Science and Technology Project”, no. D171100003317001 (Key technology research and development of Beijing animation derivatives personalized consumer service).

Citation

La, L., Cao, S. and Qin, L. (2018), "Take full advantage of unlabeled data for sentiment classification", Kybernetes, Vol. 47 No. 3, pp. 474-486. https://doi.org/10.1108/K-08-2016-0196

Publisher

:

Emerald Publishing Limited

Copyright © 2017, Emerald Publishing Limited

Related articles