Publication Type
Journal Article
Version
publishedVersion
Publication Date
9-2009
Abstract
Most machine learning tasks in data classification and information retrieval require manually labeled data examples in the training stage. The goal of active learning is to select the most informative examples for manual labeling in these learning tasks. Most of the previous studies in active learning have focused on selecting a single unlabeled example in each iteration. This could be inefficient, since the classification model has to be retrained for every acquired labeled example. It is also inappropriate for the setup of information retrieval tasks where the user's relevance feedback is often provided for the top K retrieved items. In this paper, we present a framework for batch mode active learning, which selects a number of informative examples for manual labeling in each iteration. The key feature of batch mode active learning is to reduce the redundancy among the selected examples such that each example provides unique information for model updating. To this end, we employ the Fisher information matrix as the measurement of model uncertainty, and choose the set of unlabeled examples that can efficiently reduce the Fisher information of the classification model. We apply our batch mode active learning framework to both text categorization and image retrieval. Promising results show that our algorithms are significantly more effective than the active learning approaches that select unlabeled examples based only on their informativeness for the classification model.
Keywords
Batch mode active learning, convex optimization, image retrieval, kernel logistic regressions, logistic regressions, text categorization
Discipline
Databases and Information Systems | Theory and Algorithms
Research Areas
Data Science and Engineering
Publication
IEEE Transactions on Knowledge and Data Engineering (TKDE)
Volume
21
Issue
9
First Page
1233
Last Page
1248
ISSN
1041-4347
Identifier
10.1109/TKDE.2009.60
Publisher
IEEE
Citation
HOI, Steven C. H.; JIN, Rong; and LYU, Michael R..
Batch Mode Active Learning with Applications to Text Categorization and Image Retrieval. (2009). IEEE Transactions on Knowledge and Data Engineering (TKDE). 21, (9), 1233-1248.
Available at: https://ink.library.smu.edu.sg/sis_research/2310
Copyright Owner and License
Authors
Creative Commons License
This work is licensed under a Creative Commons Attribution-NonCommercial-No Derivative Works 4.0 International License.
Additional URL
https://doi.org/10.1109/TKDE.2009.60