skip to main content
10.1145/2072298.2072028acmconferencesArticle/Chapter ViewAbstractPublication PagesmmConference Proceedingsconference-collections
short-paper

Optimal batch selection for active learning in multi-label classification

Published:28 November 2011Publication History

ABSTRACT

Multi-label classification is a generalization of conventional classification, where it is possible for a single data point to have multiple labels. Manual annotation of a multi-label data point requires a human oracle to consider the presence/absence of every possible class separately, which involves significant labor. Active learning techniques are effective in reducing human labeling effort to induce a classification model. When exposed to large quantities of unlabeled data, such algorithms automatically select the salient and representative instances for manual annotation. Further, to address the high redundancy in data such as image or video sequences as well as the availability of multiple labeling agents, there have been recent attempts towards a batch mode form of active learning, where a batch of data points is selected simultaneously from an unlabeled set. In this work, we propose a novel optimization based batch mode active learning strategy to minimize human labeling effort in multi-label classification problems. To the best of our knowledge, this is the first attempt to develop such a scheme primarily intended for the multi-label context. The proposed framework is computationally simple, easy to implement and can be suitably modified to perform batch mode active learning in other formulations, such as single-label classification or problems involving hierarchical label spaces. Our results corroborate the efficacy of the proposed algorithm and certify the potential of the framework in being used for real world applications.

References

  1. Y. Baram, R. El-Yaniv, and K. Luz. Online choice of active learning algorithms. JMLR, 5, 2004. Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. M. Boutell, J. Luo, X. Shen, and C. Brown. Learning multi-label scene classification. Pattern Recognition, 2004.Google ScholarGoogle Scholar
  3. K. Brinker. Incorporating diversity in active learning with support vector machines. ICML, 2003.Google ScholarGoogle Scholar
  4. K. Brinker. On active learning in multi-label classification. In SpringerLink, 2006.Google ScholarGoogle ScholarCross RefCross Ref
  5. D. Cohn, Z. Ghahramani, and M. Jordan. Active learning with statistical models. JAIR, 1996. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. B. Gokberk, L. Akarun, and E. Alpaydin. Feature selection for pose invariant face recognition. In IEEE ICPR, 2002. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. G.Tsoumakas and I. Katakis. Multi-label classification: An overview. In International Journal of Data Warehousing and Mining, 2007.Google ScholarGoogle Scholar
  8. Y. Guo and D. Schuurmans. Discriminative batch mode active learning. In NIPS, 2008.Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. S. Hoi, R. Jin, and M. R. Lyu. Large-scale text categorization by batch mode active learning. In International Conference on World Wide Web, 2006. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. S. Hoi, R. Jin, J. Zhu, and M. Lyu. Semi-supervised SVM batch mode active learning for image retrieval. In IEEE CVPR, 2008.Google ScholarGoogle ScholarCross RefCross Ref
  11. S. Hoi, R. Jin, J. Zhu, and M. R. Lyu. Batch mode active learning and its application to medical image classification. In ICML, 2006. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. X. Li, L. Wang, and E. Sung. Multi-label svm active learning for image classification. IEEE ICIP, 2004.Google ScholarGoogle Scholar
  13. Y. Liu and Z. Zhang. A fast algorithm for linearly constrained quadratic programming problems with lower and upper bounds. In International Conference on Multimedia and Information Technology, 2008. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. M. Singh, E. Curran, and P. Cunningham. Active learning for multi-label image annotation. In Technical Report, University College Dublin, 2009.Google ScholarGoogle Scholar
  15. S. Tong and D. Koller. Support vector machine active learning with applications to text classification. JMLR, 2000. Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. X. Zhang, J. Cheng, C. Xu, H. Lu, and S. Ma. Multi-view multi-label active learning for image classification. In IEEE ICME, 2009. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Optimal batch selection for active learning in multi-label classification

      Recommendations

      Comments

      Login options

      Check if you have access through your login credentials or your institution to get full access on this article.

      Sign in
      • Published in

        cover image ACM Conferences
        MM '11: Proceedings of the 19th ACM international conference on Multimedia
        November 2011
        944 pages
        ISBN:9781450306164
        DOI:10.1145/2072298

        Copyright © 2011 ACM

        Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        • Published: 28 November 2011

        Permissions

        Request permissions about this article.

        Request Permissions

        Check for updates

        Qualifiers

        • short-paper

        Acceptance Rates

        Overall Acceptance Rate995of4,171submissions,24%

        Upcoming Conference

        MM '24
        MM '24: The 32nd ACM International Conference on Multimedia
        October 28 - November 1, 2024
        Melbourne , VIC , Australia

      PDF Format

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader