Skip to main content
SpringerLink
Log in

Semi-supervised classification with privileged information

  • Original Article
  • Published:
International Journal of Machine Learning and Cybernetics Aims and scope Submit manuscript

Abstract

The privileged information that is available only for the training examples and not available for test examples, is a new concept proposed by Vapnik and Vashist (Neural Netw 22(5–6):544–557, 2009). With the help of the privileged information, learning using privileged information (LUPI) (Neural Netw 22(5–6):544–557, 2009) can significantly accelerate the speed of learning. However, LUPI is a standard supervised learning method. In fact, in many real-world problems, there are also a lot of unlabeled data. This drives us to solve problems under a semi-supervised learning framework. In this paper, we propose a semi-supervised learning using privileged information (called Semi-LUPI), which can exploit both the distribution information in unlabeled data and privileged information to improve the efficiency of the learning. Furthermore, we also compare the relative importance of both types of information for the learning model. All experiments verify the effectiveness of the proposed method, and simultaneously show that Semi-LUPI can obtain superior performances over traditional supervised and semi-supervised methods.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

Notes

  1. http://www.nec-labs.com/research/machine/ml_website/department/software/learning-with-teacher.

  2. 0-5 is the range of possible values.

References

  1. Vapnik V, Vashist A (2009) A new learning paradigm: learning using privileged information. Neural Netw 22(5–6):544–557

    Article  Google Scholar 

  2. Vapnik V (1995) The nature of statistical learning theory. Springer, New York

  3. Vapnik V (1996) The nature of statistical learning theory. Springer, New York

  4. Vapnik V (2006) Estimation of dependences based on empirical data (information science and statistics). Springer, Berlin

  5. Pechyony D, Vapnik V (2010) On the theory of learning with privileged information. In: Advances in neural information processing systems, vol 23

  6. Pechyony D, Izmailov R, Vashist A, Vapnik V (2010) Smo-style algorithms for learning using privileged information. In: DMIN. CSREA Press, Providence, pp 235–241

  7. Seeger M (2001) Learning with labeled and unlabeled data. Technical report

  8. Chapelle O, Schölkopf B, Zien A (eds) (2006) Semi-supervised learning (adaptive computation and machine learning). The MIT Press, Cambridge

  9. Zhu X (2006) Semi-supervised learning literature survey. Technical Report 15304, University of Wisconsin, Madison

  10. Belkin M, Matveeva I, Niyogi P (2004) Regularization and semi-supervised learning on large graphs. In: COLT. Springer, Berlin, pp 624–638

  11. Grandvalet Y, Bengio Y (2005) Semi-supervised learning by entropy minimization. In: CAP, PUG, pp 281–296

  12. Belkin M, Niyogi P, Sindhwani V (2006) Manifold regularization: a geometric framework for learning from labeled and unlabeled examples. J Mach Learn Res 7:2399–2434

    MathSciNet  Google Scholar 

  13. Joachims T (2003) Transductive learning via spectral graph partitioning. In: ICML, pp 290–297

  14. Belkin M, Niyogi P (2002) Using manifold structure for partially labelled classification. In: NIPS, pp 953–960

  15. Zhu X, Ghahramani Z, Lafferty J (2003) Semi-supervised learning using gaussian fields and harmonic functions. In: ICML, pp 912–919

  16. Deng N, Tian Y, Zhang C (2011) Optimization based data mining: theory and applications. Springer Press, Berlin

  17. Tian Y, Yong S, Xiaohui L (2012) Recent advances on support vector machines research. Technol Econ Dev Econ 18(1): 5–33

  18. Mackey MC, Glass L (1977) Oscillation and chaos in physiological control systems. Science 197(4300):287–289

    Article  Google Scholar 

  19. Everingham M, Zisserman A, Williams CKI, Van Gool L (2006) The PASCAL visual object classes challenge 2006 (VOC 2006) results. http://www.pascal-network.org/challenges/VOC/voc2006/results.pdf

  20. Deng Y, Manjunath BS, Kenney C, Moore MS, Member S, Shin H (2001) An efficient color representation for image retrieval. IEEE Trans Image Process 10:140–147

    Article  Google Scholar 

Download references

Acknowledgments

This work has been partially supported by grants from National Natural Science Foundation of China (NO. 61472390, NO. 61402429, NO. 11271361, NO. 11201472, NO. 11331012), key project of National Natural Science Foundation of China (NO. 71331005), Major International (Regional) Joint Research Project (NO. 71110107026).

Author information

Authors and Affiliations

  1. Key Laboratory of Big Data Mining and Knowledge Management, Chinese Academy of Sciences, Beijing, 100190, China

    Zhiquan Qi, Yingjie Tian, Lingfeng Niu & Bo Wang

Authors
  1. Zhiquan Qi
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Yingjie Tian
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Lingfeng Niu
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Bo Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Yingjie Tian.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Qi, Z., Tian, Y., Niu, L. et al. Semi-supervised classification with privileged information. Int. J. Mach. Learn. & Cyber. 6, 667–676 (2015). https://doi.org/10.1007/s13042-015-0390-1

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s13042-015-0390-1

Keywords

Search

Navigation