Skip to main content
SpringerLink
Log in

Safe semi supervised multi-target regression (MTR-SAFER) for new targets learning

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Multi-target regression (MTR) is a challenging research problem which aims to predict more than one continuous variable as output in a pattern. In recent time, a number of novel applications have increased interest and research in this area. Applications include predicting brain activity from multimedia sensors, different values for stocks from continuous web data, condition of various attributes of the vegetation at a given site, etc. In contrast to conventional regression problems where each instance only belongs to single target from a set of disjoint targets, in multi-target regression, each instance may belong to more than one continuous variable as output. Multi-target regression problems are concerned with problems where there are more than one continuous variables to output. These output variables may or may not be related. A number of approaches have been proposed for this problem. However, for a dynamic multi-target learning system, a pre-trained multi-target system shall be revised as new targets emerge with very few instances. The objective of this paper is to investigate semi-supervised techniques on multi-target regression problems to predict new target using very limited amount of examples. Experiments are then conducted on real world multi-target regression (MTR) data sets. The proposed methodology is then compared with state of the art MTR methods. Promising results are obtained using proposed safe semi-supervised regressor with binary relevance.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6

Similar content being viewed by others

Notes

  1. http://mulan.sourceforge.net/datasets-mtr.html

  2. http://lamda.nju.edu.cn/code_SAFER.ashx

  3. http://mulan.sourceforge.net/

References

  1. Aho T, ženko B, Džeroski S, Elomaa T (2012) Multi-target regression with rule ensembles. J Mach Learn Res 13(1):2367–2407

    MathSciNet  MATH  Google Scholar 

  2. Bishop CM (2006) Pattern recognition and machine learning springer

  3. Borchani H, Varando G, Bielza C, Larrañaga P (2015) A survey on multi-output regression. Wiley Interdisciplinary Reviews: Data Mining and Knowledge Discovery 5(5):216–233

    Google Scholar 

  4. Chapelle O, Schlkopf B, Zien A (2010) Semi-supervised learning, 1st edn. The MIT Press

  5. Goovaerts P (1997) Geostatistics for natural resources evaluation. Oxford University Press, Oxford

    Google Scholar 

  6. Guo Y, Ding G, Jin X, Wang J (2016) Transductive zero-shot recognition via shared model space learning. In: AAAI, vol 3, p 8

  7. Guo Y, Ding G, Han J, Gao Y (2017) Zero-shot learning with transferred samples. IEEE Trans Image Process 26(7):3277–3290

    Article  MathSciNet  Google Scholar 

  8. Guo Y, Ding G, Han J, Gao Y (2017) Zero-shot recognition via direct classifier learning with transferred samples and pseudo labels. In: AAAI, pp 4061–4067

  9. Guo Y, Ding G, Han J, Gao Y (2017) Synthesizing samples fro zero-shot learning. IJCAI

  10. Guo S, Tan G, Pan H, Chen L, Gao C (2017) Face alignment under occlusion based on local and global feature regression. Multimedia Tools and Applications 76 (6):8677–8694

    Article  Google Scholar 

  11. Hatzikos EV, Tsoumakas G, Tzanis G, Bassiliades N, Vlahavas I (2008) An empirical study on sea water quality prediction. Knowl-Based Syst 21(6):471–478

    Article  Google Scholar 

  12. Kaggle (2012) Kaggle competition: Online product sales. https://www.kaggle.com/c/online-sales

  13. Karalič A, Bratko I (1997) First order regression. Mach Learn 26(2):147–176

    Article  Google Scholar 

  14. Kira K, Rendell LA (1992) The feature selection problem: Traditional methods and a new algorithm. In: AAAI, vol 2, pp 129–134

  15. Kocev D, Džeroski S, White MD, Newell GR, Griffioen P (2009) Using single- and multi-target regression trees and ensembles to model a compound index of vegetation condition. Ecol Model 220(8):1159–1168

    Article  Google Scholar 

  16. Lewis FI, Ward MP (2013) Improving epidemiologic data analyses through multivariate regression modelling. Emerging Themes in Epidemiology 10(1):4

    Article  Google Scholar 

  17. Li YF, Zha HW, Zhou ZH (2017) Learning safe prediction for semi-supervised regression. In: AAAI conference on artificial intelligence

  18. Lucian B, Ganea AM, Cîrciumaru LD, et al. (2010) Using linear regression in the analysis of financial-economic performances. Annals of University of Craiova-Economic Sciences Series 2(38):32–43

  19. Pan SJ, Yang Q (2010) A survey on transfer learning. IEEE Trans Knowl Data Eng 22(10):1345–1359

    Article  Google Scholar 

  20. Popek S (2003) Application of regression analysis as a method to determine total ash content in some selected nectar honeys. Food Nahrung 47(1):36–38

    Article  Google Scholar 

  21. Schneider A, Hommel G, Blettner M (2010) Linear regression analysis. Dtsch Ä, Rztebl Int 107(44):776–82

    Google Scholar 

  22. Shaikh MK, Lawgaly A, Tahir MA, Bouridane A (2017) Modality identification for heterogeneous face recognition. Multimedia Tools and Applications 76 (3):4635–4650

    Article  Google Scholar 

  23. Shi Y, Lan Z, Liu W, Bi W (2009) Extending semi-supervised learning methods for inductive transfer learning. In: 2009 Ninth IEEE international conference on data mining, pp 483–492. https://doi.org/10.1109/ICDM.2009.75

  24. SpolaôR N, Cherman EA, Monard MC, Lee HD (2013) A comparison of multi-label feature selection methods using the problem transformation approach. Electron Notes Theor Comput Sci 292:135–151

    Article  Google Scholar 

  25. Spyromitros-Xioufis E, Tsoumakas G, Groves W, Vlahavas I (2016) Multi-target regression via input space expansion: treating targets as inputs. Mach Learn 104(1):55–98

    Article  MathSciNet  Google Scholar 

  26. Sun Y, Wen G (2017) Ensemble softmax regression model for speech emotion recognition. Multimedia Tools and Applications 76(6):8305–8328

    Article  Google Scholar 

  27. Tsanas A, Xifara A (2012) Accurate quantitative estimation of energy performance of residential buildings using statistical machine learning tools. Energ Buildings 49 (Supplement C):560–567

    Article  Google Scholar 

  28. Tsoumakas G, Spyromitros-Xioufis E, Vrekou A, Vlahavas I (2014) Multi-target regression via random linear target combinations. In: Joint european conference on machine learning and knowledge discovery in databases, Springer, pp 225–240

  29. Wen Z, Li Y (2016) A spatial-constrained multi-target regression model for human brain activity prediction. In: Applied informatics, vol 3. Springer, Berlin, p 10

  30. Xu S, An X, Qiao X, Zhu L, Li L (2013) Multi-output least-squares support vector regression machines. Pattern Recogn Lett 34(9):1078–1084

    Article  Google Scholar 

  31. Yarowsky D (1995) Unsupervised word sense disambiguation rivaling supervised methods. In: Proceedings of the 33rd annual meeting on association for computational linguistics. association for computational linguistics

  32. Yeh IC (2007) Modeling slump flow of concrete using second-order regressions and artificial neural networks. Cem Concr Compos 29(6):474–480

    Article  Google Scholar 

  33. Zhou ZH (2012) Ensemble methods: foundations and algorithms. Chapman and Hall/CRC

  34. Zhou ZH (2016) Learnware: on the future of machine learning. Front Comput Sci 10(4):589–590. https://doi.org/10.1007/s11704-016-6906-3

    Article  Google Scholar 

  35. Zhu X, Goldberg AB, Brachman R, Dietterich T (2009) Introduction to Semi-Supervised learning. Morgan and Claypool Publishers, San Francisco

    Google Scholar 

  36. Zhu Y, Ting KM, Zhou ZH (2016) Multi-label learning with emerging new labels. In: 16Th IEEE international conference on data mining (ICDM’16), pp 1371–1376

Download references

Author information

Authors and Affiliations

  1. Data Science Research Group, Department of Computer Science, National University of Computer and Emerging Sciences, Karachi Campus, Karachi, Pakistan

    Farrukh Hasan Syed & Muhammad Atif Tahir

Authors
  1. Farrukh Hasan Syed
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Muhammad Atif Tahir
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Farrukh Hasan Syed.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Syed, F.H., Tahir, M.A. Safe semi supervised multi-target regression (MTR-SAFER) for new targets learning. Multimed Tools Appl 77, 29971–29987 (2018). https://doi.org/10.1007/s11042-018-6367-9

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-018-6367-9

Keywords

Search

Navigation