Skip to main content
SpringerLink
Log in

Asymmetric ν-twin support vector regression

  • Original Article
  • Published:
Neural Computing and Applications Aims and scope Submit manuscript

Abstract

Twin support vector regression (TSVR) aims at finding 𝜖-insensitive up- and down-bound functions for the training points by solving a pair of smaller-sized quadratic programming problems (QPPs) rather than a single large one as in the conventional SVR. So TSVR works faster than SVR in theory. However, TSVR gives equal emphasis to the points above the up-bound and below the down-bound, which leads to the same influences on the regression function. In fact, points in different positions have different effects on the regressor. Inspired by it, we propose an asymmetric ν-twin support vector regression based on pinball loss function (Asy- ν-TSVR). The new algorithm can effectively control the fitting error by tuning the parameters ν and p. Therefore, it enhances the generalization ability. Moreover, we study the distribution of samples and give the upper bounds for the samples locating in different positions. Numerical experiments on one artificial dataset, eleven benchmark datasets and a real wheat dataset demonstrate the validity of our proposed algorithm.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4

Similar content being viewed by others

Notes

  1. http://archive.ics.uci.edu/ml/datasets.html

References

  1. Steinwart I, Christmann A (2008) Support vector machines. Springer, New York

    MATH  Google Scholar 

  2. Vapnik V (1995) The nature of statistical learning theory. Springer, New York

    Book  Google Scholar 

  3. Shawe-Taylor J, Cristianini N (2004) Kernel methods for pattern analysis. Cambridge University Press

  4. Cristianini N, Shawe-Taylor J (2000) An introduction to support vector machines and other kernel-based learning methods. Cambridge University Press

  5. Schölkopf B, Smola A, Williamson RC, Bartlett PL (2000) New support vector algorithms. Neural Comput 12:1207–1245

    Article  Google Scholar 

  6. Bi J, Bennett KP (2003) A geometric approach to support vector regression. Neurocomputing 55:79–108

    Article  Google Scholar 

  7. Peng XJ (2010) TSVR: an efficient twin support vector machine for regression. Neural Netw 23:365–372

    Article  Google Scholar 

  8. Peng XJ (2012) Efficient twin parametric insensitive support vector regression model. Neurocomputing 79:26–38

    Article  Google Scholar 

  9. Peng XJ, Xu D, Shen JD (2014) A twin projection support vector machine for data regression. Neurocomputing 138:131–141

    Article  Google Scholar 

  10. Santanu G, Mukherjee A, Dutta PK (2009) Nonparallel plane proximal classifier. Signal Process 89:510–522

    Article  Google Scholar 

  11. Jayadeva KR, Chandra S (2007) Khemchandani Twin support vector machines for pattern classification. IEEE Trans Pattern Anal Mach Intell 29:905–910

    Article  Google Scholar 

  12. Xu YT, Xi WW, Lv X (2012) An improved least squares twin support vector machine. J Info Comput Sci 9:1063–1071

    Google Scholar 

  13. Singh M, Chadha J, Ahuja P, Jayadeva S (2011) Chandra Reduced twin support vector regression. Neurocomputing 74:1474– 1477

    Article  Google Scholar 

  14. Zhao YP, Zhao J, Zhao M (2013) Twin least squares support vector regression. Neurocomputing 118:225–236

    Article  Google Scholar 

  15. Kumar MA, Gopal M (2009) Least squares twin support vector machines for pattern classification. Expert Syst Appl 36:7535–7543

    Article  Google Scholar 

  16. Tomar D, Agarwal S (2015) Twin Support Vector Machine: a review from 2007 to 2014. Egyptian Info J 16:55–69

    Article  Google Scholar 

  17. Huang XL, Shi L, Suykens JAK (2014) Support vector machine classifier with pinball loss. IEEE Trans Pattern Anal Mach Intell 36:984–997

    Article  Google Scholar 

  18. Huang XL, Shi L, Pelckmans K, Suykens JAK (2014) Asymmetric ν-tube support vector regression. Comput Stat Data Anal 77:371–382

    Article  MathSciNet  Google Scholar 

  19. Xu YT, Yang ZJ, Zhang YQ, Pan XL, Wang LS (2016) A maximum margin and minimum volume hyper-spheres machine with pinball loss for imbalanced data classification. Knowl-Based Syst 95:75–85

    Article  Google Scholar 

  20. Xu YT, Yang ZJ, Pan XL (2016) A novel twin support vector machine with pinball loss. IEEE Trans Neural Netw Learn Syst 28(2):359–370

    Article  MathSciNet  Google Scholar 

  21. Hao PY (2010) New support vector algorithms with parametric insensitive/margin model. Neural Netw 23:60–73

    Article  Google Scholar 

  22. Le Masne Q, Pothier H, Birge NO, Urbina C, Esteve D (2009) Asymmetric noise probed with a josephson junction. Phys Rev Lett 102:067002

    Article  Google Scholar 

  23. Yu K, Moyeed RA (2001) Bayesian quantile regression. Stat Prob Lett 54:437–447

    Article  MathSciNet  Google Scholar 

  24. Sengupta RN (2008) Use of asymmetric loss functions in sequential estimation problems for multiple linear regression. J Appl Stat 35:245–261

    Article  MathSciNet  Google Scholar 

  25. Xu YT, Guo R (2014) An improved ν-twin support vector machine. Appl Intell 41:42–54

    Article  Google Scholar 

  26. Xu YT, Wang L, Zhong P (2012) A rough margin-based ν-twin support vector machine. Neural Comput Applic 21:1307–1317

    Article  Google Scholar 

  27. Steinwart I, Christmann A (2011) Estimating conditional quantiles with the help of the pinball loss. Bernoulli 17:211–225

    Article  MathSciNet  Google Scholar 

  28. Suykens JAK, Tony VG, Jos DB et al (2002) Least squares support vector machines. World Scientific Pub Co, Singapore

    Book  Google Scholar 

  29. Xu YT (2012) A rough margin-based linear ν support vector regression. Stat Prob Lett 82:528–534

    Article  MathSciNet  Google Scholar 

  30. Xu YT, Wang LS (2012) A weighted twin support vector regression. Knowl-Based Syst 33:92–101

    Article  Google Scholar 

  31. Navia-Vzquez F, Prez-Cruz A, Arts-Rodrguezand A, Figueiras-Vidal R (2001) Weighted least squares training of support vectors classifiers which leads to compact and adaptive schemes. IEEE Trans Neural Netw 12 (5):1047–1059

    Article  Google Scholar 

  32. Prez-Cruz J, Herrmann DJL, Scholkopf B (2003) Weston Weston Extension of the nu-SVM range for classification. In: Prez-Cruz J, Herrmann DJL, Scholkopf B (eds) Advances in learning theory: methods, models and applications. IOS Press, pp 179–196

  33. Scholkopf B, Smola A, Bartlett P, Williamson R (2000) New support vector algorithms. Neural Comput 12(5):1207–1245

    Article  Google Scholar 

  34. Xu YT, Wang LS (2014) k-nearest neighbor-based weighted twin support vector regression. Appl Intell 41:299–309

    Article  Google Scholar 

  35. Gibbons JD, Chakraborti S (2011) Nonparametric statistical inference, 5th Ed. Chapman & Hall CRC Press, Taylor & Francis Group, Boca Raton

    MATH  Google Scholar 

  36. Dems̆ar J (2006) Statistical comparisons of classifiers over multiple data sets. J Mach Learn Res 7:1–30

    MathSciNet  Google Scholar 

  37. García S, Fernández A, Luengo J, Herrera F (2010) Advanced nonparametric tests for multiple comparisons in the design of experiments in computational intelligence and data mining. Experimental analysis of power. Info Sci 180:2044–2064

    Google Scholar 

Download references

Acknowledgments

The authors gratefully acknowledge the helpful comments and suggestions of the reviewers, which have improved the presentation. This work was supported in part by the National Natural Science Foundation of China (No. 11671010) and Natural Science Foundation of Beijing Municipality (No. 4172035).

Author information

Authors and Affiliations

  1. College of Science, China Agricultural University, Beijing, 100083, China

    Yitian Xu, Xianli Pan & Zhiji Yang

  2. Donlinks School of Economics and Management, University of Science and Technology Beijing, Beijing, 100083, China

    Xiaoyan Li

Authors
  1. Yitian Xu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Xiaoyan Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Xianli Pan
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Zhiji Yang
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Yitian Xu.

Ethics declarations

Conflict of interests

The authors declare that they have no conflict of interest.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Xu, Y., Li, X., Pan, X. et al. Asymmetric ν-twin support vector regression. Neural Comput & Applic 30, 3799–3814 (2018). https://doi.org/10.1007/s00521-017-2966-z

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00521-017-2966-z

Keywords

Search

Navigation