Skip to main content
SpringerLink
Log in

If-SVM: Iterative factoring support vector machine

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Support Vector Machine (SVM) is widely applied in classification and regression tasks where support vectors are pursued through convex quadratic programming technique due to its effectiveness and efficiency. However, existing studies ignore the importance of training samples when they are fed into the model. In this paper, we propose a novel Iterative Factoring Support Vector Machine (If-SVM) method. Sample factoring is introduced in our proposed model to measure the significance of each data point, where it can effectively reduce the negative impact of trivial or noisy data points. In this way, our proposed model is concentrates on the critical data points falling around the hyperplane. By introducing this iterative factoring of data points into SVM, the classification accuracy of our proposed method is above that of 1.45% than other comparative methods in image recognition datasets. Experimental results on a variety of UCI demonstrate that, our proposed method has superior performances in decreasing the total number of support vectors than the other state-of-the-art SVM methods. More importantly, our further experiments also illustrate that, the classification performance of the state-of-the-art SVM methods can be improved 1.29% by incorporating our sample factoring idea into their models, which demonstrate our idea is a useful tool to improve the state-of-art SVM models.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13

Similar content being viewed by others

References

  1. Amorim RCD, Mirkin B (2012) Minkowski metric, feature weighting and anomalous cluster initializing in k-means clustering. Pattern Recogn 45 (3):1061–1075

    Article  Google Scholar 

  2. Apasiba Abeo T, Shen XJ, Bao BK, Zha ZJ, Fan J (2019) A generalized multi-dictionary least squares framework regularized with multi-graph embeddings. Pattern Recognit 90:1–11

    Article  Google Scholar 

  3. Chaki J, Dey N, Shi F, Sherratt RS (2019) Pattern mining approaches used in sensor-based biometric recognition: a review. IEEE Sens J PP(99):1–1

    Google Scholar 

  4. Cortes C, Vapnik V (1995) Support-vector networks. Mach Learn 20(3):273–297

    MATH  Google Scholar 

  5. Cui C, Asari VK (2013) Adaptive weighted local textural features for illumination, expression, and occlusion invariant face recognition. In: Imaging& multimedia analytics in a web& mobile world

  6. Cui W, Yan X (2009) Adaptive weighted least square support vector machine regression integrated with outlier detection and its application in qsar. Chemom Intell Lab Syst 98(2):130–135

    Article  Google Scholar 

  7. Do H, Kalousis A, Hilario M (2009) Feature weighting using margin and radius based error bound optimization in svms. In: European conference on machine learning& knowledge discovery in databases

  8. Fan Y, Tian F, Qin T, Bian J, Liu TY (2017) Learning what data to learn

  9. Gao H, Zhuang L, Maaten LVD, Weinberger KQ (2017) Densely connected convolutional networks. In: IEEE Conference on computer vision& pattern recognition

  10. Han X, Jinjun W, Ziku W, Guofeng L, Yan W, Juan L (2018) Learning solutions to two dimensional electromagnetic equations using ls-svm. Neurocomputing pp S0925231218305,873–

  11. Hu WJ, Song Q (2003) An accelerated decomposition algorithm for robust support vector machines. Circuits Syst II Exp Briefs IEEE Trans 51(5):234–240

    Article  Google Scholar 

  12. Kwak N, Choi CH (2002) Input feature selection by mutual information based on parzen window. IEEE T Pattern Anal 24(12):1667–1671

    Article  Google Scholar 

  13. Lin CF, de Wang S (2004) Training algorithms for fuzzy support vector machines with noisy data. Pattern Recogn Lett 25(14):1647–1656

    Article  Google Scholar 

  14. Lin CF, Wang SD (2002) Fuzzy support vector machines. IEEE T Neural Networ 13(2):464–471

    Article  Google Scholar 

  15. Liu Y, Wen K, Gao Q, Gao X, Nie F (2018) Svm based multi-label learning with missing labels for image annotation. Pattern Recognition 78, S0031320318300, 372

  16. Min H, Li K, Wang X, Ren F (2015) Facial expression recognition based on histogram weighted hcbp. Journal of Electronic Measurement & Instrumentation

  17. Phan AV, Nguyen ML, Bui LT (2016) Feature weighting and svm parameters optimization based on genetic algorithms for classification problems. Appl Intell 46(2):1–15

    Google Scholar 

  18. Principe JC (2010) Information theoretic learning renyi<−s entropy and kernel perspectives

  19. Ren M, Zeng W, Yang B, Urtasun R (2018) Learning to reweight examples for robust deep learning

  20. Shen XJ, Dong Y, Gou JP, Zhan YZ, Fan J (2018) Least squares kernel ensemble regression in reproducing kernel hilbert space

  21. Shivaswamy PK, Jebara T (2010) Maximum relative margin and data-dependent regularization. J Mach Learn Res 11(1):747–788

    MathSciNet  MATH  Google Scholar 

  22. Shuang C, Partridge D (2004) Feature ranking and best feature subset using mutual information. Neural Comput Appl 13(3):175–184

    Article  Google Scholar 

  23. Song Q, Hu W, Xie W (2002) Robust support vector machine with bullet hole image classification. IEEE Trans Syst Man Cybern 32(4):440–448

    Article  Google Scholar 

  24. Torkkola K (2003) Feature extraction by non-parametric mutual information maximization. J Mach Learn Res 3(3):1415–1438

    MathSciNet  MATH  Google Scholar 

  25. Wang M, Yang J, Liu GP, Xu ZJ, Chou KC (2004) Weighted-support vector machines for predicting membrane protein types based on pseudo-amino acid composition. Protein Eng Des Sel 17(6):509–516

    Article  Google Scholar 

  26. Wu J, Yang H (2017) Linear regression-based efficient svm learning for large-scale classification. IEEE T Neur Net Learn 26(10):2357–2369

    Article  MathSciNet  Google Scholar 

  27. Wu X, Zuo W, Lin L, Jia W, Zhang D (2018) F-svm: Combination of feature transformation and svm learning via convex relaxation. IEEE T Neur Net Lear PP(99):1–15

    Google Scholar 

  28. Xing HJ, Ha MH, Tian DZ, Hu BG (2008) A novel support vector machine with its features weighted by mutual information. In: IEEE International joint conference on neural networks

  29. Yang X, Song Q, Cao A (2007) Weighted support vector machine for data classification. In: IEEE International joint conference on neural networks

  30. Yu H, He F, Pan Y (2019) A scalable region-based level set method using adaptive bilateral filter for noisy image segmentation. Multimedia Tools Applications 79(10)

  31. Yu J, Hong C, Rui Y, Tao D (2017) Multi-task autoencoder model for recovering human poses. IEEE T Ind Electron PP(99):1–1

    Google Scholar 

  32. Zhang J, He F, Chen Y (2019) A new haze removal approach for sky/river alike scenes based on external and internal clues. Multimedia Tools and Applications (20)

  33. Zhang Q, Dong L, Fan Z, Ying L, Li Z (2011) Feature and sample weighted support vector machine

  34. Zhang S, He F (2019) Drcdn: learning deep residual convolutional dehazing networks. Vis Comput, pp 1–12

  35. Zhang X (1999) Using class-center vectors to build support vector machines. In: Neural networks for signal processing ix, IEEE signal processing society workshop

Download references

Acknowledgements

This work was funded in part by the National Natural Science Foundation of China (No.61572240, 61701200).

Author information

Authors and Affiliations

  1. School of Computer Science and Communication Engineering, JiangSu University, JiangSu, 212013, China

    Yuqing Pan, Wenpeng Zhai, Wei Gao & Xiangjun Shen

Authors
  1. Yuqing Pan
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Wenpeng Zhai
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Wei Gao
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Xiangjun Shen
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Xiangjun Shen.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Pan, Y., Zhai, W., Gao, W. et al. If-SVM: Iterative factoring support vector machine. Multimed Tools Appl 79, 25441–25461 (2020). https://doi.org/10.1007/s11042-020-09179-9

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-020-09179-9

Keywords

Search

Navigation