Skip to main content
SpringerLink
Log in

Structured sparse multi-view feature selection based on weighted hinge loss

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

In applications, using features obtained from multiple views to describe objects has become popular because multiple views contain much more information than the single view. As the dimensions of the data sets are high, which may cause expensive time consumption and memory space, how to identify the representative views and features becomes a crucial problem. Multi-view feature selection that can integrate multiple views to select important and relevant features to improve performance has attracted more and more attentions in recent years. Previous supervised multi-view feature selection methods usually establish the models by concatenating multiple views into long vectors. However, this concatenation is not physically meaningful and implies that different views play the similar roles for specific tasks. In this paper, we propose a novel supervised multi-view feature selection method based on the weighted hinge loss (WHMVFS) that can learn the corresponding weight for each view and implement sparsity from the group and individual point of views under the structured sparsity framework. The newly proposed multi-view weighted hinge loss penalty not only has the ability to select more discriminative features for classification, but also can make the involved optimization problem be decomposed into several small scale subproblems, which can be easily solved by an iterative algorithm, and the convergence of the iterative algorithm is also proved. Experimental results conducted on real-world data sets show the effectiveness of the proposed method.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

Notes

  1. http://lms.comp.nus.edu.sg/research/NUS-WIDE.htm

  2. http://archive.ics.uci.edu/ml/datasets/Multiple+Features

References

  1. Cai X, Nie F, Huang H (2013) Multi-view K-means clustering on big data. In: International joint conference on artificial intelligence. AAAI Press, pp 2598–2604

  2. Chang X, Nie F, Yang Y, Huang H (2014) A convex formulation for semi-supervised multi-label feature selection. In: Twenty-Eighth AAAI conference on artificial intelligence. AAAI Press, pp 1171–1177

  3. Chen J, Zhou J, Ye J (2011) Integrating low-rank and group-sparse structures for robust multi-task learning. In: ACM SIGKDD International conference on knowledge discovery and data mining, pp 42–50

  4. Cheng X, Zhu Y, Song J, Wen G, He W (2017) A novel low-rank hypergraph feature selection for multi-view classification. Neurocomputing 253:115–121

    Article  Google Scholar 

  5. Chua T, Tang J, Hong R, Li H, Luo Z, Zheng Y (2009) NUS-WIDE: a real-world web image database from National University of Singapore. In: ACM International conference on image and video retrieva. ACM, p 48

  6. Gui J, Tao D, Sun Z, Luo Y, You X, Tang Y (2014) Group sparse multiview patch alignment framework with view consistency for image classification. IEEE Trans Image Process Publ IEEE Signal Process Soc 23(7):3126–3137

    MathSciNet  MATH  Google Scholar 

  7. Gui J, Sun Z, Ji S, Tao D, Tan T (2016) Feature selection based on structured sparsity: a comprehensive study. IEEE Trans Neural Netw Learn Syst 28 (7):1490–1507

    Article  MathSciNet  Google Scholar 

  8. Jebara T (2011) Multi-task sparsity via maximum entropy discrimination. J Mach Learn Res 12:75– 110

    MathSciNet  MATH  Google Scholar 

  9. Li X, Chen M, Nie F, Wang Q (2017) A multiview-based parameter free framework for group detection. In: Proceedings of the thirty-first AAAI conference on artificial intelligence, pp 4147–4153

  10. Lichman M (2013) UCI machine learning repository [http://archive.ics.uci.edu/ml], Irvine, CA: University of California School of Information and Computer Science

  11. Liu J, Ji S, Ye J (2012) Multi-task feature learning via efficient l 2,1-norm minimization. In: Conference on uncertainty in artificial intelligence. AUAI Press, pp 339–348

  12. Nie F, Huang H, Cai X, Ding C (2010) Efficient and robust feature selection via joint L 2,1-norms minimization. In: International conference on neural information processing systems. Curran Associates Inc, pp 1813–1821

  13. Tibshirani R (2011) Regression shrinkage and selection via the lasso. J R Stat Soc 73(3):273–282

    Article  MathSciNet  MATH  Google Scholar 

  14. Tibshirani R, Saunders M, Rosset S, Zhu J, Knight K (2010) Sparsity and smoothness via the fused lasso. J R Stat Soc 67(1):91–108

    Article  MathSciNet  MATH  Google Scholar 

  15. Wang H, Nie F, Huang H, Risacher S (2011) Sparse Multi-task regression and feature selection to identify brain imaging predictors for memory performance. In: International conference on computer vision. IEEE Computer Society, pp 557–562

  16. Wang H, Nie F, Huang H, Risacher SL, Saykin AJ, Shen L (2012) Identifying disease sensitive and quantitative trait-relevant biomarkers from multidimensional heterogeneous imaging genetics data via sparse multimodal multitask learning. Bioinformatics 28(12):i127–i136

    Article  Google Scholar 

  17. Wang H, Nie F, Huang H (2013) Multi-view clustering and feature learning via structured sparsity. In: International conference on machine learning, pp 352–360

  18. Wang H, Nie F, Huang H, Ding C (2013) Heterogeneous visual features fusion via sparse multimodal machine. In: IEEE Conference on computer vision and pattern recognition. IEEE Computer Society, pp 3097–3102

  19. Wang X, Zhang X, Zeng Z, Wu Q, Zhang J (2016) Unsupervised spectral feature selection with l 1-norm graph. Neurocomputing 200:47–54

    Article  Google Scholar 

  20. Wang X, Chen R, Hong C, Zeng Z, Zhou Z (2017) Semi-supervised multi-label feature selection via label correlation analysis with l 1-norm graph embedding. Image Vis Comput 63:10–23

    Article  Google Scholar 

  21. Wang Q, Zhang F, Li X (2018) Optimal clustering framework for hyperspectral band selection. IEEE Trans Geosci Remote Sens 56(10):5910–5922

    Article  Google Scholar 

  22. Wang Q, Qin Z, Nie F, Li X Spectral embedded adaptive neighbors clustering. IEEE Transactions on Neural Networks and Learning Systems, https://doi.org/10.1109/TNNLS.2018.2861209

  23. Xiao L, Sun Z, He R, Tan T (2013) Coupled feature selection for cross-sensor iris recognition. In: IEEE Sixth international conference on biometrics: theory, applications and systems. IEEE, pp 1–6

  24. Xiao L, Sun Z, He R, Tan T (2014) Margin based feature selection for cross-sensor iris recognition via linear programming. Pattern Recognition. IEEE, pp 246–250

  25. Xu Y, Wang C, Lai J (2016) Weighted multi-view clustering with feature selection. Pattern Recogn 53:25–35

    Article  Google Scholar 

  26. Xu J, Han J, Nie F, Li X (2017) Re-weighted discriminatively embedded K-means for multi-view clustering. IEEE Trans Image Process 26(6):3016–3027

    Article  MathSciNet  MATH  Google Scholar 

  27. Yang Y, Ma Z, Hauptmann AG, Sebe N (2013) Feature selection for multimedia analysis by sharing information among multiple tasks. IEEE Trans Multimed 15(3):661–669

    Article  Google Scholar 

  28. Yang Z, Wang H, Han Y, Zhu X (2017) Discriminative multi-task multi-view feature selection and fusion for multimedia analysis. Multimed Tools Appl 1:1–23

    Google Scholar 

  29. Ye J, Zhao Z, Wu M (2007) Discriminative K-means for clustering. In: International conference on neural information processing systems. Curran Associates Inc, pp 1649–1656

  30. Yuan M, Lin Y (2006) Model selection and estimation in regression with grouped variables. J R Stat Soc 68(1):49–67

    Article  MathSciNet  MATH  Google Scholar 

  31. Zhang M, Yang Y, Shen F, Zhang H, Wang Y (2017) Multi-view feature selection and classification for Alzheimers Disease diagnosis. Multimed Tools Appl 76 (8):10761–10775

    Article  Google Scholar 

  32. Zou H (2006) The adaptive lasso and its oracle properties. Publ Am Stat Assoc 101(476):1418–1429

    Article  MathSciNet  MATH  Google Scholar 

Download references

Acknowledgments

The work is supported by the National Natural Science Foundation of China (Grant No. 61872368, U1536121,11171346). We thank Jing Zhong for her assistance of collecting data during the preparation of the revision. We also gratefully acknowledge the helpful comments and suggestions of the reviewers, which have improved the presentation.

Author information

Authors and Affiliations

  1. College of Science, China Agricultural University, Beijing, 100083, China

    Nan Wang, Qiang Lin & Ping Zhong

  2. College of Information and Electrical Engineering, China Agricultural University, Beijing, 100083, China

    Yiming Xue

Authors
  1. Nan Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Yiming Xue
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Qiang Lin
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Ping Zhong
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Ping Zhong.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Wang, N., Xue, Y., Lin, Q. et al. Structured sparse multi-view feature selection based on weighted hinge loss. Multimed Tools Appl 78, 15455–15481 (2019). https://doi.org/10.1007/s11042-018-6937-x

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-018-6937-x

Keywords

Search

Navigation