Loading [a11y]/accessibility-menu.js
Cascaded Two-Stage Feature Clustering and Selection via Separability and Consistency in Fuzzy Decision Systems | IEEE Journals & Magazine | IEEE Xplore

Cascaded Two-Stage Feature Clustering and Selection via Separability and Consistency in Fuzzy Decision Systems


Abstract:

Feature selection is a vital technique in machine learning, as it can reduce computational complexity, improve model performance, and mitigate the risk of overfitting. Ho...Show More

Abstract:

Feature selection is a vital technique in machine learning, as it can reduce computational complexity, improve model performance, and mitigate the risk of overfitting. However, the increasing complexity and dimensionality of datasets pose significant challenges in the selection of features. Focusing on these challenges, this article proposes a cascaded two-stage feature clustering and selection algorithm for fuzzy decision systems. In the first stage, we reduce the search space by clustering relevant features and addressing interfeature redundancy. In the second stage, a clustering-based sequentially forward selection method that explores the global and local structure of data is presented. We propose a novel metric for assessing the significance of features, which considers both global separability and local consistency. Global separability measures the degree of intraclass cohesion and interclass separation based on fuzzy membership, providing a comprehensive understanding of data separability. Meanwhile, local consistency leverages the fuzzy neighborhood rough set (FNRS) model to capture uncertainty and fuzziness in the data. The effectiveness of our proposed algorithm is evaluated through experiments conducted on 18 public datasets and a real-world schizophrenia dataset. The experiment results demonstrate our algorithm's superiority over benchmarking algorithms in both classification accuracy and the number of selected features.
Published in: IEEE Transactions on Fuzzy Systems ( Volume: 32, Issue: 9, September 2024)
Page(s): 5320 - 5333
Date of Publication: 01 July 2024

ISSN Information:

Funding Agency:


Contact IEEE to Subscribe

References

References is not available for this document.