Loading [a11y]/accessibility-menu.js
Paradoxical Correlation Pattern Mining | IEEE Journals & Magazine | IEEE Xplore

Paradoxical Correlation Pattern Mining


Abstract:

Given a large transactional database, correlation computing/association analysis aims at efficiently finding strongly correlated items. For traditional association analys...Show More

Abstract:

Given a large transactional database, correlation computing/association analysis aims at efficiently finding strongly correlated items. For traditional association analysis, relationships among variables are usually measured at a global level. In this study, we investigate confounding factors that can help to capture abnormal correlation behaviors at a local level. Indeed, many real-world phenomena are localized to specific markets or subpopulations. Such local relationships may not be visible or may be miscalculated when collectively analyzing the entire data. In particular, confounding effects that change the direction of correlation are a most severe problem because the global correlations alone leads to errant conclusions. To this end, we propose CONFOUND, an efficient algorithm to identify paradoxical correlation patterns (i.e., where controlling for a third item changes the direction of association for strongly correlated pairs) using effective pruning strategies. Moreover, we also provide an enhanced version of this algorithm, called CONFOUND±, which substantially speeds up the confounder search step. Finally, experimental results showed that our proposed CONFOUND and CONFOUND± algorithms can effectively identify confounders and the computational performance is orders of magnitude faster than benchmark methods.
Published in: IEEE Transactions on Knowledge and Data Engineering ( Volume: 30, Issue: 8, 01 August 2018)
Page(s): 1561 - 1574
Date of Publication: 18 January 2018

ISSN Information:

Funding Agency:


Contact IEEE to Subscribe

References

References is not available for this document.