Skip to main content
SpringerLink
Log in

Research on abnormal data mining algorithm based on ICA

  • Published:
Cluster Computing Aims and scope Submit manuscript

Abstract

The research of abnormal data mining is very important for ensuring the reliable operation of data mining. The algorithm currently used in data mining of anomaly mining is only a kind of measuring error time or spatial correlation. Considering the shortcomings of the existing outlier data mining algorithms and the temporal and spatial correlation of the error matrix, an abnormal data mining algorithm based on ICA is proposed. In this algorithm, the ability of reducing the dimension of BSA and the multi-scale modeling ability of wavelet transform are used to construct the algorithm of abnormal data mining. In the analysis of residual anomaly data, it is realized mainly by EWMA and Shewart control chart. And the sliding window mechanism is applied to realize the online expansion of outlier data mining algorithm, and online ICA outlier data mining algorithm is obtained. By analyzing the outlier data and the simulation results, we can conclude that compared with the BSA algorithm and the KLE algorithm, the ICA algorithm has more outstanding advantages and better detection performance.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6

Similar content being viewed by others

References

  1. Berka, P.: Knowledge discovery in databases and data mining. Am. Sci. 7(4), 197–198 (2015)

    Google Scholar 

  2. Santos, I., Brezo, F., Ugarte-Pedrero, X., Bringas, P.G.: Opcode sequences as representation of executables for data-mining-based unknown malware detection. Inf. Sci. 231(9), 64–82 (2013)

    Article  MathSciNet  Google Scholar 

  3. Lausch, A., Schmidt, A., Tischendorf, L.: Data mining and linked open data—new perspectives for data analysis in environmental research. Ecol. Model. 295, 5–17 (2015)

    Article  Google Scholar 

  4. Schneider, A.: Monitoring land cover change in urban and peri-urban areas using dense time stacks of landsat satellite data and a data mining approach. Remote Sens. Environ. 124, 689–704 (2012)

    Article  Google Scholar 

  5. Karimi, S., Wang, C., Metke-Jimenez, A., Gaire, R., Paris, C.: Text and data mining techniques in adverse drug reaction detection. ACM Comput. Surv. 47(4), 1–39 (2015)

    Article  Google Scholar 

  6. Vieira, M.A., Formaggio, A.R., Rennó, C.D., Atzberger, C., Aguiar, D.A., Mello, M.P.: Object based image analysis and data mining applied to a remotely sensed landsat time-series to map sugarcane over large areas. Remote Sens. Environ. 123(8), 553–562 (2012)

    Article  Google Scholar 

  7. Astolfi, D., Castellani, F., Garinei, A., Terzi, L.: Data mining techniques for performance analysis of onshore wind farms. Appl. Energy 148, 220–233 (2015)

    Article  Google Scholar 

  8. Mooney, B.L., Corrales, L.R., Clark, A.E.: Molecularnetworks: an integrated graph theoretic and data mining tool to explore solvent organization in molecular simulation. J. Comput. Chem. 33(8), 853–860 (2012)

    Article  Google Scholar 

  9. Ferreira, J.C., Almeida, J.D., Silva, A.R.D.: The impact of driving styles on fuel consumption: a data-warehouse-and-data-mining-based discovery process. IEEE Trans. Intell. Transp. Syst. 16(5), 2653–2662 (2015)

    Article  Google Scholar 

  10. Pruim, R.H., Mennes, M., Van, R.D., Llera, A., Buitelaar, J.K., Beckmann, C.F.: Ica-aroma: a robust ica-based strategy for removing motion artifacts from fmri data. Neuroimage 112, 267–277 (2015)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. School of Mathematics and Computer Science, Panzhihua University, Panzhihua, 617000, Sichuan, China

    Jiangke Cheng

  2. College of Information Technology, Guangdong Industry Polytechnic, Guangzhou, 510300, China

    Xiaodong Mai

  3. School of Biological and Chemical Engineering, Panzhihua University, Panzhihua, 617000, Sichuan, China

    Shengnan Wang

Authors
  1. Jiangke Cheng
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Xiaodong Mai
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Shengnan Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Xiaodong Mai.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Cheng, J., Mai, X. & Wang, S. Research on abnormal data mining algorithm based on ICA. Cluster Comput 22 (Suppl 2), 3613–3619 (2019). https://doi.org/10.1007/s10586-018-2211-2

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10586-018-2211-2

Keywords

Search

Navigation