Loading [a11y]/accessibility-menu.js
Redundancy Avoidance for Big Data in Data Centers: A Conventional Neural Network Approach | IEEE Journals & Magazine | IEEE Xplore

Redundancy Avoidance for Big Data in Data Centers: A Conventional Neural Network Approach


Abstract:

As the innovative data collection technologies are applying to every aspect of our society, the data volume is skyrocketing. Such phenomenon poses tremendous challenges t...Show More

Abstract:

As the innovative data collection technologies are applying to every aspect of our society, the data volume is skyrocketing. Such phenomenon poses tremendous challenges to data centers with respect to enabling storage. In this paper, a hybrid-stream big data analytics model is proposed to perform multimedia big data analysis. This model contains four procedures, i.e., data pre-processing, data classification, data recognition and data load reduction. Specifically, an innovative multi-dimensional Convolution Neural Network (CNN) is proposed to assess the importance of each video frame. Thus, those unimportant frames can be dropped by a reliable decision-making algorithm. In order to ensure video quality, minimal correlation and minimal redundancy (MCMR) are combined to optimize the decision-making algorithm. Simulation results show that the amount of processed video is significantly reduced, and the quality of video is preserved due to the addition of MCMR. The simulation also proves that the proposed model performs steadily and is robust enough to scale up to accommodate the big data crush in data centers.
Published in: IEEE Transactions on Network Science and Engineering ( Volume: 7, Issue: 1, 01 Jan.-March 2020)
Page(s): 104 - 114
Date of Publication: 04 June 2018

ISSN Information:

Funding Agency:


Contact IEEE to Subscribe

References

References is not available for this document.