Skip to main content

Dimension Reduction Algorithm of Big Data Based on Deep Neural Network

  • Conference paper
  • First Online:
Book cover Data Processing Techniques and Applications for Cyber-Physical Systems (DPTA 2019)

Part of the book series: Advances in Intelligent Systems and Computing ((AISC,volume 1088))

  • 70 Accesses

Abstract

Dimensionality reduction refers to mapping data from high-dimensional space to a low-dimensional space, which is the main method of high-dimensional data mining. The restricted Boltzmann machine, the basic structure module of deep learning, is introduced and analyzed. The high-dimensional data reduction model based on restricted Boltzmann machine is established. At the same time, the validity has been verified theoretically and experimentally. It makes the depth model as compact and simple as possible without losing the precision, and the calculation speed is improved. Experiment results show that the model identification is of high accuracy. In particular, the depth model built by RBM based on the adaptive adjustment of hidden layer node units not only has high recognition accuracy, but also greatly improves the computing speed and saves the storage space.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 259.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 329.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Chen, Jie, and Yousef Saad. 2009. Lanczos vectors versus singular vectors for effective dimension reduction. IEEE Transactions on Knowledge and Data Engineering 21 (8): 1091–1103.

    Article  Google Scholar 

  2. Mo, Dengyao, and Samuel H. Huang. 2012. Fractal-based intrinsic dimension estimation and its application in dimensionality reduction. IEEE Transactions on Knowledge and Data Engineering 24 (1): 59–71.

    Article  MathSciNet  Google Scholar 

  3. Zhao, Y., and S. Zhang. 2006. Generalized dimension-reduction framework for recent-biased time series analysis. IEEE Transactions on Knowledge and Data Engineering 18 (2): 231–244.

    Article  Google Scholar 

  4. Yan, Jun, Ning Liu, Shuicheng Yan, et al. 2011. Trace-oriented feature analysis for large-scale text data dimension reduction. IEEE Transactions on Knowledge and Data Engineering 23 (7): 1103–1117.

    Article  Google Scholar 

  5. Sedlmair, Michael, Tamara Munzner, and Melanie Tory. 2013. Empirical guidance on scatterplot and dimension reduction technique choices. IEEE Transactions on Visualization and Computer Graphics 19 (12): 2634–2643.

    Article  Google Scholar 

  6. Pellet, Victor, and Filipe Aires. 2018. Bottleneck channels algorithm for satellite data dimension reduction: A case study for IASI. IEEE Transactions on Geoscience and Remote Sensing 56 (10): 6069–6081.

    Article  Google Scholar 

  7. Farrell, M.D., and R.M. Mersereau. 2005. On the impact of PCA dimension reduction for hyperspectral detection of difficult targets. IEEE Geoscience and Remote Sensing Letters 2 (2): 192–195.

    Article  Google Scholar 

  8. Zhang, Rui, Du Tao, and Qu Shouning. 2018. A principal component analysis algorithm based on dimension reduction window. IEEE Access 6: 63737–63747.

    Article  Google Scholar 

  9. You, Wenjie, Zijiang Yang, Mingshun Yuan, et al. 2014. Totalpls: Local dimension reduction for multicategory microarray data. IEEE Transactions on Human-Machine Systems 44 (1): 125–138.

    Article  Google Scholar 

  10. Yang, Wanqi, Yinghuan Shi, Yang Gao, et al. 2018. Incomplete-data oriented multiview dimension reduction via sparse low-rank representation. IEEE Transactions on Neural Networks and Learning Systems 29 (12): 6276–6291.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Jianye Zhang .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Zhang, J., Shen, J., Wang, T., Liu, K., Li, J. (2020). Dimension Reduction Algorithm of Big Data Based on Deep Neural Network. In: Huang, C., Chan, YW., Yen, N. (eds) Data Processing Techniques and Applications for Cyber-Physical Systems (DPTA 2019). Advances in Intelligent Systems and Computing, vol 1088. Springer, Singapore. https://doi.org/10.1007/978-981-15-1468-5_149

Download citation

Publish with us

Policies and ethics