Skip to main content

A Strategy to Improve Accuracy of Multi-dimensional Feature Forecasting in Big Data Stream Computing Environments

  • Conference paper
  • First Online:
  • 1263 Accesses

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 10041))

Abstract

High accuracy of multi-dimensional feature forecasting is very important for online scheduling in big data stream computing environments. Currently, most stream computing systems only consider historical features, with future features ignored. In this paper, a strategy to improve accuracy of multi-dimensional feature forecasting for online data stream is proposed. It includes the following contributions. (1) Profiling principles of accurate future feature forecasting objectives from multi-dimensional big data streams. (2) Extracting future features from multi-dimensional historical features of data stream via an improved hybrid IGA-BP (Immune Genetic Algorithm and Back Propagation) algorithm. (3) Evaluating accuracy of future feature forecasting and acceptable latency objectives in big data stream computing environments. Experimental results conclusively demonstrate the efficiency and effectiveness of the proposed strategy.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  1. Demirkan, H., Delen, D.: Leveraging the capabilities of service-oriented decision support systems: putting analytics and big data in cloud. Decis. Support Syst. 55(1), 412–421 (2013)

    Article  Google Scholar 

  2. Tien, J.M.: Big data: unleashing information. J. Syst. Sci. Syst. Eng. 22(2), 127–151 (2013)

    Article  MathSciNet  Google Scholar 

  3. Zeng, X.Q., Li, G.Z.: Incremental partial least squares analysis of big streaming data. Pattern Recogn. 47(11), 3726–3735 (2014)

    Article  MathSciNet  Google Scholar 

  4. Peng, B., Hosseini, M., Hong, Z., Farivar, R., Campbell, R.: R-Storm: resource-aware scheduling in Storm. In: Proceedings of the 16th Annual Middleware Conference, Middleware 2015, pp. 149–161. ACM Press (2015)

    Google Scholar 

  5. Zeng, J., Liu, Z.Q., Cao, X.Q.: Fast online EM for big topic modeling. IEEE Trans. Knowl. Data Eng. 28(3), 675–688 (2016)

    Article  Google Scholar 

  6. Sheikhalishahi, M., Wallace, R.M., Grandinetti, L., Vazquez-Poletti, J.L., Guerriero, F.: A multi-dimensional job scheduling. Future Gener. Comput. Syst. 54, 123–131 (2016)

    Article  Google Scholar 

  7. Sun, D.W., Chang, G.R., Li, F.Y., Wang, C., Wang, X.W.: Optimizing multi-dimensional QoS cloud resource scheduling by immune clonal with preference. Acta Electronica Sinica 20(8), 1824–1831 (2011)

    Google Scholar 

  8. Yang, S.X., He, Z., Chen, Y.P.P.: Workload-based ordering of multi-dimensional data. IEEE Trans. Knowl. Data Eng. 28(3), 831–844 (2016)

    Article  MathSciNet  Google Scholar 

  9. Wang, L., Zeng, Y., Chen, T.: Back propagation neural network with adaptive differential evolution algorithm for time series forecasting. Expert Syst. Appl. 42(2), 855–863 (2015)

    Article  Google Scholar 

  10. Kim, J.S., Jung, S.: Implementation of the RBF neural chip with the back-propagation algorithm for on-line learning. Appl. Soft Comput. 29, 233–244 (2015)

    Article  Google Scholar 

  11. Lee, S., Choi, W.S.: A multi-industry bankruptcy prediction model using back-propagation neural network and multivariate discriminant analysis. Expert Syst. Appl. 40(8), 2941–2946 (2013)

    Article  MathSciNet  Google Scholar 

  12. Kuo, R.J., Lee, Y.H., Zulvia, F.E., Tien, F.C.: Solving bi-level linear programming problem through hybrid of immune genetic algorithm and particle swarm optimization algorithm. Appl. Math. Comput. 266, 1013–1026 (2015)

    MathSciNet  Google Scholar 

  13. Toshniwal, A., Taneja, S., Shukla, A., Ramasamy, K., Patel, J.M., Kulkarni, S., Jackson, J., Gade, K., Fu, M., Donham, J., Bhagat, N., Mittal, S., Ryaboy, D.: Storm@twitter. In: Proceedings of the 2014 ACM SIGMOD International Conference on Management of Data, pp. 147–156. ACM Press (2014)

    Google Scholar 

Download references

Acknowledgment

This work is supported by the National Natural Science Foundation of China under Grant No. 61602428; the Fundamental Research Funds for the Central Universities under Grant No. 2652015338 and No. N130316001.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Dawei Sun .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2016 Springer International Publishing AG

About this paper

Cite this paper

Sun, D., Tang, H., Gao, S., Li, F. (2016). A Strategy to Improve Accuracy of Multi-dimensional Feature Forecasting in Big Data Stream Computing Environments. In: Cellary, W., Mokbel, M., Wang, J., Wang, H., Zhou, R., Zhang, Y. (eds) Web Information Systems Engineering – WISE 2016. WISE 2016. Lecture Notes in Computer Science(), vol 10041. Springer, Cham. https://doi.org/10.1007/978-3-319-48740-3_30

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-48740-3_30

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-48739-7

  • Online ISBN: 978-3-319-48740-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics