Skip to main content

An Elastic Data Processing Method Based on Data-Center-Platform

  • Conference paper
  • First Online:
Security and Privacy in Social Networks and Big Data (SocialSec 2020)

Part of the book series: Communications in Computer and Information Science ((CCIS,volume 1298))

  • 773 Accesses

Abstract

This paper analyzes the business value and application prospect of data-center-platform as a big data service platform. Based on the existing technology, it describes the organizational structure and data management process of data-center-platform, and studies the business interaction logic and construction elements of data-center-platform. The goal of data-center-platform is to build the center of data sharing in the whole domain, and to provide the services of data collection, data extraction, data service and provide a data intelligent platform for business applications. We analyze the problem of database synchronization in isolated networks faced by data-center-platform during data collection, and the existing database replication technology in detail, and design the process of maintaining data consistency in the same or different databases between different sites in a certain period of time. Finally, we take an equipment data integration system as an example to analyze the specific application of data-center-platform.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Tan, H.: Explain on ODPS of Ali. China Information Weekly (2019)

    Google Scholar 

  2. Zhang, J.: Design and realization of data center platform. Inf. Secur. Technol. 12, 46–49 (2011)

    Google Scholar 

  3. Bell, D.L., Cozzolino, D.L., Lee, M.L., Hagen, R.L.: System and method for database synchronization (1998)

    Google Scholar 

  4. He, T., Tang, X., Zhang, B., Cui, S. and Xie, G.: Study the way of the security database synchronization between physical isolated networks of Web-based metallurgy database. Comput. Appl. Chem. (2014)

    Google Scholar 

  5. Gai, J.: Data replication technique analysis and application in distributed database system. Comput. Appl. Softw. 22(7), 36–38 (2005)

    Google Scholar 

  6. Wang, Y., Rao, X., He, P.: Incremental database synchronization update mechanism under heterogeneous environment. Comput. Eng. Des. 32(3), 948–951 (2011)

    Google Scholar 

  7. Zhang, Y., Xia, K., Zhang, F.: Research and implementation of data synchronization for distributed heterogeneous database. J. Chin. Comput. Syst. (2007)

    Google Scholar 

  8. Wang, T., Chen, M., Zhao, H., Zhu, L.: Estimating a sparse reduction for general regression in high dimensions. Stat. Comput. 28(1), 33–46 (2016). https://doi.org/10.1007/s11222-016-9714-6

    Article  MathSciNet  MATH  Google Scholar 

  9. Koziel, S., Bekasiewicz, A.: Fast redesign and geometry scaling of multiband antennas using inverse surrogate modeling techniques. Stat. Comput. (2018)

    Google Scholar 

  10. Yu, Y., Silveira H., Sundaram, M.: A microservice based reference architecture model in the context of enterprise architecture. In: Advanced Information Management, Communicates, Electronic & Automation Control Conference, pp. 1856–1860 (2016)

    Google Scholar 

  11. Puripunpinyo, H., Samadzadeh, M.: Design, prototype implementation, and comparison of scalable web-push architectures on Amazon web services using the Actor model. In: International Conference on Systems Engineering, pp. 301–308 (2017)

    Google Scholar 

  12. Chintapalli, S., et al.: Benchmarking streaming computation engines: storm, flink and spark streaming. In: IEEE International Parallel & Distributed Processing Symposium Workshops, pp. 1789–1792 (2016)

    Google Scholar 

  13. Hou, Y., Xu, Q., Li, Y.: Monitoring system for mineral processing equipment based on IoT and industrial cloud computing. Comput. Integr. Manuf. Syst. 23(9), 1972–1982 (2017)

    Google Scholar 

  14. Wang, C.: A brief talk on the research and recommendations of internet enterprise data central platform architecture and security. Inf. Syst. Eng. (2019)

    Google Scholar 

  15. Wang, J., Xu, D., Wang, Y., Gao, S., Hu, Q., Ding, X.: The design for electric marketing service data middle-platform. In: Atiquzzaman, M., Yen, N., Xu, Z. (eds.) BDCPS 2019. AISC, vol. 1117, pp. 1752–1760. Springer, Singapore (2020). https://doi.org/10.1007/978-981-15-2568-1_247

    Chapter  Google Scholar 

Download references

Acknowledgments

This research is sponsored by State Grid Technology Project “Research and Application of Key Technologies in Enterprise-level Data Center Platform based on Full-Service Unified Data Center” under grants number 5211XT190033.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Yu Xiao .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Pan, Z. et al. (2020). An Elastic Data Processing Method Based on Data-Center-Platform. In: Xiang, Y., Liu, Z., Li, J. (eds) Security and Privacy in Social Networks and Big Data. SocialSec 2020. Communications in Computer and Information Science, vol 1298. Springer, Singapore. https://doi.org/10.1007/978-981-15-9031-3_6

Download citation

  • DOI: https://doi.org/10.1007/978-981-15-9031-3_6

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-15-9030-6

  • Online ISBN: 978-981-15-9031-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics