Skip to main content
Springer Nature Link
Log in

Implementing MapReduce with MSVL

  • Conference paper
  • First Online:
Structured Object-Oriented Formal Language and Method (SOFL+MSVL 2017)

Part of the book series: Lecture Notes in Computer Science ((LNTCS,volume 10795))

Abstract

This paper presents an approach to implementing MapReduce processes with Modeling Simulation and Verification Language (MSVL). This facilitates programmers not only to deal with large data sets but also to verify properties of programs in a convenient way.

The research is supported by National Natural Science Foundation of China under Grant Nos. 61420106004, 61732013, 61751207 and 61572386.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. http://hadoop.apache.org/

  2. https://storm.apache.org/

  3. https://spark.apache.org/

  4. Armbrust, M., Fox, A., Griffith, R., Joseph, A.D., Katz, R., Konwinski, A., Lee, G., Patterson, D., Rabkin, A., Stoica, I., et al.: A view of cloud computing. Commun. ACM 53(4), 50–58 (2010)

    Article  Google Scholar 

  5. Borthakur, D.: The hadoop distributed file system: architecture and design. Hadoop Proj. Website 11(2007), 21 (2007)

    Google Scholar 

  6. Bryant, R.E.: Data intensive scalable computing. Carnegie Mellon University (2008). Accessed 10 Aug 2009

    Google Scholar 

  7. Coppersmith, D., Winograd, S.: Matrix multiplication via arithmetic progressions. In: Proceedings of the Nineteenth Annual ACM Symposium on Theory of Computing, pp. 1–6. ACM (1987)

    Google Scholar 

  8. Dean, J., Ghemawat, S.: MapReduce: simplified data processing on large clusters. Commun. ACM 51, 107–113 (2008)

    Article  Google Scholar 

  9. Duan, Z.: An extended interval temporal logic and a framing technique for temporal logic programming. Ph.D. thesis, University of Newcastle upon Tyne (1996)

    Google Scholar 

  10. Duan, Z.: Temporal Logic and Temporal Logic Programming. Science Press, Marrickville (2005)

    Google Scholar 

  11. Duan, Z., Tian, C.: A unified model checking approach with projection temporal logic. In: Liu, S., Maibaum, T., Araki, K. (eds.) ICFEM 2008. LNCS, vol. 5256, pp. 167–186. Springer, Heidelberg (2008). https://doi.org/10.1007/978-3-540-88194-0_12

    Chapter  Google Scholar 

  12. Herlihy, M., Shavit, N.: The Art of Multiprocessor Programming. Elsevier, Amsterdam (2008)

    Google Scholar 

  13. Ihaka, R., Gentleman, R.: R: a language for data analysis and graphics. J. Comput. Graph. Stat. 5(3), 299–314 (1996)

    Google Scholar 

  14. John Walker, S.: Big Data: A Revolution that Will Transform how We Live, Work, and Think (2014)

    Article  Google Scholar 

  15. McAfee, A., Brynjolfsson, E., et al.: Big data: the management revolution. Harvard Bus. Rev. 90(10), 60–68 (2012)

    Google Scholar 

  16. Vavilapalli, V.K., Murthy, A.C., Douglas, C., Agarwal, S., Konar, M., Evans, R., Graves, T., Lowe, J., Shah, H., Seth, S., et al.: Apache hadoop yarn: yet another resource negotiator. In: Proceedings of the 4th Annual Symposium on Cloud Computing, p. 5. ACM (2013)

    Google Scholar 

  17. Vora, M.N.: Hadoop-HBase for large-scale data. In: 2011 International Conference on Computer Science and Network Technology (ICCSNT), vol. 1, pp. 601–605. IEEE (2011)

    Google Scholar 

  18. Wang, M., Tian, C., Duan, Z.: Full regular temporal property verification as dynamic program execution. In: Proceedings of the 39th International Conference on Software Engineering Companion, pp. 226–228. IEEE Press (2017)

    Google Scholar 

  19. Wang, X., Tian, C., Duan, Z., Zhao, L.: MSVL: a typed language for temporal logic programming. Front. Comput. Sci. 11(5), 762–785 (2017)

    Article  Google Scholar 

  20. Yang, K., Duan, Z., Tian, C., Zhang, N.: A compiler for MSVL and its applications. Theor. Comput. Sci. (2017). https://doi.org/10.1016/j.tcs.2017.07.032

  21. Yang, W., Liu, X., Zhang, L., Yang, L.T.: Big data real-time processing based on storm. In: 12th IEEE International Conference on Trust, Security and Privacy in Computing and Communications (TrustCom) 2013, pp. 1784–1787. IEEE (2013)

    Google Scholar 

  22. Zaharia, M., Chowdhury, M., Franklin, M.J., Shenker, S., Stoica, I.: Spark: cluster computing with working sets. HotCloud 10(10–10), 95 (2010)

    Google Scholar 

  23. Zhang, N., Duan, Z., Tian, C.: A cylinder computation model for many-core parallel computing. Theoret. Comput. Sci. 497, 68–83 (2013)

    Article  MathSciNet  Google Scholar 

  24. Zhang, N., Duan, Z., Tian, C.: A mechanism of function calls in MSVL. Theoret. Comput. Sci. 654, 11–25 (2016)

    Article  MathSciNet  Google Scholar 

  25. Zhang, N., Duan, Z., Tian, C.: Model checking concurrent systems with MSVL. Sci. China Inf. Sci. 59, 118101 (2016)

    Article  Google Scholar 

  26. Zikopoulos, P., Eaton, C., et al.: Understanding Big Data: Analytics for Enterprise Class Hadoop and Streaming Data. McGraw-Hill Osborne Media (2011)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Institute of Computing Theory and Technology, and ISN Laboratory, Xidian University, Xi’an, 710071, China

    Nan Zhang, Meng Wang, Zhenhua Duan, Cong Tian & Jin Cui

Authors
  1. Nan Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Meng Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Zhenhua Duan
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Cong Tian
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Jin Cui
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Zhenhua Duan .

Editor information

Editors and Affiliations

  1. Xidian University, Xi’an, China

    Cong Tian

  2. Nihon University, Tokyo, Japan

    Fumiko Nagoya

  3. Hosei University, Koganei-shi, Tokyo, Japan

    Shaoying Liu

  4. Xidian University, Xi’an, China

    Zhenhua Duan

Appendix A: MSVL Program of Sparse Matrix Multiplication

Appendix A: MSVL Program of Sparse Matrix Multiplication

figure c
figure d
figure e
figure f
figure g
figure h
figure i
figure j
figure k
figure l

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer International Publishing AG, part of Springer Nature

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Zhang, N., Wang, M., Duan, Z., Tian, C., Cui, J. (2018). Implementing MapReduce with MSVL. In: Tian, C., Nagoya, F., Liu, S., Duan, Z. (eds) Structured Object-Oriented Formal Language and Method. SOFL+MSVL 2017. Lecture Notes in Computer Science(), vol 10795. Springer, Cham. https://doi.org/10.1007/978-3-319-90104-6_10

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-90104-6_10

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-90103-9

  • Online ISBN: 978-3-319-90104-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics