Skip to main content

A Temporal Approach for Testing Distributed Systems-A MapReduce Case Study

  • Conference paper
  • First Online:
New Trends in Model and Data Engineering (MEDI 2019)

Part of the book series: Communications in Computer and Information Science ((CCIS,volume 1085))

Included in the following conference series:

  • 419 Accesses

Abstract

To observe the behavior of a distributed implementation under test (IUT), we commonly coordinate parallel testers in order to check not only if the output events have been observed, but also the dates when these events have been occurred. However, the use of multiple testers can produce several coordination problems amongst remote testers known as Controllability and Observability issues. To cope with such problems, we suggest-in previous works- the inclusion of some timing constraints in the test architecture. In this paper, we choose as a case study the use of a MapReduce architecture with several worker components running essentially two functionalities: Map and Reduce tasks. These systems often face failures caused by various conditions, e.g., network connection delays, power outages or hardware problems. Moreover, we define the temporal properties in the specification of such systems. Then, we explain how to apply these properties in the case of MapReduce testing to identify faulty workers, in order to reschedule their tasks to a healthy worker.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Charaf, M.E.H., Azzouzi, S.: A colored Petri-net model for control execution of distributed systems. In: 2017 4th International Conference on Control, Decision and Information Technologies, CoDIT 2017, January 2017, vol. 2017, pp. 277–282 (2017)

    Google Scholar 

  2. Azzouzi, S., Benattou, M., Charaf, M.E.H.: A temporal agent based approach for testing open distributed systems. Comput. Stand. Interfaces 40, 23–33 (2015)

    Article  Google Scholar 

  3. Benattou, M., Cacciari, L., Pasini, R., Rafiq, O.: Principles and tools for testing open distributed systems. In: Csopaki, G., Dibuz, S., Tarnay, K. (eds.) Testing of Communicating Systems. IFIPAICT, vol. 21, pp. 77–92. Springer, Boston, MA (1999). https://doi.org/10.1007/978-0-387-35567-2_6

    Chapter  Google Scholar 

  4. Hierons, R.M.: Testing a distributed system: generating minimal synchronised test sequences that detect output-shifting faults. Inf. Softw. Technol. 43(9), 551–560 (2001)

    Article  Google Scholar 

  5. Tai, K.-C., Young, Y.-C.: Synchronizable test sequences of finite state machines. Comput. Netw. ISDN Syst. 30(12), 1111–1134 (1998)

    Article  Google Scholar 

  6. Liu, W.Y., Zeng, H.W., Miao, H.K.: Multiple UIO-based test sequence generation for distributed systems. J. Shanghai Univ. 12(5), 438–443 (2008)

    Article  Google Scholar 

  7. Anier, A., Vain, J., Tsiopoulos, L.: DTRON: a tool for distributed model-based testing of time critical applications. Proc. Est. Acad. Sci. 66(1), 75 (2017)

    Article  Google Scholar 

  8. Merayo, M.G., Hierons, R.M., Núñez, M.: Passive testing with asynchronous communications and timestamps. Distrib. Comput. 31(5), 327–342 (2018)

    Article  MathSciNet  Google Scholar 

  9. Hierons, R.M., Merayo, M.G., Núñez, M.: Bounded reordering in the distributed test architecture. IEEE Trans. Reliab. 67(2), 522–537 (2018)

    Article  Google Scholar 

  10. Lanet, J.L., Le Bouder, H., Benattou, M., Legay, A.: When time meets test. Int. J. Inf. Secur. 17(4), 395–409 (2018)

    Article  Google Scholar 

  11. Marynowski, J.E., Albonico, M., de Almeida, E.C., Sunyé, G.: Testing MapReduce-based systems. In: SBBD - XXVI Simpósio Bras, Banco Dados (2011)

    Google Scholar 

  12. Moran, J., La Riva, C.D., Tuya, J.: MRTree: functional testing based on MapReduce’s execution behaviour. In: Proceedings of 2014 International Conference on Future Internet of Things and Clou, FiCloud 2014, pp. 379–384 (2014)

    Google Scholar 

  13. Csallner, C., Fegaras, L.: New ideas track: testing MapReduce style programs categories and subject descriptors. In: Engineering, pp. 504–507 (2011)

    Google Scholar 

  14. Lublinsky, B., Smith, K.T., Yakubovich, A.: Professional Hadoop Solutions (2013)

    Google Scholar 

  15. Petrenko, A., Bochmann, G.v., Yao, M.: On fault coverage of tests for finite state specifications. Comput. Netw. ISDN Syst. 29(1), 81–106 (1996)

    Article  Google Scholar 

  16. Wottrich, K., Bressoud, T.: The performance characteristics of mapreduce applications on scalable clusters. In: Proceedings of the Midstates Conference on Undergraduate Research in Computer Science and Mathematics, April 2011

    Google Scholar 

  17. Khan, M., Jin, Y., Li, M., Xiang, Y., Jiang, C.: Hadoop performance modeling for job estimation and resource provisioning. IEEE Trans. Parallel Distrib. Syst. 27(2), 441–454 (2016)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Sara Hsaini .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Hsaini, S., Azzouzi, S., Charaf, M.E.H. (2019). A Temporal Approach for Testing Distributed Systems-A MapReduce Case Study. In: Attiogbé, C., Ferrarotti, F., Maabout, S. (eds) New Trends in Model and Data Engineering. MEDI 2019. Communications in Computer and Information Science, vol 1085. Springer, Cham. https://doi.org/10.1007/978-3-030-32213-7_7

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-32213-7_7

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-32212-0

  • Online ISBN: 978-3-030-32213-7

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics