Skip to main content

Midiag: A Sequential Trace-Based Fault Diagnosis Framework for Microservices

  • Conference paper
  • First Online:

Part of the book series: Lecture Notes in Computer Science ((LNPSE,volume 12409))

Abstract

Cloud applications are often deployed in shared data centers to optimize resource allocation and improve management efficiency. However, since a cloud application often has a large amount of different microservices, it is difficult for operators to analyze these microservices with a unified model. To deal with the above problem, this paper proposes a sequential trace-based fault diagnosis framework called as Midiag by mining the patterns of microservices’ system call sequences. Midiag collects system calls with a non-invasive lightweight tool, and then uses k-means to cluster system call sequences as patterns with the longest common subsequence. The GRU-based neural network is employed to model the patterns of system call sequences to predict the next system call, and thus we can diagnose faults by comparing the predicted next system call and the actual next one in the specific pattern. We have validated Midiag with many different types of applications deployed in containers. The results demonstrate that Midiag can well classify these applications as different types and accurately diagnose the injected faults.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  1. Forrest, S., Hofmeyr, S., Somayaji, A.: The evolution of system call collecting. In: The Annual Computer Security Applications Conference, Piscataway, NJ, pp. 418–430. IEEE Computer Society (2008). https://doi.org/10.1109/acsac.2008.54

  2. Maggi, F., Matteucci, M., Zanero, S.: Detecting intrusions through system call sequence and argument analysis. IEEE Trans. Dependable Secure Comput. 7(4), 381–395 (2010). https://doi.org/10.1109/TDSC.2008.69

    Article  Google Scholar 

  3. Sekar, R., Bendre, M., Dhurjati, D., Bollineni P.: A fast automaton based method for detecting anomalous program behaviors. In: Symposium on Security and Privacy, Piscataway, NJ, pp. 144–155. IEEE Computer Society (2001). https://doi.org/10.1109/secpri.2001.924295

  4. Fenga, L., Guana, X., Guoa, S., Gaoa, Y., Liua, P.: Predicting the intrusion intentions by observing system call sequences. Comput. Secur. 23(3), 241–252 (2004). https://doi.org/10.1016/j.cose.2004.01.016

    Article  Google Scholar 

  5. Kolosnjaji, B., Zarras, A., Webster, G., Eckert, C.: Deep learning for classification of malware system call sequences. In: Kang, B.H., Bai, Q. (eds.) AI 2016. LNCS (LNAI), vol. 9992, pp. 137–149. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-50127-7_11

    Chapter  Google Scholar 

  6. Provos., N.: Improving host security with system call policies. In: the 12th Conference on USENIX Security Symposium, Berkeley, pp. 1–18. USENIX (2003). 10.1.1.13.2425

    Google Scholar 

  7. Bernaille, L., Teixeira, R., Salamatian, K.: Early application identification. In: ACM CoNEXT Conference, New York, NY, USA, pp. 1–12. ACM (2006). https://doi.org/10.1145/1368436.1368445

  8. Ermana, J., Mahanti, A., Arlitt, M., Cohen, I., Williamson, C.: Offline/realtime traffic classification using semi-supervised learning. Perform. Eval. 64(9), 1194–1213 (2007). https://doi.org/10.1016/j.peva.2007.06.014

    Article  Google Scholar 

  9. Zhang, J., Chen, X., Xiang, Y., Zhou, W., Wu, J.: Robust network traffic classification. IEEE/ACM Trans. Netw. 23(4), 1257–1270 (2015). https://doi.org/10.1109/TNET.2014.2320577

    Article  Google Scholar 

  10. Jamshidi, P., Pahl, C., Mendonca, N.C., Lewis, J., Tilkov, S.: Microservices: the journey so far and challenges ahead. IEEE Softw. 35(3), 24–35 (2018). https://doi.org/10.1109/MS.2018.2141039

    Article  Google Scholar 

  11. Magalhes, J.P., Silva, L.M.: SHoWA: a self-healing framework for web-based applications. ACM Trans. Auton. Adapt. Syst. 10(1), 1–28 (2015). https://doi.org/10.1145/2700325

    Article  Google Scholar 

Download references

Acknowledgment

This work is supported by National Key R&D Program of China (2018YFB1402900).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Shudong Zhang .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Meng, L., Sun, Y., Zhang, S. (2020). Midiag: A Sequential Trace-Based Fault Diagnosis Framework for Microservices. In: Wang, Q., Xia, Y., Seshadri, S., Zhang, LJ. (eds) Services Computing – SCC 2020. SCC 2020. Lecture Notes in Computer Science(), vol 12409. Springer, Cham. https://doi.org/10.1007/978-3-030-59592-0_9

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-59592-0_9

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-59591-3

  • Online ISBN: 978-3-030-59592-0

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics