Skip to main content
Springer Nature Link
Log in

Rio_DSA: Redirecting I/O Scheme for Dynamic Storage Allocation on Docker Container

  • Conference paper
  • First Online:
Ubiquitous Networking (UNet 2022)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 13853))

Included in the following conference series:

  • 283 Accesses

Abstract

In this paper, we present a dynamic storage extension scheme for docker containers. In the current implementation of docker containers, in the case that the default storage of a container runs out of space in the middle of application executions, those applications would abruptly stop to execute, leading to either application restart or data loss. Our proposed scheme can prevent such a harmful situation from taking place, by providing I/O redirection to rio_DSA extended storage in the overlay filesystem. We evaluated the performance of rio_DSA by using IOzone and FIO benchmarks, and showed that our scheme performed well without causing any malicious effect in I/O performance. Moreover, we can observe that the performance potential due to leveraging high-speed I/O devices, such as NVMe SSD, can be preserved as it is in the existing docker container implementation.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Merkel, D.: Docker: lightweight Linux containers for consistent development and deployment. Linux J. 239, 2 (2014)

    Google Scholar 

  2. Arpaci-Dusseau, A., Arpaci-Dussear, R.: Slacker: fast distribution with lazy Docker containers. In: 14th USENIX Conference on File and Storage Technologies (FAST2016), Santa Clara, CA, USA (2016)

    Google Scholar 

  3. Shah, J., Dubaria, D.: Building modern clouds: using Docker, Kubernetes & google cloud platform. In: IEEE 9th Annual Computing and Communication Workshop and Conference (CCWC), Las Vegas, USA (2019)

    Google Scholar 

  4. Xavier, B., Ferreto, T., Jersak, L.: Time provisioning evaluation of KVM, Docker and Unikernels in a cloud platform. In: 16th IEEE/ACM International Symposium on Cluster, and Grid Computing, Cartagena, Colombia (2016)

    Google Scholar 

  5. Manco, F., et al.: My VM is lighter (and Safer) than your container. In: ACM SIGOPS 26th Symposium on Operating Systems Principles (SOSP2017), Shanghai, China (2017)

    Google Scholar 

  6. Dong, Y., Yang, X., Li, J., Liao, G., Tian, K., Guan, H.: High performance network virtualization with SR-IOV. J. Parallel Distrib. Comput. 72, 1471–1480 (2012)

    Article  Google Scholar 

  7. Har’El, N., Gordon, A., Landau, A.: Efficient and scalable Paravirtual I/O System. In: 2013 USENIX Annual Technical Conference, pp. 231–242, San Jose, USA (2013)

    Google Scholar 

  8. Zhu, J., Jiang, Z., Xiao, Z.: Twinkle: a fast resource provisioning mechanism for internet services. In: 2011 Proceedings IEEE INFOCOM (2011)

    Google Scholar 

  9. Razavi, K., Kielmann, T.: Scalable virtual machine deployment using VM image cache. In: SC’13 on High Performance Computing, Networking, Storage and Analysis, Denver, USA (2013)

    Google Scholar 

  10. Ferreira, A., Rajamony, R., Rubio, J.: An updated performance comparison of virtual machines and Linux containers. In: IEEE International Symposium on Performance Analysis of Systems and Software (ISPASS), Philadelphia, PA, USA (2015)

    Google Scholar 

  11. Chaufournier, L., Sharma, P., Shenoy, P.: Containers and virtual machines at scale: a comparative study. In: 17th International Middleware Conference, Trento, Italy (2016)

    Google Scholar 

  12. Wu, X., Wang, W., Jiang, S.: TotalCOW: unleash the power of copy-on-write for thin-provisioned containers. In: 6th Asia-Pacific Workshop on Systems, Tokyo, Japan (2015)

    Google Scholar 

  13. Jiang, Y., Liu, W., Shi, X., Qiang, W.: Optimizing the copy-on-write mechanism of Docker by dynamic prefetching. Tsinghua Sci. Technol. 26, 266–274 (2021)

    Article  Google Scholar 

  14. Anwar, A., et al.: Improving Docker registry design based on production workload analysis. Oakland, CA, USA (2018)

    Google Scholar 

  15. Mizusawa, N., Kon, J., Seki, Y., Tao, J., Yamaguchi, S.: Performance improvement of file operations on OverlayFS for containers. In: IEEE International Conference on Smart Computing (SMARTCOMP), Taormina, Sicily, Italy (2018)

    Google Scholar 

  16. Lu, L., Zhang, Y., Do, T., Al-Kiswany, S., Arpaci-Dusseau, A., Arpaci-Dusseau, R.: Physical disentanglement in a container-based file system, Broomfield, CO, USA (2014)

    Google Scholar 

Download references

Acknowledgements

This work was supported by the National Research Foundation of Korea (NRF) grant funded by the Korea Government (MSIT)(No. 2022R1A2C1004156). Also, this work was supported by Institute of Information & communications Technology Planning & Evaluation (IITP) grant funded by the Korea government (MSIT)(No. 2021–0-00219, Exascale Data Storage and High Performance Computing Technology).

Author information

Authors and Affiliations

  1. College of Electronics and Information Engineering, Sejong University, 209 Neungdong-Ro, Gwangjin-Gu, Seoul, Korea

    Sehoon Kwon & Jaechun No

  2. Deptartment of Computer Engineering, Anyang University and Gluesys Co. LTD, Anyang 5-Dong, Manan-Go, Korea

    Sung-soon Park

Authors
  1. Sehoon Kwon
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Jaechun No
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Sung-soon Park
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Jaechun No .

Editor information

Editors and Affiliations

  1. University of Quebec at Montreal, Montreal, QC, Canada

    Essaid Sabir

  2. University of Quebec at Montreal, Montreal, QC, Canada

    Halima Elbiaze

  3. Public University of Navarre, Pamplona, Spain

    Francisco Falcone

  4. University of Quebec at Montreal, Montreal, QC, Canada

    Wessam Ajib

  5. Hassan II University of Casablanca, Casablanca, Morocco

    Mohamed Sadik

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Kwon, S., No, J., Park, Ss. (2023). Rio_DSA: Redirecting I/O Scheme for Dynamic Storage Allocation on Docker Container. In: Sabir, E., Elbiaze, H., Falcone, F., Ajib, W., Sadik, M. (eds) Ubiquitous Networking. UNet 2022. Lecture Notes in Computer Science, vol 13853. Springer, Cham. https://doi.org/10.1007/978-3-031-29419-8_9

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-29419-8_9

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-29418-1

  • Online ISBN: 978-3-031-29419-8

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics