research-article

Designing A Simple Storage Services (S3) Compatible System Based on Ceph Software-Defined Storage System

Authors:

Hung-Ming Chen,

Ci-Jie Li,

Bi-Shun KeAuthors Info & Claims

ICMSSP 2017: Proceedings of the 2017 2nd International Conference on Multimedia Systems and Signal Processing

Pages 6 - 10

https://doi.org/10.1145/3145511.3145519

Published: 13 August 2017 Publication History

Get Access

Abstract

As a result of cloud computing evolution, the rapid growth of the data center storage has prompted enterprises to develop their own public clouds, which, to name a few, include Amazon Web Services (AWS), Microsoft Azure, IBM SoftLayer etc. These public clouds, however, also come with rental fees, as well as the security risks of sensitive internal data leakage. Therefore, the private cloud can be an alternative. This research focuses on minimizing the difficulties in administering private clouds by introducing to private clouds compatible AWS Simple Storage Services (S3) based on distributed software-defined object storing system Ceph, whose distributed storing system increases reliability where a corrupted datum can be recovered from the backup. Moreover, when the enterprise expands its internal structure, the cloud system can provide a better flexibility in node extensions for more convenient management and maintenance. Finally, performance and stress testing tools have been applied to scrutinize the system and object storage services mentioned in this paper with relevant data provided for the considerations of enterprises.

References

[1]

Nunes, B. A. A., Mendonca, M., Nguyen, X. N., Obraczka, K., & Turletti, T. (2014). A survey of software-defined networking: Past, present, and future of programmable networks. IEEE Communications Surveys & Tutorials, 16(3), 1617--1634.

Crossref

Google Scholar

[2]

Corradi, A., Fanelli, M., & Foschini, L. (2014). VM consolidation: A real case based on OpenStack Cloud. Future Generation Computer Systems, 32, 118--127.

Crossref

Google Scholar

[3]

Xiao, Z., Song, W., & Chen, Q. (2013). Dynamic resource allocation using virtual machines for cloud computing environment. IEEE transactions on parallel and distributed systems, 24(6), 1107--1117.

Digital Library

Google Scholar

[4]

Robinson, D. (2008). Amazon Web Services Made Simple: Learn how Amazon EC2, S3, SimpleDB and SQS Web Services enables you to reach business goals faster. Emereo Pty Ltd.

Digital Library

Google Scholar

[5]

Amazon S3 official website: http://docs.aws.amazon.com/AmazonS3/latest/dev/Introduction.html#features (last accessed:2017/04/11)

Google Scholar

[6]

Zhang, X., Gaddam, S., & Chronopoulos, A. T. (2015, November). Ceph distributed file system benchmarks on an openstack cloud. In Cloud Computing in Emerging Markets (CCEM), 2015 IEEE International Conference on (pp. 113--120). IEEE.

Crossref

Google Scholar

[7]

Weil, S. A., S. A. Brandt, et al. "Ceph: A scalable, high-performance distributed file system.", Operating Systems Design and Implementation (OSDI), pp. 307--320, 2006.

Digital Library

Google Scholar

[8]

Weil, S. A., S. A. Brandt, et al. "RADOS: A Scalable, Reliable Storage Service for Petabyte-scale Storage Clusters", The ACM Digital Library, 2007

Google Scholar

[9]

COSBench User Guide: https://github.com/intel-cloud/cosbench/blob/master/COSBenchUserGuide.pdf

Google Scholar

[10]

Webbench document: http://home.tiscali.cz/~cz210552/webbench.html (last accessed:2017/04/11)

Google Scholar

Cited By

View all

Hoz AHeredia Canales ACimadevilla Álvarez EObregón Ruiz MLópez García Á(2025)DataLab as a Service: Distributed Computing Framework for Multi-Interactive Analysis EnvironmentsIEEE Access10.1109/ACCESS.2025.353663713(22566-22577)Online publication date: 2025
https://doi.org/10.1109/ACCESS.2025.3536637
Yang DLiu YChen JJiang Z(2024)Data Balancing of Ceph Distributed Storage System Based on Deep Reinforcement LearningMultidimensional Signals, Augmented Reality and Information Technologies10.1007/978-981-99-7011-7_8(107-116)Online publication date: 2-Jan-2024
https://doi.org/10.1007/978-981-99-7011-7_8

Index Terms

Designing A Simple Storage Services (S3) Compatible System Based on Ceph Software-Defined Storage System
1. Information systems
  1. Information storage systems
    1. Storage management
      1. Hierarchical storage management

Recommendations

On construction of a cloud storage system with heterogeneous software-defined storage technologies

With the rapid development of networks and Information technologies, cloud computing is not only becoming popular, the types of cloud services available are also increasing. Through cloud services, users can upload their requirements via the Internet to ...
Implementation of Software-Defined Storage Service with Heterogeneous Object Storage Technologies
ASE BD&SI '15: Proceedings of the ASE BigData & SocialInformatics 2015

With the rapid development of information, personal computers are not only popular but also provide cloud services. Cloud Service is a concept that users can upload their requirement via Internet to cloud environment and then receive a response by ...
Middleware enabled data sharing on cloud storage services
MW4SOC '10: Proceedings of the 5th International Workshop on Middleware for Service Oriented Computing

With the emergence of public cloud storage platforms like Amazon, Microsoft and Google etc, individual applications and some enterprise storage are being increasingly deployed on Clouds. However, dynamic data sharing in public clouds face problems of ...

Comments

Information & Contributors

Information

Published In

ICMSSP 2017: Proceedings of the 2017 2nd International Conference on Multimedia Systems and Signal Processing

August 2017

72 pages

ISBN:9781450353144

DOI:10.1145/3145511

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

In-Cooperation

National Kaohsiung University of Applied Sciences: National Kaohsiung University of Applied Sciences

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 13 August 2017

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

ICMSSP 2017

ICMSSP 2017: 2017 2nd International Conference on Multimedia Systems and Signal Processing

August 13 - 16, 2017

Taichung, Taiwan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
256
Total Downloads

Downloads (Last 12 months)16
Downloads (Last 6 weeks)3

Reflects downloads up to 18 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Hoz AHeredia Canales ACimadevilla Álvarez EObregón Ruiz MLópez García Á(2025)DataLab as a Service: Distributed Computing Framework for Multi-Interactive Analysis EnvironmentsIEEE Access10.1109/ACCESS.2025.353663713(22566-22577)Online publication date: 2025
https://doi.org/10.1109/ACCESS.2025.3536637
Yang DLiu YChen JJiang Z(2024)Data Balancing of Ceph Distributed Storage System Based on Deep Reinforcement LearningMultidimensional Signals, Augmented Reality and Information Technologies10.1007/978-981-99-7011-7_8(107-116)Online publication date: 2-Jan-2024
https://doi.org/10.1007/978-981-99-7011-7_8

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Abstract

References

Cited By

Index Terms

Recommendations

On construction of a cloud storage system with heterogeneous software-defined storage technologies

Implementation of Software-Defined Storage Service with Heterogeneous Object Storage Technologies

Middleware enabled data sharing on cloud storage services

Comments

Information

Published In

In-Cooperation

Publisher

Publication History

Permissions

Check for updates

Author Tags

Qualifiers

Conference

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Login options

Full Access

View options

PDF

eReader

Share

Share this Publication link

Share on social media

Affiliations