Skip to main content

On the Fly File Dereplication Mechanism

  • Conference paper
Advances in Computing and Information Technology

Part of the book series: Advances in Intelligent Systems and Computing ((AISC,volume 176))

  • 2009 Accesses

Abstract

Resource replication in distributed environment produces issues of secondary storage. Dereplication of resources is required when replication mechanism is hindered due to lack of secondary storage. This paper introduces dereplication approaches that depend upon last modification time, number of replica available and resource size. Comparative study shows that dereplication can be used to overcome the space overhead issue and reduces the dereplication time. Result shows that in case the space required is same but number of files to be dereplicated varies, dereplication time also varies depending on number of files to be dereplicated. Dereplication time will be more for case having large number of files. Also if file size is increasing by 7 times, increase in dereplication time is by 1.5 times. This shows that dereplication time is decoupled from size of files that are dereplicated on the fly dynamically and does not increase proportionally with respect to file size.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Similar content being viewed by others

References

  1. Kshemkalyani, A.D.: Distributed Computing Principles, Algorithms and Systems

    Google Scholar 

  2. Gupta, M., Ammar, M.H., Ahamad, M.: Trade-offs between reliability and overheads in peer-to-peer reputation tracking. Computer Networks 50(4), 501–522 (2006)

    Article  MATH  Google Scholar 

  3. Venkatasubramanian, N.: CompOSE|Q - a QoS-enabled customizable middleware framework for distributed computing, Electronic Commerce and Web-based Applications/Middleware. In: 19th IEEE International Conference on Distributed Computing Systems, pp. 134–139 (1999)

    Google Scholar 

  4. Chou, C.-F., Golubchik, L., Lui, J.C.S.: Striping doesn’t scale: how to achieve scalability for continuous media servers with replication. In: 20th International Conference on Distributed Computing Systems, pp. 64–71 (2000)

    Google Scholar 

  5. Venkatasubramanian, N., Deshpande, M., Mohapatra, S., Gutierrez-Nolasco, S., Wickramasuriya, J.: Design and implementation of a composable reflective middleware framework. In: 21st International Conference on Distributed Computing Systems, pp. 644–653 (April 2001)

    Google Scholar 

  6. Santry, D.S., Feeley, M.J., Hutchinson, N.C., Veitch, A.C., Carton, R.W., Ofir, J.: Deciding when to forget in the Elephant file system 33(5), 110–123 (December 1999)

    Google Scholar 

  7. Hurley, R.T., Soon, A.Y.: File migration and file replication: a symbiotic relationship. IEEE Transactions on Parallel and Distributed Systems 7(6), 578–586 (1996)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Paras Gupta .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2012 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Gupta, P., Vardhan, M., Goel, A., Verma, A., Kushwaha, D.S. (2012). On the Fly File Dereplication Mechanism. In: Meghanathan, N., Nagamalai, D., Chaki, N. (eds) Advances in Computing and Information Technology. Advances in Intelligent Systems and Computing, vol 176. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-31513-8_72

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-31513-8_72

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-31512-1

  • Online ISBN: 978-3-642-31513-8

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics