Skip to main content

Effective Data Distribution and Reallocation Strategies for Fast Query Response in Distributed Query-Intensive Data Environments

  • Conference paper
Progress in WWW Research and Development (APWeb 2008)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 4976))

Included in the following conference series:

Abstract

Modern large distributed applications, such as mobile communications and banking services, require fast responses to enormous and frequent query requests. This kind of application usually employs in a distributed query-intensive data environment, where the system response time significantly depends on ways of data distribution. Motivated by the efficiency need, we develop two novel strategies: a static data distribution strategy DDH and a dynamic data reallocation strategy DRC to speed up the query response time through load balancing. DDH uses a hash-based heuristic technique to distribute data off-line according to the query history. DRC can reallocate data dynamically at runtime to adapt the changing query patterns in the system. To validate the performance of these two strategies, experiments are conducted using a simulation environment and real customer data. Experimental results show that they both offer favorable performance with the increasing query load of the system.

This work is supported by the NSFC Grants 60473051, 60642004, the National ’863’ High-Tech Program of China under grant No. 2007AA01Z191, 2006AA01Z230, and the Siemens - Peking University Collaborative Research Project.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Grosu, D., Chronopoulos, A.T., Leung, M.-Y.: Load Balancing in Distributed Systems: An Approach Using Cooperative Games. In: Parallel and Distributed Processing Symposium, pp. 52–61 (2002)

    Google Scholar 

  2. Li, J., Kameda, H.: Load balancing problems for multiclass jobs in distributed/parallel computer systems. IEEE Transactions on Computers 47(3), 322–332 (1998)

    Article  MathSciNet  Google Scholar 

  3. Kim, C., Kameda, H.: Optimal static load balancing of multi-class jobs in a distributed computer system. In: 10th International Conference on Distributed Computing Systems, pp. 562–569 (1990)

    Google Scholar 

  4. Lin, H.-C., Raghavendra, C.S.: A Dynamic Load-Balancing Policy with a Central Job Dispatcher (LBC). IEEE Transactions on Software Engineering 18(2), 148–158 (1992)

    Article  Google Scholar 

  5. Sundaram, V., Wood, T., Shenoy, P.: Efficient Data Migration in Self-managing Storage Systems. In: IEEE International Conference on Autonomic Computing, pp. 297–300 (2006)

    Google Scholar 

  6. Zhang, Y., Kameda, H., Hung, S.-L.: Comparison of dynamic and static load-balancing strategies in heterogeneous distributed systems. Computers and Digital Techniques, IEE Proceedings 144(2), 100–106 (1997)

    Article  Google Scholar 

  7. Qin, X., Jiang, H., Zhu, Y., Swanson, D.R.: A dynamic load balancing scheme for I/O-intensive applications in distributed systems. In: International Conference on Parallel Processing Workshops, pp. 79–86 (2003)

    Google Scholar 

  8. Kuo, C.-F., Yang, T.-W., Kuo, T.-W.: Dynamic Load Balancing for Multiple Processors. In: 12th IEEE International Conference on Embedded and Real-Time Computing Systems and Applications, pp. 395–401 (2006)

    Google Scholar 

  9. Feldmann, M., Rissen, J.P.: GSM Network Systems and Overall System Integration. Electrical Communication, 2nd Quarter (1993)

    Google Scholar 

  10. Jain, R.: The Art of Computer Systems Performance Analysis: Techniques for Experimental Design, Measurement, Simulation, and Modeling. Wiley-Interscience, New York (1991)

    MATH  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Yanchun Zhang Ge Yu Elisa Bertino Guandong Xu

Rights and permissions

Reprints and permissions

Copyright information

© 2008 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Wang, T., Yang, B., Gao, J., Yang, D. (2008). Effective Data Distribution and Reallocation Strategies for Fast Query Response in Distributed Query-Intensive Data Environments. In: Zhang, Y., Yu, G., Bertino, E., Xu, G. (eds) Progress in WWW Research and Development. APWeb 2008. Lecture Notes in Computer Science, vol 4976. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-78849-2_55

Download citation

  • DOI: https://doi.org/10.1007/978-3-540-78849-2_55

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-78848-5

  • Online ISBN: 978-3-540-78849-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics