Skip to main content
SpringerLink
Log in

Towards Progressive and Load Balancing Distributed Computation: A Case Study on Skyline Analysis

  • Regular Paper
  • Published:
Journal of Computer Science and Technology Aims and scope Submit manuscript

Abstract

Many latest high performance distributed computational environments come with high bandwidth in communication. Such high bandwidth distributed systems provide unprecedented opportunities for analyzing huge datasets, but simultaneously posts new technical challenges. For users, progressive query answering is important. For utility of systems, load balancing is critical. How we can achieve progressive and load balancing distributed computation is an interesting and promising research direction. As skyline analysis has been shown very useful in many multi-criteria decision making applications, in this paper, we study the problem of progressive and load balancing distributed skyline analysis. We propose a simple yet scalable approach which comes with several nice properties for progressive and load balancing query answering. We conduct extensive experiments which demonstrate the feasibility and effectiveness of the proposed method.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Borzsonyi S, Kossmann D, Stocker K. The skyline operator. In Proc. ICDE 2001, Heidelberg, Germany, April 2–6, 2001, pp.421–430.

  2. Lee K C K, Zheng B, Li H, Lee W. Approaching the skyline in Z-order. In Proc. VLDB2007, Vienna, Austria, Sept. 23–27, 2007, pp.279–290.

  3. Ratnasamy S, Francis P, Handley M, Karp R, Schenker S. A scalable content addressable network. In Proc. SIGCOMM, San Diego, USA, Aug. 27–31, 2001, pp.161–172.

  4. Chomicki J, Godfrey P, Gryz J, Liang D. Skyline with pre-sorting. In Proc. ICDE 2003, Bangalore, India, Mar. 5–8, 2003, pp.816–825.

  5. Godfrey P, Shipley R, Gryz J. Maximal vector computation in large data sets. In Proc. VLDB2005, Trondheim, Norway, Aug. 30–Sept. 2, 2005, pp.229–240.

  6. Kossmann D, Ramsak F, Rost S. Shooting stars in the sky: An online algorithm for skyline queries. In Proc. VLDB, Hong Kong, China, Aug. 20–23, 2002, pp.275–286.

  7. Papadias D, Tao Y, Fu G, Seeger B. An optimal and progressive algorithm for skyline queries. In Proc. SIGMOD2003, San Diego, USA, June 9–12, 2003, pp.467–478.

  8. Wu P, Zhang C, Feng Y, Zhao B, Agrawal D, Abbadi E. Parallelizing skyline queries for scalable distribution. In Proc. EDBT2006, Munich, Germany, Mar. 26–31, 2006, pp.112–130.

  9. Wang S, Vu Q, Ooi B C, Tung A K H, Xu L. Skyframe: A framework for skyline query processing in peer-to-peer systems. VLDB Journal, 2009, 18(1): 345–362.

    Article  Google Scholar 

  10. Balke W, Guntzer U, Zheng J. Efficient distributed skylining for Web information systems. In Proc. EDBT2004, Heraklion, Greece, Mar. 14–18, 2004, pp.256–273.

  11. Cui B, Lu H, Xu Q, Chen L, Dai Y, Zhou Y. Parallel distributed processing of constrained skyline queries by filtering. In Proc. ICDE 2008, Cancun, Mexico, Apr. 7–12, 2008, pp.546–555.

  12. Guttman A. R-trees: A dynamic index structure for spatial searching. In Proc. SIGMOD1984, Boston, USA, Jun. 18–21, 1984, pp.47–57.

  13. Fagin R, Lotem A, Naor M. Optimal aggregation algorithms for middleware. In Proc. ACM Symp. Principles of Database Systems, Santa Barbara, USA, May 21–23, 2001, pp.102–113.

  14. Wang S, Ooi B C, Tung A K H, Xu L. Efficient skyline query processing on peer-to-peer networks. In Proc. ICDE 2007, Istanbul, Turkey, April 15–20, 2007, pp.1126–1135.

  15. Li H, Tan Q, Lee W C. Efficient progressive processing of skyline queries in peer-to-peer systems. In Proc. INFOS-CALE2006, Hong Kong, China, May 2006.

Download references

Author information

Authors and Affiliations

  1. School of Information Science and Technology, Sun Yat-Sen University, Guangzhou, 510275, China

    Jin Huang & Jian Yin (Senior Member, CCF)

  2. School of Software Engineering, South China University of Technology, Guangzhou, 510006, China

    Feng Zhao & Jian Chen (Member, CCF)

  3. School of Computing Science, Simon Fraser University, British Columbia, V5A 1S6, Canada

    Jian Pei (Senior Member, ACM, IEEE)

Authors
  1. Jin Huang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Feng Zhao
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Jian Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Jian Pei
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Jian Yin
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Jian Chen.

Additional information

Supported by the Doctoral Research Foundation of the Natural Science Foundation of Guangdong Province under Grant No. 8451064101000054, the National Natural Science Foundation of China under Grant Nos. 60773198, 60703111, Natural Science Foundation of Guangdong Province under Grant Nos. 06104916, 8151027501000021, Research Foundation of Science and Technology Plan Project in Guangdong Province under Grant No. 2008B050100040, Program for New Century Excellent Talents in University of China under Grant No. NCET-06-0727, and the Fundamental Research Funds for the Central Universities, SCUT, under Grant No. 2009ZM0008.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Huang, J., Zhao, F., Chen, J. et al. Towards Progressive and Load Balancing Distributed Computation: A Case Study on Skyline Analysis. J. Comput. Sci. Technol. 25, 431–443 (2010). https://doi.org/10.1007/s11390-010-9335-z

Download citation

  • Received:

  • Revised:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11390-010-9335-z

Keywords

Search

Navigation