Skip to main content

GPU-Accelerated Block-Max Query Processing

  • Conference paper
  • First Online:
Book cover Algorithms and Architectures for Parallel Processing (ICA3PP 2017)

Abstract

In this paper, we propose a method for parallel top-k query processing on GPU(s). We employ a novel partitioning strategy which splits the posting lists according to document ID numbers. Individual GPU threads simultaneously perform top-k query processing within their allocated subsets of posting lists, the results of the query are merged to give the final top-k results. We further design a CPU-GPU cooperative query processing method, where a majority of queries involving shorter posting lists are processed on the GPU side. We experiment with AND, OR, WAND, and Block-Max WAND (BMW) queries, with experimental results showing a promising improvement in query throughput, particularly in the case of BMW queries.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Agrawal, S.R., Pistol, V., Pang, V., Tran, J., Tarjan, D., Lebeck, A.R.: Rhythm: harnessing data parallel hardware for server workloads. In: Proceedings of ASPLOS, pp. 19–84 (2014)

    Google Scholar 

  2. Ao, N., Zhang, F., Wu, D., Stones, D.S., Wang, G., Liu, X., Liu, J., Lin, S.: Efficient parallel lists intersection and index compression algorithms using graphics processing units. Proc. VLDB Endow. 4, 470–481 (2011)

    Article  Google Scholar 

  3. Broder, A.Z., Carmel, D., Herscovici, M., Soffer, A., Zien, J.Y.: Efficient query evaluation using a two-level retrieval process. In: Proceedings of CIKM, pp. 426–434 (2003)

    Google Scholar 

  4. Ding, S., Attenberg, J., Baeza-Yates, R., Suel, T.: Batch query processing for web search engines. In: Proceedings of WSDM, pp. 137–146 (2011)

    Google Scholar 

  5. Ding, S., He, J., Yan, H., Suel, T.: Using graphics processors for high performance IR query processing. In: Proceedings of WWW, pp. 421–430 (2009)

    Google Scholar 

  6. Ding, S., Suel, T.: Faster top-\(k\) document retrieval using block-max indexes. In: Proceedings of SIGIR, pp. 993–1002 (2011)

    Google Scholar 

  7. Fang, R., He, B., Lu, M., Yang, K., Govindaraju, N.K., Luo, Q., Sander, P.V.: GPUQP: query co-processing using graphics processors. In: Proceedings of SIGMOD, pp. 1061–1063 (2007)

    Google Scholar 

  8. NVIDIA: NVIDIA CUDA C programming guide (2015)

    Google Scholar 

  9. Robertson, S.E., Walker, S., Jones, S., Hancock-Beaulieu, M.M., Gatford, M.: Okapi at TREC-3, p. 109. NIST Special Publication, Gaithersburg (1995)

    Google Scholar 

  10. Rojas, O., Gil-Costa, V., Marin, M.: Efficient parallel block-max WAND algorithm. In: Wolf, F., Mohr, B., Mey, D. (eds.) Euro-Par 2013. LNCS, vol. 8097, pp. 394–405. Springer, Heidelberg (2013). doi:10.1007/978-3-642-40047-6_41

    Chapter  Google Scholar 

  11. Silvestri, F.: Sorting out the document identifier assignment problem. In: Amati, G., Carpineto, C., Romano, G. (eds.) ECIR 2007. LNCS, vol. 4425, pp. 101–112. Springer, Heidelberg (2007). doi:10.1007/978-3-540-71496-5_12

    Chapter  Google Scholar 

  12. Tatikonda, S., Cambazoglu, B.B., Junqueira, F.P.: Posting list intersection on multicore architectures. In: Proceeding of the 34th International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2011, Beijing, China, pp. 963–972, 25–29 July 2011

    Google Scholar 

  13. Voorhees, E.M.: Overview of TREC 2003. In: Proceedings of TREC, pp. 1–13 (2003)

    Google Scholar 

  14. Wu, D., Zhang, F., Ao, N., Wang, G., Liu, X., Liu, J.: Efficient lists intersection by CPU-GPU cooperative computing. In: Proceedings of IPDPSW, pp. 1–8 (2010)

    Google Scholar 

  15. Yan, H., Ding, S., Suel, T.: Inverted index compression and query processing with optimized document ordering. In: Proceedings of WWW, pp. 401–410 (2009)

    Google Scholar 

  16. Zhang, F., Wu, D., Ao, N., Wang, G., Liu, X., Liu, J.: Fast lists intersection with bloom filter using graphics processing units. In: Proceedings of SAC, pp. 825–826 (2011)

    Google Scholar 

  17. Zhang, J., Long, X., Suel, T.: Performance of compressed inverted list caching in search engines. In: Proceedings of WWW, pp. 387–396 (2008)

    Google Scholar 

  18. Zhang, S., Zhang, C., You, Z., Zheng, R., Xu, B.: Asynchronous stochastic gradient descent for DNN training. In: IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP 2013, Vancouver, BC, Canada, pp. 6660–6663, 26–31 May 2013

    Google Scholar 

Download references

Acknowledgment

This work is partially supported by NSF of China (grant numbers: 61373018, 61602266 11550110491), Science and Technology Development Plan of Tianjin (17JCYBJC15300, 16JCYBJC41900) and the Fundamental Research Funds for the Central Universities (Grant number: 65141020).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Mingming Ren .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Springer International Publishing AG

About this paper

Cite this paper

Huang, H. et al. (2017). GPU-Accelerated Block-Max Query Processing. In: Ibrahim, S., Choo, KK., Yan, Z., Pedrycz, W. (eds) Algorithms and Architectures for Parallel Processing. ICA3PP 2017. Lecture Notes in Computer Science(), vol 10393. Springer, Cham. https://doi.org/10.1007/978-3-319-65482-9_15

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-65482-9_15

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-65481-2

  • Online ISBN: 978-3-319-65482-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics