skip to main content
10.1145/3404835.3462997acmconferencesArticle/Chapter ViewAbstractPublication PagesirConference Proceedingsconference-collections
short-paper

GAIPS: Accelerating Maximum Inner Product Search with GPU

Published: 11 July 2021 Publication History

Abstract

In this paper, we propose the GAIPS framework for efficient maximum inner product search (MIPS) on GPU. We observe that a query can usually find a good lower bound of its maximum inner product in some large norm items that take up only a small portion of the dataset and utilize this fact to facilitate pruning. In addition, we design norm-based, residue-based and hash-based pruning techniques to avoid computation for items that are unlikely to be the MIPS results. Experiment results show that compared with FAISS, the state-of-the-art GPU-based similarity search framework, GAIPS has significantly shorter query processing time at the same recall.

Supplementary Material

MP4 File (sp1232-xiangA-video.mp4)
Presentation video

References

[1]
[n.d.]. https://github.com/ekzhu/set-similarity-search-benchmarks/.
[2]
Firas Abuzaid, Geet Sethi, Peter Bailis, and Matei Zaharia. 2019. To Index or Not to Index: Optimizing Exact Maximum Inner Product Search. In 2019 IEEE 35th International Conference on Data Engineering (ICDE). 1250--1261. https://doi.org/10.1109/ICDE.2019.00114
[3]
Yongjian Chen, Tao Guan, and Cheng Wang. 2010. Approximate nearest neighbor search by residual vector quantization. Sensors, Vol. 10, 12 (2010), 11259--11273.
[4]
Thomas Dean, Mark A Ruzon, Mark Segal, Jonathon Shlens, Sudheendra Vijayanarasimhan, and Jay Yagnik. 2013. Fast, Accurate Detection of 100,000 Object Classes on a Single Machine. In Proceedings of the 2013 IEEE Conference on Computer Vision and Pattern Recognition. 1814--1821. https://doi.org/10.1109/CVPR.2013.237
[5]
Pedro F Felzenszwalb, Ross B Girshick, David McAllester, and Deva Ramanan. 2009. Object Detection with Discriminatively Trained Part-Based Models. IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 32, 9 (2009), 1627--1645. https://doi.org/10.1109/TPAMI.2009.167
[6]
Tiezheng Ge, Kaiming He, Qifa Ke, and Jian Sun. 2013. Optimized Product Quantization for Approximate Nearest Neighbor Search. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR). 2946--2953. https://doi.org/10.1109/CVPR.2013.379
[7]
Jeff Johnson, Matthijs Douze, and Hervé Jégou. 2019. Billion-scale similarity search with GPUs. IEEE Transactions on Big Data (2019), 1--1. https://doi.org/10.1109/TBDATA.2019.2921572
[8]
Herve Jégou, Matthijs Douze, and Cordelia Schmid. 2011. Product Quantization for Nearest Neighbor Search. IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 33, 1 (2011), 117--128. https://doi.org/10.1109/TPAMI.2010.57
[9]
Yehuda Koren, Robert Bell, and Chris Volinsky. 2009. Matrix factorization techniques for recommender systems. Computer, Vol. 42, 8 (2009), 30--37. https://doi.org/10.1109/MC.2009.263
[10]
Jie Liu, Xiao Yan, Xinyan Dai, Zhirong Li, James Cheng, and Ming-Chang Yang. 2020. Understanding and Improving Proximity Graph Based Maximum Inner Product Search. Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 34, 01 (2020), 139--146. https://doi.org/10.1609/aaai.v34i01.5344
[11]
Anshumali Shrivastava and Ping Li. 2014. Asymmetric LSH (ALSH) for sublinear time Maximum Inner Product Search (MIPS). In Proceedings of the 27th International Conference on Neural Information Processing Systems. 2321--2329.
[12]
Long Xiang, Bo Tang, and Chuan Yang. 2019. Accelerating Exact Inner Product Retrieval by CPU-GPU Systems. In Proceedings of the 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval. 1277--1280. https://doi.org/10.1145/3331184.3331376

Cited By

View all
  • (2024)Faster maximum inner product search in high dimensionsProceedings of the 41st International Conference on Machine Learning10.5555/3692070.3694045(48344-48361)Online publication date: 21-Jul-2024

Index Terms

  1. GAIPS: Accelerating Maximum Inner Product Search with GPU

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    SIGIR '21: Proceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval
    July 2021
    2998 pages
    ISBN:9781450380379
    DOI:10.1145/3404835
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 11 July 2021

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. GPU
    2. maximum inner product search
    3. vector quantization

    Qualifiers

    • Short-paper

    Funding Sources

    • the Education Department of Guangdong
    • National Science Foundation of China
    • the Guangdong Provincial Key Laboratory

    Conference

    SIGIR '21
    Sponsor:

    Acceptance Rates

    Overall Acceptance Rate 792 of 3,983 submissions, 20%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)40
    • Downloads (Last 6 weeks)3
    Reflects downloads up to 02 Mar 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)Faster maximum inner product search in high dimensionsProceedings of the 41st International Conference on Machine Learning10.5555/3692070.3694045(48344-48361)Online publication date: 21-Jul-2024

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media