short-paper

Public Access

An Exploration of Serverless Architectures for Information Retrieval

Authors:

Matt Crane,

Jimmy LinAuthors Info & Claims

ICTIR '17: Proceedings of the ACM SIGIR International Conference on Theory of Information Retrieval

Pages 241 - 244

https://doi.org/10.1145/3121050.3121086

Published: 01 October 2017 Publication History

PDF eReader

Abstract

Serverless architectures represent a new approach to designing applications in the cloud without having to explicitly provision or manage servers. The developer specifies functions with well-defined entry and exit points, and the cloud provider handles all other aspects of execution. In this paper, we explore a novel application of serverless architectures to information retrieval and describe a search engine built in this manner with Amazon Web Services: postings lists are stored in the DynamoDB NoSQL store and the postings traversal algorithm for query evaluation is implemented in the Lambda service. The result is a search engine that scales elastically with a pay-per-request model, in contrast to a server-based model that requires paying for running instances even if there are no requests. We empirically assess the performance and economics of our serverless architecture. While our implementation is currently too slow for interactive searching, analysis shows that the pay-per-request model is economically compelling, and future infrastructure improvements will increase the attractiveness of serverless designs over time.

References

[1]

Krisztian Balog, Anne Schuth, Peter Dekker, Narges Tavakolpoursaleh, Philipp Schaer, and Po-Yu Chuang 2016. Overview of the TREC 2016 Open Search Track.

Google Scholar

[2]

cecilia@aws. 2014. Re: Lambda CPU relative to which instance type? (9 Dec. 2014). Retrieved February 2, 2017 from https://forums.aws.amazon.com/message.jspa?messageID=588722

Google Scholar

[3]

Charles Clarke, Nick Craswell, and Ian Soboroff. 2004. Overview of the TREC 2004 Terabyte Track. In TREC.

Google Scholar

[4]

Matt Crane, J. Shane Culpepper, Jimmy Lin, Joel Mackenzie, and Andrew Trotman 2017. A Comparison of Document-at-a-Time and Score-at-a-Time Query Evaluation WSDM. 201--210.

Digital Library

Google Scholar

[5]

Giuseppe DeCandia, Deniz Hastorun, Madan Jampani, Gunavardhan Kakulapati, Avinash Lakshman, Alex Pilchin, Swaminathan Sivasubramanian, Peter Vosshall, and Werner Vogels. 2007. Dynamo: Amazon's Highly Available Key-value Store. SOSP. 205--220.

Digital Library

Google Scholar

[6]

Vineet Gopal. 2015. Powering CRISPR With AWS Lambda. (25 Sept. 2015). Retrieved February 6, 2017 from http://benchling.engineering/crispr-aws-lambda/

Google Scholar

[7]

Scott Hendrickson, Stephen Sturdevant, Tyler Harter, Venkateshwaran Venkataramani, Andrea C. Arpaci-Dusseau, and Remzi H. Arpaci-Dusseau 2016. Serverless Computation with OpenLambda. In HotCloud.

Digital Library

Google Scholar

[8]

Jimmy Lin, Matt Crane, Andrew Trotman, Jaime Callan, Ishan Chattopadhyaya, John Foley, Grant Ingersoll, Craig Macdonald, and Sebastiano Vigna 2016. Toward Reproducible Baselines: The Open-Source IR Reproducibility Challenge ECIR. 408--420.

Google Scholar

[9]

Jimmy Lin and Andrew Trotman 2015. Anytime Ranking for Impact-Ordered Indexes. In ICTIR. 301--304.

Digital Library

Google Scholar

[10]

Jimmy Lin and Andrew Trotman 2017. The Role of Index Compression in Score-at-a-Time Query Evaluation. Information Retrieval Vol. 20, 3 (2017), 199--220.

Digital Library

Google Scholar

[11]

Dirk Merkel. 2014. Docker: Lightweight Linux Containers for Consistent Development and Deployment. Linux Journal, Vol. 2014, 239 (2014), Article No. 2.

Digital Library

Google Scholar

Cited By

View all

Alam M(2024)Unveiling Serverless: A Systematic Review of Software Architectures2024 International Conference on Advanced Information Scientific Development (ICAISD)10.1109/ICAISD63055.2024.10895318(58-63)Online publication date: 25-Nov-2024
https://doi.org/10.1109/ICAISD63055.2024.10895318
Montin ECarluccio GCollins CLattanzi R(2024)A Serverless Implementation of a Tool for Temperature and SAR Estimation (TESS 2.0)2024 E-Health and Bioengineering Conference (EHB)10.1109/EHB64556.2024.10805647(1-4)Online publication date: 14-Nov-2024
https://doi.org/10.1109/EHB64556.2024.10805647
Sisoev IGavrilenko VKovalchuk O(2023)USING NEURAL NETWORKS TO EVALUATE THE COMPLEXITY OF A JSON-FORMATTED QUERYAutomobile Roads and Road Construction10.33744/0365-8171-2023-113.2-171-179(171-179)Online publication date: 2023
https://doi.org/10.33744/0365-8171-2023-113.2-171-179
Show More Cited By

Index Terms

An Exploration of Serverless Architectures for Information Retrieval
1. Information systems
  1. Information retrieval
    1. Retrieval models and ranking
    2. Search engine architectures and scalability
  2. Information storage systems
    1. Storage architectures
      1. Cloud based storage

Recommendations

The SPEC cloud group's research vision on FaaS and serverless architectures
WoSC '17: Proceedings of the 2nd International Workshop on Serverless Computing

Cloud computing enables an entire ecosystem of developing, composing, and providing IT services. An emerging class of cloud-based software architectures, serverless, focuses on providing software architects the ability to execute arbitrary functions ...
Role of Serverless Computing in Healthcare Systems: Case Studies
Computational Science and Its Applications – ICCSA 2022 Workshops
Abstract
Recently, serverless architecture has gained popularity due to its cost-effective policies, independent stateless functions, auto-scaling, and simplified code deployment. It allows the developer to deploy and run their applications without ...
On Merits and Viability of Multi-Cloud Serverless
SoCC '21: Proceedings of the ACM Symposium on Cloud Computing

Serverless computing is a rapidly growing paradigm in the cloud industry that envisions functions as the computational building blocks of an application. Instead of forcing the application developer to provision cloud resources for their application, ...

Comments

Information & Contributors

Information

Published In

ICTIR '17: Proceedings of the ACM SIGIR International Conference on Theory of Information Retrieval

October 2017

348 pages

ISBN:9781450344906

DOI:10.1145/3121050

General Chairs:
Jaap Kamps
University of Amsterdam, The Netherlands
,
Evangelos Kanoulas
University of Amsterdam, The Netherlands
,
Maarten de Rijke
University of Amsterdam, The Netherlands
,
Program Chairs:
Hui Fang
University of Delaware, USA
,
Emine Yilmaz
University College London, UK

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 October 2017

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Short-paper

Funding Sources

Conference

ICTIR '17

Sponsor:

SIGIR

ICTIR '17: ACM SIGIR International Conference on the Theory of Information Retrieval

October 1 - 4, 2017

Amsterdam, The Netherlands

Acceptance Rates

ICTIR '17 Paper Acceptance Rate 27 of 54 submissions, 50%;

Overall Acceptance Rate 235 of 527 submissions, 45%

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

16
Total Citations
View Citations
920
Total Downloads

Downloads (Last 12 months)199
Downloads (Last 6 weeks)32

Reflects downloads up to 07 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Alam M(2024)Unveiling Serverless: A Systematic Review of Software Architectures2024 International Conference on Advanced Information Scientific Development (ICAISD)10.1109/ICAISD63055.2024.10895318(58-63)Online publication date: 25-Nov-2024
https://doi.org/10.1109/ICAISD63055.2024.10895318
Montin ECarluccio GCollins CLattanzi R(2024)A Serverless Implementation of a Tool for Temperature and SAR Estimation (TESS 2.0)2024 E-Health and Bioengineering Conference (EHB)10.1109/EHB64556.2024.10805647(1-4)Online publication date: 14-Nov-2024
https://doi.org/10.1109/EHB64556.2024.10805647
Sisoev IGavrilenko VKovalchuk O(2023)USING NEURAL NETWORKS TO EVALUATE THE COMPLEXITY OF A JSON-FORMATTED QUERYAutomobile Roads and Road Construction10.33744/0365-8171-2023-113.2-171-179(171-179)Online publication date: 2023
https://doi.org/10.33744/0365-8171-2023-113.2-171-179
Guo HLi JXu YLong YZhou JWu W(2023)FaaSCom: Mitigate Cold Start Problem in FaaS via Function Community2023 IEEE 29th International Conference on Parallel and Distributed Systems (ICPADS)10.1109/ICPADS60453.2023.00151(1023-1030)Online publication date: 17-Dec-2023
https://doi.org/10.1109/ICPADS60453.2023.00151
Thallapally N(2022)Improving System Availability and Load Balancing in Distributed SystemsInternational Journal of Scientific Research in Computer Science, Engineering and Information Technology10.32628/CSEIT22547(567-573)Online publication date: 1-Jun-2022
https://doi.org/10.32628/CSEIT22547
Kumar AGupta RBhandari R(2022)WoS Bibliometric-based Review on Serverless Computing model2022 Seventh International Conference on Parallel, Distributed and Grid Computing (PDGC)10.1109/PDGC56933.2022.10053142(600-605)Online publication date: 25-Nov-2022
https://doi.org/10.1109/PDGC56933.2022.10053142
Hassan HBarakat SSarhan Q(2021)Survey on serverless computingJournal of Cloud Computing: Advances, Systems and Applications10.1186/s13677-021-00253-710:1Online publication date: 12-Jul-2021
https://dl.acm.org/doi/10.1186/s13677-021-00253-7
Zhao LYang YLi YZhou XLi Kde Supinski BHall MGamblin T(2021)Understanding, predicting and scheduling serverless workloads under partial interferenceProceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis10.1145/3458817.3476215(1-15)Online publication date: 14-Nov-2021
https://dl.acm.org/doi/10.1145/3458817.3476215
Patil RChaudhery TQureshi MSawant VDalvi H(2021)Serverless Computing and the Emergence of Function-as-a-Service2021 International Conference on Recent Trends on Electronics, Information, Communication & Technology (RTEICT)10.1109/RTEICT52294.2021.9573962(764-769)Online publication date: 27-Aug-2021
https://doi.org/10.1109/RTEICT52294.2021.9573962
Mahajan KMahajan SMisra VRubenstein DUnknown (2019)Exploiting content similarity to address cold start in container deploymentsProceedings of the 15th International Conference on emerging Networking EXperiments and Technologies - CoNEXT '1910.1145/3360468.3366781(37-39)Online publication date: 2019
https://doi.org/10.1145/3360468.3366781
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

The SPEC cloud group's research vision on FaaS and serverless architectures

Role of Serverless Computing in Healthcare Systems: Case Studies

On Merits and Viability of Multi-Cloud Serverless