Integration of text and geospatial search for hydrographic datasets using the lucene search library
Article No.: 36, Pages 1 - 5
Abstract
We present a hybrid text and geospatial search application for hydrographic datasets built on the open-source Lucene search library. Our goal is to demonstrate that it is possible to build custom GIS applications by integrating existing open-source components and data sources, which contrasts with existing approaches based on monolithic platforms such as ArcGIS and QGIS. Lucene provides rich index structures and search capabilities for free text and geometries; the former has already been integrated and exposed via our group's Anserini and Pyserini IR toolkits. In this work, we extend these toolkits to include geospatial capabilities. Combining knowledge extracted from Wikidata with the HydroSHEDS dataset, our application enables text and geospatial search of rivers worldwide.
References
[1]
Josh Devins, Julie Tibshirani, and Jimmy Lin. 2022. Aligning the Research and Practice of Building Search Applications: Elasticsearch and Pyserini. In Proceedings of the 15th ACM International Conference on Web Search and Data Mining (WSDM 2022). 1573--1576.
[2]
Shane Ding, Edwin Zhang, and Jimmy Lin. 2020. Cydex: Neural Search Infrastructure for the Scholarly Literature. In Proceedings of the First Workshop on Scholarly Document Processing. 168--173.
[3]
Bernhard Lehner, Kristine Verdin, and Andy Jarvis. 2008. New Global Hydrography Derived From Spaceborne Elevation Data. Eos 89, 10 (2008), 93--94.
[4]
Jimmy Lin, Xueguang Ma, Sheng-Chieh Lin, Jheng-Hong Yang, Ronak Pradeep, and Rodrigo Nogueira. 2021. Pyserini: A Python Toolkit for Reproducible Information Retrieval Research with Sparse and Dense Representations. In Proceedings of the 44th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR 2021). 2356--2362.
[5]
Jimmy Lin, Rodrigo Nogueira, and Andrew Yates. 2021. Pretrained Transformers for Text Ranking: BERT and Beyond. Morgan & Claypool Publishers.
[6]
Rodrigo Nogueira, Zhiying Jiang, Ronak Pradeep, and Jimmy Lin. 2020. Document Ranking with a Pretrained Sequence-to-Sequence Model. In Findings of the Association for Computational Linguistics: EMNLP 2020. 708--718.
[7]
Stephen Robertson and Hugo Zaragoza. 2009. The Probabilistic Relevance Framework: BM25 and Beyond. Foundations and Trends in Information Retrieval 3, 4 (2009), 333--389.
[8]
Denny Vrandečić and Markus Krötzsch. 2014. Wikidata: A Free Collaborative Knowledgebase. Commun. ACM 57, 10 (Sept. 2014), 78--85.
[9]
Peilin Yang, Hui Fang, and Jimmy Lin. 2018. Anserini: Reproducible Ranking Baselines Using Lucene. Journal of Data and Information Quality 10, 4 (2018), Article 16.
[10]
Edwin Zhang, Nikhil Gupta, Raphael Tang, Xiao Han, Ronak Pradeep, Kuang Lu, Yue Zhang, Rodrigo Nogueira, Kyunghyun Cho, Hui Fang, and Jimmy Lin. 2020. Covidex: Neural Ranking Models and Keyword Search Infrastructure for the COVID-19 Open Research Dataset. In Proceedings of the First Workshop on Scholarly Document Processing. 31--41.
Index Terms
- Integration of text and geospatial search for hydrographic datasets using the lucene search library
Recommendations
Anserini Gets Dense Retrieval: Integration of Lucene's HNSW Indexes
CIKM '23: Proceedings of the 32nd ACM International Conference on Information and Knowledge ManagementAnserini is a Lucene-based toolkit for reproducible information retrieval research in Java that has been gaining traction in the community. It provides retrieval capabilities for both "traditional" bag-of-words retrieval models such as BM25 as well as ...
An approach to content-based image retrieval based on the Lucene search engine library
ECDL'10: Proceedings of the 14th European conference on Research and advanced technology for digital librariesContent-based image retrieval is becoming a popular way for searching digital libraries as the amount of available multimedia data increases. However, the cost of developing from scratch a robust and reliable system with content-based image retrieval ...
Integrating socio-economic and biophysical data to support water allocations within river basins: An example from the Inkomati Water Management Area in South Africa
Sustainable natural resource management requires inputs from both the natural and the social sciences. Since natural and social systems are inter-related and inter-dependent, it is essential that these data can be integrated within a given analysis, ...
Comments
Information & Contributors
Information
Published In
June 2022
392 pages
ISBN:9781450393454
DOI:10.1145/3529372
- General Chairs:
- Akiko Aizawa,
- Thomas Mandl,
- Zeljko Carevic,
- Program Chairs:
- Annika Hinze,
- Philipp Mayr,
- Philipp Schaer
Copyright © 2022 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].
Sponsors
In-Cooperation
- IEEE Technical Committee on Digital Libraries (TC DL)
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 20 June 2022
Check for updates
Author Tags
Qualifiers
- Short-paper
Funding Sources
- Canada First Research Excellence Fund
- Natural Sciences and Engineering Research Council (NSERC) of Canada
Conference
JCDL '22: The ACM/IEEE Joint Conference on Digital Libraries in 2022
June 20 - 24, 2022
Cologne, Germany
Acceptance Rates
JCDL '22 Paper Acceptance Rate 35 of 132 submissions, 27%;
Overall Acceptance Rate 415 of 1,482 submissions, 28%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 85Total Downloads
- Downloads (Last 12 months)13
- Downloads (Last 6 weeks)1
Reflects downloads up to 07 Mar 2025
Other Metrics
Citations
Cited By
View allView Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in