Mitigating Bias in GLAM Search Engines: A Simple Rating-Based Approach and Reflection
Authors: 
Xinran Tian, Bernardo Pereira Nunes, Katrina Grant, Marco Antonio CasanovaAuthors Info & Claims
Xinran Tian, Bernardo Pereira Nunes, Katrina Grant, Marco Antonio CasanovaAuthors Info & ClaimsArticle No.: 25, Pages 1 - 5
Abstract
Galleries, Libraries, Archives and Museums (GLAM) institutions are increasingly opening up their digitised collections and associated data for engagement online via their own websites/search engines and for reuse by third parties. Although bias in GLAM collections is inherent, bias in the search engines themselves can be rated. This work proposes a bias rating method to reflect on the use of search engines in the GLAM sector along with strategies to mitigate bias. The application of this to an existing large art collection shows the applicability of the proposed method and highlights a range of existing issues.
References
[1]
Arifah Addison, Christoph Bartneck, and Kumar Yogeeswaran. 2019. Robots Can Be More Than Black And White: Examining Racial Bias Towards Robots. In Proceedings of the 2019 AAAI/ACM Conference on AI, Ethics, and Society (Honolulu, HI, USA) (AIES '19). ACM, New York, NY, USA, 493--498. https://doi.org/10.1145/3306618.3314272
[2]
Marzieh Babaeianjelodar, Stephen Lorenz, Josh Gordon, Jeanna Matthews, and Evan Freitag. 2020. Quantifying Gender Bias in Different Corpora. In Companion Proceedings of the Web Conference 2020 (Taipei, Taiwan) (WWW '20). ACM, New York, NY, USA, 752--759. https://doi.org/10.1145/3366424.3383559
[3]
Pierre Bourdieu, Dominique. Schnapper, and Alain. Darbel. 1991. The love of art: European art museums and their public / Pierre Bourdieu and Alain Darbel with Dominique Schnapper; translated by Caroline Beattie and Nick Merriman. Polity Press Cambridge, UK. viii, 182 p.; pages.
[4]
Aleksandr Chuklin, Ilya Markov, and Maarten de Rijke. 2015. Click Models for Web Search. Morgan & Claypool.
[5]
Kelly Davis. 2019. Old metadata in a new world: Standardizing the Getty Provenance Index for linked data. Art Libraries Journal 44, 4 (Oct. 2019), 162--166. https://doi.org/10.1017/alj.2019.24
[6]
Carol Duncan. 2012. Art museums and the ritual of citizenship. In Interpreting Objects and Collections, Susan Pearce (Ed.). Routledge, 291--298. https://doi.org/10.4324/9780203428276
[7]
Fangxiaoyu Feng, Yinfei Yang, Daniel Cer, Naveen Arivazhagan, and Wei Wang. 2020. Language-agnostic BERT Sentence Embedding. arXiv:2007.01852 [cs.CL]
[8]
Kathryn M. Hunter. 2017. Silence in Noisy Archives: Reflections on Judith Allen's 'Evidence and Silence -- Feminism and the Limits of History' (1986) in the Era of Mass Digitisation. Australian Feminist Studies 32, 91-92 (April 2017), 202--212. https://doi.org/10.1080/08164649.2017.1357009
[9]
Inna Kizhner, Melissa Terras, Maxim Rumyantsev, Valentina Khokhlova, Elisaveta Demeshkova, Ivan Rudov, and Julia Afanasieva. 2020. Digital cultural colonialism: measuring bias in aggregated digitized content held in Google Arts & Culture. Digital Scholarship in the Humanities (2020).
[10]
Shirley Lim and Chern Li Liew. 2011. Metadata quality and interoperability of GLAM digital images. Aslib Proceedings 63, 5 (01 Jan 2011), 484--498. https://doi.org/10.1108/00012531111164978
[11]
Yinhan Liu, Myle Ott, Naman Goyal, Jingfei Du, Mandar Joshi, Danqi Chen, Omer Levy, Mike Lewis, Luke Zettlemoyer, and Veselin Stoyanov. 2019. RoBERTa: A Robustly Optimized BERT Pretraining Approach. arXiv:1907.11692 [cs.CL]
[12]
Sharon Macdonald. 2011. A Companion to Museum Studies. Wiley, New York.
[13]
Sean Minney. 2021. Digital Trasnformation in the Asutralian GLAM sector: Staffing differences. https://metodhology.anu.edu.au/index.php/2021/01/14/digital-transformation-in-the-australian-glam-sector-staffing-differences/
[14]
Gaby Porter. 1990. Gender bias: Representations of work in history museums. Continuum 3, 1 (Jan. 1990), 70--83. https://doi.org/10.1080/10304319009388150
[15]
Victor Sanh, Lysandre Debut, Julien Chaumond, and Thomas Wolf. 2020. DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter. arXiv:1910.01108 [cs.CL]
[16]
Biplav Srivastava and Francesca Rossi. 2018. Towards Composable Bias Rating of AI Services. In Proceedings of the AAAI Conf. on AI, Ethics, and Society (New Orleans, LA, USA). ACM, 284--289.
[17]
Xuanhui Wang, Michael Bendersky, Donald Metzler, and Marc Najork. 2016. Learning to Rank with Selection Bias in Personal Search. In Proc of the 39th Int'l ACM SIGIR Conf. on Research and Development in Information Retrieval (Pisa, Italy) (SIGIR '16). ACM, 115--124.
Index Terms
- Mitigating Bias in GLAM Search Engines: A Simple Rating-Based Approach and Reflection
Recommendations
Evaluating the performance and neutrality/bias of search engines
VALUETOOLS 2019: Proceedings of the 12th EAI International Conference on Performance Evaluation Methodologies and ToolsDifferent search engines provide different outputs for the same keyword. This may be due to different definitions of relevance, to different ranking aggregation methods, and/or to different knowledge/anticipation of users' preferences, but rankings are ...
Measuring search engine bias
This paper examines a real-time measure of bias in Web search engines. The measure captures the degree to which the distribution of URLs, retrieved in response to a query, deviates from an ideal or fair distribution for that query. This ideal is ...
Search engines and the public use of reason
How should the policies of search engines and other information intermediaries be ethically evaluated__ __ It is argued that Kant's principles for the public use of reason are useful starting points for the formulation of criteria for such an ...
Comments
Information & Contributors
Information
Published In
September 2023
334 pages
ISBN:9798400702327
DOI:10.1145/3603163
Copyright © 2023 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].
Sponsors
In-Cooperation
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 05 September 2023
Check for updates
Author Tags
Qualifiers
- Short-paper
- Research
- Refereed limited
Conference
HT '23
Sponsor:
Acceptance Rates
Overall Acceptance Rate 378 of 1,158 submissions, 33%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 161Total Downloads
- Downloads (Last 12 months)107
- Downloads (Last 6 weeks)23
Reflects downloads up to 02 Mar 2025
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in