skip to main content
opinion
Free access

The web is missing an essential part of infrastructure: an open web index

Published: 20 March 2019 Publication History

Abstract

A proposal for building an index of the Web that separates the infrastructure part of the search engine---the index---from the services part that will form the basis for myriad search engines and other services utilizing Web data on top of a public infrastructure open to everyone.

References

[1]
Broder, A. A taxonomy of Web search. ACM SIGIR Forum 36, 2 (2002), 3--10.
[2]
Epstein, R. and Robertson, R.E. The search engine manipulation effect (SEME) and its possible impact on the outcomes of elections. In Proceedings of the National Academy of Sciences 112, 33 (2015), E4512--E4521.
[3]
European Commission. Antitrust: Commission fines Google €2.42 billion for abusing dominance as search engine by giving illegal advantage to own comparison shopping service---Factsheet, 2017; https://bit.ly/2tRknDJ.
[4]
Goel, S. et al. Anatomy of the long tail: Ordinary people with extraordinary tastes. In Proceedings of the Third ACM International Conference on Web Search and Data Mining, ACM (2010), 201--210.
[5]
Grimmelmann, J. Some skepticism about search neutrality. The Next Digital Decade: Essays on the Future of the Internet 31, (2010), 435--460.
[6]
Lewandowski, D. Is Google responsible for providing fair and unbiased results? In M. Taddeo and L. Floridi, Hrsg., The Responsibilities of Online Service Providers. Springer, Berlin Heidelberg, 2017, 61--77.
[7]
Noble, S.U. Algorithms of Oppression: How Search Engines Reinforce Racism. New York University Press, NY, USA, 2018.
[8]
Purcell, K., Brenner, J., and Raine, L. Search Engine Use 2012. Washington, D.C., USA, 2012.
[9]
Schwartz, B. Google's search knows about over 130 trillion pages. Search Engine Land, 2016; https://selnd.com/2g7MnA7.
[10]
Sterling, G. Data: Google monthly search volume dwarfs rivals because of mobile advantage. Search Engine Land, 2017.
[11]
Sullivan, D. Google now handles at least 2 trillion searches per year. Search Engine Land, 2016; https://selnd.com/2GsdYYq
[12]
Sullivan, L. Report: Companies will spend $65 billion on SEO in 2016. Media Post, 2016; https://bit.ly/2BqNrqX
[13]
White, R.W. and Horvitz, E. Cyberchondria. ACM Transactions on Information Systems 27, 4 (2009), Article No. 23.

Cited By

View all
  • (2024)Making exploratory search engines using qualitative case studies: a mixed method implementation using interviews with Detroit ArtisansJournal of Integrated Global STEM10.1515/jigs-2024-00071:1(15-32)Online publication date: 15-Nov-2024
  • (2024)The Open Web IndexAdvances in Information Retrieval10.1007/978-3-031-56069-9_10(130-143)Online publication date: 24-Mar-2024
  • (2023)Algorithms, UsersKeywords In and Out of Context10.1007/978-3-031-32530-4_10(141-154)Online publication date: 4-Jun-2023
  • Show More Cited By

Index Terms

  1. The web is missing an essential part of infrastructure: an open web index

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image Communications of the ACM
    Communications of the ACM  Volume 62, Issue 4
    April 2019
    136 pages
    ISSN:0001-0782
    EISSN:1557-7317
    DOI:10.1145/3321370
    Issue’s Table of Contents
    Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 20 March 2019
    Published in CACM Volume 62, Issue 4

    Check for updates

    Qualifiers

    • Opinion
    • Popular
    • Un-reviewed

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)493
    • Downloads (Last 6 weeks)129
    Reflects downloads up to 18 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)Making exploratory search engines using qualitative case studies: a mixed method implementation using interviews with Detroit ArtisansJournal of Integrated Global STEM10.1515/jigs-2024-00071:1(15-32)Online publication date: 15-Nov-2024
    • (2024)The Open Web IndexAdvances in Information Retrieval10.1007/978-3-031-56069-9_10(130-143)Online publication date: 24-Mar-2024
    • (2023)Algorithms, UsersKeywords In and Out of Context10.1007/978-3-031-32530-4_10(141-154)Online publication date: 4-Jun-2023
    • (2023)The Future of SearchUnderstanding Search Engines10.1007/978-3-031-22789-9_16(275-282)Online publication date: 8-Mar-2023
    • (2023)JASIST Special Issue EditorialJournal of the Association for Information Science and Technology10.1002/asi.2484575:5(503-511)Online publication date: 27-Oct-2023
    • (2023)Impact and development of an Open Web Index for open web searchJournal of the Association for Information Science and Technology10.1002/asi.2481875:5(512-520)Online publication date: 7-Aug-2023
    • (2022)Public awareness and attitudes towards search engine optimizationBehaviour & Information Technology10.1080/0144929X.2022.205650742:8(1025-1044)Online publication date: 6-Apr-2022
    • (2022)A Comparison of Source Distribution and Result Overlap in Web Search EnginesProceedings of the Association for Information Science and Technology10.1002/pra2.75859:1(346-357)Online publication date: 14-Oct-2022
    • (2022)Whose relevance? Web search engines as multisided relevance machinesJournal of the Association for Information Science and Technology10.1002/asi.2457073:5(637-642)Online publication date: 1-Apr-2022
    • (2021)Legal challenges of an open web indexInternational Cybersecurity Law Review10.1365/s43439-021-00017-8Online publication date: 16-Mar-2021
    • Show More Cited By

    View Options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Digital Edition

    View this article in digital edition.

    Digital Edition

    Magazine Site

    View this article on the magazine site (external)

    Magazine Site

    Login options

    Full Access

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media