Skip to main content

Gatekeeper: Quantifying the Impacts of Service to the Scientific Community

  • Conference paper
  • First Online:
Digital Libraries for Open Knowledge (TPDL 2019)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 11799))

Included in the following conference series:

  • 1635 Accesses

Abstract

Academic scholars have several duties, including teaching, research, and service to the community and society. While a scholar’s research impacts can be reasonably measured and tracked via citation analysis in existing digital libraries, to our best knowledge, there has been no system that systematically collects and quantifies a scholar’s impacts of service to the scientific community. In particular, we are interested in measuring scholars’ impacts as “gatekeepers,” who play a key role in the spread of research findings and new knowledge via the accept/reject decisions of research articles. In this work, toward this goal, we present a prototype digital library, Gatekeeper, that crawls, extracts, and quantifies the impacts of service based on one’s roles in the technical program committees of Computer Science conferences.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 64.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 84.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    https://www.microsoft.com/en-us/research/project/microsoft-academic-graph/.

  2. 2.

    https://nlp.stanford.edu/software/CRF-NER.html.

References

  1. Atdaǧ, S., Labatut, V.: A comparison of named entity recognition tools applied to biographical texts. In: International Conference on Systems and Computer Science (2013)

    Google Scholar 

  2. Brin, S., Page, L.: The anatomy of a large scale hypertextual Web search engine, published version. In: Computer Networks and ISDN Systems (1998)

    Google Scholar 

  3. Chen, P., Xie, H., Maslov, S., Redner, S.: Finding scientific gems with Google’s PageRank algorithm. J. Informetr. 1, 8–15 (2007)

    Article  Google Scholar 

  4. Egghe, L.: Theory and practise of the g-index. Scientometrics 69, 131–152 (2006)

    Article  Google Scholar 

  5. Fang, H., Zhai, C.X.: Probabilistic models for expert finding. In: Amati, G., Carpineto, C., Romano, G. (eds.) ECIR 2007. LNCS, vol. 4425, pp. 418–430. Springer, Heidelberg (2007). https://doi.org/10.1007/978-3-540-71496-5_38

    Chapter  Google Scholar 

  6. Garfield, E.: Citation indexes for science. Science 122, 108–111 (1955)

    Article  Google Scholar 

  7. Garfield, E.: The history and meaning of the journal impact factor (2006)

    Article  Google Scholar 

  8. Hirsch, J.E.: An index to quantify an individual’s scientific research output. Proc. Natl. Acad. Sci. U S A 102, 16569–16572 (2005)

    Article  Google Scholar 

  9. Kleinberg, J.M.: Authoritative sources in a hyperlinked environment. J. ACM 46, 604–632 (1999)

    Article  MathSciNet  Google Scholar 

  10. Li, X., Rong, W., Shi, H., Tang, J., Xiong, Z.: The impact of conference ranking systems in computer science: a comparative regression analysis. Scientometrics 116(2), 879–907 (2018)

    Article  Google Scholar 

  11. Sidiropoulos, A., Manolopoulos, Y.: A new perspective to automatically rank scientific conferences using digital libraries. Inf. Process. Manag. 41, 289–312 (2005)

    Article  Google Scholar 

  12. Yan, S., Lee, D.: Toward alternative measures for ranking venues: a case of database research community. In: 7th ACM/IEEE-CS Joint Conference on Digital Libraries (JCDL), pp. 235–244. ACM, New York (2007)

    Google Scholar 

  13. Zhuang, Z., Elmacioglu, E., Lee, D., Giles, C.L.: Measuring conference quality by mining program committee characteristics. In: 7th ACM/IEEE-CS Joint Conference on Digital Libraries (JCDL) (2007)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding authors

Correspondence to Spyke Krepshaw or Dongwon Lee .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Krepshaw, S., Lee, D. (2019). Gatekeeper: Quantifying the Impacts of Service to the Scientific Community. In: Doucet, A., Isaac, A., Golub, K., Aalberg, T., Jatowt, A. (eds) Digital Libraries for Open Knowledge. TPDL 2019. Lecture Notes in Computer Science(), vol 11799. Springer, Cham. https://doi.org/10.1007/978-3-030-30760-8_11

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-30760-8_11

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-30759-2

  • Online ISBN: 978-3-030-30760-8

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics