Srihari Nelakuditi
Abstract
A comprehensive qualitative assessment of a researcher's contribution in a specific narrow discipline takes time and expertise. Given the shortage of both in typical situations, a researcher's productivity is often judged quantitatively by the number of publications, their acceptance ratios, and citation counts that are highly discipline-dependent. We believe such a cursory evaluation is unavoidable and suggest a more intuitive discipline-agnostic approach for perfunctory assessment. We propose a metric called peers' reputation (PR) which ties the selectivity of a publication venue with the reputations of authors' institutions. Briefly, PR conveys the selectivity of a conference with a tuple, say <1/3 , 20>, indicating that 1/3 of the papers at that conference are from the top 20 universities. We compute PR for networking research publication venues, and argue that PR is a better indicator of selectivity than acceptance ratio, and many conferences have similar or better PR than journals. While these insights are not necessarily new to researchers in the networking community, PR metric helps inform a dean or a provost that getting a paper accepted at MobiCom involves competing with researchers from the top 20 US universities.
- http://www.publitics.net.Google Scholar
- CHEN, J., AND KONSTAN, J. A. Conference Paper Selectivity and Impact. Communications of ACM 53, 6 (June 2010). Google ScholarDigital Library
- CONFERENCE ACCEPTANCE STATISTICS. http://www.cs.ucsb.edu/ almeroth/conf/stats/.Google Scholar
- MICROSOFT ACADEMIC SEARCH. http://academic.research.microsoft.com/.Google Scholar
- NATIONAL RESEARCH COUNCIL. http://sites.nationalacademies.org/nrc/index.htm.Google Scholar
- US NEWS AND WORLD REPORT: RANKINGS - COMPUTER SCIENCE - GRADUATE SCHOOLS. http://gradschools.usnews.rankingsandreviews.com/best-graduateschools/top-computer-science-schools/rankings.Google Scholar
Index Terms
- Snap judgement of publication quality: how to convince a dean that you are a good researcher
Recommendations
Citation success of different publication types: a case study on all references in psychology publications from the German-speaking countries (D---A---CH---L---L) in 2009, 2010, and 2011
Scientometric data on the citation success of different publication types and publication genres in psychology publications are presented. Data refer to references that are cited in these scientific publications and that are documented in PSYNDEX, the ...
Researchers' risk-smoothing publication strategies: Is productivity the enemy of impact?
In the quest for balance between research productivity and impact, researchers in science and engineering are often encouraged to adopt a play-it-safe research and publication strategy that allows them to maintain high publication productivity and ...
Funding Data from Publication Acknowledgments: Coverage, Uses, and Limitations
This article contributes to the development of methods for analysing research funding systems by exploring the robustness and comparability of emerging approaches to generate funding landscapes useful for policy making. We use a novel data set of ...
Comments