Regular articlePatent citation inflation: The phenomenon, its measurement, and relative indicators to temper its effects
Introduction
In economics, it is well known that inflation reflects devaluation, i.e., that purchasing power decreases with excessive growth in the supply of money (Abel & Bernanke, 2005; Barro, 1997). However, when citation inflation occurs, does the same apply? Moreover, if so, how then can an idea’s value be accurately measured with citations? These are indeed important and interesting issues.
Half a century ago, de Solla Price (1961, 1963) proposed that the number of scientific publications would grow exponentially. Although the law of exponential growth in science has not been proven to be entirely correct, scientific research publications are experiencing very rapid growth (Larsen & von Ins, 2010). Patents have undergone similar growth, as evidenced by the increase in patents granted by the United States Patent and Trademark Office (USPTO) over the past several decades. For example, in 1976, the USPTO granted around 70,000 patents, but, by 2015, that number had quadrupled to around 300,000.
Although the external forces that drive patents differ from scientific publications in several respects – for example, economic incentives for R&D, competition, the need for market dominance, or the need to take public ownership of one’s ideas – both patents and scientific articles contain references that provide the potential approach to trace knowledge interactions and technology flows. Further, the mechanisms that generate the references within those outputs have some commonalities. References trace the provenance of knowledge and properly attribute the work of others (Criscuolo & Verspagen, 2008; Jaffe, Trajtenberg, & Fogarty, 2000). Authors, applicants, and patent examiners all conduct thorough searches for relevant references, often deeming an innovation to be novel when they do not find any (Cotropia, Lemley, & Sampat, 2013), and, today, the internet and information retrieval systems make it very easy to conduct exhaustive literature reviews that result in extensive reference lists. Cotropia (2009) and Sampat (2010) pointed out that an abundance of references can benefit patent applicants because their patents might earn the presumption of validity against the cited art in litigation since the examiners might not scrutinize each and every reference in an exhaustive list. Greater output and more references per unit of output would undoubtedly cause an explosion in references with the inevitable result of citation inflation.
In this article, we have chosen to examine patent citation inflation, i.e., citation inflation in a corpus of patents. Although we cannot attest that all our conclusions will hold true for the academic literature, we do believe that some of our findings will apply. Moreover, we hope our overarching purpose shines through, which is to explore the efficacy of traditional research performance indicators given the phenomenon of citation inflation. Hence, for this reason and for brevity, we simply use the term citation inflation throughout this article.
In recent decades, the references in patents have been used extensively to: trace the spread of technical knowledge (Chen & Hicks, 2004; Hu & Jaffe, 2003; Nelson, 2009; Park & Suh, 2013); chart technological trajectories (Epicoco, 2013; Érdi et al., 2013; Huang et al., 2017; Martinelli, 2012); map technical domains (Wang, Zhang, & Xu, 2011; Weng & Daim, 2012); and even to identify untapped opportunities for innovation (Albert, Avery, Narin, & McAllister, 1991; Lanjouw & Schankeman, 2004; Verspagen, 2000; von Wartburg, Teichert, & Rost, 2005). With so many studies relying on patents as a data source, the phenomenon of exploding references has not escaped attention. Hall, Jaffe, and Trajtenberg (2001) highlight that: “The combination of more patents making more citations suggests a kind of citation ‘inflation’ that may mean that later citations are less significant than earlier ones.” They also proposed several methods of tempering the effects of citation inflation (Hall, Jaffe, & Trajtenberg, 2000; Hall et al., 2001; Jaffe & Lerner, 2001; Jaffe & Trajtenberg, 1999). Persson et al. (2004) studied inflation in fundamental bibliometric indicators from the perspective of scientific collaboration, including citations counts, and concluded that relative indicators are needed to guarantee the validity of findings drawn from bibliometric results. Such calls also have peaked concern over inequitable journal impact factors as a result of citation inflation – especially self-citations (Chorus & Waltman, 2016; Heneberg, 2014, 2016; Ioannidis, 2015; Opthof, 2013).
Correctly evaluating the worth of citations is an essential issue because, in the same way that we cannot directly compare the box office takings of a movie released in 1939 with one released in this year, directly comparing the citations received by two pieces of research produced decades apart is just as absurd. Quantitative science & technology evaluation requires measures that are transparent, relatively simple, and free of any bias due to time, discipline, or field. In a very recent work, Petersen, Pan, Pammolli, and Fortunato (2019) provided a solution to the paper citation inflation that arises from growth in scientific publications and/or the increasing length of reference lists. However, patent citation inflation has not yet been addressed from a systematic perspective. With the above problems in mind, we set ourselves three goals:
- 1)
To conduct an in-depth exploration of the phenomena of citation inflation using patents as a corpus;
- 2)
To identify the different types of citation inflation and devise appropriate methods for measuring the impact of each;
- 3)
To develop relative indicators that more accurately reflect the worth of citation counts by properly accounting for inflation.
Section snippets
Data collection
As an important background note, throughout this paper, we make a distinction between “citations” and “references”: a reference is given, and a citation is received. To help keep this distinction in mind, think of a reference list in a paper that gives credit to the work of other scholars, while citation counts reflect the acknowledgments we as scholars receive for our work.
Our corpus for analysis consisted of USPTO utility patents granted between 1976 and 2015. To assemble the data, we
Measurement: two types of citation inflation
In economics, inflation relates to devaluation caused by an increase in the money supply, which leads to a general rise in the price of goods and services and, in turn, results in a loss of currency value. In this study, citation inflation refers to a devaluation of citation counts caused by an increased supply of patents and/or references. However, before we set out to measure citation inflation, we need to be aware that there are two types of citation inflation: absolute and comparative.
The cumulative effects of citation inflation
To mitigate the effects of citation inflation, it is necessary to consider the causes of citation inflation. Compared to absolute patent citation inflation, the causes of comparative inflation are less transparent, so this is where we have focused our attention. Fig. 8 shows the growth in the average number of citations grouped by the year the patent was granted. For example, as of 2015, patents granted in 1976 had received an average of 11.52 citations over 40 years, whereas patents granted in
Case study: Patent evaluations for eight US universities
The eight universities we selected for the case study were the University of California (UC), the Massachusetts Institute of Technology (MIT), Leland Stanford Junior University (Stanford), the California Institute of Technology (Caltech), Johns Hopkins University (Hopkins), the University of Wisconsin (UWisc), the University of Michigan (UMich), and Columbia University in the City of New York (Columbia). All are prestigious universities founded before 1976 (given our corpus for analysis
Conclusions and discussions
According to the theory of obsolescence, academic papers typically receive most of their citations in their first few years of life, after which they gradually receive fewer and fewer per year (Brookes, 1970; Burton & Kebler, 1960; de Solla Price, 1965; Gosnell, 1944; Griffith et al., 1979; Marton, 1985). This phenomenon of obsolescence also exists with patents: patent citations rapidly increase in the years immediately following a patent’s approval, peaking several years later before gradually
Author contributions
Ying Huang: Conceived and designed the analysis; Performed the analysis; Wrote the paper.
Lixin Chen: Collected the data; Performed the analysis; Wrote the paper.
Lin Zhang: Conceived and designed the analysis; Wrote the paper.
Acknowledgments
We would like to thank Professor Liming Liang (Henan Normal University) and the reviewers for their valuable comments and suggestions. This study was supported by the National Natural Science Foundation of China (Grant No. 71974150, 71573085 and No 71373252), the Excellent Scholars of Philosophy and Social Sciences in Henan Province (Grant No. 2018-YXXZ-10) and the Fundamental Research Funds for the Central Universities.
References (45)
- et al.
Direct validation of citation counts as indicators of industrially important patents
Research Policy
(1991) - et al.
Identifying missing relevant patent citation links by using bibliographic coupling in LED illuminating technology
Journal of Informetrics
(2011) - et al.
Do applicant patent citations matter?
Research Policy
(2013) - et al.
Does it matter where patent citations come from? Inventor vs. examiner citations in European patents
Research Policy
(2008) Knowledge patterns and sources of leadership: Mapping the semiconductor miniaturization trajectory
Research Policy
(2013)- et al.
Patent citations and international knowledge flow: The cases of Korea and Taiwan
International Journal of Industrial Organization
(2003) A generalized view of self-citation: Direct, co-author, collaborative, and coercive induced self-citation
Journal of Psychosomatic Research
(2015)An emerging paradigm or just another trajectory? Understanding the nature of technological changes using engineering heuristics in the telecommunications switching industry
Research Policy
(2012)Measuring knowledge spillovers: What patents, licenses and publications reveal about innovation diffusion
Research Policy
(2009)- et al.
Methods to account for citation inflation in research evaluation
Research Policy
(2019)
Inventive progress measured by multi-stage patent citation analysis
Research Policy
Macroeconomics
Macroeconomics
The growth, utility, and obsolescence of scientific periodical literature
Journal of Documentation
The “half-life” of some scientific and technical literatures
American Documentation
Tracing knowledge diffusion
Scientometrics
A large-scale analysis of impact factor biased journal self-citations
PloS One
Modernizing patent law’s inequitable conduct doctrine
Berkeley Technology Law Journal
Science since babylon
Little science, big science
Networks of scientific papers
Science
Prediction of emerging technologies based on analysis of the US patent citation network
Scientometrics
Cited by (9)
How to detect the sleeping beauty papers and princes in technology considering indirect citations?
2023, Journal of InformetricsHow public investment fuels innovation: Clues from government-subsidized USPTO patents
2022, Journal of InformetricsCitation Excerpt :As patent filing is sometimes driven by motives other than seeking protection or the actual granting of a patent, incorporating all patents, including applications, into a corpus for analysis might result in a less perfect representation of innovation. Hence, we used granted patents instead of patents filed in the USPTO as a more appropriate sample, following one of our studies on patent citation inflation in the USPTO (Huang et al., 2020). Further, we only included utility patents in our sample, excluding the other types of patents, such as Design, Plant, Reissue, and Defensive Publication patents, for several reasons.
A collaborative evaluation method of the quality of patent scientific and technological resources
2021, World Patent InformationCitation Excerpt :To provide users with scientific and technological services more efficiently, it is critical to evaluate the quality of such resources scientifically and accurately. As patents are an important kind of scientific and technological resources, patent evaluation has drawn extensive from academics during recent years [5–7]. Yet still, to the best of our knowledge, a unified patent value evaluation system has not been formed yet.
Become a better you: Correlation between the change of research direction and the change of scientific performance
2021, Journal of Informetrics