Skip to main content
Log in

Indicators for the dynamics of research organizations: a biomedical case study

  • Published:
Scientometrics Aims and scope Submit manuscript

Abstract

This paper reports results on a bibliometric case study of the long-term development of research organizations, using an internationally leading biomedical institute as example. Using scientometric concepts, small group theory, organizational ecology, and process-based organizational theory, we developed a life cycle based theoretical model for analyzing long-term development of research groups and institutes. Three bibliometric indicators are proposed for growth, activity profile stability, and focus. With these, the research dynamics of the case institute are described. First, overall output growth matches developments internationally in developmental biology and stem cell research, and, in line with this, journal article output increasingly dominates the institute’s activity profile. Second, superposed on the overall growth curve, a stepwise development is observed, consisting of long phases of growth and stabilisation. These steps reflect local conditions and events. Historical sources from the Institutes’ archive and interviews with the current staff of the institute suggest that the pattern of life cycles reflects a strong influence of pioneering individuals. But once settled, pioneering directors who remain in function for many years delay adaptation of the institutes’ mission to field developments. Furthermore, national science policies on PhD training, and on priority areas have influenced the life cycles, as did merging with other institutes. As in a social science case, also in this case study stabilized local conditions lead to adaptation to research field dynamics in a delayed fashion. In the present case stable output periods lasted at most 15 years, when local impulses led to new growth of research output and thus prevented onset of a lifecycle decline. The continued growth in the larger field both promoted and legitimized these local impulses.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

Notes

  1. Hubrecht Institute for Developmental Biology and Stem Cell Research, Utrecht, The Netherlands.

  2. We use the concept of ‘group’ here interchangeable with ‘laboratory’, and ‘institute’.

  3. A domain is a relatively secluded social context wherein a research group performs activities. Larédo and Mustar (2000) distinguish five such domains: the scientific arena; the education system; the economic system; government; public media.

  4. \( {\text{Sim }}\left( {{\text{APyr}}_{t} ,{\text{ APyr}}_{t - 1} } \right) = \frac{{\sum\limits_{i = 1}^{n} {\left( {{\text{Ai}}_{\text{yrt}} } \right)*\left( {{\text{Ai}}_{{{\text{yrt}} - 1}} } \right) } }}{{\surd \sum\limits_{i = 1}^{n} {\left( {{\text{Ai}}_{\text{yrt}} } \right)^{ 2} *\surd \sum\limits_{i = 1}^{n} {\left( {{\text{Ai}}_{{{\text{yrt}} - 1}} } \right)^{ 2} } \, } }} = \left( {0, 1} \right) \)

    where APyr t is the Activity Profile: items on activities of category i to n, in year t;

    Aiyrt is the output items in Activity category i (e.g. journal publication) in Year t.

    This ‘Cosine’ formula: Salton and McGill (1983), and Jones and Furnas (1987); the approach is similar to one earlier introduced to compare term profiles of document clusters (Braam, 1991).

  5. We use integer counts of items per year as for all output categories. At the item level, differences may exist in time and efforts to produce them, both between and within categories, but data to correct for this are lacking. In our analysis of long term patterns in output production this is not a large problem: each output category can be followed, and local fluctuations, due to the production of ‘rare’ items consuming much time and effort, are captured if other output decreases as a result. For performance comparison, it can be more sensitive (Moed 2005).

  6. Sources: www.hubrecht.eu/information/history.html; www.developmental-biology.org/about/about.html, Gerhart (1997).

  7. The KNAW has as its other main tasks science policy advice, promoting scientific cooperation, and quality assessment. In this latter task, the KNAW closely cooperates with the research council (NWO) and the association of Netherlands universities (VSNU).

  8. http://www.hubrecht.eu/information/publications.html.

  9. Web of Science, 16 September 2009; Topic = (development * biology); Timespan = All Years. Databases = SCI-EXPANDED, SSCI, A&HCI, CPCI-S, CPCI-SSH. 28,218 records. The documents are classified in subject areas as biochemistry & molecular biology (3.192), cell biology (2.406), oncology (1.681), biotechnology and applied microbiology (1.397), genetics & heredity (1.386), plant sciences (1.383), biology (1.215), entomology (1.184), developmental biology (1174), and others. Of the 28.218 found documents, 15.177 were articles; 7.590 reviews and 3.909 proceedings papers. Of the found documents, 26.970 were in the English language. Most were from the USA (12.594), whereas the Netherlands came 11th with 646 records counted.

    Web of Science, 16 September 2009; TI = (stem AND cell*); Timespan = All Years. Databases = SCI-EXPANDED, SSCI, A&HCI, CPCI-S, CPCI-SSH. 67.043 records. Note: As Topic search was larger than 100.000, we used a TI search, so we underestimate the number of papers here. The documents were classified in many different subject areas, most in haematology (29.187), then in oncology (13.499), immunology (11.286), transplantation (10.495), cell biology (8.408), biophysics (7.912) medicine (6.168), biochemistry & molecular biology (4.167), and in biotechnology & applied microbiology (3.991), all others subject areas were below 5.000 documents for this search. Most records were from USA (24.674), the Netherlands was at 9th place with 2.052 records counted. Document types were: meeting abstracts (28.509), articles (25.875), reviews (3.645) and proceedings papers (3.103). The specific terms used in the search may underestimate activities worldwide, and for stem cell research even more (see above). Still, the general pattern is quite clear: a continuous growth of output in these particular research areas.

  10. And of course contributed to these trends. Several directors were internationally leading pioneers in the field, and e.g., Nieuwkoop founded the International Society of Developmental Biologists.

  11. KNAW Yearbook 1948, pp. 92–96; 1949, pp. 115–116; 1950, pp. 209–210.

  12. KNAW Yearbook 1971, p. 157.

  13. KNAW Yearbook 1983, 1984.

  14. KNAW Yearbook 1985, 1986.

  15. KNAW Yearbook 1989, 1990, 1991; Annual Report KNAW 1992.

  16. Hubrecht Laboratory, Progress Report 1993.

  17. Hubrecht Laboratory, Progress Report 1994.

  18. Hubrecht Institute/Laboratory Progress Report 2007, 2006, 2005, 2004.

  19. Hubrecht Laboratory Progress Report 2003.

  20. Hubrecht Laboratory Progress Report 2005, 2006.

  21. Stepwise, as we observe periods without output growth of the HI, whereas global output steadily increases.

References

  • Arrow, H., Henry, K. B., Poole, M. S., Wheelan, S., & Moreland, R. (2005). Traces, trajectories, and timing: The temporal perspective on groups. In M. S. Poole & A. B. Hollingshead (Eds.), Theories of small groups: Interdisciplinary perspectives (pp. 313–367). Thousand Oaks, CA: Sage.

  • Bonaccorsi, A. (2008). Search regimes and the industrial dynamics of science. Minerva, 46, 285–315.

    Article  Google Scholar 

  • Braam, R. R. (1991). Mapping of science: foci of intellectual interest in scientific literature. Thesis. Leiden, The Netherlands: DSWO Press.

  • Braam, R., & Van den Besselaar, P. (2010). Life cycles research groups: The case of CWTS. Research Evaluation, 19, 173–184.

    Article  Google Scholar 

  • De Solla Price, D. (1963). Little science big science. Paperback edition 1965. New York: Columbia University Press.

  • Faasse, P. (1999). Zuiver om de Wetenschap, De Akademie en haar levenswetenschappe-lijke instituten (Fundamentally for science: the life science institutes of the Academy of Science, KNAW, Amsterdam).

  • Hannan, M. T., Polos, L., & Carroll, G. R. (2007). Logics of organization theory: Audiences, codes, and ecologies. Princeton, NJ: Princeton University Press.

    Google Scholar 

  • Jones, W. P., & Furnas, G. W. (1987). Pictures of relevance: A geometric analysis of similarity measures. Journal of the American Society for Information Science, 36, 420–442.

    Article  Google Scholar 

  • Larédo, P., & Mustar, P. (2000). Laboratory activity profiles: An exploratory approach. Scientometrics, 47, 515–539.

    Article  Google Scholar 

  • Moed, H. F. (2000). Bibliometric indicators reflect publication and management strategies. Scientometrics, 47, 323–346.

    Article  Google Scholar 

  • Moed, H. F. (2005). Citation analysis in research evaluation. Dordrecht: Springer.

    Google Scholar 

  • Nederhof, A. J. (1985). Evaluating research output through life work citation counts. Scientometrics, 7(1–2), 23–28.

    Article  Google Scholar 

  • Poole, M. S., & Hollingshead, A. B. (Eds.). (2005). Theories of small groups, interdisciplinary perspectives. Thousand Oaks: Sage.

  • Poole, M. S., Van de Ven, A. H., Dooley, K., & Holmes, M. (2000). Organizational change and innovation processes: Theory and methods for research. New York: Oxford University Press.

    Google Scholar 

  • Sanz-Menendez, L., & Cruz-Castro, L. (2003). Coping with environmental pressures: Public research organisations responses to funding crises. Research Policy, 32, 1293–1308.

    Article  Google Scholar 

  • Salton, G., & McGill, M. J. (1983). Introduction to modern information retrieval. New York, NY: McGraw-Hill.

    MATH  Google Scholar 

  • Taylor, W. (2008). Change-point analyzer software. Libertyville: Taylor Enterprises, Inc. http://www.variation.com

  • Van Raan, A. F. J. (2000). R&D evaluation at the beginning of the new century. Research Evaluation, 8(2), 81–86.

    Google Scholar 

Sources on history of Hubrecht Laboratory/Institute

  • Clevers, H. (2008). Report by the Director, Site visit Hubrecht Institute, October 2008.

  • De Laat, S., Faber, J., & Bluemink, J. G. (Eds.). (1986). Hubrecht Laboratory, Netherlands Institute for Developmental Biology (NIOB), 70th anniversary brochure. Royal Netherlands Academy of Arts and Sciences, Amsterdam.

  • De Laat, S. W. (1996). History and development of the Hubrecht Laboratory, notation at the 80th anniversary of the Hubrecht Laboratory, KNAW-Hubrecht Laboratory, Utrecht.

  • Faasse P., et al. (1999). A brief history of the Hubrecht Laboratory. The International Journal of Developmental Biology, Special Issue Hubrecht Laboratory, 43(7), 583–590.

  • Gerhart, J. (1997). In memoriam: Pieter Nieuwkoop. Developmental Biology, 182, 1–4.

    Article  Google Scholar 

  • KNAW Annual Report (in Dutch), 2009, 2002, 1999, 1998, 1992.

  • KNAW Yearbook (in Dutch), issues for the years 1991–1983; 1970–1966; 1952–1942; 1941 (with publication list 1917–1941), 1940–1937.

  • Piekaar, A. J. Openingswoord bij de opening van het Hubrecht Laboratorium te Utrecht, directeur-generaal voor de wetenschappen, uitgesproken op 16 juli 1964, te Utrecht. Document from Hubrecht Library.

  • Progress Reports Hubrecht Laboratory, 2007–2003, 2001, 2000, 1997–1993, 1987.

  • Website of the Hubrecht Institute: http://www.hubrecht.eu/information/history.html

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Peter van den Besselaar.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Braam, R., van den Besselaar, P. Indicators for the dynamics of research organizations: a biomedical case study. Scientometrics 99, 949–971 (2014). https://doi.org/10.1007/s11192-014-1235-5

Download citation

  • Received:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11192-014-1235-5

Keywords

Navigation