Assessing scientific performance

doi:10.1016/0306-4573(84)90074-8

Information Processing & Management

Volume 20, Issues 5–6, 1984, Pages 575-582

https://doi.org/10.1016/0306-4573(84)90074-8 Get rights and content

Abstract

A method for assessing scientific performance is proposed and illustrated. Advantages over existing methods are: (1) increased objectivity; (2) increased emphasis on what was rather than who contributed; and (3) increased accuracy in theme identification. The procedure is based on relationships displayed numerically in the published documents. These relationships are extracted and organized as a graphic display representing the conceptual structure for a subject. Individuals or groups contributing to the knowledge of the discipline can be identified. The extent of their contributions also can be documented.

The method is illustrated using published documents in Pediatric Oncology for the period 1979–1982. The contributions of a major clinical investigations group, the Childrens Cancer Study Group, are analyzed. The results show increasing contributions by the Group as the conceptual structure changes from the simplest measure of survival to ones requiring sophisticated follow-up and clinical evaluation procedures.

References (29)

J.M. Weiner et al.
Information processing using document data management techniques
A.S. Relman
Journals
J.K. Stross et al.
The dissemination of new medical information
J. Amer. Medical Assoc.
(1979)
I. Asimov
The New Intelligent Guide to Science
I. Asimov
The New Intelligent Guide to Science
H. Zuckerman
Nobel laureates in science: patterns of productivity, collaboration, and authorship
J.A. Chambers
Relating personality and biographical factors to scientific creativity
R.K. Merton
Priorities in scientific discovery: a chapter in the sociology of science
T.S. Kuhn
Energy conservation as an example of simultaneous discovery
W.O. Hagstrom
The Scientific Community
(1965)
N.W. Storer
Relations among scientific disciplines

A.J. Meadows

Communication in Science

(1974)

W.D. Garvey

Communication: The Essence of Science

(1979)

J.R. Cole et al.

Social Stratification in Science

(1973)

H.G. Small et al.

The structure of scientific literature, I. Identifying and graphing specialties

Science Studies

(1974)

Cited by (5)

Idea analysis: a new approach in using scientific literature
1989, International Journal of Man-Machine Studies
This paper describes a method for identifying the knowledge used by experts in the design of clinical trials. The ideas presented in numerical displays are identified in the medical literature dealing with clinical investigations of the disease. These ideas are extracted, computerized, retrieved, and compared with those in the clinical trial protocol prepared by the experts. The agreements and differences between the two sets of ideas provide insights into the cognitive behavior of experts as they design the therapeutic trial. By tracing the ideas involved, it is possible to estimate the “creation trail” used by the experts.
An example is given using the work of the Intergroup Rhabdomyosarcoma Study Committee (IRS). That committee has been the primary contributor of information dealing with the treatment of rhabdomyosarcoma in children. The IRS-III protocol was used in this analysis, because that protocol was adopted by the leading pediatric oncology clinical trial groups in North America and Europe.
The Idea Analysis method was found to be useful in identifying most of the ideas used in constructing the IRS-III protocol. Those features which were not direct extensions of the data-supported ideas previously published in the literature could be identified and put into perspective. In most instances, the logic and precursors of the innovative ingredients could be identified.
Tracing expert thinking in clinical trial design
1989, Computers and Biomedical Research
This paper describes a method for the analysis of the clinical trial design process used by experts. With this procedure, the scientific ideas and their sources can be identified and related to the clinical trial protocol actually prepared by the experts. An example is given using the work of the Intergroup Rhabdomyosarcoma Study Committee (IRS). That committee has been the primary contributor of information dealing with the treatment of rhabdomyosarcoma inchildren. The IRS-III protocol was used in this analysis of expert behavior because the protocol was adopted by the leading pediatric oncology clinical trial groups in North America and Europe. The analysis showed that the experts rely heavily, for much of the design, on ideas presented in numerical displays in published documents. Further, those aspects of the design which are innovative can be traced and better understood by applying the new procedure.
Scientometrics of Indian organic chemistry research
1999, Scientometrics
Making use of scientometric techniques, the paper attempts to assess the performance of Indian organic chemistry research during the 70s and 80s. Identifies the significant work and its impact using mainstream connectivity, surrogate measures of quality and relative impact indicators. It is observed that the organic chemistry research performed in India during the later period (80s) has improved slightly as compared to the previous period (70s).
A bibliometric profile of top-scientists a case study in chemical engineering
1994, Scientometrics
Article-by-article citation analysis of medical journals
1987, Scientometrics

View full text

Assessing scientific performance

Abstract

J. Amer. Medical Assoc.

The New Intelligent Guide to Science

The New Intelligent Guide to Science

Nobel laureates in science: patterns of productivity, collaboration, and authorship

Relating personality and biographical factors to scientific creativity

Priorities in scientific discovery: a chapter in the sociology of science

Energy conservation as an example of simultaneous discovery

The Scientific Community

Relations among scientific disciplines

Communication in Science

Communication: The Essence of Science

Social Stratification in Science

The structure of scientific literature, I. Identifying and graphing specialties

Science Studies