Towards objectivity in research evaluation using bibliometric indicators - a protocol for incorporating complexity

Autor: Retzer, V., Jurasinski, G.
In:

Basic and Applied Ecology

Bandangabe: 10
Auflage: 5
Seite: 393 - 400
Jahr: 2009

Einordung:
Institut: Professur Landschaftsökologie und Standortkunde

Abstract:
Publications are thought to be an integrative indicator best suited to measure the multifaceted nature of scientific performance. Therefore, indicators based on the publication record (citation analysis) are the primary tool for rapid evaluation of scientific performance. Nevertheless, it has to be questioned whether the indicators really measure what they are intended to measure because people adjust to the use of the indicator system by optimizing their indicator rather than the performance itself. Thus, no matter how sophisticated an indicator may be, it will never be proof against manipulations. A literature review identifies the most critical problems of citation analysis: database-related problems, boosted citation records, biases in citation rates and crediting of multi-author papers. We present a step-by-step protocol to address these problems. By applying this protocol, reviewers can avoid most of the pitfalls associated with the pure numbers of indicators and achieve a fast but fair evaluation of a scientist’s performance. We as ecologists should accept complexity not only in our research but also in our research evaluation and should encourage scientists of other disciplines to do so as well.

Zur Publikation: Mitarbeiter, Projekte
Weitere Publikationen im Forschungsteilschwerpunkt