Professional Documents
Culture Documents
What Is ' Evaluation ' of Research Achievements and Impacts
What Is ' Evaluation ' of Research Achievements and Impacts
Robert Tijssen
Source: The role of evaluation in the 21th century foundation / Edward Pauly. - Gütersloh : Bertelsmann Foundation, 2005
‘Research evaluation’
How ‘systematic’?
Purpose
Methodologies
Key weaknesses
Objectives are not clearly specified
Narrow basis for judging the level of attainment of a project or program
Focuses primarily on (short term) results
Elements are (not sufficiently) amenable to quantitative measures
Evaluation Methods and Tools
Qualitative
In-depth, open-ended interviews
Direct observation
Written document analysis
Independent external sources (e.g. expert panels)
Quantitative
Questionnaires
Independent external sources (e.g. statistical data on
publication output and citation impact)
Improving and adapting
evaluation methodologies
People
Creativity and ideas
Risk taking
Long term agenda’s
International competition and/or cooperation
Trust, but verify
Include measurable objectives
Numbers matter