IMPORTANT LEGAL NOTICE - The information on this site is subject todisclaimercopyright notice
Evaluation
  EUROPA > European Commission > EuropeAid > Evaluation > Methodology > Basics > How
Last updated: 09/11/2005
EuropeAid

Methodological bases
Evaluation process (How?)
Judgement references
Indicators

EuropeAid
 

Indicators derived from scoring

 


Methodology
• Evaluation Guidelines
• Methodological bases
• Evaluation tools
• Examples
• Glossary
• Sitemap

Methods
• What
• When
• Why
• Who
• How

How
• Overview
• Strategy
• Questions
• References
• Design
• Data collection
• Analysis
• Judgment
• Quality
assurance

References
• Overview
• Judgment criteria
• Family of
criteria

• New target
• Indicator

 
 

What does this mean?

Scoring (or rating) produces figures that synthesise a set of qualitative data and or opinions. Scoring is guided by a scoring grid (or scorecard) with varying degrees of detail.

From an evaluation point of view, both words scoring and rating can be used.



What is the point?

Scoring allows the production of structured and comparable data on judgement criteria that do not lend themselves to a measurement using quantitative indicators.



How to construct a scoring grid

  • Examine several possible dimensions for the criterion that has to be assessed (sub-criteria).
  • For each dimension or sub-criterion, write a short sentence defining the success of the intervention (descriptor of full success).
  • For each dimension or sub-criterion, write another sentence (descriptor) defining the failure of the intervention.
  • Write one or more sentences (descriptors) that represent intermediate levels of success.
  • Associate a score with each descriptor (e.g. from 0 to 10, from 0 to 3, from -3 to +3).
  • Weight the sub-criteria if necessary.
  • Test the grid on a few pilot examples.
  • Discuss the test with the reference group if relevant


How to use the scoring grid

Scoring grids usually apply to projects or components of the intervention and allow for comparing these.

The evaluation team puts together all the data it has on the project or intervention to be assessed. It then chooses the level (or descriptor) in the scoring grid that corresponds best (or the least badly) to this information. The score results from this choice.

Top

Recommendations

The more detailed the scoring grid the less subjective the score will be and the more comparable the scores allocated by two different evaluators will be.

Top