What does this mean?
Scoring (or rating) produces figures that synthesise a set of qualitative data and or opinions. Scoring is guided by a scoring grid (or scorecard) with varying degrees of detail.
From an evaluation point of view, both words scoring and rating can be used.
What is the point?
Scoring allows the production of structured and comparable data on judgement criteria that do not lend themselves to a measurement using quantitative indicators.
How to construct a scoring grid
- Examine several possible dimensions for the criterion that has to be assessed (sub-criteria).
- For each dimension or sub-criterion, write a short sentence defining the success of the intervention (descriptor of full success).
- For each dimension or sub-criterion, write another sentence (descriptor) defining the failure of the intervention.
- Write one or more sentences (descriptors) that represent intermediate levels of success.
- Associate a score with each descriptor (e.g. from 0 to 10, from 0 to 3, from -3 to +3).
- Weight the sub-criteria if necessary.
- Test the grid on a few pilot examples.
- Discuss the test with the reference group if relevant
How to use the scoring grid
Scoring grids usually apply to projects or components of the intervention and allow for comparing these.
The evaluation team puts together all the data it has on the project or intervention to be assessed. It then chooses the level (or descriptor) in the scoring grid that corresponds best (or the least badly) to this information. The score results from this choice.