An evaluation team had evidence of the equal opportunities impact of a range of measures. These are presented in the form of the synoptic table , in which each column concerns an impact cluster and contains the conclusions drawn on all related measures (see extract below).
|
Extract from synoptic presentation of conclusions relative to an impact |
||
|
Measure |
Description of the equal opportunities impact |
|
|
1 |
Training intended for the long-term unemployed |
The training had a positive impact in terms of orientating women towards secure jobs traditionally occupied by men |
|
2 |
Aid for new business creation
|
45% of the new businesses were created by women, as compared to the national average which is 30%. The difference can be imputed to the programme. |
|
. |
Other measures |
Etc. |
At this stage of its work, the evaluation team noted that the impacts are not directly comparable and that it could not go much further, on its own, towards a synthetic conclusion. A way of formulating comparative judgements was to get the steering group or an expert panel to express an opinion.
The approach was to:
- Organise a half-day seminar with an expert panel ;
- Present the evaluation conclusions to the participants, measure by measure. Verify the credibility of the conclusions and validate them;
- Present the synoptic table of conclusions;
- Examine each column of the synoptic table and ask each participant to intuitively situate the impacts of each measure on a scale (from maximum positive impact, through neutral impact, to maximum negative impact). Compare the participants' classifications, discuss them and make them converge as much as possible;
- Continue the classification with the other columns in the synoptic table.
After the seminar, convert the classifications into scores ranging from 10 (maximum negative impact) to +10 (maximum positive impact), through 0 (neutral impact). Convert the synoptic table into a table of ratings (impact scoring matrix). The construction of scoring scales allows for comparisons to be made within the same column (e.g. one particular measure has a better rating than another). On the other hand, scores in different columns cannot be compared (e.g. a score of 5 for employment is not comparable to the same score for an environmental impact).