Study "Evaluation Manual for ICT Research in FP7: The Joint Technology Initiatives"
Summary of the Results
The study defines a common evaluation framework suitable for the JTI instrument under FP7 and elaborates the key evaluative questions for the two interim evaluations and ex-post evaluation.
Content of the Interim Evalutions of the JTI's
The overall context of the two interim evaluations is set in the JTI's statutes: "The interim evaluations shall cover the quality and efficiency of the respective JTI and the progress towards the objectives set". This directly follows the direction of the Commission's proposal for the whole Seventh Framework Programme.
Given the extended time length of the JTI's, the interim evaluations become of critical importance, not least for calibrating purposes with respect to efficiency in implementing and effectiveness in orientation towards the programme objectives.
The Interim Evaluations should concentrate on the following aspects of the JTI:
- Relevance
- Effectiveness
- Efficiency
- Research Quality
The final evaluation of the JTI's should focus on the following aspects:
- Relevance
- Effectiveness
- Efficiency
Expected Exploitation of the Results
The study output (evaluation manual) was and will be used to define the Terms of Reference for the panels charged with interim evaluations and the ex-post evaluation of the ARTEMIS and ENIA JTI's. During the evaluation process it will constitute a methodological guide to the evaluators. Equally the manual may be used in order to define the Terms of Reference of potential support team (external contractors) to the above mentioned evaluation panels.
Despite different conceptions of the JTI instrument, the evaluation can equially inform the evaluations of the three original JTI's launched by DG RTD (IMI, Clean Sky and FCH).
Report
-
Interim Report
[263 KB] -
Final report [251 KB]
Background Documents
-
Tender specifications
[403 KB]
Additional Information/documentation
Mr Martin UBELHOR
European Commission - Directorate General Information Society and Media
Policy Coordination and Strategy
Evaluation and Monitoring
Fax no.: +32 2 296 66 13
email: infso-c3 in the domain ec.europa.eu