Communications Networks, Content and Technology
European Commission Directorate General

Knowledge Base: Evaluation

Knowledge Base: Evaluation

Goal

Evaluations are part of a broader agenda of evidence-based policy making. Evaluation and monitoring provide a core set of tools that management and stakeholders can use to verify and improve the effectiveness of funding programmes and policy interventions. This is particularly relevant in a context where civil society demands results and accountability from policy programmes. In close cooperation with other Commission services, we aim at strengthening the implementation of evaluation techniques, processes and impact, in particular – but not only - for research spending, understanding the causal relationship between project and the results, and working with stakeholders and policy makers to demonstrate and raise the awareness of the importance of evaluation, even in cases where it is not mandatory.

Action

Our Priority is to coordinate and carry out evaluation activities relevant to the DG's objectives and make proposals for strategic orientations of the DG's evaluation policy.

Situation

Increase the use of evaluation and evaluation results for more evidence-based policy making, providing feed-back and relevant information to policy makers. Make evaluation in CONNECT more relevant. For this it is important to pilot novel evaluation techniques (for instance by introducing counterfactual elements) and to have a better understanding of the causality between outputs and outcomes. Strengthen the choice of indicators used in evaluation, for example by including a longer-term perspective on the output of research programmes; ensure that data needs are always reflected in the structuring and governance of projects. Use evaluation results strategically. Ensure the availability of data (such as reviewers' assessments) in usable formats.

Input

Full-Time Equivalent: 
People: 
4.00 full-time equivalent (FTE)
Budget: 
Budget for evaluation studies
Other: 

Specifications and data from other units.

Knowledge Base (Unit F.4)
Outputs

Unit F4 Priority 3 - Output

Evaluation projects (realised vs planned in evaluation plan) carried out according to Commission best practice

Indicators

1580

Number of timely evaluation projects (realised vs planned in evaluation plan) carried out according to Commission best practice

Baseline 6 (2013)
Target 100%

Unit F4 Priority 3 - Output

2 Pilot projects per year for improved evaluation approaches

Indicators

1583

2 pilot projects per year for improved evaluation approaches

Baseline 2 (2013)
Target

Unit F4 Priority 3 - Output

Evaluations relating to policy (non-spending) initiatives carried out by the DG

Indicators

1585

Number of evaluations relating to policy (non-spending) initiatives carried out by the DG

Baseline 4 (2013)
Target

Unit F4 Priority 3 - Output

Participation in evaluation networks

Indicators

1587

Active participation in evaluation networks: (At least) one substantial DG Connect contribution per meeting.

Baseline 10 (2013)
Target 15(2015)
Results/Impacts

Unit F4 Priority 3 - Impacts

Evaluation recommendations a) acknowledged by senior management and b) implemented, if within the remit of the DG decision making.

Indicators

1589

% of evaluation recommendations a) acknowledged by senior management and, b) implemented, if within the remit of DG decision making (lead indicator)

Baseline Baselines being established.
Target a)100% b)80%(2014)

Unit F4 Priority 3 - Result

Development of Horizon 2020 evaluation indicators for ICT research and innovation.

Indicators

1591

Number of new suitable Horizon 2020 evaluation indicators developed for ICT research and innovation.

Target 5 new or upgraded suitable indicators by mid-2014, in line with CNECT priorities.(2014)

Unit F4 Priority 3 - Results

Contribution of DG CONNECT to evaluation networks and ICT FP7 to overall FP7 evaluation.

Indicators

1593

Contribution of DG CONNECT to evaluation networks and ICT FP7 to overall FP7 evaluation.

Target Contribution of DG CONNECT estimated to be amongst top 3 Commission DGs. Feasibility of internal survey to be launched.

Link to DG CONNECT's Top Level Targets

  • Europe 2020 - 3% of the EU's GDP should be invested in R&D, complemented by a future EU 2020 Headline Innovation Indicator
  • H2020 - By 2020, one third of all Europe's ICT business investment in ICT R&D in the EU should come from companies created within the last two decades
  • DG CONNECT is a lean, modern, effective and efficient public administration
  • Direct contribution to Digital Agenda