Communications Networks, Content and Technology

Evidence Base and Evaluation

Evidence Base and Evaluation

Knowledge Base (Unit F.4)
Goal: 

To continuously improve our evidence base through our data strategy and enhance it through our own analyses, studies and evaluation.

Action: 

We coordinate data collection, dissemination and analyses to assess progress in implementing the Digital Agenda, to carry out evaluations and to identify future trends. Based on the data strategy "audit" carried out, we are creating a better fit between the evidence we have and the evidence needed for future policy making. We will continue to deepen the content published in the Scoreboard, its relevance and use through open data functionalities. We also ensure that data needs of DG CONNECT, internally and externally, are met at cost and in time, supporting the specific efforts of each unit, coordinating the studies procured by the DG.

Situation: 

Reliable and trustworthy data and sound evidence are crucial for policy making. They help policy makers to evaluate the efficiency of their actions and enhance their accountability. Demand for sound measurement is particularly high as digital transforms economies and societies at an increasingly fast pace of change.DG CONNECT will further strengthen its approach to evidence-based policy making. Based on our progress and experience 2012-2014, our revamped data strategy will equip the DG with the necessary data to design, assess and implement policy initiatives throughout the policy cycle, including evaluation. These needs are properly reflected in the list of studies to be procured. Based on our current achievements (Digital Agenda Scoreboard), we will share and publish quality data - internally and externally -in open data formats. Our approach and focus will be adapted in 2015 in view of the needs of the next Commission mandate. As regards evaluation, we want to increase the use of evaluation and evaluation results for more evidence-based policy making, providing feed-back and relevant information to policy makers and make evaluation in CONNECT more relevant.

Mandate: 
Digital Agenda for Europe, Horizon 2020.

Input

Full-Time Equivalent: 
15
People: 
15.00 full-time equivalent (FTE)
Collaboration with other DGs or agencies:
Budget: 
Funds of about €4m for studies and external expertise.
Other: 

stakeholder input, data from internal and external sources.

Outputs

Outputs

- Data produced for policy making- Data analysis for policy support- Data visualisation and publishing (open data)- Delivery of data strategy (2014)- Quality management- Training and awareness-raising related to data and analysis- Ex-post evaluation function

Timeframe: 2013 - 2015

Indicators

458

Number of DG CONNECT datasets published on the open data portal (lead indicator)

Baseline 2 (2013)
Current 31 (May 2014)

Number of policy briefs to management team

Target 8 per year (2014 - 2015)
Baseline 2 per year (2013)
Results/Impacts

Result/Impact F4

The ultimate objective is to have and use robust data sets on the Digital Agenda and related main policy initiatives and the availability as open data on the scoreboard. These data and resulting analyses shall be used for policy making, implementation and evaluation. 

Timeframe: 2014-2015

Indicators

478

Number of visitors/users of visualization tools for our statistical datasets (Scoreboard and EU open data portal visualization tools).

Target Double by 2015 (2014 - 2015)
Baseline 4300 users, 7500 visits (November 2012)

% of evaluation recommendations a) acknowledged by senior management and b) implemented if within the remit of DG decision making

Target a) 100%, b) 80% (2014-2015)
Baseline being established

Number of references in official documents of the EU

Target Double 2014 values by 2015 (2014 - 2015)
Baseline Baseline being established. (2014)

1 pilot projects per year for improved evaluation approaches

Target 2 (2014)
Baseline 1 (2013)

Number of downloads of Scoreboard reports

Target Double 2014 values by 2015. (2014 - 2015)
Baseline Baseline being established. (2014)

a) % of studies in the DG aimed at data collection, b) whose tender specifications include a standard contract clause about the data format, publication and re-use.

Target Measuring trend for a) and target of 100% for b) (2015)
Baseline being updated (2014)

Link to DG CONNECT's Top Level Targets

  • Europe 2020 - 3% of the EU's GDP should be invested in R&D, complemented by a future EU 2020 Headline Innovation Indicator
  • eCommerce Action Plan - Double the share of eCommerce in retail sales and of the internet sector in European GDP by 2015
  • H2020 - By 2020, one third of all Europe's ICT business investment in ICT R&D in the EU should come from companies created within the last two decades
  • DAE - The entire EU to be covered by broadband by 2013
  • DAE - The entire EU to be covered by broadband above 30Mbps by 2020
  • DAE - 50% of the EU to subscribe to broadband above100 Mbps by 2020
  • DAE - 50 % of the population to buy online by 2015
  • DAE - 20 % of the population to buy online cross-border by 2015
  • DAE - 33 % of SMEs to make online sales by 2015
  • DAE - The difference between roaming and national tariffs to approach zero by 2015
  • DAE - To increase regular internet usage from 60 % to 75 % by2015, and from 41 % to 60 % among disadvantaged people
  • DAE - To halve the proportion of the population that has never used the internet from 30 % to 15 % by 2015
  • DAE - 50 % of citizens to use eGovernment by 2015, with more than half returning completed forms
  • DAE - All key cross-border public services, to be agreed by Member States in 2011, to be available online by 2015
  • DAE - To double public investment in ICT R&D to € 11 bn by 2020
  • DG CONNECT is a lean, modern, effective and efficient public administration
Read more
  • http://ec.europa.eu/digital-agenda/en/scoreboard