Navigation path

Additional tools

Analysis

Evaluations of the 2007-2013 programming period

Ex Post Evaluation of the ERDF and CF

The Evaluation unit - in cooperation with the Member States - are carrying out the ex post evaluation 2007-2013. The evaluation consists of a set of 15 working packages most of them of thematic nature.

  • Work package 0 - Data collection and quality assessment - Terms of Reference en PDF document
  • Work package 1 - Synthesis
    • Inception report en PDF document
    • Terms of Reference en PDF document
  • Work package 2 - Small and medium sized enterprises, innovation, ICT - Terms of Reference en PDF document
  • Work package 3 - Financial Instruments for Enterprises - Terms of Reference en PDF document
  • Work package 4 - Large enterprises - Terms of Reference en PDF document
  • Work package 5 - Transport - Terms of Reference en PDF document
  • Work package 6 - Environment - Terms of Reference en PDF document
  • Work package 7 - Modelling the effects of transport projects
  • Work package 8 - Energy efficiency - Terms of Reference en PDF document
  • Work package 9 - Tourism and Culture - Terms of Reference en PDF document
  • Work package 10 - Urban development and Social infrastructure - Terms of Reference en PDF document
  • Work package 11 - European territorial Cooperation - Terms of Reference en PDF document
  • Work package 12 - Delivery System - Terms of Reference en PDF document
  • Work package 13 - Geography of expenditures
  • Work package 14 - Effect on macroeconomic aggregates

Expert Evaluation Network - Analysis on the Cohesion Policy Performance

The objective of this network of experts is to synthesise evidence on the performance of Cohesion policy in the 2007-2013 period by examining the physical and financial performance of the operational programmes and evaluation and other evidence available. Every year the expert network produces country reports on the achievements of cohesion policy and on a selected theme. All reports look at the physical and financial performance of the operational programmes and analyse evidence coming from evaluations undertaken in the Member States.

Another task of the network is a peer review of selected evaluations. The idea is to encourage the relevant authorities to carry out more and more rigorous evaluations. The review looks both the relevance of the evaluations as well as the techniques applied to produce meaningful and reliable results. A panel of a small number of high-level experts acts as the peers in this process.

2013 Reports

  • Note on the provisional results of the peer review process en PDF

For 2013, the network of experts produced 27 policy papers (one for each country) on the topic of job creation as an indicator in ERDF programmes. The main findings from the country reports are summarized in a synthesis report.

  • Synthesis Report en PDF
  • Policy papers Austria Belgium Bulgaria Cyprus Czech Republic Denmark Estonia Finland France Germany Greece Hungary Ireland Italy Latvia Lithuania Luxembourg Malta the NetherlandsPoland Portugal Romania Slovak Republic Slovenia Spain Sweden United Kingdom PDF document

The network of experts also produced for every Member State a report on the achievements of cohesion policy. The main findings are summarized in a synthesis report:

  • Synthesis Report and executive summaries (DE-EN-FR) en PDF
  • Country Reports on achievements of cohesion policy Austria Belgium Bulgaria Cyprus the Czech Republic Denmark Estonia Finland France Germany Greece Hungary Ireland Italy Latvia Lithuania Luxembourg Malta the Netherlands Poland Portugal Romania the Slovak Republic Slovenia Spain Sweden United Kingdom PDF document

2012 Reports

For 2012, the network of experts produced 27 policy papers (one for each country) on the topic of financial instruments. The main findings from the country reports are summarized in a synthesis report.

Financial engineering

  • Synthesis report enWord Document
  • Executive Summary de en fr Word Document
  • Policy papers Austria Belgium Bulgaria Cyprus the Czech Republic Denmark Estonia Finland France Germany Greece Hungary Ireland Italy Latvia Lithuania Luxembourg Malta the Netherlands Poland Portugal Romania the Slovak Republic Slovenia Spain Sweden United Kingdom PDF document
  • Literature review en Word Document

The network of experts also produced for every Member State a report on the achievements of cohesion policy. The main findings are summarized in a synthesis report:

  • Synthesis Report and executive summaries (EN, FR, DE) en PDF
  • Country Reports on achievements of cohesion policy Austria Belgium Bulgaria Cyprus the Czech Republic Denmark Estonia Finland France Germany Greece Hungary Ireland Italy Latvia Lithuania Luxembourg Malta the Netherlands Poland Portugal Romania the Slovak Republic Slovenia Spain Sweden United Kingdom PDF document

2011 Reports

For 2011 the network of experts produced for every Member State a report on the achievements of cohesion policy and a policy paper on  renewable energy and energy efficiency in residential housing. The network also identified examples of good practice in evaluation (interesting methods, good data, etc.). The main findings from all country reports are summarized in the synthesis reports which contain comparative analysis and trends across the EU.

  • Synthesis of national reports 2011 en Word Document
  • Executive Summary de en en Word Document
  • Country Reports on achievements of cohesion policy : Country reports zip file- Tables zip file
  • Synthesis report on renewable energies and energy efficiency of housing en PDF document
  • Policy papers Austria Belgium Bulgaria Cyprus the Czech Republic Denmark Estonia Finland France Germany Greece Hungary Ireland Italy Latvia Lithuania Luxembourg Malta the Netherlands Poland Portugal Romania the Slovak Republic Slovenia Spain Sweden United Kingdom PDF document
  • Executive summary de en fr PDF document
  • Incentives for developing renewable energy supplies and improving the energy efficiency of housing - Literature review en PDF document
  • Inception report (2011) en Word Document
  • Terms of Reference (2011) en Word Document

2010 Reports

In 2010 the network of experts produced for every Member State a report on the achievements of cohesion policy and a policy paper on innovation.

  • Country reports on achievements of cohesion policy Austria Belgium Bulgaria Cyprus the Czech Republic Denmark Estonia Finland France Germany Greece Hungary Ireland Italy Latvia Lithuania Luxembourg Malta the Netherlands Poland Portugal the Slovak Republic Slovenia Spain Spain United Kingdom PDF document
  • Synthesis Report on Achievements of Cohesion Policy en PDF document - Executive Summary en fr PDF document
  • Policy papers on innovation Austria Belgium Bulgaria Cyprus the Czech Republic Denmark Estonia Finland France Germany Greece Hungary Ireland Italy Latvia Lithuania Luxembourg Malta the Netherlands Poland Portugal Romania the Slovak Republic Slovenia Spain United Kingdom Sweden PDF document
  • Synthesis Report on Innovation en PDF document - Executive Summary de en fr PDF document
  • Feedback from Maltese Managing Authorities en PDF document
  • Inception report (2010) en PDF document
  • Terms of Reference (2010) en Word Document

Evaluation of the European Observation Network for Territorial Development and Cohesion (ESPON) programme

The European Observation Network for Territorial Development and Cohesion (ESPON) supports policy making by providing evidence and analysis in the field of territorial cohesion. The current programme has a budget of €47 million: 75% from the ERDF, the remainder from the 31 countries participating (27 EU Member States plus Iceland, Lichtenstein, Norway and Switzerland).

The European council at Poznan in November 2011 agreed that the role of ESPON should be strengthened in future and asked the Commission to conduct "an evaluation of the results of ESPON providing the basis for its future work".

The core of the evaluation was in depth case studies of 12 ESPON research projects - including peer review by academic and territorial policy experts. The case studies were selected to be broadly representative, examining recent projects from each of ESPON's four priorities, covering a range of subjects (e.g. migration, secondary growth poles, portraits of rural regions and indicators of territorial cohesion).

In addition, the evaluation included in depth interviews with monitoring committee members and other key stakeholders as well as discussion of the findings with a scientific committee of experts.

Key findings

Key recommendations include:

  • Each research project should have a dissemination strategy throughout its lifecycle. This includes a clear definition of the target audience and a tighter focus on their needs from the terms of reference onwards.
  • The ESPON co-ordination unit should take a greater role as knowledge broker, building relationships in the policy community. This is not just about disseminating results, but actively engaging with the policy community to discover what research needs there are which could be filled by future ESPON projects.
  • A different administrative set-up should be considered for payment claims - this would free up time for both project leaders and ESPON co-ordination unit.
  • Monitoring committee members should take a more strategic role, delegating much of the project work to members with expertise in a given field and/or theESPON co-ordination unit.

Documents

  • Final Report enPDF - Quality assessment enPDF
  • Annexes (including case studies) enPDF

Evaluating innovation activities: methods and practices

This study gives an overview of the methods used for assessing different kinds of publicly supported innovation activities throughout Europe. It analyses the advantages and the limits of available methodologies and covers 15 case studies on evaluations of the most popular innovation activities in Austria, Belgium, Denmark, Estonia, Finland, France, Germany, Hungary, Ireland, Italy, the Netherlands, Poland, Sweden, and UK. On this basis, guidance for managing authorities to support their evaluation activities was produced.

  • Guidance on evaluation of innovation de en es fr pl PDF document
  • Final report en PDF document
  • Case studies en zip
  • Interim Report
    • Synthesis: en PDF document
    • Appendix A: Literature review en PDF document
    • Appendix B: Analysis of an online survey of Managing Authorities en PDF document
  • Inception Report en PDF document
  • Terms of Reference en PDF document

Cohesion policy in specific territories - islands, mountains, sparsely populated

This study analyzed the extent to which cohesion policy interventions have been appropriate and effective in the special territories for the 2000-2006 and 2007-2013 periods. It was carried out for both periods 2000 - 2006 and 2007 - 2013 and was based on analysis of ERDF / CF impact on fifteen NUTS2 regions, and six NUTS3 areas. The study showed that the two financial instruments created a stable long term financial framework in which the regions can operate and develop projects that would have not been possible to be funded otherwise (such as transport or environment infrastructures) or projects that build on local assets (touristic and creative activities, support to cluster for example). It was proved that the instruments had the required flexibility to meet the needs of such challenging regions provided that policy approaches are more strategic and better coordinated through multi level governance arrangements.

  • Final report en PDF document
  • The six Case Studies en PDF document

  • Inception Report en PDF document
  • Terms of Reference en PDF document
  • First Intermediate Report en PDF document
  • Second Intermediate Report - overview en PDF document
    • Castilla-la-Mancha, Spain en PDF document
    • Sterea Ellada, Greece en PDF document
    • Itä-Suomi, Finland en PDF document
    • Highlands and Islands, UK en PDF document
    • Övre Norrland, Sweden en PDF document
    • Steiremark, Austria en PDF document
    • Rhône Alps, France en PDF document
    • Ślaskie, Poland en PDF document
    • Centro, Portugal en PDF document
    • Vzhodna Slovenija, Slovenia en PDF document
    • The Balearic Islands, Spain en PDF document
    • Corsica, France en PDF document
    • Sicilia, Italy en PDF document
    • Voreio Aigaio, Greece en PDF document
    • Hovesdstaden including Bornholm, Denmark en PDF document

Local development approach in the delivery of ERDF interventions

The study assesses the contribution of the local development approach to the effective delivery of Cohesion Policy. It covers interventions co-financed by the ERDF in the 2000-2006 and 2007-13 programming periods. Findings from the review of 38 Operational Programmes and the in-depth analysis of 5 regional cases - in Andalusia Region, Berlin Metropolitan Area, Czech Regional Northwest, Puglia Region and West Wales and the Valleys - serve as a base for operational recommendations on how and when local development could be used to deliver Cohesion Policy and how to monitor and evaluate the effects of local development interventions on economic, social and territorial cohesion.

  • Final report en PDF document
  • Case Studies : Berlin en PDF document - Andalucia en PDF document - West Wales and the Valleys en PDF document - Northwest Czech Republic en PDF document - Puglia en PDF document
  • Inception Report en PDF document
  • Terms of Reference en PDF document
  • First Interim Report en PDF document

Roma pilot project and household survey

The European Commission has launched pilot projects in the fields of early childhood education and microfinance. Evaluation and data-gathering are being carried out in collaboration with the UNDP and World Bank. Here you can follow the progress of the evaluations and the household survey - comprehensive data on the social and economic situations of disadvantaged Roma.

  • Inception Report en PDF document
  • Terms of Reference en Word document

Contribution of regional policy programmes to the Lisbon and Gothenburg agendas

The study evaluates the potential for current regional policy instruments to contribute to the achievement of growth, jobs and sustainable development. The analysis is based on examination of the Cohesion policy instruments in all 27 Member States including all 246 operational programmes supported by the ERDF and Cohesion Fund, as well as the National Strategic Reference Frameworks, the National Reform Programmes and the National Sustainable Development Plans. Conclusions are drawn at the level of each objective (Convergence and Regional Competitiveness and Employment) at the EU level.

  • Terms of Reference en Word Document
  • Final synthesis report en PDF document

Gender equality, non-discrimination and accessibility for disabled

A study on the Translation of Article 16 of Regulation EC 1083/2006 for Cohesion policy programmes 2007-2013 co-financed by the ERDF and the Cohesion Fund

The study analyses the integration of the gender perspective, non-discrimination and accessibility for disabled persons in Cohesion policy programmes co-financed by ERDF and the Cohesion Fund. 15 examples of good practices across Member States and policy areas will be identified and analysed. Conclusions and useful lessons to strengthen the gender, non-discrimination and disability dimensions in the current and next policy programming period will be derived.

Main findings

  • The evaluation found a good overall awareness of the Article 16 requirements in programmes supported by the ERDF (explicit reference in 64% of the programmes analysed)
  • In most cases (70%), Member States consider equal opportunities as horizontal priorities and do not devote attention in separate strategies or priority axes. In 22% of the examined programmes the three themes appear as declarative statement without clear targets, relevant selection criteria or obligations in terms of monitoring. Only 8% of the programmes integrate the three themes in a comprehensive strategy with clear identification of problems and quantified targets.
  • Unequal emphasis of the three themes: most attention is devoted to gender equality (70%), followed by non-discrimination. Accessibility for disabled has the weakest emphasis (accessibility requirements are usually defined in national legislation).
  • The target groups for "non-discrimination" differ across Member States: in EU12 it's mostly ethnic minority groups, particularly the Roma, while in EU15 it is more about women, migrants and elderly.
  • The ERDF and the Cohesion Fund promote equal opportunities in: SME support, public transport infrastructure, social infrastructure (child care facilities). However, other policies that can potentially promote equal opportunities through these funds were identified: (R&D, ICT integration in SMEs; cross-border cooperation through integration of cross border labour markets; tourism and culture services for disabled, health infrastructure, urban regeneration especially in remote areas, etc.)
  • Experience built upon previous programming periods has contributed to address better equal opportunities in the current programmes. However, in many cases there is a risk of a formal approach stating the problems without a clear vision of how to adequately deal with them.

Recommendations

  • The evaluators recommend Managing Authorities to review their performance in integrating the three themes into their programmes by using this Self-assessment guide, specifically designed for them.
  • In order to improve accessibility for disabled, Member States could make accessibility to all venues, infrastructures, transport, technologies and services an explicit compliance requirement for project selection.
  • The case studies revealed sufficient involvement of bodies and NGOs working on equal opportunities. Member States are encouraged to empower relevant stakeholders to play even more active role in programme implementation through Technical Assistance budget or specific projects.

Documents

  • Executive summary pdf deenfr
  • Final Report pdf en
  • Case studies of good practices examples pdf en
  • Terms of Reference Word Document en
  • Inception Report pdf en
  • Intermediate report pdf en - annexes pdf en - Indicators xls en

Macro economic modelling

  • HERMIN: Analysis of the Impact of Cohesion Policy - a note explaining the Hermin-based simulations (May 2007) en PDF document - Annexes en zip
  • QUEST: The Potential Impact of the Fiscal Transfers under the EU Cohesion Policy Programme (June 2007) en PDF document
  • ECOMOD: Study on the Economic Impacts of Convergence Interventions (2007-2013) (November 2007) en PDF document
    • Simulation results by country with uniform TFP en PDF document : Spain Greece Portugal Poland Hungary Czech Republic Slovakia Slovenia Estonia Latvia Lithuania Italy Germany Bulgaria Romania
    • Simulation results by country with benchmark TFP en PDF document: Spain Greece Portugal Poland Hungary Czech Republic Slovakia Slovenia Estonia Latvia Lithuania Italy Germany Bulgaria Romania
    • Case study Poland: simulation results with TFP 0.03 en PDF document

Feasibility study on Rail Baltica railways

  • Report en PDF document
    • Annexes en PDF document
    • Conclusions enfrde et lt lv pl PDF document
    • Movie video (28MB)

Innovation and Knowledge based Economy in 2007-2013 programmes

  • Report en PDF document
  • Country reports en PDF document: Austria Belgium Bulgaria Cyprus the Czech Republic Denmark Estonia Finland France Germany Greece Hungary Ireland Italy Latvia Lithuania Luxembourg Malta the Netherlands Poland Portugal Romania the Slovak Republic Slovenia Spain Sweden United Kingdom

Environment and Risk Prevention under Structural Funds for 2007-2013 period

  • Report en PDF document (November 2006)
  • Full report en PDF document: Bulgaria Cyprus the Czech Republic Estonia Greece Hungary Latvia Lithuania Malta Poland Portugal Romania the Slovak Republic Slovenia Spain
  • Executive Summary en pdf: Bulgaria Cyprus the Czech Republic Estonia Greece Hungary Latvia Lithuania Malta Poland Portugal Romania the Slovak Republic Slovenia Spain

Transport Investment under Structural and Cohesion Funds in 2007-2013 programmes

  • Report en PDF document (October 2006)
  • Country reports en PDF document: Bulgaria Cyprus the Czech Republic Estonia Greece Hungary Latvia Lithuania Malta Poland Portugal Romania the Slovak Republic Slovenia Spain

Joint Assistance to Support Projects in European Regions (JASPERS)

    This study evaluates the JASPERS initiative from its inception until the end of June 2011. Its main focus is to establish the impact of JASPERS assistance on the quality and timeliness of the preparation, submission, approval and implementation of major projects, in the countries which joined the European Union in 2004 and 2007. These include Bulgaria, the Czech Republic, Cyprus, Estonia, Hungary, Latvia, Lithuania, Malta, Poland, Romania, Slovakia and Slovenia.

    JASPERS was created to increase the capacity of beneficiary countries to make the best use of EU funding. By providing technical assistance to improve the quantity and quality of major projects submitted for approval, it was expected that there would be significant benefits in the regions concerned and in the European Union as a whole.

  • Final report en PDF document
  • Terms of Reference en PDF document (July 2011)
  • Inception report en PDF document ( March 2012) - Annex showing proposed case studies en PDF document
  • First Intermediate Report June 2012 en PDF document
  • Second Intermediate Report October 2012 en PDF document

Evaluation of the main achievements of Cohesion Policy programmes and projects over the longer term in 15 selected regions (from 1989-1993 programming period to the present)

    The evaluation scope covers not only ERDF regional programmes but also any national programme implemented in the region as well as, only for Cohesion Countries, relevant Cohesion Fund projects. After more than 20 years of implementation (for the EU15) of this reformed cohesion policy the focus on results, effectiveness and performance has grown significantly in recent years. In this context this evaluation aims to feed the debate about the effectiveness of the policy with empirical evidence on what has actually happened on the ground in cohesion policy over successive programming periods.

  • Final report en PDF document - Quality assessment en PDF document
  • Executive Summary de fr Word Document
  • Case Studies: Algarve en PDF document - Andalucia en PDF document - Aquitaine en PDF document - Basilicata en PDF document - Burgenland en PDF document - Campania en PDF document - Dytiki Ellada en PDF document - Galicia en PDF document - Ireland en PDF document - Itä-Suomi en PDF document - Nord-Pas-de-Calais en PDF document - Nordrhein-Westfalen en PDF document - Norte en PDF document - North East England en PDF document - Sachsen-Anhalt en PDF document
  • Terms of Reference en PDF document
  • Inception report en PDF document

Ex post evaluation of projects co-financed by ERDF and Cohesion Fund in the period 1994-1999 (finalized in 2012)

  • Ex post evaluation of projects co-financed by ERDF and Cohesion Fund in the period 1994-1999
    • Final report en PDF document - Quality assessment en PDF document
    • Executive Summary de en fr Word Document
    The objective of this evaluation is to analyse the long term contribution of 10 selected projects to economic development and as well as the quality of life and well-being of society. The selected projects are major investments in transport and environment infrastructure with a total value over EUR 50 million per project and were implemented during the 1994-1999 programming period.
    The Port of Gioia Tauro pdfen - M1 Motorway pdfen - Water supply in Palermo pdfen - Dublin Waste Water Treatment pdfen - Egnatia Motorway pdfen - Madrid Metro pdfen - Mediterranean Corridor pdfen - Solid Waste Management in Northern Lisbon pdfen - Environmental Regeneration of Ria de Vigo pdfen - Urban Solid Waste Management in Galicia pdfen
    First Interim report: Vol.1 Conceptual Framework; Vol.2 Selection of projects for case studies zip : en
    Inception report pdf : en
    Terms of Reference pdf : en

Counterfactual impact evaluations of Cohesion Policy

The strength of counterfactual impact evaluation lies in quantified estimates of impacts at the micro level – "how much has changed because of cohesion policy?" and in identifying the most effective investments "what type of project generates the most impact?"

Counterfactual impact evaluations of Cohesion Policy

EU Regional Policy: Stay informed