Evaluation Network

Agenda

Presentations :

• Pilot Project Result Indicators – Etude de cas Aquitaine (France) - Laurent Caillaud, Préfecture de région Aquitaine, Secrétariat général pour les affaires régionales - France
• Regional Operational Programme 2007-2013 – Slovak Republic - Richard Brooš, Regional Development Programmes Preparation Unit - Slovakia
• Results Indicators 2014+ Findings of the Pilots - Veronica Gaffey, Acting Director for Policy Development and Head of the Evaluation Unit, DG REGIO: Presentation - Report
• Core Indicators in the Annual Reporting Exercise 2011 – Adam Abdulwahab, Evaluation Unit, DG REGIO
• Completed and nearly completed studies, Evaluation Unit, DG REGIO
• Ex ante Evaluation (2014-2020), Joint Guidance of DG REGIO and DG EMPL

Minutes

Agenda

• Draft guidance on monitoring and evaluation 2014-2020: Concepts and recommendations - Kai Stryczynski -
• Common Indicators – Annex 1 of Concepts and Recommendations Paper - Adam Abdulwahab
• Core Indicators: Annual Reporting Exercise 2011 - Adam Abdulwahab
• Ex post evaluation of Cohesion Policy Interventions 2000-2006 financed by the Cohesion Fund (including former ISPA): Work Package B : Cost-benefit analysis of selected transport projects - Jurate Vaznelyte
• Ex post evaluation of Cohesion Policy Interventions 2000-2006 financed by the Cohesion Fund (including former ISPA): Work Package C : Cost-benefit analysis of environment projects - Adam Abdulwahab
• Ex post evaluation of Cohesion Fund (including former ISPA) : State of Play - Jurate Vaznelyte
• Synthesis report on renewable energy & energy efficiency in housing - Cvetina Yocheva
• DG REGIo Evaluations : State of Play - Veronica Gaffey
• Counterfactual impact evaluation - Daniel Mouqué
• Evaluating innovation in cohesion policy programmes : Technopolis study, Network of Managing authorities - Marielle Riché

Please find below some first findings of a pilot exercise on defining future result indicators. The result indicators proposed are preliminary examples and my change during the course of the pilot exercise.

• Regional Operational Programmeunder Objective 1 of Cohesion Policy : case of Pomorskie Region in Poland - Stanislaw Bienias on behalf of Pomorskie Region
• Pilot project outcome/result indicators
• POR ERDF Sardinia 2007-2013 : Pilot test indicators - Regional Working group
• A test about outcome indicators : Galician Case - Xunta de Galicia
• Indicator pilot project – 2011 : Central Hungary Operational Program
• Indicator pilot project Skåne-Blekinge, Sweden - Kristina Sandberg & Christian Lindell
• The Interreg IVB North Sea Region Programme Case - Carsten Westerholt

Agenda

Minutes

• Towards a European perspective on the use and usability of evaluation outputs - Prof. Murray Saunders (Lancaster University, UK)
• Evaluation Use and Usability: Theoretical Foundations and Current State of International Debate - Prof. Murray Saunders (Lancaster University, UK)
• Use of ESF Evaluation Findings in Austria: Evaluation of the Sub-Priority "Adult Education" of the Employment Operational Programme (2007-2013), Regina Barth, Ministry for Education, Arts and Culture, Austria
• Evaluation of ESF Support to Gender Equality - Effie Meletiou (European Commission, DG EMPL)
• Estimating Net Impacts of the European Social Fund in England, Paul Ainsworth, ESF Evaluation, Jobseekers and Work Programme Division, Department for Work and Pensions, UK
• Feedback on the Evaluation Experiences during the Implementation, Ignác Siba, National Development Agency, Hungary
• What are the challenges in applying Counterfactual Impact Evaluation in Cohesion Policy? Prof. Bernhard Boockmann (Institute for Applied Economic Research, Germany)
• How to make an appropriate choice of methods to evaluate Cohesion Policy? Prof. Harvey Armstrong (University of Sheffield, UK)

Agenda

Minutes

Presentations :

• Monitoring & evaluation after 2013 – Concepts and ideas -
• Monitoring & evaluation after 2013 - Common Indicators and Result Indicators
• Monitoring & evaluation after 2013 - Practical Points
• Evaluating Innovation : On-going and Planned Activities
• Evaluation of the Innovation Voucher Programme in Poland: Results, Methods and Plans -
• Cohesion Policy Support to Innovation in Lithuania: Lessons Learnt for Evaluation
• DG REGIO Evaluations - State of Play
• DG REGIO Evaluations-related activities - State of Play
• DG REGIO Ex Post Evaluation Cohesion Fund (including former ISPA) 2000 -2006
• Mid Term Evaluation 2007-2013 of the Saxony Programme
• Mid Term Evaluation 2007-2013 in the Czech Republic
• Mid Term Evaluation 2007-2013 of the Integrated Regional Operational Programme in Bulgaria
• Polish Presidency in the EU : Cohesion Policy and Evaluation-related activities

Agenda

Minutes

Presentations :

• Annual Reporting Exercise 2010: Core Indicators in the SFC2007 Modules - Adam Abdulwahab, DG REGIO Evaluation Unit
• Ex Post Evaluation of INTERREG Initiative (2000-2006): Presentation of the Final Results- Pasi Rantahalvari, DG REGIO Evaluation Unit
• Ex Post Evaluation of URBAN Initiative (2000-2006): Presentation of the Final Results - Daniel Mouqué, DG REGIO Evaluation Unit
• Ex Post Evaluation of Cohesion Fund and ISPA (2000-2006): Update and Presentation of the Preliminary Results - Jurate Vaznelyte, DG REGIO Evaluation Unit
• Ex Post Evaluation of ERDF in Objective 1 and 2 Programmes (2000-2006) – Work Package 11: Management and Implementation Systems – Recommendations on Good Governance and Administrative Capacity Building - Anna Burylo, DG REGIO Evaluation Unit
• Evaluating Innovation in Member States: On-going and planned Activities - Marielle Riché, DG REGIO Evaluation Unit
• Future Development of the Expert Evaluation Network - Kai Stryczynski, DG REGIO Evaluation Unit
• First Results of the Ex Post Evaluation in Poland: 2004-2006 - Stanisław Bienias, Ministry of Regional Development, Poland
• Measurable Objectives for Public Service Provision: Experience of the Performance Reserve in Italy: 2007-2013 - Iolanda Anselmo, UVAL-DPS, Italy
• Evaluation of the Modernisation of the Public Employment Service in Hungary: 2004-2006 - Gergely Fekete, Coordination MA, Division for Evaluation, National Development Agency, Hungary
• EVALSED: State of Play and Further Steps - Patty Simou, DG REGIO Evaluation Unit
• Evaluations Planned by DG REGIO: 2010/2011 - Overview
• Ex Post Evaluation of ERDF in Objective 1 and 2 Programmes (2000-2006) – Work Package 6c: Enterprise and Innovation Support – Econometric and Counterfactual Approach: Presentation of the Final Results - Daniel Mouqué, DG REGIO Evaluation Unit
• Using an innovative experimental approach to evaluate innovation policy: Do Dutch innovation vouchers help SME’s to bridge the gap towards science? - Marc van der Steeg, Bureau for Economic Policy Analysis, Netherlands
• Counterfactual Impact Evaluation of Cohesion Policy: Planned Activities - Daniel Mouqué, DG REGIO Evaluation Unit
• Monitoring and evaluation after 2013 – some first ideas, mainly for ERDF / CF

Agenda - Minutes

Presentations :

• National Strategic Reports : Overview of core indicatiors and Evaluation Results - Lucia Pacillo, DG REGIO Evaluation Unit
• Core Indicators : Pilot Exercise and Annual Reports 2010 - Adam Abdulwahab, DG REGIO Evaluation Unit
• DG REGIO Ex post Evaluations of ERDF in Objective 1 and 2 Programmes (2000-2006)
  • Overview and Update of all Work Packages and the Synthesis Report - Kai Stryczynski, DG REGIO Evaluation Unit
  • Work Package 4: Structural Change and Globalisation – Presentation of the Final Results - José Luis Calvo de Celis, DG REGIO Evaluation Unit
  • Work Package 5a: Transport – Presentation of the Final Results - Patty Simou, DG REGIO Evaluation Unit
  • Work Package 5b: Environment and Climate Change – Presentation of the Final Results - Adam Abdulwahab, DG REGIO Evaluation Unit
  • Cohesion Fund (including former ISPA) Ex Post Evaluation (all three work packages) - Jurate Vaznelyte, DG REGIO Evaluation Unit
• Improvement of the Competitiveness of Enterprises: Analysis of Net Effects - Executive summary
  Jarosław Górniak, Jagiellonian University in Kraków, Poland
  Rafał Trzciński, Polish Agency for Enterprise Development
• Learning Through Ongoing Evaluation
  Maria Eriksson, Swedish Ministry for Enterprise, Energy and Communications
  Göran Brulin, Swedish Agency for Economic and Regional Growth
  Fredrik Tiger, Swedish Agency for Economic and Regional Growth
• Evaluation of the Impact of the EU Structural Funds on the Gross Domestic Product (HERLIT model based on HERMIN)
  Danute Burakiene, Ministry of Finance, Lithuania
  Jonas Jatkauskas, BGI Consulting, Lithuania
• Start of the DG REGIO Evaluation Expert Network - Kai Stryczynski, DG REGIO Evaluation Unit
• Evaluating Innovation in Member States - Marielle Riché, DG REGIO Evaluation Unit

• Agenda - Minutes

Evaluations undertaken for DG REGIO: State of Play – Overview

• DG REGIO evaluations underway
  • Ex Post Evaluation of ERDF in Objective 1 and 2 Programmes (2000-2006), Kai Stryczynski,
  • Ex Post Evaluation of the URBAN Community Initiative 2000-2006, Daniel Mouqué
  • Ex post Evaluation of INTERREG III 2000-2006 Initiative, Pasi Rantahalvari
    
• DG REGIO Ex Post Evaluations of ERDF in Objective 1 and 2 Programmes (2000-2006) - Finalised : Presentation of the Results
  • Work Package 7: Effectiveness of Cohesion Policy: Gender Equality and Demographic Change, José Luis Calvo de Celis
  • Work Package 9: Rural Development, Marielle Riché
    
  • Work Package 10: Efficiency: Unit Costs of Major Projects, Adam Abdulwahab
    
  • Work Package 11: Management and Implementation Systems, Anna Burylo
    
• Other Evaluations finalised : Presentation of the Results
  • Study on the transition of Article 16 of Regulation (EC) No. 1083/2006 on the promotion of gender equality, non-discrimination and accessibility for disabled persons in Cohesion policy programmes 2007-2013 (ERDF and Cohesion Fund) - Haroldas Brazaitis and Egidijus Barcevicius, Public Policy Management Institute, Lithuania
    

Evaluation Results in Member States

• Quantitative effects of the EU Regional Policy on regional cohesion and growth in Austria using a multiregional IO model - Andreas Maier, ÖROK, Austrian Conference on Spatial Planning, Austria - Oliver Fritz, WIFO, Austrian Institute of Economic Research, Austria - Gerhard Streicher, Joanneum Forschungsgesellschaft GmbH, Institute of Technology and Regional Policy (RTG), Austria
• Assessment of the benefits drawn by the EU15 Member States as a result of the EU Cohesion policy implementation in Poland - Stanisław Bienias, Ministry of Regional Development, Poland
  Julian Zawistowski, Institute for Structural Research, Poland
  
• Competitive project selection in North Rhine- Westphalia - Claudia Schulte, Ministry of Economy, North Rhine-Westphalia, Germany
• Evaluation of interventions in mountain areas of Emilia Romagna - Antonella Bonaduce, Regional Government of Emilia Romagna, Italy
• Analysis of the impact and effectiveness of projects implemented in Malta in the period 2004-2006
  Marilou Micallef, Office of the Prime Minister, Malta
• Evaluation Plans for the period 2007-2013 - Marina Koutsouri, Ministry of National Economy, Greece
  
  

• Agenda - Minutes

• Draft Working Document N° 7 "Indicative Guidelines on Evaluation Methods: reporting on Indicators for the ERDF/CF:
  - DG REGIO - Abdulwahab

• Evaluation Plans for 2007-2013 and evaluation results:
  - BE - S.Jelas (Walonia)
  - DE - Schrekenberger
  - ES - Muños
  - PL - Bienias
  - LV - Kravale
  - EE - Korda
  - CZ - Michalik

• DG REGIO  Evaluations Underway: State of Play

• Potential for Regional Policy Instruments, 2007-2013, to contribute to the Lisbon Objectives (Final Report):
  - Lisa Van Well, Nordregio

• Updating EVALSED: the source for evaluation of socio-economic development

• Agenda
• Minutes
• Definitions and use of Core indicators:
  • DG REGIO - Abdulwahab
• Evaluation Arrangements for 2007-2013:
  • PT - Bernardo - Portuguese NSRF and OP Global Evaluation Plan 2007-2013
  • RO - Bedea - Evaluation Plans in Romania
  • FI - Osenius - ERDF Evaluation Plan 2007-2015
  • SI - Mesec - Evaluation Arrangements for 2007-2013
  • SK - Izáková - Evaluation within EU assistance provided to the Slovak Republic
• Impact evaluation:
  • DG REGIO - Mouqué - Impact Evaluation - introductory words
  • HU - Béres - Impact evaluation of a SME program
  • FR - Calzada - Experience in France - Complementary documents:
    DIV 0136 - Intervention Experience in France - EL102 Octobre 2007
  • DG REGIO - Mouqué - Impact Evaluation - examples ex post
• DG REGIO evaluations underway
  • DG REGIO - Stryczynski - Ex post evaluation Obj1+2 - Contractors, subconctractors rev 29 Oct 08
  • APPLICA - Ward - Ex post Evaluation - Coordination - Analyse-synthesis

• Agenda - Minutes


• 
• Core Indicators during 2007-2013:
  • BE - Hennart - présentation indicateurs 26juin08
  • FI - Ahlgren - Evaluation Network Meeting 26 June 2008.
  • FR - Peguy - Core indicators
  • GR - Koutsouri - Formulation of the Indicator System in the NSRF
  • LV - Kravale - Core_indicators 27 June 2008
  • PL - Bienias - Measuring Core Indicators
• Ex Post Evaluation of ERDF in Objective 1 and 2 Programmes (200-2006) - Work Package 2 : Data Feasibility Study:
  • ADE-WP2 Evaluation network
  • KS - Ex post state of play June 08
  • Marielle Riché June 08
• Evaluation Arrangements for 2007-2013:
  • SE Presentation 26 june
  • BG Dinkova presentation for Evaluation Network 26/27 June 2008
  • De Heller - Evaluation
  • ES - Kaiser - Presnetación Grupo Evaluacion Bruselas
  • FR - Peguy - Cadre Evaluation National
  • HU - Tetenyi - Evaluation Plan
  • IT - Italy Evaluation Plans
  • LT - Jarmalaviciute - Evaluation arrangements
  • MT - Cassar - Eval Plan
  • PL - Bienias - Evaluation System in Poland
• Guide to Cost-Benefit Analysis of Investment Projects:
  • CBA Guide New Edition

Agenda and presentations - Minutes

Agenda and presentations - Minutes

Agenda - Minutes - State of Play

Agenda

Presentation

Other Reports :

• "Report on the Performance Reserve and Mid Term Evaluation in Objective 1 and 2 Regions" - 27 July 2004
• Final report "The Mid Term Evaluation in Objective 1 and 2 Regions, Growing Evaluation Capacity" - A Report by DG Regional Policy drawn up in consultation with the Technical Group on Evaluation