IMPORTANT LEGAL NOTICE - The information on this site is subject todisclaimercopyright notice
Evaluation
  EUROPA > European Commission > EuropeAid > Evaluation > Methodology > Sitemap
Last updated: 18/08/2005
EuropeAid

EuropeAid
 

Sitemap



Methodology
• Evaluation Guidelines
• Methodological bases
• Evaluation tools
• Examples
• Glossary
• Sitemap

 
 
Methodology
Evaluation Guidelines
Process diagram
Geographic, thematic and other evaluations
Guidelines for the manager
Overview
Preparatory phase (0)
Specific situations
Desk phase (1)
Specific situations
Field phase (2)
Specific situations
Synthesis phase (3)
Specific situations
Dissemination and follow up phase (4)
Specific situations
Guidelines for the evaluation team
Overview
Preparatory phase (0)
Desk phase (1)
Field phase (2)
Synthesis phase (3)
Check lists
Content of documents
Inception report
Contents of first phase report (desk)
Content of a country note (thematic evaluation)
Content of the final report
Quality criteria
Quality of the inception report
Quality of first phase report (desk)
Quality of final report
How to fill out the quality assessment grid?
Agenda for the meeting
Inception meeting
First phase meeting (desk)
Debriefing meeting
Final discussion meeting
Project and programme evaluation
Overview
Guidelines for the evaluation manager
Detailed guidelines
Specific situations
Guidelines for the external evaluation team
Detailed guidelines
Specific situations
Methodological bases
Subject
Scope of the evaluation
Evaluation of projects, programmes and strategies
Sectors, themes and cross-cutting issues
Timing
Evaluation and the intervention cycle
Utilisation
Users of an evaluation
Types of use
Evaluation and decision-making
Evaluation and knowledge transfer
Dissemination of the evaluation
Documents presenting the evaluation
Presenting an evaluation in a seminar
Roles
The distribution of roles
The evaluation manager
The reference group
Experts invited to the reference group
Chairing a reference group meeting
The external evaluation team
Evaluation capacity
The stakeholders
Method
Rationale of the intervention
Intervention strategy
Intervention logic
Objectives
Related policies
Evaluation questions
Focus the evaluation on key questions
Questions and complexity of evaluation
Preparing an evaluation question
Specify the nature of the expected use
Questions for different uses
Specificity of evaluation compared to monitoring and auditing
Avoid auditing and monitoring questions
Specify the scope of the question
Questions on intervention design and implementation
Inferring a question from the intervention logic
Questions and intervention logic
Specifying the evaluation criterion
Evaluation questions and criteria
Families of evaluation criteria
Should questions be open or closed?
Examples
Evaluation at country level
Evaluation at regional level
Sector or thematic global evaluation
Judgement references
Judgement criterion
Target
Indicator
Indicators derived from scoring
Categories of indicators
From questions to indicators
From question to indicator: example of a country evaluation
From question to indicator: example of a sector evaluation
Methodological design
Design table per question
Design table for a question: an example
Sub-questions
Optimising the overall design
Developing a tool
Developing tools: an example
Feasibility (evaluability) of a question
Data collection
Using available data
Most frequent difficulties with data collection
Reliability of collected data
Analysis
Strategy of analysis
Counterfactual
Cause and effect questions
External factors
Exploration
Confirmation
Validity
Judgement
Conclusions and lessons
Ethical principles
Recommendations
Quality assurance
Approval of deliveries
Quality assurance support
Evaluation Tools
Problem diagram
Detailed presentation of the tool
What is a problem diagram?
Why and when?
How should the problem diagram be constructed?
In country evaluation
Quality control
Examples of its use in the planning field
Bibliography
Summary
Check list for Managers
Check list for Evaluators
Objectives diagram and the effect diagram
Detailed presentation of the tool
What is an objectives diagram and what is an effect diagram?
Why and when?
How should the objectives and effect diagram be constructed?
In country evaluations
Quality control
Examples
Bibliography
Summary
Check list for Managers
Check list for Evaluators
Decision diagram
Detailed presentation of the tool
What is a decision diagram?
Why and when should the decision diagram be used?
What are the decision diagram's construction stages?
How should the decision diagram be used?
Quality control
Examples
Bibliography
Summary
Check list for Managers
Check list for Evaluators
Survey
Detailed presentation of the tool
Definition
Why and when is the survey used?
How is a survey carried out?
Quality control
Glossary
Examples
Summary
Check list for Managers
Check list for Evaluators
Context indicators
Detailed presentation of the tool
What is a context indicator?
Why and when are context indicators used?
How are context indicators selected, collected and used?
Quality control
Example
Summary
Check list for Managers
Check list for Evaluators
Interview
Detailed presentation of the tool
Why and when?
In country/region evaluation
How is the interview carried out?
How is the quality of the interview controlled?
Summary
Check list for Managers
Check list for Evaluators
Focus group
Detailed presentation of the tool
Why and when is a focus group used?
In country/region evaluation
How is a focus group investigation carried out?
Quality control
Examples
Summary
Check list for Managers
Check list for Evaluators
Expert panel
Detailed presentation of the tool
Why and when is an expert panel established?
How is the panel process managed?
Quality control
Examples
Bibliography
Summary
Check list for Managers
Check list for Evaluators
Case study
Detailed presentation of the tool
What is a case study?
What are the various types of case study?
Why and when
In country / region evaluation
How is a case study carried out?
Quality control
Examples
Bibliography
Summary
Check list for Managers
Check list for Evaluators
SWOT (Strengths, Weakness, Opportunities, Threats)
Detailed presentation of the tool
What is SWOT analysis?
Why and when?
How should SWOT analysis be carried out?
Quality control
Examples
Bibliography
Summary
Check list for Managers
Check list for Evaluators
Multi-criteria analysis
Detailed presentation of the tool
Definition
Why and when should multi-criteria analysis be undertaken?
How should multi-criteria analysis be undertaken?
Quality control
Bibliography
Summary
Check list for Managers
Check list for Evaluators
Cost-effectiveness analysis
Detailed presentation of the tool
Definition
Why and when is a cost-effectiveness analysis undertaken?
How is a cost-effectiveness analysis undertaken?
Quality control
Examples
Bibliography
Summary
Check list for Managers
Check list for Evaluators
Cultural and social analysis
Detailed presentation of the tool
What is a cultural and social analysis?
When and why should cultural and social analysis be used?
Quality control
Examples
Bibliography
Check list for Managers
Check list for Evaluators
Toolbox
What type of tools?
When to use which tools?
Which combination of tools?
What specific constraints and requirement?
Check list for the tool's implementation
Check Lists for tools
for Managers
Problem Diagram
Objectives and effects diagram
Decision diagram
Questionnaire Survey
Context indicators
Interview
Focus Group
Expert Panel
Case Study
SWOT (Strengths, Weakness, Opportunities, Threats)
Multi-criteria analysis
Cost/effectiveness analysis
Socio-cultural analysis
Right mix of tools
for Evaluators
Problem Diagram
Objectives and effects diagram
Decision diagram
Questionnaire Survey
Context indicators
Interview
Focus Group
Expert Panel
Case Study
SWOT (Strengths, Weakness, Opportunities, Threats)
Multi-criteria analysis
Cost/effectiveness analysis
Socio-cultural analysis
Right mix of tools
Examples
Glossary
Sitemap


Top