Monitoring and Evaluation Tools

Download as ppt, pdf, or txt
Download as ppt, pdf, or txt
You are on page 1of 39

MONITORING AND

EVALUATION TOOLS
Monitoring and Evaluation

The National Democratic Institute


INTRODUCTIONS/
GROUND RULES
• Introductions
• Ground Rules
• Ice Breaker Exercise

Photo: Sanja Gjenero, RGBstock.com


MONITORING AND EVALUATION
(M&E) TOOLS OBJECTIVES
• To become familiar with and practice
using a range of M&E tools
• To consider when and how the tools can
be employed during the project life
cycle
M&E TOOLS TOPICS
• What is M&E?
• Gender analysis
• Project lifecycle
• Data collection
• Program design tools
• Evaluations
Image: www.pixabay.com
• Other tools
KEY TERMS
• Indicator • Goal
• Input • Target
• Output • Baseline
• Intermediate result • Impact
• Outcome • Gender
• Objective • Stakeholder
M&E DEFINED
• Monitoring
— Continuous
— Ensures project on track
— Identifies problems

• Evaluation
— Assesses whether project is achieving
objectives
— Periodic
— Focuses on outcomes and impacts
GENDER AND M&E
• Gendered priorities, constraints and
impact
• Failure to address gender leads to
inefficient and unsustainable results
and exacerbates inequities
PROJECT LIFE CYCLE
DATA COLLECTION TOOLS
• Quantitative methods
– Household surveys
– Public opinion polls/surveys
• Qualitative methods
– In-depth interviews
– Focus groups
– Direct observation
– Document review
– Participatory assessments
EXERCISE:
WHICH TOOLS? WHEN?
• Multi-workshop training
program for women
political activists
• Objective: Improve the
capacity of women to
run for elected office
• Which data collection
tools? When? Photo: Amy Hamelin, NDI
EXAMPLE:
WHICH TOOLS? WHEN?
• Workshops
– Pre-and post questionnaires
– Evaluation forms
• In between events
– Direct observation
• End of project
– Focus groups
Photo: Amy Hamelin, NDI

– In-depth interviews
– Election results
PROGRAM DESIGN TOOLS
• Gender, context and
stakeholder analysis
• Problem and objective
analysis
• Activity plan
• Indicators
• Critical assumptions Image: www.pixabay.com

• Risk analysis and


management
• Resource plan
• Results framework
GENDER ANALYSIS
• Can be undertaken at any stage but
most effective if included in design
• Systematic way of analyzing different
roles and impacts
• Asks the “who” questions
• How this will affect women and men?
CONTEXT ANALYSIS
• Institutions or vehicles that have
positive or negative impact?
• Key actors or factors that help or
hinder?
• Socio-cultural, political and economic
environment?
CONTEXT ANALYSIS EXAMPLE
STAKEHOLDER ANALYSIS
• All people who have a stake
– Participants
– Implementers
– Decision-makers
– Donors
• Who are they?
• What is their interest? Influence? Power?
• Relations with other stakeholders
STAKEHOLDER ANALYSIS
• Survey all people who have a stake
High

Low High

Low
POWER
EXERCISE:
STAKEHOLDER ANALYSIS
• Program to enhance the capacity of the
Liberian legislature to represent
citizen’s interests
• Identify stakeholders
• Plot them on chart

Photo: NDI
PROBLEM ANALYSIS
EXERCISE: PROBLEM TREE

• Problem: Low level


of women in
elected bodies
• Identify root causes
• Identify effects
• Link root causes to
their effects
Photo: www.pixabay.com
OBJECTIVE ANALYSIS
• Links problem analysis to program
design
• Provides visual map
• Defines scope of program
• Maps out pathway of change
• Identifies what will be monitored and
evaluated
• Facilitates planning and management
OBJECTIVE ANALYSIS
• Core problem reframed as objective
• Root causes reframed as intermediate
results
INDICATORS
• Qualitative versus quantitative
• SMART
– Specific
– Measurable
– Achievable
– Relevant
– Time-bound Photo: www.pixabay.com

• Negative effects reframed become


indicators
CRITICAL ASSUMPTIONS

• Factors outside our control


• Conditions under which program logic
will hold true
• Conditions likely to affect achievement
of results
• Identify at each level of framework
RISK ANALYSIS AND
MANAGEMENT
• Every program entails risk
• Identify risks and contingency
plans/mitigation measures for each
level of framework

Image: www.pixabay.com
RESOURCE PLAN
• What resources are needed for:
– Staff time and materials for setting up an
M&E system
– Evaluation activities
RESULTS FRAMEWORK
• Links evaluation strategy to problem
analysis
• Helps identify indicators
• Aids in M&E
• Clarifies logic of project
• Provides roadmap for planning and
management
EXAMPLE: FRAMEWORK
EXERCISE:
RESULTS FRAMEWORK
PROGRAM EVALUATION
Types of evaluations:
• Baseline
• Mid-term
• Final
• Impact
• Internal versus external
EXAMPLE: ASSESSMENTS
Win with Women
Political Party Assessment Tool
PROGRAM EVALUATION

Steps
• Determine evaluability
• Select research questions Photo: Sanja Gjenero, RGBstock.com

• Identify methods for data collection


• Develop and test data collection
instruments and protocols
EVENT EVALUATIONS

• Verbal feedback
• Evaluation forms
• Pre- and post-workshop questionnaires
PUBLIC OPINION RESEARCH
• Qualitative
– Focus groups/in-depth interviews
• Quantitative
– Surveys/polls
• Combination of both
IN-DEPTH INTERVIEWS
• Key informant/one-on-one interviews
• Explore thoughts on deeper level
• More flexible
• Avoid influence of group dynamics

Photo: NDI
FOCUS GROUPS
• Why and how strongly people hold
opinions
• Can’t project results to wider
population
• Groups formed around common
characteristics
• Six to ten people and moderator
• Open-ended questions
SURVEYS
• Identical set of close-ended questions
• Representative sample of population
• Results projected to larger population
• Predict future behaviors and trends
Can men represent women?

80

60

40

20

0
Female Male
Yes 22.81 61.9
No 54.39 26.19
Unsure 22.81 11.9
EXAMPLE: PUBLIC OPINION
RESEARCH IN UKRAINE
• Nearly 50% thought women
underrepresented
• More likely to vote for party with
outreach to women
• Perceive women as better managers

Photo: NDI
M&E TOOLS REVIEW
• Monitoring: continuous activity to
ensure project is on track
• Evaluation: assesses impact
• M&E must address gender
• Wide range of qualitative and
quantitative data collection tools that
can be used throughout project life
cycle

You might also like