DME-003 Project Identification, Formulation and Design - EIF
DME-003 Project Identification, Formulation and Design - EIF
in Project Identification,
Formulation and Design
© EIF 2011
Project Identification, Formulation and Design
-----------------------------------------------------------------
This training resource was developed for the Enhanced Integrated Framework by the Centre
for International Development and Training (CIDT) at the University of Wolverhampton, UK.
The methodology presented in this document was piloted by the EIF Executive Secretariat, in
collaboration with the Standards and Trade Development Facility (STDF), in selected Least
Developed Countries in 2011.
The interpretations and conclusions in this document are entirely those of the authors. They
do not necessarily represent the view of the Enhanced Integrated Framework, or any of its
partner agencies or donors.
This document may be used and reproduced for non‐commercial purposes. Commercial
uses are prohibited. The use of this document for training purposes is encouraged, and the
EIF Secretariat would be grateful to received feedback on where and how this training
resource is applied. For further information, contact the EIF Executive Secretariat by email
([email protected]).
© EIF 2011
Project Identification, Formulation and Design
-----------------------------------------------------------------
CONTENTS
INTRODUCTION ........................................................................................................ 3
1. STAKEHOLDER ANALYSIS; WHO ARE WE? .................................................. 6
1.1 Why do we involve others? .......................................................................... 6
1.2 Who do we need to involve? ........................................................................ 7
1.3 Undertaking a Stakeholder Analysis............................................................. 8
1.4 Where to get more information on stakeholder analysis:- ............................ 9
1.5 A note on the Organic and Fairtrade Dried Fruit (OFDF) project case study 9
2. PROBLEM ANALYSYS; WHERE ARE WE NOW? ..........................................12
2.1 Identifying Problems and Possibilities (the current situation) ......................12
2.2 Developing a Problem Tree .........................................................................12
3. OBJECTIVES AND OPTIONS ANALYSIS; WHERE DO WE WANT TO BE? .15
3.1 Looking forward ...........................................................................................15
3.2 Developing an Objectives/Vision Tree.........................................................15
3.3 Choosing between options ..........................................................................17
3.4 Linking with the logframe .............................................................................18
4. OBJECTIVES DESIGN; HOW WILL WE GET THERE? ...................................19
4.1 Identifying our objectives .............................................................................19
4.2 The Objectives Column in the Logical Framework ......................................21
4.3 Checklist - Objectives ..................................................................................23
5. RISK MANAGEMENT; WHAT MAY STOP US GETTING THERE? .................24
5.1 Managing Risk ............................................................................................24
5.2 The Key Questions ......................................................................................25
5.3 Undertaking a Risk Analysis ........................................................................25
5.4 The Assumptions Column in the Logframe .................................................28
5.5 Checklist – Risks and Assumptions.............................................................31
6. HOW WILL WE KNOW IF WE’VE GOT THERE? .............................................32
6.1 Laying the foundations for Monitoring, Review and Evaluation (M,R&E) ....32
6.2 Terms and principles ...................................................................................32
6.3 The process in brief .....................................................................................34
6.4 Constructing indicators and targets .............................................................35
6.5 Types of Indicators ......................................................................................36
6.6 Identifying the Data Sources, the evidence .................................................38
6.7 Checklist – Indicators and Data Sources.....................................................40
7. RESOURCE PLANNING; WHAT DO WE NEED TO GET THERE? .................45
7.1 Preparing a Project Work Plan ....................................................................45
7.2 Preparing a Project Budget .........................................................................45
8. CONCLUSIONS .................................................................................................48
8.1 Checking the Logical Framework ................................................................48
8.2 Using the Logical Framework ......................................................................50
8.3 Nesting the Framework ...............................................................................50
8.4 Useful References .......................................................................................50
INTRODUCTION
Project and Programme management and planning can be difficult at the best of
times. When the project or programme is one that involves a whole range of partners
and agencies, it can be made even more so.1 The “Programme and Project Thinking
Tools” introduced in this handbook have evolved over several decades to support
teams undergoing “project” work.
The term ‘project’ can be confusing. In essence a project is set of activities aimed at
achieving clearly specified objectives within a defined time period and with a defined
budget. The “Project Thinking Tools” can be applied at different levels of planning
and decision-making. Essentially they can be used, with a relatively small project, a
higher-level programme or indeed a whole organisation. In this handbook, the term
‘project’ is intended to include these higher levels.
The process of developing the key “thinking tool” - a logical framework (logframe) -
for a project includes the development with key partners of thorough and clear plans2.
The logical framework can help to organise the thinking within the project and to
guide the purpose, with built-in mechanisms for minimising risks and monitoring,
reviewing and evaluating progress. Completed logical frameworks form the basis of
a project plan and can be used as a reference tool for on-going reporting.
The thinking tool approach is divided into two phases of analysis and design.
1
For more background on projects and project management, see Appendix B
2
For more information on the strengths and weaknesses of the logframe approach, see Appendix D
Put it another way, the “Project Thinking Tool” process helps guide the planning of a
journey from where we are now, HERE, to where we want to go, THERE. It works
through 7 core questions. This guidebook devotes a chapter to each question.
THERE
Strategic Objectives
Vision/ Mission
Plans
Early Review
Project Idea Concept Note
Evaluation - Strategic fit
• Internal - Profile
“Project Thinking
• External - Funding
Tools”: - Team
• Stakeholder Analysis - Timing
Evaluation • Problem Analysis
• Risk Analysis
• Logical Framework
• Communication
Project Completion
Report (PCR) Approval to
Design
Lesson Learning
Monitoring
Project Approval
• Project Information
Project Supervision Approval • Profile
Report to • Activities
6 monthly reports • Time and Work Plans
Implement • Finance and Budgets
Involving key partners in the early stages of project planning helps ensure
commitment and ownership. This can help minimise tensions later on and has the
added benefit that it pools knowledge and experience; helping to ensure the plan is
as robust as possible. In a multi-agency project this early involvement is vital.
Effective engagement is likely to result in:
Improved effectiveness of your project. There is likely to be a greater sense of
ownership and agreement of the processes to achieve an objective.
Responsiveness is enhanced; effort and inputs are more likely to be targeted at
perceived needs so that outputs from the project are used appropriately.
Improved efficiency. In other words project inputs and activities are more likely to
result in outputs on time, of good quality and within budget if local knowledge and
skills are tapped into and mistakes are avoided.
Improved sustainability and sustainable impact. More people are committed to
carrying on the activity after outside support has stopped. And active participation
has helped develop skills and confidence and maintain infrastructure for the long
term.
Improved transparency and accountability if more and more stakeholders are
given information and decision making power.
Improved equity is likely to result if all stakeholders’ needs, interests and abilities
are taken into account.
W h a t th e e x p e r ts W h a t th e g o v e r n m e n t
p ro p o s e d d e p a r tm e n t s p e c ifie d
T h e d e s ig n a fte r re v ie w b y T h e fin a l c o m p r o m is e
a n a d v is o ry c o m m itte e d e s ig n a g re e d
There are many other ways of doing a stakeholder analysis and many other factors
that could be considered.
http://www1.worldbank.org/publicsector/anticorrupt/PoliticalEconomy/PREMNo
te95.pdf - excellent World Bank paper on stakeholder analysis in reform
processes
http://www1.worldbank.org/publicsector/politicaleconomy/November3Seminar/
Stakehlder%20Readings/SAGuidelines.pdf - interesting guidelines for doing
SA (over-complex and quantitative?)
http://www.stsc.hill.af.mil/crosstalk/2000/12/smith.html - a good journal article
http://www.dfid.gov.uk/pubs/files/toolsfordevelopment.pdf - DFID (2002) Tools
for Development.
http://http-server.carleton.ca/~jchevali/Frontengl.html - eccentric Canadian
website
http://www.phrplus.org/Pubs/hts3.pdf - stakeholder analysis in health reform
http://www.policy-powertools.org/index.html - tools for SA in natural resource
management
1.5 A note on the Organic and Fairtrade Dried Fruit (OFDF) project case
study
Figure 1a The Organic and Fairtrade Dried Fruit (OFDF) project case study:
Example of an initial Stakeholder Analysis
Figure 1b The Organic and Fairtrade Dried Fruit (OFDF) project: Example of an initial Summary Participation Matrix
Action Inform Consult Partnership Manage/Control
Project Stage
Identification FAO Donors Ministry of Agriculture,
Livestock and Food (MALF)
Misral Dried Fruit Traders Association
Planning Small scale growers DONOR Misral Dried Fruit MALF
Traders Association
Children Producer Groups
Central Asian Traders
Women Provincial MALF
Chiefs Dried Fruit Importers
Large scale growers
FAO Fairtrade Labelling
Organisation (FLO)
Implementing and Donors MALF Implementing Partner Project staff Project Steering Committee
Monitoring
FAO Small scale growers Producer Groups
International Federation of Organic Children Misral Dried Fruit
Agriculture Movements (IFOAM) Traders Association
Women
Central Asian Traders
Large scale growers
Fairtrade Labelling
Provincial MALF
Organisation (FLO)
Chiefs
Evaluation FAO Implementing Partner Producer Groups Provincial MALF External Evaluators
Chiefs
Project staff Small scale growers
MALF
Central Asian Traders Children
Project Steering
IFOAM Women
Committee
FLO Large scale growers
Misral Dried Fruit
Donors Traders Association
There is no single right way to do this and there are a number of options for working
through the process – you should judge for yourself the best route to fit the context.
This stage will include analysis of previous studies, research or evaluation material –
perhaps documents that have lead you to this stage or documents from other
organisations. There may also be notes from earlier meetings that may inform the
process. The exercise usually needs to be repeated with different stakeholder
groups, often very different pictures of the situation emerge.
Addressing the
effects identifies
the indicators
EFFECTS
Turning the problem
into a positive
Focal Problem statement gives the
purpose or goal for
the intervention
Addressing the
causes of the
problem identifies
outputs and
CAUSES activities
Depending on the group or the situation there are two methods for developing a
problem tree…
Start with a blank sheet of flip chart paper, pens and 2” x 2” post-its (or small card
and tape).
Method 1: “Brainstorming”
This method can be more creative, but it is risky; you can get tangled up.
Participants “brainstorm" issues around a problem(s) as yet unidentified.
Each issue is recorded on a separate post-it. Don’t stop and think or question,
just scatter the post-its on the flipchart. When ideas for issues dry up and
stop,
Identify and agree the focal problem. It is probably there on the flipchart, but
may need rewording. Note that a problem is not the absence of a solution, but
an existing negative state.
Sort the remaining issues into causes and effects of the problem.
Cluster the issues into smaller sub-groups of causes and effects building
the tree in the process. Tear up, re-word and add post-its as you go.
Finish by drawing connecting lines to show the cause and effect
relationships.
Method 2: Systematic
Better suited to the more systematic and methodical.
Participants first debate and agree the focal problem. Write this on a post-it
and place it in the middle of the flipchart.
Now develop the direct causes (first level below the focal problem) by asking
‘but why?’. Continue with 2nd, 3rd and 4th level causes, each time asking ‘but
why?’.
Repeat for the effects above the focal problem instead asking ‘so what?’.
Draw connecting lines to show the cause – effect relationships.
Figure 2b The Organic and Fairtrade Dried Fruit (OFDF) project case study: Example of a Problem Tree
A problem
Disparity in income
and opportunity in ills and negative current tensions and
relation to gender, cultural norms conflict
tree
disability,
Exit from, and no Entry into Disillusionment with
vulnerable
new investment in, narcotics efforts towards good
perennial crops production governance
Low incomes of
small farmers and
their households Over- Failure to achieve
competitive national objectives
Low prices and saturated attitudes and
local markets approaches
Lost Lost
opportunities at opportunities to
household level Oversupply of dried products from national economy
perennial crops
EFFECTS
Farmer groups unable to export dried products
CAUSES
Erratic Weak linkages Lack of Poor planning Limited Weak
productivity among and information on at local and capacity of infrastructure;
and between technologies, national levels producers ICT and roads
production producers & markets and and traders
traders quality standards
Planning No systematic, Past and
absent or appropriate current low
Little
Incentives Weak Competitive fragmented training investment
compre-
poor for production attitudes hensive
History of central Low priority Incentives not
long-term and post- prevail in market
control and in state favourable to
planning and harvest spite of research
discouragement of planning and private sector
investment research extensive
by farmers markets entrepreneurship budgets investment
Having defined the problem that we are trying to tackle we now need to develop
this into objectives that we can work towards.
Some facilitators and participants prefer to skip Step 2 the Problem Tree and
move directly on to an Objectives or Vision Tree. Instead of looking back, looking
forward; rather than thinking in terms of negatives, participants imagine a desired
situation in the future; (this Focal Objective is placed in the centre of the flipchart.)
What is needed to achieve that situation? (placed below the Focal Objective).
What would result from achieving the situation? (placed above).
Going directly to an Objective Tree can be particularly useful in a post-conflict
context where participants find analysis of the problem painful.
This can be done by reformulating the elements of our problem tree into positive
desirable conditions. Essentially the focal problem is “turned over” to become the
key objective for addressing the problem. In logical framework terms it may be the
Impact/Goal or Purpose; discussed in more detail later. (So in our example, the
problem of ‘Farmer groups unable to export dried products’ could become an
objective of ‘Farmer groups exporting dried products to organic and fairtrade
markets’). Below the focal problem, you can continue this “reversing” for each of
the causes listed to create further objectives.
Above, if the problem is addressed one would expect to see changes in the
effects, so there will be useful ideas here for potential indicators of progress and
identification of the benefits to be achieved.
Figure 3a The Organic and Fairtrade Dried Fruit (OFDF) project case study:
An Objectives Tree derived from a Problem Tree
A problem
Disparity in income
and opportunity in ills and negative current tensions and
relation to gender, cultural norms conflict
tree
disability,
Exit from, and no Entry into Disillusionment with
vulnerable
new investment in, narcotics efforts towards good
perennial crops production governance
Low incomes of
small farmers and
their households Over- Failure to achieve
competitive national objectives
Low prices and saturated attitudes and
local markets
Lost approaches Lost
opportunities at opportunities to
household level Oversupply of dried products from national economy
perennial crops
EFFECTS
Farmer groups unable to export dried products
CAUSES
Erratic Weak linkages Lack of Poor planning Limited Weak
productivity among and information on at local and capacity of infrastructure;
and between technologies, national levels producers ICT and roads
production producers & markets and and traders
traders quality standards
Planning No systematic, Past and
absent or appropriate current low
Little
Incentives Weak Competitive fragmented training investment
compre-
poor for production attitudes hensive
History of central Low priority Incentives not
long-term and post- prevail in market
control and in state favourable to
planning and harvest spite of research
discouragement of planning and private sector
investment research extensive
entrepreneurship budgets investment
by farmers markets
An Objectives
More parity in
income and and negative cultural tension and
opportunity in norms addressed conflict
tree
relation to gender,
Increased new Decrease in More support for
disability, vulnerable
investment in narcotics efforts towards good
perennial crops production governance
Higher incomes of
small farmers and
Willingness to Better achievement of
their households
use more national objectives
Improved prices collaborative
Opportunities approaches Opportunities Possible
taken at taken at national
INDICATORS
household level Better supply of dried products economy level
from perennial crops
This has now given us a number of options for our objectives and the group needs
to decide which ones to focus on (Options Analysis). You should agree the
criteria for assessing the various options. Key factors here could include:
Degree of fit with macro objectives (The bigger picture)
What other stakeholders are doing?
The experience and comparative advantage of your organisation and
partners
What are the expected benefits? To whom?
What is the feasibility and probability of success?
Risks and assumptions? Who is carrying the risk?
Financial criteria – costs, cashflows, financial sustainability?
Social criteria – costs and benefits, gender issues, socio-cultural
constraints; who carries social costs?
Environmental criteria – what are the environmental costs and gains?
Technical criteria – appropriateness, use of local resources, market factors?
Institutional criteria – capacity, capacity building, technical assistance?
Economic criteria – economic returns, cost effectiveness?
When the criteria have been set a decision as to which option to take can follow.
Figure 3b The OFDF project case study: Options Analysis
Options analysis
•Degree of fit with higher plans •Feasibility?
Use objective •What are others doing? •Social criteria
criteria to •Experience and comparative advantage? •Technical
analyse which
•Costs? Who carries them? •Institutional
objectives ‘root’
•Benefits to whom? Poverty focus? •Economic & Financial
to prioritise
•Risks and assumptions? Who is at risk? •Environmental
What then happens to options which you decide NOT to address? (In the example
in Figure 3b, it has been decided, for whatever reason, not to focus on regular and
improved productivity and production and improved infrastructure.) It may be
these options are being addressed by others in parallel with your project (in which
case there will be need for dialogue with those invoved). If no one will be
addressing them, and these root causes to the orginal problem are serious, they
remain risks to our planned project and will need to be managed. We will return
to this later.
Sometimes it is possible to link the chosen options from the objectives tree into the
first ‘objectives’ column of the logframe as shown in Figure 3c.
It does not always work as neatly as in the example! It depends on the complexity
of the orginal problem, and on the time spent on and the level and detail of the
problem analysis. Sometimes the original core problem translates into the
Purpose (as here), sometimes into the Impact/Goal. The point is, your problem
and objectives trees are important as source documents for ideas. There are
no hard and fast rules. In the example, a major effect of the original problem low
income for small farmers and their households has been used as the basis for the
Goal, giving the project a social and poverty focus.
Figure 3c The OFDF case study: Linking with the logframe objectives
Impact / Goal
small farmers and their
families
Increased income of small farmers and
their families
Outcome / Purpose
Farmer groups exporting dried
Farmer groups exporting dried products to organic and fairtrade
products to organic and markets
fairtrade markets
Outputs
1. Effective linkages in place
Effective Evidence A coherent Strengthened 2. Market–oriented evidence available
linkages available on plan in place capacity of
among and technologies, at local and producers 3. A coherent plan developed at local
between markets and national and traders and national levels
producers & quality levels 4. Strengthened capacity of producers
traders standards
and traders
Activities
We have defined our problem and begun to consider our objectives. Remember
the Problem Tree and Objectives Tree are important reference documents at this
stage. Work through a simple step-by-step approach.
We put the objectives into the first column of the logical framework – the objectives
column:
Figure 4a The Objectives Column
Column 2 Column 3
Column 1 Column 4
Indicators / Data
Objectives Assumptions
targets sources
Goal:
Purpose:
Outputs:
Activities:
The main activities that must be
undertaken to deliver the
outputs
The How?
Column 1 Column 2
Column 3 Column 4
Objectives Indicators /
Data sources Assumptions
targets
Goal:
Purpose:
Farmer groups and exporters are competent partners for
international trade and are exporting dried fruit products
to organic and fairtrade markets.
Outputs:
Activities:
1. Do they answer
Goal Greater Why?
Purpose Why?
Outputs What?
Activities How?
Then
If
Is it necessary and sufficient? (i.e. is too much or too little being
proposed?)
Remember other documents are likely to help in the identification of risks; e.g. the
stakeholder analysis, the problem analysis etc. But once we have identified the
risks, what are the key questions?
Figure 5b The Key Questions
COSTS? Social? Financial? What are they and who bears them? The
already vulnerable?
GAINS? What are the gains from going ahead?
Step 1 Identify the risks. Brainstorm the risks using the draft Hierarchy
of Objectives (Column 1). At each level ask the question: ‘What
can stop us … ?’ …doing these Activities,…..delivering these
Outputs, ….achieving this Purpose, ……contributing to this
Impact / Goal?
These are phrased as risks. Write each risk on a separate post-
it and place them in column 4; it does not matter at this stage at
what level you place them.
On a separate sheet on flipchart paper draw the table in Figure
5b overleaf. Transfer the risk postits from column 4 of the
logframe to the left column of the new table.
Step 2 Analyse and manage the risks. Then as a group discuss each risk
in turn:
Example:
Highjacking is a risk in civil aviation. As a mitigatory measure,
passengers are now subject to hand luggage and body searches.
Even if done effectively this does not remove the risk altogether; the
Impact probably remains unchanged, the Probability may be reduced
from Medium to Low. You are left with a residual assumption that
‘With effective screening measures in place, highjacking will not
happen’.
Transfer these
Do these transfer to to Column 4 of
Column 1 and become the LF
extra activities?
4
Importance
5
Probability
Ensure institutional
2. Benefits of the 2. Benefits of the project
representation of
project are captured accrue to the
M M disadvantaged groups.
by elites at vulnerable at
community and community and
household levels. household levels.
Initial and on-going
3. Export organic and 3. Local production is
market research must
fairtrade markets are able to compete in
be realistic and robust.
hard to penetrate and M L meeting growing
local markets international and local
become saturated. demand.
Encourage diversity of
4. Required production 4. Key production inputs
service provision.
inputs outside project are available to small
Strong collaboration
control (notably farmers.
extension advice and L M with relevant partners.
Inclusion of partners in
irrigation) are
planning and capacity
available.
building.
5. Current social Thorough stakeholder 5. Essential linkages
networks hinder the analysis, involvement between producers,
establishment of new and ownership. traders and others in
essential linkages H L Implement the market chain can
e.g. between communication be fostered.
producers and strategy.
traders.
6. The on-going Effective training and 6. Quality needs are
demands of communication. understood and
international quality Clear and understood addressed especially
standards are alien to quality criteria. by producers and
producers and H M Export farmer traders.
traders. certification and
ongoing fair produce
grading system.
7. The incentives and Parallel efforts within 7. The incentives for
social pressures to the enforcement and small farmers to
stay in, or enter, H M alternative livelihood produce and export
narcotics production programmes. dried fruit are strong
are too strong. enough.
You have identified and analysed the risks, determined mitigatory measures and
agreed what residual assumptions still hold. Transfer to your logframe as
appropriate:
Your mitigatory measures into Column 1; i.e. extra activities; (or the
measures may be reflected in the indicators in Column 2; we come to this
later).
Your residual assumptions into Column 4. These are conditions which could
affect the success of the project. They are what remains after the
mitigatory measures have been put in place.
By adding assumptions our logic is extended; check the logic with the IF AND
THEN test:
IF the Pre-conditions hold, THEN the Activities will be carried out.
IF Activities have been carried out, AND if the Assumptions at Output level
hold true, THEN the Outputs will be delivered.
IF Outputs are delivered, AND if the Assumptions at Output level hold,
THEN the Purpose will be achieved.
IF the Purpose has been achieved, AND if the assumptions at Impact level
hold, THEN the Project will contribute to the Impact / Goal.
Objectives Assumptions
Impact/
Goal Then we should And these
contribute to this conditions
Impact/Goal hold
If
One of the key strengths of the logframe approach is that it forces the planning
team to build into the design how the project will be monitored, reviewed and
evaluated. The project is planning to deliver, achieve and contribute a chain of
results at different levels; these are the intended changes in development
conditions resulting from the development project or programme.
Indicators are identified to show how we intend to measure change from the
current baseline. Targets are set to be achieved by the end of the time period,
together with milestones to measure progress along the way. The logframe
approach helps in addressing and reaching agreement on these issues early at
the design stage. It helps to pinpoint the gaps and determine what needs to be
done. It asks what data is needed now and in the future, and what data sources
will be used, be they secondary, external, reliable and available, or primary,
internal and requiring budgeted data collection activites within the project.
An oft-quoted principle is ‘if you can measure it, you can manage it’. The one
may not inevitably follow the other, so we can qualify as: ‘if you can measure it,
you are more likely to be able to manage it’. Or the reverse that ‘if you can’t
measure it, you can’t manage it.
6.2 Terms and principles
Indicators Targets
the proportion of population with halve, between 1990 and 2015, the
access to improved sanitation, proportion of people without
urban and rural sustainable access to basic
sanitation
The indicator shows how the change from the current situation will be measured.
An indicator is not something you achieve. You do however aim to achieve a
target. A target is an endpoint; a Specific, Measureable, Achievable, Relevant
and Time-bound endpoint. A target should be SMART; don’t try making an
indicator smart. And don’t make the objectives in column 1 of the logframe smart;
keep them as broad results.
It’s useful to think of milestones as interim or formative targets. Thus for the first
example target above of halving by 2015 the proportion of people without
sustainable access to basic sanitation, reductions of 35% by 2009 and 42% by
2012 would be milestones. They provide an early warning system and are the
basis for monitoring the trajectory of change during the lifetime of the project.
A baseline is needed to identify a starting point and give a clear picture of the pre-
existing situation. Without it, it is impossible to measure subsequent change and
performance (Figure 6a). For example, without knowing the baseline, it would not
be possible to assess whether or not there has been a ‘25% improvement in crop
production’. Collecting baseline data clearly has a cost; but so does the lack of
baseline data! The reliability and validity of existing, secondary data may be in
doubt and there may not be enough of it. In which case, baseline studies will be
needed before targets can be set and before approval for implementation can
generally be given. In some circumstances, it may be appropriate to carry out
some baseline data collection and target-setting post-approval. Indeed it may be
perfectly acceptable, indeed good practice, to state that some ‘indicators and
targets to be developed with primary stakeholders in first 6 months of the project.’
Figure 6a: Baseline, targets and achievement (adapted from UNDG guidelines)
Commitment
Performance
Achievement
Current level of
Baseline
achievement
Target
Is the baseline
data available?
No
Yes
Is it possible
to collect it?
Yes
No
Collect it
Choose different indicators
Set milestones and targets
to be achieved
Before looking at the process of constructing indicators and targets, the point is
made again here: who should be involved in developing indicators and
determining the target? ‘Insiders’ are much more likely to come up with original
and effective measures than ‘outsiders’.
Step1: Start by writing basic indicators as simple measures of change. They are
best written at this stage without elements of the baseline or target, without
numbers or timeframe. For example:
Step 2: Indicators need to be clear, measuring quality and quantity and, where
appropriate, disaggregated and location-specific. So re-examine your basic
indicator to clarify your measure. The previous examples might develop into:
Step 4: With the relevant baseline data to hand, determine milestones (at regular
intervals during the project) and targets (at the end). For example
a. % loan return rate of men and women group F44:M24 F50:M40 F70:M60 F80:M70
in 3 targeted districts.
d. Average weekly fish catch per legally certified 50kg 50kg 75kg 100kg
boat.
Step 5: Check that your milestones and targets are SMART, Specific,
Measureable, Achievable, Relevant and Time-bound.
To be useful, indicators need to have a number of characteristics. They need to
be:
Specific; not vague and ambiguous; clear in terms of the quality and
quantity of change sought; sensitive to change attributable to the project;
disaggregated appropriately;
Measurable; the information can be collected, and will be available at
the time planned; cost-effective and proportionate
Achievable; realistic in the time and with the resources available; targets
not just ‘made up’, without baseline or stakeholder ownership;
Relevant; substantial, necessary and sufficient; they relate to higher
level indicators
Time-bound; milestones will together show progress is on-course;
targets are measurable within the lifetime of the project.
Rigid application of the steps and format outlined in 6.4 can result in performance
or change that is difficult to quantify not being considered or given value. We
should not ignore to measure changes just because they may be difficult to
quantify or analyse.
It is often, with care, possible to ‘quantify’ qualitative aspects; opinion polls and
market surveys do it all the time. A citizen score card for example might collect
public opinion data on public services. Whether the instrument is valid or crude or
spurious will depend on the context, and the way the information is collected,
analysed and used.
Focus on the processes will generally lead to better targeting of the activities at
real problems and needs, better implementation and improved sustainability. At
the outset of a process initiative it may be very difficult, and undesirable, to state
the precise products of the initiative. Instead outputs and activities may be
devised for the first stage or year; then later outputs and activities are defined on
the basis of the initiative learning. Processes will therefore need more frequent
monitoring.
Product indicators may measure the technologies adopted, the training manual in
print and disseminated, the increase in income generated. Process indicators are
usually more qualitative and will assess how the technologies were developed and
adopted, how the manual was produced and how the income was generated, and
who was involved. At least some of these indicators will be subjective. End-users
and participants may be asked to verify them, but the means of verification may
still be less than fully objective.
Having set indicators, milestones and targets, what Data Sources or evidence will
be used for each measure? This is a vital aspect of the initial planning that is often
overlooked. Building in data sources at this stage will make the monitoring, review
and evaluating of the project easier.
Column 3 of the logframe relates to the verification; indeed it is sometimes titled
Means of Verification. It should be considered as you formulate your indicators
and targets. So complete columns 2 and 3 at the same time.
A data source will almost invariably be documents; sometimes it may be films,
DVDs, videos or audiotapes. The key point, a data source is not an activity, such
as a survey, a stakeholder review. If an activity is required, and will be done and
budgeted within the project, then it will be in Column 1 of the logframe. The
output of that activity, the survey report or review report will be the data source.
In specifying our Data Sources we need to ask a series of simple questions:
What evidence do we need?
Where will the evidence be located?
How are we going to collect it?
Is it available from existing sources? (e.g. progress reports, records,
accounts, national or international statistics, etc)
Is special data gathering required? (e.g. special surveys)
Who is going to collect it? (e.g. the project team, consultants, stakeholders
etc)
Who will pay for its collection?
When/how regularly it should be provided (e.g. monthly, quarterly annually)
How much data gathering (in terms of quantity and quality) is worthwhile?
1. Are the Targets and Milestones described in terms of Quality, Quantity and
Time (QQT)?
2. Are the Indicators and Data Sources:
Relevant
Valid / Reliable
Measurable / verifiable
Cost-effective / proportionate?
3. Are the Indicators necessary and sufficient? Do they provide enough
triangulation (cross checking)?
4. Are the Indicators varied enough?
Product and Process
Direct and Indirect
Formative, Summative and beyond
Qualitative and Quantitative
Cross-sectoral?
5. Who has set / will set the Indicators? How will indicators be owned?
6. Are the Data Sources
Already available
Set up where necessary within the project?
7. Is there need for baseline survey?
Data
Objectives Indicators and Targets Assumptions
sources
Milestones
Indicators Base- Target
line 1year 2 year - 2015
6
Most are expressed as Indicators; Targets to be determined by end of Inception Phase and baseline survey.
Indicative Activities:
1.1 Raise awareness of key 1.1 Completed by M2. Quarterly reports
stakeholders. 1.2 PSC in place by M3. Quarterly reports 6. Key
1.2 Establish Project Steering 1.3 Staff recruited, trained and in Quarterly reports production
Committee (PSC). post by M6. inputs are
1.3 Recruit / train core staff. 1.4 Completed by M4 Quarterly reports available to
1.4 Initial stakeholder 1.5 Inception Report agreed by PSC Inception report small
consultations. completed by M6 including and PSC meeting farmers.
1.5 Secure agreement on project plan, M&E framework report 7. The
Inception Report. and security plan. incentives for
small farmers
2.1 Establish partnerships 2.1. Linkages in place by M5 with Quarterly reports to produce
with existing institutions meetings at least quarterly and export
(including parallel thereafter. dried fruit are
programmes on counter 2.2 Review completed by M7 with Review report and sufficiently
narcotics and alternative action plan in operation Quarterly reports strong.
livelihoods). 2.3 Three district-level clusters each Quarterly reports
2.2 Review current socio- of at least 12 farmer groups with
economic networks with a total of 120 farmers
emphasis on gender and established by M12 and meeting
the needs of vulnerable monthly. A further six similar
groups. district clusters established by
2.3 Set up farmer groups. M24; total number of groups 36,
2.4 Identify and build and farmers 360.
networks with diverse 2.4 Initial review carried out as part of Review report and
service providers in public 2.2; review action plan in Quarterly reports
and private sectors and operation.
civil society.
3.1 Analyse market 3.1 Robust analysis completed by Analysis report
opportunities and M9. and Quarterly
standards. reports
3.2 Conduct baseline and on- 3.2 Baseline study completed by M 9. Baseline report
going study of farmer Ongoing data study thereafter and Quarterly
practices, productivity and report
production.
3.3 Review lessons from 3.3 Reviews completed by M12 with Review report
similar quality standards case studies and clear lessons
export marketing efforts, derived.
particularly in complex,
difficult environments.
3.4 Establish information 3.4 Timely quality information OFDF Plan
systems for on-going informing the development, Quarterly reports
access, flow and implementation and updating of
exchange of information. the OFDF plan
3.5 Carry out analysis of post- 3.5 Analysis provides information as Synthesis report
harvest elements of the per 3.4 OFDF Plan
market chain. Quarterly reports
3.6 Identify best practices in 3.6 Best practice briefings for a Best practice
production and post- variety of audiences drafted and briefings and
harvest. tested; first set by M 18. other materials
4.1 Develop farmer group 4.1 Each group develops a plan Distrcit staff
level action plans. within 3 months of forming; reports and
4.2 Agree criteria for OFDF updated annually. Quarterly reports
project support. 4.2 Initial critiera set by M 6; Quarterly reports
4.3 Develop and agree overall amended in the OFDF plan.
OFDF project plan and 4.3 Plan agreed by PSC M 9. The OFDF plan
process. and Quarterly
4.4 Implement following 4.4 Implementation targets as per the reports
agreed plan and process. plan. Quarterly Reports
4.5 Develop and implement 4.5 Communications plan agreed by The Comm plan
OFDF communications PSC by M12. and Quarterly
plan and strategy. Reports
5.1 Carry out comprehensive 5.1. TNA completed by M12. TNA report
Training Needs
Assessment (TNA)
across key stakeholders.
5.2 Develop and implement a 5.2 Training plan in place by M12; Training Plan and
training programme for training ongoing thereafter. reports
key stakeholders.
Now the full Budget needs to be prepared. Figure 7b gives an example. It is not
essential for the budget line headings to fully correlate with the logframe objective
headings and not always possible. For example there could be one project vehicle
partially used for implementation of ALL project activities.
However if costs can be accounted for against project activities and outputs then
value for money can be compared between the different Activities and Outputs
and this will be very useful when the project is reviewed and perhaps further
phases are planned and funded.
In addition if project expenditure can be reported against the logframe objectives
then expenditure on different aspects of the project become much more
transparent for the interested, but intermittently involved, stakeholders
Figure 7a Example of a work plan / Gantt Chart (partial) The OFDF case study
MONTH
ACTIVITY WHO? 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 etc.
Activities / Inputs Unit Quantity per quarter Cost per Cost codes Costs per quarter Project
unit total
Q1 Q2 Q3 Q4 Project Govt Q1 Q2 Q3 Q4
1.1 Raise awareness of
key stakeholders
Equipment
Computers No. 1 780 E2 A/1.5 780 780
Travel Km 500 500 250 250 0.2 T1 C/2.3 100 100 50 50 300
Non-fixed salaries and P days 40 40 40 40 70 S4 B/4.3 2800 2800 2800 2800 11200
allowances
Consultancy support P days 14 14 300 S3 B/3.2 4200 - - 4200 8400
Meeting costs No. 2 1 1 3 200 P5 F/4.2 400 200 200 600 1400
Communications Lump 2 2 1 1 100 O3 H/3.3 200 200 100 100 600
1.2 etc
1.3 etc
8. CONCLUSIONS
8.1 Checking the Logical Framework
You should now have a completed Logical Framework and it is worth going through it
and checking it against this checklist7.
4 The Purpose is clearly stated and does not contain words like “by”,
“so that” or “through”.
7 The outputs are stated as results, with the noun preceding the
verb.
7
Adapted from the Team up Project List.
The logical framework now provides a comprehensive and through project plan that
all partners have been involved in and that has an inherent logic running through it.
The logical framework is useful for a number of purposes:
Monitoring, Reviewing and Evaluating – Keeping track of the project, it forms a
most useful monitoring, reporting and evaluation tool (See Appendix F for further
details).
Communicating the details of what the project is about – Informing partners about
the overall objectives of the project (See Appendix I for further details).
Reporting in brief.(See Appendix J for further details).
A commissioning tool – Section 8.3 explains how frameworks can be nested
within each other – the overall goals can become Purposes which other
organisations can be commissioned to deliver.
One of the interesting things about logical frameworks is how they can be linked
together and ‘nested’ within each other. Your organisation/group may have a number
of different level plans (For example an organisational plan, regional plans, team
plans and individual plans within these). Theoretically the objectives should feed
down through these plans so that the ‘Purpose for the high level plan becomes the
impact / goal for the subsequent plans and this process continues as objectives
become more and more specialised. See Appendices G and H for further details.
APPENDIX A: GLOSSARY
Term Definitions Notes
Impact Positive and negative, long-term effects on These effects could be economic,
identifiable population groups produced by a socio-cultural, institutional,
development intervention, directly or indirectly, environmental, technological or of
intended or unintended. other types. Note that both Goal
and Impact should relate to people,
not solely to things e.g. an
ecosystem.
Inputs The financial, human, material technological
and information resources used for the
development intervention.
Milestones Significant points in the lifetime of a project. Hence the term may apply to a
Times by which certain progress should have milestone indicator or target;
been made. synonymous with formative
indicator or target in contrast with
terminal – at the end of a given
period or intervention.
Logical A management tool used to improve the Typically synonymous with Results
Framework or design of interventions, most often at project Framework or Design and
Logframe level. It involves identifying strategic elements Monitoring Framework. Though
(inputs, outputs, Purposes and impact) and most often used at project level, is
their causal relationships, indicators and the also used at lower levels (e.g. an
assumptions and risks that may influence personal development plan) and at
success and failure. It thus facilitates higher levels (e.g. programme,
planning, execution and evaluation of a budget support, or country levels -
development intervention. such as an UNDAF Monitoring and
Evaluation Framework).
Means of Data sources and reporting mechanisms that More or less synonymous with
Verification specify how indicator data will be collected, by Evidence or Verification or Data
(MoVs) whom and when. Sources.
Objective A generic term referring to Activities, Outputs, To avoid confusion it is best to only
Purpose and Impact. use this term generically. Avoid
using it more narrowly e.g. Specific
Objective, Intermediate Objective,
Development Objective.
Purpose The likely or achieved short-term and Outcome has become synonymous
medium-term effects of an intervention’s with Purpose. Limit the Purpose to
outputs, usually requiring the collective effort one succinct statement to ensure
of partners. Purposes represent changes in clarity and focus. Purpose
development conditions which occur between statements typically describe the
the completion of outputs and the change of behaviour resulting from
achievement of impact the uptake or use or implementation
by others outside the project team
(often beneficiaries) of the Outputs.
Outputs The products and services which result from Outputs are like promises; they are
the completion of Activities within a the deliverables, the term of
development intervention. reference of the project manager
and team. The team has a high
degree of control over the delivery
of the outputs.
Project A series of activities aimed at bringing about Confusingly the term is sometimes
clearly specified objectives within a defined used more widely to include
time-period and with a defined budget. programmes and budget support;
i.e. it is used synonymously with
Development Intervention.
Purpose The publicly stated outcome of a project or Purpose has become synonymous
programme. with Outcome. Outcome is
preferred in UNDG terminology.
Results Results are changes in a state or condition Result is best used as a generic
which derive from a cause-and-effect term for output, outcome and
relationship. There are three types of such impact at any or all levels. In
changes (intended or unintended, positive contrast the EC uses the term
and/or negative) which can be set in motion narrowly, synonymous with Output.
Results chain The causal sequence for a development Based on a theory of change,
intervention that stipulates the necessary including underlying assumptions.
sequence to achieve desired objectives –
beginning with inputs, moving through
activities and outputs, and culminating in
outcomes, impacts and feedback.
Risk A potential event or occurrence could A risk should not be written as the
adversely affect achievement of the desired negative of an assumption (e.g.
results. Assumption = ‘inflation remains at
manageable level’; Risk =
‘Hyperinflation’). It is useful to view
assumptions as the conditions that
remain after mitigatory measures
have been put in place.
Stakeholder Any person, group, organisation or institution This includes intended beneficiaries
that has an interest in an activity, project or and intermediaries, winners and
programme. losers, and those involved or
excluded from the decision making
process.
What is a project?
A project can be defined as ‘a series of activities aimed at bringing about clearly
specified objectives within a defined time period and with a defined budget’8.
Within the business context emphasis is placed on the need for a project to be
created and implemented according to a specified business case. In the
development context, this may not be considered relevant. But it is. Perhaps omit
the word business and the message is clear and useful; that a project needs to have
a specified case. It needs to be based on a clear rationale and logic; it must be
‘defendable’ at all stages when it comes under scrutiny.
By its very nature, a project is temporary, set up for a specific purpose. When the
expected results have been achieved, it will be disbanded. So projects should be
distinguished from on-going organisational structures, processes and
operations, with no clear life cycle. These organisational aspects may well of course
provide key support functions to projects but those aspects do not come with the
remit of the project team. Where needed they are in effect services bought in by the
project. (One can of course have an individual with more than one role, one of which
may be long-term, on-going within the organisation, another temporary within a
project.)
Within the development context there are many different types of project;
different in purpose, scope and scale and this can lead to confusion. In
essence a project is any planned initiative that is intended to bring about beneficial
change in a nation, community, institution or organisation. It has boundaries that are
determined by its objectives, resources and time span. A ‘project’ typically is a free-
standing entity relatively small in budget, short in duration and delivered by its own
8
EU (2004) Aid Delivery Methods. Volume 1 Project Cycle Management Guidelines available at
ec.europa.eu/comm/europeaid/reports/pcm_guidelines_2004_en.pdf
9
This definition comes from PRINCE2 a project management method established by the UK Office of
Government Commerce (OGC) which has become a standard used extensively by the UK government
but which is also widely used and recognised internationally.
OGC( 2005) Managing successful projects with PRINCE2
But all these issues are not unique to projects; many can apply equally to other aid
approaches. And they have not meant that projects have disappeared. In non-state
work, such as civil society (e.g. NGOs, charities) and the private sector, projects
remain a key aid modality. And projects remain within state work, but the nature and
ownership of those projects and the funding mechanisms behind them have changed
and are continuing to change.
Negotiate effective solutions to the various conflicts that may arise between
the needs of the project and its stakeholders.
Identify the risks to the project and limit their effects upon its success.
Use a variety of basic project management tools and techniques
Maintain a good sense of humour at all times!
© EIF 2011
STRATEGIC OBJECTIVES
Requests
Local Objectives
Project Concepts
Feasibility Studies
IDENTIFICATION
Evaluation Studies
Stakeholder Analysis
CLEARANCE Problem Analysis
EVALUATION Risk Analysis
Logical Framework
Analysis
LESSON DESIGN
Project Completion LEARNING
Project Document
Reports
Terms of Reference
COMPLETION
APPROVAL
Project Identification, Formulation and Design
-----------------------------------------------------------------
Participatory Management
Reporting
IMPLEMENTATION
Monitoring
Output-to-Outcome
Reviews Activity-to-Output
Page 57
Reviews
Project Identification, Formulation and Design
-----------------------------------------------------------------
Step 5 Check the vertical logic back up Column 1 Step 6 Define the assumptions at each level
Apply the If/then test to check cause and effect. If the listed Activities are carried Do a robust risk analysis to determine the Assumptions in the project
out, then will the stated Output result? Is what is planned necessary and design.
sufficient? Are we planning to do too much or too little? And so on up Column 1.
INTRODUCTION
The logical framework (logframe) approach (LFA) is a process and tool (more
accurately a ‘basket of tools’) for use throughout the project and programme cycle10 to
help strengthen analysis and design during formulation, implementation, evaluation
and audit. It involves identifying strategic elements (activities, outputs, Purpose and
impact) and their causal relationships, indicators and evidence to measure
performance and the assumptions and risks that may influence success and failure.
The logframe approach includes a set of interlocking concepts to guide and structure
an iterative process of analysis, design and management. In this paper we
distinguish between that process and the documented product of that process, the
logical framework matrix. A quality process is vital if a useful and effective product is
to be generated. The approach is essentially a way of thinking, a mentality. In some
contexts the matrix product is less important than the process; indeed a matrix may
not be needed.
The approach has become very widely employed and influential especially, but not
exclusively, in international development work. Many development agencies,
including national governments, multilateral and bilateral partners, and non-
government organisations, use the logframe approach in one of its variants. In many
agencies and for a variety of reasons, it has become mandatory practice.
Aid effectiveness commitments, most recently in the 2005 Paris Declaration11 agreed
by most partners in the development community, set out clear progress indicators
including for harmonisation of procedures in shared analysis, design and results-
oriented frameworks. This is work still, as the webpages say, ‘under construction’.
Already we are seeing much more consensus on terminology (e.g. in OECD12 and
UNDG13 glossaries). Similarly there is more uniformity amongst agencies in the
format of logical frameworks than there was a decade ago. Complete uniformity is
unlikely to be achievable or indeed desirable; frameworks are needed for different
outcomes so a general design framework will differ from one specifically to show
detailed results monitoring arrangements. The important thing is that the frameworks
help not hinder communication; that users can see how frameworks for different
outcomes link one to another within an overall results-based management system.
10
The LFA can be applied at different levels with small projects, a higher-level programme or indeed a
whole organisation. In this paper, the term ‘project’ is intended to include all levels.
11
http://www.oecd.org/dataoecd/11/41/34428351.pdf
12
http://www.oecd.org/dataoecd/29/21/2754804.pdf
13
http://www.undg.org/documents/2485-Results-Based_Management_Terminology_-
_Final_version.doc
There are however limitations to the logframe approach. In the current debate, it is not
easy to separate weaknesses that may be inherent in the tool itself from the poor
application of that tool. Some feel it is essentially a good tool, but one that is often
badly applied. The 'good servant, bad master' theme is deepened by the frequent use
of the logframe as a rigid and inflexible tool for central, hierarchical control. Some
opponents go further and reject the approach itself on the grounds that it is
reductionist and simplistic, that it exacerbates power imbalances between funder,
intermediary and beneficiary and that it is 'western-centric'.
Perhaps the most valid, but not altogether satisfactory, justification for widening the
use of the LFA is that 'something is better than nothing'. An approach has to be used,
ultimately to report progress against expenditure, and if there is widespread
consensus on one approach, all the better. Some who criticise the LFA as a planning
tool, are actually comparing it with not planning. Most of us would rather not plan; but
not planning rarely results in effective and efficient operation.
Many lessons have been learnt over the last twenty years as regards LFA best
practice; examples of enlightened and rewarding application in a variety of contexts
are now common. The LFA will only be beneficial if it is used in a thoughtful way such
that it influences project identification and design from the start, rather than only being
added at the end. The logframe matrix itself should be a product and summary of
thorough and systematic situation analysis and cannot be a substitute for this. As
such it must be embedded in a wider process; before work on the logframe matrix
starts, there needs to be analysis of who should be involved and how. This in turn will
lead to more effective appraisal of the context (be it social, technical, environmental,
economic, institutional, or gender etc.), of the problem to be addressed, of the vision
sought and strategic analysis of the alternative ways forward.
It brings together in one place a statement of all key elements of the project or
programme.
Having all key components of projects or programme in a systematic, concise
and coherent way helps you clarify and demonstrate the logic of how the initiative
will work. This can be particularly helpful when communicating between partners
and when there is a change of personnel.
It fosters good situation analysis and project design that responds to real problems
and real needs.
It systematizes thinking. It can help ensure that the fundamental questions are
asked and that cause and effect relationships are identified. Problems are
analysed in a systematic way and logical sequence. It guides you in identifying
It anticipates implementation.
The logframe approach helps in the setting up of activity and input schedules with
clear anticipated outcomes. Likewise the use of logframes, can help ensure
continuity of approach if any original project staff move or are replaced.
It sets up a framework for monitoring and evaluation where anticipated and actual
results can be compared.
By having objectives and indicators of success clearly stated before the project
starts the approach helps you set up a framework for monitoring and evaluation.
It is notoriously difficult to evaluate projects retrospectively if the original
objectives are not clearly stated. It helps to reveal where baseline information is
lacking and what needs to be done to rectify this. The approach can help clarify
the relationships that underlie judgements about the likely efficiency and
effectiveness of projects; likewise it can help identify the main factors related to
the success of the project.
It does not add time or effort to project design and management, but reduces it.
Like many other design and management tools the logframe approach has to be
learnt before it can be effectively used. Once learnt however, it will save time. Of
course, if it is being compared with not doing essential analysis and design work,
then it takes longer; but ‘not doing’ is not an option.
It enhances communication.
The approach facilitates common terminology, understanding, purpose and
ownership within and between partners. Several logframes can interrelate; they
can nest together as a portfolio of initiatives working towards a common vision. In
a powerful way this can help individuals and teams understand the whole of
which they are a part; it helps them to see the bigger picture.
It can be used as a basis for a reporting and overall performance assessment system.
The monitoring and evaluation elements of the logframe can be used to develop
a format for reporting clearly and succinctly against objectives and indicators and
for success scoring. Scores in turn can be collated across a portfolio to give an
assessment of overall performance and organisational and developmental
effectiveness.
It is not a substitute for other technical, economic, social and environmental analyses.
It cannot replace the use of professionally qualified and experienced staff.
It can help project design, implementation and evaluation, but clearly does not do
away with the need for other project tools especially those related to technical,
economic, social and environmental analyses. Likewise the approach does not
replace the need for professional expertise and experience and judgement.
IN CONCLUSION
The logframe is not a panacea. However, used sensitively, it is a powerful approach,
that can result in greater effectiveness, efficiency and inclusion. Developing a
logframe with real participation can have a very positive impact. Fresh thinking is
needed, customised to each context, to the extent in some contexts perhaps of not
using the matrix itself, and just working with the questions therein. The LFA’s wide
adoption suggests that, on balance, its strengths outweigh its limitations; some
disagree. Users need however to be well aware of the weaknesses and potential
abuses and misuses of the approach. The LFA must to be used flexibly with eyes
open to its limitations and pitfalls.
Systems
For Administration
For Management
For Handling Information
Procedures and guidelines
For Research
For Monitoring and Evaluation
For Promotion and dissemination
For Procurement and Contracting
For Reporting
For Human Resource Management
Infrastructure
Clinics
Classrooms
Computers etc.
Materials
Research publications
Extension materials
Grey literature
Training materials / curricula
Broadcasts
Websites
Databases
Documented procedures
Product and Process
MDGs
Learning
Capacity
Why?
Accountability building for
performance
Decision Making
Monitoring: I
the systematic collection and analysis on a regular basis of
data for checking performance. This is usually done O
internally to assess how inputs are being used, whether and
O
how well activities are being completed, and whether outputs
are being delivered as planned. Monitoring focuses in
A
particular on efficiency, the use of resources. Key data
sources for monitoring will be typically internal documents
such as monthly/quarterly reports, work and travel logs,
training records, minutes of meetings etc.
Review:
an assessment of performance periodically or on an ad hoc I
Evaluation: I
in many organisations is a general term used to include
review. Other organisations use it in the more specific sense O
of a systematic and comprehensive assessment of an on-
going or completed initiative. Evaluations are usually carried O
What typically internal both internal and both internal and external
sources of documents such as external documents such including review reports,
inform- monthly/quarterly as ½ yearly or annual consultants reports, national and
ation are reports, work and reports, a report from a international statistics, impact
used? travel logs, training stakeholder participatory assess-ment reports etc.
records, minutes of review event, data
meetings etc. collection documents,
consultants reports etc.
Who uses managers and staff many people use the many people use the
the are the main users of information e.g. information e.g. managers,
results? the information managers, staff, staff, donors, beneficiaries
gathered donors, beneficiaries and other audiences
Performance Scoring
Some organisations use scoring systems as an integral part of the monitoring and
review process to rate aspects of performance; for example of the likelihood that the
outputs and Purpose of the project will succeed (or have succeeded, depending
on when the scoring is done) or of the level of risk, which threatens the achievement
of success.
Annual scoring can provide important data for accountability, learning and decision-
making. With care it may be possible for scores to be aggregated across a
programme or sector or office to provide an overall picture of success and value for
money. The quality of scoring is clearly a key issue; bad data generates bad
conclusions. The system has to be applied consistently and robustly involving
relevant stakeholders and partners.
A typical scoring system (based on DFID’s), using a scale of 1-5 that can be applied
for each Output, overall at Output level and at Purpose level:
A typical risk rating system (also based on DFID’s) that can be used to determine an
Overall Project Risk rating:
Rating Description
Low Risk factor may lead to tolerable delay in the achievement of
Impact objectives or minor reduction in Quality/Quantity and/or an
increase in cost.
Medium Risk factor may lead to some delay, and/or loss of
quality/quantity and/or and increase in cost.
High Risk factor may cause some or all aspects of objectives in
relation to Time, Quality/Quantity not being achieved to an
acceptable standard or to an acceptable cost.
Low Unlikely to occur or the risk is fully manageable by us.
Probability
Medium Could go either way and we can have some influence in
managing the risk but cannot control it completely.
High Very likely to occur and our ability to actively manage the risk
is limited.
FAO
http://www.fao.org/pbe/pbee/en/224/index.html
http://www.fao.org/docs/eims/upload/160705/auto-evaluation_guide.pdf
IFAD
http://www.ifad.org/evaluation/guide/
EU Guidelines
http://europa.eu.int/comm/europeaid/evaluation/methods/guidelines_en.pdf
UN Evaluation Forum
http://www.uneval.org/
INSTITUTION
Mandate
Mission
Objectives
PROGRAMMES
Themes
Sectors
Regions
PROJECTS
The logframe approach can help to communicate, organise, manage and focus a
portfolio:
For the individual involved in such an organisation, to be able to ‘see the whole’
can be important in motivation and ownership.
Department or Country
Assistance Plan level
Impact / Goal
Poverty reduced in Sub- Sector level
Saharan Africa. e.g. Health sector in
Nkonia
Purpose Impact / Goal
Progress towards Progress towards health
Millennium Development MDGs in Nkonia. Programme level
Goals in 16 key countries. e.g. sexual and
reproductive health in
Ekim State.
Outputs Purpose Impact / Goal
1. Government-led Government-led health State health programme
health programmes programme within Poverty implemented successfully
within poverty Reduction Strategy contributing to sexual and Project level
reduction strategy developed and reproductive health e.g. Life Planning
developed and implemented focussing on MDGs. Education in Marivi
implemented MDGs. Districts.
focussing on MDGs. Outputs Purpose Impact / Goal
2. Government-led 1. National Strategic Sexual and Reproductive Improved sexual and
education Health Policy Health policy developed reproductive health status
programmes in developed and and implemented in Ekim in Marivi though
Poverty Reduction implemented. State. successful implementation
Strategy developed 2. A model for Family of State Sexual and
and implemented Medicine. Reproductive Health
focussing on MDGs. 3. Integration of Ministry policy.
3. Better economic and of Health with Social Outputs Purpose
political governance. Security systems. 1. Improved enabling Schools effectively
4. Sustained 4. Research, monitoring and policy delivering Life Planning
improvement in and impact environment. Education.
climate for foreign assessment systems 2. Capacity of partner
investment, local agreed and in place. institutions developed.
private sector 5. Skills developed in 3. Youth-friendly
development and contracting private services accessible to
market access for the services. female and male
poor. adolescents.
4. Schools able to Outputs
deliver Life Planning 1. Partner consensus
Education effectively. and plan for way
5. etc forward.
2. Improved methods of
control identified.
3. Schools with
resourced Action
Plans developed with
community.
4. Cadre of teacher
trainers in place.
5. Materials and
curriculum developed.
6. Core of teachers
trained in each
school.
7. Etc.
Department level
Impact / Goal
Poverty reduced.
Economic growth.
National environmental Sector strategy level
problems mitigated. e.g. Research strategy
Purpose Impact / Goal
Productive capacity of Productive capacity of
crop sector enhanced on smallholder cropping
economically and sector enhanced on
environmentally economically and Programme level
sustainable basis. environmentally e.g. semi-arid systems
sustainable basis. programme
Outputs Purpose Impact / Goal
1. Research outputs Research outputs relating
Research outputs
disseminated and to semi-arid systems
disseminated and
implemented. disseminated and
implemented.
2. Policy development implemented.
strategy successfully
implemented. Project level
3. Successful operations e.g. Control of Striga
strategy in place. weed project
Outputs Purpose Impact / Goal
1. Key researchable Research programmes Research programmes
constraints removed. successfully operational. relating to semi-arid
2. Research systems successfully
programmes operational.
successfully
operational.
Outputs Purpose
1. Impact of weeds on Impact of Striga on the
the crop production crop production cycle
cycle minimised. minimised.
2. Impact of pests on
production of
sorghum and millet
based systems
minimised.
3. Impact of pests on
cotton production
minimised.
. Outputs
1. Dynamics of
sorghum/Striga
communities better
understood and
incorporated in crop
management
strategies.
2. Improved methods of
control developed and
promoted.
3. etc
8. Output level Assumptions: "These other factors, outside our direct control,
include ........."
9. Purpose level Assumptions: "We believe that if we can achieve our major
objective, we will contribute to our overall goal. This contribution is, however,
affected by factors outside of this project. These include ........ All of these
factors taken together will be sufficient to realise this goal. The strategy we
propose is an important and cost effective step towards that end."
10. Evidence: "We propose that our performance be monitored and assessed in
the following way..........."
14
Adapted from the original Team Up Project Checklist
PROGRESS/MONITORING REPORT
PROGRESS/MONITORING REPORT
Impact / Goal: Number of stressed families Reports from village Birth rate continues
Integrated community with decreases by 50% clinic and counsellors
happy kids and adults Other communities adopt Newspaper articles
similar ideas
Purpose:
Kids have fun, are busy and 60% of local young kids use User survey Safe recreation leads to
safe the swing safely at least happiness and
once a month by end of year Participatory evaluation community integration
2. with the kids Facilities don’t create
Kids’ opinion on life in the conflict
village improved by end of
year 2.
Outputs:
1. Capacity within community 6-monthly meetings after Minutes of meetings People see the benefit of
to manage the building and completion with > 5 it
long-term maintenance of members.
the swing Swing maintained and in use Maintenance and Easy maintenance
over minimum 5 year period annual safety inspection
records
2. A safe, well-built swing Swing completed and in use Safety certificate on No vandalism
in 12 months completion Kids like and use it
Minimal number of accidents Accident records; Kids don’t fight
bruises, minor cuts &
Few repairs needed hospitalisation
Maintenance log
Activities:
1.1 Establish community Planning team set up by x Minutes of meetings Enthusiasm and
committee and undertake Committee chosen by x participation maintained
lobbying required Monthly meetings during Attendance records
planning & building phase Football club will give up
with > 8 members a small amount of land
for the swing
15
Dearden P.N. 2000 Report on Project Cycle Management and Logframe Review Workshop Jamaica All Age School
Project (JAASP) Jamaica, October 2000. Department for International Development (DFID) and University of
Wolverhampton, UK.
2. Improved school School Development Plan Plans submitted Training and support is
management. prepared in all project to project sufficient to enable
schools by year 1 manager schools to formulate and
REOs records implement plans and
and reports monitoring systems are
School Development Plans
effective
implemented effectively in
Plans submitted
all schools by year 2
to Project Principals and other
Managers school personnel
respond positively
Comprehensive and Plans reviewed Principals and other
effective School by Regional school personnel do not
Development Plans (SDPs)
officers and feel threatened by
developed and approved by Technical change/full community
stakeholders in all Project Assistants involvement in school
Schools by March 2001 development planning.
All principals trained by TEO monitoring
Ministry of Education and reports
Culture (MOEC) in staff
instructional management Education officer
by year 2 Reports
80% of Principals use Senior Education
improved management Officer records
techniques by end of year 3
Principals Workshop reports
organised/conduct one
6. Minor Work identified costed and Building reports Work carried out is on
rehabilitation works approved by March year 1 time and adequately
identified and School supervised to maintain
carried out (through Work satisfactorily Development plan quality.
school completed by mid year 2
development Estimate of Work plan will be within
planning process). expenditure the financial budget
Building Officers
inspection report
TEOs reports
Community
feedback
7. Increased 10% of non-project schools Baseline data and A culture of learning will
capacity for lessons utilising the best practices at research results develop.
learnt to be End of Project
transferred and Monitoring reports Documentation will take
sustained. Action research in all place.
regions following project Panel reports/
guidelines classroom Findings will be
observation disseminated to all
Participation by all stakeholders.
stakeholders in mid-term Documentation
review from action
research projects
Review reports
GOAL:
Public finances Achievement of:
effectively managed Poverty Reduction
and targeted towards Strategy targets
improved development.
PURPOSE:
Strong PFM systems 1. Cabinet leads strong 1. Political will to target
and processes started PFM oversight by: budgetary resources
to be implemented, led New Finance Act released by improved
by clear, long-term Commitment to an PFM to meet objectives
Government of Lesotho integrated capital & of the GoL Poverty
(GoL) priorities recurrent budget. Reduction Strategy
Commitment to (PRS).
macro- & medium 2. PRS and macro- and
term planning. medium term plans set
2. PAC discharges out clear targets and
oversight function as strategies for poverty
evidenced by: reduction, in line with
Hearings held on National Vision 2020.
schedule with 3. The parallel and
Accounting Officers complementary reforms
challenged arising from PSIRP are
Reports on the PAC achieved
with clear
recommendations on
measures to be
taken
16
Dearden, P. N.(2005) Government of Lesotho Public Sector Improvement and Reform Programme, Public
Financial Management (PFM) Component, Logical Framework and Project Cycle Management Training,
Inception Workshop 27 June – 1 July 2005, Department For International Development South Africa
(DFIDSA).
17
Dearden, P.N. Mahony, D. and Jordan, G. ,2006, Illegal Logging – Tackling the Underlying Governance,
Policy and Market Failures Programme. Output to Purpose Review (OPR), January 2006, Department for
International Development. (DFID) London.
3.1 Servicing Inter-departmental Whitehall Group, the Inter-Departmental Working Group, the Timber
Buyers’ Group and the UK Forest Partnership.
3.2 Participating in and supporting actions aimed at implementing the EU FLEGT programme.
3.3 Regular communications with Japan to share lessons on promoting coherent domestic and
international policies on procurement, trade policy, illegal logging and governance reforms..
Continued attendance at AFP. Co-operation on activities in Indonesia.
3.4 Regular communications with involved US officials, through G8 and other fora. Support to US on
Latin America and N. Eurasia FLEG where appropriate.
3.5 Identify and follow through opportunities to engage with China
4.1 Support to development and evaluation of monitoring, auditing and tracking systems, including
support to EU FLEGT partnerships.
4.2 Support to operation of monitoring, auditing and tracking systems, where appropriate.
4.3 Support to use of tools and systems that support inter-agency co-operation, both regionally and
internationally.
5.1 Support to civil society involvement in promoting actions under regional FLEGs
5.2 Reports on poor people’s access and management opportunities prepared for FLEG and other
regional fora.
5.3 Continued selective support to and participation in East Asia FLEG
5.4 Dialogue and other actions to encourage Malaysia and Singapore to participate in tackling illegal
timber trade.
5.5 Continued selective support to and participation in AFLEG
5.6 Participate where can offer useful support in Latin America and N. Eurasia FLEG.
5.7 Support visits of participants from FLEG processes to observe and offer insights to other FLEGs.
18
Includes CFUGs, PLMGS, Soil groups, Leasehold groups, CFMG, etc.
19
Active forest management means planning based on potentiality of the forest and resources and its
implementation (maximizing the potentialities)
20
% of P&E organized in the groups will be recorded as the achievement against the indicator
OUTPUT 01 BY EOP26
21
Technical support includes advisory services required to FUGs such as technical, social, institutional and
coordination related services
22
The leveraged amount will be calculated on annual expenditure and it is not about the cumulative total for
programme period
23
Disadvantaged janajati and caste group people and religious minorities will be considered while analysing
information against this indicator.
24
The baseline values indicate the percentage of FUGs which spent 20% or above resources in pro-poor
provisions
26
EOP/EOC= End of Programme or End of Component
25
The word “forest managers” denotes forest group members of any forest regimes, and all forest
management-related service providers
27
Technically improved OPs will have supervised inventory and management prescriptions.
OUTPUT 02 BY EOP
1. All the new and amended 1. FUG There will be
Poor and excluded groups operational plans (OPs) and Assessment continued respect
enabled to participate in constitutions have at least reports, FUG and support to
and benefit from the three P&E equitable constitution working
forestry sector provisions, one each for review report, inclusively in the
participation, forest and other independent new political
resource distribution). study reports. context.
2. % of the total FUGs who
implement at least three P&E 2. FUG
equitable provisions assessment LFP partners will
increases from 1.25% (2003) reports, FUG have favourable
in hills, 3.5% (2004) in mid documents policy and
west, 3.8% (2004) in Terai to review and operating
20% (one each related to independent environment to
participation, forest and other studies. implement their
resource allocation). activities
3. At least 50% of economically
poor FUG members access 3. FUG progress MFSC will
income-generating reports, District approve and
opportunities. Progress implement
4. At least (i) 50% women, (ii) reports, FUG Gender and
15% Dalits (both male and Assessment Social Inclusion
female), (iii) 30% reports. (GSI) strategy
disadvantaged ethnic group
(both male and female) and 4. FUG
(iv) 15% poor represented in assessment
executive committees of FUGs reports.
5. At least (i) 33% women and
(ii) 33% Dalits or 5. FUG
disadvantaged ethnic group Assessment
(both male and female) reports, District
represent in key decision Progress
making positions of FUG reports,
executive committees. Reports from
6. At least 60% of poor and LFP partner
excluded households access institutions,
benefits generated from independent
forestry groups and their study reports.
resources (e.g., paid
employment, educational 6. District
benefits, quick impact and Progress
community development, reports, FUG
credit facility, skill development assessment
training, land allocation, reports, DFO
emergency fund etc.) progress
reports, FUG
progress
reports,
independent
study reports.
OUTPUT 03 By EOP
1. All LFP districts have multi 1. LFP/ DFO/ MFSC and MLD
Capacity within and stakeholder fora with a Network will have
coordination amongst secretariat functioning as the Progress consensus on
institutions strengthened principle district level forest reports, decentralisation
for forestry sector sector planning, coordination strategies and
development and and monitoring mechanism. federal state
enhanced livelihoods. 2. In LFP districts, village level structure.
multi-stakeholders forum 2. LFP/ DFO/
engaged in forestry sector Network Politically
activities (i.e. network)) Progress accepted
established in at least 50% reports, governance
VDCs of hills and mid west, mechanism will
and 25% VDCs in Terai. be in place at
3. All multi-stakeholder fora districts and
include gender and social 3. Training national level
inclusion aspects in their reports,
decisions, plans and progress DFCC, VFCC and
monitoring. reports. forest user group
4. % of (i) woman staff in LFP networks will work
and its partner institutions positively with
increases from 21% (2006) to 4. Review report, user groups and
33%; and (ii) staff from Progress report stakeholders
excluded groups (both women and Gender
and men from Dalits and audit reports.
disadvantaged ethnic groups)
from 37% (2006) to 45%.
5. All District Forest Offices and 5. Copies of DFO
key partners will target their and partners
interventions in proportion to plans, Gender
the base population28 of audit reports.
different social groups
(women, Dalits and
disadvantaged groups) in LFP
districts. 6. LFP financial
6. Up to 15 MSc and 30 BSc records,
scholarships provided to nominations by
MFSC staff MFSC, annual
and progress
reports.
28
Base population will be defined by the information available from Central Bureau of Statistics (CBS/GoN)
and the figures are taken as context data for proportionate services and representations
OUTPUT 04 By EOP
1. At least one new (innovative) 1. Progress There will be
Innovative, inclusive and initiative (i.e., in forest reports, continued
conflict sensitive management/ NTFP/ Agro- documents of favourable
approaches shared to forestry/ public land, safe and innovative political and policy
inform forest sector effective development/ pro- practices environment that
planning and policies poor and excluded growth, Annual review supports
scholarship package, and developing and
alternative energy, High independent testing of
Altitude Forest Management, reviews. innovative ideas.
forest certification etc.) tested
per year 2. Copy of
publication,
2. LFP strategy on progress
Communication developed and reports, annual
implemented, sharing with review report,
Programme Management meeting
Committee (PMC/MFSC) minutes,
members, LFP partners (e.g. response from
DFOs and forestry sector people
networks), DFID and wider receiving
audience. publications
and
communication
s, website
feedback.
3. Copies of
3. At least one effective practice strategy,
paper/ strategy/ approach Progress
developed, implemented and reports, Annual
shared (e.g. on climate Review report,
change, peace building, SFM, sharing reports,
second generation issues in meeting
forestry and importance of minutes.
disaggregated monitoring
information) per year.
5. Copy of
forestry sector
reform papers
and plans
2. Output 2
2.1. P&E identification activities (e.g., well-being ranking)
2.2. Income generating activities (forest based and non-forest based) and revolving
fund provisions
2.3. Support in P&E sensitive policy formulation and FUG planning
2.4. Animation/ Social Mobilisation activities
2.5. Education support for P&E children
2.6. Emergency fund/ humanitarian support
2.7. Small health and sanitation activities targeting to P&E
2.8. Land allocation (CF and Public Land)
2.9. P&E exposure visit
2.10. P&E skills enhancement, capacity building training/ workshop and scholarship
support
2.11. Issue based sub group formation and related support
2.12. Tole level processes and groups strengthening
2.13. Small infrastructure support (irrigation, drinking water etc. focusing to P&E)
2.14. Research related to P&E issues
2.15. NRM classes targeted to women and P&E
2.16. P&E specific support under Local Initiative Fund (LIF)
3. Output 03
3.1. Network formation and strengthening
3.2. VFCC/ DFCC strengthening support
3.3. Awareness raising on climate change, global warming and Kyoto protocol
3.4. Orientation on peace sensitive development
3.5. Different level forest coordination meetings
4. Output 04
4.1. Strategy development
4.2. Publication of best practices
4.3. Thematic workshops/ interactions
4.4. Piloting/ testing of different approaches and initiatives
4.5. Central level support to networks and federations (civil society groups)
4.6. Policy work through participation in different task forces
4.7. Capacity building/ training on planning and monitoring
4.8. Publication/ dissemination of LFP effective practices
4.9. Implementation of communication action plan
5. Output 05
5.1. Central level support to MFSC on policy/ strategies/ system and guidelines
development/ strengthening (e.g. PLMG policy, CF guidelines…)
5.2. Joint action with civil society networks
5.3. Contribution to develop and implement Gender and Social Inclusion Strategy
5.4. Contribution for forestry sector review, study on forest sector contribution on
GDP
5.5. P&E support in participating policy debate
5.6. Policy review (audit)
5.7. Contribution in research/ studies by MFSC and its subsidiaries
5.8. M&E system strengthening support / Database management support
5.9. Communication and extension activities