The Logic Model GuideBook 2nd Edition
The Logic Model GuideBook 2nd Edition
The Logic Model GuideBook 2nd Edition
his chapter introduces logic models. There are two types: theory of change
and program. This chapter describes model benefits and uses and explains
the role of modeling in both program and organizational effectiveness.
The process of modeling begins with results. Regardless of type, quality models are
evidence based.
LEARNER OBJECTIVES
Explain the difference between models and modeling
Recognize the benefits and uses of logic models
Demonstrate how to read a logic model
Recognize types of models and their characteristics
Describe the ways that models can support effectiveness
Basic Concepts
Models and Modeling
Logic models support design, planning, communication, evaluation, and learning.
They are often used when explaining an idea, resolving a challenge, or assessing progress. They can untangle and clarify complex relationships among elements or parts.
Logic models are a graphic way to organize information and display thinking.
They are a visual approach to the implicit maps we all carry in our minds about
how the world does or should work. Logic models are tools that convey a scheme,
program, or project in a brief, visual format. Logic models describe planned action
and its expected results. A model is a snapshot of an individuals or groups current
thinking about how their idea or program might work.
Modeling is a technique. The process of modeling encourages iterative development of an idea, program, or project. It can create a safe space to start a debate,
generate ideas, support deliberations, and allow one to think more clearly about
specific relationships. A single, coherent logic reflects a consistent thread that connects design, plans, execution, and evaluation. This thread of evidence-based logic
is critical to program and organizational effectiveness.
Modeling allows careful consideration of the relationship between activities and
results. When tackled by a team or small group of stakeholders, models can be
improved by engaging the knowledge and experience of others. We think modeling
is significantly underutilized as a valuable process with real benefits. We believe the
best models are socially constructed in a shared experience that is facilitated. The
shared understanding and meaning they produce among colleagues are valuable
and enable success in subsequent steps of implementation and assessment.
4PART I CONSTRUCTION
critically review and improve thinking. And better thinking always yields better
results. Modeling can happen well before resources are committed or final decisions
get made. This offers a way to pretest quality and limit risk.
Effectiveness is not limited tobut certainly depends ona clear vision, capable implementation, and the means to monitor both processes and results. Logic
models can be tremendous supports for creating and communicating a common
understanding of challenges, resources, and intended success. Moreover, models
can also be used to calibrate alignment between the big picture and component
parts. They can illustrate parts of or whole systems. Choosing a perspective can
influence the level of detail. When modeling, this specifies boundaries as well as the
breadth or depth of display. For example, a logic model can show the learning
objectives for an elementary Spanish curriculum, what a school district will do to
secure student achievement, or what the federal government will provide in educational resources for second-language learning.
Historical Background
Use of theory of change and program logic models began in the 1970s. Carol
Weiss (1995) and Michael Fullan (2001) and Huey Chen (2005) are among the
Time frame
No time
Time bound
Level of detail
Low
High
Elements
Many
Primary display
Graphics
Graphics + text
Focus
Generic
6PART I CONSTRUCTION
pioneers and champions for the use of program theory in program design and
evaluation. U.S. Agency for International Developments logical framework
approach (Practical Concepts, Inc, 1971) and Claude Bennetts (1976) hierarchy of
program effectiveness were among the earliest uses of the types of visual displays
that have evolved into the program logic models we know today.
Logic models did not receive much recognition, however, until after the United
Way of America came out with its publication Measuring Program Outcomes in
1996. This publication promoted the structures and vocabulary of logic models.
The W. K. Kellogg Foundation also was instrumental in spreading the use of logic
models with its Logic Model Development Guide (2001). For those readers interested
in more detail on the historical evolution of logic models, see the references provided at the end of this chapter. Thinking about thinking, or metacognition, is
present in many new management and leadership texts. Because our thinking
affects our actions, its an area thats well worth understanding better.
Examples
In the examples that follow, we briefly explain the general concepts and terms
related to a theory of change and to a program logic model. Chapters 2 and 3 provide more depth. Although we show one of each type of model, it is important to
keep in mind that these are but two examples from a much broader continuum of
possibilities. There are many ways to express or display the ideas and level of detail.
Strategies
Academy
Leadership
Curriculum
More and
Better
Community
Leaders
Community
Development
Academy
Leadership
Experiences
publications) that occur to fulfill the promise of each strategy. Together, activities
make up the program design. Outputs are descriptive indicators of what the specific activities generate. Outcomes are changes in awareness, knowledge, skill, or
behavior. The impact reflects changes over a longer period. Figure 1.2 displays a
simple program model for the same community leadership program shown as a
theory of change model in Figure 1.1.
This program model suggests desired results include more and better leaders
and community development. It implies the leadership development agenda is
about resolution of community challenges and that, if resolved, it contributes to
community development.
To read this model, first note the intended impact (ultimate aim) of the program: community development. Then, move to the far left-hand side, where
resources or inputs essential to the program are listed. Logic models employ an
ifthen sequence among their elements. When applied to the elements in each
column, it reads, If we have these resources, then we can provide these activities. If
we pursue these activities, then we can produce these outputs. If we have these outputs, then we will secure these outcomes, and so on.
This model is just one very simple representation of how a program might be
designed and planned for implementation. Many variations on this example could
represent program design and planning for community leadership development
that meets standards of logic and plausibility. We know that Figure 1.2, in fact,
represents a program with some definite flaws. More discussion about how the
Sponsors ($)
Marketing/
communication
campaign
Host and
facility
Participants
Faculty
Curriculum
and materials
Resources
Leadership
Experiences
Processes
Leadership
Curriculum
Content
Activities
Participant
satisfaction
Completion
rate
Participant
description
Outputs
Better Leaders
Increased
community
awareness and
action bias
New leadership
attitudes,
knowledge, skills,
and behaviors
Short Term
Graduates use
knowledge and
skills obtained
through the
program to
strengthen
the community
Intermediate/Long Term
Outcomes
Community
development
Impact
program could be improved through a mark up (or critical review) that tests the
program design is described in Chapter 4.
10
Sponsors ($)
Marketing/
communication
campaign
Host and
facility
Participants
Faculty
Curriculum
and materials
Resources
Leadership
Experiences
Processes
Leadership
Curriculum
Content
Activities
3
What difference has the CLA
made among participants?
2
Is the CLA doing
things right?
Community
development
Impact
Graduates use
knowledge and
skills obtained
through the
program to
strengthen
the community
Outcomes
Intermediate/Long Term
Better Leaders
Increased
community
awareness and
action bias
New leadership
attitudes,
knowledge, skills,
and behaviors
Short Term
Participant
satisfaction
Completion
rate
Participant
description
Outputs
These evaluation questions can be very helpful in the initial design and development of the program, as they help to aim the program intervention. The next step
is establishing indicators. Models also help in guiding the conversation and exploration needed to determine indicators or the measures of progress for an effort.
These issues are addressed in greater detail in Chapter 5.
12PART I CONSTRUCTION
with vision, outcomes are earlier indications of progress toward results. We think
results are the place to begin when you are struggling with choices about strategies
(with a theory of change) or activities (with a program logic model). It is important
to avoid moving prematurely to specify what you want to do. In any change work,
program design, or problem solving, specifying those outcomes most likely to occur
soon and then those that will take more time to emerge helps determine what route
(action path) might be best to use.
People commonly complain their work is both activity focused and frantic.
Considerable time and effort are spent on a flurry of tasks that frequently lack a
clear relationship to intended results. Logic models can assist in sorting priorities
because they both rely on and help build a visual literacy that makes action and
expected consequences clear. Through the models and modeling, stakeholders can
identify potent strategies/activities likely to contribute to the results sought. And
those with less (relative) value can be sidelined or discarded.
Program Logic
Model (PLM)
Improved Program
Effectiveness
Design
Theory of
Change (TOC)
Evaluation
Are we achieving
superior results?
logic models help with more precise decisions about which activities in a given
strategy are most effective. Program logic models can also be used to support
evaluation design. They can assist in pointing to optimal areas of inquiry and help
to determine whether progress is being made and what difference has occurred
relative to results.
Some organizations use logic models routinely. They can become a standard tool
that promotes alignment and synergy. For example, evaluation can be designed and
implemented more easily when a clear theory of change and program logic model
have already been determined. These tools and related processes can also assist
learning and dissemination in significant ways. Logic models and modeling can be
vital elements in performance management because they rely on evidence, support
informed decisions about strategy, and assist with assessment. Performance management seeks predetermined results and adapts actions to obtain them.
IN SUMMARY
Logic models are simply a visual display of the pathways from actions to results.
They are a great way to review and improve thinking, find common understandings, document plans, and communicate and explicate what works under what
conditions. We think theory of change models are distinct from program logic
models in several important ways. Theory of change models present a very highlevel and simple explanation of do and get. Program logic models offer a detailed
14PART I CONSTRUCTION
map that can be implemented when supplemented with work plans. In this chapter,
we also distinguished between models as tools and modeling as a process. A quality
feature of logic models is that they are evidence based. Logic models can be used
for learning, improving, and greater effectiveness.
LEARNING RESOURCES
Reflection
1. In what circumstances can you use logic models in your work or field of study?
2. What benefits does each type of model provide? And to whom?
3. What do logic models display? And what is missing?
4. How are theory of change models and program models alike? Different?
5. What kind of logic models have you seen before? Which are most commonly
used?
6. What current models/processes are commonly used for program design in your
organization? What work cultures are best suited for logic models?
Application
Select and draw one of the following: promotion of a new brand of ketchup, a
drivers training program, or a domestic violence awareness campaign. Have others
independently draw the same project you select. What do all the drawings have in
common? What areas are different? Why? When and how do these differences
become reconciled? How did the levels of detail differ among the drawings? What
can these drawings tell us about mental maps?
Journal Articles
Bennett, C. (1976). Analyzing impacts of extension programs, ESC-575. Washington, DC: U.S.
Department of Agriculture, Extension Service.
Dwyer, J. (1996). Applying program logic model in program planning and evaluation. Public
Health and Epidemiology Report Ontario, 7(2), 3846.
Fitzpatrick, J. (2002). A conversation with Leonard Bickman. American Journal of Evaluation,
23(3), 6980.
Funnell, S. (1997). Program logic: An adaptable tool for designing and evaluating programs.
Evaluation News and Comment, 6(1), 517.
Julian, D. (1997). The utilization of the logic model as a system level planning and evaluation
device. Evaluation and Program Planning, 20(3), 251257.
Julian, D. A., Jones, A., et al. (1995). Open systems evaluation and the logic model: Program
planning and evaluation tools. Evaluation and Program Planning, 18, 333341.
Sartorius, R. (1991). The logical framework approach to project design and management.
Evaluation Practice, 12(2), 139147.
Internet Resources
Davies, R. (2008). The logical framework: A list of useful documents. Retrieved December 1, 2011,
from http://mande.co.uk/2008/lists/the-logical-framework-a-list-of-useful-documents/
Duigan, P. (n.d.). Brief introduction to program logic models (outcome models). Retrieved
December 1, 2011, from http://outcomescentral.org/programlogicmodels2.html
Evaluation logic model bibliography. (n.d.). Madison, WI: University of Wisconsin Extension
Service. Retrieved December 1, 2011, from http://www.uwex.edu/ces/pdande/evaluation/
evallogicbiblio.html
Israel, G. D. (2001). Using logic models for program development. Retrieved December 1, 2011,
from http://edis.ifas.ufl.edu/wc041
List, D. (2006). Program logic: An introduction. Retrieved December 1, 2011, from http://
www.audiencedialogue.net/proglog.html
McCawley, P. F. (1997). The logic model for planning and evaluation. Retrieved December 1,
2011, from http://www.uiweb.uidaho.edu/extension/LogicModel.pdf
2
Building and Improving Theory
of Change Logic Models
his chapter identifies the basic elements of a theory of change logic model. They
are evidence based and plausible. This chapter describes the steps to create and
improve a theory of change model. It also names criteria for a good model.
LEARNER OBJECTIVES
Identify basic elements of a theory of change model
Identify the contributions a theory of change model lends to a change
effort
Create a simple theory of change model
Apply critical review for theory of change model plausibility
Logic models offer an exciting way to combine narrative and graphics to display
the mental maps people hold about a specific program or change initiative. These
mental constructs are also sometimes called idea maps. While the process of creating a model can be solitary, there are significant benefits when models are generated in a small group among stakeholders with a shared agenda. Logic models can
be used over the entire life of a change efforttheir boundaries should be consciously determined by the participants who create the model.
needs to describe broad and general concepts about change or more detailed
operational elements essential to design, plans, and management. It is possible to
begin with either a program logic model or theory of change model.
We believe it is important that a program model always accompany a theory of
change because the assumptions held in the theory of change have fundamental
value for program operations and success. These assumptions should be consistent
and anchor choices made in the development and selection of strategies to fulfill
intended results. When assumptions are evidence based, then a single coherent
logic and alignment can occur that enables success. Relying on knowledge, whether
theory, research, practice, and/or literature, is essential to a good model.
18PART I CONSTRUCTION
This is about the choices made in selection of strategies relative to anticipated and
therefore planned results. When constructing a program logic model, the realistic
criterion of limited resources is also in play. Any program, project, initiative, or
organization has some limits on time, talent, and financial resources. In the migration from theory of change to program logic model, users can shift their thinking
from what could work to what should work.
Get
Strategies
Results
challenging both to conceptualize and to represent. For example, to become proficient in a new language, it is most likely the combination of instruction, practice,
and cultural immersion that generates proficiency. Likewise, to be a profitable
cereal company may require a high level of competency in research/development,
marketing, production, and distribution strategies. In addition, great health outcomes for neurosurgery may rely on expertise in diagnostics, surgical techniques,
pre- and postsurgical care, and rehabilitation therapies. Because multiple strategies
often contribute to results, a more complex representation of a theory of change
might look like Figure 2.2. We call the path from each strategy to result a strand.
Recall the theory of change model for the Community Leadership Academy
(Figure 1.1). In that example, the outcome desired was more and better community
leaders. This model described two simple strategies as essential contributions to the
recipe: curriculum and experiences. An applied example of a multi-strategy model
for securing improved health is displayed in Figure 2.3. Read from left to right, the
theory of change suggests if we provide exercise, nutrition, stress reduction, and
some other key strategies, then we will secure improved health for participants who
follow the program. It is also important to note that strategies may interact
(although not shown here). This theory of change represents a generalized construct for many health-improvement programs.
Figure 2.3 simply provides a gross summary of strategies and intended results for
a health-improvement program. A theory of change model displays some of the
underlying assumptions about change and is a view at 65,000 feet. This view is how
a farm looks from an airplane window in contrast to the view from a tractor seat. It
simply shows the specific strategies that the designer believes will achieve a desired
result. Theory of change models are distinct in that they include assumptions (either
explicitly or implicitly), offer the big picture of the bounded mental map, and name
impact. Theory of change models do not provide the detail essential to action planning, implementation, or evaluation. They simply state what you plan to do and
Figure 2.2 Multiple-Strategy Basic Theory of Change
Do
Get
Strategy 1
Strategy 2
Results
Strategy 3
Strategy 4
20PART I CONSTRUCTION
Get
Exercise
Nutrition
Improved
Health
Stress
Reduction
Recruitment
and Retention
what you expect to get. It is easier to explore ideas and manipulate them at this stage.
The why and how of these models are embedded in assumptions and eventually
reveal themselves in the strategies selected. For example, in Figure 2.3, some of the
underlying assumptions might include the following:
Increased exercise and improved nutrition are known to contribute to
improved health.
Only those who participate in the program will achieve results. Participants
need to be recruited.
Stress may be a contributing factor to poor health.
Participants fidelity to the program is critical to achieve results. They will
need parallel increases in awareness, knowledge, and skill in order to change
behaviors that most impact health.
Realistic Models
Theory of change models should demonstrate plausibility. This means they could
work. Given the realities of limited time, as well as human and social resources,
logic alone is inadequate. In fact, the logic displayed in a model can be uninformed
or misinformed. For example, world peace is a tangible and clear desired result, but
a theory of change that relies solely on communication (e.g., newsletters and websites) is not plausible in securing world peace. Or consider the desired result of
hiring more mid-level scientists at your research institute. Are outreach strategies
with local math and science teachers and students logical action steps? Yes, but
meetings with those targets can be helpful only in a pipeline that can tolerate a
decade of delay. It is not a best strategy given urgent human resource needs this
week and next month.
22PART I CONSTRUCTION
Research
Practice
Believe
Assumptions
Do
Get
Strategies
Results
Theory
Knowledge
Once results are named, we suggest identifying the strategies required to achieve
the results you seek. Strategies are about how intended changes will occur. And
assumptions are the preceding knowledge: the research, practice, and theory that
inform choices about strategies. They significantly influence which strategies are
chosen as pathways to your intended result.
So the steps to generate a theory of change logic model are ordered in
this way:
1. Identify results desired.
2. Name the strategies that will deliver your intended results.
3. Define the assumptions (see Figure 2.4) that support your specified strategies.
Figure 2.5 displays these actions in a three-step sequence. Most theory of change
models generally do not display underlying beliefs or assumptions. Nevertheless,
these are important elements to explore consciously when creating a theory of
change. We suggest those assumptions are named in association with the theory
of change. Assumptions can simply be a bulleted list on the same page or reverse
side. Remember, a theory of change model is simply one representation of the
truth, not a substitute for it. The model draft becomes a place for starting discussion and testing meaning, coherence, assumptions, and plausibility. Engaging
others in modeling offers the opportunity for critical review and improvement
over time through the generation of versions. By starting with a theory of change
model, it is easier to arrive at shared understanding of what your program will do
and can achieve.
Step 3
Define
Underlying
Assumptions
Strategies
Results
Step 2
Name
Strategies
Step 1
Identify
Results
Multiple Perspectives
People hold and operationalize theories of change in both their work and personal
lives. Most experienced parents, for example, have a recipe that contains the primary strategies they believe are vital to parenting a good kid. Parents can vary
considerably, however, in what they mean by a good kid. Likewise, even if we agree
on what a good kid might know and be able to do, it is highly likely that from one
parent to the next, there will be many variations on parenting strategies to ensure
the good kid result. This example suggests the considerable importance of ensuring that all stakeholders in your program or change effort are specifying results and
the strategies needed to get there with the same meaning and level of specificity.
Developing and improving the theory of change for your program is one way to
begin the conversations needed to reach shared understanding.
In the health example we started this chapter with (see Figure 2.3), we identify
improved health as the result sought. It is important to ensure that everyone has a
24PART I CONSTRUCTION
highly consistent understanding of what improved health means. To one participant, it may be weight loss. Another could interpret it as normal blood pressure.
Others may feel improved health is a combination of several positive outcomes. If
you ask a half-dozen people what improved health means to them, it is quite likely
there will be variation in their individual answers.
Specifying what the results mean, such as improved health in this example,
becomes critical for your program design as well as essential for measuring progress
toward and determination of results. If the meaning and measures of results are
shared and understood similarly, then it is more likely strategy choices will align with
your intended impact. It is more likely indicators of progress will be appropriate, too.
Low
High
Least Likely
to Succeed
Most Likely
to Succeed
Toggling
Another practical way to improve models is what we refer to as toggling. We
define toggling as finding the optimal fit between a selected set of strategies and
plausible results. For example, options to improve school nutrition could include
planting a garden, removing vending machines, or changing the lunch menu.
Toggling tries on options and makes a best choice. In this critical review, the
model builder is experimenting with the best combination of strategies to secure
the results sought. Inviting others to join in this iterative tactic in real time can be
very productive. Sometimes it is best to refine or focus the specified results. For
example, a program or social change effort could specify one of these results: end
childhood obesity or create schools with improved nutrition choices for children.
During toggling, it may become apparent the result is not plausible. Often, ambitions are greater than what is feasible. It is important to guard against grand ambitions. They are possible hazards that can result in flawed models. Figure 2.7
demonstrates the interactions between strategies and results as choices are made in
the final determination.
This figure displays the testing that occurs in an effort to determine the best
combination of strategies to secure your intended results. Once a preliminary theory of change model is drawn, the modeling process begins. The model is tested
though iterative cycles of inquiry. The basic questions addressed are Are the results
focused and narrow enough to discern optimum strategies? and Is the connection
between the strategies named and the results desired as strong and direct as needed
to be effective with the population of interest?
Toggling can also involve a review of both the duration and sequence for chosen
strategies. The objective is to specify a model that is plausible. The specifics of what
is feasible are developed in the program logic model (and are discussed in following
chapters). People sometimes mention confusion when they talk about the fog of
war. In our experience, there is considerable fog or ambiguity in program design
and planning. A clear and plausible theory of change is the foundation of intended
work and requires considerable attention and scrutiny. Just as with the Cheshire Cat
in the story Alice in Wonderland, if you do not know where you are going, any road
will do. Fuzzy, ambiguous theories of change rarely net the success intended.
Get
Testing Design/Plans
Strategies
Results
Testing Effectiveness
26PART I CONSTRUCTION
Group Process
Consider involving others in co-creating a theory of change model. Lets build on
the improved health example from earlier in this chapter and aim at obesity prevention. How could you guide a group in exploring a countywide program design
intended to maintain healthy weight and prevent obesity? In tackling this question,
its important to anticipate the need for data prior to the convening. Gathering and
sharing information about research, practice, and theory makes for a much smarter
dialogue. Its also possible to include experts who bring data and field experience
literally to the table. In general, a guided group process could follow these action
steps in a daylong work session or over a series of meetings.
Remind participants, again, of the intention of the work to establish a theory
of change that articulates a single relationship between results and strategies. The
assignment is to identify strategies most likely to get the planned results given the
context, target audiences, and other factors. So its important, first, to secure a
shared understanding of the results intended. Ask all the participants, on their
own, to identify the result they want the program to achieve in the next 3 years.
Its vital to specify a period to bound the program effort. Have participants post
directly (or transfer) their intended results for public sharing. This first posting
will likely display a range of expectations and assumptions about what results are
desired. Reconcile those that are similar and do discovery on whats underneath
the postings.
Through dialogue, find the result that the group believes is most feasible given
the context. Features of context might include historical and current rates of obesity and overweight, definitions of those terms, an inventory of physical fitness
options and their physical proximity, socioeconomic data for the county population, and access to healthcare and weight loss resources, along with aspects of prevailing culture. Create a list of resources, including specific funds that could be
designated for the program. Your participants can probably name many other features of context. These are the influences as well as data that help to inform the
current reality. It may help to post facts and features of context so they are present
to dialogue. This portion of the process should rely on facts as well as perception.
Then, consider your target audience(s). Will your program effort be designed to
influence males, females, teens, young adults, all residents between 10 and 50 years
of age? Or some combination of these characteristics? Employ learning from the
context discussion to inform your choices. Be aware the selection you make may
require you to adjust the groups intended result. The effort to name and understand the results is well worth the effort because it frames subsequent action steps.
Last, ask participants to name strategies that the program should include. Post
them. Often, people will name tactics or specific activities. Getting to the same level of
detail just requires some modification. This is another great opportunity to insert
more information. For example, identify independent research, practice, and theory
shown to influence weight management. Share some benchmarking information from
effective programs that have already tackled this same challenge and those that failed
to make progress. Be sure to include their costs and related organizational resources.
Ultimately, the group should determine a clear list of strategies and specified results
that are not simply feasible but optimalthat is, highly likely to secure the impact.
This may require some toggling. Use the Guiding Questions (below) to critically
review the work of the group. Look forward to Chapter 6 and review the New York
state Healthy Weight Partnership. It offers some great ideas about strategies and results
(defined by their mission and vision). The NY model cites target sectors/settings to
segment their program plans since the work is focused on all state residents.
As you construct, then review a theory of change, the following questions may
be useful:
28PART I CONSTRUCTION
Strategy 1
Strategy 2
Results
Strategy 3
Strategy 4
Academy
Leadership
Curriculum
Community
Development
Academy
Leadership
Experiences
30PART I CONSTRUCTION
your specified success. Eventually, right work is also about detailing those specific
activities that are subsumed by each strategy that is chosen for display in the program logic model. Giving conscious attention to the criterion used in selecting
strategies at this stage, and again later, will identify how implementation can make
a big difference in the likelihood that your program will secure results. The right
work is clarified and confirmed if there is a shared understanding of the problem
you plan to resolve and there is agreement on how it can be accomplished.
Specificity here, on the front end, contributes to the results you and your colleagues
intend to secure. Ambiguity can doom the best-intentioned efforts to failure.
If your end result in a construction project is a great house, then cooking and
sewing probably are not the most relevant strategies. However, planning with welldetailed blueprints as well as appropriate purchasing (e.g., quality lumber) and
contracting should be ripe for your attention. It is surprisingly easy to spend time
on the wrong work. It can be an unconscious or conscious choice. Theory of change
models should display planned results and specify the most relevant and influential
strategies to secure the results. The strategies are determined from a universe of
possibilities. Often, people include strategies (and later, activities) they have always
done or are most familiar with doing. If replication is intentional, then repeating
what has been done before might be appropriate. As time passes and knowledge
changes, however, results may require we use what has been learned about new or
different strategies (and activities) to be more efficient and effective. Remember, a
theory is only as good as its last test.
Tough Questions
Of course, there are many ways to secure a named and intended result. Discarding
strategies/activities that are peripheral, modest contributors or less than optimal in
potency can focus limited resources. Models and their iterations can develop a disciplined way of thinking that contributes to new understandings about what will
generate progress toward results. Once results are specified, the discovery and discussion that should be encouraged during your modeling attends to these two big
questions:
What are the many ways we could resolve this challenge?
Then, what are the most effective and efficient ways to secure results?
Subsequently, as model versions are explored, it is important to inquire further. For example, are we doing something that has a reasonable chance of working? Are we doing something that should be done? Are we clear enough about the
work that we have shared expectations for what it includes and can yield? How
does our model rely on research, practice, theory, and/or literature? We know that
the politics of power and dynamics of resources often preclude these conversations. A predisposition to activities and busyness can overwhelm a disciplined
and interactive process, too. However, the benefits and relative value of getting
things right at the start are considerable. The opportunity cost or waste in missing this step is huge.
IN SUMMARY
Logic models display mental maps people hold about cause and effect. Combined,
theory of change coupled with program logic models are the most potent design
prescription. Theory of change models specify and link strategies with results. Most
change efforts require multiple strategies. Knowledge is a critical input for models
and can include research, practice, and theory. What people believe affects the content and format of models. Improving theory of change models requires multiple
perspectives, unpacking assumptions, shared language, toggling, and the exploration of promising practices.
LEARNING RESOURCES
Reflection
1. What role do assumptions and beliefs play in a theory of change model?
2. How can you test a theory of change model for plausibility? Why bother with
this step?
3. Are there blind spots in the modeling process? If so, what are they?
4. What are the implications of a change model that relies on a hypothesis versus
one based on a claim with proof?
5. What are some ways that theory of change models can be improved and/or
developed?
6. What challenges do complex and highly interactive systems present in a theory
of change model? Where and how do you bound the presentation of a theory of
change model?
Application
1. Have a conversation:
A. Ask colleagues to share their beliefs about parenting (or their mothers or
fathers beliefs) to ensure a happy, confident, successful young adult. From
this conversation, draw a theory of change. What are their most important
strategies? Can you identify their beliefs, values, assumptions? Do they cite
any evidence for their choices? Is research, practice, or theory part of their
explanation? How are their views similar to or different from yours? Do they
have a shared understanding and agreement about parenting with their
spouse (or among their parents)? How does your response to these questions
influence the model?
B. Ask a friend or colleague to share a recipe for marketing a new car model. What
are the most important strategies for ensuring profit? What evidence supports
32PART I CONSTRUCTION
their choice of strategies? How do assumptions inform their theory of profitability? How does your response to these questions influence the model?
2. Ask several people to list the many ways that improved health might be
described. Why does this outcome/result have different meanings? Could these
differences influence modeling?
3. Find a news article that describes a change effort (in a government, nonprofit, or
private sector). Draw it. Can you detect the efforts underlying theory of change?
How was it informed: based on a claim or a hypothesis?
4. Considering the drawings from Questions 1 and 3, how do choices of strategies
influence the likelihood of achieving your intended results? What changes, if any,
could be made to improve the plausibility of these models?
Journal Articles
Birckmayer, J. D., & Weiss, C. H. (2000). Theory-based evaluation in practice: What do we
learn? Evaluation Review, 24(8), 4043.
Bolduc, K., Buteau, E., Laughlin, G., Ragin, R., & Ross, J. A. (n.d.). Beyond the rhetoric:
Foundation strategy. Cambridge, MA: Center for Effective Philanthropy. Retrieved
December 7, 2011, from http://www.effectivephilanthropy.org/assets/pdfs/CEP_
BeyondTheRhetoric.pdf
Internet Resources
Sharpe, M. (2009) Change theory. Muncie, IN: Ball State University. Retrieved December 7,
2011 from http://www.instituteforpr.org/wp-content/uploads/ChangeTheory-1.pdf
3
Creating Program Logic Models
his chapter identifies the basic elements of a program logic model. Generally, these models have enough detail to support design, planning, management, or evaluation. This chapter describes a program logic model
example and the action steps to create a model with a small group.
LEARNER OBJECTIVES
Describe the relationship between theory of change and program logic
models
Identify basic elements for a program logic model
Create a simple model
Recognize limitations of display
Resources
Do
Get
Strategies
Results
Activities
Outputs
Short-Term
Outcomes
IntermediateTerm
Outcomes
Long-Term
Outcomes
Assumptions Matter
It is important to be aware that specific assumptions are not illustrated in Figure 3.1.
Recall that assumptions are informed by beliefs and knowledge. Too often, program
models are built without the benefit of explicitly naming the assumptions and
underlying theory of change. This omission can help explain why tremendous conflict, even chaos, can erupt during program development, planning, implementation, or assessment. In the absence of explicitly named assumptions, either a clear
theory of change does not exist or people hold multiple and conflicting variations
that reflect their deeply held views about what should/could work and why. This can
lead to diffuse or dilute programs that lack the focus and intensity needed to produce intended results. Because of these implications, omitting this foundation for
your idea, program, or social change effort undermines its potential for success.
As noted previously, conceptualization and learning styles differ from person to
person. Organizational culture can also affect how design, planning, monitoring,
and measuring occur. Given these practical issues, we strongly suggest that both
theory of change and program logic models eventually be created to form the foundation of shared meaning for all aspects of the program. The sequence in which
they are developed certainly should and will reflect the stakeholders preferences.
Impact
36PART I CONSTRUCTION
Resources
Activities
Outputs
Short-Term
Outcomes
IntermediateTerm
Outcomes
Long-Term
Outcomes
Impact
38PART I CONSTRUCTION
Activities
Activities
Activities
Resources
Outputs
Outputs
Outputs
Resources Resources
Short-Term
Outcomes
Impact
Short-Term
Outcomes
Impact
Short-Term
Outcomes
Impact
Intermediate
-Term
Outcomes
Short-Term
Outcomes
Intermediate
-Term
Outcomes
Short-Term
Outcomes
Short-Term
Outcomes
IntermediateTerm
Outcomes
39
E
Eigible and
willing
participants
Coaches
Faculty
Facility
Funds
Resources
Retention and
recruitment
activities
Stressreduction
activities
Nutrition
activities
Exercise
activities
Activities
Do
Coaching
tools and logs
Messages
and media
Participant
data
Curricula
and staff
Outputs
Awareness
Knowledge
Short-Term
Outcomes
Motivation
Adherence
Skill
IntermediateTerm Outcomes
Get
Retention
Relaxation
Flexibility
Fat/Calories
Nutrients
Endurance
Strength
Long-Term
Outcomes
Improved
health
Impact
40PART I CONSTRUCTION
activities in this illustration. The specific activities that contribute to outputs are not
named. Outputs from the intervention strategies and associated activities (exercise,
nutrition, stress reduction) could be numerous. For this illustration, we show only
the overarching categories of information that could be considered. Each category
would be repeated for each of the strands. These would include details about the
scope, sequence, and quality of the curriculum; staffing qualifications; and information about participants and their participation. Activities inside these strategy
strands contribute to changes in knowledge, skill, and adherence. Eventually, they
can contribute to increases in strength, endurance, nutrients, flexibility, and relaxation. Concurrently, over time, these same strategies also yield reduced fat/calories.
The retention and recruitment strategy strand also generates some outputs and
outcomes. Aggregated, activities within this strategy secure and keep participants in
the program. Note that this model uses arrows to show relationships. Sometimes
they reflect a cluster (indicating synergies) rather than just one:one relationships.
As is typical of many programs, several strategies may be shown as contributing
collectively to outcomes rather than each strategy making its individual contribution to distinct outcomes in isolation. Collectively, the long-term outcomes generate improved health, which could be measured in a variety of ways (e.g., blood
pressure, blood lipid and sugar profiles, weight).
In contrast to the big-picture view that theory of change models offer, program
logic models provide a closer, more detailed picture of operations. This view of the
program provides adequate detail to then create work plans. Program models can
provide a reliable outline for work plans that are used to implement and manage a
program or larger change effort. Just like theory of change models, program models
are often logicalbut here, feasibility, given limited time and resources, is the
appropriate standard for assessing their value. A common question about program
logic models focuses on their level of detail. Essentially, the level of detail in program logic models should be determined by their intended use and users. Although
somewhat situational, program logic models build out strategies to activities.
Sometimes they can even get to the fine detail of tasks, although more often that is
described in an operations or action plan.
whole with some of the inherent complexity reduced. Ultimately, program execution relies on integrated actionbut the work that precedes it may require focused
developmental attention on smaller parts.
Using the health improvement program example, Figure 3.5 provides an orientation to how the exercise strategy strand might be reduced to activities. It breaks
the strategy into greater detail for the purposes of selection and design.
In Figure 3.5, it becomes evident that exercise as a strategy is made up of several
key activities. They include physical exercise (strength and endurance), education,
and assessment. Together, all of these activities represent a comprehensive strategy,
exercise, that is just one means to improved health. Recall that the whole theory of
change for this example also includes stress reduction, nutrition, and retention. It
is the combination of strategies reflected in the whole program that is most likely
to secure results. Each strand of a comprehensive program logic model needs to
illustrate the contribution of each strategy as well as the interdependence.
As you specify the activities content of your strategy, you are naming more precisely
what makes up the given strategy. Later, the whole model is tested for feasibilityboth
practically before implementation and literally when the program is evaluated.
In Figure 3.6, we provide a view with greater detail for only the exercise strategy.
In this illustration, we show the detail of activities within the exercise strategy. It
also suggests the many decisions hidden in program design and planning. In choosing activities, it is critical that the relationship among strategies and activities is
intentional. The strategies and the cluster of appropriate activities should also be
chosen with reference to a target audience. Remember, logic models use ifthen
sequences from left to right in the columns and among the features as you read
from left to right.
Get
Strength
Activities
Endurance
Activities
Results
Exercise
Education
Fitness
Assessment
Exercise Strategy
42
Coaches
Faculty
Facility
Funds
Resources
Implement
Exercise Strategy
Collect final
measurements
16-week
program
Participant
orientation
Collect baseline
measurements
Activities
Participant Data
and Exercise Logs
Participant logs
Baseline data
# and types of
participants
Outputs
Skill with
endurance
equipment
Skill with
strength
equipment
IntermediateTerm Outcomes
Increased
Adherence
Satisfaction and
enjoyment
Time (length/
session)
Intensity
(exertion/
session)
Frequency
(sessions/week)
Understands
personal
exercise
prescription
General fitness
knowledge
Short-Term
Outcomes
Increased
endurance
Increased
strength
Long-Term
Outcomes
Improved
Health
Impact
44PART I CONSTRUCTION
Get
Strategies
Results
Step1
Resources
Activities
Step4
Outputs
Short-Term
Outcomes
Step5
Step3
IntermediateTerm
Outcomes
Long-Term
Outcomes
Impact
Step2
reconcile the variations. This approach helps avoid groupthink but requires
strong process facilitation with content knowledge. A generic model or template for
a given program may be available. With some advance planning, its possible to
identify one of these archetypes and introduce it to your group. Then, the content
adaptations can focus on improving it so that the content is relevant to your purposes, conditions, and planned results. Chapter 7 includes examples of models that
can be used in this way. Sometimes a call for proposals or funding opportunity will
articulate the range of acceptable content in a model.
Regardless of the process, strategic decisions about activities and the relationships between elements should be made from among all the content generated. It is
important to consider criteria for choices that reflect context, target audience(s),
research, practice, literature, and program benchmarking, as well as resource
parameters. It can be very helpful to have draft models critically reviewed in a
mark up. This is described in the next chapter as a quality assurance process.
We often use Microsoft Visio to construct our models, but many other applications such as Word and PowerPoint have drawing options. These as well as
Inspiration software are all readily available. The Supplemental Readings list at the
end of the chapter identifies some examples of other free and commercial software
applications. Take care in using technology for model creation, because it can
exclude valuable participation.
IN SUMMARY
High-quality program logic models depend on the evidence base found in their
parallel but simpler theory of change models. Program logic models display several
important elements: resources; activities; outputs; short-, intermediate-, and longterm outcomes; and impact. To create a program logic model, start with the
intended results: outcomes and impact. Then, activities (which are consistent with
strategies in the theory of change model) are selected. Next, resources and outputs
are cited. We believe creating models with deep participation of stakeholders
improves their quality and encourages their use.
LEARNING RESOURCES
Reflection
1. What are the implications of a program logic model built without a specific
theory of change?
2. Think of a successful business and its product or service. What is the underlying
program logic that shows the explanations for profitability?
3. Feasibility relies on several aspects. Can you name some?
46PART I CONSTRUCTION
Application
Specify the result of a shared program, project, or idea. Draw a theory of change
model for the program, project, or idea. Then, attempt a program logic model.
Using sticky notes or pieces of paper, brainstorm the outcomes that need to happen
to secure the result. Organize them into short, intermediate, and long term. Pick
one short-term outcome. Brainstorm what activities are critical to that outcome.
Organize the activities relative to a single or multiple strategies. For given strategies
and their activities, name the resources needed. From the activities, cite what outputs are possible. Organize these elements as one model.
Journal Articles
Cooksy, L. J., Gill, P., & Kelly, P. A. (2001). The program logic model as an integrative framework for a multi-method evaluation. Evaluation and Program Planning, 24(2), 119128.
McLaughlin, J. A. (1999). Logic models: A tool for telling your programs performance story.
Evaluation and Program Planning, 22(1), 6572.
Millar, A., Simeone, R. S., & Carnevale, J. T. (2001). Logic models: A systems tool for performance management. Evaluation and Program Planning, 24(1), 7381.
Porteous, N. C., Sheldrick, B. J., & Stewart, P. J. (2002). Introducing program teams to logic
models: Facilitating the learning process. Canadian Journal of Evaluation, 17(3), 113141.
Renger, R., & Titcomb, A. (2002). A three-step approach to teaching logic modeling.
American Journal of Evaluation, 23(4), 493503.
Rush, B., & Ogborne, A. (1991). Program logic models: Expanding their role and structures for
program planning and evaluation. Canadian Journal of Program Evaluation, 6, 95106.
Internet Resources
For comprehensive bibliographies and links to additional resources, see
Logic model resources. (n.d.). Atlanta, GA: The Evaluation Working Group of the Centers for
Disease Control and Prevention. Retrieved December 8, 2011, from http://www.cdc
.gov/eval/resources/index.htm#logicmodels
Jung, B. C. (19992012). Evaluation resources on the Internet. Retrieved December 8, 2011,
from http://www.bettycjung.net/Evaluation.htm
University of Wisconsin Extension. (n.d.). Logic model bibliography. Retrieved December 8,
2011, from http://www.uwex.edu/ces/pdande/evaluation/evallogicbiblio.html
4
Modeling
Improving Program Logic Models
LEARNER OBJECTIVES
Apply simple review and improvement steps to models
Identify common errors in program logic models
Recognize the value of multiple versions of models
Recognize contributors to model quality
The process of modeling supports better thinking about a given idea or effort. It
can establish routines wherein alternative possibilities are considered and explored.
Modeling may be an important antidote to snap judgments. We see modeling as an
essential step that has tremendous potential to position a project, program, or initiative for greater effectiveness. It generally involves several versions or attempts at
models that result from a critical review of the information displayed.
Chapter 4Modeling49
revision. Modeling is the most important content in this book because critical thinking is what refines the content of the model. Modeling is a means to illustrate where
you are headed, make better decisions about getting there, and get closer to the right
work. We think it is important to test both plausibility and feasibility through modeling. In Chapter 2, we stated that plausibility is the most important criterion for a
theory of change model. The process of toggling between combinations of strategies
and results to secure an evidence-based model tests and verifies plausibility. We provide techniques that address the aspect of feasibility once plausibility has been established or confirmed. These criteria reflect the widely used Program Evaluation
Standards (The Joint Committee on Standards for Educational Evaluation, 1994) that
include utility, feasibility, propriety, and accuracy. Given the strong relationship
between programming (strategy) and evaluation (results), we draw upon what constitutes sound evaluation practice to inform logic model development.
This chapter identifies some of the common context challenges that influence
models and mitigate their potential. Some result in flaws embedded in the models
and others occur in the modeling process. Our list includes blind spots, myths,
logic, and scale. We also name an overarching concern: culture. It can influence
all the preceding items and more. Next, we identify some quality review techniques
for program logic models. Through this sequence, we name the problems often
associated with models and attempt to offer some remedies.
Context Challenges
Common Pitfalls: Blind Spots and Myths
Generating high-quality models through modeling is not easy, but both the products and the process do offer significant benefits. Some discomfort among participants during modeling can be an indicator that the process is useful. This
discomfort probably reflects the twists, turns, flips, and angles of new or different
thinking. It is important to be aware of blind spots (which we all have).
Individuals have blind spots and small groups can have collective ones they protect and promote through interaction among participants. Blind spots are simply
unintentional omissions in our thinking or commissions of error that happen
because of habit (e.g., snap judgments, confidence, experience enables them).
Eventually, these blind spots show up in our models because models represent
how we think.
Prevailing myths are another pitfall to guard against. Common examples of
myths include access equals use, knowledge equals action, activities equals outcomes, and send equals communication. These myths end up as embedded
flaws in models because they are not precisely named and subsequently discarded.
Almost every organization, department, or unit perpetuates some myths. We think
its how people defend and rationalize bad habits. These habits are often a way of
coping with the organization, a boss, a funder, or another entity. Avoiding the pitfalls of blind spots and myths through disciplined and intentional discovery can
contribute to model quality and eventually to program effectiveness.
50PART I CONSTRUCTION
Chapter 4Modeling51
sequence on the path to the vision of the future you want to create. These more
proximal outcomes can help define a contribution to the desired results. The
strength of logic models lies in articulating the contribution to desired impact.
Probability statistics underscore our point: With fewer variables, the likelihood
of the optimal combination increases. As the variables increase in number, the likelihood of success declines. We advocate for smaller bites. It simply means picking
which results are likely and moving backward from those results while employing a
feasibility lens to determine the activities needed to develop plans, programs, or
related efforts.
52PART I CONSTRUCTION
Quality Techniques
Modeling
Most ideas, projects, or programs can be characterized in their life to include four
simple stages: design, implementation, evaluation and adaptation. We suggest that
modeling is most useful when done in the creation stage and during evaluation, but
models can be used at any stage for different purposes. Getting things right at the start
can be very important to ultimate results and is a key influence to subsequent stages.
Modeling can be thought of as a review process that occurs prior to implementation
or execution. It is done to improve thinking and the models that reflect thinking.
Time and effort spent in this work can have enormous return on investment through
the influence on the program itself. The steps in modeling are draw and test. This
construct is displayed in Figure 4.1.
As a program, project, or idea is created, we suggest it gets drawn as a model. The
draw step is satisfied when all elements of a program model (see Chapter 3) are present.
Chapter 4Modeling53
Design
Draw
Test
To IMPROVE
Implement
To ADAPT
Evaluate
Completion of this step means resources, activities, outputs, outcomes, and impact are
named. This provides an opportunity to graphically display the thinking behind how
the ideas framed in the theory of change will be implemented as a program. Many
efforts with logic models quit at this point. However, through modeling, you can move
quickly to dialogue to process the content and the tangles. Tangles represent areas of
confusion or where some in your group think a choice is wrong, confusing, or poorly
specified. Modeling is the process that guides model improvement.
In this chapter, we begin to name how and what can test (or explore) model
quality. We believe this testing can help improve models. The subsequent versions
of models that result from literal and figurative tests are products of modeling. This
process can yield benefits to the specific idea or project as well as the individuals
engaged as a work group. It is important to be aware that many external issues
influence modeling. We describe some of those issues, but our list is not exhaustive.
54PART I CONSTRUCTION
If just a few people apply SMART principles to the outcomes portion of a program logic model, it will probably surface several flaws and, at the very least, some
good questions. It may also raise concerns that are unique reflections of the training, experience, perspectives, and style among those contributing to the review. We
suggest that a SMART analysis be applied to both the parts and the whole. In other
words, it can be used to examine selected individual strategy strands and activities,
as well as the model as a comprehensive effort.
A second way to explore or test the quality of a model is to consider FIT. FIT is
an acronym that was first coined by the American College of Sports Medicine as
FITT (frequency, intensity, time, and type). Although originally developed to prescribe exercise, we have modified it for use in our practice to quantify program
delivery. It stands for
Frequency of occurrence,
Intensity or strength of the given effort,
Targeted at a specified market or audience.
FIT principles offer an easy way to consider the process elements of the program,
project, or idea you display in your model. They translate to important questions
about the adequacy of dose relative to intended results. The frequency reference
implies this question: Does the project (idea or program) repeat, occur with appropriate volume, or happen often enough so that results are likely? The intensity reference implies this question: Does the project (idea or program) have enough depth
or concentration that results are likely? The target reference implies this question:
Does the project (idea or program) aim at an appropriate and specific audience or
market segment?
In effect, FIT can remedy treatment trickle, one thing known about resolution of problems or generating a change in awareness, knowledge, skill, or behavior: The treatment (or intervention) needs to be both appropriate (the right
choice) and adequate (the right dose). The wrong choice wont help get the results
you want. The right choice has more chance of securing results, but there needs
to be enough of it (volume) focused on appropriate targets to ensure results.
Treatment trickle means that a problem or challenge is underdosed or an effort
that is too broad or diluted to have impact. Feasibility is enhanced when we tackle
a desired change with the right strategies as well as appropriate depth of intervention. Treatment trickle is common because people prefer to give everything or
everyone some rather than make hard choices about who or what gets enough!
It is often a reflection of limited resources, vague goals, or organizations with an
activities focus (see Figure 4.2).
A Mark Up
In Figure 4.3, we revisit the logic model introduced in Chapter 1 for the Community
Leadership Academy program. We suggest a technique thats often used in the
Chapter 4Modeling55
Context
identifies
challenges
FIT
tests activities
SMART
tests outcomes
Better model
Model
Modeling
Better program
56
Content
Faculty
Participant
satisfaction
Completion
rate
FIT
How often does the academy meet? How long are the sessions? Over
what period? Dose is important and should be included in the outputs.
Leadership
Experiences
Processes
Participant
description
Outputs
Context
This model emphasizes the academy perspective. To what extent
was the community involved in developing it?
Sponsors ($)
Marketing/
communication
campaign
Host and
facility
Leadership
Curriculum
Curriculum
and materials
Participants
Activities
Resources
Graduates use
knowledge and
skills obtained
through the
program to
strengthen
the community
Intermediate/Long Term
Outcomes
Community
development
Impact
SMART
The short- and intermediate-/long-term outcomes are specific,
measurable, and action oriented.The impact is not.
Better Leaders
Increased
community
awareness and
action bias
New leadership
attitudes,
knowledge, skills,
and behaviors
Short Term
57
Retention and
recruitment
activities
Stressreduction
activities
Nutrition
activities
Coaching
tools and logs
Messages
and media
Participant
data
Curricula
and staff
Outputs
Knowledge
Short-Term
Outcomes
Awareness
FIT
How are the frequency and intensity specified? Is there sufficient evidence that the program
dose will be enough to achieve outcomes? Do we assume that Participant Data will include
this information? Will baseline health data be collected?
Does it make sense that the activities identified will contribute to the outcomes specified?
Are these activities enough to change awareness, knowledge, skill, AND behavior? Is the
program, as illustrated, feasible?
What health-improvement and behavioral change theories inform the choices about
curriculum and activities (exercise, nutrition, stress reduction, and retention/recruitment)?
This model doesnt show how determined or if best approach is used.
Context
This model emphasizes the clinical perspective with little detail. To what extent were other
stakeholders involved in developing it? This may influence shared understanding about the
program and how its outcomes are defined and represented.
Eligible and
willing
participants
Coaches
Faculty
Facility
Funds
Exercise
activities
Activities
Resources
Retention
Relaxation
Flexibility
Fat/Calories
Nutrients
Endurance
Strength
Long-Term
Outcomes
Improved
health
Impact
This model shows knowledge, skill, adherence, and motivation as contributing to the
changes in health status. What else might help or hinder participants making progress
toward improved health?
In particular, the specifics of how each outcome and impact will be measured will
matter a lotfor example, Is it okay if people weigh more but are also more fit?
The short- and intermediate-/long-term outcomes and impact are specific, measurable, and
action oriented. They are appropriate for the overall level of detail expressed in this
design-framework-type model, but more detail would be needed to operate, manage, and
evaluate the actual program.
SMART
Who is the best target for this program? Who isnt? Eligible and willing may be insufficient.
What about able? Are the intended activities appropriate, safe, and effective for this target?
Do we assume these details are in the narrative that accompanies the model?
Motivation
Adherence
Skill
IntermediateTerm Outcomes
58PART I CONSTRUCTION
secure the intended impact. The real time and context between activities and outcomes
means many external issues also have the potential to influence the outcomes.
Typically, groups vary on how much emphasis they place on each of the characteristics of quality models described here. As with model interpretation and review,
context and composition of the group frequently determine how the difficult distinction is made.
This also points to crucial issues in execution. When a model (representing an
idea, project, or program) is evidence based, strategic, and well designed, implementation can still fail its potential. Although logic models are often used to inform
evaluation, modeling at this stage is rarely done (see Chapter 5). Although outside
the scope of this text, great execution is absolutely essential to results.
Quality Questions
The models you (and your colleagues) build reflect your collective thinking. Nobody
would argue with this assumption: Best thinking is a critical input to any work and
its likely success. As you consider the design or plans for your project (program or
idea), the following questions reflect quality considerations. They include application of the SMART and FIT principles. You might construct other questions based
on your own experience or particular subject matter expertise. Think about ways to
conduct discovery around blind spots, myths, and other culture concerns. Regardless,
it is important that deliberate efforts are invested in the maturation of a model.
Modeling provides an opportunity to test, improve, and revise models. This process
helps develop the thinking and the program that the model represents.
Chapter 4Modeling59
A Quality Model
Figure 4.5 displays characteristics for model quality. It assembles key narrative from
this chapter into a graphic. The figure describes two important standards for model
quality: plausibility and feasibility. The quality characteristics for theory of change
models are noted (as in Chapter 2), where the focus is on the relationship between
strategies and results. The quality characteristics for a program logic model are
captured by FIT and SMART principles. We suggest the application of this in a
mark up is one way to work with colleagues in modeling. We think, taken together,
theory of change models that are plausible and program logic models that are feasible can contribute to effectiveness.
Better Decisions
Earlier in the text, we asked three questions about effectiveness:
Are you doing the right work?
Can you make better decisions?
Are you getting superior results?
The second, about making better decisions, is highly central to modeling. In
effect, we apply this query to strategy and activity selection relative to results. How
you choose to focus time, energy, talents, and resources in relation to your specified
success is related directly to effectiveness. There are many ways to secure a named
intention. Discarding strategies/activities that are peripheral, modest contributors,
Plausibility
Quality
Characteristics
Co-created with
shared meaning
Evidence based
Appropriate
scale
Theory of Change
strategiesresults
Test Underlying
Idea for Plausibility
Better
Models
Feasibility
Quality Questions
FIT
SMART
Better
Programs
60PART I CONSTRUCTION
or less than optimal focuses limited resources. Further, specificity about strategies
and activities contributes to the results you and your colleagues intend to secure.
Ambiguity should be avoided. Eventually, right work is also about the strategies
and activities in the program logic model. Giving conscious attention to the criteria
employed in selecting strategies for the theory of change model and then the specific activities in the program logic model can make a big difference in securing
results. Right work gets clarified and better decisions considered through the
process of modeling. Models and their versions can develop discipline as well as
standard practices that contribute to new understandings about what will generate
progress on results.
IN SUMMARY
Although frequently overlooked, modeling is a helpful technique to improve your
chances of success, because great design and plans come from great models. We
suggest iterative versions of models are co-created through a disciplined process
that tests and retests quality. Models can be greatly influenced by unintentional
omissions (blind spots), myths, politics, persuasions, and perceptions. Logic, scale,
and specificity all have a bearing on models, too. A simple way to explore model
quality is the application of SMART and FIT principles. We suggest a mark up as a
good way to critically review your program logic model.
LEARNING RESOURCES
Reflection
1. Given how subjective program logic models are, what are the implications for
the outside reader of a model? What does a model that will be read and perhaps used by those other than those who constructed it have to communicate?
2. What role might politics, persuasion, or perception play in how a model might
be created, tested, and improved? How do these issues influence model quality
and use?
3. What prevailing myths might influence choices in your workplace or family?
How do blind spots influence choices?
4. How might the improvement process for a simple, single-site project model be
different from that for a more complex multisite, multilevel initiative? What concerns should the model development team be sure to address, and what aspects
of the model will be most important to communicate?
5. Can a complex, comprehensive program be effectively modeled with a single
diagram? Why or why not? How would you approach a task like this?
Chapter 4Modeling61
Exercises
1. Imagine what a strand focused on marketing might look like to promote an
innovative new hearing aid. Make an assignment for individuals to illustrate
this strand. Give them all the same amount of specified financial resources
over 12 months and tell them the desired outcome is maximum sales volume.
Then, ask them to name their target market and key activities in the marketing
strategy. Compare and contrast versions each participant creates. What
assumptions, knowledge, or evidence accounts for the differences in how the
marketing strands are constructed? What criteria are useful for reconciling
these different illustrations?
2. Consider the questions raised in Figure 4.3 about the Community Leadership
Academy program logic model. How would you answer them? What would the
model look like once those questions had your answers? Draw it and discuss the
implications of your response to the mark up.
Consider the questions raised in Figure 4.4 about the Health Improvement
Program. How would you answer them? What would the model look like once
those questions had your answers? Draw it and discuss the implications of your
response to the mark up.
3. Draw a logic model for learning a foreign language. Ask a colleague to conduct a
mark up using SMART and FIT on the models. What might change? How? Why?
Journal Articles
Alter, C., & Egan, M. (1997). Logic modeling: A tool for teaching critical thinking in social
work practice. Journal of Social Work Education, 33(1), 85102.
Doran, G. T. (1981). Theres a S.M.A.R.T. way to write managements goals and objectives.
Management Review, 70(11), 3536.
Dwyer, J. (1996). Applying program logic model in program planning and evaluation. Public
Health and Epidemiology Report Ontario, 7(2), 3846.
Israel, G. D. (2010). Using logic models for program development (AEC 360). Gainesville, FL:
University of South Florida, IFAS Extension. Retrieved December 7, 2011, from http://
edis.ifas.ufl.edu/wc041
Julian, D. (1997). The utilization of the logic model as a system level planning and evaluation
device. Evaluation and Program Planning, 20(3), 251257.
62PART I CONSTRUCTION
Renger, R. (2006). Consequences to federal programs when the logic-modeling process is not
followed with fidelity. American Journal of Evaluation, 12(27), 452463.
Rush, B., & Ogbourne, A. (1991). Program logic models: Expanding their role and structure for
program planning and evaluation. Canadian Journal of Program Evaluation, 6, 95106.
Internet Resources
Burke, M. (n.d.). Tips for developing logic models. Retrieved December 7, 2011, from http://
www.rti.org/pubs/apha07_burke_poster.pdf
In addition to practicing the review steps on your own models, there are many
other examples of logic models to work from available on the Internet. For several
different approaches, see the following:
Duigan, P. (n.d.) Outcomes model listing. Retrieved December 8, 2011, from http://www.out
comesmodels.org/models.html
Tucson: University of Arizona Cooperative Extension. (2009). Logic models. Retrieved
December 7, 2011, from http://extension.arizona.edu/evaluation/content/logic-modelexamples
Capable communities: Examples. (2011). East Lansing: Michigan State University. Retrieved
December 7, 2011, from http://outreach.msu.edu/capablecommunities/examples.asp
SEDL. (2009). Research utilization support and help: Logic model examples. Retrieved December 8,
2011, from http://www.researchutilization.org/logicmodel/examples.html