Program-Development
Program-Development
Grant
Needs Program
Writing
Assessment Development
Fiscal Strategic Volunteer
Management Technology
Planning Management
Development
Human
Resources
Surviving an Audit
Board
Program Development
Evaluation
Faith-Based
Starting a
Leadership Nonprofit
Development
Leadership
Development
PROGRAM DEVELOPMENT
Dear Colleague,
On behalf of the National Minority AIDS Council (NMAC), thank you for picking up
this manual and taking a step toward increasing your capacity in this struggle.
As we enter the third decade of HIV/AIDS, it is more important than ever to
develop our skills and knowl- edge to better serve our communities and our
constituents.
The Technical Assistance and Training Division‘s mission to build the capacity
and strength of community-based organizations, community-planning groups for
HIV prevention, and health departments throughout the United States and its
territories is supported through a multifaceted approach. This approach includes
individualized capacity-building assistance, written information (manuals,
publications, and information provided through NMAC’s web- site and broadcast
e-mail messages and interactive learning experiences (trainings). All com-
ponents are integral to providing a comprehensive capacity-building assistance
experience, as opposed to offering isolated instances or random episodes of
assistance.
Our hope is that this revised manual will give you the skills and knowledge to
increase your capacity and serve your community at a greater level than ever
before. Please feel free to contact us if you would like further information on
what other services we can provide to you and your community.
Paul Akio
Kawata
Executive
Director
1
Contents
Preface...................................................................................................5
Introduction.........................................................................................7
UNIT 1: Introduction...........................................................................11
I. What Is Program Development?....................................................................13
II. Program Development Pre-test....................................................................14
III. Why Is Program Development Important?...................................................15
IV. Content of the Program Plan........................................................................15
V. The Planning Process......................................................................................16
VI. Program Development: The Seven-Step Model.........................................17
3
UNIT 6: Program Design....................................................................59
I. The Action Plan..............................................................................................61
II. Program Design Planning..............................................................................62
III. Intervention Activities Timeline....................................................................64
IV. Collaboration and Coordination.....................................................................65
V. Evaluation Plan...............................................................................................66
VI. Staffing Plan....................................................................................................67
VII.Budget............................................................................................................68
UNIT 8: Evaluation.............................................................................79
I. Conducting Evaluations.................................................................................82
II. Helpful Tools..................................................................................................86
Appendix A: Glossary.......................................................................93
Appendix C: Bibliography...............................................................105
4
Preface
Organizational Effectiveness
Ongoing learning and training in each of these areas will allow your
organization to meet the needs of your constituents.
For information regarding training in any of these areas, contact the National
Minority AIDS Council’s Technical Assistance, Training and Treatment Division by
telephone at
(202) 234-5120 or by e-mail at [email protected].
Board Development
Faith-Based Leadership
Development Fiscal Management
Grant Writing
HIV Prevention Community
Planning Human Resources
Leadership
Development Needs
Assessment
Program
Development
Program Evaluation
Organization Starting a Nonprofit
Strategic Planning
al Surviving an Audit
Technology
Effectivenes Development
s Volunteer
Management
5
Introduction PROGRAM
DEVELOPMENT
An ongoing,
compre- hensive
Purpose planning pro- cess
used to establish
PROGRAM
Learning Objectives IMPLEMENTATION
The stage in
Upon completion of this manual, learners should be able to:
program planning
✓ Identify the steps and explain the importance of program development. where you develop
✓ Explain why program planning is essential to program development.
✓ Describe how knowledge of program development can support
community organization design and prevention program
implementation.
✓ Explain what a needs assessment determines and how the
information it generates can be used in program planning.
✓ Describe what should be included in a needs assessment.
✓ Explain the steps for conducting a needs assessment and describe
how this information will be applied in the context of an
organization.
✓ Identify who can conduct a needs assessment and prepare a list
of possible recommendations.
✓ Explain ways that a program assessment is useful and
describe how the assessment can enhance service delivery.
✓ Develop a needs assessment questionnaire.
✓ Explain why mission statements are essential.
✓ Write an effective mission statement.
✓ Explain why program goals are necessary.
✓ Explain how to write realistic, time-framed and measurable goals.
✓ Write realistic, time-framed and measurable goals.
✓ Write attainable program objectives.
✓ Identify the major sources of funding.
✓ Identify ways to develop and improve relationships with funding agencies.
✓ Explain why assigning leadership roles is an essential step in
building successful programs.
✓ Understand the different leadership styles and identify styles that
support your organization’s mission.
7
✓ Identify factors that influence good leadership and design activities for
implementing leadership-development training and group maintenance
roles.
✓ List the characteristics of a good leader.
✓ Explain the relationship between successful programs and competent leadership.
✓ Explain why program design is integral to overall program planning.
✓ Explain the major components of an action plan.
✓ Describe your interventions, outline the services that comprise your
interventions and present the activities you will engage in to
implement the interventions.
✓ Describe how your interventions will be implemented and by whom.
✓ Explain the importance of program implementation and outline an
implementation plan for a program.
✓ Identify the elements of program design necessary to ensure the
successful imple- mentation of program activities, and explain why they
are important.
✓ Explain program evaluation and describe how it is useful for making
programmatic decisions in a program.
✓ Describe the purpose of conducting evaluations and explain how each
purpose can impact a program.
✓ Explain impact assessment and identify which areas you would like to have
an impact on AIDS/HIV prevention and other sexually transmitted disease-
prevention programs.
8
Program
Development
Pre-training Assessment
This Pre-training Assessment is an opportunity for you to check your knowledge
against the information that will be addressed in this manual. Take this test now
and again when you have finished the manual. Answers are found on page 91.
Pre-training Assessment
Please circle the following statements either True or False.
Purpose:
This unit explains program development as an ongoing
comprehensive planning process used to establish programs.
Learning Objectives:
By the end of this unit, learners will be able to:
Directions: Using the scale shown below, indicate your level of proficiency
for each of the following as a pre-test assessment.
Level of
Proficien
Course Objectives cy Pre-
test
Understand the benefits of program planning for program
development.
Identify and define terms used in the program
development process.
Understand the steps in program development.
Explain the importance of the needs assessment.
Locate appropriate resources to implement program
development activities.
Develop a networking system for support when carrying
out program planning activities.
Develop mission, goals and objectives statements.
Organize materials for program development.
Use the Internet to locate needed resources and
appropriate funding sources.
Understand how to conduct a needs assessment.
Identify factors associated with good leadership.
Establish linkages and collaborations with other
community change agents.
Implement sound program design principles.
Understand the principles of process evaluation.
Understand the importance of identifying.
Able to write a SMART goal.
Able to develop a sound budget.
Use sound management strategies in developing a staffing
plan.
Able to write a capability statement.
Can construct intervention timelines.
14
Program
Development
INTERVENTION
A collection of
15
NEEDS ASSESSMENT V. The Planning Process
An appraisal to
deter- mine what
programs and
services your com- The planning process provides the foundation for sound decision-making
munity needs. It in setting program priorities and using resources. By necessity it involves
pro- vides planners gathering, analyzing and interpreting data; identifying community needs,
with the information concerns and assets; and com- municating the results. Program planning
required to prioritize is an ongoing, comprehensive process that is intended to improve
goals according to effectiveness. Prioritizing needs is a critical part of program planning.
those identified Members of planning groups are expected to follow a logical method to
determine their highest priority. Planning should reflect an open, candid
and partici- patory process that is inclusive of differences in cultural and
ethnic background,
perspective, and experiences. Planning produces priorities that are responsive
to commu- nity-validated needs. Initiatives developed with input from affected
communities are likely to be successful in garnering the necessary public
support for effective implementation.
Questions to Be
Addressed During the
Planning
Planning
Process
Planning
Steps Issues
Conduct Needs What HIV/AIDS problems does the
Assessment community need to address?
Planning Planning
Steps Issues
Implementation, What relationship do you need to establish
Linkages with other social service agencies,
and Collaborations community organiza- tions and faith-based
organizations? Does this program fit with
others? What procedures will
QUESTIONNAIRE
VI. Program Development: A list of
The Seven-Step Model questions to be
asked.
MISSION STATEMENT
Products: Worksheets: Write your Mission Statement; Write your Goal Statement
17
Step 3: Identify Funding Sources
Tasks: Determine how much money is needed and develop a list of funding sources.
Team Roaster
Key Players Responsible: Program planner; program planning team and staff
Purpose:
This unit explains the purpose of conducting a needs
assessment and explains how program assessment can be
useful in documenting pro- grams and their effects,
determining gaps and unmet needs and im- proving the
service delivery in your community. A needs assessment
helps determine what programs and services your community
needs. It also provides planners with information needed for
prioritizing goals according to the identified needs.
Learning Objectives:
By the end of this unit, learners will be able to:
A needs assessment determines what programs and services your community needs.
This assessment is an essential part of the planning process when designing
successful community initiatives. It also provides planners with the information
needed to prioritize goals according to identified needs. The needs assessment
determines:
Before performing a needs assessment, you must decide who will conduct
the study. A needs assessment study can be carried out by outside consultants
and volunteers. Available resources, your time frame and your comfort level with
performing research may influence your decision.
A needs assessment helps you identify the extent and type of existing
problems in the community, the services available and the unmet needs. In even
simpler terms, a needs as- sessment is a process to determine the need, which
can be defined as the gap between the problem and the efforts, resources and
programs that exist to deal with the need.
You must also decide what you hope to learn about your community and
what kind of information you plan to collect. For example, do you hope to
perform a broad-based study or one that is focused on your problem? Some of
the categories of information you may be interested in collecting include:
Disadvantages:
✓ Attendees may not represent the population in need of services.
✓ Attendees’ perceptions of need may be incorrect.
✓ Can turn into a “gripe” session.
✓ Can raise expectations too high.
Social Indicators
Advantages:
✓ Vast existing data pools.
✓ Low cost.
✓ Flexible design.
✓ Foundation on which to build other needs assessments.
23
SERVICE PROVIDER Disadvantages:
SURVEY ✓ Must verify with other evidence that need really exists.
A survey of those ✓ Data are only indirect measures of need.
who actually ✓ Personal or class bias of researchers can be introduced.
✓ Few indicator series have been developed; therefore,
provide serv- ices
specialized staff skills are required to create them.
to a population in
your community.
Service Provider Surveys
KEY INFORMANT
SURVEY Research is directed at those who actually provide services to a
A research population in your community (administrative program staff at
activity that seeks other agencies).
information from
Advantages:
those who are not
participants in ✓ Provides information on problems or service needs which
the service may not be widely recognized.
delivery system but ✓ Validates information on existing community resources.
✓ Helps develop an overview of existing problems.
who repre- sent and
✓ Simple and inexpensive.
speak for various
constituencies in the Disadvantages:
community, such as
✓ Problems identified may reflect cultural or class biases of
clergymen, elected
providers rather than real problems.
officials, advisory
✓ Data may reflect needs only of those already being served.
✓ Needs identified may reflect vested interests of providers.
This research activity collects information from those who are not
partici- pants in the service delivery system but who represent and
speak for various constituencies in the community, such as
clergymen, elected officials, advi- sory group members and
commissioners.
Advantages:
✓ Provides for simple and inexpensive input of many
well-placed individuals.
✓ Identifies problems that can become public issues and
receive widespread exposure.
✓ Indicates programs likely to be supported — or
opposed — by community leaders.
✓ Highlights issues of importance to vocal and active
segment of community.
24
Program
Development
Disadvantages: SURVEY
✓ Identification of problems may stem from political or Research technique
personal sensitivity. based on a
✓ May exclude some leaders who should have been included. collection of data
✓ May exclude parts of community having no access to a leader. from a sample or
the entire popula-
Surveys tion of a
community. This
Based on a collection of data from a sample or the entire population of approach is de-
a community, this approach is designed to elicit information from signed to obtain
respon- dents about their needs. infor- mation from
respondents about
Advantages:
✓ Most scientifically valid and reliable approach.
✓ Most direct way to learn the information on needs of individuals.
✓ Expands way to obtain information found through other techniques.
✓ Flexible costs and timeframe, depending on whether
general or target population is surveyed.
Disadvantages:
✓ Most expensive approach.
✓ Individuals chosen may be reluctant to respond.
✓ Requires extreme care in selecting a sample.
✓ Requires specialized research skills.
✓ Can require greatest amount of time.
✓ Choice of methods (person-to-person, mail, telephone)
must be clear and applicable to your community.
25
III. Suggestions for Developing
a Questionnaire
26
Program
Development
Once you have collected information on the extent of the problem, its
impact on the community and existing programs and services, planners must
decide which problems need the most attention.
In your own words, list some questions you might include in your questionnaire:
27
How to Design a
Questionnaire that Is Easy to
Administer and Answer
✓ Include on the first page: identification number; interviewer identity;
interviewee address, name and telephone number (for making
appointment); introduction; list for contact and outcome; and
respondent selection key.
✓ Print questions on one side of paper only.
✓ Make the introduction short, non-threatening and simple.
✓ Ask warm-up questions first. These are the ones that are the least
sensitive or most interesting to respondent. For example, length of
time at current residence or respondent’s opinion about community
problems.
✓ Ask demographic questions last. Don’t ask them if you don’t need the information.
✓ List the questions in a logical sequence.
✓ Use transitions such as “Now, here’s a different kind of question…” or
“Turning to another subject…” They dispel boredom and allow you to
change subjects easily.
✓ Use “Now, here are a few final questions,” to indicate the end is in sight.
✓ Do not crowd the questionnaire page with too many questions.
✓ Keep format consistent throughout the questionnaire.
✓ Ask only as many questions as you need. (Twenty questions will take
no longer than 10 minutes to answer. A well-spaced 10-page
questionnaire takes 30 minutes to answer.)
✓ Use white paper for the body of the questionnaire.
✓ Use colored pages to mark the beginning of different sections for the
interviewer, who might have to skip a whole section if it’s not
applicable to the respondent.
✓ Use symbols to guide the interviewer through the questionnaire (an
ellipsis indi- cates a pause, an asterisk indicates the answer leads to
another question, arrows indicate direction, vertical lines separate or
group items together).
✓ Write instructions for interviewer in capital letters; box them or put
them in parentheses.
✓ Leave room in the left-hand margin for coded column and response numbers.
✓ Provide several lines to answer open-ended questions.
✓ Line up responses vertically. This makes it easier to respond and input.
✓ Use horizontal listing of responses when several questions have
identical re- sponse categories.
✓ Use small dots (…) to guide the eye across the page toward the space for answers.
✓ End the questionnaire with “Thank you.”
Source: Public Management Institute, 358 Brannan Street, San Francisco CA 94107,
(415) 896-1900.
28
Program
Development
Notes:
Source: Public Management Institute, 358 Brannan Street, San Francisco, CA 94107,
(415) 896-1900.
29
UNIT 3:
Developing Mission,
Goals and Objectives
Purpose:
This unit explains the purpose of conducting a needs
assessment and how program assessments can be useful in
documenting programs and their effects, determining gaps
and unmet needs, and improving the service delivery in your
community. A needs assessment helps you determine what
programs and services your community needs.
It also provides planners with information needed for prioritizing
goals according to the needs identified.
Learning Objectives:
By the end of this unit, learners will be able to:
A fter completing a needs assessment, you will have the information you needand tax-exempt
to develop reasonable goals. You should establish goals that accurately
reflect po-
organi- zations;
501(c)(3) organ-
tential solutions to the problems found during the needs assessment. After izations are further
success- fully completing the needs assessment, you should be ready to defined as public
define the underlying assumptions and expectations on which the program chari- ties, private
depends for its success. You should be able to answer the questions of operating
“how” and “why” the program’s concept will bring about the intended foundations and
results. Once stakeholders have agreed on the basic premise of the
program, they should develop a formal mission statement. The pro- gram
mission is the fundamental guide for all future program-development
decisions.
The mission statement must be written so that it reflects the ideals of the
people working in and for your organization. Everyone should feel ownership
in, value and be committed to the mission of the organization.
The mission statement should be brief, clear and concise. It should state the
organiza- tion’s name, that it is a nonprofit, the type of organization, what it does, for
whom and where.
Purpose
Business
33
Values
This statement communicates what your group members hold in common and
are attempt- ing to implement. It is the basic shared belief of an organization.
Beneficiaries
This part of the mission statement identifies who will receive the services and
who will benefit from the implementation of those services.
Purpose:
Business:
Guiding Principles:
Beneficiaries:
34
Program
Development
Establishing realistic goals that describe how a program will affect its target
population is essential to solving the identified problem. You must develop
specific strategies to achieve those goals based on evidence about methods that
have demonstrated success with the program’s target population.
Next, state your program’s ultimate objectives in measurable terms. This sets
the stage for analyzing program results later on. The project goal statement
should be the driving force behind the project. It should be the cornerstone
against which everything done on the project is measured. A good project goal
statement is SMART:
✓ Specific
✓ Measurable
✓ Achievable
✓ Realistic
✓ Time-framed
✓ Specific: A specific goal is usually better than a general goal. The specific
goal should be as precise and detailed as possible, stating exactly what the
project aims to achieve. It should be phrased using action words such as
“plan,” “construct” and “execute.”
A specific goal should answer the questions who, what, where, when, which and why.
As an example, a general goal would state, “Get your education.” A specific
goal would state, “Get accepted and enroll in a four-year university and take
at least twelve hours of classes per semester.”
✓ Measurable: If you cannot measure it, you cannot control it. In other
words, a goal must be quantifiable. The goal statement is a yardstick for
the project; if the goal is
completed, the project is a success. Measuring progress keeps you focused
on the goal. A good way to measure your goal is to ask questions such as
“How much?” and “How many?” and “How will I know when my goal is
accomplished?” There are usually several temporary or small measurements
that can be built into your goal. Since words such as “improve,” “increase”
and “reduce” can be misinterpreted; whenever you include them, be sure to
incorporate the ways in which they will be measured. For example, you may
want to state the number of persons targeted for services. It is also important
to avoid jargon because this also is easily misinterpreted. When your progress
is measured properly, it becomes easier to stay on track and meet target
dates.
✓ Realistic: A goal must correspond to a task that you have the motivation
and capa- bility to complete. A goal must be doable. Do not plan to do
something if you cannot follow through. In addition, make sure you set your
goals high. The higher the goal, the greater the motivation, and the greater
the motivation, the higher your chances of completion. But, make sure the
skills required to perform the work are obtainable. A good way to determine
workable goals is to look back on past projects and see whether they were
possible, or so farfetched that they would never have worked.
✓ Time-framed: A goal must have a beginning and an end. Very little is ever
accomplished without a deadline, and one of the easier parts of setting a goal
is establishing the dead- line. This is particularly true of work that is piled on
top of everything else you do on a daily basis. Building the delivery deadline
into the project goal keeps it in front of the team and lets members of the
organization know when they can expect to see results.
Frame
36
Program
Development
37
classified as long-term objectives. Compare each six-month and 12-month
objective against the following checklist:
38
UNIT 4:
Identifying Funding Sources
Purpose:
This unit offers effective strategies for identifying funding
sources to support programmatic mission, goals and
objectives. The success of your program may very well depend
on the ability to obtain resources. You may not be able to
obtain all the resources you need through voluntary
contribution or networking, so some resources will have to be
purchased. It is important early on to identify sources from
which you will be able to get the money needed to successfully
implement your program.
Learning Objectives:
By the end of this unit, learners will be able to:
41
can also help you identify non-monetary resources such as speakers, support
groups and sources of referrals for your program.
You should also develop relationships with funding agencies. There are a number
of methods that can be used to develop relationships. When attempting to raise
money through grant proposals, it is very important to build peer-to-peer
relationships. You should attempt to build a relationship with the decision-maker,
although the funder representative
may have considerably more power. Most decision-makers want to be
treated as a peer. Each decision-maker is unique, with his or her own
GRANT
standards, priorities, interests and degrees of power in the grant-making
A financial decision. Your task is to determine who in the organization has decision-
assistance award making authority and how,
made to an in a non-obstructive fashion, you can obtain that person’s support.
organization in
the name of a Initiating the first contact can sometimes be difficult and perhaps a little awkward.
principal You should attempt to present your organization in its best light. This
investigator to means proof- reading your letters and proposals, spelling names correctly,
assist the tracking who works at what foundation and so forth. However, remember
organization in no program is perfect; you should be honest and list the areas that need
conducting improvement as well as your strengths. When acknowledging weaknesses,
research or other mention your strategies for overcoming them and your plans for
programs as improvement. Professionalism means treating everyone with courtesy, re-
specified in an gardless of job title or status.
approved
proposal. Below are some ways to develop and improve relationships with funding agencies:
A grant — as
✓ Write letters to donors.
opposed to a ✓ Attend workshops and other training opportunities that donors sponsor.
cooperative agree- ✓ Communicate with donors over the phone or by e-mail to discuss
ment — is used some of your major needs.
when- ever the ✓ Attend conferences at which donor representatives are scheduled to speak.
awarding office ✓ Send notes, questions or suggestions to the sponsors.
✓ Order specialized publications about the sponsors.
✓ Get sponsors’ e-mail addresses and send them notes containing
information in which they might be interested.
✓ When possible, obtain donor travel schedules to determine availability of
representa- tives to speak to your organization.
✓ Ask the representatives to serve as project advisors or member of your board.
✓ Acquire samples of the most successful programs they have funded.
✓ Ask them to review a proposal you are considering submitting for funding.
✓ Ask them to provide technical training for your organization.
✓ Send them a copy of any of your organization’s noted accomplishments
or special publicity.
✓ Have your name or agency added to their mailing lists.
✓ Ask them to share with you the most common reasons they reject requests for support.
✓ Ask them what they look for in a good program (how they measure success).
✓ Ask them to mentor you or refer you to someone who will be able to
support your organization’s growth and development.
✓ Ask them to review your needs assessments and determine if the
identified needs fit in their philanthropic mission.
42
Program
Development
If you are unable to acquire all of the needed resources to operate your program
from local sources, you may need to obtain additional funding from foundation
and government grants. Many foundations are interested in assisting
community-based organizations in de- veloping and expanding their programs to
meet local needs. But obtaining funding from these resources can be very
competitive.
Project Title
Project Description
Audience Targeted by Project
Notes
Source: Public Management Institute, 358 Brannan Street, San Francisco CA 94107,
(415) 896-1900.
43
Sample Webbing Form
Instructions: Answer these questions as completely as you can. The
information you provide is confidential and will be used only to help us
expand our fundraising base. Return this form to
by . Thank you for your help.
2. Would you be willing to speak with any of the names listed above on
our behalf? If yes, please identify which one(s).
5. Of what social, fraternal, athletic, civic or other clubs are you a member?
Source: 1980 Public Management Institute, 358 Brannan Street, San Francisco CA 94107,
(415) 896-1900
44
Program
Development
47
UNIT 5:
Assigning Leadership Tasks
Purpose:
This unit explains the importance of assigning competent
people to handle key leadership tasks. Effective community
program leadership requires continuous attention to a
number of complex issues, but the essential ingredient for
strong leadership is having the skills to help the group
progress toward meeting its goals.
Learning Objectives:
By the end of this unit, learners will be able to:
There are many leadership styles. A good leader will choose the leadership
style that is closely related to him/her. The first leadership style is democratic.
Under a democratic leadership, group members use their own knowledge and
experience to reach a decision. The challenges and answers are discussed and
managed by the members of the group, and the entire group must be
committed and agree to the action. The entire team must become involved.
The third leadership style is convincing. Under this style, the leader must
be able to convince team members that they are able to accomplish their goal.
The leader has to be able to explain the advantages and disadvantages of his or
her orders. This style allows the leader to convince group members and gain
their support. He or she is required to give an order, convince the team as to
why the order was good and be able to eliminate any doubts that may arise.
The fourth leadership style is command. Under this style, the leader tells the
group what to do or accomplish. He or she has to ensure that the problem is
understood and is immediately taken care of. The main role of the leader in this
style is to advise or direct. The group member’s role is to understand what is
expected and do as he or she is told. This leadership style requires no feedback
and is not concerned with the opinion of the group it is a style frequently seen in
the military. The goal of the leader is to give an order and make sure it is
executed.
51
The essential ingredient for leadership is possessing the skills to help the
group progress toward meeting its goals. Leaders must continuously inspire,
guide and reward their team. On any given day, program leaders must call
upon many skills to handle the wide variety of situations that invariably arise.
Adding to the challenge, as an organization evolves and grows it requires
different capabilities from its leaders.
1. D. Fessler, Facilitating Community Change: A Basic Guide, La Jolla, CA: University Associates, 1976.
52
Program
Development
Leadership Styles
Name the four leadership
styles. 1.
2.
3.
4.
Which of these leadership styles will work most effectively in your organization? Why?
Every perspective is valuable, but involving too many people can make it
difficult to focus on a single program, solution or agenda. Choose your team
carefully. Try to achieve a diver- sity of voices, all working towards the same
goal: helping your target population. In an ideal situation, you would be able to
include:
55
✓ Program Planners: Members of your staff and volunteers who help
PROGRAM PLANNERS develop programs are the core of every program-planning team.
Members of your Include people who have used a variety of intervention styles to solve
staff and problems. Additionally, find people who have program planning
volunteers who experience in other fields for this target community, or who have
help to develop experience planning in this field for other communities.
programs. ✓ Members of the Target Population: This is mandatory! One of the
most impor- tant group of voices, the people who will be receiving
SERVICE PROVIDERS services must always be included in the development of any program.
And do not forget to include
People who are
HIV-positive people in your group. As members of the target
responsible for
population who have sero-converted, they can offer a valuable
administering
perspective on your approaches and priorities — on what works and
services in your
doesn’t. Also, remember that some of our work includes preventing
re-infection, as well as working with people who may be positive but
who have not yet been tested.
✓ Researchers: Anyone who has conducted research on members of your pop-
ulation can help assemble people for interviews and focus groups,
which is particularly helpful if you have limited funding. In addition,
researchers can assist in developing evaluation tools and interpreting the
information you gather. Valuable research comes not only from people
who have worked directly on HIV issues, but also from psychological,
behavioral and marketing perspectives.
✓ Service Providers: People who do not plan programs but who are responsible for
administering services, such as teachers, ministers, medical professionals
and mental health care workers, can provide valuable insight on your target
population. They have practical experience on overcoming barriers and
solving problems related to your community.
✓ Which high-risk segment of the target audience will be specifically targeted and how?
✓ Changing which behavior of the target audience will directly reduce its
risk of HIV transmission?
✓ What are the key factors affecting the behavior you wish to change?
✓ How will you influence these factors?
56
Program
Development
Program-Planning Team
Who Tools They Will Bring to the Team Name
Program Knowledge of the target audience.
planners
Experience in community
programming. Knowledge of program
design in other communities and/or
about other relevant issues in the
target community.
Members of Own perspective. Personal insight into
the target target audience. Insight into potential
population response to programs.
Researchers Research-backed insight into
target audience. Experience
developing evaluation tools.
Service Hands-on experience providing
provider other services to target community.
s Insight into community needs.
In certain situations, one person plays all the roles listed in the chart above.
In that case, it is critical to seek feedback from others and ask any questions
needed to obtain a
57
full assessment of the problem. You may be surprised at the different
assumptions that un- derlie a person’s response based on background and area
of expertise. All these assump- tions are valuable and worth bringing to the
surface.
The chart below will help you identify where to go for the needed planning
perspec- tives, based on some “typical” patterns for agency growth and staffing
in most minority HIV/AIDS service organizations.
Purpose:
This unit details the characteristics of an effective program
design. Program design includes development of major
programmatic efforts, activities and services to be
implemented, and a work plan of the project-specific
objectives and key action steps.
Learning Objectives:
By the end of this unit, learners will be able to:
In designing projects, use the following checklist to make sure your program:
61
✓ Suits the participation and learning style of the target clientele.
✓ Reflects logical, sequential connections between events, each one building on another.
✓ Includes dates, time schedules and deadlines.
✓ Identifies the various responsibilities of staff members.
✓ Commits necessary resources and supports cooperation.
✓ Connects to other major programs and takes advantage of existing
OUTCOME OBJECTIVES planned events.
An important ✓ Includes plans for marketing and promoting the program.
program ✓ Provides opportunities for continual feedback as well as for
development compo- evaluation at key points.
✓ Is cost-effective.
nent where you
deter- mine 1) the
behavior changes
targeted by the
intervention, 2) the
number of
individuals with
behavior change in II. Program Design Planning
the desired direction,
3) how you will
measure this change,
4) the time- lines for An Intervention Description Worksheet (see below) serves as a guide for
the behavioral program im- plementation and as a needed source document for a grant
writer. In the sections that follow, you will design your intervention plan.
This plan provides a description of your
proposed intervention, a mechanism to tie process and outcome objectives to
your program design, intervention activities timelines, identification of needed
collaborations or partner- ships, the plan for collaboration, the evaluation plan,
staffing and training plan, and the pro- posed budget. These tools provide the
foundation for the essential components of your proposed program.
62
Program
Development
Process Objective
✓ How many times will this intervention occur in one grant year?
✓ When will you begin offering this intervention?
✓ When will you complete this intervention?
✓ How many members of your target audience do you intend to
have attend each intervention?
✓ How many participants in total do you intend to have
participate in your intervention in one year?
✓ Who will be responsible for achieving this objective? (Give their
name and job title.)
✓ How will you document participation in this intervention?
Outcome Objective
63
III. Intervention Activities Timeline
Intervention When?
Activity Person Responsible Q1 Q2 Q3 Q4
1)
2)
3)
4)
5)
6)
7)
8)
9)
10)
64
Program
Development
You may decide that your program can have greater impact by joining with other
groups or organizations having similar missions, goals and objectives. It is
important to understand the nature and extent of possible collaborations among
service providers. Collaborating/coordi- nating partners should first complete the
Agency Capability Assessment Questionnaire. This information should be
provided to your grant writer to the grant writer. You will also need to draw up a
Memorandum of Understanding (agreement of the actual grant application) be-
fore you begin the collaboration.
65
V. Evaluation Plan
Complete one worksheet for each process objective and one worksheet for
each outcome objective.
Process Objective:
Question
(What question will your evaluation seek to answer?)
Data
(What kinds of data will be collected?)
Source
(At what points will data be collected?)
Collection Method
(What methods or instruments will be used to collect data?)
Baseline
(What comparison group or baseline will be used, if any?)
Success
(What result constitutes a successful outcome?)
Evaluator
(Who will conduct the evaluation?)
Use
(How will the evaluation data and results be used?)
Audience
(How will the results be reported and to whom?)
66
Program
Development
Many people are hired because of their knowledge and/or relationship with
particular communities. While this works in many cases, there are times when it
is more important to hire people because of their skills, even if they have no
prior experience with the target community. It is important to identify this kind of
priority early because it will help you make decisions later about where to
advertise a job, how to list job requirements and how to de- scribe the job to
potential applicants. You should also try to anticipate potential disagree- ment
from the community you serve over hiring choices, especially when you select
applicants from outside your target audience.
You can also use information about skills and experience in the program
planning process to anticipate training needs, based on candidates’ experience
(or lack thereof). Training will probably cost money and certainly take some
time. You should factor this into your program’s timeline and budget.
VII. Budget
When you create an intervention activities plan and develop program objectives,
you gener- ate many numbers, such as the amount of time needed for a
workshop, the number of peo- ple you need to hire, how many people you expect
to reach, etc. Ask someone in the finance department to calculate the costs of
each of these steps and requirements as a basis for creating a budget.
Your accountant and program planner should talk through the budget for
every pro- posed program. The budget document will be used in grant
applications. It’s also a good idea to create a couple of different program
scenarios at different levels of funding, so you’ll be prepared if you don’t get all
the funding you apply for. You’ll also have more options if you have to apply to
several smaller funding sources to amass enough to create your pro- gram. Don’t
wait until after you’ve completed the plan and sold everyone on it to discover
there’s no way that you can reasonably do it or it doesn’t fit the grant proposal.
There may be items in your plan where you made assumptions that an
accountant can’t account for or doesn’t agree with. For example, if you say that a
staff member will handle a particular activity, are you assuming that you will hire
someone who is already trained to do that, or have you included time and money
in your plan for training? When you indicated you will conduct a workshop, did
you think about where the workshop would take place and whether you need to
include space rental costs in your budget? Did you calculate the amount of time
it would take someone to supervise staff? To complete a report? To meet with
collaborators? To develop a brochure?
68
Program
Development
In determining your budget, you will have to take into consideration the
costs of pro- gram staff, consultant, intervention operations and program
capital costs. The worksheets below provide simple and easy-to-follow tables to
help you determine cost allocations for projected expenses.
✓ Personnel costs
✓ Intervention operating costs
✓ Program capital costs
✓ Site and facilities costs
Personnel Costs
Full-Time
Title Equivalent (FTE) Salary Dates
1.
2.
3.
Shared
4. Program Director
5. Administrative Assistant
Consultants
List all consultants needed to implement your program
Number of
Title Hours/Days Rate Dates
1.
2.
3.
69
FTE Calculation
To verify that your estimated FTEs are sufficient to the program, use this
table to compare available hours needed.
Hours: Activity 1 +
Hours: Activity 2 +
Hours: Activity 3 +
Hours: Activity 4 +
Hours: Training +
1.
2.
3.
4.
5.
6.
7.
8.
9.
10.
71
Program Capital Costs
Equipment Costs
List all new equipment needed to implement your program (e.g., computers)
Purpose/For
Item What Cost Number
Interventions?
1.
2.
3.
4.
5.
6.
7.
8.
9.
10.
72
UNIT 7:
Program Implementation
Purpose:
This unit explains the procedures for carrying out program
tasks. Planning must include the development of procedures
that ensure the success of your activities when the
unexpected occurs. Key factors to be considered in program
implementation include the role
of the media, recruiting volunteers, implementing sound
management practices, supervising staff and volunteers,
establishing accountability mechanisms, and developing
collaborations.
Learning Objectives:
By the end of this unit, learners will be able to:
F or the program implementation, you must develop procedures for carrying out
tasks. By now, you should have determined the goals, objectives and activities
that your organiza-
tion will be implementing. You also should have identified and acquired the
necessary re- sources and your leadership structure should be in place. While it is
impossible to ensure that nothing will go wrong, you should have a reasonable
amount of assurance that every- thing will operate well. However, you should be
prepared for unforeseen flaws and for flukes to occur. Therefore, planning must
also include the development of procedures that ensure the success of your
activities when the unexpected occurs. Once you have secured commu- nity and
financial support, delegate tasks to ensure the program’s successful initiation
and establish a viable structure for its continued operation.
The following elements will help ensure the success of your program activities.
Developing relationships with the media is labor intensive. Below are some
ways to enhance your effectiveness in working with the media.
75
✓ Track media results; report successes and plans for improvement.
✓ Recognize the contributions of the media by sending letters, notes and e-mails.
✓ Be polite. Establish a rapport by talking with reporters on a first-name
basis. Keep in touch if possible.
✓ Be informative and accurate. Always strive to be truthful. Do not be
afraid to say, “I don’t know,” or “I will get back to you later with the
information.” If you make a mistake, correct it as soon as possible. Do
not blow up over minor typographical errors; however, significant errors
should be called to the attention of editors or reporters in a courteous
telephone call, meeting or letter.
✓ Be consistent. If you use a statistic once, do not contradict it later.
✓ Use every opportunity to make a positive point and tell reporters about
your organ- ization’s achievements.
✓ Keep to your message. Reporters are almost always on a tight deadline
and allocate only a few moments to listen to information about your
program. So it is important that your responses are definitive and positive.
Use secondary points or qualifications for the remainder of your answer.
✓ Be responsive. Print and broadcast deadlines must be met. Not meeting
media deadlines means not being included in a story and missing an
opportunity to present the mission of your organization to more people.
From your needs assessment, you have already determined the types of
programs required to accomplish your goals. To determine the number of
volunteers needed, you should list your program activities and identify the
number of people needed to carry out each task. Create a recruitment plan and
develop a written volunteer job description.
76
Program
Development
Emphasize Accountability
Accountability is a very important element — and this includes financial
accountability. You should have in place a mechanism to plan for
troubleshooting and for resolving crises and disputes.
Foster Collaboration
There is real value in developing partnerships with local and state providers
of services and communities. Successful programs take on the daunting task
of communicating, collaborating and cooperating with other providers in the
community. This task requires cultural sensitivity, competency, respect and
much time. Productive collaborations can
77
lend strength to your program, which can sometimes mean the difference
between success and failure. Successful collaborations:
Source: Public Management Institute, 358 Brannan Street, San Francisco, CA 94107, (415) 896-1900.
78
UNIT 8:
Evaluation
Purpose:
This unit explains how to evaluate and assess programs.
Evaluation is designed to verify, document and quantify
activities and their efforts. This unit offers a four-step
approach to evaluation that includes identifying goals and
desired outcomes and conducting process assessment,
outcome evaluation and impact assessments.
Learning Objectives:
By the end of this unit, learners will be able to:
✓ Verify. Often “common sense” turns out to be wrong. There are many
cases where what initially seems to make a lot of sense may not in fact be
the case when you get it down in black and white.
✓ Document. Whether it is to funding agencies, other practitioners in the area
or lay audi- ences, documentation provides evidence of accomplishments and
results.
✓ Quantify. While you may have some general knowledge of what is going
on, it is important to use numbers for support if you’re trying to show that
there is a problem.
For example, you may know there is a problem with AIDS/HIV in the
community but not know exactly how many people are infected with the
DATA CODING
virus. Surveying commu- nity residents using a sexual-behavior
questionnaire would provide the information you need to verify, document Collating
and quantify community sexual behavior. information,
ensuring that it is
Evaluation is labor-intensive. It is critical that you create a step-by-step accurate and trans-
work plan for conducting the evaluation. At a minimum, an evaluation of a lating collected
community program will require that the following functions be performed: data for analysis.
81
I. Conducting Evaluations
Evaluations serve many purposes. The most common reasons for program
evaluation include:
✓ Whom are you trying to reach (e.g., teachers, minorities, parents, general public)?
✓ What outcomes are desired?
✓ What do you hope to accomplish?
82
Program
Development
Activities. There are also important questions that need to be asked about
the activi- ties, such as:
The more clearly these questions are answered, the more useful the process
assessment will be. Information or data should be collected to answer the
following questions:
Often, the “bottom line” of program assessment is what the effects of a program were.
There are two types of assessment related to effects. Outcome assessment
looks at the short-term effects. Impact assessment looks at the long-term
or ultimate effects. Out- come assessment is concerned with measuring the
OUTCOME
immediate effects of a program on the recipients of service. It attempts to
ASSESSMENT
determine the direct effects of the program, such as the degree to which
Analysis used to the program increased knowledge about HIV/AIDS.
deter- mine the
effects of a program; You should ask, “What identifying evidence is involved regarding the
primarily con- cerned extent to which the outcomes were achieved?” Evidence includes changes
with the effects of a in the number of re- ferrals, an increase in the number of students attending
program on the an activity, and increased pub- licity about the dangers of HIV/AIDS and
recipients of service. other sexually transmitted diseases.
Outcome measures should be closely linked to objectives.
ARCHIVAL DATA
There are several potential sources of information you can use for an
Data that have
outcome as- sessment:
been collected, such
as med- ical records, ✓ Questionnaire. Questionnaires are commonly used to measure
school grades and outcomes, but the questions used must be chosen with care. For
school at- tendance standardized instruments, the reliability coefficient is an index of stability
and consistency. A reliability coefficient
can range from 0 to 1.0. The higher the value of the reliability coefficient,
the more stable the measure. Generally, a reliability coefficient between
0.6 and 0.9 is con-
sidered good. If a commonly used measure is available for an objective that
you want to measure and it has acceptable reliability and validity, then it is
usually better to use that measure than to make up one of your own. Other
sources of data for outcome assess- ment include archival data and ratings by
others.
✓ Archival data. Archival data is information that has been collected, such as medical
records, school grades and school attendance records.
✓ Ratings by others. For certain purposes, it may be useful to obtain
information about a participant from other sources, such as ratings of a child
by a parent or ratings of stu- dents by teachers. Permission from the
individual to be rated may need to be obtained.
84
Program
Development
✓ How many awareness sessions did the program offer participants last year?
✓ How many staff members did you train to implement HIV/AIDS
awareness/ prevention education?
✓ With how many other groups are we collaborating on our program?
Real
Maintaining Confidentiality
Collecting data from human subjects can be a very sensitive matter, so it is
essential that your program implement measures to ensure confidentiality for
participants. Organizations that use federal funds to collect information directly
from children must obtain parental con-
sent. Informed consent ensures that a person is aware of what information
is being collected and gives his or her permission for it to be part of the
DATA COLLECTION
data collection.
Administering
ques- tionnaires, What risk to subjects can arise when you evaluate a program? First,
conducting there is the risk that damaging information about individuals may become
interviews, known to project staff or even made known publicly. There is the risk that
observing program information that was supposed to be held in confidence may be used in
operations, or ways that hurt individuals or groups of respon- dents. There is also the risk
reviewing or that some respondents may react poorly to questioning.
entering data from
The best way to protect evaluation subjects is to ensure them
anonymity by not obtaining any identifying information during data
collection. This approach has the added benefit of decreasing the
chances that respondents will give inaccurate an-
swers. From the evaluator’s standpoint, it is better to promise confidentiality.
This means that each respondent is assigned a number that is used in data
collection.
✓ All employees involved in surveys or evaluations shall sign this assurance of confidentiality.
✓ Employees shall keep completely confidential the names of respondents, all
information or opinions collected in the course of interviews, and any
information about respon- dents learned incidentally during data collection.
Employees shall exercise reasonable caution to prevent access by others to
survey data in their possession.
✓ Survey data containing personal identifiers shall be kept in a locked container
or a locked room when not being used each working day in routine survey
activities. Reason- able caution shall be exercised in limiting access to survey
data to only those persons who are working on the specific project and who
have been instructed in the applicable confidentiality requirements for that
project.
86
Program
Development
Pledge
I hereby certify that I have carefully read and will cooperate fully with the above
procedures. I will keep completely confidential all information arising from
surveys concerning individual respondents to which I gain access. I will not
discuss, disclose, disseminate or provide ac- cess to survey data and identifiers
except as authorized. I will devote my best efforts to en- sure that there is
compliance with the required procedures by personnel whom I supervise. I
understand that violation of the privacy rights of individuals through such
unauthorized discussion, disclosure, dissemination or access may make me
subject to criminal or civil penalties. I give my personal pledge that I shall abide
by this assurance of confidentiality.
Signature:
Source: Muraskin, L. Understanding Evolution: The Way To Better Prevention Programs, 1993.
✓ Applicant Capability 30
❏ Does the Applicant credibly state
its purpose, programs, target
populations and major
accomplishments?
❏ Does there appear to be credible
community support for the
proposed program?
❏ Does the Applicant appear
well- managed and fiscally
secure?
TOTAL 200
90
Program
Development
Post-training Assessment
1. True Fals The first step in planning a needs assessment is to
e decide who will conduct the study.
2. True Fals A needs assessment identifies the extent and type of
e existing problems in your community and the services
available.
3. True Fals Outside consultants are the only ones capable of
e performing a needs assessment.
4. True Fals Collecting data on historical development helps you
e understand your community’s growth patterns and
population distribution.
5. True Fals Demographic data includes information such as age,
e character- istics, size, and race.
6. True Fals A needs assessment determines whether resources are
e adequate.
7. True Fals Dividing the responsibilities in creative ways may help in
e performing a cost-effective needs assessment.
8. True Fals One of the disadvantages in using volunteers to
e help with needs assessments is that they may
present a biased inter- pretation of what the
community needs.
9. True Fals A profile of the population you intend to serve should be
e included in the needs assessment.
10. True Fals A needs assessment is an essential part of the planning
e process when designing successful community
initiatives.
91
APPENDIX A:
Glossary
Action plan: The summary of what you and others in your organization will do
to achieve your objectives.
Archival data: Data that have been collected, such as medical records, school
grades and school attendance records.
Budget: Exhibits that provide justification for all subcontract expenses, listed by line item.
93
Goal: The final outcome of a long period of activity. Goals describe how the
program will affect the target population and should be SMART (specific,
measurable, achievable, realistic and time-framed.
Key informant survey: A research activity that seeks information from those
who are not participants in the service delivery system but who represent and
speak for various con- stituencies in the community, such as clergymen, elected
officials, advisory group members and commissioners.
Mission statement: A sentence that states the fundamental guide for all
future program- development decisions and includes: the purpose or needs
your group will address, the business of your group, your guiding values, and
who will benefit from your work.
Program planners: Members of your staff and volunteers who help to develop programs.
Request for Proposal (RFP): When the government issues a new contract or
grant pro- gram, it sends out RFPs to agencies that might be qualified to
participate. The RFP lists project specifications and application procedures.
Although an increasing number of foun- dations use RFPs in specific fields, most
still prefer to consider proposals that are initiated by applications.
95
Statement of the problem: A component of a proposal where you
document need and provide detailed information on your target community
and its unmet need.
96
APPENDIX B:
Frequently Asked Questions
97
✓ Changing which behavior of the target audience will directly reduce
their risk of HIV transmission?
✓ What are the key factors affecting the behavior we wish to change?
✓ How will we influence these factors?
11.What is a foundation?
A foundation is an entity that is established as a nonprofit corporation or
charitable trust, with the principal purpose of making grants to unrelated
organizations or institu- tions or to individuals for scientific, educational,
cultural, religious or other charitable purposes. This broad definition
encompasses two foundation types: private foundation and public
foundations. The most common distinguishing characteristic of a private
foundation is the fact that most of its funds come from one source, be it an
individual, family or corporation. A public foundation, by contrast, normally
receives its assets from multiple sources, which may include private
foundations, individuals, government agen- cies and fees for service.
Moreover, a public foundation must continue to seek money from diverse
sources in order to retain its public status.
99
12.Where can I find information about government grants?
The following is a list of publications and websites that are useful in seeking
govern- ment funding:
✓ FirstGov (www.firstgov.gov) is the first-ever government Web portal to provide
the public with easy, one-stop access to all online US federal government
resources, including government grants information.
✓ The Catalog of Federal Domestic Assistance (www.cfda.gov) is a searchable
database of information about federal assistance programs.
✓ Notices of Funding Availability appear in the Federal Register,
printed each business day by the US government, and are available
for online searching. You can search by broad subject categories or
by agency at www.ntia.doc.gov.
✓ The National Endowment for the Arts (www.nea.gov) supports
learning in all areas of the arts.
✓ The National Endowment for the Humanities
(www.neh.fed.us) supports learning in all areas of the
humanities.
✓ The U.S. Department of Agriculture Nonprofit Gateway
(www.usda.gov/ nonprofit.htm) includes links to federal websites
and information about grant programs, sorted by cabinet department
and federal agency. Visitors can also use this portal to search Notices
of Funding Availability in the Federal Register.
✓ Community of Science (COS) Funded Research Database
(www.cos.com) allows you to search grants made by the National
Institutes of Health (NIH), National Science Foundation (NSF), US
Department of Agriculture (USDA), Small Business Innovation Research
(SBIR) and the Medical Research Council (MRC) in a variety of ways.
You can search grants by key word, geography, institutional recipient,
award amount, date, agency, investigator departments and more.
Registration is required, but it is free.
100
Program
Development
101
✓ US Department of Health and Human Services Substance
Abuse and Mental Health Services Administration
(SAMHSA) www.mentalhealth.org/cmhs/HIVAIDs/about.asp
The Center for Mental Health Services HIV/AIDS Program
Free materials:
CDC National Prevention Information
Network (operators of the National AIDS
Clearinghouse) (800) 458-5231
1-301-562-1098 (international)
P.O. Box 6003
Rockville, MD 20849-6003
102
Program
Development
105
Morrisey, George L. A Guide to Strategic Thinking: Building Your Planning Foundation.
San Francisco: Jossey-Bass.
Redefining Community
Development. Shelterforce Online. January/February 1998.
www.nhi.org/online/ issues/97/ccis.html.
Statistical Abstract of the United States: 2001. The National Data Book, Washington,
D.C. 2001.
US Department of Health and Human Services. Prevention Plus II: Tools for
Creating and Sustaining Drug-Free Communities. Public Health Service
National Clearinghouse for Alcohol and Drug Information. P.O. Box 2345
Rockville, MD 20852.
Funded by the Centers for Disease Control and Prevention, grants U22/CCU318121 and
U22/CCU318525.