Webinar 3 Logic Models, Performance Measures, Budgets
Webinar 3 Logic Models, Performance Measures, Budgets
Performance Measures,
& Budgets
A D E E P E R D I V E I N T O T H R E E I M P O RTA N T S E C T I O N S O F T H E A M E R I C O R P S S TAT E A P P L I C AT I O N .
A P P L I C AT I O N T E C H N I C A L A S S I S TA N C E W E B I N A R S E R I E S
TRAINING #3
AUGUST 14TH, 2018, 2:30-3:30PM (EST)
Who should attend
2019-20 Applicants:
◦ Competitive continuation applicants
◦ Re-compete (competitive or formula) applicants
◦ New applicants applying for funding in Indiana
Others:
◦ Any organization interested in learning more about the AmeriCorps application basics
◦ Any formula applicant preparing for their Spring submission
◦ Applicants must read and understand all materials to successfully complete grant
◦ All items & updates are available on Serve Indiana website: http://www.in.gov/serveindiana/2718.htm
◦ Due dates and materials for 2019-20 applications updated late August/early September 2018
Submission Roles & Additional
Information
Submission roles:
◦ Main applicant: Serve Indiana
◦ Sub-applicant: Programs/Organizations
Review materials:
◦ Read all materials on website
◦ Review Serve Indiana AmeriCorps handbook
◦ Review Serve Indiana State Service Plan
◦ Review AmeriCorps State Terms and Conditions
Grant Application Sections:
•SF 424 (Application Info & Application Info)
•Documents: Evaluation Report, Learning Memo, Labor Union Concurrence, etc.
•Narratives:
• Executive Summary
• Program Design
• Organizational Capability
• Cost Effectiveness and Budget Adequacy
• Evaluation Plan (if applicable)
• Logic Model/theory of change
•Logic model
•Budget
•Performance Measures
Logic Model
What is a logic model?
Communicates the inputs or resources that are necessary to deliver the intervention, including but not limited to:
◦ Number of locations or sites in which members will provide services
◦ Number of AmeriCorps members that will deliver the intervention
◦ The core activities that define the intervention or program model that members will implement or deliver, including:
◦ The duration of the intervention (e.g., the total number of weeks, sessions or months of the intervention)
◦ The dosage of the intervention (e.g., the number of hours per session or sessions per week)
◦ The target population for the intervention (e.g., disconnected youth, third graders at a certain reading proficiency level)
◦ The measurable outputs that result from delivering the intervention (i.e. number of beneficiaries served, hours of service
delivered, types and number of activities conducted.) If applicable, identify which National Performance Measures will be used
as output indicators
◦ Outcomes that demonstrate changes in knowledge/skill, attitude, behavior, or condition that occur as a result of the
intervention. If applicable, identify which National Performance Measures will be used as outcome indicators.
It generates a clear and shared understanding of how a program works!
It supports program planning and improvement!
It serves as a foundation for evaluation!
Why else is a logic model important?
A logic model can serve as a framework for planning performance measurement activities.
•It can help to:
• Identify components of your program that tie to the National Performance measures
• Identify indicators and the measures of progress/performance that align with program components
•If you have two “interventions” then there should be two different logic models that begin
unique problem sections
Inputs
•AKA “resources”
• Includes the human, financial, organizational, and community resources available for carrying out
programs activities.
•Examples:
• Funding
• Program staff
• AmeriCorps members
• Volunteers
• Research
Activities
•The processes, tools, events, and actions that are used to bring about a program’s intended
changes or results.
•Examples:
• Workshops on healthy food options
• Food preparation counseling
• Referrals to food program and resources
• What will the members/staff be “doing”?
Outputs
•The direct products of a program’s activities and may include types, levels, and targets of
services to be delivered by the program
• At least one output listed should be verbatim the performance measure output!
•Examples
• # of individuals attending workshops
• # of individuals receiving services
• # of individuals receiving referrals
Short Term Outcomes
•Outcomes are the expected changes in the population served (beneficiaries) that result from a
program’s activities and fall along a continuum, ranging from short to long term results:
• Short term: Changes in knowledge, skills, and/or attitudes (increase in knowledge of healthy food
choices)
• Medium-term: Changes in behavior or action (Adoption of healthy food practices)
• Long-term: Changes in condition or status in life (food security)
Serve IN Requirements:
• Short tem/medium term are usually the outcome listed in the performance measure and should be
verbatim listed in your logic model.
• Programs should have at least one output and one outcome in their logic model and are encouraged to
keep things simple!
Outputs vs. Outcomes
How to create a logic model
•Two main approaches:
• Reverse logic (right to left): Asks “but how” questions
• Forward logic (left to right): Uses “if…then” statements
Forward logic approach
Reverse logic approach
Questions to consider when creating
logic model
Example logic model for wildlife
conservation program
Once you’ve created your logic model…
Ask yourself the following questions:
• Does your model contain an appropriate amount of detail for its intended use?
• Does it have too much detail that a lay person would not understand? Does it include all key program
components?
• Does it tie back to my performance measures directly?
• Does the logic of the model seem correct? Are there any gaps in the logic of the program?
• Is it reasonable to assume that the program can achieve the expected outcomes?
• Do program staff and external stakeholders agree that the model accurately depicts the program and its
intended results?
• Can I collect the data within a program year (especially short and mid term outcomes)?
◦ In turn, your performance measures should align within your logic model to best support that model
◦ Create your logic model first and review the performance measure instructions for the best aligned measure
◦ Choose one output and outcome
◦ Follow instructions exactly and ensure PM is listed exactly in logic model
32
What does a performance measure
entail?
Identifying a High Quality Outcome
The Outcome should:
•Be meaningful
•Be ambitious yet realistic
•Reflect the type of change (attitude, knowledge, behavior, or condition) you want to measure
34
Meaningful Outcome
Criteria for a meaningful outcome. Consider:
• Community Need/problem: Is the outcome addressing it?
• Compelling/powerful. Is the outcome central or peripheral?
• Beneficiaries. Is the target audience identified in the outcome?
• Scope of the outcome. How many will benefit?
• Magnitude of the outcome. How much change will occur for beneficiaries?
• Evidence. Is the outcome supported by evidence for the intervention?
35
Ambitious yet Realistic
Is the outcome too ambitious? Consider:
• Program timeframe
• Scope of the intervention
• Severity of the problems being addressed
• Program resources
36
Mentoring Example
NEED: Documented high rates of chronic absence from school lead to other problems, e.g. low school engagement, poor
academic performance (Social Work Practices, 2010).
INTERVENTION: Weekly individual and group mentoring to 6th grade students with attendance problems over 10 months.
Focus on promoting re-engagement with school through social development and leadership skills.
Alignment of Outputs and Outcomes
• Intervention produces output
• Output leads to the outcome
• Output and outcome measure the same intervention and beneficiaries
Interventi
Output Outcome
on
100 75
38
Examples of Aligned Output-Outcome
National Performance Measures
40
Summary of Key Points
• Quality outcomes should:
• Be meaningful
• Be ambitious yet realistic
• Match the type of change you want to see (attitude, knowledge/skills, behavior,
condition)
• Strong performance measures are aligned
• Output comes from the intervention
• Outcome is likely to result from output
• Output and outcome measure the same intervention and beneficiaries
• Serve IN strongly encourages 1 output/1 outcome (1 National Performance Measure)
41
Serve Indiana Specific Reminders:
After your first draft, make sure the following questions are answered:
•Does it align with your narrative/theory of change?
•Are interventions repeated in multiple PM?
•Is the dosage (frequency, intensity, duration of intervention) described and is sufficient to achieve
outcomes?
•Are you giving as much detail as possible to show your data will be collected in an accurate
manner?
•Does the resource allocation align with your number of MSYs?
•Do your national performance measures align with expected outputs and outcomes?
•Are your data method/collections appropriate?
Resources
• CNCS Priorities and Performance Measures: https://www.nationalserviceresources.org/npm/home
• Program Specific Notices of Funding Opportunities and Application Instructions: http://
www.nationalservice.gov/for_organizations/funding/nofa.asp
43
Budget
Project and Award Period
Two start dates: August 1st, 2019; September 1st, 2019
◦ End dates: July 31st, 2020; August 31st, 2020
New Programs:
◦ May only choose September 1st start date
◦ Encouraged to begin members on or after September 15th
Additional information:
◦ Members cannot begin before start date
◦ Awarded programs can expend funds on or after start date but cannot request reimbursement until
have an executed state contract and purchaser order number
Budgets Overview
Fixed Grants submit basic budget covering member costs and source of funds
Covered by CNCS:
◦ Loan forbearance and interest accrual
◦ Education Award
◦ Child Care Assistance
•Include the amount of funds to purchase consumable supplies and materials, including member service
gear and equipment that does not fit the definition above.
•You must individually list any single item costing $1,000 or more.
•Except for safety equipment, grantees may only charge the cost of member service gear to the federal
share if it includes the AmeriCorps logo.
• All safety gear may be charged to the federal share, regardless of whether it includes the AmeriCorps
logo.
• All other service gear must be purchased with non-CNCS funds.
Contractual and Consultant Services
•Include costs for consultants related to the project’s operations, except training or evaluation
consultants, who will be listed in Sections G. and H.
•There is not a maximum daily rate.
Staff Training
•Include the costs associated with training staff on project requirements and training to enhance
the skills staff need for effective project implementation
• i.e., project or financial management, team building, etc.
•If using a consultant(s) for training, indicate the estimated daily rate.
•There is not a maximum daily rate.
•Applicants should consult the Serve Indiana handbook and AmeriCorps State terms and
conditions for requirements around site supervisor trainings.
•All costs for training service sites should be included in this line item.
Member Training
•Include the costs associated with member training to support them in carrying out their service
activities.
•You may also use this section to request funds to support training in Life after AmeriCorps.
•If using a consultant(s) for training, indicate the estimated daily rate.
• There is not a maximum daily rate.
•Programs should review the Serve Indiana handbook for all required member trainings the
programs must offer to members and incorporate those costs into their budget.
•All costs for training members should be included in this line item.
Evaluation
•Include costs for project evaluation activities, including additional staff time or subcontracts, use
of evaluation consultants, purchase of instrumentation, and other costs specifically for this
activity not budgeted in Section A Personnel Expenses.
•This cost does not include the daily/weekly gathering of data to assess progress toward meeting
performance measures, but is a larger assessment of the impact your project is having on the
community, as well as an assessment of the overall systems and project design.
•Indicate daily rates of consultants, where applicable.
•Serve Indiana will ask clarification questions if this section is left blank by an applicant.
Other Program Operating Costs
Allowable costs in this budget category should include when applicable:
•Criminal history background checks for all members and for all employees or other individuals who
receive a salary, education award, living allowance, or stipend or similar payment from the grant
(federal or non-federal share).
•Office space rental for projects operating without an approved indirect cost rate agreement that covers
office space. If space is budgeted and it is shared with other projects or activities, the costs must be
equitably pro-rated and allocated between the activities or projects.
•Utilities, telephone, internet, postage, copying, and similar expenses that are specifically used for
AmeriCorps members and AmeriCorps project staff, and are not part of the organization’s indirect cost
allocation pool. If such expenses are budgeted and shared with other projects or activities, the costs must
be equitably pro-rated and allocated between the activities or projects.
•Recognition costs for members. List each item and provide a justification in the budget narrative. Gifts
and/or food in an entertainment/event setting are not allowable costs.
Continued…
Serve Indiana Suggestion:
•Indiana AmeriCorps Directors Association (IADA) costs: Programs are highly encouraged to
include a $100 flat fee in this budget line item for IADA support including Camp AmeriCorps and
program director networking events.
Serve Indiana Requirement:
•Serve Indiana requires that all programs budget $25 per month for the use of OnCorps.
Programs should add this in their budget as an OnCorps line item with the detail “OnCorps
$25/month fee * 12 months = $300)
Section 2 Explained
MEMBER COSTS
Living Allowance
•The narrative should clearly identify the number of members you are supporting by category
(i.e., fulltime, half-time, reduced-half-time, quarter-time, minimum-time) and the amount of
living allowance they will receive, allocating appropriate portions between the CNCS share
(CNCS Share) and grantee share (match).
• The minimum and maximum living allowance amounts are provided in the Notice. In eGrants, enter the
total number of members you are requesting in each category.
• Enter the average amount of the living allowance for each type of member.
• In addition, enter the number of members for which you are not requesting funds for a living allowance,
but for which you are requesting education awards.
Living Allowance Updates
Service Term Minimum # of
Hours
Minimum Living Allowance Maximum Total Living Allowance
Grantee Share 24% 26% 30% 34% 38% 42% 46% 50%
Requirements
Cash from:
Donations
Non-federal income
State appropriations (grants)
Fees for service – Program income