Far West Lab Evaluation Proposal

A proposal submitted to Far West Laboratory for evaluating its Determining Instructional Purposes training program. Submitted By: Turner Evaluation Associates T.E.A.

Introduction:
Far West Laboratory, an educational research and development company, issued a request for proposals to evaluate its (DIP) training program. The overall goal is to provide information and recommendations to the company for use in making decisions regarding marketing of their training units. The company has created the training units, and has sold some of the training packages. However, they are leery about investing a substantial amount capital in the product for mass marketing until an evaluation of the training package has been completed. This document is a program evaluation proposal to be submitted to Far West Laboratory in response to their request. Description of Program Being Evaluated: The program which is being evaluated is the Determining Instructional Purposes training program. The training package was developed by Far West Lab to train school administrators and graduate students in educational administration skills related to the planning of effective school programs. The training package consists of a Coordinators Handbook and three training units. Each unit is comprised of four to six modules that provide training on a limited number of instructional objectives. The modules include reading materials related to the skills to be taught along with practice activities. The modules also contain feedback for the practice activities. The units were designed so that one unit, or any combination of units, could be used during a training session. The required training time required for the units are between 10 18 hours for each unit. The training materials require that the training sessions be overseen by a coordinator. Training coordinators are required to complete the training sessions independently, or as a group member, before conducting sessions as a coordinator. A coordinators role is to serve as a guide. They are to monitor, and organize activities provided in the coordinators handbook. Evaluation Method: The evaluation of the (DIP) training program is being performed to provide information to Far West Labs to aid in decision making. The company would like to market their training program to grow their business. The company would like to make sure that the program is worthy of the capital investment. A second purpose of the evaluation would be to provide information to schools administrators who are contemplating purchasing the training program. The evaluation should provide information that could be used by both the investor (FWL) and the potential client.

The central questions to be answered by the evaluation are:

Are training programs meeting trainee and client expectations? Is the program preparing trainees for the planning of effective schools by helping them to learn the necessary skills? Are Far West Labs program developers, staff, and trainees satisfied with the program and its support services?

For the purpose of this evaluation, we will be using the decision making model of evaluation. This type of evaluation is employed to make decisions about further use of a program. This evaluation model will evaluate the potential long term effects of the program. This model allows for a wide range of methodology for data collection. It will help to determine the effectiveness and efficiency of the program. Because the decision making model of evaluation allows for either summative or formative evaluations, we will be using methods of evaluation that gather qualitative data. Qualitative methods are ways of collecting data which are concerned with describing meaning, rather than with drawing statistical inferences. The qualitative data gathered from this model of evaluation should aid FWL in making a decision in terms of marketing their programs. The data would also beneficial to administrators contemplating purchasing the training units. The methods to be used for collecting data will include the following: 1. Observation: The observer will serve as a participant in a recently purchased training program. This will enable the evaluator to participate in the group activities, yet the main role of the evaluator is to collect data, and the group being studied is aware of the evaluators observation activities. Conducting the observation in this way allows for better observation and, hence, generating more complete understanding of the group's activities. 2. Document Analysis: An analysis of documents will be completed. The evaluation will include gathering information from program documents. This will include evaluating accomplishment reports, statistical reports, receipts, logs, enrollment

records, and personnel records. The document analysis will give insight into the cost, production, development, and design of the training program.

3. Qualitative Case Studies: The qualitative case studies will be completed with either an individual, or in a small group setting. The case study will be performed through the use of an interview. The interviews will be conducted with the staff, as well as training participants. The interview questions will be based on the perceived effectiveness and efficiency of the training programs. The interviews will be conducted as face to face interviews or using video conference call software such as Skype. 4. Surveys: Surveys will be produced with carefully constructed questions. The surveys will be distributed, or mailed, to both the trainees and the staff. The survey questions will be based on the perceived effectiveness and efficiency of the training program. Task Schedule: The anticipated amount of time needed to conduct the evaluation is eight weeks. The timeline for completion is itemized below. To avoid additional expense, the evaluation should occur during a previously scheduled training session. The tasks will be completed at a training location, and at the Far West Lab corporate office. Task: Meet with program developers at corporate office to discuss evaluation Timeline: 5/1/12 5/4/12

and collection methods. Document Analysis: Begin collecting documents for analysis. Complete the document analysis and begin written report of analysis findings. Compose rubric for qualitative case study interview. Compose survey questionnaire Distribute surveys to staff and trainees Complete observation of trainee program Complete written analysis of observation Conduct interviews for qualitative case study Complete written analysis of case study Collect surveys Complete written report of all findings Report findings to stakeholders Project Personnel: At Turner Evaluation Associates, we strive to provide the most reliable information to our clients. We have been providing evaluation services for 20 years. Our evaluators possess Graduate level training in research methodology and statistics. They also possess demonstrated expertise in the design and conduct of program evaluation studies. Our evaluators have excellent analytical skills, including policy and program outcome analysis combined with excellent interpersonal skills including the ability to function in a team setting, to lead or facilitate meetings, and to communicate effectively with staff, faculty and higher level administrators. Budget or Fee: 5/7/12 5/18/12 5/21/12-5/23/12

5/24/12 5/25/12 5/28/12 5/31/12 6/1/12 6/4/12 6/8/12 6/11/12-6/13/12 6/13/12 6/19/12 6/20/12-6/21/12 6/22/12 6/25/12 6/29/12 6/30/12

The table below represents the itemized budget for this evaluation proposal. Expense Item Description: Professional Salaries: Debbie Turner Evaluator $450 per day Kris Cable Project Assistant $250 per day Project Secretary: $100 per day Travel and Per Diem: Mileage/transportation based on state mileage rates: 50 miles per day round trip $0.51 per mile to training facility in Atlanta Per Diem: Based on state per diem rates: $56 per day for meals Round trip airfare Atlanta to Los Angeles to Far West Labs Corporate office 5 days lodging and meals Car rental $50 per day for 5 days Supplies: Photocopying and binding of reports estimated 20 reports $10 each Communications: mailings Conference calling Expense: 40 days = $18,000 20 days = $5,000 10 days = $1,000 $25.50 per day x 20 days = $510

$56.00 x 20 days = $1,120 $575 $780 $250 $200 $100 $100 Total Expenditures: $27,635.00

Conclusion: The purpose of program evaluation is to prove the worth, value, or merit of a program. This evaluation proposal utilizes an objectives-based approach to determine the merit of marketing and extending this training program. This approach was utilized to answer specific guiding questions about how well the program is working. This approach is also organized and systematic. At T.E.A we strive to meet the needs of our clients. Please do not hesitate to call on us if we can assist you with your evaluation needs.

Regards, Debbie Turner