210 likes | 631 Views
Program Evaluation. Mark Spolidoro , University of Massachusetts Boston. What is Evaluation?. Program evaluation is the systematic assessment of the processes and outcomes of a program with the intent of furthering its development and improvement. *
E N D
Program Evaluation Mark Spolidoro, University of Massachusetts Boston
What is Evaluation? • Program evaluation is the systematic assessment of the processesand outcomes of a program with the intent of furthering its development and improvement. * • It involves collecting and analyzing information about a program’s: • Features • Activities • Outcomes * (Office of Educational Assessment, University of Washington)
Importance of Evaluation • Improve your program’s: • Design • Implementation • Demonstrate your program’s impact • Leverage findings: • To garner community support • To attract potential funders • To attract new families to your program
Sources of Information • Everyone involved in the program including: • Families • Staff • Coaches • Counselors • Children
Sources of Information Child Impact
Tools of Evaluation • Program surveys • Paper and pencil • Online • Observations • Interviews • In-person • Phone • Logs
Examples of Evaluation Objective: What are parents’ reasons for sending their child to camp? Camp Shriver: Below is a list of goals that family members have for their child at Camp Shriver. Please rank the three things that are most important to you.
Examples of Evaluation Objective: Did the program work? Camp Shelanu How did we do? Please rate the following aspects of camp
Examples of Evaluation Objective: Is inclusion taking place? Camp Crossroads: 1. How do you feel that the overall spirit of inclusion is working this summer? • I don’t know what inclusion is • It’s going okay • It’s going well but it doesn’t really apply to me • It’s going great! 2. If you were a counselor last summer, have you noticed any changes in inclusion? ________________________ 3. What are the biggest difficulties or challenges that you face with inclusion? ________________________
Examples of Evaluation Objective: Did the program improve the child’s social skills? Camp Shriver • Use the number scale below to show how often each child engaged in each of the following statements during the past week. Just do your best to answer each item, based on how well you know each camper. 0 = never 1= rarely 2 = sometimes 3 = often DK= don’t know
Examples of Evaluation Objective: Did the program improve the child’s swimming skills? Camp Shriver
Examples of Evaluation Objective: What did the child like about camp? Camp Shriver
What makes a good evaluation? • It is tailored to your program • It takes into account many different perspectives • The methods are as rigorous as possible
Strategies in Developing an Evaluation • Think about the most essential questions: What do you want to know about your program? • Use research and program evaluation resources of the community • Determine what is feasible • Network with other programs to find out what works for them • Get buy-in from stakeholders