1 / 21

Writing Result Measures and Program Evaluation

Writing Result Measures and Program Evaluation . Kathy Keeley Northland Foundation Strengthening Communities April 14, 2011. Agenda. Welcome Review Technology Overview and Definitions Writing Result Measures and Examples Program Evaluation Definitions and Purpose Methods

royal
Download Presentation

Writing Result Measures and Program Evaluation

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Writing Result Measures and Program Evaluation Kathy Keeley Northland Foundation Strengthening Communities April 14, 2011

  2. Agenda • Welcome • Review Technology • Overview and Definitions • Writing Result Measures and Examples • Program Evaluation • Definitions and Purpose • Methods • Using with Results Methods • Webinar Feedback – Please complete SurveyMonkey form The Keeley Group

  3. Technology • Mute & Unmute Phone *5 We ask that everyone leave their phone on mute until question and answer time to avoid outside noises. • Asking Questions Please use the chat to the right of your screen for any questions. We hope to have time to respond. • If Cut Off – what to do If you have technical difficulties we have loaded this PowerPoint on our website that you can follow along with. www.northlandfdn.org/Grants/NonprofitResources.shtml The Keeley Group

  4. Writing Result Measures The Keeley Group

  5. Results /Outcomes • Results are also called Outcomes. • Impact – Benefit to the client. • Beyond the numbers who attend your program or services. • Answers “what is different because of what you do?” NOT “what you do The Keeley Group

  6. Not A Strategy Outcome is: • Healthy Babies • Youth Ready for College • Sense of connection to social issues in our community Strategy is: • Train mothers in illness prevention model • Educational Reform in High Schools • Rewrite all plays to focus on current social issues in the city The Keeley Group

  7. Not Outputs • Not how many people served • What is the benefit to the client because they got help from your organization? The Keeley Group

  8. Why Important? • Mission • Right programs and services • Demonstrate a return on investment • Consistent message for donors The Keeley Group

  9. Definition of Result Measure • Outcome – Benefit from what you do • Indicator – Measure of your impact on the outcome • Target – Number you are trying to achieve Example Public Safety (Outcome) 50% (target)emergency calls will be responded to within 3 minutes (indicator) The Keeley Group

  10. Steps to Create 1. Who is the customer? Decide who you intend to benefit from what you do? 2. How do they benefit? Identify exactly how you want them to benefit because of what you do--Outcomes. Examples: skills, behavior, knowledge, circumstances, attitudes, enjoyment…… 3. Select measurable indicators for each Outcome. Review for ability to communicate your story and ease of data collection 4. Decide 3-5 year targets for each indicator. The Keeley Group

  11. Results Must • Communicate Story – Be compelling • Be affordable to measure • Have a baseline of data The Keeley Group

  12. Examples Healthy Children 80% of children will be immunized before kindergarten. Employed Individuals with Living Wage 50% of program graduates will obtain a job that pays at least $12 an hour. Audience Participation 50% of audience will participate in audience talk back sessions. New Audience Development 25% of audiences will be composed of young professionals Eliminating Homelessness 50% of homeless individuals will obtain permanent housing Outcome Target Indicator The Keeley Group

  13. Results - Outcomes • What to Measure • Feelings – not very effective • Learning - Increased knowledge • Increased skills – new skills to apply • Effectiveness – change in life circumstances The Keeley Group

  14. Examples Improving Parenting Skills • 50% of families receiving case management achieve goals established in plan. Children Reading at/or above • 60% of children improve reading as measured by X The Keeley Group

  15. Program Evaluation The Keeley Group

  16. Program Evaluation • Making Decisions • Funding –Accountable, Cuts, New Funding • Improve Program • Respond customer satisfaction • Measure against Strategic Plan • Board and Management Dashboard The Keeley Group

  17. Before • What do you want to know – really know? • Who is the audience? • What kinds of information is needed? • Strengths and Weaknesses • Outcomes vs. Outputs – what happened • Client experience – customer satisfaction • 4. How will you collect? • 5. Timeline • 6. What can you afford? The Keeley Group

  18. Types of Evaluation • Goals – Client, Program, Funding • Surveys (follow-up) • Interviews • Documentation Review • Outcomes – what has been achieved • Survey • Database Records • Sample Interviews • Process – how program works • Focus Groups • Interviews The Keeley Group

  19. Data Base Resources • http://www.communitytech.net/ • Vista Share http://www.vistashare.com/Corporate/Home/ • Sales Forces – www.saleforce.com • Filemaker Pro • Access • Excel Spreadsheet • Trade Association in Sector • http://www.socialsolutions.com/ The Keeley Group

  20. Resources • Program Managers Guide • Methods Review • PowerPoint Slides • www.northlandfdn.org/Grants/NonprofitResources.shtml The Keeley Group

  21. Wrap-up Please complete the SurveyMonkey webinar feedback form. You will be receiving an email shortly. • Feedback form link:www.surveymonkey.com/s/HB2788G The Keeley Group

More Related