Action for Prisoners’ Families Seminar 25 June 2014 Quality services: ticking all the boxes

1. Action for Prisoners’ Families Seminar 25 June 2014 Quality services: ticking all the boxes

2. Evaluation and family relationship measures AnnaKazimirski

3. Evaluation and family relationship measuresAnne kazimirski, nPC Action for Prisoners’ Families – 25th June 2014 NPC - title of the document (can be changed under view/header and footer. Add date here if needed.

4. TRANSFORMING THE UK CHARITY SECTOR Charity Funder Sector NPC works at the nexus between charities and funders Increasing the impact of charities eg, impact-focused theories of change Strengthening the partnership Eg, collaboration towards shared goals Increasing the impact of funders eg, effective commissioning Consultancy Think tank 4

5. Why measuring impact is important Motivates staff Raises profile Helps secure funding The Brandon Centre provides counselling and psychotherapy to young people between the ages of 12 and 21 Influences the debate on “what works” Improved services Taken from: Rickey, B, Lumley, T and Ni Ogain, E . (2011) A Journey to Greater Impact New Philanthropy Capital.

6. Components of NPC’s approach to measuring social impact Effective measurement framework developed Map your theory of change Prioritise what you measure Choose your level of evidence Select your sources and tools Strategic vision Leadership Case for impact measurement

7. theory of change • Links activities èintermediate outcomes èfinal outcomes • clarifies what the activities aim to achieve and how • provides a structure for identifying what can be measured • provides the case for why achieving intermediate outcomes is important A conceptual map of how activities lead to outcomes

8. Reintegration into (non criminal) social & family groups Offenders (and families) feel empowered to take responsibility and maintain gains Strengthened family ties & relationships Family therapy Levels of conflict within families reduced Contribution to reduced reoffending Observable reduction in problem behaviours during process EXAMPLE THEORY OF CHANGE

9. Offenders’ family relationships • Commissioned by NOMS to develop toolkit to measure intermediate outcomes of work to improve family & peer relationships of offenders • Project going through peer review, to be published later this year • Parallel project: RAND Europe, with ARCS (UK) and University of Glamorgan, focusing on arts and mentoring work with offenders

11. Project process Evidence review – identifying outcomes and toolkits Consultation with providers & commissioners to select outcomes to focus on Development and piloting of toolkit Consultation with providers & commissioners to inform guidance Analysis and reporting

12. Development of relationships toolkit • Desistance theory: • Link between creation/ investment in family relationships / reduction in peer pressure with reduced offending • Consultation: • Outcomes differed depending on the type of intervention & beneficiary • Needed to reach a balance between being prescriptive and allowing for flexibility • We researched existing scales and evaluations in each outcome area and prioritised: • good validity and reliability; recently developed; brevity. Toolkit: 25 standardised scales, to be used in paper questionnaires for offenders to complete. For each outcome area: short general scales & longer specialised scales.

13. Child relationships Toolkit structure Wider family relationships Partner relationships + + Reduced reoffending + + Peer relationships RAND personal development outcomes + + Parenting

14. Outcome areaS • Partner relationships • Increased satisfaction with partner relationship, reduced conflict and improved commitment • Child relationships • Quality of relationships with children, children’s well-being and behaviour • Wider family relationships • Family functioning, resilience, conflict and communication, satisfaction with relationships in the family and quality of relationships • Parenting • Improved satisfaction with the parent-child relationship and parenting skills • Peer relationships • Satisfaction with peer relationships and reduction of negative peer relationships

15. Characteristics of toolkit • The questions can be used as monitoring or as part of an evaluation with a ‘before and after’ (pre/post) research design, with a comparison group where possible Before measure After measure “Intervention” group Programme / service After measure Before measure “Comparison” group

16. resources • http://www.thinknpc.org/ • NPC’s Wellbeing measure: http://www.well-beingmeasure.com • NPC’s papers on • How to approach evaluation: http://www.thinknpc.org/publications/npcs-four-pillar-approach/ • Theory of Change: http://www.thinknpc.org/publications/theory-of-change/ • How to communicate your results: http://www.thinknpc.org/publications/talking-about-results/ • Profile of six charities who radically improved their approach to impact measurement: http://www.thinknpc.org/publications/a-journey-to-greater-impact/ • http://inspiringimpact.org/ • Code of Good Impact Practice • Online impact marketplace • anne.kazimirski@thinknpc.org • 020 7620 4855 • Twitter: @npcthinks, @AnneKazimirski

17. Action for Prisoners’ Families Seminar 25 June 2014 Quality services: ticking all the boxes

18. www.prisonersfamilies.org.uk @Prisonerfamily