Outline

1. Systems Improvement throughService Collaboratives(SISC)Brian Rush, PhD(on behalf of the Performance Measurement & Implementation Research Team)Centre for Addiction & Mental HealthOntario, Canada

2. Outline • Background and Context • Ontario • CAMH • Systems Improvement through Service Collaboratives (SISC) Initiative • Implementation Framework • Background • Adaptation of the National Implementation Research Network (NIRN) Active Implementation Framework to SISC • Balancing between Science & Pragmatism • Implementation research dilemmas 2

3. Ontario, you say? Source: http://www.fmcsa.dot.gov/intl-programs/canada/index.htm

4. Ontario, you say? What Ontario is… What Ontario isn’t…

5. Ontario: Population density

6. What is CAMH? The Centre for Addiction and Mental Health (CAMH) is Canada's largest mental health and addiction teaching hospital, as well as one of the world's leading research centres in the area of addiction and mental health. CAMH combines clinical care, research, education, policy development and health promotion to help transform the lives of people affected by mental health and addiction issues. CAMH has been recognized internationally as a Pan American Health Organization and World Health Organization Collaborating. 6

7. Background: Open Minds, Healthy Minds • CAMH has been asked by the province of Ontario to lead several key provincial activities which are now underway as part of Open Minds, Healthy Minds: Ontario’s Comprehensive Mental Health and Addictions Strategy. • The Strategy begins with a three-year-plan that focuses on children and youth. 7

8. Starting with Child and Youth Mental Health Our Vision: An Ontario in which children and youth mental health is recognized as a key determinant of overall health and well-being, and where children and youth reach their full potential. Identify and intervene in kids’ mental health needs early Professionals in community-based child and youth mental health agencies and teachers will learn how to identify and respond to the mental health needs of kids. Close critical service gaps for vulnerable kids, kids in key transitions, and those in remote communities Kids will receive the type of specialized service they need and it will be culturally appropriate Provide fast access to high quality service Kids and families will know where to go to get what they need and services will be available to respond in a timely way. THEMES • Fewer hospital (ER) admissions and readmissions for child and youth mental health • Reduced Wait Times • Reduced child and youth suicides/suicide attempts • Educational progress (EQAO) • Fewer school suspensions and/or expulsions • Higher graduation rates • More professionals trained to identify kids’ mental health needs • Higher parent satisfaction in services received • Decrease in severity of mental health issues through treatment • Decrease in inpatient admission rates for child and youth mental health INDICATORS Outcomes, indicators and development of scorecard Ontario’s Comprehensive Mental Health and Addictions StrategyOVERVIEW OF THE THREE YEAR PLAN Implement standardized tools for outcomes and needs assessment Implement Working Together for Kids’ Mental Health Enhance and expand Telepsychiatry model and services Provide support at key transition points Pilot Family Support Navigator model Y1 pilot Improve public access to service information Develop K-12 resource guide for educators Improve service coordination for high needs kids, youth and families Amend education curriculum to cover mental health promotion and address stigma Funding to increase supply of child and youth mental health professionals Increase Youth Mental Health Court Workers Hire new Aboriginal workers Implement Aboriginal Mental Health Worker Training Program INITIATIVES Expand inpatient/outpatient services for child and youth eating disorders Hire Nurse Practitioners for eating disorders program Provide designated mental health workers in schools Reduce wait times for service, revise service contracting, standards, and reporting Implement school mental health ASSIST program and mental health literacy provincially Strategy Evaluation Create 18 service collaboratives Provide nurses in schools to support mental health services Implement Mental Health Leaders in selected School Boards

9. “Create 18 Service Collaboratives” SISC’s Goal To support local systems to improve coordination of and enhance access to mental health and addiction services. Systems Improvement through Service Collaboratives (SISC) is one initiative encompassed within the Comprehensive Strategy. 18 Service Collaboratives established across Ontario will focus on addressing system gaps related to mental health and addictions services. 9

10. Which Ministries are involved? The Centre for Addiction and Mental Health (CAMH) is working with six provincial ministries to ensure the Service Collaboratives’ success. They are: • Ministry of Health and Long-Term Care; • Ministry of Children and Youth Services; • Ministry of Education; • Ministry of Training, College and Universities; • Ministry of the Attorney General, and; • Ministry of Community Safety and Correctional Services. 10

11. Advisory and Accountability Structures Systems Improvement through Service Collaboratives (SISC) Project Sponsor: CAMH Provincial Government Oversight Committee Advice, Communication and Approvals Accountability Communication Ministry of Health and Long-Term Care Service User Expert Panel Provincial Collaborative Advisory Group Advice and Communication Scientific Expert Panel Other Expert Panels Communication Related Services and Stakeholders

12. Minimum Specifications Focus on improving transitions Multi-sector partnerships Use of Implementation Science & Quality Improvement tools Focus on Equity Evaluation

13. What is a Service Collaborative? • A group of local service providers who work together to improve access to and coordination of mental health and/or addiction services. • Membership in Collaboratives reflects the cross section of sectors that provide service to children and youth with complex needs. • 14 Service Collaboratives are geographically based, and 4 focus on transitions between the health and justice systems. Statement of Purpose Service Collaboratives will bring together service providers and other stakeholders from various sectors that interact with people who have mental health and/or addictions problems, in particular children and youth agencies, justice programs, health providers, and education organizations. By working together to identify and implement system level changes, the Collaboratives will improve individuals’ ability to access services, their service experience, and their health outcomes. (Government of Ontario, 2011)

14. Key Transition Points Hospital Community Services • E.g. Clients transitioning from inpatient to community based services. Child Services Adult Services • E.g. Youth transitioning to adult services. • E.g. An individual with mental health and/or addiction issues moving between health and justice services. Health Justice System

15. Who is participating?

16. Service Collaborative Rollout The Strategy’s First 3 Years – Children & Youth 2012-2013 2011-2012 2013-2014 4demonstration sites have been established (Cluster 1). 8 Service Collaboratives (6 geographic and 2 justice + health) (Cluster 2). 6Service Collaboratives (4 geographic and 2 justice + health) (Cluster 3).

17. Service Collaborative Locations (to date) Cluster 1 2011/2012 Cluster 2 2012/2013 Thunder Bay Ottawa Simcoe/Muskoka Champlain (J) Kingston, Frontenac, Lennox & Addington Durham London Waterloo/Wellington Peel Toronto (J) Hamilton 17

18. Implementation Framework Implementation • A specified set of purposefulactivities at the practice, program, and system level designed to put into place a program or intervention of known dimensions with fidelity. • A “make it happen” process, as opposed to diffusion or dissemination, which can be more passive in nature (Greenhalgh, Robert, Macfarlane, Bate, and Kyriakidou, 2004). Implementation Science • The study of the methods to implement research findings (i.e. evidence-based research) into routine practice to ultimately improve client outcomes;

19. Adaptation of the National Implementation Research Network (NIRN) Active Implementation Framework to SISC • Implementation Stages – SC sites phased in by 3 clusters • Exploration • Installation • Initial Implementation • Full Implementation • Implementation Teams -Central and regional resources • Implementation Cycles - QI tools (i.e. PDSA and practice-policy communication loop) • Implementation Drivers – • a) Leadership; • b) Competency; • c) Organization (e.g. program evaluation / decision support data systems).

20. Implementation Science in a Community Development Context Where we land depends on the issue, stakeholder perspective and perceived costs and benefits

21. Balancing between Science & Pragmatism Developmental evaluation (Patton, 2011) has been applied from the beginning of the SISC initiative and aligned with the implementation stages. Seeks to balance the gold standards of evaluation practice, policymaking and implementation science with the realities of community development

22. SISC Evaluation Plan Performance Measures – Local level

23. Local Evaluation • Logic model / Evaluation Framework / Contribution Analysis • Linking activities, processes and outcomes • Evaluation Plans with Key Principles • Distinction between process and outcome objectives • Stakeholder-based • Consistent with developmental evaluation • Local indicators developed after decision on interventions

24. Evaluation Challenges I • Meeting provincial expectations while supporting community development process • Intervention + context = outcome • NOT a linear process • Developmental Evaluation • Evaluation is part of the development of SISC, not above or outside of it • Time constraints • Timeline for SISC program development, including for PMIR (e.g. hiring Regional Evaluation Coordinators) • Timeline for intervention and short to medium term outcomes – what is measurable and when?

25. Evaluation Challenges II • Holding space for Implementation Science • Tremendous opportunity but needs time and resources • ‘Levels of evidence’ – Implementation Science for EBPs compared to reality of lack of evidence • Moving timelines • Challenges with fidelity to stages with moving timelines (community reality) • Data sharing • Sharing of client info, confidentiality, legal issues…etc

26. Balancing between Science & Pragmatism Not an easy balancing act but it’s exciting and we don’t think we’re alone!

27. ServiceCollaboratives.ca About SISC - The Strategy - FAQ - Who we are - Implementation Framework News & Resources - Project Updates - Upcoming Events - Resources - Newsletters Service Collaborative Communities - Map of active Service Collaboratives - A page for each Collaborative

28. For more information about the Systems Improvement through Service Collaboratives (SISC) initiative, contact: Brian Rush Director, Performance Measurement and Implementation Research Team Provincial System Support Program (PSSP) CAMHbrian.rush@camh.ca Fiona Thomas Research Coordinator, Performance Measurement and Implementation Research Team Provincial System Support Program (PSSP) CAMH fiona.thomas@camh.ca

29. Appendix: Cluster 1 Gaps & Interventions 29

30. Appendix: Cluster 1 Gaps & Interventions 30