MTSS Coach Kick-Off

1. MTSS Coach Kick-Off September 4, 2014 Brian Lloyd, Ed.S., NCSP Mary Jo Wegenke Melanie Kahler

2. Learning Intentions By the end of the morning you will: • You will about or be reminded of practices that improve benchmark fidelity • Learn about AIMSweb Growth Norms and applicability for progress monitoring goal setting • Identify which of your intervention practices align with the 8 Steps for Successful Interventions • Identify the gold standards of MTSS Coaching Practices

3. Success Criteria • I can articulate why the ISD is not migrating to the new AIMSweb 2.0 • I can maintain high fidelity when benchmarking and progress monitoring by scheduling refresher trainings and administration/scoring fidelity checks. • I can use the new growth norms to help set progress monitoring goals for identified students. • I can work with appropriate staff to schedule data analysis at the grade and building. • I can identify how the intervention practices within my school align with the 8 Steps for Successful Intervention Management System. • Write at least one personal goal to improve your MTSS Coaching Skill Set

4. Administrivia • Kid President https://www.youtube.com/watch?v=RwlhUcSGqgs • Introduction of New Staff • Rob Stephenson • Tara Becker-Utess • Brian Lloyd • MTSS Wiki • Data Review Work Days • Professional Development Sessions • Calendar of Upcoming Events and Due Dates • Update MTSS Coach List • Family Learning Connection Website

5. Still AIMSWeb 1.0 – Why? • AIMSWeb 2.0 is still extremely buggy. • There were issues with migrating our data. • The progress monitoring features look awesome, but there were issues with how benchmarking was set up that they are still working on. Example: They did not include the tier transition reports in the new version. These issues will be eventually be resolved.

6. Understanding New Growth Norms • AIMSWeb 2.0 has automated/easier progress monitoring decision making using fairly recently released growth norms. • AIMSWeb suggests using these for setting progress monitoring goals. They are better because: • More specific to each students level of performance. • More appropriate to the time of the year in which they are being monitored. • An explanation of how to use the new growth norms without using AIMSWeb 2.0 is needed.

7. Understanding New Growth Norms • The weekly rate of improvement you select to determine your goal is going to depend on the grade (of course), the benchmark/baseline score the student achieved, and the period of time you are monitoring. • You will use a different set of weekly ROIs when setting goals for fall to winter, than you would when setting goals between winter to spring, and another different set of ROIs when setting yearly goals. • It’s not as complicated as it sounds when you actually do it.

8. Understanding New Growth Norms • See the handed out ROI Growth norm table page for fifth grade or download your own digital copy:

9. Understanding New Growth Norms • Step 1: Determine whether you can use grade level measures. If not, find what grade level you need. • AIMSWeb survey assessment procedures indicate that you go down a grade level when the student scores below the 10th percentile. • Remember though that when in doubt, use grade level measures for progress monitoring.

10. Understanding New Growth Norms • Step 2: Select the ROI using the ranges provided in the ROI Growth Norms Table. Reference the column for the time of the year. Use this range

11. Understanding New Growth Norms

12. Understanding New Growth Norms • Step 3: Use the baseline, number of weeks of progress monitoring, and your newly referenced ROI to calculate a goal score.

13. Understanding New Growth Norms Pull out Growth Norms Practice sheet and work in pairs

14. Understanding Growth Norms

15. Understanding Growth Norms

16. Understanding Growth Norms The Correct Answer is 137

17. Understanding Growth Norms • We used the highest range of scores at the 85th percentile, but the use of this score is only one of your options to set your goals. • The 85th percentile score GN ranges represent the most ambitious score that AIMSweb recommends that you use to set your goal. • In the past, we’ve recommended using 1.5 times the ROI at the 50th percentile on the AIMSweb norms. We also recommend the use of 2.0 times the ROI at the 50th percentile for ambitious goals and/or for students receiving tier 3 interventions.

18. Selecting Progress Monitoring Goals • There are differing “acceptable” methods for setting progress monitoring goals. • Using the Growth Norms to select a goal for different achievement bands at specified percentiles. • This method is best for making sure the ROI goal is best matched to student needs and skills. • You will need to decide which GN growth percentiles you select and under which circumstances. (85th for tier 3, 65th or 75th for tier 2, etc. • Selecting default benchmark scores for grade levels or percentiles (usually 25th or 50th) for all students. Use Growth Norms to make sure they close the gap and isn’t too ambitious. • Use 1.5 times the ROI for students at the 50th percentiles for tier 2 and 2.0 times the ROI for students at the 50th percentiles for tier 3.

19. Benchmarking Reminders

20. Benchmarking Reminders • Schedule administration/scoring refreshers • Periodic observations • Booklet/measure review • Score comparisons between testers • Check to make sure your data makes sense at student, classroom, and grade levels. • Unfortunately, if something is just too good to be true, it just might be.

21. Calculating Accuracy Rate • The inclusion of accuracy rate for R-CBM, MAZE, TEL, and TEN measures are important metric when analyzing student data. Remember to include this data when entering scores. • Accuracy rate may not determine recommendations, but errors are still important for student.

22. Calculating Accuracy Rate • The errors/accuracy rate are automatically calculated/entered when using web-based scoring. • Hand scoring: TWR – WRC = Errors • Don’t include words not yet read. Skipped lines do count as errors. • Calculate accuracy by: Words read correct divided by total words read equals accuracy rate. • Or - WRC / TWR = Accuracy rate • Example: A student who reads 100 total words with 5 errors would read 95 out of 100 possible words correctly. The accuracy rate is 95%.

23. Give Two Get One • Grab a Marker • At a designated poster paper, write two practices that you have put in place to make your increase your benchmarking fidelity or efficiency. • Walk around the poster paper and find one practice that you haven’t tried that might increase your school/district’s benchmarking fidelity or efficiency.

24. Intervention Best Practices Reminder See the 8 Steps for Successful Management of Interventions reference sheet. Use it as a reference as setting up intervention groups this fall.

25. What do you need for a successful year? Let us know so we can get it for you!

26. Coaching Practice Profile

27. Coaching Support Critical Features MiBLSi Critical Features

28. Critical Components on the Coaching Practice Profile Effective Communication Organization Technical Assistance Reinforcement of Leadership Team and School Faculty Participate in Leadership Team Activities Deepen Personal Knowledge of MTSS

29. Coaching Practice Profile

30. Practice Profile Read each standard, put a: next to any expectation that needs clarification next to any expectation that can be addressed with little or no support next to an expectation that could be a potential barrier in your building

31. Review the Critical Components on the Practice Profile Highlight any “Gold Standard” or “Acceptable Variation” you are currently doing. Reflect on the Unacceptable and Harmful Variations. What is your Coaching GOAL from now until the end of the year that will move towards an “Acceptable Variation” or “Gold Standard”? Activity