Informal Academic Diagnostic Assessment: Using Data to Guide Intensive Instruction

1. Informal Academic Diagnostic Assessment: Using Data to Guide Intensive Instruction • Part 3: Miscue and Skills Analysis This document was produced under U.S. Department of Education, Office of Special Education Programs, Award No. H326Q110005. Celia Rosenquist serves as the project officer. The views expressed herein do not necessarily represent the positions or policies of the U.S. Department of Education. No official endorsement by the U.S. Department of Education of any product, commodity, service or enterprise mentioned in this document is intended or should be inferred.

2. Informal Academic Diagnostic Assessment: Using Data to Guide Intensive Instruction

3. Purpose and Objectives Purpose: Provide an introduction to the use of miscue analysis to identify academic skill deficits for instructional planning. Objectives: • Learn how to analyze student miscues on Passage Reading Fluency assessments to identify error types. • Learn how to analyze mathematics computation errors.

4. Miscue analysis within the data-based individualization (DBI) process

5. Purpose of Miscue Analysis Student errors on curriculum-based measures (CBMs) can be analyzed to • Describe academic strengths and weaknesses • Help align intervention adaptations with student need

6. Consider the Current Intervention First Before conducting miscue analysis, ask • Has the intervention been implemented as planned? • Is the student engaged in the intervention? • Is the progress monitoring tool at the appropriate level?

7. Possible Implementation Issues • Intervention • Fidelity • Intensity • Dosage • Duration of intervention • Session length • Missed sessions

8. Possible Motivation Issues • Student attention to instruction • Student effort during intervention • Student effort and attention during assessment • Others?

9. Miscue and Skills Analysis in Reading 9

10. Miscue Analysis in Reading • Student reads a CBM passage out loud. • Administrator records errors. • First 10 miscues are analyzed for error type.

11. Types of Errors • Graphophonetic • Syntactic • Semantic

12. Graphophonetic Error • Preserves some important phonetics of the written word, even if it does not make sense. • Example: Written word is “friend,” but spoken word is “fried.”

13. Syntactic Error • Preserves the grammar of the written word. • Example: “Ran” is the same part of speech as “jogged.”

14. Semantic Error • Preserves the meaning of the sentence. • Example: “The woman is tall” has the same meaning as “the lady is tall.” • Practice: what is a possible semantic miscue for the written word “pony?”

15. Practice: Error Types Provide an example of each error type for the underlined word in the following written sentence: Sally likes jelly on her biscuit. Possible miscues: • Graphophonetic: jolly • Syntactic: mustard • Semantic: jam

16. Quick Miscue Analysis Table See handout: Reading Miscue Analysis.

17. Calculating Percentages For each error type column:

18. Miscue Analysis Example Janet’s Passage Reading Fluency (PRF)

19. Janet’s Quick Miscue Analysis Table 19

20. What do Janet’s errors tell us?

21. Instructional Recommendations for Janet Janet may benefit from instruction and practice to help her • Sound out all parts of a word • Self-monitor and self-correct for meaning • Cloze procedure • Listen to recording of own reading

22. Practice: Reading Miscue Analysis Reading Miscue Analysis handout • Sample PRF passage on page 3 • Quick Miscue Analysis Table on page 2

23. Correct Answers What have we learned about the student’s reading? 23

24. What do the errors tell us?

25. Instructional Recommendations Practice short, functional words to help the student develop fluency. • Discriminate between similar words and phrases. • Master common error words. • Echo reading • Writing or spelling exercises

26. Error and Skills Analysis in Mathematics 26

27. Analyzing Computation Errors • How wrong is a wrong answer? • Evaluate each numeral in the answer to look for patterns in correct and incorrect digits • Further analyze student’s work when shown

28. Computation Scoring Review: Addition, Subtraction, Multiplication Score each correct digit in the answer from right to left. Example: Correct answer is 417.

29. Scoring Review: Division Score each correct digit in the answer from left to right, with remainders scored from right to left. # R #

30. Scoring Review: Decimals Start at the decimal point and work outward in both directions. #.#

31. Scoring Review: Fractions Score correct digits in each part of problem (whole number, numerator, denominator) from right to leftthen add for total correct digits.

32. Jim’s Multi-digit Addition: Example 1 • Jim’s Answer: • Correct Answer: 2 Correct Digits (2 CD) _ _ • What does this answer tell us about Jim’s skills?

33. Jim’s Multi-digit Addition: Example 2 • Jim’s Answer: • Correct Answer: 2 Correct Digits (2 CD) _ _ • How did Jim do on this problem? • What instructional recommendations would you make?

34. Comparing Different Answers to the Same Problem: Subtraction How might your instructional decisions differ for these students? What might Student B know that Student C does not? _ _ _ _ _ _ _ _ _ Student C: 2 CD Student B: 3 CD Student A: 4 CD

35. Martha’s Multiplication with Decimals • Martha’s Answer: • Correct Answer: 4 CD 0 CD • How would you help Martha?

36. Let’s Practice • Score the correct digits in each student response to complete the table on page 1 of the handout. • Answer the questions on page 2 of the handout. See handout: Computation Error Analysis Practice.

37. Scoring Check: Items 1-3

38. Scoring Check: Items 4-6

39. What does this analysis tell us? • Whose errors were more significant? • What would be your instructional recommendations for each student? • What additional data would help plan instruction?

40. Item 1 • Correct Answer: • Student 1: • Student 2: ? • What does Item 1 tell us about each student?

41. Item 2 • Correct Answer: • Student 1: • Student 2: ?

42. Item 3 • Correct Answer: • Student 1: • Student 2: ?

43. Item 4 • Correct Answer: • Student 1: ? • Student 2:

44. Item 5 • Correct Answer: • Student 1: • Student 2: ?

45. Item 6 • Correct Answer: • Student 1: • Student 2: ?

46. What could additional data tell us? • Is this error type consistent? • Why does the student make type of error?

47. Instructional Targets

48. Instructional Recommendations • Explicit instruction in • Consistent error types • Underlying skills (e.g., single digit computation) • Additional practice with • Corrective feedback • Varied response formats

49. In Summary

50. Disclaimer This module was produced under the U.S. Department of Education, Office of Special Education Programs, Award No. H326Q110005. Celia Rosenquist serves as the project officer. The views expressed herein do not necessarily represent the positions or polices of the U.S. Department of Education. No official endorsement by the U.S. Department of Education of any product, commodity, service or enterprise mentioned in this website is intended or should be inferred.