Smarter Balanced Assessment Consortium Introduction & Workshop (Secondary Version)

1. Smarter Balanced Assessment ConsortiumIntroduction & Workshop(Secondary Version) Presented by Sandy Sanford August 21, 2012

2. History of CCSS & SBAC CCSS0 NGA 2009 CCSS PARCC SBAC California On Board—15% Rule Calif CCSS 2010 PARCC 2011 SBAC

3. Transition Techniques Assessment Based Full Implement Instruction Based TRAINING TRAINING Progressive Based

4. CILA Cycle—Teaching WHAT? Content Standards Assessment Instruction HOW WELL? HOW? Learning WHY?

5. CILA Cycle—Development WHAT? Content Standards Assessment Instruction HOW WELL? HOW? Learning WHY?

6. Take NotesYou’ll need them for the final activity

7. SBAC Workshop LOL What?—You will learn the basics of the SBAC assessment system and the instructional impact on CCSS. How?—Your table group will collaboratively create a Non-Linguistic Representation to demonstrate the instructional impact of SBAC on the teaching of CCSS AND you will share it with other table groups via a gallery walk. Relevance?—Full implementation of CCSS and SBAC in 2014-2015 school year!

8. SBAC Workshop Agenda • 12:30 – 12:45 - Introductions, Opening Activity, Pretest, and Venting • 12:45 to 2:00—SBAC Organization, Activity, Timeline, and Venting • 2:00 to 2:15—Break • 2:15 to 2:45—Tools, SBAC Sample Item Walk, & Venting • 2:45 to 3:15—Instructional Impact Activity • 3:15 to 3:45—Concluding Activity (Non-Linguistic Representation with Gallery Walk focusing on Instructional Impact of SBAC on Teaching of the CCSS) • 3:45 to 4:00—Wrap-up, Questions, & Venting Closure

9. Very ShortPre-Test

10. Terminology • Standards (CA and CS) • Instruction (3 components) • Assessment • Accountability • Summative Assessment (SA) • Interim Assessment (IA) • Formative (Cluster) Assessment (FA)

11. Limitations of Workshop • Introductory • Many unknowns • Emphasis on Math Items • Limited ability to address Accountability • Does not address alternative assessments • More content specific detail in subsequent workshops • Too long until first activity

12. Venting SBAC Bop Buddy • Unavoidable & Natural • Write down “vents” as we go • Hold “vents” until designated times • Consolidate “vents” on a table group list • At designated times, groups tape “vent list” to SBAC Bop Buddy and then SOCK him to your hearts content

13. The Deer in Historical Perspective 1997 1998 1999 2002 2003 2000 2001 2012 2015 2008 API CA Content Stds AYP NCLB CCSS SAT-9 Inst Mat CSTs Inst Mat SBAC CAHSEE

14. SBAC Organization & Description

15. What are Biggest differences between CA & CC Standards? • ELA • Text complexity and content area integration • Math • Cognitive vs Cognitive & Meta-Cognitive • No Core Materials until at least 2017

19. When are CCSS Operational? • Already Adopted • 2012-13 & 2013-14 Transition Years • 2014-15 Fully Operational and Tested

20. SBAC Purpose CCSS Common Core State Standards specify K-12 expectations for college and career readiness All students leave high school college and career ready SBAC

21. Timeline • 2012—Assessment Plan, ELD, Sup Materials to SBE • 2013—Pilot SA, Revised Math FW, PD Modules • 2014—Field Test SA, Revised ELA FW • 2015—Operational SA • 2017 to 2018—Core Inst Materials SA = Summative Assessment FW = Framework

22. Timeline • 2012—Assessment Plan, ELD, Sup Materials to SBE • 2013—Pilot SA, Revised Math FW, PD Modules • 2014—Field Test SA, Revised ELA FW • 2015—Operational SA • 2017 to 2018—Core Inst Materials SA = Summative Assessment FW = Framework

23. SBAC Structure Start Year End Year Last 12 Weeks Summative Assessments Form Asmt Form Asmt Form Asmt • Performance Tasks • 1 Reading • 1 Writing • 2 Math Form Asmt Form Asmt Interim Assessment (CAT) Interim Assessment (CAT) • Computer Adaptive Assessment • 40-65 Items • ELA & Math • CR, SR, CE Retake Digital Toolbox Optional & Probably Extra Cost

24. Scoring & Accountability Output Performance Tasks • Vertical & Horizontal Scaling • Summative • Interim • 2 week turnaround • Full-Service Reports • Progress • Instruction Support Separate & Combined Scores Computer Adaptive Assessment (CAT)

25. Horizontal Scaling 3rd Grade ELA CST 600 200 150 350 550 500 250 300 400 450 4th Grade ELA CST 600 200 150 350 550 500 250 300 400 450 5th Grade ELA CST 600 200 150 350 550 500 250 300 400 450 6th Grade ELA CST 600 200 150 350 550 500 250 300 400 450

26. 800 8th Grade ELA SBAC Summative 700 7th Grade ELA SBAC Summative 600 6th Grade ELA SBAC Summative 500 VERTICAL SCALING 400 5th Grade ELA SBAC Summative 300 4th Grade ELA SBAC Summative 200 3rd Grade ELA SBAC Summative 100

27. Computer Adaptive Testing (CAT) HARD ITEMS EASY Standards Computer Student

28. Basic Item Types • Selected Response (Enhanced) • Constructed Response • Technology-Enhanced • Performance Tasks CAT Items Perf Tasks CBT (Computer Based Testing)

29. Selected Response (Traditional)

30. Selected Response (Enhanced)

31. Scoring Rubric

32. Extended Activity • In table groups study the elementary math item (RTQs from 1997 CA Standards) provided • Convert that item to an Enhanced Selected Response Item (following the example problem just modeled) 5 minutes • Be prepared to share out your enhanced item and explain your rationale

33. 7NS1.3

36. 7NS1.3

37. ESR Item Advantages Guessing Factor Depth of Knowledge (DOK) Discriminate Partial Knowledge Accuracy of Measurement

38. Constructed Response The table below shows the number of students in each third-grade class at Lincoln School. There are 105 fourth-grade students at Lincoln School. How many more fourth-grade students than third-grade students are at Lincoln School? Show or explain how you found your answer.

39. Performance Tasks • Take approximately one to two class periods • Will “involve student-initiated planning, management of information & ideas, interaction with other materials and/or people, and production of an extended response such as an oral presentation, exhibit, product development, or an extended written piece.” • Combination of machine and teacher scoring

40. Quick Activity • In tables groups discuss the advantages of the Enhanced Selected Response (ESR) Items over traditional (4 response, best single answer). 2 minutes • Be prepared to share out

41. SBAC Bop Buddy VENTING ACTIVITY

42. Venting • Each table group writing (concisely) their “vents” on the half sheet of paper provided • Send ONE group member to SBAC Bop Buddy and TAPE the “vent list” to him. • One punch (not too hard yet) is allowed per table group (more punches later) • Total time 3 minutes

43. SBAC Sample Item Walk

44. Tools to Help • Technology Evaluation Tool • Flexible Administration Platforms • Blueprints • Interim & Formative Assessments • Cognitive Taxonomies • Knowledge of CCSS (what’s new?) • Instructional Videos (Teacher Channel) • Crosswalks (e.g., SCOE) • CDE, CCSS, & SBAC websites • Sample Items (Both from SBAC & ETS)

45. Traditional Blueprint 4th Grade Math, Number Sense Strand

46. SBAC Blueprint • Simplicity of Traditional Blueprint is confounded by… • Computer Adaptive Testing (CAT) • Multiple Standards assigned to same item • Likely SBAC Blueprint format… • Not as prescriptive as present format • Proportions of assessment assigned to groups of standards (Domains or Clusters)

47. SBAC Structure Start Year End Year Last 12 Weeks Summative Assessments Form Asmt Form Asmt Form Asmt • Performance Tasks • 1 Reading • 1 Writing • 2 Math Form Asmt Form Asmt Interim Assessment (CAT) Interim Assessment (CAT) • Computer Adaptive Assessment • 40-65 Items • ELA & Math • CR, SR, CE Retake Formative Assessments Optional & Probably Extra Cost

48. WestEd Study (March 2011)on SBAC Website • Which CCSS standards are Eligible for SBAC Summative Assessment (SA)? • Learnable within the school year • Expected content for all students at the grade level/span • Measurable via on-demand tasks in an end-of-the-year summative assessment

49. ELA Eligible (285/333) 3rd—35 of 42 4th—35 of 43 5th—35 of 43 6th—36 of 41 7th—36 of 41 8th—36 of 41 9th—36 of 41 10th—36 of 41 11th—36 of 41 12th—36 of 41 Not Eligible (48/333) All Grades Reading Standard 10 (both RL & RI) Writing Standards 6 & 10 Speaking & Listening Standard 1 Grades 4-5 Reading Foundational Standard 3 Grades 3-5 Reading Foundational Standard 4 Writing Standard 7

50. Math Eligible (270/316) 3rd—25/25 4th—28/28 5th—28/28 6th—31/31 7th—29/29 8th—27/28 9th—36 of 41 10th—36 of 41 11th—36 of 41 12th—36 of 41 Not Eligible (46/316) Grade 8 Geometry Standard 1 High School Grades Number & Quantity (43) Geometry (2)