160 likes | 290 Views
Cognitive Tutor ® Evaluation Results October 2001. Research. Based upon the ACT-R Theory Close observation of students 15 Years of applications to mathematics Developed with teachers Unit assessments are part of the R & D. Evaluation Methodology. Controlled comparisons
E N D
Cognitive Tutor® Evaluation Results October 2001
Research • Based upon the ACT-R Theory • Close observation of students • 15 Years of applications to mathematics • Developed with teachers • Unit assessments are part of the R & D
Evaluation Methodology • Controlled comparisons • Standardized tests • Problem solving and more complex assessments
Summary of Results • Students using the Cognitive Tutor® perform better than students in traditional math classes on: • Complex problem solving • Standardized assessments, including Math SAT, Iowa Algebra test, Texas End of Course Algebra test, and TIMSS • The benefits of just one Cognitive Tutor course are long-lasting: students taking Cognitive Tutor Algebra I continue to outperform their peers in later math courses using a traditional curriculum
Summary of Results (continued) • The Cognitive Tutor is effective with: • All ethnicities, including African American, Asian, Hispanic, and Caucasian • Summer school and the regular school year • Urban and suburban settings • Large and small schools
Cognitive Tutor: Better Performance Cognitive Tutor Algebra I Students Perform Better on Complex Problem Solving and Standardized Tests Koedinger, K. R., Anderson, J.R., Hadley, W.H., & Mark, M. A. (1997). Intelligent tutoring goes to school in the big city. International Journal of Artificial Intelligence in Education, 8, 30-43. Results from 3 studies in Pittsburgh and Milwaukee public schools, 1994-97.
Control Students Cognitive Tutor Students Algebra I & Geometry: Better Performance Students Completing Cognitive Tutor Algebra I and Geometry Perform Better on Complex Problem Solving and Standardized Tests Results from 2 studies in Pittsburgh Public Schools, 1998-99.
3 Course Sequence: Better Performance Students Completing the 3-Course Sequence Perform Better on Complex Problem Solving and Standardized Tests Results from 2 studies in Pittsburgh Public Schools, 1998-99.
Texas EOC Algebra Exam CognitiveTutor Algebra I Students Perform Better on the Texas EOC Algebra Exam
More Success in Later Math Class Cognitive Tutor Algebra I Students Succeed in Later Math Courses All students took same (traditional) Geometry and Algebra II courses; the students only differ in the curriculum used for Algebra I 28.6% of Cognitive Tutor Algebra I students passed Algebra II 16.7% of traditional Algebra I students passed Algebra II
Success in Summer School Cognitive Tutor Algebra I Has Been Successful as a Summer School Program
Benefits to Caucasians and African-Americans Performance on Standardized Tests from Pittsburgh Study, 1994 with both groups using Cognitive Tutor Algebra I Summer School Pass Rates at San Francisco, Summer 2000 %Correct African American(n=68) Caucasian (n=12) Pretest Posttest African-American Students Caucasian Students
“Closing the Gap” “Closing the Gap” Between African American and Caucasian Students Pre and Post Cognitive Tutor Performance on Standardized Tests from Pittsburgh Study, 1994
Benefits to Hispanic Students Results from 1-Semester Pilot in Denver, CO; Fall 1999-2000 Overall Course Performance End of Course Test Results Control Students Cognitive Tutor Students
Before Cognitive Tutor (1999) Cognitive Tutor (2000) Benefits to Hispanic Students Cognitive Tutor Algebra I Benefits Hispanic Students Pass Rates on Texas End of Course Algebra Exam Among Hispanic Students in El Paso
For More Information Please visit our Web site at www.carnegielearning.com/results • Detailed Results Reports corresponding to the studies summarized in this presentation • Guide to Interpreting Evaluations • Guide to Conducting Your Own Evaluation