1 / 7

Psychometric Issues in the Use of Testing Accommodations

Psychometric Issues in the Use of Testing Accommodations. Chapter 4 David Goh. Testing Accommodations and Psychometric Soundness. Federal and state laws require that nonbiased procedures be used in assessment

dorjan
Download Presentation

Psychometric Issues in the Use of Testing Accommodations

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Psychometric Issues in the Use of Testing Accommodations Chapter 4 David Goh

  2. Testing Accommodations and Psychometric Soundness • Federal and state laws require that nonbiased procedures be used in assessment • But does using testing accommodations make the technical aspects of the tests questionable? • Reliability: accuracy • Validity: effectiveness, consistency and stability of scores

  3. Standardization • Standardization implies uniformity of procedures in administering a test and scoring the results • Poses a problem for diverse learners who exhibit different physical, sensory, linguistic, cultural and or psychological qualities from the general population • In theory all accommodations compromise standardization, so issues of validity and reliability need to be examined

  4. Reliability • Refers to consistency and stability • High reliability produces consistent results • Low reliability produces inconsistent results • Ex- ELLs using a bilingual interpreter may make different interpretations • Accommodations and modifications may increase measurement errors and decrease reliability • Methods of examining reliability include comparing scores of the same test takers on different administration, with different sets of times, or with different scores or examiners

  5. Validity • Refers to effectiveness- is the test testing what it intended • If used right- accommodations can increase validity • If used inappositely, accommodations may nullify the results • Types: content, response process, internal structure, other variables, and consequences of testing

  6. Effect of Accommodations • Limited evidence on the effect of test accommodations on reliability and validity • Studies have shown that testing accommodations on SAT and GRE did not significantly effect reliability and validity • However, findings are not generalizable • But, some accommodations have been found to increase student performance- ex- extended time

  7. Flagging Test Scores • On large scale test a very controversial issue • Reveals examinee has a disability; prompts invalid inferences about score and prejudice; identifies and violates person with disabilities privacy that is protected under the law • If comparability can be demonstrated between standard and non-standard administration, there is no need to flag • However, if test results are not comparable, then testing accommodations need to be noted and explained

More Related