1 / 21

ITEM ANALYSIS

ITEM ANALYSIS. ARDHIAN SUSENO CHOIRUL RISA PRADANA P. ITEM ANALYSIS. is a process which examines student responses to individual test items (questions) in order to assess the quality of those items and of the test as a whole SCOREPAK ®. PURPOSE.

admon
Download Presentation

ITEM ANALYSIS

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. ITEM ANALYSIS ARDHIAN SUSENO CHOIRUL RISA PRADANA P.

  2. ITEM ANALYSIS is aprocess which examines student responses to individual test items (questions) in orderto assess the quality of those items and of the test as a whole SCOREPAK®

  3. PURPOSE • To improveitems which will be used again in later tests. • To eliminate ambiguous items in a single test administration. • To increase instructors' skills in test construction. • To identifyspecific areas of course content which need greateremphasis or clarity.

  4. Method • ITEM DIFFICULTY • ITEM DISCRIMINATIO ITEM CHARACTERISTIC CURVE 3. Item validity (point biserial method) 4. Effectiveness of distractors

  5. I. ITEM DIFFICULTY • item difficulty is determined by the number of people who answer a particular test item correctly (p). • For example, if the first question on a test was answered correctly by 76% of the class, then the difficulty level (p or percentage passing) for that question isp = .76. If the second question on a test was answered correctly by only 48% of the class, then the difficulty level for that question is p = .48. The higher the percentage of people who answer correctly, the easier the item, so that a difficulty level of .48 indicates that question two was more difficult than question one, which had a difficulty level of .76.

  6. Method of Item Difficulty • Method for Dichotomously Scored Item • Method for Polytomously Scored Item • Grouping Method

  7. a). Method for Dichotomously Scored Item Method for Dichotomously Scored Items p is the difficulty of a certain item. R is the number of examinees who get that item correct. N is the total number of examinees.

  8. Example 1 There are 80 high school students attending a science achievement test, and 61 students pass item 1. Please calculate the difficulty for item 1. Answer : 0.7

  9. b). Method for Polytomously Scored Items , the mean oftotal examinees’ scores on one item , the perfect scores of that item

  10. Example 2 The perfect scores of one open- ended item is 20 points, the average score of total examinees on this item is 11 points. What is the item difficulty? Answer : 0.55

  11. c). Grouping Method (Use of Extreme Groups) • Upper (U) and Lower (L) Criterion groups are selected from the extremes of distribution of test scores or job ratings is theproportion for examinees of upper group who get the item correct. is the proportion for examinees of lower group who get the item correct.

  12. Example 3 There are 370 examinees attending a language test. Known that 64 examinees of 27% upper extreme group pass item 5, and 33 examinees of 27% lower extreme group pass the same item. Please compute the difficulty of item 5. Answer : 0.49

  13. II. ITEM DISCRIMINATION • Item discrimination refers to the degree to which an item differentiates correctly among test takers in the behavior that the test is designed to measure. • item discrimination determines whether those who did well on the entire test did well on a particular item.

  14. Method of Item Discrimination a). Index of Discrimination D = pH - pL(7.5) We need to set one or two cutting scores to divide the examinees into upper scoring group and lower scoring group. pH is the proportion in the upper group who answer the item correctly and pL is the proportion in the lower group who answer the item correctly. Values of D may range from -1.00 to 1.00.

  15. ILLUSTRATION BY GGS INFORMATION SERVICES. CENGAGE LEARNING, GALE.

  16. Another example 50 Examinees’ Test Data on 8-Item Scale About Job Stress.

  17. Question: There are 140 students attending a world history test. (1) If we use the ratio 27% to determine the upper and lower group, then how many examinees are there in the upper and lower group separately? (2)If 18 examinees in upper group answer item 5 correctly, and 6 examinees in lower group answer it correctly, then calculate the discrimination index for item 5.

  18. ITEM VALIDITY :POINT-BISERIAL METHOD • ILLUSTRATION BY GGS INFORMATION SERVICES. CENGAGE LEARNING, GALE.

  19. Anotherway to determine the discriminability of an item is to determine the correlation coefficient between performance on an item and performance on a test, or the tendency of students selecting the correct answer to have high overall scores.POINT-BISERIAL METHOD

  20. Distractor (Incorrect Alternatives) • Analyzing the distractors (e.i., incorrect alternatives) is useful in determining the relative usefulness of the decoys in each item. Items should be modified if students consistently fail to select certain multiple choice alternatives. The alternatives are probably totally implausible and therefore of little use as decoys in multiple choice items. A discrimination index or discrimination coefficient should be obtained for each option in order to determine each distractor'susefulness .

More Related