วณิช วรรณพฤกษ์

1. ???????????????? ??? ?????????? ???? ?????????

2. ???????????

3. ?????????????????????? ????????????????? ????????? ???????????????????????????? ???????????? ?????????? ???????????

4. This Session Addresses the Following Questions What is standard setting? - Why is standard setting used? - Who should pass and fail? Which method of standard setting is preferable? - How does one decide which method to use? - When should standard setting be used? Where can one find related evidence?

5. ???????????? 1. ?????????????????????????????????? 2. ????????????????? 3. ???????????????????? 4. ?????????????????????????????????????????? 5. ??????????????????????????????????????????????????????? ?????????????????

7. A test score is a piece of information about a person. How can you use that information to make a decision ?

8. ????????

10.   ?????????????? ?????????????????????????? ??? - ?? ???? - ??????? ????????????? � ????????????????

11. ??????????:??????????  ?????????????????????????: ???????????????  ????????????

12. IT is Obviously Impossible To Set Acceptable Standards On Unacceptable Test

13. Standard Setting  and  Grading ???? ????????? 28 ??????? 2553

14. Standard Setting is the process of demarcating the minimal level of knowledge and skill required and identifying a score on the examination that corresponds to it

15. Type of Standards Relative; expressed in terms of the performance of a group of examinees. absolute ; expressed in terms of the performance of examinees against the test material.

16. Standard Setters ??????????????????????????? ???????????????????????????????? ??????????????????????? ??????????????????????????????????????? ????????????????????????????????????

17. Standard Setting methods Relative methods Absolute methods; test centered Absolute methods ; examinee centered Compromise methods.

18. Relative methods Fixed-percentage methods; student selection Reference group method

19. Absolute methods; test centered (Angoff and Ebel ) Angoff - ??????? 5 ???????????????????????????????????????? ?????????????????????????????????????????????????? - ?????????????? ??????????????????????? - ??????????????????? 5 ??????????????? - ???????????????????????????????????????

21. Absolute methods; test centered(Angoff and Ebel ) Ebel ????????????????? ???? ???? ??????? ??? ??? ??????????????? (???????-????) ???????????????????????? ????????????????????????????????????????????????????????????? (???????) ??????????????????????????????????????????????????????????? ??????????????? ?????????????????????????????????????????????????????? ??????????????????????? 4 ???????????????????????????????

23. Absolute methods ; examinee centered ( contrasting group) ???????????????????????? ?????????? ????????????????????????????????????? ???????????????????????????????? ??????????????????????????????????????????????????????????????????????????? ???????????????????????????? ?????????????

26. Compromise methods Hofstee methods ????????????????????????????????? ????????????????????????????????????????????????????? ????????????????????????????????????????????????????????????????????????? ???????????? 4 ????????????????? ?????????????????????????????????????????????????????????????????????

27. Difficulty Index (DI) Acceptability index (AI)= DI ??????????????????????? ??????????????????????????????????????????????? ????????????????????????????????????????? multiple choice

28. ?????????????? AI Medical Education Center at U. of Illinoise at Chicago ?????????????????????????? -??????????? ?????????????? 2 -???????????????????????????? ?????????????? 0 -????????????????????????????????????????? ?????????? ???? 1.5 -??????????????????????????????? ????????????????????? 0.5- 1.0

29. ?????????????? AI (???)

30. Minimal passing level ????????????? MPL ???????????????? ( MCQ) ????? AI ??????????????????? ????????????????????????? MPL= =

31. ?????????????? AI ???????????????????????? ????????????????????????????????? ????????????? ?????????????????????????????????????????????????????????????? ???????? ???????????????? ?????????????????????????????????????????? 20 ?? ?????? ????????? ??????????????????????????????? ?????????????? ?????????????????? ???????????? ???????????? ??????????????

32. ?????????????????????? assessment ???????????????????? competency ??? professionalism

33. Components of Professionalism Professionalism requires a person to be; Knowledgeable and skilled. Continuously update their expertise and proficiency. Well in communication skill. Trusted by society; honesty/integrity, responsibility, respect for others, compassion/empathy, self-improvement, knowledge of limits, altruism,

34. ??????????????????? ?????????????????????? ?????????????????????????????? ????? ????????????????????????????????????

36. ??????????????(?????????????????????????) ???????????????? (Ranking) ????????????? (Frequency of distribution) ????????????????????????????? (Grouped frequency distribution) ???????????? (Median) ?????????????????? (Arithmetic mean)

38. Derived Score *????? percentile *????? ??????? - Z score - T - score

39. ???????????????????? ????????????????????????????????????????????????????????? ????????????????????? ??????????????????????????????? ???? ???????????????? 80 ???????????????????????????????? 70 ????????????????? 70 ???????????????????????????? 80

40. Percentile = (cf + � f) 100 N f = ????????????????????????? cf = ??????????? (cf + � f) = ?????????????????? = ??????????? ??????????????? + � ?????????????? ????????? N = ??????????????????????

41. ?????????????????????????????????????????

42. ??????????????????????? ?????????????????????

43. Z - score ????????????????????????????????????????????????????????? ????????? Z ???????????????????????????????????????????????????????? ???????????????????? ???????????????????? ????? X ??? SD ????? ??? ??????????????????? = 0 ??????????????????? (SD) = 1 z = x � x SD ??????????? x = ?x N = ??????????????? SD = ? (x � x )2 N

44. ???????????????????????????????????????? 50 ??????????????????????????????? ??? ???? ??? =10 T = 10 z + 50 T - score

45. ???????????????????? z ???? T

48. ?????????? ???????????????????????????????????????????????? ??????? mean ??? SD ???? SEM ????????????????????????????? (class ability levels)-Dewey B.Stuit

49. ???????? Grade Point Average (GPA) : ???.????? 4 ?????????? 2546

50. ?????????????? ?????????????????????????????????????????????????????????? (distribution curve) ?? X ??? S.D. ???????????????????????? A,B,C,D,F ???????????????????????????????????????????????????????????????? 6 ????(x+3S.D.) ???????????????????? ??? c ??????????????????

52. ???????????????????????(Grading system) ??????????????????????????????????? (Absolute marking system) ?????????????????????????????????????????????????? (Relative marking system)

53. ???????????????????????????????? > 85 - A 75 � 84 - B 65 � 74 - C 55 � 64 - D 45 � 54 - F

54. ????????????? ????????????????????????????? 1. ?????????? (range) 2. ???????????????????????????????

55. ?????????? ???????? ??????? (T-score) ????????????? =88 ????? ?????? =25 ??????????? 8 ????? ???????????? = ??????????? - ??????????? ? ????? = 88 � 25 = 63 ????? = 7.86 = 8 A = 81 � 88 B + = 73 � 80 B = 65 � 72 C+ = 57 � 64 C = 49 � 56 D + = 41 � 48 D = 33 � 40 F = 25 � 32

56. ???????????????????????? 1. ???????????????????? - Validity -Reliability - Usability 2. ??????????????????????????????????

57. Relative marking system (norm reference) A = > x + 1.5 SD B = x + 0.5 SD x + 1.5 SD C = x + 0.5 SD x � 0.5 SD D = x � 0.5 SD x �1.5 SD F = < x � 1.5 SD

58. ??????????????????????????? normalized T-score 1. ?????????????????????????????????? ???????????????????????????????????? T 2. ?????????????????????????????????????????????????????????? ??????????????????????????????????????

60. ????????????? Dewey B. stuit 1. ????????????????? (Median) 2. ????????????????????????????? (SD) 3. ???????????????????? A 4. ??????????????????????????????????????????? 5. ???????????????????

61. ????????????????? ??? Dewey B.Stuit ???????????????????????????? ??????????????????????????????????????? ?????????????????????????? ?????????????????????????????????????? ??????????????????????????????????????

62. ??????????????? ???????????? A ?????? = 0.7 x SD ????? = 0.9 x SD ?? = 1.1 x SD ????? = 1.3 x SD ??????? = 1.5 x SD ???? = 1.7 x SD ??????? = 1.9 x SD

63. ????????????????????????????? ???????????? A

68. ????????????????????????????????????????? (SEM) A > x + 1.5 SEM x + 1.5 SEM > B > x + 1 SEM x + 1 SEM > C > x � 1 SEM x � 1 SEM > D > x � 1.5 SEM x � 1.5 SEM > F

70. ??????????????? 1. Norm references 2. Criterion references

71. ???????? passing score ????????????????? Absolute standard � criterion reference ????????????????????? ??????????? 60% ??????????????????? ??????????????????????????? ???????????????????????????????????????????????????????????? ??????????? prerequisit ??????????????????????????????????????????????????????????????????????????? �minimal passing level

72. Passing score : The lowest level of Performance that will be considered acceptable

73. ???????????? ???????????? ???????????

74. ??????????????????????????????? ????????? ???????????????????????????? ????????? ??????????????????

75. ????????? - Nedelsky�s - Angof�s - Ebel�s ?????????

76. 1. ????????????????????? 2. ????????????????????????????????? 3. ?????????????????????????????? 4. ????????????????????????????? 5. ???????????????????????????????????????????? 6. ????????????????????????????????????????????????????????????? ??????????????????

77. 1. ??????????????????????????????? 2. ???????????????????????????? Validity ??? reliability 3. ????????????????????????????????? 4. ?????????????????????????? ?????????????????? 5. ??????????????????????????? ??????????????????????? ??????????

78. ??????????(???) 6. ????????????????????????? 7. ?????????????????????????? - ??????????? - ?????????????????? 8. ?????????????????????????????????? 9. ?????????????????????????????? 10. ???????????????????