Writing Objective Questions

1. Writing Objective Questions Hugh Davis Chris Havill The National CAA Centre at Luton

2. The Anatomy of an MCQ • Stem • Options • Key (correct answer) • Distracters And Don’t forget • Multiple Response • Numeric Answer • Text Answer • Hot Spot • True/False

3. Writing Stems: Present a single, definite statement to be completed or answered by one of the several given choices A Weak Question A 4 bit binary counter: a) Doesn’t have 4 flip-flops b) Has a maximum modulus of 8 c) Has a maximum modulus of 16 d) Has a terminal count of 15

4. Improved question: A 4 bit binary counter has a maximum modulus of a) 4 b) 8 c) 15 d) 16 e) 32

5. Avoid unnecessary and irrelevant material Weak Question A full adder can be constructed from two half adders and an OR gate, or with XOR and NAND gates. If you were to feed in the binary number 110 into such a device, the result would be: a) Sum=0, carry=0 b) Sum=0, carry=1 c) Sum=1, carry=0 d) Sum=1, carry=1

6. Improved Question The binary number 110 is fed into a full-adder, the result would be: a) Sum=0, carry=0 b) Sum=0, carry=1 c) Sum=1, carry=0 d) Sum=1, carry=1

7. Use clear, straightforward language in the stem of the item not a test of reading comprehension Weak question As the level of fertility approaches its nadir, what is the most likely ramification for the citizenry of a developing nation? • a decrease in the labour force participation rate of women • a dispersing effect on population concentration • a downward trend in the youth dependency ratio • a broader base in the population pyramid • an increased infant mortality rate

8. Improved Question A major decline in fertility in a developing nation is likely to produce • a.    a decrease in the labour force participation rate of women • b.   a dispersing effect on population concentration • c.    a downward trend in the youth dependency ratio • d.   a broader base in the population pyramid • e. an increased infant mortality rate

9. Use negatives sparingly. If negatives must be used, capitalize, underscore, embolden or otherwise highlight Weak question Which of the following is not a symptom of osteoporosis? • decreased bone density • frequent bone fractures • raised body temperature • lower back pain

10. Improved question Which of the following is a symptom of osteoporosis? • decreased bone density • raised body temperature • hair loss • painful joints

11. Put as much of the question in the stem as possible, rather than duplicating material. • Weak question Calculate the voltage VX. • Using Kirchoff’s voltage law VX is -32V • Using Kirchoff’s voltage law VX is +28V • Using Kirchoff’s voltage law VX is +32V • Using Kirchoff’s voltage law VX is -28V

12. Improved Question For the circuit shown, use Kirchoff’s voltage law to calculate the voltage VX. • -32V • +28V • +32V • -28V

13. For single response MCQ's, ensure that there is only one correct response. • Weak question import java.io.*; class FileHandling { public static void main (String [] args ) throws Exception { File f = new File("temp.tmp"); FileOutputStream s = new FileOutputStream(f); PrintStream p = new PrintStream (s); p.println("Hello World"); } } If one attempted to compile and run the above Java Program • It would fail to compile • It would execute without error • It would generate a run-time error on execution • It would print “Hello World” on the standard output (screen) • It would print “Hello World” to a file called temp.tmp

14. Improved Question import java.io.*; class FileHandling { public static void main (String [] args ) throws Exception { File f = new File("temp.tmp"); FileOutputStream s = new FileOutputStream(f); PrintStream p = new PrintStream (s); p.println("Hello World"); } } If one attempted to compile and run the above Java Program • It would fail to compile • It would generate a run-time error on execution • It would execute, but ask the user to specify the directory in which to create temp.tmp • It would execute without error and print “Hello World” on the standard output (screen) • It would execute without error and print “Hello World” to a file called temp.tmp

15. Writing Distracters: Use only plausible and attractive alternatives as distracters. • Weak question A narrative, English-like description of the logic of a program is called • Hypertext • A Storyboard • Pseudocode • Fiction • Rhetoric

16. Improved Questions A narrative, English-like description of the logic of a program is called • Hypertext • A Storyboard • Pseudocode • A structure chart • An overview diagram • In the other example, options 'd' and 'e' are not serious distracters.

17. Avoid giving clues to the correct answer. Weak Question The negatively charged fundamental particle is called an • proton • electron • neutron • quark

18. Improved Question The negatively charged fundamental particle is called a/an • proton • electron • neutron • quark

19. Avoid the choices "All of the above" and "None of the above". • "All of the above" - identify only two as correct • "None of the above" or identify one wrong and you have ruled this out. • "None of the above" does not find out whether the student knows the correct answer!

20. Additional points on Distracters • Distracters based on common student errors or misconceptions are very effective. • Correct statements that do not answer the question are often strong distracters.  • Avoid using ALWAYS and NEVER in the stem as testwise students are likely to rule such universal statements out of consideration. • Distracters should differ from the key in a substantial way, not just in some minor nuance of phrasing or emphasis • Provide a sufficient number of distracters. • 5 is best.