Item writing art or science Maj Corina ISPAS

Item writing: art or science? Maj. Corina ISPAS NDFLTC Chief of SLP Section

Item writing • a matter of precision more akin to a computer programming than to writing purpose

Items vs question • • not always in question format they should be discrete one item is part of a larger whole they occur gradually

Item development • Where does test-writing expertise come from?

Test specifications

Item types or format • all items use stimulus material • all items have at least one “right” answer • all items will have inadequate or wrong answers

Item writing guidelines • Format • Content • Structure • Response development

What item serves best? • • • MCQ SAQ Essay length written discourse Role-play Other…

Characteristics of a good item? • it tests what it is supposed to be testing • it co vibrates with the profile of the target population • content is relevant to the objective • it is not biased or completely unknown/unavailable to candidates

• comes in a variety of shapes and forms • facilitates the item writer enough time to ponder • pre-set scoring procedures and assessment criteria • co-professional input: “the more the merrier”

A good item is the result of creative act paneling process public acceptance

Other characteristics Independence. Distracter Stem item as a Test/Item in relation Length discrete to other items test element Keyed answer item as the integrity of the test as a whole

But, is it a good item? OBJECTIVITY BALANCE SPECIFICITY

• Provide enough information of what it is expected poor: Write about what you did in your summer holiday. better: Write about your summer holiday. Include details and information about places you visited and things you did. • Indicate the amount expected in the response poor: Tell us your opinion about globalization. better: Give 2 -3 arguments in sustaining your opinion about globalization.

• Keep items of similar format/content together • Avoid ambiguity poor: Do you know what the word “enunciate” means? better: The word “enunciate” means…. . • Designate specific units in the instructions. poor: What is the total time of the journey? better: The journey took…. . hours and …… minutes.

• Indicate the criteria of assessment • Introduce the new/unfamiliar tasks by samples or explanation • Indicate the expected structure/ organization • Provide any useful advice • Train your invigilators • Train the scoring team

Questions?