Item Banking Neil Wilkinson Item Banking 2 Test

Item Banking Neil Wilkinson

Item Banking 2 • Test development • Item banking • What data is stored • Why use item banking • Item bank features • Keys to successful item banks Presentation Title runs here l 00/00/00

Test Development

Test Development Analyse Job Analyse Stats Write Administer Set Standard Review Build Exam

Item Banking Statistics History Content Scoring Learning Outcome References + Management + Searching +Reporting +Auditing Test Review Process Item = Item Bank Author Status Other Data

Item banking

Item banking is the process of storing all of your items and related data

Item bank An item bank could be a database, a word document, an excel document, anything that ties together content with related data.

What data

Content • The question you are asking • Distractors • Graphics • Other Material (audio/video/pdf/graphics)

Scoring • The correct answer or key • Sample responses • Rationale • Alternative scoring

Learning Outcome • The learning outcome/syllabus/objectives are generally stored in a tree structure • Every item might have one or more classification • Each author might write to a particular section • Used for gap analysis

Reference • It is often useful to store a reference to something that proves the item correct • It could be a book, journal webpage or other • This gives you the ability to check the quality and validity of the item

Other Data • Items often have meta-data • This should be configurable and searchable • Often a mix of response types (free-text, drop down lists, combo boxes) • Eg Blooms Taxonomy, item status

Review Process • Items may have a review process • Each step might have outcomes • Items might need to be tracked through the process • Example: ‘how many items are currently at 1 st Editorial Review? ’

Statistics • Items may have statistics generated by a measurement expert • Statistics could have come from many exam sittings • Often used in test construction • Used to review author and item performance

Test Build • Items will be added to a test • The test will be exported for delivery in some environment • The test could be in many formats, including Word/QTI/XML

History • Who reviewed an item? • What was changed? • What tests has it been delivered in? • How did it perform?

Why?

Why Item Bank Increased reliability. Good items can be reused, bad items can be retired.

Why Item Bank Increased consistency. Review steps allow all items to go through the same review process.

Why Item Bank To allow reporting on program status

Why Item Bank Increased speed of creating tests

Why Item Bank Customised workflow for your items.

Why Item Bank Ability to build an audit trail for your items.

Why Item Bank Increased security of items.

Item bank features

Item Bank Features • Item authoring • Remote item authoring • Support of multiple item types • Item banking • Search capabilities • Import/export capabilities • Batch editing capabilities

Item Bank Features • Test construction • Test assembly • Export features • Ancillary features • Security and access • Workflow management • Project tracking

Key features

Key features of successful Item Banks • Thoughtful creation of meta-data • Item bank manager • Solid processes • Consistency • Training • Migration • Stakeholder buy in

Thank you!