Question Level Analysis The good the bad and

Question Level Analysis The good, the bad and the ugly Austin Booth Blog: http: //eviedblog. wordpress. com/ @lazyrunner 78

What have my students really learnt? Learning is a change in long-term memory (Sweller & Kirschner). Assessment for Learning tell us about performance.

http: //kevs-variability-thoughts. blogspot. co. uk/2013/04/givingsummative-tests-formative-impact. html

20 -25% general overall improvement

“Find out what children don't know & teach it to them” Stephen Tierney, CEO of the Blessed Edward Bamber Catholic Multi Academy Trust @Leading. Learner https: //leadinglearner. me/2016/07/03/12 -pointers-towardsgreat-teaching-assessment-and-learning/

Like anything, to get results it has to be used in the right way

The ugly…

http: //thescienceteacher. co. uk/question-level-analysis/

Vs

• Invalid inferences. • Not being specific enough in pinpointing what the question is assessing. • Looking at whole questions and not individual question items.

The bad…

Source: OCR J 560 -06 H SAM

Using assessments composed of only past paper questions. What Would be better?

The good…

• Be specific in pinpointing what the question is assessing. • Looking at individual question items. • Don’t use assessments composed of only past paper questions.

What do I do with the data?

Strategies I’ve used 1. Amber topics: – Further practice through lesson starters (often different and unrelated to the lesson content) – Peer teaching 2. Red topics (<35%) need re-teaching 3. Regular low-stakes multiple choice / short answer quizzes 4. Specific homework for select topics 5. Pupil self assessment

QLA System If you want an easy way to get started using QLA. . . https: //app. flexassessment. com/register

Thanks for listening! Austin Booth Blog: http: //eviedblog. wordpress. com/ @lazyrunner 78