Principles of Assessment and Evaluation GENERAL PRINCIPLES OF

Principles of Assessment and Evaluation GENERAL PRINCIPLES OF ASSESSMENT Created bt Zuraimi Zakaria Not to be distributed or reproduced without permission

Principles of Assessment and Evaluation Latent Trait Theory The Concept of Noise Important Types of Assessment Created bt Zuraimi Zakaria Not to be distributed or reproduced without permission

Principles of Assessment and Evaluation GENERAL PRINCIPLES OF ASSESSMENT Created bt Zuraimi Zakaria Not to be distributed or reproduced without permission session three Latent Trait Theory

Principles of Assessment and Evaluation GENERAL PRINCIPLES OF ASSESSMENT Created bt Zuraimi Zakaria Not to be distributed or reproduced without permission session three In the classroom, teachers often have to measure traits or variables that cannot be physically seen. QUESTION If the construct or domain assessed is invisible, how can assessment be carried out?

Principles of Assessment and Evaluation GENERAL PRINCIPLES OF ASSESSMENT Created bt Zuraimi Zakaria Not to be distributed or reproduced without permission session three Remember two types of variables: LATENT VARIABLES MANIFEST VARIABLES

Principles of Assessment and Evaluation GENERAL PRINCIPLES OF ASSESSMENT Created bt Zuraimi Zakaria Not to be distributed or reproduced without permission session three What do we base our inferences on? write say do make

Principles of Assessment and Evaluation GENERAL PRINCIPLES OF ASSESSMENT Created bt Zuraimi Zakaria Not to be distributed or reproduced without permission session tthree big idea vs. little idea 1 BIG IDEA Little Idea

Principles of Assessment and Evaluation GENERAL PRINCIPLES OF ASSESSMENT Created bt Zuraimi Zakaria Not to be distributed or reproduced without permission session tthree big idea vs. little ideas 1 2 3 4 5 BIG IDEA Little Ideas

Principles of Assessment and Evaluation GENERAL PRINCIPLES OF ASSESSMENT Created bt Zuraimi Zakaria Not to be distributed or reproduced without permission session tthree latent variable & manifest variables latent trait intelligence 1 task 2 task 3 task 4 task 5 task evidence manifest variables

Principles of Assessment and Evaluation GENERAL PRINCIPLES OF ASSESSMENT Created bt Zuraimi Zakaria Not to be distributed or reproduced without permission session three QUESTION If determination of students’ abilities are based on inferences, how accurate can it be?

Principles of Assessment and Evaluation GENERAL PRINCIPLES OF ASSESSMENT Created bt Zuraimi Zakaria Not to be distributed or reproduced without permission session three Noise

Principles of Assessment and Evaluation GENERAL PRINCIPLES OF ASSESSMENT Created bt Zuraimi Zakaria Not to be distributed or reproduced without permission session three the concept of noise 1 2 3 1 3 3 1 4 3 1 5 3 intelligence 3 latent trait 1 1 evidence noises

Principles of Assessment and Evaluation GENERAL PRINCIPLES OF ASSESSMENT Created bt Zuraimi Zakaria Not to be distributed or reproduced without permission session tthree example of item with noise Siti sells biscuits during Sunday sales. When she opens her stall, she has 469 tins of biscuits. Each tin contains 300 pieces. By 10 a. m. , she has sold 227 tins. Two customers returned back two tins each as they have exceeded the expiry dates. By the time she closes her stall, she has sold another 48 tins. How many pieces of biscuits does Siti have left?

Principles of Assessment and Evaluation GENERAL PRINCIPLES OF ASSESSMENT Created bt Zuraimi Zakaria Not to be distributed or reproduced without permission session tthree example of item with noise Many of the skills used in public speaking are the same as those used in everyday conversation. These skills include a. b. c. d. e. organizing your thoughts logically. tailoring your message to audience. adapting to listener feedback. all of the above. b and c only.

Principles of Assessment and Evaluation GENERAL PRINCIPLES OF ASSESSMENT Created bt Zuraimi Zakaria Not to be distributed or reproduced without permission session tthree example of item with noise

Principles of Assessment and Evaluation GENERAL PRINCIPLES OF ASSESSMENT Created bt Zuraimi Zakaria Not to be distributed or reproduced without permission session three what should you do? Your goal in any assessment is to reduce the noise as much as possible!!!

Principles of Assessment and Evaluation GENERAL PRINCIPLES OF ASSESSMENT Created bt Zuraimi Zakaria Not to be distributed or reproduced without permission session tthree Let’s take a break!!!

Principles of Assessment and Evaluation GENERAL PRINCIPLES OF ASSESSMENT Created bt Zuraimi Zakaria Not to be distributed or reproduced without permission session tthree Now… let’s look at… Important terms in assessment that every teacher must know!!!

Principles of Assessment and Evaluation GENERAL PRINCIPLES OF ASSESSMENT Created bt Zuraimi Zakaria Not to be distributed or reproduced without permission session three Types of Assessment

Principles of Assessment and Evaluation GENERAL PRINCIPLES OF ASSESSMENT Created bt Zuraimi Zakaria Not to be distributed or reproduced without permission session tthree They are … Informal vs. Formal Assessment Formative vs. Summative Assessment Norm-Referenced Testing vs. Criterion Referenced Testing Assessment of Learning, Assessment for Learning vs. Assessment for Teaching REMINDER : Oh, do remember them by heart cause they will be repeatedly used this class.

Principles of Assessment and Evaluation GENERAL PRINCIPLES OF ASSESSMENT Created bt Zuraimi Zakaria Not to be distributed or reproduced without permission session tthree Formal Assessment Formal ways of knowing how much a student has learnt or improved during the instructional period. For examples, exams, diagnostic test, achievement tests, intelligence tests, etc. All formal assessments have standardized methods of administering and scoring the tests.

Principles of Assessment and Evaluation GENERAL PRINCIPLES OF ASSESSMENT Created bt Zuraimi Zakaria Not to be distributed or reproduced without permission session tthree Informal Assessment Allows teachers to carry out assessment while teaching and learning process is ongoing, without making use of standardized tests and scoring patterns. Eg. Running records, observation, anecdotal notes, etc.

Principles of Assessment and Evaluation CLASSROOM ASSESSMENTS Created bt Zuraimi Zakaria Not to be distributed or reproduced without permission session six the relevance of informal assessment i. It can be administered at any point of teaching process ii. Data from informal assessment can be immediately used to intervene student learning, unlike test which requires data to be collected in a procedural fashion, and processed before it can be used to inform teaching iii. It requires less effort for teachers to administer iv. Can be immediately targeted to suit individual student’s learning needs.

Principles of Assessment and Evaluation GENERAL PRINCIPLES OF ASSESSMENT Created bt Zuraimi Zakaria Not to be distributed or reproduced without permission session tthree Formative Assessment carried out while the lessons are ongoing for the purpose of improving teaching and learning process. The evidence derived from formative assessment is used to improve current teaching effectiveness and/or to intervene students’ learning. QUESTION Can you think of examples of formative assessment?

Principles of Assessment and Evaluation GENERAL PRINCIPLES OF ASSESSMENT Created bt Zuraimi Zakaria Not to be distributed or reproduced without permission session tthree Formative Assessment Teacher Observation in Formative Assessment Teacher observation provides useful information about student learning: 1. It allows teachers to immediately intervene student learning. Tests are only carried out three or four times a year and it might be too late to do the teaching intervention based on evidence from the test.

Principles of Assessment and Evaluation GENERAL PRINCIPLES OF ASSESSMENT Created bt Zuraimi Zakaria Not to be distributed or reproduced without permission session tthree Teacher Observation in Formative Assessment 2. Teacher observation has no incurred cost and not time consuming, as compared to other forms of formative assessments which require careful planning and time. 3. It enables teachers to better target their teaching. Teachers are able to gauge the effectiveness of the lesson and make improvement to their teaching.

Principles of Assessment and Evaluation GENERAL PRINCIPLES OF ASSESSMENT Created bt Zuraimi Zakaria Not to be distributed or reproduced without permission session tthree Summative Assessment carried out at a point in time (usually at the end of teaching year/ semester/topics) aimed in capturing students’ performance or achievement, usually for the purpose of reporting. QUESTION What are some examples of summative assessment?

Principles of Assessment and Evaluation GENERAL PRINCIPLES OF ASSESSMENT Created bt Zuraimi Zakaria Not to be distributed or reproduced without permission session tthree Norm-referenced Testing An assessment where student performance is compared to a larger group or ‘norm group’. The purpose is usually to sort students and not to measure achievement toward some criterion or performance. The National Center for Research on Evaluation, Standards and Student Testing (1996)

Principles of Assessment and Evaluation GENERAL PRINCIPLES OF ASSESSMENT Created bt Zuraimi Zakaria Not to be distributed or reproduced without permission session three Criterion-referenced Testing An assessment where an individual’s performance is compared to a specific learning objective or performance standard and not to the performance of other students.

Principles of Assessment and Evaluation GENERAL PRINCIPLES OF ASSESSMENT Created bt Zuraimi Zakaria Not to be distributed or reproduced without permission session three bla bla bla! But what do they mean?

Principles of Assessment and Evaluation GENERAL PRINCIPLES OF ASSESSMENT Created bt Zuraimi Zakaria Not to be distributed or reproduced without permission session three nrt Test score tells a student where he stands in terms of total number of possible points (e. g. Jamal scored 80 out of 100 marks). Or in terms of other students in the class (Jamal received the highest score in the class).

Principles of Assessment and Evaluation GENERAL PRINCIPLES OF ASSESSMENT Created bt Zuraimi Zakaria Not to be distributed or reproduced without permission session three more on nrt Through grades, teachers convey messages to students about their judgment of students’ work: their work is excellent, very good, satisfactory. This is helpful information, but what does it mean?

Principles of Assessment and Evaluation GENERAL PRINCIPLES OF ASSESSMENT Created bt Zuraimi Zakaria Not to be distributed or reproduced without permission session three more on nrt In other words, test scores and grades help teachers monitor student learning, but they do very little to promote learning.

Principles of Assessment and Evaluation GENERAL PRINCIPLES OF ASSESSMENT Created bt Zuraimi Zakaria Not to be distributed or reproduced without permission session three nrt versus crt Solution: CRT enables the teacher to monitor student learning as well as promote student learning.

Principles of Assessment and Evaluation GENERAL PRINCIPLES OF ASSESSMENT Created bt Zuraimi Zakaria Not to be distributed or reproduced without permission session three crt: MUET bands aggregated score band 260 -300 6 very good user very good command of the language very fluent, accurate and appropriate; hardly any inaccuracies high level of understanding of the language functions extremely well in the language 250 -259 5 good user good command of the language fluent, appropriate but with minor inaccuracies good level of understanding of the language functions well in the language 180 -219 4 competent user satisfactory command of the language generally fluent, usually appropriate but with occasional inaccuracies satisfactory level of understanding of the language functions reasonably well in the language 140 -179 3 modest user fair command of the language fairly fluent, usually appropriate but with noticeable inaccuracies. able to understand but with some misinterpretation able to function well but with some effort 100 -139 2 limited user limited command of the language lacks fluency and appropriacy; inaccurate use of the language resulting in frequent breakdowns in communication limited understanding of the language limited ability to function in the language 1 extremely limited user poor command of the language poor understanding of the language hardly able to function in the language below 100 user command of language communicative ability inappropriate and inaccurate use of the language resulting in very frequent breakdowns in communication understanding task performance

Principles of Assessment and Evaluation GENERAL PRINCIPLES OF ASSESSMENT Created bt Zuraimi Zakaria Not to be distributed or reproduced without permission session three crt: IELTS bands BAND DESCRIPTIONS 9 Expert User 8 Very Good User 7 Good User 6 Competent User 5 Modest User 4 Limited User 3 Extremely Limited User 2 Intermittent User 1 Non User 0 Did not attempt the test Has fully operational command of the language: appropriate, accurate and fluent with complete understanding. Has fully operational command of the language with only occasional unsystematic inaccuracies and inappropriacies. Misunderstanding may occur in unfamiliar situations. Handles complex detailed argument well. Has operational command of the language, though with occasional inaccuracies, inappropriacies and misunderstanding in some situations. Generally handles complex language well and understands detailed reasoning. Has generally effective command of the language despite some inaccuracies, inappropriacies and misunderstandings. Can use and understand fairly complex language, particularly in familiar situations. Has partial command of the language, coping with overall meaning in most situations, though is likely to make many mistakes. Should be able to handle basic communication in own field. Basic competence is limited to familiar situations. Has frequent problems in understanding and expressions, is not able to use complex language. Conveys and understands only general meaning in very familiar situations. Frequent breakdowns in communication occur. No real communication is possible except for the most basic information using isolated words or short formulae in familiar situations and to meet immediate needs. Has great difficulty understanding spoken and written English. Essentially has no ability to use the language beyond possibly a few isolated words. No assessable information provided.

Principles of Assessment and Evaluation GENERAL PRINCIPLES OF ASSESSMENT Created bt Zuraimi Zakaria Not to be distributed or reproduced without permission session three linking CRT to teaching and learning 1. The learning standards or criteria describe students’ current abilities or skills. 2. The learning standards or criteria indicate the level of learning where teachers should target next in their teaching. 3. The learning standards or criteria inform the progress made by the students throughout the teaching period.

Principles of Assessment and Evaluation GENERAL PRINCIPLES OF ASSESSMENT Created bt Zuraimi Zakaria Not to be distributed or reproduced without permission session three cumulative grade point average (cgpa) Regarded as indication of students’ abilities and often serves as a way of ranking and distinguishing people for purposes of university admissions, scholarship awards and job interviews. Each grade a student earns is weighted according to a uniform scale so that a single number can be used to express grades earned over a semester, year or the entire academic career.

Principles of Assessment and Evaluation ASSESSMENT FOR LEARNING Created bt Zuraimi Zakaria Not to be distributed or reproduced without permission session eleven assessment-OF-learning

Principles of Assessment and Evaluation ASSESSMENT FOR LEARNING Created bt Zuraimi Zakaria Not to be distributed or reproduced without permission session eleven assessment-OF-learning Traditionally, assessments were utilised to measure the learning of content and skills taught. When teachers plan and construct a particular assessment, the focus would be on what the students have learnt.

Principles of Assessment and Evaluation ASSESSMENT FOR LEARNING Created bt Zuraimi Zakaria Not to be distributed or reproduced without permission session eleven However, assessment can provide pertinent information about student learning that can be used to improve our teaching and to improve student learning after the assessment is carried out.

Principles of Assessment and Evaluation ASSESSMENT FOR LEARNING Created bt Zuraimi Zakaria Not to be distributed or reproduced without permission session eleven Assessment-FOR-learning

Principles of Assessment and Evaluation ASSESSMENT FOR LEARNING Created bt Zuraimi Zakaria Not to be distributed or reproduced without permission session eleven assessment-FOR-learning In assessment-FOR-learning, data from assessment is used to gear the teaching and learning process after that particular assessment is carried out. In other words, data derived from a particular assessment informs intervention strategies that can be targeted to improve teaching and student learning.

Principles of Assessment and Evaluation ASSESSMENT FOR LEARNING Created bt Zuraimi Zakaria Not to be distributed or reproduced without permission session eleven features Assessment-OF-learning assessment-FOR-learning Focus on ‘What students have learnt? ’. Focus on ‘What students learn next? ’. Student performance is ranked (normedreferenced). Student performance is compared to a set of standards (criterion-referenced). Teaching and assessment are the sole right of teachers. Teachers and students work as a team in deciding instructional content and assessment. Assessments motivate students to try to learn. Assessment is frequent. Assessment data is used to report student learning. Focus on achievement. Assessments provide information for students to take ownership of their own learning and achieve success. Assessment is continuous. Assessment data is used to scaffold individual learning. Focus on progress.

Principles of Assessment and Evaluation GENERAL PRINCIPLES OF ASSESSMENT Created bt Zuraimi Zakaria Not to be distributed or reproduced without permission session three end of session three…