PAPER SETTING PRINCIPLES AND PRACTICES G Balasubramanian The

PAPER SETTING PRINCIPLES AND PRACTICES G Balasubramanian

The case of the forest school ◦ Who passed the exam? 12/7/2020

Road Map Skills of paper setting Set a question paper with Marking scheme Understandin g the principles of paper setting

Which are the familiar words we use during testing? E A

Why do we want to test people? �Certifying �Qualifying �Selecting �Eliminating �Classifying �Searching

What are the different modes of testing?

Criterion-Referenced Eval’s �Based on a predetermined set of criteria. �For instance, ◦ ◦ ◦ 90% and up = A 80% to 89. 99% = B 70% to 79. 99% = C 60% to 69. 99% = D 59. 99% and below = F

Criterion-Referenced Eval’s �Pros: ◦ Sets minimum performance expectations. ◦ Demonstrate what students can and cannot do in relation to important contentarea standards (e. g, ILS). �Cons: ◦ Some times it’s hard to know just where to set boundary conditions. ◦ Lack of comparison data with other students and/or schools.

What is the position of the evaluation in the learning Pyramid?

Cognitive Domain

Taxonomy of Affective domain

Psycho-Motor Domain

Bloom’s Taxonomy

Testing knowledge Dimensions �Factual knowledge �Procedural knowledge �Conceptual knowledge �Meta-cognitive knowledge

Quiz �Give an example of all the four types of knowledge

The salient features of a good Question paper 1

Reflect… �How do we test the validity and reliability of a question paper?

The salient features of a good Question paper 2

Reflect…. �How do you test the Reliability and consistency of a Question paper?

The domains of the Blue Print of a question paper �Knowledge �Understanding �Application �Skill �Creativity

What is a Blue print indicate? �Congruence with teaching and learning plan �Content Validity – testing what has been taught �Assist the paper setter �Maintain standards of testing

Action verbs to test competencies

Remembering. . �define, �list, �recall, �repeat, �reproduce �state �narrate

Understanding �classify, �locate, �describe, �recognize, �discuss, �report, �explain, � select, �identify, � translate, �paraphrase

Applying �choose, �demonstrate, �Illustrate �operate, �schedule, �sketch, �interpret, �solve, �write. �use,

Analyzing �appraise, �distinguish, �compare, �examine, �contrast, �experiment, �Critically evaluate �question, �differentiate, � discriminate �test

Evaluating. . �appraise, �argue, �defend, �judge, �select, �support, �value,

Creating �assemble, �construct, �create, �design, �develop, �formulate, �write.

Group work 1 �Each group will create 2 sample questions on each of the competencies identified.

Content elements of a question �Terms �Facts �Concepts �Principles �Processes �Themes

Terms �What is an ‘Valency’? �Define the term “Entropy” �What do you understand from the term “Momentum”? �Define the term “polymerisation” �What is malnutrition?

Facts �What is Gravitational Force? �Why do we need to purify ores before extraction of metals? �How is sugar digested in the body? �What is periodic law?

Concepts �In a triangle, the square on the hypotenuse is equal to the sum of the squares on the two adjacent sides. What do you call this triangle? �Why the water in a mud pot is cool? �Why does a cycle tube often burst during a summer? �Why do we need to expose ourselves to sunlight for sometime everyday? �What is a sub-routine in a program?

Principles �Why are able to cook the food faster in a pressure cooker? �Animal charcoal is used as a decolourizing agent. Why? �Hydrogen/Helium balloons are used for study by weather departments. Why? �The electropositive character of elements decrease along a group in the periodic table. Why?

Processes �Suggest three factors that influence the production of Ammonia in Haber’s process �Describe how fermentation takes place �How is the impure blood purified in the body? �Explain the role of messenger- RNA in genetic processes �How does an inverter function?

Themes � Properties of elements are periodic functions of their atomic numbers – why? �What is Artificial Intelligence? How does it play a significant role in modern computing? �Pollution control needs social priority. Why? �Why the plastic bags are banned in

Group work 2 �Create 2 questions under each category

Mechanics of writing a question paper

The same concept can be used to identify different competencies �Examine the competencies in the following questions: ◦ Name three conditions necessary for germination of a seed ◦ Why air is necessary for germination of a seed? ◦ If seeds are sown very deep, they do not germinate, why? ◦ If there is a heavy rainfall immediately after sowing the seeds, what would be the effect on the germination of seeds?

The same concept can be formatted differently to trigger differential thinking skills �Why do Sodium and Chlorine have a tendency to form a chemical bond? �Metallic sodium reacts vigourously with water but not a Sodium ion. Why? �Give an example of a highly electropositive and a highly electronegative element which results in the formation of an electrovalent bond? �Sodium chloride is an ionic compound but not Barium Chloride. Explain

Questions could be used to identify different ability levels �List two chemical properties of Carbon di oxide gas (lower ability –recall) �Describe the details of the digestive system of a man (medium ability – cognitive outcome) �Why the P – 1/v graph is linear? How would the graph look if it is 1/ P Vs V? ( ability to interpret and explore- higher difficulty) �Prepare Oxygen gas in the laboratory and collect two cylinders. Show two tests for its chemical property � ( psychomotor outcome- higher ability)

Questions could be used to trigger thinking � Why Carbon monoxide is considered as a poisonous gas? � All alcoholic drinks are made of ethyl alcohol and not methyl alcohol. Why? �When water seeps through a wall towards a switch in an electric point, the switch gives a shock when touched?

Verbal to non-verbal forms �See the following questions: ◦ With the help of a diagram describe the internal structure of a dicot system ◦ Draw a labeled diagram of longitudinal section of the petunia flower ◦ In the given diagram of amoeba, label the parts a, b, c and d ◦ (a+b)2 =……………. .

What are the features to be taken note of while wording a question? �Vocabulary �Syntax �Directional or stimulus words �Scoring objectivity �Mechanics of writing

Vocabulary of a question �Questions should be direct and simple �The vocabulary should be communicative �It should ensure correct communication �It should not give an implied meaning

Syntax of a question � The syntax should be correct � The syntax should have the correct positioning of the stimulus word � The syntax should be simple and not be a compounded sentence � The syntax should not be long enough to trigger multiple meanings

Directional stimulus of the question �Every word carries a different directional stimulus. �Need to understand the differences between; ◦ ◦ Name, state, list, and enumerate Explain, discuss, clarify, and describe Why, what, when and how Comment, observe, differentiate and analyze

Scoring objectivity of a question �Need to know the target clientele �Need to know target objective �Need to know the status of the question in the blue print �Need to know the difficulty level �Need to know -Is the question a differentiator or a neutralizer?

Mechanics of writing a question �The context of the question �The knowledge level of the examinees �The locus of the question in the blue print �The nature of the topic �The score allotted �The possible value point(s)

What is HOTS? �How do we set questions relating to HOTS?

Example of HOTS Questions � On 26 th August Lok sabha cleared the Food security bill. Some of the features of this bill are: � The food bill will cover 2/3 of the Indian population. It includes 75% of rural and 50% of urban population. Each beneficiary will be entitled to get 5 kg of rice, wheat and cereals for 5, 3 and 1 per kg. Solve the following: Write in decimal form. If the population of India is 1. 26 billion, find the number of people who will be covered under this food bill. If 70% of Indians live in rural areas, find the number of rural people who will be covered under this food bill. Do you think the implementation of the Food Security bill will improve the condition of malnourished children in India? Give a reason. � � � �

HOTS 2 � � � The land acquisition bill was passed by Lok Sabha on Aug 29 and the Rajya Sabha on Sep 4. Some of the Key features of this bill are: The consent of 80 % of land owners concerned is needed to acquire land for private projects and of 70 % landowners for public-private projects. The compensation has also been significantly increased under the new law. It suggests compensation for the owners of the acquired land to be four times the market value in case of rural areas and twice in case of urban areas. P Using the above information, solve the following: 1400 m 1300 � Q 1500 m � � A villager Ranjan was growing wheat in a piece of land, which was triangular in shape as shown in the figure. A private company that wanted to set up a factory acquired his land. The market value of the land was 450 per sq. m. Find the amount he got from the company as compensation. Do you agree with the development happening at the loss of agricultural land in India? Justify your answer.

P Q C B HOTs 3 � Krishna has a triangular plot. The government decided to take over this land to construct a Health centre. The government said that it would give him another piece of plot in lieu of his plot. In the figure, is Krishna’s plot C B and would be the plot given by the government, in such a Q way that side PQ II side AB and PC = BC. Find out whether Krishna would be compensated with less area or more area or equal area of land. Also, find the length of side QC if length of AC = 850 m. Justify your answers with proper reasons.

Why do we set a multiple choice question? �Is it to ensure higher scoring objectivity? �Is it to facilitate guessing competency? �Is it to enable analytical thinking? �Is it to identify the level of understanding?

How do we set a Multiple choice question? �The four elements: ◦ ◦ Visibly incorrect Provocative Apparently correct Correct

Example from Sciences Aluminum vessels are frequently used for cooking; not copper vessels? a. Copper is costly, while Aluminum is cheap a. Aluminium is a good conductor, Copper is a poor conductor b. Aluminum is easily available, but copper is not c. Copper form poisonous hydroxy complexes, while Aluminium doesn’t.

Example Sciences �Q. 1 Mumbai can not have a large scale production of wind energy because of a) lack of technology b) very high humidity (90% or more) c) less wind velocity d) lack of space.