MEETING PRINCIPALS HODS SCHOOL BASED ASSESSMENT DRIVER OF
MEETING: PRINCIPALS & HODS SCHOOL BASED ASSESSMENT: DRIVER OF TEACHING AND LEARNING HTS WELKOM 16 MARCH 2017
1. 2. 3. 4. 5. 6. 7. 8. 9. PRESENTATION OUTLINE BACKGROUND LEGISLATIVE CONTEXT 2016 REFLECTION RECOMMENDATIONS STATISTICAL MODERATION 2017 SBA PLAN AND APPROACH SBA MARK SHEETS MANAGEMENT PLAN KEY ACTIVITIES CONCLUSION
BACKGROUND • School Based Assessment (SBA) refers to forms of assessment, which are conducted by the teacher at the school level. • This includes assignments, projects, research, demonstrations, role plays, listening exercises, homework pieces, class work pieces, tests and examinations. • In subjects with a practical component and in the case of languages with an oral component, SBA includes assessment of the practical skills and in the case of languages, assessment of the oral skills.
(Cont. ) • SBA constitutes 25% of the final promotion mark in all the subjects offered as part of the National Senior Certificate (NSC). • In the case of the subjects with a practical component and the languages, the weighting of SBA is higher than 25%. • In the case of Life Orientation the assessment is totally school based (i. e. 100% SBA).
(Cont. ) • It is the responsibility of the PEDs and (DBE) to ensure the reliability, validity, fairness and practicability of the SBA. • Moderation of SBA should be conducted at school, district, provincial and at national level to ensure credibility of the SBA. • Umalusi quality assures.
LEGISLATIVE CONTEXT SBA policy must be read in conjunction with the Curriculum and Assessment Policy Statements, Regulations for the Conduct, Administration and Management of Assessment for the National Senior Certificate, 2005, the National Protocol on Assessment for Schools in the General and Further Education and Training Band, (Grade R-12), 2006 and National protocol for Reporting and Recording.
LET’S REFLECT 2016: AREAS OF CONCERN • Utilization of district and school SBA Coordinators. • Quality of assessment practices – Practical tasks, Oral tasks, marking, rubrics etc. • SBA Irregularities • Handling of SBA moderation reports. • Submission of portfolios for moderations • Learners who fail to administer tasks on the day of administration.
(Cont. ) • SASAMS / School recording Sheets /Quarterly reporting. • SBA Mark sheets – Correctness and timeous submission. • Part time learners – SBA tasks and Mark sheets – Subject changes • Common tasks – Compliance, Quality, Memoranda & Memo discussions. • Rejection / adjustment of SBA marks.
UMALUSI FINDINGS Subjects verified in July / August 2016 Accounting Agricultural Sciences Business Studies Civil Technology CAT Consumer Studies Dramatic Arts Economics English FAL Geography IT Life Sciences Mathematics Mechanical Technology Physical Sciences Subjects verified in October 2016 Accounting Agricultural Management Practices Dramatic Arts Economics English FAL History Life Sciences Mathematics Tourism
AREAS OF GOOD PRACTICE • Adequate content coverage in most subjects verified. • Many Teacher’s files and evidence of Learner performance indexed, neat, well presented and orderly. • Evidence of internal moderation in some Teacher and learner files. • Use of common tasks for capacity building and equivalent standards.
AREAS OF WEAKNESSES • Poor handling of SBA irregularities. • Absence of or ineffective SAICs across provinces. • Quality of internal moderation in most schools sampled. • Availability of supplies, equipment and tools for Consumer Studies and Hospitality remains a challenge. • Failure to provide analysis grids indicating spread of content and cognitive skills. • Poor marking and application of rubrics.
(Cont. ) • The use of textbooks and past year’s question papers and exemplars without modification. • Poorly developed practical tasks. • Inability to distinguish between good, satisfactory and excellent responses. • Little or undirected feedback. • Double lesson period for subjects with PATs not adhered to. • Evidence of performance in Dance Studies is always missing as most schools do not record performance.
RECOMMENDATIONS • SBA marks for ALL subjects must be moderated and approved by HODs Subject Advisors by the end of every term. • PATS and Orals are components on their own. ALL learners must have marks for the PATs and for the Orals. • SBA recorded marks must correspond with SBA marks in SASAMS.
(Cont. ) • SBA Coordinators to track the progress of Part time learners. • Schools must ensure that ALL tasks administered are of good quality and CAPS Compliant as per each subject. • ALL 2016 grade 10 – 12 Moderation reports and Irregularities must be discussed during staff and Departmental meetings.
(Cont. ) • Policy to be adhered to with regard to learners who fail to perform certain tasks. • SMTs should communicate school assessment plans to parents and learners. • Accountability has to be instilled in subject Teachers and HODs in schools. • Disciplinary procedures should be followed in cases of non-compliance. • Annual SBA day.
(Cont. ) • Irregularities committed need to be recorded, reported and followed up. • DBE & PEDs need to ensure that SAICs are functional at schools. • DBE needs to ensure that a joint workshop on development and moderation of tasks is conducted for curriculum staff. • DBE & PEDs need to ensure that schools offering schools with practical components have adequate resources, equipment & infrastructure.
(Cont. ) • The curriculum directorate needs to ensure that analysis grids are made compulsory for all SBA tasks. • DBE & PEDs need to ensure that PATs are submitted timeously for moderation. • DBE & PEDs to ensure schools to adhere to policy with regard to PATs. • Recording of live performance in Dance Studies must be made compulsory.
STATISTICAL MODERATION V/S REJECTION OF SBA MARKS • Conducted by UMALUSI on SBA marks for all Provinces. • Adjusted examination marks statistically compared to the mean of raw SBA marks, per school. • Spread of marks statistically represented by SD. • Marks get adjusted up, adjusted down or completely rejected. • When marks get rejected, learners get compensation of 5 % of the exam mark.
MEAN & STANDARD DEVIATION • The statistical mean refers to the mean or average that is used to derive the central tendency of the data in question. It is determined by adding all the data points in a population and then dividing the total by the number of points. The resulting number is known as the mean or the average. • The standard deviation is a measure that is used to quantify the amount of variation or dispersion of a set of data values. It provides some idea about the distribution of scores around the mean (average). The smaller the standard deviation, the more narrow the range between the lowest and highest scores or, more generally, that the scores cluster closely to the average score.
PRINCIPLE 1 • If the mean of the SBA marks for the centre are between 5% – 10% above the adjusted examination mean, the SBA marks of that centre will be accepted as is.
EXAMPLE ADJUSTED EXAM MEAN RAW SBA MEAN FINAL SBA MARK 50 57 57 45 55 55
PRINCIPLE 2 • If the mean of the SBA marks for the centre are less than 5% above the adjusted examination mean, the mean of the SBA marks must be brought up to 5% above the adjusted examination mean.
EXAMPLE ADJUSTED EXAM MEAN RAW SBA MEAN FINAL SBA MARK 50 50 53 48 55 55
PRINCIPLE 3 • If the mean of the SBA marks for the centre are greater than 10% and less than or equal to 15%, above the adjusted examination mean, the SBA marks will be adjusted and scaled down as follows:
1. If the SBA mean is 11% above the adjusted exam mean, it is brought down to 9% above, the adjusted exam mean 2. If the SBA mean is 12% above the adjusted exam mean, it is brought down to 8% above, the adjusted exam mean. 3. If the SBA mean is 13% above the adjusted exam mean, it is brought down to 7% above, the adjusted exam mean. 4. If the SBA mean is 14% above the adjusted exam mean, it is brought down to 6% above, the adjusted exam mean. 5. If the SBA mean is 15% and above the adjusted exam mean, it is brought down to 5% above, the adjusted exam mean
ADJUSTED EXAM MEAN RAW SBA MEAN 50 50 50 61 62 63 64 65 AND ABOVE FINAL SBA MARK 59 58 57 56 55
PRINCIPLE 4: REJECTION OF MARKS • The spread or the distribution of SBA marks. • The spread or distribution of marks is statistically represented by the Standard Deviation (SD). • When the standard deviation (SD) of SBA is very small, it is an indication that the SBA marks are bunched, i. e. the SBA marks are concentrated around a specific mark. This implies that the assessor was not able to distinguish the abilities of the candidates, and therefore most of the candidates obtain an average mark. In such cases the SBA marks will be ignored or rejected. • If the standard deviation (SD) is less than 5% and less than three quarters of the exam standard deviation, the SBA marks for that centre and that subject are rejected. These candidates will be compensated by having their SBA mark generated, which will be equal to 5% above the adjusted exam mark.
SUMMARY OF THE PROCESS •
PROVINCIAL SBA COMPARISON PER DISTRICT Reject %Rejec ed ted >=5 %>=5 and <=10% >10 and <=15 % >10 and >15% <=15 % >15% <5% %<5% 181 4. 3 2654 63. 6 10. 8 23 2. 9 535 67. 7 108 12. 1 41 4. 6 559 62. 6 21. 4 133 11. 8 60 5. 3 672 59. 8 222 20. 3 90 8. 2 45 4. 1 710 65. 0 0. 7 55 20. 2 25 9. 2 12 4. 4 178 65. 4 1. 5 832 19. 9 441 10. 6 181 4. 3 2654 63. 6 2016 ALL FREE STATE 4171 63 1. 5 832 19. 9 441 10. 6 FZ 790 8 1. 0 139 17. 6 85 LJ 893 9 1. 0 176 19. 7 MT 1123 18 1. 6 240 TM 1093 26 2. 4 XR 272 2 GRAND TOTAL 4171 63
(Cont) • There are 63 records (60 in 2015) with Motheo 18 records (13 records in 2015) and Thabo Mofutsanyana with 26 records (27 records in 2015) being the main contributors to the rejected category. • The percentage of records in the greater than 15% category is fairly good. This should be kept at these levels and could even be lowered. • In the less than 5% category, attention should be given to the schools affected as learners are disadvantaged because of low SBA marks.
(Cont) • The performance in the category of between 5% and 10% which is regarded as the ideal percentage is very low and should be increased. In the short term the province should try to achieve at least 25 % across all districts and aim for 50% in this category in the medium to longer term.
NATIONAL SBA COMPARISON PER PROVINCE : 2015 TO 2016 EC FS GP KZN LP ALL Rejected %Rejecte d % >10 and <=15 >15% % >15% <5% %<5% 2015 10848 462 4. 3 2115 19. 5 1672 15. 4 1852 17. 1 4747 43. 8 2016 10942 420 3. 8 2179 19. 9 1589 14. 5 1457 13. 3 5297 48. 4 2015 4243 60 1. 4 830 19. 6 370 8. 7 177 4. 2 2806 66. 1 2016 4171 63 1. 5 832 19. 9 441 10. 6 181 4. 3 2654 63. 6 2015 12288 113 0. 9 1988 16. 2 1152 9. 4 1107 9. 0 7928 64. 5 2016 12508 104 0. 8 2098 16. 8 1013 8. 1 682 5. 5 8611 68. 8 2015 19454 679 3. 5 3442 17. 7 3067 15. 8 5311 27. 3 6955 35. 8 2016 19325 540 2. 8 3947 20. 4 2757 14. 3 2581 13. 4 9500 49. 2 2015 15019 1055 7. 0 3063 20. 4 2285 15. 2 2533 16. 9 6083 40. 5 2016 14818 913 6. 2 >=5 and %>=5 and >10 and <=10% <=15 3133 21. 1 2123 14. 3 1845 12. 5 6804 45. 9
NATIONAL SBA COMPARISON PER PROVINCE : 2015 TO 2016 Rejecte %Rejec d ted >=5 and <=10% %>=5 and <=10% >10 and <=15 % >10 and <=15 >15% % >15% <5% %<5% ALL 2015 6828 225 3. 3 1278 18. 7 913 13. 4 959 14. 0 3453 50. 6 2016 6799 209 3. 1 1458 21. 4 897 13. 2 712 10. 5 3523 51. 8 2015 1593 38 2. 4 307 19. 3 227 14. 2 247 15. 5 774 48. 6 2016 1602 34 2. 1 303 18. 9 208 13. 0 171 10. 7 886 55. 3 2015 4373 163 3. 7 844 19. 3 499 11. 4 509 11. 6 2358 53. 9 2016 4481 163 3. 6 934 20. 8 475 10. 6 315 7. 0 2594 57. 9 2015 6095 24 0. 4 1043 17. 1 512 8. 4 234 3. 8 4282 70. 3 2016 6042 28 0. 5 1308 21. 6 545 9. 0 228 3. 8 3933 65. 1 2015 80741 2819 3. 5 14910 18. 5 10697 13. 2 12929 16. 0 39386 48. 8 2016 80688 2474 3. 1 16192 20. 1 10048 12. 5 8172 10. 1 43804 54. 3 MP NC NW WC Grand Total
(CONT) • There has been a national decline of 0. 4% of rejected marks from 2015 to 2016. In the provinces, it ranged from +0. 1% to -0. 8%. • Limpopo has the highest number (913) and percentage (6. 2%) of moderation records that were rejected in 2016. • From 2015 to 2016, there has been an improvement in the category where SBA marks are not adjusted. Nationally this improvement is 1. 6%, with provincial improvements in this category ranging from 0. 3% in the Free State to 4. 5% in the Western Cape. The Northern Cape experienced a slight decline of 0. 4% in this category.
(Cont) • In the category of very high differences between SBA means and Examination means there has also been an improvement as the data shows a decline of 5. 9% nationally, with the improvement ranging from 0. 1% in the Free State to 13. 9% in Kwa. Zulu-Natal has improved from 27. 3% in 2015 to 13. 4% in 2016. The PED must be commended for this improvement as it means that their SBA standards are being raised. • The performance in the category between 5% and 10% which is regarded as the acceptable percentage range is at 20. 1% nationally. It would be ideal if this percentage could be raised incrementally by at least 10% per year.
(Cont) • In the category where SBA means are less than 5% above the Examination means (last column), the national percentage has increased by 5. 5%. This suggests an increase in the standard of assessment at these schools. This however is not the ideal situation as learners at such a school can, possibly, be disadvantaged as they do not benefit as much as the learners in a school that falls in the ideal category and where the school’s SBA mean is exactly 10% above the examination mean.
AS THE NEW TERM STARTS IN 2017 • 2 Chronicles 20: 12 • “We do not know what to do, but our eyes are on you”.
2017 SBA PLAN AND APPROACH ACTIVITY The advert for the appointment of Provincial moderators goes out. APPROACH/BRIEF DESCRIPTION An advert sent via the bulkmail. TIME FRAMES/DATE 10 February District based SBA Coordinators will organise Trainings/Meetings with meetings with school based SBA February - School based SBA Coordinators. Provincial SBA Coordinator will March Coordinators. be part of most of those meetings. PERSON RESPONSIBLE SBA Provincial Coordinator SBA Provincial and District Coordinators School visits: Schools with rejected SBA marks will be prioritised. Schools that struggled with submission of portfolios and marks in 2016 will be visited for support. February - March SBA Provincial and District Coordinators The advert closes. Application forms personally delivered or sent via district and HO officials. The due date m 10 March SBA Provincial Coordinator
(Cont. ) ACTIVITY The advert closes. APPROACH/BRIEF DESCRIPTION Application forms personally delivered or sent via district and HO officials. The due date must be observed and respected. Sampling based on 2016 grade 12 Sampling of schools for grade performance, big enrolment and 10 - 12 Provincial track record on SBA (Schools with moderations. rejected SBA marks). TIME FRAMES/DATE PERSON RESPONSIBLE 10 March SBA Provincial Coordinator District officials Principals Teachers 10 – 14 April SBA Provincial Coordinator 18 - 21 April SBA Provincial Coordinator Admin person Appointment of grade 10 – 12 Provincial moderators. Letters of appointment generated and sent to schools via SBA Coordinators, email and District Exam officials. List of sampled schools released for GR 10. Lists of sampled schools sent via SBA 25 April Coordinators, email and SAACs. SBA Provincial Coordinator Admin person
(Cont. ) ACTIVITY APPROACH/BRIEF DESCRIPTION TIME FRAMES/DATE PERSON RESPONSIBLE List of sampled schools released for GR 11. Lists of sampled schools sent via SBA Coordinators, email and SAACs. 02 May SBA Provincial Coordinator Admin person List of sampled schools released for GR 12. Lists of sampled schools sent via SBA Coordinators, email and SAACs. 08 May SBA Provincial Coordinator Admin person Grade 10 Provincial moderation. Portfolios delivered, checked, controlled 09 – 15 May 2017 SBA Provincial Coordinator Provincial moderators and placed according to subjects and Districts prior to the actual start of moderation. District SBA coordinators to bring the District control list when bringing portfolios to the moderation venue.
(Cont. ) ACTIVITY APPROACH/BRIEF DESCRIPTION Grade 11 Provincial moderation. SBA Coordinators bring grade 11 portfolios and take grade 10 ones. Grade 12 Provincial moderation. SBA Coordinators bring grade 12 portfolios and take grade 10 ones. DBE SBA Moderation. SBA Coordinators bring grade 11 & 12 portfolios for DBE and take grade 12 ones. TIME FRAMES/DATE PERSON RESPONSIBLE 16 – 22 May 2017 SBA Provincial Coordinator Provincial moderators Admin person EAs 23 – 29 May 2017 SBA Provincial Coordinator Provincial moderators 24 June – 30 June 2017 SBA Provincial Coordinator DBE Moderators
(Cont. ) ACTIVITY APPROACH/BRIEF DESCRIPTION Umalusi Moderation and Verification. SBA Coordinators bring grade 12 portfolios for Umalusi and take DBE ones. 01 – 04 July 2017 Investigation of Irregularities Serious Irregularities will be investigated immediately after Umalusi moderation July - August Grade 10 Provincial moderations. Portfolios delivered, checked, controlled and placed according to subjects and Districts. Grade 11 Provincial moderations. SBA Coordinators bring grade 11 portfolios and take grade 10 ones. TIME FRAMES/DATE 12 – 18 September 2017 19 – 25 September 2017 PERSON RESPONSIBLE SBA Provincial Coordinator Umalusi moderators Admin person EAs SBA Provincial Coordinator District SBA Coordinators PSCs SAs SBA Provincial Coordinator Provincial moderators
(Cont. ) ACTIVITY APPROACH/BRIEF DESCRIPTION TIME FRAMES/DATE Grade 12 Provincial moderation. SBA Coordinators bring grade 12 portfolios and take grade 10 ones. 26 September – 02 October 2017 DBE SBA Moderation. SBA Coordinators bring grade 11 & 12 portfolios for DBE and take grade 12 ones. 30 September – 06 October 2017 Umalusi Moderation and Verification. SBA Coordinators bring grade 12 portfolios for Umalusi and take DBE ones. 07 – 10 October 2017 PERSON RESPONSIBLE SBA Provincial Coordinator Provincial moderators
(Cont. ) ACTIVITY Grade 12 SBA Moderations APPROACH/BRIEF DESCRIPTION Subject Advisors do final moderation of SBA marks and hand in SBA computerised mark sheets. Marks are received from Subject Advisors, get captured SBA Capturing and at District offices and get Verification verified at Head office. PSCs also assist a great deal in this exercise. TIME FRAMES/DATE PERSON RESPONSIBLE Orals: August – September SBA: October Subject Advisors PSCs October - November Exam officials – Head office Exam officials: Districts EAs
SBA MARK SHEETS – MANAGEMENT PLAN • Circular on Management of mark sheets sent to schools and districts by 01 August 2017. • The printing of the Mark sheets will start on 4 September 2017. • Control and Packing will commence on 6 September and conclude on 8 September 2017. • Distribution to districts will commence on 11 September and conclude on 13 September 2017. • Distribution to schools to be completed by 16 September 2016.
(Cont. ) • Subject Advisors to moderate from 01 August to 27 October 2017. • Oral mark sheets to be submitted by 28 September 2017. • Submission of mark sheets to district office will commence on 17 October until 27 October 2017. • All marks should be submitted by 27 October 2017
THE PROVINCE WILL PRIORITISE THE FOLLOWING KEY ACTIVITIES: • Stabilising and Strengthening performance of SBA coordinators at school and district level. • Prioritization of SBA Irregularities, Moderation reports, schools with rejected marks, MO learners, Part time learners & Subject changes. • Monitoring of SBA by Circuit managers, SAs & SBA coordinators. • Administration of DBE PATS. • Discussion of SBA matters in SGB meetings.
(Cont. ) • • Grade 10 Provincial SBA Moderation. Grade 11 Provincial SBA Moderation. Grade 12 Provincial SBA Moderation. DBE Moderations. Umalusi Moderation & Verification. LO Provincial moderation. NSC LO moderation by DBE & Umalusi. Capturing of SBA marks.
(Cont) • Regular and proper assessment is critical. • Weekly assessment for underperforming schools. • Monthly tests • Participation in common tests/ exams • Proper marking of tasks, tests and exams • Analysis, recording and reporting/feedback
CONCLUSION • “Every day is a new beginning. Treat it that way. Stay away from what might have been, and look at what can be”
THANK YOU
- Slides: 51