Provincial Achievement Tests and Provincial Diploma Exams Summary

  • Slides: 46
Download presentation
Provincial Achievement Tests and Provincial Diploma Exams Summary of the 2009 -10 Results October

Provincial Achievement Tests and Provincial Diploma Exams Summary of the 2009 -10 Results October 13, 2010 1

Provincial Achievement Test Definitions Acceptable Standard: Students who scored at or above the ‘cut’

Provincial Achievement Test Definitions Acceptable Standard: Students who scored at or above the ‘cut’ score. . . Basically those who passed the test Standard of Excellence: Students who achieved excellence on the test. . . Generally, above 85% 2

Provincial Achievement Test Definitions Cohort: All students registered in a grade for the school

Provincial Achievement Test Definitions Cohort: All students registered in a grade for the school year. This includes those who do not write due to absence or exemption. Non-writers’ are scored zero. Writers: The students who actually write the test. 3

Provincial Achievement Test Other Notes: Math 3, 6 and 9: This was a new

Provincial Achievement Test Other Notes: Math 3, 6 and 9: This was a new curriculum in 2009 -10 and therefore a pilot PAT. The results are not included in the analysis. Grade 3: These students write only Language Arts and Math. 4

Provincial Achievement Test information for whole school year (2009 -2010) For the purposes of

Provincial Achievement Test information for whole school year (2009 -2010) For the purposes of this analysis, differences greater than 4% are indicated by either… • Red, for a negative difference • Green, for a positive difference, • Yellow where the difference was statistically similar. 5

Participation Rates Rate at which students who were registered in a grade also wrote

Participation Rates Rate at which students who were registered in a grade also wrote the provincial achievement test. Including Vista Virtual. . . On par with province in grade 3 and 6, lower in grade 9. English Language Arts Math Grade 3 Grade 6 Grade 9 92. 3% (+1. 2) 90. 3% (-0. 4) 80. 6% (-9. 2) New Form Science NA 89. 3% (-0. 6) 81. 5% (-8. 3) Social Studies NA 89. % (-0. 8) 82. 7% (-7. 0) 6

Participation Rates Rate at which students who were registered in a grade also wrote

Participation Rates Rate at which students who were registered in a grade also wrote the provincial achievement test. Excluding Vista Virtual. . . Community schools exceed province in 6 tests, on par on 1. English Language Arts Math Grade 3 Grade 6 Grade 9 97. 3% (+6. 2) 97. 1% (+6. 4) 93. 1% (+3. 3) New Form Science NA 96. 8% (+6. 9) 94. 0% (+4. 2) Social Studies NA 96. 4% (+6. 6) 96. 1% (+6. 4) 7

Participation Rate Summary The participation rates of students in our community schools exceeds that

Participation Rate Summary The participation rates of students in our community schools exceeds that of the province on 6 of 7 measurable tests, and is on par on the other. PHRD’s higher participation rates means that more of our students write than most of the province. . . Therefore less tests are scored as zero. 8

PROVINCE AGGREGATED COHORT RESULTS: The provincial results have remained virtually static for 8 years.

PROVINCE AGGREGATED COHORT RESULTS: The provincial results have remained virtually static for 8 years. 9

PHRD AGGREGATED COHORT RESULTS: PHRD results are slightly better than last year, and are

PHRD AGGREGATED COHORT RESULTS: PHRD results are slightly better than last year, and are similar to previous years’ results. 10

PROVINCE AGGREGATED WRITER RESULTS: The provincial results have remained virtually static for 8 years.

PROVINCE AGGREGATED WRITER RESULTS: The provincial results have remained virtually static for 8 years. 11

PHRD AGGREGATED WRITER RESULTS: PHRD results have remained virtually static for 8 years as

PHRD AGGREGATED WRITER RESULTS: PHRD results have remained virtually static for 8 years as well. 12

Acceptable Standard: PHRD Cohort compared to the Province Students who did not write are

Acceptable Standard: PHRD Cohort compared to the Province Students who did not write are scored as zero. This data includes Vista Virtual. English Language Arts Math Grade 3 Grade 6 Grade 9 77. 5% (-4. 1) 83. 7% (-0. 4) 69. 7% (-9. 6) New Form Science NA 78. 3% (+1. 7) 64. 1% (-8. 8) Social Studies NA 71. 3% (+0. 4) 62. 0% (-6. 0) 13

Acceptable Standard: PHRD Cohort compared to the Province Students who did not write are

Acceptable Standard: PHRD Cohort compared to the Province Students who did not write are scored as zero. This data excludes Vista Virtual in the cohort. English Language Arts Math Grade 3 Grade 6 Grade 9 81. 7% (+0. 1) 90. 0% (+6. 7) 80. 5% (+1. 2) New Form Science NA 84. 8% (+8. 2) 73. 9% (+1. 0) Social Studies NA 77. 2% (+6. 3) 72. 1% (+4. 1) 14

Acceptable Standard: PHRD Writers compared to the Province (Vista Virtual is not a factor).

Acceptable Standard: PHRD Writers compared to the Province (Vista Virtual is not a factor). Concerns: Grade 3 ELA, and grade 9 ELA. English Language Arts Math Grade 3 Grade 6 Grade 9 84. 0% (-5. 5) 92. 6% (+0. 8) 86. 5% (-1. 0) New Form Science NA 87. 7% (+2. 5) 78. 6% (-2. 6) Social Studies NA 80. 1% (+1. 1) 75. 0% (-0. 8) 15

Provincial Achievement Test Results Summary PHRD’s Community School Cohort results are on par with

Provincial Achievement Test Results Summary PHRD’s Community School Cohort results are on par with the province on 3 of 7 measurable tests, and exceed the province in Grade 6 ELA, Science and Social Studies, and in Grade 9 Social Studies. PHRD’s Writers were on par with the province on 6 of 7 measurable tests, and are a little below the province in 3 ELA. PHRD’s aggregate cohort results are consistent to previous years. 16

Provincial Achievement Test Results Summary Vista Virtual students are all over the province and

Provincial Achievement Test Results Summary Vista Virtual students are all over the province and beyond. Their non-participation results from many valid reasons that include: • distance to writing centers, • being out of province at time of tests, • general dissatisfaction with the community schools in proximity to families involved. 17

Provincial Achievement Test Results Summary Vista Virtual School’s low rate of participation impacts PHRD

Provincial Achievement Test Results Summary Vista Virtual School’s low rate of participation impacts PHRD overall Cohort results by approx: • -4% in grade 3 • -6% in grade 6 • -10% in grade 9 When, or IF, Achievement Tests could be written on-line, and supervision rules were adapted, VV students would be much more likely to write the tests. • This difference grows as community school achievement improves. 18

Provincial Achievement Test Results Summary PHRD’s Writers have demonstrated reasonable consistency for the past

Provincial Achievement Test Results Summary PHRD’s Writers have demonstrated reasonable consistency for the past 7 years. PHRD’s grade 3 ELA results have declined slightly over time. Grade 6 achievement is improving over time and is generally a little better then Provincial rates. Grade 9 achievement has improved, particularly in Science, but we still lag behind Provincial rates. 19

PHRD’s Writers Results over time ELA 3 – decline over past three years 20

PHRD’s Writers Results over time ELA 3 – decline over past three years 20

PHRD’s Writers Results over time Math 3 – New Program of Studies. . .

PHRD’s Writers Results over time Math 3 – New Program of Studies. . . and therefore a new test. . . Not used yet in results analysis. 21

PHRD’s Writers Results over time ELA 6 – Improvement over 7 years 22

PHRD’s Writers Results over time ELA 6 – Improvement over 7 years 22

PHRD’s Writers Results over time Grade 6 Math – New Program of Studies. .

PHRD’s Writers Results over time Grade 6 Math – New Program of Studies. . . and therefore a new test. . . Not used yet in results analysis. 23

PHRD’s Writers Results over time Grade 6 Science – 4 years of improvement 24

PHRD’s Writers Results over time Grade 6 Science – 4 years of improvement 24

PHRD’s Writers Results over time Grade 6 Social Studies – New Program of Studies

PHRD’s Writers Results over time Grade 6 Social Studies – New Program of Studies Previous Program of Studies New Program, New PAT Transition year, PAT not incl 25

PHRD’s Writers Results over time ELA 9 – consistent with longer term averages 26

PHRD’s Writers Results over time ELA 9 – consistent with longer term averages 26

PHRD’s Writers Results over time Math 9 – New Program of Studies. . .

PHRD’s Writers Results over time Math 9 – New Program of Studies. . . and therefore a new test. . . Not used yet in results analysis. 27

PHRD’s Writers Results over time Grade 9 Science – showing improvement 28

PHRD’s Writers Results over time Grade 9 Science – showing improvement 28

PHRD’s Writers Results over time Grade 9 Social Studies – New Program of Studies

PHRD’s Writers Results over time Grade 9 Social Studies – New Program of Studies Previous Program of Studies New Program, New PAT Transition year. This result from small pop doing old Program 29

In Summary. . . (without Math) Grade 3 ELA • Grade 3: Lower than

In Summary. . . (without Math) Grade 3 ELA • Grade 3: Lower than anticipated achievement • Grade 6: Higher than anticipated achievement • Grade 9: Satisfactory achievement Grade 6 ELA Grade 6 Science Grade 6 Social Studies Grade 9 ELA Grade 9 Science Grade 9 Social Studies 30

Accountability combined with Analysis. . . Province Jurisdiction School Grade Level Student At risk.

Accountability combined with Analysis. . . Province Jurisdiction School Grade Level Student At risk. . . Teacher teams examine and analyze all results. . . By student and by outcome. . . 31

Provincial Diploma Exam information for whole school year (2009 -2010) For the purposes of

Provincial Diploma Exam information for whole school year (2009 -2010) For the purposes of this analysis, differences greater than 4% are indicated by either… • Red, for a negative difference • Green, for a positive difference, • Yellow where the difference was statistically similar. 32

Provincial Diploma Exam Notes: EXAM marks: These reference the achievement of students on the

Provincial Diploma Exam Notes: EXAM marks: These reference the achievement of students on the exam itself. COURSE Marks: These reference the success of students in the course as a whole. Participation Rates: reflects the percentage of students enrolled in their 3 rd yr of high school in the reported school year and who completed the course in the reported school year. Students may have completed the course in an earlier school year. 33

Participation Rates Compared to Province (the rate at which 3 rd year students participate

Participation Rates Compared to Province (the rate at which 3 rd year students participate in diploma exam courses) Overall – Consistent rate of participation in Diploma Exams. 34

Participation Rates Compared to Province (the rate at which 3 rd year students participate

Participation Rates Compared to Province (the rate at which 3 rd year students participate in diploma exam courses) 2005/06 2006/08 2007/08 2008/09 2009/10 ELA 30 -1 (-8. 6) ELA 30 -2 (-4. 6) SS 30 (-3. 0) SS 33 (-3. 6) ELA 30 -1 (-10. 4) ELA 30 -2 (-1. 1) SS 30 (-10. 1) SS 33 (-0. 7) ELA 30 -1 (-8. 8) ELA 30 -2 (-4. 7) SS 30 (-5. 6) SS 33 (-7. 8) ELA 30 -1 (-3. 4) ELA 30 -2 (-7. 7) SS 30 (-3. 5) SS 33 (-7. 8) ELA 30 -1 (-2. 2) ELA 30 -2 (-6. 8) SS 30 (-5. 1) SS 33 (-11. 0) Math 30 P (-5. 0) Math 30 A (-8. 3) Math 30 P (-9. 3) Math 30 A (-4. 8) Math 30 P (-9. 5) Math 30 A (-2. 6) Math 30 P (-8. 4) Math 30 A (-1. 9) Math 30 P (-3. 4) Math 30 A (-4. 0) Bio 30 (-3. 8) Chem 30 (-5. 8) Phys 30 (-1. 5) Sci 30 (-0. 9) Bio 30 (-9. 4) Chem 30 (-10. 0) Phys 30 (-1. 7) Sci 30 (-3. 7) Bio 30 (-8. 2) Chem 30 (-11. 1) Phys 30 (-4. 7) Sci 30 (-2. 3) Bio 30 (-5. 5) Chem 30 (-8. 6) Phys 30 (-3. 9) Sci 30 (-0. 9) Bio 30 (-3. 8) Chem 30 (-3. 9) Phys 30 (-4. 0) Sci 30 (-4. 0) 35

PHRD Results Compared to Province EXAM Marks (This summary reflects achievement of students based

PHRD Results Compared to Province EXAM Marks (This summary reflects achievement of students based just on their on the exams) Larger class sizemarks than typical is likely to have impacted the SS 30 -1 result Acceptable Standard of Excellence ELA 30 -1 (+1. 1) (improved) ELA 30 -2 (+1. 9) (improved) SS 30 -1 (-16. 1) (widened gap) SS 30 -2 (-4. 4) (consistent) Math 30 P (-0. 9) (consistent) Math 30 A (+8. 2) (improved) Bio 30 (-21. 9) (widened gap) Chem 30 (-7. 1) (closing gap) Phys 30 (+2. 4) (significantly improved) Sci 30 (+10. 4) (significantly improved) ELA 30 -1 (+0. 6) ELA 30 -2 (-1. 4) • We believe that the Bio 30 result SS 30 -1 (--7. 2) was impacted by awkward SS 30 -2 (-7. 6) timetabling. . . • Classes included students Math 30 P (=) that would have otherwise Math 30 A (+4. 8) taken Science 30 Bio 30 (-15. 2)* Chem 30 (-12. 5) Phys 30 (-1. 7)* Sci 30 (+5. 8) 36

PHRD EXAM marks alone On the diploma exams themselves, PHRD students were similar to

PHRD EXAM marks alone On the diploma exams themselves, PHRD students were similar to the province on 5 of 10 tests In Biology and Social Studies 30 -1, PHRD students achieved less well than was expected. There is a gap when these results are compared to the province. The exam marks alone are only half of the assessment story… 37

PHRD Results Compared to Province Final Course Marks (Final Marks combine school mark and

PHRD Results Compared to Province Final Course Marks (Final Marks combine school mark and exam mark) Acceptable Standard of Excellence ELA 30 -1 (+2. 8) (consistent) ELA 30 -2 (+1. 4) (consistent) SS 30 (-1. 5) (consistent) SS 33 (-0. 5) (consistent) ELA 30 -1 (+3. 6) ELA 30 -2 (-0. 6) SS 30 (-0. 3) SS 33 (-6. 0) Math 30 P (+2. 0) (consistent) Math 30 A (+9. 0) (consistent) Math 30 P (-1. 7) Math 30 A (+10. 2) Bio 30 (-6. 8) (widened gap) Chem 30 (+2. 4) (consistent) Phys 30 (+3. 4) (consistent) Sci 30 (+3. 0) (consistent) Bio 30 (-17. 8) Chem 30 (-9. 4) Phys 30 (+2. 2) Sci 30 (+7. 8) 38

Diploma Exam Courses – Final Course Marks Overall – Consistent achievement in acceptable level.

Diploma Exam Courses – Final Course Marks Overall – Consistent achievement in acceptable level. 95% of students are successful in courses that have a Diploma Exam. 39

Diploma Exam Courses – Final Course Marks: HUMANITIES Humanities: Generally very good rate of

Diploma Exam Courses – Final Course Marks: HUMANITIES Humanities: Generally very good rate of achievement of the acceptable standard. Excellence: Typical levels with decline in SS 30 -2. 40

Diploma Exam Courses – Final Course Marks: MATHEMATICS Maths – Achievement in both courses

Diploma Exam Courses – Final Course Marks: MATHEMATICS Maths – Achievement in both courses is very consistent and at a high level. 41

Diploma Exam Courses – Final Course Marks: SCIENCES Sciences – Biology took a significant

Diploma Exam Courses – Final Course Marks: SCIENCES Sciences – Biology took a significant dip. Chemistry has recovered a little bit. Physics and Science are quite strong. 42

Provincial Exam Courses Summary Overall results indicate another strong performance, consistent with previous years.

Provincial Exam Courses Summary Overall results indicate another strong performance, consistent with previous years. • 95% of students achieved acceptable standard in the course (all exams combined). 43

Provincial Exam Courses Summary There is a trend of improvement in English Language Arts

Provincial Exam Courses Summary There is a trend of improvement in English Language Arts We continue to do well in both Pure and Applied Math courses 2 of the ‘big’ 3 science results were below expectations • Biology had a lower than anticipated result. • Chemistry seems to be recovering • Physics is strong and demonstrated some improvement 44

School/Course Level Analysis Principals facilitate conversations and analysis of results. • Successes: Which courses,

School/Course Level Analysis Principals facilitate conversations and analysis of results. • Successes: Which courses, How and Why? • Concerns: Which courses, Why and Specifically What elements in the Program of Studies? Students of concern can be identified A focus of Professional Learning Community work when issues are identified Timetabling and class sizes continue to be carefully developed and monitored 45

That’s all for now… Any questions? 46

That’s all for now… Any questions? 46