TURKEY School Evaluation National Measurement and Evaluation Implementations

TURKEY School Evaluation National Measurement and Evaluation Implementations

Overwiev 2 General Overwiev to Turkish Education System National Assessment Tools Transition System From Basic Education to Secondary Education (TEOG) Transition System From Secondary Education to Higher Education (OSYS) International Assessment Tools PISA TIMSS A new National Assessment Study

General Overview to Turkish Education System 3

4 Transition System from Basic Education to Secondary Education

Transition System from Basic Education to Secondary Education 5 • Central Common Examination – 8 th Grade • 2 exams – one in fall, one in spring term. • If a lesson has two exams in one term, first one is conducted centrally, • If a lesson has three exams in one term, second one is conducted centrally

Transition System from Basic Education to Secondary Education 6 AIMS To strengthen relationship among the teacher, school and student. To make the role of school and teachers more active in the education process. To enable the simultaneous implementation of education curriculum country-wide To minimize the exam anxiety by spreading the evaluation process to a wider time frame. Tracking and evaluating of the students gains and the implementation of education curriculums objectively.

Transition System from Basic Education to Secondary Education 7 • Subjects: • Turkish • Mathematics • Science • Revolution History • Foreign Language (English, German, French and Italian) • Education of Religion and Ethics (for Juadism and Armenian Community)

Transition System from Basic Education to Secondary Education 2013 -2014 Mean Performances by years* 2014 -2015 8 Education Mathematics of Rel. and Science Revolution English History Ethics Term Turkish Fall 12. 315 8. 089 12. 794 10. 618 11. 275 7. 863 Spring 13. 666 8. 931 13. 362 10. 899 11. 278 10. 010 Fall 11. 983 7. 628 15. 880 11. 143 11. 190 9. 358 Spring 13. 380 8. 684 15. 254 10. 774 12. 079 8. 425 *There are 20 items in each sub-test.

Transition System from Basic Education to Secondary Education 9 Discrimination Index by Subjects Turkish Mathematics Reliability Levels by Subjects Discrimination Index 0, 696 0, 601 Education of Religion and Ethics 0, 765 Science 0, 691 Revolution History Foreign Language All 0, 655 0, 649 0, 568 Subjects Turkish Mathematics Education of Religion and Ethics Science Revolution History Foreign Language All Reliability Level 0, 852 0, 813 0, 862 0, 877 0, 850 0, 838 0, 963

Transition System from Basic Education to Secondary Education 10 Item Difficulty by Subjects Item Difficulty Turkish 0. 669 Mathematics 0. 434 Education of Religion and Ethics 0. 763 Science 0. 539 Revolution History 0. 604 Foreign Language 0. 421 All 0, 572

Transition System from Basic Education to Secondary Education 11 Number Of The Students Attending A Central Common Exam In Each Lesson 1. 235. 891 Turkish Mathematics 1. 236. 867 Education of Religious Ethics 1. 235994 Science 1. 235. 681 The History of Revolution 1. 236. 463 Foreign Language 1. 221. 269 TOTAL 7. 402. 165

Transition System from Basic Education to Secondary Education 12 ITEM DEVELOPMENT Item Development Group Editorial Group Item Developers String Group Academicians Assessment Experts

Transition System from Basic Education to Secondary Education 13 Safety Precautions Item development in a safe and isolated environment. Printing in a safe and isolated environment. Distribution of boxes with security locks to schools. Different types of booklets. Cheat control via computer program.

Transition System from Basic Education to Secondary Education 14 SCORING Year-end Performance Score ( out of 300 points scale) 6, 7 and 8 th grades Weighted Performance Score (out of 700 points scale) Center Common Examinations Scores used for placement (500 points scale) (Year-end Performance Score+Weighted Performance Score)/2

Transition System from Basic Education to Secondary Education EXPERIENCES Process evaluation instead of outcome evaluation. Increasing quality of teacher-made tests. Unity in implementation of curriculum. Less anxiety with help of make-up sessions.

Transition System from Basic Education to Secondary Education EXPERIENCES Feedback on curriculums. Increasing significance of schools instead of courses outside schools. More usage of testing and evaluation technics by teachers. Data track by years. Analysis of factors affecting students’ performance.

Transition System from Basic Education to Secondary Education 17

Transition System from Basic Education to Secondary Education DIFFICULTIES ENCOUNTERED Excessive number of students – increasing work load and need for more staff. Need for objective testing tools to assess extracurricular activities Planning to integrate open-ended questions.

19 Transition System From Secondary Education to Higher Education

Transition System From Secondary Education to Higher Education 20 Two exams for each lesson per term. Prepared by the school branch group teachers collectively – enabling a unity in curriculums within school. Analyses are made related to results, acquisition and program. If necessary supplementary courses in schools are given by the teachers.

Transition System From Secondary Education to Higher Education 21 Two-stage examination – 12 th grade. Higher Education Examination (YGS) – First Stage Undergraduate Placement Examination (LYS) – Second Stage

Transition System From Secondary Education to Higher Education 22 Higher Education Examination (YGS) Questions for assessing the skills of the candidates weighted with those questions from the common curriculum of the Grade 9 of all high school types. Interpreting Usage of logical and judgment skill Assessing analytical skills.

Transition System From Secondary Education to Higher Education 23 Higher Education Examination (YGS) 4 subjetcs - 40 items in each test. Turkish Social Basic Sciences Mathematics Science

Transition System From Secondary Education to Higher Education 24 Higher Education Examination (YGS) Performing more than 140 score - Vocational School of Higher Education. Performing more than 180 – Chance for Undergraduate Placement Examination.

Transition System From Secondary Education to Higher Education 25 Undergraduate Placement Examination (LYS) More difficult than YGS. Five different examination. 1. 2. 3. Mathematics, Geometry Exam (LYS 1), Science (Physics, Chemistry, Biology) Exam (LYS 2), Turkish Language and Literature, Geography 1 Exam (LYS 3), 4. Social Science (History, Geography 2, Philosophy group) Exam (LYS 4), 5. Foreign Language Exam (LYS 5)

Transition System From Secondary Education to Higher Education 26 Using results for Quality The gap between the exam questions and the curriculum was removed. The distributions and the numbers of the questions in the exam were determined according to the fields. Thanks to the new structure, by integrating the richness of questions in the exam and the curriculum, the school absenteeism in the last grade of the high school was prevented.

Transition System From Secondary Education to Higher Education 27 Stats for OSYS Number of the Candidates having the privilege of Preference and who have preferred a Field High School Vocational School Total Those having the Privilege of Preference Transition (Including without 1. 144. 744 866. 046 2. 010. 790 704. 557 535. 243 1. 239. 800 Examination) Those having Preferred a Field

Transition System From Secondary Education to Higher Education 28 Percentage of Placed and not Placed Students in Higher Education

Transition System From Secondary Education to Higher Education 2015 YGS Average and Standard Deviations 29 Average Standard Deviation Number of Candidate Turkish 15, 8 7, 5 1. 944. 933 Social Science 10, 7 6, 8 1. 944. 933 Basic Mathematics 5, 2 8, 1 1. 944. 933 Science 3, 9 7, 3 1. 944. 933

Transition System From Secondary Education to Higher Education 30 Male- Female Distribution in 2015 YGS Success Distribution According to Sex Percentage of Candidates Scoring 54% 46% 140 or more Femal e Percentage of Candidates Scoring 180 or more Female 92, 08 72, 26 Male 87, 4 66, 01 Total 89, 55 68, 89

Transition System From Secondary Education to Higher Education 31 Distribution of Number of Correct Answers of All Tests in 2013 -2015 YGS

32 INTERNATIONAL ASSESSMENTS -PISA-

PISA in TURKEY 33 * Participation and progress since 2003.

PISA in TURKEY 34 Results of 2012 "It is clear that there is a significant increase trend in all three domains but still not enough. This needs other requirements. It is surely beyond doubt that we are working to fullfill these requirements. We believe this is not only a general evaluation but also an opportunity for self-criticism that we consider our failings. " Nabi AVCI Minister of National Education

PISA in TURKEY 35 How Results Are Used After each cycle and releasing of the results, National Preliminary and Final Reports are prepared and sent to the units of Ministry of National Education, universities and other stakeholders. PISA results are taken into consideration especially while revising education curriculum. Besides, academicians in the universities benefit from the findings and the results of PISA while conducting studies on the education systems in Turkey and the world.

PISA in TURKEY 36 Preparations for PISA 2015 4 seminars before administration of PISA 2015. For provincial director of national education For coordinators from provincial directorate of national education. For school coordinator from each school. For test administrators from Ministry of National Education Brochures, introductory booklets and guidebooks for PISA 2015 were distributed to the participants

PISA in TURKEY 37 Statistics for PISA 2015 Main Study between April 02 -22. 61 cities – 192 schools and 5904 students. A test administrator from Ministry for each school 2 -3 ‰ data loss. Data submission at the end of June 2015.

38 INTERNATIONAL ASSESSMENTS -TIMSS-

TIMSS in TURKEY 39 * Participation and progress since 1999 8 th Grade Mathematic Performances 8 th Grade Science Performances

TIMSS in TURKEY 40 Using Results TIMSS educational research study has a high prestige among educational and academicals environments in Turkey. After each cycle attended TIMSS national reports are prepared. Turkey’s success in TIMSS studies and the evaluation of Turkish Education System in school, family, teacher and socio-economic contexts Many academicians use the results and findings of TIMSS studies while conducting researches on the education system and education policy makers pay regard to TIMSS national reports, results and conducted researches while making educational policies in Turkey.

TIMSS in TURKEY 41 Preparations for TIMSS 2015 4 seminars before administration of TIMSS 2015. For provincial director of national education For coordinators from provincial directorate of national education. For school coordinator from each school. For test administrators from Ministry of National Education Brochures, introductory booklets and guidebooks for TIMSS 2015 were distributed to the participants

TIMSS in TURKEY 42 Statistics for TIMSS 2015 Main Study between 23 March – 22 April. 78 cities – 498 schools and about 15000 students. A test administrator from Ministry for each school Minimized data loss. Data submission in beginnig of July 2015.

New National Assessment Tool 43 Aim of the Study To assess students’ ability of applying their knowledge and competences learned in school to real-life situations at the end of basic education. Other targeted sub-aims are designed to: Assess students’ higher-order thinking skills through knowledge. Assess effectiveness of current curriculums. Monitor performance by years through standard tests. Provide reliable data for addressing aspects of education reforms.

New National Assessment Tool 44

Thank you…