Jack Buckley Commissioner National Center for Education Statistics
Jack Buckley Commissioner National Center for Education Statistics October 3, 2013
Overview 2011 Assessments: NAEP Mathematics and Science at Grade 8 • 50 U. S. states, the District of Columbia, and the Department of Defense schools participated • Results for each state based on approximately – 3, 200 students from 50 to 230 schools for mathematics – 2, 300 students from 50 to 220 schools for science 2 National Center for Education Statistics: 2011 Linking Study at Grade 8
Overview 2011 Assessment: TIMSS Mathematics and Science at Grade 8 • 47 education systems (38 countries and 9 subnational entities) • –Results for eachfrom education based on no fewer 4, 000 students at least system 150 schools than – Alabama, California, Colorado, Connecticut, Florida, • Nine U. S. states participated Indiana, Massachusetts, Minnesota, and North Carolina 3 National Center for Education Statistics: 2011 Linking Study at Grade 8
Overview 47 education systems assessed 8 th-graders in TIMSS 2011 4 National Center for Education Statistics: 2011 Linking Study at Grade 8
Overview U. S. states that participated in TIMSS 2011 5 National Center for Education Statistics: 2011 Linking Study at Grade 8
2011 NAEP and TIMSS Programs 6 National Center for Education Statistics: 2011 Linking Study at Grade 8
2011 NAEP and TIMSS Assessments 7 National Center for Education Statistics: 2011 Linking Study at Grade 8
2011 NAEP-TIMSS Linking Study • Reported predicted TIMSS scores for the 43 states that participated only in NAEP. • Applied three statistical linking methods: o Calibration, o Statistical projection, and o Statistical moderation • Selected statistical moderation method, the simplest of the three, in predicting TIMSS scores. 8 National Center for Education Statistics: 2011 Linking Study at Grade 8
2011 NAEP-TIMSS Linking Study • Accuracy of prediction was evaluated using scores for the nine states that participated in both NAEP and TIMSS. • All three methods yielded essentially the same predicted TIMSS results. • In predicting TIMSS scores, additional adjustments were made to make NAEP and TIMSS assessed populations more comparable. • The differences between actual and predicted TIMSS scores for the nine states were not statistically different, except in two cases in 9 one subject. National Center for Education Statistics: 2011 Linking Study at Grade 8
Compared to the TIMSS average of 500, average scores for 36 states were higher 10 states were comparable 6 states were lower 1 Department of Defense Education Activity (overseas and domestic schools). National Center for Education Statistics: 2011 Linking Study at Grade 8 11
Percentages of students reaching Advanced benchmark (≥ 625) • Massachusetts has highest U. S state percentage • Chinese Taipei, Singapore, and the Republic of Korea have highest education system percentages 12 National Center for Education Statistics: 2011 Linking Study at Grade 8
Percentages of students reaching High benchmark (≥ 550) • Massachusetts has highest U. S. state percentage • Singapore and the Republic of Korea have highest education system percentag 13 National Center for Education Statistics: 2011 Linking Study at Grade 8
Compared to the TIMSS average of 500, average scores for 47 states were higher 2 states were comparable 3 states were lower 1 Department of Defense Education Activity (overseas and domestic schools). National Center for Education Statistics: 2011 Linking Study at Grade 8 15
Percentages of students reaching Advanced benchmark (≥ 625) • Massachusetts has highest U. S. state percentage • Singapore has highest education system percentage 16 National Center for Education Statistics: 2011 Linking Study at Grade 8
Percentages of students reaching High benchmark (≥ 550) • Massachusetts and Vermont have highest U. S. state percentages • Singapore has highest education system percentage 17 National Center for Education Statistics: 2011 Linking Study at Grade 8
Resources Download the following documents: • A highlights report to learn about the NAEPTIMSS linking results • A paper to understand the methodology applied in linking • Papers to find how two assessments, NAEP and TIMSS, compare in what is assessed, and how TIMSS items map onto the NAEP assessment frameworks • Frequently Asked Questions National Center for Education Statistics: 2011 Linking Study at Grade 8 18
For more information http: //nces. ed. gov/nationsreportcard/ d e t a e b ll d p u i w e g a Im Photo Credits: © DNY 59/i. Stockphoto #1966820 © Photo. Alto/Michele Constantini/Getty Images, Inc. #103057941 © Datacraft Co. Ltd. /Getty Images, Inc. #122688704 19
- Slides: 19