Introducing the New Iowa Assessments The Iowa Assessments

  • Slides: 59
Download presentation
Introducing the New Iowa Assessments

Introducing the New Iowa Assessments

The Iowa Assessments Dates Locations Purposes Introduction May June AEAs Overview of changes in

The Iowa Assessments Dates Locations Purposes Introduction May June AEAs Overview of changes in content, ordering, delivery, reporting Content Overviews August September Webinars Details on content coverage, instructional linkages Interpretation Overviews October November AEAs Webinars Details on new reports, interpretations and use Professional Development Scheduled as needed Schools Districts Strategies for using Iowa Assessment data to inform and change instruction 2011 by Iowa Testing Programs

Details • All slides posted to Iowa Testing Programs website: https: //www. education. uiowa.

Details • All slides posted to Iowa Testing Programs website: https: //www. education. uiowa. edu/itp/ • Q&A is underway and will be posted by early June • Catherine-welch@uiowa. edu 2011 by Iowa Testing Programs

Overview of New Iowa Assessments

Overview of New Iowa Assessments

New Iowa Assessments • Forms E and F • All new items • All

New Iowa Assessments • Forms E and F • All new items • All items written and reviewed by Iowa educators • All items field tested on Iowa students • All items align to the Iowa Core and the Common Core State Standards 2011 by Iowa Testing Programs

Major Changes from Current Forms • All Levels – Order of tests within the

Major Changes from Current Forms • All Levels – Order of tests within the booklet; adjusted number of items – Use of color, page layouts – New configuration of composite scores • Levels 5/6 to 8 – Sources of Information has been eliminated • Levels 9 to 14 – Maps and Diagrams and Reference Materials have been eliminated* – Mathematics (two separately timed parts) has replaced Math Concepts and Estimation and Math Problem Solving and Data Interpretation • Levels 15 to 17/18 – Spelling and Sources of Information* have been eliminated *where appropriate content has been moved to Science or Social Studies 2011 by Iowa Testing Programs

Implications for AYP/NCLB Testing (Levels 9 to 14) Forms A and B Forms E

Implications for AYP/NCLB Testing (Levels 9 to 14) Forms A and B Forms E and F • Reading Comprehension (25 + 30 mins) • Science (30 mins) • Mathematics Concepts and Estimation (25 + 5 mins) • Mathematics Problem Solving and Data Interpretation (30 mins) • • Reading, Part 1 (30 mins) Reading, Part 2 (30 mins) Science (35 mins) Mathematics, Part 1 (30 mins) • Mathematics, Part 2 (30 mins) 2011 by Iowa Testing Programs

Implications for AYP/NCLB Testing (Levels 15 – 17/18) Forms A and B Forms E

Implications for AYP/NCLB Testing (Levels 15 – 17/18) Forms A and B Forms E and F • Reading (40 mins) • Science (40 mins) • Mathematics (40 mins) 2011 by Iowa Testing Programs

Level 10 Example Score Reading Written Expression Conventions of Writing Vocabulary Composite Scores ELA

Level 10 Example Score Reading Written Expression Conventions of Writing Vocabulary Composite Scores ELA Total Mathematics Computation Mathematics Total Core Composite Science Social Studies Complete Composite 2011 by Iowa Testing Programs

Level 15 Example Score Reading Written Expression Vocabulary Composite Scores ELA Total Mathematics Computation

Level 15 Example Score Reading Written Expression Vocabulary Composite Scores ELA Total Mathematics Computation Mathematics Total Core Composite Science Social Studies Complete Composite 2011 by Iowa Testing Programs

Reading Specifications Level 9 10 Content Explicit Meaning Essential Competencies Conceptual Understanding Extended Reasoning

Reading Specifications Level 9 10 Content Explicit Meaning Essential Competencies Conceptual Understanding Extended Reasoning Implicit Meaning Author’s Craft Key Ideas Vocabulary Explicit Meaning Implicit Meaning Author’s Craft Key Ideas Vocabulary 2011 by Iowa Testing Programs

Written Expression Specifications Level 9 Content Appropriate Expression Essential Competencies Conceptual Understanding Planning and

Written Expression Specifications Level 9 Content Appropriate Expression Essential Competencies Conceptual Understanding Planning and Organization 10 Extended Reasoning Sentence Structure Usage and Grammar Appropriate Expression Planning and Organization Sentence Structure Usage and Grammar 2011 by Iowa Testing Programs

Mathematics Specifications Level 9 10 Content Essential Competencies Conceptual Understanding Extended Reasoning Algebraic Patterns

Mathematics Specifications Level 9 10 Content Essential Competencies Conceptual Understanding Extended Reasoning Algebraic Patterns and Connections Data, Probability and Statistics Geometry Measurement Number Sense and Operations Algebraic Patterns and Connections Data, Probability and Statistics Geometry Measurement Numbers Sense and Operations 2011 by Iowa Testing Programs

Science Specifications Level 12 13 14 Content Essential Conceptual Competencies Understanding Extended Reasoning Earth

Science Specifications Level 12 13 14 Content Essential Conceptual Competencies Understanding Extended Reasoning Earth Science Life Science Physical Science 2011 by Iowa Testing Programs

Social Studies Specifications Level 9 10 11 Content Essential Conceptual Competencies Understanding Extended Reasoning

Social Studies Specifications Level 9 10 11 Content Essential Conceptual Competencies Understanding Extended Reasoning Civics/Government Economics Geography History Civics/Government Economics Geography History 2011 by Iowa Testing Programs

Skills Tests Level Test Essential Competencies All Spelling All Capitalization All Punctuation All Vocabulary

Skills Tests Level Test Essential Competencies All Spelling All Capitalization All Punctuation All Vocabulary All Computation 2011 by Iowa Testing Programs Conceptual Understanding Extended Reasoning

Test Design and Development

Test Design and Development

2011 by Iowa Testing Programs

2011 by Iowa Testing Programs

Iowa Assessments – Forms E/F • Standards-based instructional decisions • Individual progress and growth

Iowa Assessments – Forms E/F • Standards-based instructional decisions • Individual progress and growth for individuals • Reporting group progress and growth • Providing relative comparisons • Providing empirical evidence that supports comparisons with NAEP, state results and international benchmarking measures • Providing information that measures a continuum of achievement and tracks student progress from kindergarten to grade 12. • Measuring achievement in core academic areas important for success in college including reading, language arts, mathematics and science. 2011 by Iowa Testing Programs

Test Development Sources of Evidence • • Common Core State Standards Leading state standards

Test Development Sources of Evidence • • Common Core State Standards Leading state standards International standards Assessment data Curriculum surveys NAEP frameworks and specifications Scholarly research in curriculum and assessment Feedback from educators, researchers, professional organizations, parents, students 2011 by Iowa Testing Programs

Introduction to Reports

Introduction to Reports

Reports to Support Uses of The Iowa Assessments • • • Standards-based Interpretations Accountability

Reports to Support Uses of The Iowa Assessments • • • Standards-based Interpretations Accountability Growth College Readiness Relative Comparisons 2011 by Iowa Testing Programs

Standards-Based Interpretations • Determine which standards have been mastered by the student, classroom or

Standards-Based Interpretations • Determine which standards have been mastered by the student, classroom or school • Determine which standards need additional focus • Compare progress among students 2011 by Iowa Testing Programs

Accountability 2011 by Iowa Testing Programs

Accountability 2011 by Iowa Testing Programs

Measure Growth • Determine expected growth for all students • Set goals for a

Measure Growth • Determine expected growth for all students • Set goals for a student based on any starting place • Measure student growth using vertically articulated standards 2011 by Iowa Testing Programs

College Readiness • Predict college readiness indicators • Help students plan the appropriate coursework

College Readiness • Predict college readiness indicators • Help students plan the appropriate coursework • Identify students that are not “on track” 2011 by Iowa Testing Programs

Relative Comparisons • Determine student strengths with respect to the school, district, state and

Relative Comparisons • Determine student strengths with respect to the school, district, state and nation • Use relative comparisons to evaluate programs, set expectations and determine interventions 2011 by Iowa Testing Programs

Reports – Standard Service • • List of student scores Summary reports Student labels

Reports – Standard Service • • List of student scores Summary reports Student labels Profile Narrative Report Mathematics Performance Summary Reading Performance Summary Student data on CD 2011 by Iowa Testing Programs

2011 by Iowa Testing Programs

2011 by Iowa Testing Programs

2011 by Iowa Testing Programs

2011 by Iowa Testing Programs

2011 by Iowa Testing Programs

2011 by Iowa Testing Programs

2011 by Iowa Testing Programs

2011 by Iowa Testing Programs

Reports – Optional Group Diagnostic Report Group Item Response Record Group Item Analysis Individual/Group

Reports – Optional Group Diagnostic Report Group Item Response Record Group Item Analysis Individual/Group Performance Profile Individual/Group Longitudinal Report Individual/Group Common Core Standards Domain Report • Group Narrative Summary • • • 2011 by Iowa Testing Programs

2011 by Iowa Testing Programs

2011 by Iowa Testing Programs

Scoring and Reporting • Standard Service • List of Student Scores • Summary Reports

Scoring and Reporting • Standard Service • List of Student Scores • Summary Reports 2011 by Iowa Testing Programs

2011 by Iowa Testing Programs

2011 by Iowa Testing Programs

2011 by Iowa Testing Programs

2011 by Iowa Testing Programs

2011 by Iowa Testing Programs

2011 by Iowa Testing Programs

2011 by Iowa Testing Programs

2011 by Iowa Testing Programs

Implications for AYP Reporting

Implications for AYP Reporting

New Iowa Assessments Implications for Determination of Proficiency • Background – Due to historical

New Iowa Assessments Implications for Determination of Proficiency • Background – Due to historical trend data available prior to NCLB, the state’s workbook application requested continued flexibility of administration dates (fall, midyear or spring) – The National Percentile Rank (NPR) metric allowed for a fixed cutscore while allowing for flexibility in administration dates 2011 by Iowa Testing Programs

New Iowa Assessments Implications for Determination of Proficiency • Assumptions for new forms –

New Iowa Assessments Implications for Determination of Proficiency • Assumptions for new forms – Schools will continue to administer their Iowa Assessments to meet their scheduling requirements and to retain their historical trend data (fall, midyear or spring) – New forms will be linked to previous forms and the equivalent of the 41 st NPR from the 2000 norms will be identified on the Form E scale – The expectations for proficiency remain the same from Forms A/B to Forms E/F – Interpretation information will be made available to schools to transition to new forms 2011 by Iowa Testing Programs

Standard Score Scale 41 NPR = 259 Standard Score = 21 Raw Score 2011

Standard Score Scale 41 NPR = 259 Standard Score = 21 Raw Score 2011 by Iowa Testing Programs

Current Proficiency Ranges – High School Reading Example Testing Period Fall Score Not Proficient

Current Proficiency Ranges – High School Reading Example Testing Period Fall Score Not Proficient 1 -20 21 -44 165 -258 259 -369 NPR 1 -40 41 -99 Raw Score 1 -21 22 -44 170 -261 262 -369 NPR 1 -40 41 -99 Raw Score 1 -22 23 -44 170 -262 263 -374 1 -40 41 -99 Raw Score Standard Score Midyear Standard Score Spring Standard Score NPR 2011 by Iowa Testing Programs

Proposed Link to Proficiency Ranges – High School Reading Example Testing Period Fall Score

Proposed Link to Proficiency Ranges – High School Reading Example Testing Period Fall Score Raw Score Standard Score Midyear Proficiency – New 21 -44 New assessments will be linked to current assessments 259 -369 NPR 41 -99 Raw Score 22 -44 Standard Score Spring Proficiency -Current 262 -369 NPR 41 -99 Raw Score 23 -44 Standard Score NPR 263 -374 41 -99 2011 by Iowa Testing Programs Standard score scale will be established using linking relationship SS metric will be used for reporting AYP

Reading Example Fall Midyear Spring 41 st NPR Form A 259 SS Form E

Reading Example Fall Midyear Spring 41 st NPR Form A 259 SS Form E 257 SS 41 st NPR Form A 262 SS Form E 259 SS 41 st NPR Form A 263 SS Form E 260 SS 2011 by Iowa Testing Programs

Summary • Proficiency cutscores be reported in Standard Score metric • Proficiency cutscores be

Summary • Proficiency cutscores be reported in Standard Score metric • Proficiency cutscores be available in August • Cutscores will be provided for: – Grades 3 -12 – Mathematics, Reading, Science – Fall, Midyear, Spring 2011 by Iowa Testing Programs

Test Administration and Delivery

Test Administration and Delivery

Test Administration and Delivery • Registering/Ordering Materials • Receiving Materials • Administering Assessments •

Test Administration and Delivery • Registering/Ordering Materials • Receiving Materials • Administering Assessments • Returning Materials • Scoring and Reporting

Registering and Ordering Materials • Continue to use Online Tools to register and order

Registering and Ordering Materials • Continue to use Online Tools to register and order materials • Continue to use current process for Student Demographic Files (“barcodes”) 2011 by Iowa Testing Programs

Online Tools Closed from June 8 through August 15 for updates Under Construction

Online Tools Closed from June 8 through August 15 for updates Under Construction

Receiving Testing Materials • Test Booklets, Directions for Administration and Answer Documents – Pearson

Receiving Testing Materials • Test Booklets, Directions for Administration and Answer Documents – Pearson will continue to pack and ship • Interpretive materials – Available as pdfs at Online Tools 2011 by Iowa Testing Programs

Administration Configurations for Iowa Assessments Year Form Paper/Pencil Online Constructed Response (optional) 2011 -2012

Administration Configurations for Iowa Assessments Year Form Paper/Pencil Online Constructed Response (optional) 2011 -2012 E Pilot 2012 -2013 F Pilot 2013 -2014 E 2014 -2015 F 2011 by Iowa Testing Programs

Accommodations • Determined by IEP or 504 Plan • Should be consistent with state

Accommodations • Determined by IEP or 504 Plan • Should be consistent with state policy as defined in the annual Department of Education letter on NCLB requirements 2011 by Iowa Testing Programs

Calculator Use • Calculators may be used on the Mathematics test (Parts 1 and

Calculator Use • Calculators may be used on the Mathematics test (Parts 1 and 2) – Use of calculators should be guided by district alignment of assessment with instruction – No separate calculator norms • Calculators may not be used on the Computation test 2011 by Iowa Testing Programs

Test Security • Assurance statement for school administrators from the Iowa Department of Education

Test Security • Assurance statement for school administrators from the Iowa Department of Education • Applies to test preparation and test administration practices • Maintaining test security is a requirement for NCLB compliance and Title I funds 2011 by Iowa Testing Programs

2011 by Iowa Testing Programs

2011 by Iowa Testing Programs

Returning Testing Materials • Test Booklets and Answer Documents – Return materials to Pearson

Returning Testing Materials • Test Booklets and Answer Documents – Return materials to Pearson – Answer Documents must have barcodes to be processed • Order for Scoring Services (OSS) – Complete in ITP Online Tools 2011 by Iowa Testing Programs

Scoring and Reporting • CD-ROM – Shipped from Riverside to address provided on OSS

Scoring and Reporting • CD-ROM – Shipped from Riverside to address provided on OSS – New record layout • Printed Reports – Shipped from Pearson to address provided on OSS 2011 by Iowa Testing Programs