State Accountability Update Accountability TETN June 16 2011

State Accountability Update Accountability TETN June 16, 2011 Shannon Housson and Cathy Long TEA, Performance Reporting Division

Dropout and Completion Release Products Posted on TEASE § Annual Dropout Information o Summary Tables (district & campus) o Student Listings of Dropouts (PDF or Excel) § Completion (Class of 2010 Four-Year Results) Information o Summary Tables (district & campus) o Student Listings of Completion Cohort (PDF or Excel) § Technical Documents o Dropout Summary and Lists – Explanation o Completion Summary and Lists – Explanation 1

Dropout and Completion Release Products Posted on TEASE § Graduation Rates: Class of 2009 Five-Year Extended Longitudinal Results for Use in 2011 AYP: o Summary Tables (district & campus) o Student Listings of Completion Cohort (PDF or Excel) § Class of 2009 Five-Year Longitudinal Graduate and Dropout Rates–Explanation § See 2011 AYP Guide for details on use of the Class of 2009 Five-Year Results in the 2011 AYP system. 2

Dropout and Completion Release Significant Differences from Previous Releases § Annual Dropout Rates – • The race/ethnic student groups use the new, federal definitions. • Dropout data for all federal race/ethnic categories are shown. (Asian and Pacific Islander are combined. ) • Students shown as Two or More Races will not be part of any accountability student group. Their dropout status will be evaluated as part of the All Students results only. 3

Dropout and Completion Release Significant Differences from Previous Releases § Completion/Graduation Rate Information – • The Class of 2010 Four-Year Completion Rates will continue to use race/ethnicity based on former definitions. • The Class of 2009 Five-Year Rates will continue to use race/ethnicity based on former definitions. • The AYP Ever HS LEP row is new; it replaces AYP Ever LEP shown last year. See the Five-Year Explanation for details. 4

Dropout and Completion Release Significant Differences from Previous Releases § Completion/Graduation Rate Information – • Beginning with the Class of 2010, the methodology has expanded to create four-year completion rates for campuses and districts that meet criteria as previously defined OR served grade 12 in both the first and last years of the cohort. • Some students are excluded from campus and/or district completion/graduation rates per TEC 39. 073(f) and 39. 072(d). See Four-Year explanation and Chapter 6, Table 11, of 2011 Accountability Manual. 5

2011 Accountability Manual

2011 Accountability Manual § Key chapters were posted online on May 17, 2011. • To be adopted as commissioner rule by July 28 • Comment period ends June 27 § Remaining chapters and appendices are posted as they are completed. § Complete Manual will be posted online by June 24. (Appendices C – J remain as of June 16, 2011. ) § http: //ritter. tea. state. tx. us/perfreport/account/2011/manual/index. html 7

2011 Accountability Manual Highlights of the Manual § § § Comparison of 2010 & 2011 (pp. 7 -8) § Appendix D, Table 31, Accountability Subset Rules (to be posted by June 24) § Appendix J, Federal Race/Ethnicity Provision (to be posted New ELL Progress and Commended Indicator Text (Ch. 2) Use of RI & Exceptions with ELL Progress Indicator (Ch. 3) Revised Data Table Diagram (pp. 44 -45) Table 8, Requirements for Each Rating Category (p. 48) Table 9, Overview of 2011 System Components (p. 49) by June 24) 8

2011 Accountability Review

Review of 2011 Changes n Additional tests included in TAKS indicators (TAKS-M and TAKS-Alt) n Increased rigor of standards: n n Annual Dropout Rate standard n Academically Acceptable standards for math and science n Underreported Students Rate standard (district only) n GPA College-Ready Graduates standard Addition of two new base indicators (Commended and ELL Progress) 10

Review of 2011 Changes (continued) n Use of the Texas Projection Measure (TPM) for state and federal accountability discontinued n Change in race/ethnicity definitions (except for Completion rate) n Use of Federal Race/Ethnicity Provision (TAKS indicator only) n Changes in Completion Rate methodology See slides from April TETN presentation or the 2011 Accountability Manual for greater details about each of these changes. 11

2011 Standards for Assessment Indicators (TAKS % Met, Commended Performance, ELL Progress Indicator) AA RE EX TAKS Indicator % Met Std. CP Reading/ELA ≥ 70% ≥ 80% ≥ 15% ≥ 90% ≥ 25% Writing Social Studies ≥ 70% ≥ 80% n/a ≥ 90% n/a Mathematics ≥ 65% ≥ 80% ≥ 15% ≥ 90% ≥ 25% Science ≥ 60% ≥ 80% n/a ≥ 90% n/a ELL Progress Indicator n/a ≥ 60% Bold numbers indicate changes from the prior year. 12

2011 Standards for Leaver Indicators (Gr. 7 -8 Annual Dropout Rate, Completion Rate I, Underreported Students) AA Gr. 7 -8 Annual Dropout Rate Completion Rate I Underreported Students* RE EX <1. 6% ≥ 75. 0% n/a ≥ 85. 0% ≥ 95. 0% < 3. 0% and <150 Bold numbers indicate changes from the prior year. * District requirement only. 13

Student Groups by Indicator TAKS % Passing (5 subjects) TAKS % Commended (2 subjects) ELL Progress Indicator Completion Rate I Gr. 7 -8 Annual Dropout Rate All Students Yes Yes* African American Yes* No No Yes* Hispanic Yes* No No Yes* White Yes* No No Yes* Econ. Disadv. Yes* No Yes* 4 (2 x 2) 1 5 5 Student Groups * Minimum size criteria apply Max. Measures Possible (40) 25 (5 x 5) 14

Additional Features Summary of Additional Features by Indicator Absolute Standards EX RE AA TAKS % Passing TAKS % Commended 90% 80% 70%/65%/60% EX RE 25% 15% ELL Progress Indicator RE/EX Completion Rate I 60% EX RE AA Gr. 7 -8 Annual Dropout Rate 95. 0% AA/RE/EX 85. 0% 75. 0% 1. 6% Required Improvement Used For RE & AA only No Yes For RE & AA only Yes Restrictions Floor for RE n/a No Floor for RE No No Yes No No Floor (55%) No reuse Limits on # used n/a No No No Exceptions Provision Used For EX, RE, & AA Restrictions Floors for EX, RE, AA n/a No reuse Limits on # used Federal Race/Ethnicity Provision Yes No 15

Race / Ethnicity Race/Ethnicity and Student Groups § The TAKS Percent Met Standard indicator, the Annual Dropout Rate indicator, and all GPA indicators will use the new definitions in 2011. § The Completion Rate indicator will continue to use the former definitions. § The student groups will continue to be: • All Students • African American (new, federal definition) • Hispanic (new, federal definition) • White (new, federal definition) • Economically Disadvantaged 16

Race / Ethnicity Federal Race/Ethnicity Provision § Students who are Two or More Races will be evaluated in “All Students” and not among any of the individual racial student groups. § However, a new provision, the Federal Race/Ethnicity Provision, will be applied to the following indicators in 2011: § State Accountability (Standard): TAKS Met Standard indicator § State Accountability (AEA): TAKS Progress indicator § AYP: Reading and Mathematics performance and participation indicators 17

Race / Ethnicity Federal Race/Ethnicity Provision § Selected students who are Two or More Races will be distributed into either the African American or White groups based on the information submitted on the 2009 -10 TAKS answer documents for these same students under the former definitions. § Selected students are those non-Hispanic multiracial students reporting both Black/African American and White racial categories. § If the recalculated African American and White student group performance rates allow the district or campus to achieve a higher rating or status, the higher rating/status will be assigned. 18

Race / Ethnicity Federal Race/Ethnicity Provision § A message will appear on any campus or district accountability data table indicating the Federal Race/Ethnicity Provision was used. § Assessment results will not be changed. The official accountability data for the TAKS Met Standard indicator will be the data that does not include the multiracial students in the separate student groups. § Required Improvement and the exceptions provision (state accountability) and the safe harbor provision (AYP) will be evaluated for the recalculated students groups (African American and White) to determine the final rating/status. 19

Race / Ethnicity Federal Race/Ethnicity Provision § The performance of all the identified students will be redistributed: both those who meet the TAKS passing standard and those who do not. § The performance of identified students will be redistributed into all subjects. An improved accountability outcome is only achieved if the additional students’ performance (or participation) in every relevant subject supports a better outcome. The performance of the additional students cannot be used for some subjects but not others. 20

Race / Ethnicity Federal Race/Ethnicity Provision § Additional student-level information will be available on TEASE that shows the students selected for redistribution into the Black/African American and White student groups. Only students selected for redistribution are identified on each of the accountability products (state standard, AEA, and AYP). § For state accountability, the student level information will be posted on July 19, concurrent with the release of the preview data tables. For AYP, the information will posted on July 27, concurrent with the release of preliminary AYP data tables. 21

Race / Ethnicity Federal Race/Ethnicity Provision § Given districts and campuses will have the benefit of rating evaluations under two student group options, state and federal accountability appeals related to the race/ethnicity student groups for the assessment indicators will not be considered in 2011. § Further details about the Federal Race/Ethnicity Provision will be provided in Appendix J of the 2011 Accountability Manual. 22

2011 AEA Procedures TAKS Progress Indicator § The TAKS Progress indicator standard increases to 55% for 2011 AEA ratings. Both TPM and TGI will be discontinued in the TAKS Progress indicator. § TAKS (Accommodated), TAKS-M, and TAKS-Alt will be combined with TAKS Progress results under AEA procedures. § Required Improvement (RI) and use of district at-risk data will continue to be evaluated as additional features. 23

2011 AEA Procedures Additional Indicators § The ELL Progress indicator is evaluated for All Students at 55% standard. § If the ELL Progress indicator is the only cause for the AEA: AU rating, then the AEA: AA label is assigned. § Standards for Annual Dropout and Completion Rates remain the same in 2011. § Required Improvement (RI) and use of district at-risk data will continue to be evaluated as additional features. 24

2011 State Accountability Ratings Appeals

How to Appeal As in 2010, districts register intention to appeal on the TEA Secure Environment (TEASE) Accountability website. n Go to https: //seguin. tea. state. tx. us/apps/logon. asp n Click on ACCT – Accountability. n From the Welcome page, click on the Appeals Registration link and follow the instructions. 26

How to Appeal (continued) n The Appeals Registration site will be available during the appeals window, from July 19 through 5: 00 p. m. CDT on August 12, 2011. n The status of the appeal, e. g. , receipt of registration and receipt of documentation, will be available on the TEASE Accountability website. n Some enhancements to the site have been made since last year, but it is fundamentally the same. n Submit appeal packet by mail. Registering does not constitute an appeal. 27

How to Appeal (continued) Check status using the Appeal Status Report on TEASE This report is a summary of the appeal registration and indicates the date the mailed appeal packet was received by Performance Reporting. If an appeal packet was mailed and the status is not updated, then the packet has not been received. In this case, districts should attempt to track the package, and/or contact Performance Reporting to determine whether to resend. Once the packet is received, no further updates are planned until the appeal response letters are mailed. 28

2011 Appeal Guidelines § See Chapter 15 – Appealing the Ratings for detailed information on situations not favorable for appeal and for guidelines by indicator. Some excerpted text follows. § Page 138 – TAKS and Commended Performance Appeals Due to the application of the Federal Race/Ethnicity Provision to the 2011 state accountability ratings, appeals related to the reported race and ethnicity categories on test answer documents for administration during the 2009 -10 and 2010 -11 school year will not be considered. TEA will apply a Federal Race/Ethnicity Provision to the 2011 TAKS indicator to address multiracial students reporting more than one race that includes both Black/African American and White racial categories. Appeals to reconsider accountability results based on students’ race and ethnicity reporting in any combination of multiple or single racial categories will not be considered. See Appendix J. 29

2011 Appeal Guidelines (continued) § Page 139 – Appeals of Leaver Data Districts are responsible for providing accurate information to TEA, including student leaver data which are used to determine the grade 7 -8 and grade 7 -12 annual dropout rate indicators, the longitudinal Completion Rate I and II indicators, and the Underreported Students indicator. A January 5, 2011, letter was sent from the commissioner to remind school districts of the importance of submitting accurate leaver records prior to the January 20, 2011, PEIMS resubmission deadline. The commissioner noted that these leaver records would be used to produce the 2009 -10 completion, graduation, and dropout rates that will be evaluated in the 2011 state and federal accountability systems and used to fulfill 2011 state and federal monitoring requirements. The commissioner’s letter also highlighted that state law requires use of an external panel to ensure independent oversight of the state accountability appeals process. For the 2009 and 2010 ratings, the state accountability appeal panel consistently recommended that appeals related to completion and dropout rates only be granted in limited circumstances given the opportunities that districts are provided to submit accurate leaver records for students who attended their schools in the prior year. 30

2011 Appeal Guidelines (continued) § Page 140 – Dropout Exclusions under House Bill (HB) 3 A request to apply dropout exclusions as specified in HB 3, passed during the 81 st legislative session (2009) will be denied. These exclusions apply beginning with the 2012 year (the 2010 -11 dropout year). HB 3 is clear that the current National Center for Education Statistics (NCES) definition of a dropout is to remain in place until 2011 -12. The two most common dropout exclusions unsuccessfully appealed in prior years are for students who are court-ordered to receive a General Educational Development (GED) diploma and students who are incarcerated in adult jails. 31

Important Reminders § Districts may make changes to their appeal registration by resubmitting an appeal registration form until 5 p. m. CDT August 12, 2011. § Appeals will be evaluated based on the required documentation submitted in the mailed appeal packet described in Chapter 15 of the 2011 Accountability Manual. 32

Important Reminders § All appeals must meet the requirements outlined in Chapter 15. § Ratings changed due to granted appeals will be published in late October. § Appeals are not a data correction opportunity. 33

Key Dates for 2011 Accountability

Preview Data Table Release Tuesday, July 19, 2011 § Preview data tables released to districts (and ESCs with access) through TEASE. (Data on TEASE are confidential. TEASE data are not masked). § Districts may submit appeals after review of preview data tables. No appeals will be resolved prior to July 19, 2011. § Student level information to be posted include: § Student listings for SSI grades § Student listings for ELL Progress Indicator (new in 2011) § Student listings for Federal Race/Ethnicity Provision lists (new in 2011) 35

Ratings Release Thursday, July 28 § Districts can access their list of district and campus ratings on the TEASE Accountability site secure web only (1: 00 p. m. target time). Friday, July 29 § District and campus ratings are posted to the public website. § Lists of 2011 accountability ratings for districts and campuses within respective ESC regions are planned to be sent to each ESC director (as a secure PDF via email – 10: 00 a. m. target time). 36

Remaining Calendar Items § § Appeals Panel meets - late September Final Ratings Release and Gold Performance Acknowledgments issued – late October § § 2010 -11 AEIS Reports issued (TEASE) – mid-November 2010 -11 AEIS Reports issued (Public) – late November 2011 -12 PEG list notification – early December 2010 -11 School Report Cards – early December 37

TETN Accountability Update Sessions § August 18 2011 Accountability Results § November 17 Accountability Ratings Update Gold Performance Acknowledgments (GPA) AEIS Reports School Report Cards PEG List Sessions are from 1: 00 – 3: 00 p. m. 38

Accountability Resources § Email the Division of Performance Reporting at performance. reporting@tea. state. tx. us. § Contact the Division of Performance Reporting at (512) 463 -9704. § ESC Accountability Contacts § Online: o ACCT: http: //www. tea. state. tx. us/perfreport/account/ o AEA: http: //www. tea. state. tx. us/aea/ o AYP: http: //www. tea. state. tx. us/ayp/ 39