Fall ELL Assessment Update September 09 2013 TETN

Fall ELL Assessment Update September 09, 2013 TETN Event #20783 Student Assessment Division Texas Education Agency

Disclaimer Ø These slides have been prepared by the Student Assessment Division of the Texas Education Agency Ø If any slide is changed for local use, please remove the TEA footer at the bottom of the slide TEA Fall ELL Assessment Update 2

Topics Ø What’s New Ø STAAR Spanish Highlights Ø STAAR L Ø TELPAS Ø Key Steps to Take this Fall Ø ELL Progress Measure TEA Fall ELL Assessment Update 3

What’s New

What’s New at TEA? Ø Assessments for students served by special education and assessments for ELLs are now the responsibility of the Assessments for Special Populations Unit in the Student Assessment Division. TEA Fall ELL Assessment Update 5

STAAR L Practice Sets Ø Practice sets consist of approximately 25 items for each STAAR L assessment Ø To be posted in early 2014 Ø Will be available in online format similar to TELPAS so that students may experience the items as they will be presented in the operational administration. TEA Fall ELL Assessment Update 6

STAAR L and SSI Ø Beginning 2013– 2014, 5 th and 8 th grade students assessed with STAAR L in mathematics will be held to same SSI requirements for both mathematics and reading, including retesting, as students taking the general STAAR assessments TEA Fall ELL Assessment Update 7

Special English I EOC Provisions TAC § 101. 1007 Ø For ELLs who ― Ø have been enrolled in U. S. schools 3 school years or less (5 or less if qualifying unschooled asylee/refugee) and Ø have not yet attained TELPAS advanced high reading rating Ø When enrolled in English I/ESOL I course, eligible ELL shall not be required to retake assessment each time it is administered if student passes course but does not meet standard Ø Rule to be posted for public comment in October for 30 days Note: Ø Students are not exempt from testing while in the course Ø Provisions do not apply to English II TEA Fall ELL Assessment Update 8

TELPAS Standards Review Ø Committees comprised of ELL focus group members and educators convened in August to review standards for grades 2– 12 TELPAS reading tests Ø Cut scores adjusted for each proficiency level of each grade cluster test Ø These standards will be implemented spring 2014 TEA Fall ELL Assessment Update 9

Data Collection Changes Ø Beginning in the 2013– 2014 school year, students must be enrolled for 60 consecutive school days for that year to count in years in U. S. schools calculations. Please note that this is not to be calculated retroactively. Ø Unschooled Asylee Refugee Ø Continue as it has in the past Ø Students with Interrupted Formal Education (SIFE) Ø SIFE and Limited Prior Schooling groups from 2012– 2013 have been collapsed Ø This data will be collected through the student data upload Ø Specific information will be included in the 2014 TEA Fall ELL Assessment Update DCCM 10

TELPAS Administration Manuals Ø Spring test administration manuals will be split — Ø TELPAS Rater Manual Ø TELPAS Reading Test Administrator Manual Ø This should decrease the number of additional manuals ordered by districts TEA Fall ELL Assessment Update 11

Spanish STAAR Highlights

STAAR Spanish Ø Available for students in grades 3– 5 Ø Grades 3– 5 reading and math Ø Grade 4 writing Ø Grade 5 science Ø Same grades and subjects are tested as English TEA Fall ELL Assessment Update 13

Who Takes STAAR Spanish? Ø Students for whom Spanish version of STAAR test is the most appropriate measure of academic progress Ø LPAC determines if STAAR Spanish is an appropriate assessment for ELLs and non-ELLs TEA Fall ELL Assessment Update 14

STAAR– Increased Expectations Ø Focus is on the most essential curriculum: readiness standards Ø Content and skills are addressed at a greater depth and cognitive complexity Ø Rigor evident on Ø Ø the test as a whole individual test questions more inferential questions performance standards TEA Fall ELL Assessment Update 15

Test Development Process 20 Steps TEA Fall ELL Assessment Update 16

Key Steps in STAAR Item Development Ø Annual Activities: Ø Testing contractor develops items Ø TEA reviews items and ensures items meet quality assurance Ø Educators review the items for appropriateness before they are field tested (language, grade level, TEKS, free from bias, etc. ) Ø Items are field tested Ø Data of items is reviewed Ø Items with solid data are included in the Item Bank Ø Tests are constructed from the Item Bank TEA Fall ELL Assessment Update 17

How is STAAR Spanish Developed? Ø Follow the same guidelines as English item development Ø Reading and Writing Ø The items and/or passages are developed separately to account for cultural and linguistics differences. Ø Mathematics and Science Ø Items from English development are translated or transadapted into Spanish. TEA Fall ELL Assessment Update 18

Transadaptation Process for STAAR Spanish Math and Science Ø Test items for STAAR Spanish are selected from the English development Ø Goal is to build tests for regular STAAR and STAAR Spanish using the same items if appropriate Ø Item writing and review process for transadapted items ensure that items in Spanish are linguistically and culturally appropriate and that they meet grade-level expectations Ø Every year bilingual educators review selected items for STAAR Spanish tests TEA Fall ELL Assessment Update 19

Spanish/English Alignment on STAAR Tests Ø STAAR Spanish and regular STAAR both – Ø follow the same item development guidelines Ø use the same blueprints Ø adhere to same guidelines to build tests in terms of range of content tested and cognitive complexity Ø expect same student performance TEA Fall ELL Assessment Update 20

2013 STAAR Spanish Student Performance 2013 Spanish Total Students (Satisfactory) (Advanced) (Unsatisfactory)LI in 2013 LII-2013 LIII-2013 Grade 03 READ 36, 841 68% 15% 32% Grade 04 READ 24, 323 57% 11% 43% Grade 04 WRIT 25, 436 59% 3% 41% Grade 05 READ 10, 785 70% 10% 30% Grade 03 MATH 19, 024 59% 8% 41% Grade 04 MATH 9, 426 51% 7% 49% Grade 05 MATH 3, 606 44% 5% 56% Grade 05 SCIENCE 5, 370 41% 2% 59% TEA Fall ELL Assessment Update 21

STAAR Spanish Student Performance Spring 2012 and 2013 Grade Subject 2012 2013 % Change 3 Math 56% 59% 3% Reading 65% 68% 3% Math 53% 51% -2% Reading 60% 57% -3% Writing 64% 59% -5% Math* 49% 44% -5% Reading* 69% 70% 1% Science 41% 0% 4 5 * Primary Administrations TEA Fall ELL Assessment Update 22

Key Elements for Success in STAAR Ø Understand the level of performance the TEKS require Ø Teach students the academic vocabulary Ø Teach both readiness and supporting content and skills Ø Emphasize critical/inferential thinking, problem solving, and application rather than isolated or memorized content and skills Ø Reinforce connections between different content areas (e. g. , math and science, math and reading) TEA Fall ELL Assessment Update 23

Examples of Transadapted Items

Grade 3 Math TEA Fall ELL Assessment Update 25

Grade 3 Math – Spanish TEA Fall ELL Assessment Update 26

Grade 5 Science TEA Fall ELL Assessment Update 27

Grade 5 Science – Spanish TEA Fall ELL Assessment Update 28

Grade 5 Math TEA Fall ELL Assessment Update 29

Grade 5 Math – Spanish TEA Fall ELL Assessment Update 30

Additional Information Ø 2013 STAAR tests were released in August Ø Grade 4 Writing Scoring Guides are available on the Student Assessment website Ø Timeline for new mathematics curriculum TEA Fall ELL Assessment Update 31

Timeline for New Mathematics TEKS STAAR Grades 3– 8 Ø New TEKS adopted in April 2012 Ø Convene advisory groups in 2013 Ø New STAAR items are being developed to address new TEKS in 2014 Ø Implement new TEKS in 2014– 2015 school year Ø New STAAR items are field-tested in 2014– 2015 school year Ø New STAAR items are assessed in 2015– 2016 school year TEA Fall ELL Assessment Update 32

STAAR L

2013 STAAR L Administrations Ø Online interface provided certain linguistic accommodations for qualifying students: Ø Clarification in English at the word or phrase level for pre-determined words Ø Words read aloud at the word-by-word level Ø 35, 000 students across the state were administered STAAR L across all administration in 2013 TEA Fall ELL Assessment Update 34

STAAR L Online Student Tutorial Ø Available early spring 2014 Ø Minor updates to grades 3– 8; Updates to EOC version to address assessment changes from HB 5 Ø Should be used to familiarize students with clarification and read aloud accommodations and standard Test. Nav tools Ø Test administration directions for operational STAAR L assessments will assume some familiarity with online interface TEA Fall ELL Assessment Update 35

STAAR L Paper Administrations Ø Paper test booklets (and ECGs as applicable) will be approved by TEA in rare circumstances Ø Accommodations that are not available in Test. Nav Ø Unavoidable technological problems that make online testing impossible Ø Other special situations (e. g. , homebound students, JJAEPs, etc. ) Ø Detailed information about STAAR L paper request process will be posted on Coordinator Manual Resources page at http: //www. tea. state. tx. us/student. assessment/manuals/ dccm TEA Fall ELL Assessment Update 36

STAAR L Paper Administrations Ø Student who was approved for a paper administration in the spring but is retesting in December will not automatically receive paper materials Ø DTC should forward prior approval to TEA at ELL. tests@tea. state. tx. us so paper materials can be ordered from Pearson TEA Fall ELL Assessment Update 37

ELLs with Parental Denials TAC § 101. 1005 (f) Ø Reminder: These students are not eligible for special ELL assessment, accommodation, or accountability provisions Ø Ø No testing in Spanish No linguistic accommodations during testing No English I EOC special provisions No unschooled asylee/refugee provisions Ø ELLs with parental denials may, however, use bilingual, ESL, or other allowable dictionaries as part of dictionary policy for STAAR reading and writing tests in grade 6 and up; under this policy, use of dictionaries not considered linguistic accommodation TEA Fall ELL Assessment Update 38

TELPAS

TELPAS Administration Ø Assessment window for spring: March 17– April 9 Ø Data verification window: April 10– 11 TEA Fall ELL Assessment Update 40

TELPAS Spring Dates Date Activity Jan 13 Assembling and Verifying Grades 2– 12 Writing Collections course available Jan 6 -10 TELPAS manuals shipped to districts Jan 24 End date for district coordinator training—all TELPAS components Jan 27 Online basic training courses for new K– 1 and 2– 12 raters available Jan 27 Supplemental support provider recorded Web-based training available Feb 7 End date for campus coordinator training—holistically assessed components Feb 17 Calibration window opens for new and returning raters—first 2 sets Feb 17 End date for training raters on administration procedures Feb 17 Earliest eligibility date for TELPAS writing samples Feb 26 3 rd and final calibration set available; supplemental training begins Mar 17 -Apr 9 TELPAS assessment window TEA Fall ELL Assessment Update 41

Holistic Rating Training Resources 2013– 2014 training resources: Ø Power. Point presentations (updated) Ø Making the ELPS-TELPAS Connection: K– 12 Overview Ø Introductory Training on the PLDs (separate modules for K– 1 and 2– 12) Ø Grades 2– 12 Writing Collection Overview Ø Holistic Rating Training Requirements Ø Educator Guide to TELPAS These resources will be available on the TELPAS Resources webpage at www. tea. state. tx. us/student. assessment/ell/telpas/ TEA Fall ELL Assessment Update 42

TELPAS Calibration – Spring 2012 and 2013 Grades K– 1 Grade 2 Grades 3– 5 Grades 6– 8 Grades 9– 12 2012 Total Successful Calibrations 29205 100% 15464 100% 36054 100% 17160 99% 14988 98% 2013 Total Successful Calibrations 29689 100% 15336 100% 36415 99% 17460 99% 15454 98% 2012 Successful after Set 1 26599 91% 13863 90% 30142 83% 13233 77% 9964 65% 2013 Successful after Set 1 25901 87% 11466 75% 23432 64% 13659 77% 12154 77% TEA Fall ELL Assessment Update 43

TELPAS Calibration – Spring 2012 and 2013 Grade s K– 1 Grade 2 Grades 3– 5 Grades 6– 8 Grades 9– 12 2012 Successful after Set 2 2365 8% 1336 9% 4948 14% 3433 20% 3804 25% 2013 Successful after Set 2 3234 11% 3203 21% 10126 28% 2424 14% 2702 17% 2012 Successful after Set 3 241 1% 265 2% 964 3% 494 3% 1220 8% 2013 Successful after Set 3 554 2% 667 4% 2857 8% 1377 8% 598 4% 2012 Unsuccessful after Set 3 8 0% 136 0% 87 0% 246 2% 2013 Unsuccessful 47 46 250 199 379 TEA Fall ELL Assessment Update 44

TELPAS Course Completions– Spring 2013 Course Completions Assembling and Verifying Writing Collections 8138 Grades K– 1 Online Basic Training Course 17961 Grades 2– 12 Online Basic Training Course 22741 TEA Fall ELL Assessment Update 45

TELPAS Release Ø There will be a full release of TELPAS forms for all grade bands in 2014. Ø These are to be released in an online format to allow them to be seen in the Test. Nav environment, just as the students see the operational test. TEA Fall ELL Assessment Update 46

Key Steps to Take This Fall

1. Conduct ELPS and TELPAS professional development sessions Ø Teachers are required to implement the ELPS and content area TEKS in instruction Ø District and campus administrators need working knowledge of ELPS and TELPAS Ø TELPAS familiarization training is Ø good for future raters Ø good way to reinforce use of PLDs all year long TEA Fall ELL Assessment Update 48

2. Help support teacher use of TELPAS results and ELPS PLDs to monitor and maximize learning of English Ø Beginning of year: Ø Review ELLs’ past TELPAS results to see if making steady progress in learning English Ø TELPAS confidential campus student rosters include Ø 2 years of test scores Ø how long student has been in U. S. schools TEA Fall ELL Assessment Update 49

3. Help support LPAC use of TELPAS results and ELPS PLDs to monitor and maximize learning of English LPAC meetings during school year: Ø Use previous spring’s TELPAS results and current year’s teacher input to Ø gauge progress in English proficiency Ø review and adjust linguistic accommodations used in instruction Ø plan for instructional interventions, if necessary Ø plan for linguistic accommodations during state assessment TEA Fall ELL Assessment Update 50

Remember Ø When implemented effectively in instruction, linguistic accommodations Ø accelerate learning of academic content and English Ø reduce length of time and degree to which substantial linguistic accommodations needed The ELPS, as measured by TELPAS, support better learning of the TEKS, as measured by STAAR TEA Fall ELL Assessment Update 51

ELL Progress Measure

What Will the TEXAS ELL Progress Measure Look Like? Ø ELL Progress Measure will: Ø take into account the amount of time needed to acquire English affects time needed to fully learn and demonstrate grade-level academic skills in English Ø be applied to all content areas Ø Brochure with more information to be posted this fall on the ELL Assessments webpage at http: //www. tea. state. tx. us. student. assessment/ell TEA Fall ELL Assessment Update 53

ELL Progress Measure Conceptual Model Satisfactory TEA Fall ELL Assessment Update 54

Initial Years in Schools 1 DRAFT 1 1 2 2 3 3 3 4 TEA Fall ELL Assessment Update 4 Initial TELPAS Composite Proficiency Level Beginning and Extenuating Circumstances Beginning Intermediate Advanced High Intermediate or Below and Extenuating Circumstances Intermediate or Below Advanced High Advanced or Below and Extenuating Circumstances Advanced or Below Advanced High or Below and Extenuating Circumstances Any TELPAS Score Plan 5 -Year Plan 4 -Year Plan 3 -Year Plan 2 -Year Plan 1 -Year Plan 5 -Year Plan 4 -Year Plan 3 -Year Plan 2 -Year Plan 5 -Year Plan 4 -Year Plan 3 -Year Plan 5 -Year Plan 4 -Year Plan 55

ELL Progress Measure Plan Expectation 1 st Year (E 1) 2 nd Year (E 1) 5 -Yr Plan 3 rd Year (E 2) 4 th Year (E 3) 5 th Year (LII) 1 st Year (E 1) DRAFT 4 -Yr Plan 2 nd Year (E 2) 3 rd Year (E 3) 4 th Year (LII) 1 st Year (E 2) 3 -Yr Plan 2 nd Year (E 3) 3 rd Year (LII) 2 -Yr Plan 1 st Year (E 3) 2 nd Year (LII) 1 st Year (LII) TEA Fall ELL Assessment Update 56

How Will the ELL Progress Measure be Used? Ø ELL Progress Measure will be incorporated into the 2014 state accountability reports Ø Used to calculate accountability for both Index 1 &2 Ø For detailed information regarding the accountability system: http: //ritter. tea. state. tx. us/perfreport/account/2013/ 20130328 coe/pi_technical_5 -23 -13. pdf TEA Fall ELL Assessment Update 57

Upcoming ELL Assessment Training Annual ESC LPAC Assessment Training TETN October 8, 2013 9: 00 a. m. – 12: 00 p. m. Event #20784 Open to ESCs only TEA Fall ELL Assessment Update 58

Would you like to Participate in an Educator Committee? Educators are invited to review items before they are field tested for: STAAR (all programs) and TELPAS Please go to the following link to nominate yourself or other educators: http: //educator. force. com/TX TEA Fall ELL Assessment Update 59

Actual Educators’ Comments “This was a great learning experience” “I would love to participate again” “Fue una experiencia muy bonita y educativa” “The meeting was informative and made me feel like I made a difference” “Awesome experience!” “!Aprendí mucho!” “Excellent process and very beneficial!” “I really felt that I contributed with my opinions” TEA Fall ELL Assessment Update 60

Contact Information Ø Go to www. tea. state. tx. us/student. assessment and click on ELL Assessments Ø Call the TEA Student Assessment Division at (512) 463 -9536 Ø Email us at ELL. tests@tea. state. tx. us TEA Fall ELL Assessment Update 61