ELL Assessment Update Annual Texas Assessment Conference November

ELL Assessment Update Annual Texas Assessment Conference November 2012 Megan Galicia, STAAR L Manager Cristina Vázquez, TELPAS Manager Student Assessment Division Texas Education Agency

Disclaimer These slides have been prepared by the Student Assessment Division of the Texas Education Agency If any slide is changed for local use, please remove the TEA footer at the bottom of the slide TEA ELL Assessment Update 2

Topics Demographics and Performance Trends STAAR L Updates TELPAS Updates SSI ELL Progress Measure and TELPAS-STAAR Alignment Review of ELL Assessment Policies Q&A Keys to Success TEA ELL Assessment Update 3

DEMOGRAPHICS AND PERFORMANCE TRENDS

ELLs in Texas (PEIMS, 2011– 2012) • 838, 494 ELLs in Texas public schools (up from about 570, 000 in 2000) • Over 120 languages represented • More than 90% Spanish speakers • Other languages represented: Vietnamese, Arabic, Urdu, Korean, Burmese TEA ELL Assessment Update 5

Students assessed 2011– 12: K-2 323, 536 3 -12 429, 029 B = Beginning I = Intermediate A = Advanced High Former Test (RPTE) TEA ELL Assessment Update 6

Spring 2012 STAAR Algebra I Percent Passing (Level II) TEA ELL Assessment Update 7

Spring 2012 STAAR World Geography Percent Passing (Level II) TEA ELL Assessment Update 8

Spring 2012 STAAR Biology Percent Passing (Level II) TEA ELL Assessment Update 9

Spring 2012 STAAR English I Percent Passing (Level II) TEA ELL Assessment Update 10

Spring 2012 STAAR L Percent Passing (Level II) TEA ELL Assessment Update 11

STAAR Standard Setting • February 2012 for EOC assessments • October 2012 for grades 3– 8 assessments, including STAAR Spanish for grades 3– 5 • Student reports provided to districts in January 2013 TEA ELL Assessment Update 12

STAAR L UPDATES

Key Changes • • STAAR L in grades 3– 8 and EOC will be administered online beginning in spring 2013 Paper-based testing will be approved by TEA only in rare circumstances; approval process same as for TELPAS paper STAAR L online interface allows students to hear words read aloud; therefore, students will need headphones if testing in a group Students taking STAAR L can be grouped with students taking STAAR and STAAR Modified as long as students will not be confused by differences in directions or additional accommodations provided TEA ELL Assessment Update 14

STAAR L Transition From Paper to Online Mode Note: No change to mode of testing for STAAR and STAAR Modified TEA ELL Assessment Update 15

STAAR L Online Student Tutorials • Available starting January 2013 • Should be used to familiarize students with clarification and read aloud accommodations and standard Test. Nav tools • Test administration directions for spring 2013 STAAR L assessments will assume some familiarity with online interface TEA ELL Assessment Update 16

Administering STAAR L Online • • No test administrator-provided accommodations Districts will continue to have flexibility regarding testing calendar (see 7/22/11 letter for details) • Multiple test sessions may be scheduled each day (e. g. , one morning, one afternoon) • As stated on a previous slide, STAAR L test takers may be grouped with students taking STAAR and STAAR Modified TEA ELL Assessment Update 17

December STAAR L EOC Administrations • December 2012 EOC: last STAAR L test administration to use paper test booklets • Clarification in English and reading aloud will be provided by test administrator • English Clarification Guides (ECGs) will be available for test administrators providing clarification • Use the Training on Linguistic Accommodations for the STAAR Program Power. Point from the February 2012 TETN to train test administrators. Power. Point is available at http: //www. tea. state. tx. us/student. assessment/ell/sta arl/ TEA ELL Assessment Update 18

STAAR L Paper Administrations Spring 2013 and Beyond Special Request Process • Paper test booklets (and ECGs) will be approved by TEA in rare circumstances • Accommodations that are not available in Test. Nav • Unavoidable technological problems that make online testing impossible • Other special situations (e. g. , homebound students, JJAEPs, etc. ) TEA ELL Assessment Update 19

STAAR L Paper Administrations Spring 2013 and Beyond Request process for STAAR L paper booklets (same as TELPAS paper process) Districts submit paper request form to Ell. Tests@tea. state. tx. us Requests should be submitted 2 weeks before testing to allow for processing and shipping If request is approved, TEA will notify district and order booklets Shipment will include ECGs TEA ELL Assessment Update 20

STAAR L Paper Administrations Spring 2013 and Beyond There is one paper request form that includes STAAR L and TELPAS Districts may, but are not required to, submit STAAR L and TELPAS paper requests on same form Information about request process, including the paper request form, will be posted on Coordinator Manual Resources page at http: //www. tea. state. tx. us/student. assessment/manuals/dcc m/ TEA ELL Assessment Update 21

STAAR L Paper Administrations Spring 2013 and Beyond Manuals There is a separate coordinator and test administrator supplement for STAAR L paper administrations Included in shipments of paper booklets Posted on the Coordinator Manual Resources page STAAR administration manuals do not include instructions for paper-based STAAR L testing TEA ELL Assessment Update 22

STAAR L Paper Administrations Spring 2013 and Beyond Keep in Mind… Paper testing won’t be approved on basis that student knows very little English has limited exposure to computers Don’t forget the STAAR L tutorials! TEA ELL Assessment Update 23

STAAR L EOC Eligibility • For EOC, eligibility for STAAR L can be carried over from spring to the July and December administrations • Example: A student was in his 3 rd year in U. S. schools in the 2011– 2012 school year. He took STAAR L in May, but did not meet the minimum score. The LPAC may carry over eligibility to both the July 2012 and December 2012 STAAR L EOC administrations. In spring 2013, however, he would be in his 4 th year in U. S. schools and no longer eligible for STAAR L. TEA ELL Assessment Update 24

TELPAS UPDATES

Data Collection Changes • • For this year, years in U. S. schools data collection will continue as it has in the past Required additional data collection for ELLs with extenuating needs: • Unschooled ELL asylees/refugees • Other immigrant ELLs who enter U. S. with little prior schooling • First-year immigrant ELLs who enter U. S. schools late in school year • ELLs who go back and forth between U. S. and another country (gaps in continuous schooling in U. S. ) within and across school years • ELLs with a disability that significantly affects growth in second language acquisition • TETN to train ESCs and districts on this data collection scheduled for January 23 (#4851) 9– 11 a. m. TEA ELL Assessment Update 26

TELPAS Validity and Reliability Audit for Spring 2013 • TEA will evaluate the writing domain in grades 2– 12 by rescoring a statewide representative sample of student writing collections • Districts will be notified of the campuses selected for the audit in the spring • Information about rater adherence to the assessment protocol and district adherence to required training and testing procedures will be collected TEA ELL Assessment Update 27

STUDENT SUCCESS INITIATIVE (SSI)

SSI Policies • SSI policies related to recent immigrant ELLs and unschooled asylees/refugees undergoing agency review • Policies will be finalized and disseminated in a letter to districts in time for implementation TEA ELL Assessment Update 29

ELL Progress Measure and TELPAS-STAAR Alignment

STAAR and TELPAS Relationship • TELPAS is aligned with the Texas English Language Proficiency Standards (ELPS), which target development of academic English language proficiency • By supporting development of academic English, ELPS support learning of content area TEKS • As part of transition to more rigorous STAAR program, TEA is currently examining relationship of TELPAS to STAAR and will make adjustments if needed to ensure strong link between academic language proficiency assessed on TELPAS and academic language demands of STAAR TEA ELL Assessment Update 31

What might an ELL progress measure look like in Texas? Current plan: Establish a timeframe for becoming English proficient then establish academic performance (progress) expectations for ELLs that increase progressively based on relationship between state’s expectations for learning English (measured by TELPAS) and subject matter (measured by STAAR) • • • Progress expectations to be annually increasing STAAR scale score expectations that culminate in STAAR Level II: Satisfactory standard at the timeframe’s “finish line” STAAR progress expectations to align with challenging but reasonable expectations for learning academic English Where the scale score expectations are set should support ability of ELLs to reach STAAR Level II standard within state-established timeframe TEA ELL Assessment Update 32

ELL Progress Measure • In 2013, TEA plans to release information in the state data file and student portal using current TELPAS domain weights and current TELPAS standards • In 2014, ELL progress measure to be used for accountability and reported in the teacher, student, and analytic reporting portals using new domain weightings and revised TELPAS standards 33

REVIEW OF ELL ASSESSMENT POLICIES

Participation in General STAAR Assessment • Taken by ELLs and other students not administered STAAR Spanish, STAAR L, STAAR Modified, or STAAR Alternate • Remember: • STAAR L is for mathematics, science, and social studies, not reading and writing • STAAR Spanish is for grades 3– 5 only • Linguistic accommodations beyond testing in native language not permitted for STAAR Spanish • ELLs taking general STAAR assessments permitted some linguistic accommodations TEA ELL Assessment Update 35

Alignment of STAAR, STAAR Spanish, and STAAR L Same: • • Assessed curriculum and item types STAAR blueprints for building tests Achievement standard alignment Focus on readiness for next grade level or course with goal of postsecondary readiness Differences have to do with language accessibility: • • STAAR Spanish uses native language to help students understand test STAAR L provides English-language accommodations to help students understand test TEA ELL Assessment Update 36

Eligibility for STAAR Spanish & STAAR L *For STAAR L EOC assessments, eligibility can be carried over from spring to the July and December administrations. TEA ELL Assessment Update 37

STAAR Spanish Decisions • Must be individual student decisions • Grade-based or program-based decisions not authorized • LPAC must use input of student’s teacher(s) in making STAAR Spanish decisions • STAAR Spanish may be given in grades 3– 5* as long as LPAC determines STAAR Spanish to be most appropriate measure of student’s academic progress * For the STAAR program, whether a student has been retained and would be taking STAAR in Spanish for more than 3 years is not a limiting factor TEA ELL Assessment Update 38

STAAR L is for… • Students who require moderate to substantial linguistic accommodation to understand the English used on STAAR mathematics, science, and social studies assessments • Students for whom clarification of word meaning in English and/or reading words aloud (in addition to potentially using a bilingual dictionary and having extra time) is important to their ability to understand challenging material written in English TEA ELL Assessment Update 39

STAAR L Eligibility • All students taking STAAR L will have access to the accommodations of clarification in English and reading aloud of text in online system • As part of the decision-making process, LPACs should determine and document whether the student needs at least one of these accommodations. If not, the student should take STAAR L is not for ELLs for whom a bilingual dictionary and/or extra time suffice. STAAR allows these linguistic accommodations. 40 TEA ELL Assessment Update

Assessment Decisions for ELLs Receiving Special Education Services • ELLs receiving special education services may • be administered any STAAR assessment for which they meet participation requirements Small number of ELLs receiving special education services meet requirements to take STAAR Modified or STAAR Alternate • ELLs participate only on basis of disability, not second language acquisition • LPAC works in conjunction with ARD committee to make assessment decisions for these students TEA ELL Assessment Update 41

Linguistic Accommodations in Instruction • Are required by ELPS • Support learning of both subject matter and English • Are to be provided by all teachers of ELLs • Are monitored and adjusted by teachers as students learn more English TEA ELL Assessment Update 42

Linguistic Accommodation Eligibility Criteria and Decisions • Linguistic accommodation decisions must be made on individual student basis by LPAC • Decisions must be based on — • student’s particular needs for second language acquisition support • whether student is routinely provided the accommodation in instruction and testing • Providing unfamiliar accommodations may hinder rather than help student • LPACs must coordinate with subject area teachers TEA ELL Assessment Update 43

Differing Degrees of Linguistic Accommodation for STAAR Spanish: Assessment is provided in student’s native language; other linguistic accommodations not applicable TEA ELL Assessment Update 44

Linguistic Accommodations: STAAR *Dictionary access to be provided for all students in grade 6 and up as part of STAAR dictionary policy TEA ELL Assessment Update 45

Linguistic Accommodations: STAAR L *Provided in online interface beginning spring 2013 TEA ELL Assessment Update 46

Linguistic Accommodations: STAAR Modified *Unique to STAAR Modified **Dictionary access to be provided for all students in grade 6 and up as part of STAAR dictionary policy TEA ELL Assessment Update 47

Dictionaries • Two sources for dictionary policies for ELLs taking STAAR: STAAR dictionary policy • Applies to reading and writing assessments in grade 6 and above • Available at http: //www. tea. state. tx. us/student. assessment/staar/reading/ Linguistic Accommodations for ELLs Participating in the STAAR Program guide • Outlines policies for the use of dictionaries on all other tests not covered under the STAAR dictionary policy • Available at http: //www. tea. state. tx. us/student. assessment/accommodatio ns/ TEA ELL Assessment Update 48

Special English I and II EOC Provisions TAC § 101. 1007 For ELLs who ― • have been enrolled in U. S. schools 3 school years or less (5 or less if qualifying unschooled asylee/refugee) and • have not yet attained TELPAS advanced high reading rating Why these provisions? In English I and II/ESOL I and II courses, these students may require substantial instructional scaffolding and linguistic adaptation not feasible on standardized language arts assessments TEA ELL Assessment Update 49

Three Special Provisions When enrolled in English I or II/ESOL I or II course, eligible ELL shall not be required to — • include assessment score in cumulative score for graduation; • retake assessment each time it is administered if student passes course but does not achieve minimum score; or • have score count for 15% of student’s final grade TEA ELL Assessment Update 50

Special English I/II EOC Provisions Note: • Students must take assessment while in the course • Provisions do not apply to English III • Students may graduate under any of the graduation programs (Minimum, Recommended, Distinguished) as long as they fulfill the corresponding requirements • LPAC is not required to meet to re-establish eligibility for students that fail a spring course and re-enroll in the course in the subsequent summer or fall. Eligibility in spring carries over to summer and fall. TEA ELL Assessment Update 51

Decision-Making Body • LPAC is responsible for obtaining teacher input and making assessment and linguistic accommodation decisions for ELLs • For ELLs served by special education, the ARD committee and LPAC work in conjunction to make these decisions • More information about procedures for LPACs and ARD committees to follow in making and documenting ELL assessment and accommodation decisions is available on TEA LPAC Assessment Resources webpage Linguistic accommodation and assessment decisions are not “automatic; ” they are made on an individual student basis in accordance with TEA administrative procedures TEA ELL Assessment Update 52

ELLs with Parental Denials TAC § 101. 1005 (f) Reminder: These students are not eligible for special ELL assessment, accommodation, or accountability provisions • • No testing in Spanish No linguistic accommodations during testing No English I/II EOC special provisions No unschooled asylee/refugee provisions ELLs with parental denials may, however, use bilingual, ESL, or other allowable dictionaries as part of STAAR dictionary policy on reading and writing tests in grade 6 and up; under this policy, use of dictionaries not considered linguistic accommodation TEA ELL Assessment Update 53

ELL Assessment Resources— STAAR TEA ELL Assessment Update 54

Questions & Answers

Q&A Q: We have an ELL who will take the retest in December. If there is no change to the assessment and accommodations the student will receive, does the LPAC need to re-convene to make an assessment decision for this student? A: The LPAC is not required to meet if it has been determined that the testing decision and accommodations remain the same. TEA ELL Assessment Update 56

Q&A Q: How are the STAAR L EOC assessments related to graduation requirements? A: STAAR L EOC tests count toward graduation requirements in the same way as STAAR assessments. Q: How does the 15% rule apply to STAAR L tests? A: The commissioner of education has deferred the implementation of the 15% grading requirement for the 2012– 2013 school year for all STAAR EOC assessments, including STAAR L. TEA ELL Assessment Update 57

Q&A Q: Do students taking STAAR L have to retest if they don’t meet the minimum score? A: Yes. Students who don’t meet the minimum on a STAAR L EOC assessment are required to retest. Q: Do students who take STAAR L have to graduate under the minimum plan? A: No. Students who take STAAR L may graduate under any of the graduation programs as long as they fulfill the corresponding requirements. TEA ELL Assessment Update 58

Q&A Q: How long do students who meet the eligibility criteria for the English I/II special provisions get to decide whether to apply the provisions? A: Students who meet the eligibility criteria when they are enrolled in and subsequently pass the applicable course (English I or II, ESOL I or II) can decide whether to apply the special provisions to that assessment until they meet graduation requirements. 59

Keys to Success

ELPS and Content Area TEKS • Make sure ELPS are being implemented • Ensure teachers know and use ELP levels of their ELLs to linguistically accommodate instruction, adjusting accommodations appropriately as more English is learned • Act promptly to identify subject matter and language needs of first-year immigrants • Make instructionally sound linguistic accommodations • Teach ELLs to use dictionaries (bilingual, ESL, standard) effectively as second language acquisition tools 61 TEA ELL Assessment Update

Affective Needs of Arrived ELLs Newly • Spread calm and encouraging vibrations to ELLs who are recent arrivals to this country • Help them look at their first year of test results as good information to use in setting and meeting goals for the following year • Engage all ELLs in setting and reaching goals for English acquisition and academic achievement TEA ELL Assessment Update 62

Recommendations for Educator Review Committees • • • As part of test development process for the state assessments, TEA convenes committees of educators each year to review items for state assessment programs Committees assembled from database of recommended educators Need recommendations for educators who have experience working with ELLs Recommendation forms available at http: //www. tea. state. tx. us/student. assessment/Recomm endation. Educator. Committee. pdf TEA ELL Assessment Update 63

Additional ELL Presentations Texas Assessment Conference • TELPAS for Spring 2013: Tips for Success Friday, November 30 from 8– 9: 15 a. m. in ACC Ballroom D TETN Videoconference • TELPAS Additional Data Collection (#4851) January 23, 2013 from 9: 00– 11: 00 a. m. TEA ELL Assessment Update 64

Need More Information? • Go to www. tea. state. tx. us/student. assessment and click on ELL Assessments • Call the TEA Student Assessment Division at (512) 463 -9536 • Email us at ELL. tests@tea. state. tx. us TEA ELL Assessment Update 65