Understanding the National Reporting System NRS Rosemary Matt

Understanding the National Reporting System NRS Rosemary Matt NYS Director of Accountability

From where did it come? l 1998 Federal Legislation l Workforce Investment Act l Title II = Adult Education l Implemented in 1999 l NYS began in 2001 l First NRS Report in 2003

Why Accountability? All states must report on common reporting measures All states must use OCTAE approved standardized (normed) assessments All states must report performance annually

New York State Decision l All funding sources, in addition to WIA, both state and Federal will be reported under the same guidelines as the NRS – EPE – Employment Preparation Education – WEP – Welfare Education Program – ALE – Adult Literacy Education

Educational Gain l Students must meet THRESHOLD CRITERIA – Have a valid pre assessment – 12 Contact Hours

Measuring Educational Gain l Students are assessed in BOTH Reading and Math l Their LOWER skill level determines their placement in NRS l Educational Gain is measured and counted ONLY in the LOWER skill level

NRS Level National Reporting System (NRS) Levels Grade Level Equivalents 1 Beginning ABE Literacy 0 – 1. 9 2 Beginning Basic Education 2 – 3. 9 3 Low Intermediate Basic Education 4 – 5. 9 4 High Intermediate Basic Education 6 – 8. 9 5 Low Adult Secondary Education 9 – 10. 9 6 High Adult Secondary Education 11 – 12. 9

Program Evaluation Report Enrollment includes students meeting the NRS threshold criteria: • 12 Hours of contact time + Key Demographics • Valid Pre Test

NYS Policy under NRS l l l All 5 key demographics must be complete – Name, birth date, ethnicity, gender, employment status Student has a VALID pre test Must match Instructional Code – TABE = BE, HSE/GED, or Ma – BEST Plus/BEST Literacy = ES (Spanish GED) Student is enrolled in a BE, HSE, Ma or ES Instructional Activity in current fiscal year Student must have a minimum of 12 contact hours (this includes any INTAKE hours)

What is a valid pre-test? l Must be within the scoring range on the NYS Validity Tables l Must match the Instructional Offering Code – ESL Code = BEST + or BEST + and BEST Literacy – BE or GE Code = TABE l Must have a valid date range. A pre test in FY 14/15 must be dated between January 1, 2014 and June 30, 2015

Students with invalid test scores Note: When an asterisk (*) appears next to the TABE Level, this indicates that either the FORM or LEVEL was an incorrect choice

Students with invalid test scores Note: When the Scale Score, GE, and NRS Level is zeroed out (all zeros), the student’s score fell outside the valid range

Educational Gain Number Making Gain includes students who have a valid pre test and valid post test showing improvement of at least one Educational Functioning Level.

What’s a valid post test? l Must be within the scoring range on the NYS Validity Table l If using the TABE, must be the opposite form (Pre on a 9, then Post on a 10) l Must always move levels contiguously (Pre on one level, then post on the same level or one higher, never backward) l Must have a valid date range. A post test in FY 14/15 must be dated between July 1, 2014 and June 30, 2015

Post Test Rate represents the number of students who have a valid post test score divided by the number of students enrolled at each Educational Functioning Level. The Post Test must meet all the requirements of a valid test but it does not necessarily need to show gain to be counted in the post test rate.

Average Contact Hours is a simple average of all cumulative contact hours in a fiscal year divided by the number of students enrolled at each Educational Functioning Level.

Primary Goals: l § § § Primary Goals: Improve Basic Literacy Skills Improve English Literacy Skills Obtain a Job Retain Employment Earn High School Equivalency Diploma Enter Post Secondary Education or Training

Secondary Goals: l l l Obtain Citizenship Skills Reduce Public Assistance Get involved in Community Activities Get involved in Children’s Education Get involved in Children’s Literacy Activities Vote or Register to Vote

Enter Employment For FY 2014/2015 For Enter Employment this column will include those students having the goal of “Obtain Employment” and exited in Quarters 2, 3, and 4 of FY 13/14 AND students exiting in Quarter 1 of FY 14/15.

Employment Outcomes Quarter 2 FY 14 Quarter 1 FY 15 Quarter 3 FY 14 Quarter 4 FY 14 Employment FY 14/15

Retain Employment For FY 2014/2015 For Retain Employment this column will include those students having the goal of “Retain Employment” and exited in Quarter 4 of FY 12/13 AND students exiting in Quarters 1, 2, and 3 of FY 13/14.

Retain Employment Outcomes Quarter 4 FY 13 Quarter 3 FY 14 Quarter 1 FY 14 Quarter 2 FY 14 Retain Employment FY 14/15

Enter Postsecondary Education or Training For FY 2014/2015 For Enter Postsecondary Ed/Training , this column will include those students having the goal and exited in Quarters 1, 2, 3 and 4 of FY 14/15

Obtain HSE/GED or High School Diploma For FY 2014/2015 For Obtain HSE/GED or HS Diploma , this column will include those students having the goal and exited in Quarters 1, 2, 3 and 4 of FY 14/15

Follow Up Outcomes Percentage Achieving Outcome: This column represents those students who have responded in a positive way to the required program Survey

Follow Up Outcomes NYS FY 14/15 Averages: This is the Benchmark for Follow Up Outcomes in NYS. To arrive at this number, all students achieving the outcome from any of the 3 Goal areas are combined and divided by the sum of all students enrolled with goals who have exited.

Additional Follow Up Outcomes NYS FY 14/15 Averages: This is the Benchmark for Follow Up Outcomes in NYS. To arrive at this number, all students achieving the outcome from any of the 3 Goal areas are combined and divided by the sum of all students enrolled with goals who have exited.

Additional Follow Up Outcomes NYS FY 14/15 Averages: This is the Benchmark for Follow Up Outcomes in NYS. To arrive at this number, all students achieving the outcome from any of the 3 Goal areas are combined and divided by the sum of all students enrolled with goals who have exited.

Survey Response Rate: Includes students from: • Enter Employment • Retain Employment • GED Goal • Postsecondary Education Remember: Even a Negative Response is counted as a Response!

Automatic Goal Cohorts l Employment Status: – Employed • Goal = Retain Employment – Unemployed • Goal = Obtain a Job – Not in Labor Force • No Goal Set

High School Equivalency Goals l Students who are enrolled in HSE/GED coded Instructional Offerings l Students entering the program with BOTH math and reading scores of NRS Level 6 l Students enrolled in the Assessment Phase of the NEDP program

Postsecondary Goals l Students who take and pass the current TASC test scores are entered into ASISTS, the new goal will be automatically added l Earned a secondary credential while enrolled l Have a secondary credential at entry (US or foreign)

Contact Information: Rosemary. Matt@cayuga-cc. edu