New York State Report Cards Presented by Rosemary

New York State Report Cards Presented by: Rosemary Matt NYS Director of Accountability Program Report Cards Fiscal Year 10/11

Evaluated in TWO Methods NYS Benchmarks Quartile Ranked Educational Gain = 46% Educational Gain (Weighted) Post Test Rate = 65% Post Test Rate Follow Up Outcomes = 69% Follow Up Outcomes

NYS Quartile Ranking l Quartile 1 0 -. 99 Unacceptable l Quartile 2 1 – 1. 99 Needs Improvement l Quartile 3 2 – 2. 99 Proficient l Quartile 4 3 – 4. 00 Highly Proficient

Quartile Rank l Unacceptable – l Needs Improvement – l Missed one or more benchmark & in the 2 nd, 3 rd, or 4 th quartile Proficient – l Missed one or more benchmark & in the 1 st quartile Has met all the benchmarks (any quartile) Highly Proficient – Has met all the benchmarks & in quartile 4

An overview of the program:

Data from Program Evaluation Report:

NYS Benchmark Summary: NYS Benchmarks: • Education Gain = 46% • Post Test Rate = 65 % • Follow-up Outcomes = 69%

Post Test Rate: Post Test Rate is also Quartile Ranked

Post Test Rate:

NYS Benchmark Summary: NYS Benchmarks: • Education Gain = 46% • Post Test Rate = 65 % • Follow-up Outcomes = 69%

Where have you seen them before:

Follow Up Outcomes: Raw numbers used to calculate Program Performance in Percent # students achieving goal # students exiting with goal = 86. 5%

Weighted Academic Gain:

Goal Setting: 0 5 10

Response Rate: 0 10

Quartile Rank Summary: Note: Quartile Rank includes Weighted Educational Gain

Overall Performance: Quartiles Quartile 1 0 -. 99 Unacceptable Quartile 2 1 – 1. 99 Needs Improvement Quartile 3 2 – 2. 99 Proficient Quartile 4 3 – 4. 00 Highly Proficient

Overall Performance: 0 1 2 3 4 1. 35 Quartile 1 Quartile 2 Quartile 3 Quartile 4

Rubric for FY 10/11: • Educational Gain (40%) • Follow Up Outcomes (20%) • Post Test Rate (20%) • Employment & GED Goal Setting (10%) • Response Rate (10%)

Total Score – Calculations for FY 10/11 l Maximum rating points to be earned: – Weighted Academic Gain Follow-up Measures Post Test Rate Goal setting Response Rate – Maximum Total – – 40 20 20 10 10 100

NRS Changes

Change Effective July 1, 2012 l OVAE has accepted major change to NRS Guidelines l All proposed changes begin July 1, 2012 l ASISTS will make changes in data system to begin July 1, 2012

1 st Major Change Employment Goals & Outcomes

Now July 1, 2012 Current System: Students are assessed at Intake Determination is made: Changes to System: Students are assessed at Intake Determination is made: Is student employed __yes __no Is student available for work? __yes __no If YES, then assign the goal of “Obtain Employment” (70% Target) If NO – then student status is coded as “Not in the workforce” If YES, then ASISTS will automatically assign the goal of “Obtain a Job” to all students in this cohort If NO – then student status is coded as “Not in the workforce” Let’s compare

Now July 1, 2012 Current System: Students are assessed at Intake Determination is made: Changes to System: Students are assessed at Intake Determination is made: Is student employed __yes __no If YES – is student enrolled in literacy to Retain his/her employment? If YES, then ASISTS will automatically assign the goal of “Retain Employment” to all students in this cohort. Program must conduct Follow Up Survey on each student 3 Quarters after student exits the program. If YES – code student with goal of “Retain Employment” Let’s compare

2 nd Major Change GED® Goal & Outcome

Now July 1, 2012 Current System: Students are assessed at Intake Determination is made: Changes to System: Students are assessed at Intake Determination is made: Does student have the goal of attaining a High School Equivalency Diploma __yes __no Programs must report the total number of enrolled students who take all the GED tests during the year and the number who pass them to calculate a pass rate. If YES, then assign the goal of “Obtain GED” Let’s compare All GED test data will now be recorded in ASISTS and a pass rate will be calculated for each program.

3 rd Major Change Enter Postsecondary Education or Training Goal & Outcome

Now Current System: Students are assessed at Intake Determination is made: Does student have the goal of attaining a High School Equivalency Diploma __yes __no If YES, then assign the goal of “Obtain GED” Second Question – Does the student also have the goal of entering Postsecondary Education or Training? If YES, assign goal (50% target) Let’s compare July 1, 2012 Changes to System: Students are assessed at Intake Determination is made: All learners who have a GED, a secondary credential, or are enrolled in a class specifically designed for transitioning to postsecondary education (e. g. , bridge program, college readiness), as the cohort for which “Entry into Postsecondary Education” must be tracked. Students included in the cohort are those who passed the GED tests or earned a secondary credential while enrolled in adult education, enter with these credentials, or are enrolled in a class specifically designed for transitioning to postsecondary education.

Additional Change Entry into Postsecondary Education or Training can occur any time from the time of exit until the end of the following program year.

2 Minor Changes Students’ Highest Educational Level or Degree Attained & Teacher Experience and Certification.

Contact Information: Rosemary Matt NYS Director of Accountability Email: Rosemary. Matt@cayuga-cc. edu