Postsecondary Accountability 2017 CTE Fall Webinar Series September
Postsecondary Accountability 2017 CTE Fall Webinar Series September 7, 2017 http: //www. minnstate. edu/system/cte/professionaldevelopment/index. html
Today’s Presenters Minnesota State Katie Vaccari Senior Research Associate Jeralyn Jargo System Director of Career Technical Education Debra Hsu Associate Director of Career Technical Education Slide 2
Chat, Comment, React Your Phone Line Is Muted • Use Chat to send questions/comments • Look for links, info in Chat box • Send notifications to Presenters Slide 3
Agenda We will review: • Perkins postsecondary data structure and reporting status/accountability indicator definitions. • Target negotiation process. • Data sources for determining your accountability indicator performance. • How to access Perkins data in EPM 11. Slide 4
Postsecondary Data Structure Minnesota is one of a few states to use a cohort model. The use of cohorts aligns with other system initiatives and reporting. The FY 2015 -2017 cohort includes students entering in FY 2015 and tracked for three years: 2015, 2016 and 2017. Slide 5
Postsecondary Definitions Completer A student who received a CTE award (AAS, Certificate or Diploma) in a Perkins eligible program. Concentrator A student with a Perkins eligible major who declared a CTE award (AAS, Cert, Dip) and earned 12+ college level credits OR who received an award in a short term Perkins eligible program (less than 12 credits). Participant A student taking a CTE course OR who has a Perkins eligible major. Slide 6
Reporting Status —Completer —Concentrator —Participant § Status used for reporting is typically the highest recorded Perkins status during the cohort period. § If a Concentrator changes to non-Perkins major, that student will be counted as a Participant, not Concentrator. Slide 7
1 P 1 Technical Skill Attainment e m u Number of CTE concentrators who passed technical skill assessments r o t a r Number of CTE concentrators who m o n De o t a in took technical skill assessments The reporting timeframe for 1 P 1 is different from the other core indicators. 1 P 1 includes a mixture of licensure exam data from the most recent calendar year available (at the time we assemble data for reporting) and data from NOCTI (or other third party assessments) from testers during the most recently completed fiscal (reporting) year. Slide 8
2 P 1 Credential, Certificate or Degree r to a r e m Nu Number of CTE concentrators in a given entry cohort who, anytime in the cohort time frame, received a CTE certificate, diploma, AAS or AS r Number of CTE concentrators in o t ina m o n e D the cohort December 2017 CAR will be based on the FY 2015 -2017 cohort. Slide 9
3 P 1 Student Retention or Transfer Number of CTE concentrators in a given entry cohort who, at the end of the last r o t a year of the cohort time frame, were still er m Nu intending to complete their program or had transferred to a 2 -year or 4 -year institution r Number to a n i m o n De of CTE concentrators in the cohort December 2017 CAR will be based on the FY 2015 -2017 cohort. Retention and transfer data are frozen as of 8/31. Slide 10
4 P 1 Student Placement Number of CTE completers in a given entry cohort who were placed or retained r to in employment in the 2 nd quarter following a r me u N the program year in which they left postsecondary education i r o t na m o n De Number of CTE completers December 2017 CAR will be based on the FY 2014 -2016 cohort. There is a one year lag from other indicators. Slide 11
5 P 1 Nontraditional Participation In a given entry cohort, the number of CTE participants during the cohort r o rat e tracking period who were enrolled in a m u N CTE program classified as nontraditional for their gender In a given entry cohort, the number of r CTE participants during the cohort o t a n i tracking period who were enrolled in a m o n De CTE program classified as nontraditional December 2017 CAR will be based on the FY 2015 -2017 cohort. Slide 12
5 P 2 Nontraditional Completion me u N In a given entry cohort, the number of CTE completers in a CTE program classified as nontraditional for their gender r o t ra r ato in m no e D In a given entry cohort, the number of CTE completers in CTE programs classified as nontraditional Example: # of Male Nursing Graduates + # of Female Welding Graduates # Total Nursing Graduates + # Total Welding Graduates December 2017 CAR will be based on the FY 2015 -2017 cohort. Slide 13
Postsecondary Accountability Indicators: Data Sources Indicator 1 P 1 – Technical Skill Attainment Data Source Licensure data for Radiography, Law Enforcement, Nursing; added EMT/Paramedic licensure data beginning in 2016 (aggregate data only) Other TSA data also included from NOCTI; ASE (Automotive) and NBCOT (occupational therapy) beginning in 2016 2 P 1 – Completion ISRS (Integrated Statewide Record System) enrollment and completion data on CTE students 3 P 1 – Retention and Transfer National Student Clearinghouse data on transfers to 5 P 1 – Nontraditional Participation other colleges or universities 5 P 2 – Nontraditional Completion 4 P 1 – Placement Slide 14 Minnesota Dept. of Employment & Economic Development (DEED) and Graduate Follow-up data on employment following program completion
Program Inventory Tool http: //www. asa. mnscu. edu/academicprograms/inventory/index. html Use the Program Inventory tool to produce a PDF of your institution’s current academic programs. Slide 15
Program Inventory Slide 16
State and Local Negotiations Federal/State Negotiations State/Local Consortia Negotiations Evaluation of State Performance Improvement Plans Evaluation of Local Performance Improvement Plans Slide 17
State Negotiated Postsecondary Targets Slide 18
State/Local Negotiation Process for FY 2018 Targets Target Time Frame Accountability Webinars: Postsecondary Development of State Proposed Targets Distribute Proposed Targets to Consortia Responses Due Initial State Response Local Negotiations Completed Evaluation of 2018 Performance Slide 19 September 7, 2017 November/December 2017/January 2018 January/February 2018 January 2019
Negotiating Your Targets ü Review the proposed targets ü Examine your Consortia & District level data § Look at trends/preliminary data if available ü Discuss the targets with your partners/constituents § Have there been any changes in policy or practice that may have affected performance outcomes in the coming year? ü Understand the context and rationale for the state proposed targets § Expectation of continuous improvement at the state and local level § Need for the state to be able to meet state targets negotiated with OCTAE Slide 20
Negotiating Your Targets Determine if you will accept the proposed targets, or, propose an alternative target Slide 21 If you DO accept the state proposals: q Return the FY 2018 Negotiated Performance form q Include BOTH secondary AND postsecondary signatures If you DO NOT accept the state proposals: q Notify the state q Submit alternative target(s) along with the rationale for the proposed alternative(s)
Negotiating Your Targets If submitting a counter proposal, the proposal must include: Ø The state proposal and your alternative proposed target Ø Trends in past performance Ø Rationale supporting the counter proposal, including any additional relevant data The rationale must document the context of what is driving observed trends and factors that may impact future performance. o o New or closed programs TSA’s added, removed, or changed Shifts in enrollment and the impact on programs Changes in policies or practices that may impact program performance or enrollment Keep in mind that in reviewing counter proposals the state must consider the ability of the state to meet their negotiated target (i. e. , the ability of the other consortia to make up the difference). Slide 22
Evaluation of Annual Local Performance No action At or above target Negotiated Level Report Required Between 90% and 99% Improvement Plan Below 90% of target Slide 23 90% of Negotiated Level
Postsecondary Accountability Indicators: How/Where Do I Get My Data? The System Office distributes four reports to Consortia Coordinators early in the calendar year (for the most recent reporting year): • • Annual Core Indicator Report Three-Year Trend Performance Report 1 P 1 (Technical Skill Attainment) Report 4 P 1 (Student Placement) Report More detailed data for indicators 2 P 1, 3 P 1, 5 P 1 & 5 P 2 are available in EPM 11, from aggregate data all the way down to individual person level. Slide 24
Annual Core Indicator Report Slide 25
Three-Year Trend Performance Report Slide 26
Technical Skill Assessment Data (1 P 1) Slide 27
Student Placement Data (4 P 1) Slide 28
EPM 11 Login Data for Core Accountability Indicators 2 P 1, 3 P 1, 5 P 1 and 5 P 2 are available in EPM 11. http: //www. its. mnscu. edu/reportanddataservices/ datawarehouse/index. html Slide 29
Student Carl Perkins/ Perkins IV Cohort Data Folder Slide 30
Process Data for Your Institution Slide 31
Select Your Institution RC_ID Slide 32
CAR Report Info (Summary Page) Slide 33
Results Slide 34
Indicator Reports (Summary) Slide 35
Pivot Tables by Indicator Slide 36
EPM 11 – Accessing the Data “Accessing Perkins IV Postsecondary Data Using EPM 11” document (scroll down to “Fall Webinar Series” section – Postsecondary Accountability): http: //www. minnstate. edu/system/cte/ professionaldevelopment/monthlywebinars. html Document also located in the main “Student Carl Perkins” folder in EPM 11. Slide 37
EPM 11/ITS/Other Links EPM 11 Login Page http: //www. its. mnscu. edu/reportanddataservices/datawarehouse/index. html Operational Data Security Request Form (add access for the Carl Perkins Data module) http: //www. mnscu. edu/system/its/securityforms/mnscuinfosystems/pdf/Operatio nal. Data. Security. Form. pdf EPM 11 Training (General) http: //www. its. mnscu. edu/reportanddataservices/training/index. html ITS Service Desk https: //servicedesk. mnscu. edu/Cherwell. Portal/MNSO#0 Reporting and Data Services Share. Point Site (Must log in with Star ID) https: //mnscu. sharepoint. com/sites/its/Site. Pages/Page. aspx? topic. ID=29&topic. Name=Re porting%20 and%20 Data%20 Services Program Inventory (official) (Click “Program Inventory” link, which will open EPM 11) http: //asa. mnscu. edu/academicprograms/inventory/index. html Slide 38
CTE Professional Development Resources www. minnstate. edu/system/cte/ professionaldevelopment/monthly-webinars. html § Past Webinar Recordings and Power. Points § Calendar of Monthly Webinars (Thursdays, 9 am & 10: 30 am) § Sept 14, 10: 30 am: Preparing for your Annual Performance Review (APR) § Sept 21: Postsecondary Fiscal Management Slide 39
Perkins Accountability ~ Postsecondary Katie Vaccari, (651) 201 -1718 Katie. Vaccari@minnstate. edu Jeralyn Jargo, (651) 201 -1650 Jeralyn. Jargo@minnstate. edu Debra Hsu, (651) 201 -1686 Debra. Hsu@minnstate. edu Enter your questions in the “Chat” field OR request to unmute your phone line and ask your questions. Slide 40
- Slides: 40