Nevada CTE CTECS Programs Standards Assessments Credentials Nevada

Nevada CTE & CTECS: Programs, Standards, Assessments & Credentials Nevada Department of Education Office of Career, Technical and Adult Education January, 2014

Overview Introduction – History of NV CTE and CTECS partnership Website Course Catalog Program Components CTE Assessments – Workplace Readiness Skills Assessments – End-of-Program Technical Assessments • Certificate of Skill Attainment • 2013 Assessment Results • • • Nevada Department of Education Office of Career, Technical and Adult Education January, 2014

Website Nevada Department of Education CTE Website cteae. nv. gov Nevada Department of Education Office of Career, Technical and Adult Education January, 2014

Website Nevada Department of Education Office of Career, Technical and Adult Education January, 2014

Website Nevada Department of Education Office of Career, Technical and Adult Education January, 2014

CTE Course Catalog Prior to the creation of the catalog CTE courses in Nevada were very scattered, and it was difficult to tell our story and gather data. • The creation of the NV CTE Course Catalog was our first step • The catalog is organized by program area and career cluster • It provides Course Sequencing and Course Descriptions Nevada Department of Education Office of Career, Technical and Adult Education January, 2014

Nevada’s CTE Programs Overall CTE Programs and Course Counts: 2014 -15 CTE Course Catalog Program Area Number of Programs Number of Courses Agriculture and Natural Resources 13 36 Business and Marketing Education 6 43 Education, Hospitality, and Human Services 8 44 Health Science and Public Safety 14 64 Information and Media Technologies 16 99 Skilled and Technical Sciences 22 108 79 394 Totals Nevada Department of Education Office of Career, Technical and Adult Education January, 2014

Nevada’s CTE Program Each program will have: • • Program Technical Skill Standards Employability Skills for Career Readiness Standards Program of Study Curriculum Framework Workplace Readiness Skills Assessment End-of-Program Technical Assessment Certificate of Skill Attainment Nevada Department of Education Office of Career, Technical and Adult Education January, 2014

Program Completion Requirements 1. Students must complete the sequence of courses as determined by the CTE Course Catalog 2. Where available, students must take an end-ofprogram technical assessment upon completion of the course sequence 3. Students must be taught the Employability Skills for Career Readiness (21 standards*) and demonstrate proficiency in the employability skill standards *Virginia's Workplace Readiness Standards adopted through the CTECS Consortium. Nevada Department of Education Office of Career, Technical and Adult Education January, 2014

State CTE Skill Standards • Identifies content standards, performance standards, and measureable performance indicators • Cross-walked to the Common Core State Standards to identify the performance indicators that support academic learning. (ELA, mathematics and science) • Cross-walked to the Common Career Technical Core • Identifies the body of knowledge to be assessed • Drives curriculum development, course sequences, and curriculum frameworks • Must be State School Board Approved Nevada Department of Education Office of Career, Technical and Adult Education January, 2014

Skill Standards Nevada Department of Education Office of Career, Technical and Adult Education January, 2014

Employability Skills Standards Employability Skills for Career Readiness – Adopted the 21 standards from Virginia – Virginia conducted a large research project to determine the “soft skills” need to be successful in the workplace – We took them to many groups in Nevada and they were well received. (companies, associations, economic and workforce development groups…) – Included in the instruction of all Nevada CTE Programs – All CTE students in a completion level course will be given the Workplace Readiness Skills Assessment Nevada Department of Education Office of Career, Technical and Adult Education January, 2014

Standards Development Protocols Business and Industry Validation Process: 8 Member Writing Team 12 Member Writing Team 3– Business/Industry 5 – Business/Industry 3 – Secondary 5 – Secondary 2 – Postsecondary OR Industry review panel established and implemented; OR Standards are written to nationally recognized industry standards. Nevada Department of Education Office of Career, Technical and Adult Education January, 2014

Nevada Department January, 2014 of Education Office of Career, Technical and Adult Education January, 2014

Curriculum Framework Document that indicates which performance standard should be taught at each course level in a program sequence. Nevada Department of Education Office of Career, Technical and Adult Education January, 2014

CTE Assessments • Measurement of skill attainment directly aligned to state standards – completion level courses only • Levels = L 2 C, L 3 C, and L 4 C (found in the Nevada CTE Course Catalog) • Validates quality of programs based on state standards • Allows for the collection of accurate student skill attainment data Nevada Department of Education Office of Career, Technical and Adult Education January, 2014

CTE Assessments • Test Creation Process (CTECS System) – Revise or create standards • Standards writing team – NV Teachers & Industry Representatives – Criticality surveys – Industry Representatives only – Create assessment • Assessment writing team – NV Teachers & CTECS – – Pilot assessment Item analyses (Review pilot results and issues) Live testing Cut score development (Modified-Angoff Method) • Available results: student level, site level, district level, and state level – Biggest asset is that data can be filtered in various ways Nevada Department of Education Office of Career, Technical and Adult Education January, 2014

Test Development • Test Creation Process – Revise or create standards • Standards writing team – NV CTE Teachers (Nomination from District Representative) – Business and Industry Representatives – Department of Education Representative – Criticality survey of standards (over 400 individuals participated in 2012 -2013) • Business & Industry rates each performance indicator as Nice to Know, Need to Know, and Needed for Survival Nevada Department of Education Office of Career, Technical and Adult Education January, 2014

Test Development – Test Creation • Assessment writing team – NV CTE Teachers – CTECS Representatives – Department of Education Representative • CTECS provides possible test questions to start with – Team can adopt, adapt, or create new questions – Team will align questions with each performance indicator – Emphasis will be placed on the Needed for Survival performance indicator from the criticality surveys Nevada Department of Education Office of Career, Technical and Adult Education January, 2014

Test Development – Pilot the assessment • Schools are asked to participate in the pilot tests • Assessments are online, 100 multiple-choice questions, and are timed for 60 minutes – Item analysis • • Assessment writing team Review pilot results Review each question and responses for validity Correct any issues for spring administration Nevada Department of Education Office of Career, Technical and Adult Education January, 2014

Test Development – Spring Tests (accommodations are available if required – IEP/504/ELL) • ALL Completers must participate (NAC 389. 800) • Each site will have a Test Coordinator (administrator) • Test Administrators (proctors) of testing CAN NOT be related program instructors • CTE Assessments are included in the NV Testing Administration Manual (HSPE regulations / test protocol / test security) Teachers need to attend their school’s annual test security training (HSPE). Nevada Department of Education Office of Career, Technical and Adult Education January, 2014

Test Development – Cut Score Setting • Score determined by the “Modified-Angoff Method” – It is not a norm-referenced method, when a candidate’s pass or fail status is determined by his or her performance in relation to other candidates. Using the Angoff procedure, once the passing point is determined, a candidate’s pass/fail performance is established independently of the group who sat for the exam. Candidates are judged by comparing their performance to an absolute standard, not to other candidates. Theoretically, all candidates can pass or all can fail. Nevada Department of Education Office of Career, Technical and Adult Education January, 2014

End of Program Technical Assessments • Year 1, 2012: 7 program assessments – 7 new assessments implemented (642 students) • Year 2, 2013: 32 program assessments – 25 new assessments implemented (2, 557 students) • Year 3, 2014: 55 program assessments – 23 new assessments implemented (5, 000+ students) Nevada Department of Education Office of Career, Technical and Adult Education January, 2014

CTE Assessments 2012 -13 55% of Program Completers Assessed 2013 -14 80 -85% of Program Completers to be Assessed (Projected) * Estimated program completers for 2013 -14: 5, 200 – 5, 800 * Program completers identified by completion level courses only in the 2013 -14 CTE Course Catalog (Course Levels L 2 C, L 3 C or L 4 C) Nevada Department of Education Office of Career, Technical and Adult Education January, 2014

CTE Assessments Strategies for success: • Included in the Nevada Proficiency Examination Program Procedures Manual • Added the testing requirements to the NAC • Created a Test Administrator Manual • Created a Coordinator Manual • Provided on-site training for E-SESS usage. • Have one contact person for assessments (with a backup) Unresolved Issue: • Retake Policy – (suggestions and ideas) Nevada Department of Education Office of Career, Technical and Adult Education January, 2014

Certificate of Skill Attainment • To earn this certificate, the student must: – Complete the CTE course sequence (as per the CTE Catalog) with a 3. 0 GPA or higher – Pass the workplace readiness skills assessment – Pass the end-of-program technical assessment • 2012 -13 Results – 2, 924 students eligible / approximately 700 issued • Future Alignment: – Articulation credits will be aligned with a student earning the certificate of skill attainment Nevada Department of Education Office of Career, Technical and Adult Education January, 2014

Certificates Nevada Department of Education Office of Career, Technical and Adult Education January, 2014

2013 Results Data Workplace Readiness Skills Assessment State of Nevada CTE Registered - 5296 Participated - 4790 Passed – 3493 Participation Rate – 90. 4% Passing Rate – 72. 9% Nevada Department of Education Office of Career, Technical and Adult Education January, 2014

2013 Results Data End-of-Program Technical Assessments State of Nevada CTE Registered - 2924 Participated - 2557 Passed – 1035 Participation Rate – 87. 4% Passing Rate – 40. 5% Nevada Department of Education Office of Career, Technical and Adult Education January, 2014

Questions / Comments Nevada Department of Education Office of Career, Technical and Adult Education Alex Kyser Skilled and Technical Sciences Education Programs Professional (775) 687 -7290 akyser@doe. nv. gov Nevada Department of Education Office of Career, Technical and Adult Education Sue Poland Agricultural & Nat. Resources Education Programs Professional (775) 687 -7281 spoland@doe. nv. gov January, 2014