The Common Assessment is Nearly Here Is Your

  • Slides: 32
Download presentation
The Common Assessment is Nearly Here: Is Your College Ready? Craig Rutan, CAI Steering

The Common Assessment is Nearly Here: Is Your College Ready? Craig Rutan, CAI Steering Committee Co-Chair Jennifer Coleman, CAI Statewide Program Director 2016 Spring Plenary Session

CAI Overarching Goal • Develop a comprehensive, common assessment system that: • aligns to

CAI Overarching Goal • Develop a comprehensive, common assessment system that: • aligns to state legislation • reduces unnecessary remediation • provides statewide efficiencies • effectively supports faculty and staff to ensure accurate student placement, resulting in more successful student outcomes Spring Plenary Session April 21 – 23, 2016 2

Key Objectives • A test that covers curricular areas of • Math • English

Key Objectives • A test that covers curricular areas of • Math • English as a second language (ESL) • Adaptive at the Testlet level • Multiple (Supplemental) Measures • Assessment Preparation • Accessibility as a primary consideration Spring Plenary Session April 21 – 23, 2016 3

Assessment, Not Placement • Placement is locally determined • Raw data is portable •

Assessment, Not Placement • Placement is locally determined • Raw data is portable • No traditional cut scores. Each student will have a skills assessment report that must be used to place students based upon local mapping of competencies to existing curriculum. • Validation steps • Statewide • Local Spring Plenary Session April 21 – 23, 2016 4

Current CAI Work Groups • • Math (includes above college-ready) English (includes Reading) ESL

Current CAI Work Groups • • Math (includes above college-ready) English (includes Reading) ESL (includes Noncredit) Multiple Measures Professional Development Test Development Process Platform (User Interface, Reporting) Spring Plenary Session April 21 – 23, 2016 5

Writing Sample • Resolution 18. 01 F 14 included the following: • Resolved, That

Writing Sample • Resolution 18. 01 F 14 included the following: • Resolved, That the Academic Senate for California Community Colleges recommend that the Common Assessment Initiative include writing samples as a required component of the common assessment and that the writing samples are scored by human readers whose participation will inform assessment procedures that promote the growth of students across the composition sequence; and • Resolved, That the Academic Senate for California Community Colleges urge the Common Assessment Initiative steering committee to ensure that English and ESL instructors with knowledge and experience as to how integrated assessment programs inform curriculum and pedagogy participate in the design and evaluation of writing samples to ensure that the assessment test is grounded in the latest research on language learning and assessment practices. Spring Plenary Session April 21 – 23, 2016 6

Writing Sample (2) • The writing sample will be a part of the CAI

Writing Sample (2) • The writing sample will be a part of the CAI and will serve both English and ESL students • The sample can be human scored, but the CAI system will also include a machine scoring algorithm. • RFP for this machine scoring system will be out soon • The AI must be able to “learn” from writing samples that have been hand scored • Colleges will not be required to use the machine score • Selection of machine scoring system will come soon. • Should human scoring results move with the student? Spring Plenary Session April 21 – 23, 2016 7

Multiple Measures • Overlap with Multiple Measures Assessment Project (MMAP) • Currently convening •

Multiple Measures • Overlap with Multiple Measures Assessment Project (MMAP) • Currently convening • Pilot college overlap • Non-cognitive measures • Self-Reported GPA • Statewide validated model • Integration with CCCAssess • What should be offered? • Use of multiple measures for placement is required. No single placement tool (assessment test or single multiple measure) is sufficient. • A “multiple measure” isn’t multiple if you choose to not use the assessment test and then use a single alternative placement tool! • Any measure used for placement must be validated. Spring Plenary Session April 21 – 23, 2016 8

Multiple Measures (2) • Please review Resolution 18. 02 S 16 – Placement Model

Multiple Measures (2) • Please review Resolution 18. 02 S 16 – Placement Model for Transfer Statistics Using High School Transcript Data: • Resolved, That the Academic Senate for California Community Colleges authorize the distribution of the “MMWG Mathematics Decision Rules Recommendation and Discussion Summary” to Multiple Measures Assessment Project and Common Assessment Initiative pilot colleges; • Resolved, That the Academic Senate for California Community Colleges urge local senates to work with their administrations to ensure that the proposed statistics placement model is analyzed using data for their students to ensure that the model works as predicated prior to using it to place students; • Resolved, That the Academic Senate for California Community Colleges urge local senates to review the proposed statistics placement model and make any necessary modifications to ensure that there is no negative impact on existing articulation agreements between their college and four year universities; and • Resolved, That the Academic Senate for California Community Colleges collect data on the effectiveness of the statistics placement models and report the results by Fall 2017. Spring Plenary Session April 21 – 23, 2016 9

CAI Pilot Colleges Bakersfield College Chaffey College Delta College Fresno City College Butte College

CAI Pilot Colleges Bakersfield College Chaffey College Delta College Fresno City College Butte College De. Anza College Diablo Valley College Rio Hondo College Sacramento City College Santa Monica College Saddleback College West Los Angeles College Spring Plenary Session April 21 – 23, 2016 10

Pilot Phase • Piloting began in March of 2016 of test items and the

Pilot Phase • Piloting began in March of 2016 of test items and the platform. • Two components • Test • Data collection and Validation • Technology/Platform • Student information system interface • Professional Development • Iterative process • Not a static solution Spring Plenary Session April 21 – 23, 2016 11

Project Timeline • Spring 2016 • Field testing and test validation data gathering •

Project Timeline • Spring 2016 • Field testing and test validation data gathering • Summer 2016 • Approval by CCCCO ASWG • Fall 2016 • Release and Implementation begins • Ongoing • Professional Development • Feedback and continuous improvement • Success! Spring Plenary Session April 21 – 23, 2016 12

Now What? • We know what is coming. • What does that entail locally?

Now What? • We know what is coming. • What does that entail locally? • How do we get started? Spring Plenary Session April 21 – 23, 2016 13

Spring Plenary Session April 21 – 23, 2016 14

Spring Plenary Session April 21 – 23, 2016 14

Timeline Fall 2015 Item Development March-May 2016 Item and Field Testing Adoption Schedule Released

Timeline Fall 2015 Item Development March-May 2016 Item and Field Testing Adoption Schedule Released June-July 2016 Now - October 2016 Fall 2016 Test Validation and Approval Preparation for Adoption: Professional Development and Implementation Guidance Schools begin using CCCAssess for Spring 2017 Placement Spring Plenary Session April 21 – 23, 2016 15

Local Implementation • The implementation of the Common Assessment at your campus will require

Local Implementation • The implementation of the Common Assessment at your campus will require the collaboration with • All Faculty • Administrators • IT Staff • Admissions and Records • Assessment Center Staff • Research Spring Plenary Session April 21 – 23, 2016 16

Spring Plenary Session April 21 – 23, 2016 17

Spring Plenary Session April 21 – 23, 2016 17

1 st Meeting • • Watch movie Pass out CCCAsesss Implementation guide Set Deadlines

1 st Meeting • • Watch movie Pass out CCCAsesss Implementation guide Set Deadlines Plan to attend upcoming Professional Development Assign Analyze Current Resources (Step 2) Assign apply for funding Set regular team meetings Spring Plenary Session April 21 – 23, 2016 18

Spring Plenary Session April 21 – 23, 2016 19

Spring Plenary Session April 21 – 23, 2016 19

Spring Plenary Session April 21 – 23, 2016 20

Spring Plenary Session April 21 – 23, 2016 20

Spring Plenary Session April 21 – 23, 2016 21

Spring Plenary Session April 21 – 23, 2016 21

Faculty Role in Implementation • Discipline Faculty need to look at the competency maps

Faculty Role in Implementation • Discipline Faculty need to look at the competency maps and determine how they align to existing curriculum • The conversations should involve discipline faculty outside of math, English, and ESL because placement decisions affect the entire campus • Counselors must be involved in discussion to have accurate information for students • Your Academic Senate should take the lead in coordinating the implementation efforts! Spring Plenary Session April 21 – 23, 2016 22

Spring Plenary Session April 21 – 23, 2016 23

Spring Plenary Session April 21 – 23, 2016 23

Spring Plenary Session April 21 – 23, 2016 24

Spring Plenary Session April 21 – 23, 2016 24

Spring Plenary Session April 21 – 23, 2016 25

Spring Plenary Session April 21 – 23, 2016 25

Spring Plenary Session April 21 – 23, 2016 26

Spring Plenary Session April 21 – 23, 2016 26

Spring Plenary Session April 21 – 23, 2016 27

Spring Plenary Session April 21 – 23, 2016 27

Spring Plenary Session April 21 – 23, 2016 28

Spring Plenary Session April 21 – 23, 2016 28

Spring Plenary Session April 21 – 23, 2016 29

Spring Plenary Session April 21 – 23, 2016 29

Recency & Retesting • How long should the results of the assessment be good

Recency & Retesting • How long should the results of the assessment be good for? How long before a student should be allowed to retake the assessment test? • Questions like these are a decision to be reached between local academic senates and governing boards, but the answers vary widely across California. • Resolution 18. 01 S 16 includes the following: • Resolved, That the Academic Senate for California Community Colleges work with the Chancellor’s Office to develop guidelines for the development of assessment policies that maintain local control over retesting policies and procedures while maximizing access for students and distribute the guidelines to local senates and curriculum committees prior to the availability of the Common Assessment to all colleges; and • Resolved, That the Academic Senate for California Community Colleges urge local senates to delay revision of current policies regarding retesting for placement until after the distribution of assessment retesting guidelines. Spring Plenary Session April 21 – 23, 2016 30

More Information • Visit CCCAssess. org • Sign-up for listserv • Assess Press via

More Information • Visit CCCAssess. org • Sign-up for listserv • Assess Press via Constant Contact • Biweekly newsletters • Redesign coming – stakeholder buttons • Jennifer Coleman, Statewide Program Director • 530 -879 -4165, [email protected] org • Craig Rutan, CAI Steering Committee Co-Chair • 714 -628 -4954, [email protected] edu Spring Plenary Session April 21 – 23, 2016 31

“ QUESTIONS? Spring Plenary Session April 21 – 23, 2016 32

“ QUESTIONS? Spring Plenary Session April 21 – 23, 2016 32