Criminal Justice Basic Abilities Test CJBAT Update Law

Criminal Justice Basic Abilities Test (CJBAT) Update -Law Enforcement Officer -Corrections Officer Industrial/Organizational Solutions, Inc. August 6, 2008 Florida Criminal Justice Standards and Training Commission Chad Legel &Confidential Mark Tawney

Agenda n n About I/O Solutions Update on CJBAT Testing in 07 -08 u u Test objective (changes from pre-Oct. 07) Test performance update « u u u n Pass rates, scores, reliability Test validation studies Likelihood of passing SOCE based on CJBAT score New test forms Wrap-up

About I/O Solutions n n National public safety test publisher and consulting firm based in Chicago Staff of ten consultants trained in Industrial/Organizational Psychology Provider of Florida CJBAT Program to approximately 30 FL law enforcement and correctional academies since 2001 Maintain a research and development function devoted to validating the CJBAT (on-going) and continually improving the computer-based test administration system

CJBAT Test Objectives n n Assess core basic abilities as defined by FDLE Provide an easily administered testing program More rigorously screen abilities to ensure requisite ability levels Establish compelling test validity evidence n n CJBAT assesses the 8 mandated abilities using 120 questions covering 8 ability areas CJBAT is available in paper and computerbased formats (with strong focus on customer service) Careful research was done to establish an appropriate cut-off score that screens out unqualified candidates Research demonstrates a strong relationship between CJBAT and

CJBAT Performance CJBAT Test/Form Sample Size Mean Pass Rate Reliability (Alpha) LEO 1 4515 79. 35 62 0. 93 LEO 2 2220 77. 15 51 0. 92 LEO 3 960 77. 05 52 0. 92 CO 1 3499 76. 06 66 0. 95 CO 2 1404 73. 08 58 0. 93 CO 3 1061 74. 89 52 0. 93

Major difference in sample composition: LEO = 19% female, CO = 50% fem

CJBAT Validation n 2 criterion-related validation studies demonstrating the relationship between the CJBAT and important criteria u CJBAT correlated with academy performance (final academy score) « u Data collected from Broward Sheriff, FHP, George Stone, Gulf Coast, Lake Tech, Manatee Tech and Pinellas Sheriff CJBAT correlated with state certification scores (SOCE) Data collected from all. Validity academies General «Guidelines for Interpreting Coefficients (US Dept. of Labor) Validity Value above. 35 Interpretation very beneficial . 21 -. 35 likely to be useful . 11 -. 20 depends on circumstances below. 11 unlikely to be useful using CJBAT

SOCE Success Based on CJBAT Score

New CJBAT Forms n n n CJBAT LEO & CO second practice exam released LEO 4 and CO 4 available October 2008 Field-tested on incumbent LEO and CO academy participants u LEO N= 111 « u Broward County CC, Santa Fe CC, Withlachoochee CO N= 36 « Chipola, Manatee County Sheriff, Washington Holmes

CJBAT Wrap-Up n n CJBAT is screening candidates effectively (identifying a sizable subset of the sample that does not possess necessary abilities) Academy and SOCE validation studies demonstrate that test is HIGHLY predictive of success in the academy and on SOCE We are quite confident in the CJBAT’s defensibility based on its high validity levels I/O Solutions is interested in continuing to learn from our clients how the CJBAT is functioning locally

Questions?