DHCS Data Quality Improvement Projec DHCS CSI and

DHCS Data Quality Improvement Projec DHCS CSI and DCR Data Quality Improvement Project CSI Webinar DHCS Regular CSI Feedback Reports Mental Health Data Alliance, LLC (MHData) April 12 th, 2018

DHCS Data Quality Improvement Project Goals 1. Support the ability to submit good data to the current state CSI and DCR mental health data systems 2. Close the feedback loop for counties to validate that they have good data in the CSI and DCR state mental health data systems 3. Improve the value of state CSI and DCR mental health data systems for counties, the state and stakeholders

DHCS Data Quality Improvement Projec Approach Over 1. 5 years: 1. Provided counties with 2 reports which provide an overview of current data and errors for CSI and DCR 2. Met with counties to review reports and identify potential causes of data patterns and inconsistencies 3. Work with counties and DHCS to improve processes to submit data to DCR and CSI 4. Provide counties with 2 reports which provide an overview of improved data for CSI and DCR

DHCS Data Quality Improvement Projec Regular CSI Feedback Reports �DHCS to produce feedback reports with CSI Data �Currently we are proposing two types of reports: 1. Statewide Summary Report (CSI-SSR) with All Counties Available to All Ø Produced Quarterly 2. County Specific Report (CSI-CSR) Available to Only the County Administrator Ø Produced Annually or Quarterly THIS PRESENTATION CONTIANS FAKE DATA – REPORTS PRESENTED ARE FOR DEMONSTRATION PURPOSES ONLY

DHCS Data Quality Improvement Projec Existing CSI County Submission Status from DHCS

DHCS Data Quality Improvement Projec Survey Results Comments: • “More reports the better” • “Actually would be super useful to have this report [County Report] also quarterly as a drill down to QSS” • “I would expect [Statewide Summary Report] to provide at a State level, the clients and services received at the counties. It should provide a comparative between the different counties as well” • “A trend analysis by county compared to statewide trends. ” • Make [County Report] quarterly instead of annual to pair up with QSS nicely • “A Graphical year-over-year data trend analysis [for County Report]. ” • “I like the color-coding” • “Keep the stacked tables - our clinical readers prefer pictures” • “Better age breakdown for youth such as reporting specifically for 0 -5. Breakdown mode 5 by intensity for PHF versus IMD, etc. ” • “Perhaps regional results that would help small counties with valid results when numbers are too few in one county alone. ” • “We would like a dataset so we can perform our own analysis. Thanks”

DHCS Data Quality Improvement Projec Quarterly Statewide Summary Report (CSI-SSR) 1. Total Clients Served - Counts of total clients served at any point in that quarter (includes only clients who received services). 2. Clients a) New Clients: Counts of total new client records submitted that quarter. b) Received 24 Hour Services: Counts of clients who received Mode 05 24 hour services. c) Received Day/Hourly Services: Counts of clients who received Mode 10 day or hourly services, but does not include clients who received Crisis Stabilization. d) Received Community MH Services: Counts of clients who received Mode 15 services, but does not include clients who received Crisis Intervention. e) Received Crisis Services: Counts of clients who received Mode 10 Crisis Stabilization or Mode 05 Crisis Intervention services.

DHCS Data Quality Improvement Projec Quarterly Statewide Summary Report (CSI-SSR) 3. 4. Services a. Days of 24 Hour Services (Mode 05): Total sum of days of Mode 05 24 hour services provided to all clients. b. Minutes of Community MH Services: Total sum of minutes of Mode 15 services, but does not include minutes of Crisis Intervention. c. Hours of Crisis Services: Total sum of hours of Mode 10 Crisis Stabilization and hours (minutes/60) of Mode 05 Crisis Intervention services. Intensity for Clients Receiving Services a. Days of 24 Hour Services per Client: This represents the average number of days of 24 hour service which were provided to those who received that type of service. It is calculated as the total sum of days of Mode 05 24 hour services provided to all clients divided by the number of clients who received Mode 05 24 hour services, or as metric 3 a/2 b. Minutes of Community MH Services per Client: This represents the average number of minutes of Mode 15 Community MH services which were provided to those who received that type of service. It is calculated as the total sum of minutes of Mode 15 Community MHs services (excluding crisis services) provided to all clients divided by the number of clients who received Mode 15 Community MH services other than crisis services, or as metric 3 b/2 d. c. Hours of Crisis Services per Client: This represents the average number of hours of crisis services which were provided to those who received that type of service. It is calculated as the total sum Mode 10 Crisis Stabilization hours and Mode 15 Crisis Intervention minutes converted to hours which were provided to all clients divided by the number of clients who received crisis services, or as metric 3 c/2 e.

DHCS Data Quality Improvement Projec Quarterly Statewide Summary Report (CSI-SSR) 5. Fatal Errors a) Client Records: Proportion of client records submitted which received a fatal error. b) Service Records: Proportion of service records submitted which received a fatal errors. 6. Periodic Records a) Records Submitted: Total periodic records submitted. b) % Client with Periodic this Quarter: Proportion of clients served this quarter who had a periodic record submitted during the quarter.

MOCK CSI-SSR Report DHCS Data Quality Improvement Projec Added comparison to statewide *Excluding crisis services SN = Small Number THIS IS FAKE DATA – REPORTS PRESENTED ARE FOR DEMONSTRATION PURPOSES ONLY

DHCS Data Quality Improvement Projec County Specific Report (CSI-CSR) 1. Annual Counts of Clients Served Last 5 Years a. All Clients Served By Age Group vs. Statewide b. By Provider By Age Group c. By Service Type by Age Group vs. Statewide 2. Monthly Counts of Clients Served Last 5 years a. All Clients Served vs. Statewide b. By Service Type vs. Statewide c. By Age Group vs. Statewide 3. Monthly Intensity of Services Last Year a. By Age Group and Service Type Group (24 Hour, Community MH not crisis, Crisis) at County vs. Statewide

DHCS Data Quality Improvement Projec County Specific Report (CSI-CSR) 4. Monthly Errors Last Year a. Client Records: Fatal and Non-Fatal by Reason b. Service Records By Service Type: Fatal and Non-Fatal by Reason 5. Monthly Periodic Records Last 5 Years a. Counts b. Percent of Clients Served with Records

DHCS Data Quality Improvement Projec Will add comparison to statewide THIS IS FAKE DATA – REPORTS PRESENTED ARE FOR DEMONSTRATION PURPOSES ONLY

DHCS Data Quality Improvement Projec 2. Monthly Counts of Clients Served Last 5 years a. All Clients Served b. By Service Type c. By Age Group Will add comparison to statewide THIS IS FAKE DATA – REPORTS PRESENTED ARE FOR DEMONSTRATION PURPOSES ONLY

DHCS Data Quality Improvement Projec Will add comparison to statewide 20 15 10 5 0 Jul Aug Sep Oct Nov Dec Jan Feb Mar Apr May Jun THIS IS FAKE DATA – REPORTS PRESENTED ARE FOR DEMONSTRATION PURPOSES ONLY

DHCS Data Quality Improvement Projec 4. Monthly Unresolved Error Counts Last Year Jan Feb Mar Apr May a. Client Records: Fatal and Non. Fatal by Reason b. Service Records By Service Type: Fatal and Non-Fatal by Reason THIS IS FAKE DATA – REPORTS PRESENTED ARE FOR DEMONSTRATION PURPOSES ONLY

DHCS Data Quality Improvement Projec THIS IS FAKE DATA – REPORTS PRESENTED ARE FOR DEMONSTRATION PURPOSES ONLY

DHCS Data Quality Improvement Projec Report Availability Proposal �The plan to make reports available might include: o The CSI Statewide Summary Report (CSI-SSR) report would be generated each quarter by DHCS staff and posted for public viewing and download on DHCS website o The CSI County Specific Report (CSI-CSR) Reports would be generated each year by DHCS staff and pushed out to counties, either into a BHIS folder for counties to download or via another secure transfer method

DHCS Data Quality Improvement Projec Discussion �Other ideas? �Comments? �Issues? Email Support �DHCS: mhsdata@dhcs. ca. gov �MHDATA: support@mhdata. org

DHCS Data Quality Improvement Projec DHCS CSI and DCR Data Quality Improvement Project Mental Health Data Alliance, LLC (MHData)