Biennial Service Review Training Putting it All Together

Biennial Service Review Training Putting it All Together

BIENNIAL SERVICE REVIEW QUALITY IMPROVEMENT THROUGH FOCUSED ANALYSIS AND PLANNING

Pulling together six HFA required analyses/reviews • • • Analysis of access to the population Analysis of Assessment & Program Acceptance Analysis of Participant Retention Analysis of Home Visit Completion Cultural Review Analysis of Staff Retention and Satisfaction ~~~

Where to Start? • Review the 2014 -2015 BSR • Analyze improvement plans for each category ü Did you do what you planned? ü If so, what was the impact? ü If not, why not? ü Did you do anything you hadn’t planned? ü If so, what was the impact?

Analysis of Access to the Population • Description of Target Population Basic demographics of the target population such as race, ethnicity, age, language, general description of the area üEasidemographics. com üEdr. state. fl. us üFloridacharts. com üZipwho. com üFactfinder. census. gov

Analysis of Access to the Population Continued • Description of Target Population ü Basic demographics of the target population such as race, ethnicity, age, language, general description of the area ü How target population was determined • Agreements in place to access population ü ü ü Memoranda of agreement (MOAs) Process for accessing target population Community outreach activities • Percent of births screened (use Birth Rata Analysis)

Analysis of Access to the Population Continued • To improve the screening rate, explore: ü Are you getting all the screens from Healthy Start? ü Does Healthy Start have a low screening rate, too? ü Are there other service providers/places that might provide access to the population? ü Has there been an increase or decrease in Record Referral Screens? If so, why? ü Has there been an increase or decrease in Prenatal Risk Screens? If so, why? • Develop a plan to expand methods of access. ~~~

Analysis of Assessment Acceptance • Include formal and informal data and identify sources ü Formal data=hard data or numerically recorded data ü Informal data=soft data or anecdotal data, gathered by discussion with staff, families, stakeholders, Advisory Committee members • Include a description that explains the data ü What happened to families that screened positive, but were never assessed.

Analysis of Assessment Acceptance • Use the Screening Analysis Report ü One year of data minimally required, two years optional • Determine factors impacting positive screens not resulting in assessment ü By FAW (Unable to locate, Refusals) ü Exploration of high “unable to locate”(how long between screen to offer, outreach techniques, etc. ) ü Root causes of “unable to process-limited resources” ü Analysis of “other” • Develop a plan to increase percentage of positive screens resulting in an assessment

HEALTHY FAMILIES SOMEWHERE Screening Analysis Report (07/01/2016 – 06/30/2017) HFF Record Prenatal Risk Infant Risk Screen/Refe TOTAL Screens rral Forms Total screens 386 655 0 1041 Total # of negative screens 163 172 0 335 (A) Total # of positive screens 223 483 0 706 (B) # of positive screens not assessed due to MOOSA 0 17 (C) # of positive screens not assessed due to vanished/unable to locate 0 125 (D) # of positive screens not assessed due to TC adopted out/died prior to assessment 0 19 E) Positive screens not assessed due to unable to process - limited resources 0 0 (0%) (F) # of positive screens not assessed for other reasons 98 160 0 258 # of positive screens offered assessment [A-(B+C+D+E)] 125 162 0 287 1 37 0 38 124 125 # of positive screens that refused assessment Total # that should be assessed (Offered - Refused) 249 Assessment Acceptance Rate (# that should have been assessed / # offered assessment): 87% Total # assessed during period (07/2008 - 06/2009): 250 Other reasons positive screens were not assessed: (HFF Record Screen/Referral Forms). (Prenatal Risk Screens), 4 no translator, assessment, current participant, no translator, incarcerated, past participant, pst 3 mos, current participant,

Analysis of Program Acceptance • Include formal and informal data and identify sources ü Formal data=hard data or numerically recorded data ü Informal data=soft data or anecdotal data, gathered by discussion with staff, families, stakeholders, Advisory Committee members • Include a description that explains the data ü What happened to families that assessed positive, but never enrolled.

HEALTHY FAMILIES SOMEWHERE Aggregate Report for Assessment Result (Assessed From 07/01/2016 Through 06/30/2017) Assessment Result # % MOOSA 15 6% Consented To Participate 102 41% Refused Program @Assessment 10 4% Refused Program During Creative Outreach 17 7% Active CPS Case 6 2% Scored Out 13 5% Target Child Adopted 1 0% Target Child Miscarried/ITOP/Died 4 2% Referred To More Appropriate Service 0 0% Other 0 0% Family Vanished/Unable To Locate 51 20% Not Enrolled/At Situational Capacity 30 12% Not Enrolled/At Actual Capacity 0 0% Refused CPS Background Check 0 0% None Selected 1 1% Program Acceptance Rate 79% Total: 250

Analysis of Program Acceptance continued • Report the program acceptance rate for the reporting period. This is the percent of families accepting services out of all those offered services. • One year of data minimally required. • Consider including a performance trend line for at least three years.

HEALTHY FAMILIES SOMEWHERE Aggregate Report for Assessment Result (Assessed From 07/01/2016 Through 06/30/2017) Assessment Result # % MOOSA 15 6% Consented To Participate 102 41% Refused Program @Assessment 10 4% Refused Program During Creative Outreach 17 7% Active CPS Case 6 2% Scored Out 13 5% Target Child Adopted 1 0% Target Child Miscarried/ITOP/Died 4 2% Referred To More Appropriate Service 0 0% Other 0 0% Family Vanished/Unable To Locate 51 20% Not Enrolled/At Situational Capacity 30 12% Not Enrolled/At Actual Capacity 0 0% Refused CPS Background Check 0 0% None Selected 1 1% Program Acceptance Rate 79% Total: 250

The program acceptance rate is determined by dividing the number that consented to participate by the total number offered an assessment (consented to participate + refused @ assessment + refused @ outreach) Consented To Participate 102 Refused Program @Assessment 10 Refused Program During Creative Outreach 17 . Consented to Participate (102) 129 . Consented to Participate (102) + Refused@assessment (10) + Refused@Outreach (17) 102/129 = 79% Program Acceptance Rate

Analysis of Program Acceptance continued • Analysis of those that refused services • Must include a comparison to those that accepted services • HFA requires the analysis include the following factors: ü Demographic ü Programmatic ü Social

Analysis of Program Acceptance continued • Demographic factors (use the Assessment Demographic Report) ügender: üage: ürace & ethnicity; ümarital status; üeducation; ülanguage; üemployment; and ücity, zip code, community, etc.

Analysis of Program Acceptance continued • Programmatic Factors üreferral sources* üstaffing issues (patterns & trends among assessment staff or assigned FSW; use the Assessment Demographic Report) ütimeframe between screen and assessment* ütimeframe between assessment and initial contact* ünumber and/or type of attempted contacts* * These data would require local tracking mechanisms.

Analysis of Program Acceptance continued • Assessment Demographic Report – Result: Consented To Participate – Result: Refused Program @Assessment – Result: Refused Program During Creative Outreach (Assessed between 7/1/2016 and 6/30/2017)

Assessment of Program Acceptance continued • Social Factors ü assessment score (use Participant Assessment by Results Report) ü working or in school* ü economic factors* ü teen parent(s) living with parents* ü cognitively delayed parents* ü the big three – substance abuse, mental health or domestic violence* * This would require informal data since this data is not collected for those who do not enroll and is not easily accessed for those enrolled.

Participant Assessments by Result(Result: All Results) (Assessed During 7/1/2016 Thru 6/30/2017) Run by: • Result: Consented To Participate • Result: Refused Program @Assessment • Result: Refused Program During Creative Outreach

Analysis of Program Acceptance continued • Analysis of those that refused the program – HFA requires that the analysis be based on the following factors üDemographic üProgrammatic üSocial – Findings (including comparison to those that accepted services) – Plan (based on findings) to increase program acceptance ~~~

Analysis of Retention Rates • Definition of Retention Rate The percent of families enrolled in a given fiscal year that remain in the program for a specified period of time after the initial home visit. • Retention Rate 12 Months 6 Months 24 Months OR 12 Months 36 Months 24 Months • Minimally use 1 -year cohort • Consider using 3 1 -year cohorts for trend analysis

HEALTHY FAMILIES SOMEWHERE Participant 12 Month Retention Rate Closure Reason Table for Those Participants Not Retained Closure Reason Enrolled 13 -14 Enrolled 14 -15 Parent Incarcerated 0. 0% Target Child Miscarried/ITOP/Died 2. 6% 0. 0% Moved Out Of Service Area 46. 2% 29. 7% Lost Contact 10. 3% 5. 4% Other 0. 0% 8. 1% Completed HFF Program 0. 0% Referred Out 0. 0% Parent School/Work Fulltime 7. 7% 27. 0% TC Adopted Out/Custody Change 5. 1% 0. 0% Child Removed By CPS 0. 0% 2. 7% Referred To a Non-HFF HF Program 0. 0% 2. 7% Transferred To Another HFF Site 0. 0% Primary Participant Died 0. 0% Not Interested 23. 1% 21. 6% Aged Out 0. 0% Refusing New FSW 5. 1% 2. 7% Non-target Child Died 0. 0% State Budget Cuts 0. 0% Local Budget Cuts 0. 0% Total 100% 12 Month Retention Rate 57% 54% Enrolled 15 -16 1. 8% 32. 7% 3. 6% 1. 8% 0. 0% 18. 2% 1. 8% 3. 6% 0. 0% 23. 6% 0. 0% 10. 9% 0. 0% 100% 54%

HEALTHY FAMILIES SOMEWHERE Participant 24 Month Retention Rate Closure Reason Table for Those Participants Not Retained Closure Reason Enrolled 12 -13 Enrolled 13 -14 Parent Incarcerated 0. 0% Target Child Miscarried/ITOP/Died 6. 7% 3. 4% Moved Out Of Service Area 33. 3% 22. 0% Lost Contact 28. 9% 25. 4% Other 4. 4% 11. 9% Completed HFF Program 0. 0% 1. 7% Referred Out 0. 0% Parent School/Work Fulltime 2. 2% 5. 1% TC Adopted Out/Custody Change 0. 0% Child Removed By CPS 0. 0% Referred To a Non-HFF HF Program 0. 0% Transferred To Another HFF Site 0. 0% Primary Participant Died 0. 0% Not Interested 20. 0% 27. 1% Aged Out 0. 0% Refusing New FSW 4. 4% 3. 4% Non-target Child Died 0. 0% State Budget Cuts 0. 0% Local Budget Cuts 0. 0% Total 100% 24 Month Retention Rate 50% 39% Enrolled 14 -15 0. 0% 7. 2% 9. 6% 31. 3% 9. 6% 1. 2% 0. 0% 6. 0% 2. 4% 0. 0% 27. 7% 1. 2% 3. 6% 0. 0% 100% 40%

HEALTHY FAMILIES SOMEWHERE Participant 36 Month Retention Rate Closure Reason Table for Those Participants Not Retained Closure Reason Enrolled 11 -12 Enrolled 12 -13 Parent Incarcerated 0. 0% Target Child Miscarried/ITOP/Died 6. 7% 3. 4% Moved Out Of Service Area 33. 3% 22. 0% Lost Contact 28. 9% 25. 4% Other 4. 4% 11. 9% Completed HFF Program 0. 0% 1. 7% Referred Out 0. 0% Parent School/Work Fulltime 2. 2% 5. 1% TC Adopted Out/Custody Change 0. 0% Child Removed By CPS 0. 0% Referred To a Non-HFF HF Program 0. 0% Transferred To Another HFF Site 0. 0% Primary Participant Died 0. 0% Not Interested 20. 0% 27. 1% Aged Out 0. 0% Refusing New FSW 4. 4% 3. 4% Non-target Child Died 0. 0% State Budget Cuts 0. 0% Local Budget Cuts 0. 0% Total 100% 36 Month Retention Rate 50% 39% Enrolled 13 -14 0. 0% 7. 2% 9. 6% 31. 3% 9. 6% 1. 2% 0. 0% 6. 0% 2. 4% 0. 0% 27. 7% 1. 2% 3. 6% 0. 0% 100% 40%

Analysis of Retention • Analysis is based on those families leaving the program in the reporting period – HFA requires that the analysis be based on the following factors üDemographic üProgrammatic üSocial

Analysis of Retention HEALTHY FAMILIES SOMEWHERE Aggregate Report for Closure Reasons (Closed During 07/01/2016 Thru 06/30/2017)

Analysis of Retention continued • Demographic factors (use the Participant Demographic Report-Closed Cases Only, All) ügender üage ürace & ethnicity ümarital status üeducation ülanguage üemployment ücity/zip code, etc.

Analysis of Retention continued • Programmatic Factors ü closure reasons ü assessment scores* ü timeframe from assessment to first home visit* ü Prenatal versus postnatal enrollment* ü staffing issues (by FSW, by team) ü current service level at time of closure (from QPR) ü length of time in program (from QPR) * This would require informal data or checking individual records since it is not aggregately reported for those enrolled.

Analysis of Retention continued • Social Factors ü assessment score ü working or in school* ü economic factors* ü teen parent(s) living with parents* ü cognitively delayed parents* ü the big three – substance abuse, mental health or domestic violence* *This would require informal data since this data is not collected or easily accessed for those enrolled.

Analysis of Retention continued • Analysis of those that left the program – HFA requires that the analysis be based on the following factors: üDemographic üProgrammatic üSocial – Findings (must include comparison to those that remained in the program) – Plan (based on findings) to increase family retention ~~~

Home Visit Completion • Describe monitoring system • Review home visit completion rates üBy project üBy team üBy FSW • Include any findings from HFF QA monitoring • Develop plan to increase home visit completion based on findings of monitoring (not required if all FSWs achieve 90 percent or higher) ~~~

Cultural Review • Description of Service Population (those served in reporting period) • Include: ü Ethnic/racial characteristics ü Other demographic characteristics ü Language ü Other cultural characteristics Compare to target population to determine any gaps Compare to staff/home visitors Discuss ability to serve the major cultures within the population including agreements with partners if needed

Cultural Review continued • Discuss cultural competence of the program regarding the Materials used by the FAWs and FSWs. You must include input from both families and staff in the discussion of materials. Examples and survey results are great here. Item #5 and #6 of the Participant Satisfaction Survey provides family input. Caution: Include how you got input from families and staff, but – don’t stop there! Include the actual input (survey results, what you learned from the focus group or staff meeting discussion, what you observed in shadowing, what you heard during QA calls, etc. )

Cultural Review continued Training on the Unique Characteristics of the Population • Often confused with training on cultural sensitivity • Describe what training was provided, when and who attended. • Compare the needs identified in the last BSR and whether you completed your plan to meet those needs. • Identify new training needs identified through the BSR process and plan to meet those needs.

Cultural Review continued Some tips on identifying the unique characteristics of the population: • Comparison of demographic reports • Comparison of Aggregate Report for Assessment Concerns • Areas that staff may have had difficulty in • Areas staff have requested training in Include how you determined the need in your BSR.

Cultural Competence in Service Delivery • Describe systems that ensure cultural competence in each service delivery area üAssessment üHome Visiting üSupervision üManagement • Describe accommodations and adaptations to meet cultural needs in each of the service delivery areas • Discuss barriers and plans to address them

Cultural Review continued • Provide input from families on how they regard cultural competence of the program regarding: üMaterials (may already have in materials section) üCommunications/linguistics üStaff and family interventions

Cultural Competence continued Items from Participant Satisfaction Survey that provide input on these items: • Materials – “The materials my home visitor gives me are easy to understand” (#5), “The materials my home visitor gives me respect my culture” (#6) • Communications – “My home visitor talks with me in a language I understand or has an interpreter to help” (#12) • Staff/Family Interactions – “My home visitor treats me with courtesy and respect, ” (#1) “My home visitor understands and respects my culture” (#13)

Cultural Review continued • Provide input from staff on how they view cultural competence of the program regarding: üMaterials (if not already included in materials section) üCommunications/linguistics üStaff and family interventions • Tell how you obtained the input from staff. Also, include the input. Discuss any barriers to communication or challenges with interventions that might need to be addressed.

Cultural Competence continued • Feedback from the advisory committee on last BSR (2014 -2015) üBest practice is to review the whole BSR and get feedback üHFA Standards require feedback from the committee on the Cultural Review Describe any actions taken on the feedback from the committee • Describe plan to present the current BSR to the committee ~~~

Staff Retention Analysis • Discuss how long current staff have been employed • Provide information on: üAny positions that became vacant in the reporting period üReasons for leaving for each person that left üDemographics of staff that left compared to those that remained üInput from staff who are currently employed regarding satisfaction • Discuss any challenges to staff retention • Review the plan from the previous BSR • Discuss any changes made or planned to increase staff retention.

Staff Retention Analysis • Staff (by position title) who left during the timeframe (12 months for new sites, 24 months for all others) ü their hire date ü termination date ü reason why they left ü any other pertinent characteristics • Summary of staff satisfaction • Strategies developed based on what was learned from data • Strategies which have been implemented

Biennial Service Review • Involve others – make it a team effort • Cite your references • Be a detective – find out what’s working; why or why not • Include formal and informal data • Include a plan that is reasonably linked to the findings

Process after submission • BSRs are due November 15 th for the reporting period of the previous fiscal year. • Once submitted, HFF staff will review the BSR and provide feedback, including requested revisions if the BSR does not cover everything required by the HFA Standards • Along with the feedback, projects will be given a deadline to submit revisions.

Any Questions If you have any questions at any time regarding what is required, what you are finding in your analyses, suggested activities to address your findings, or the process, etc…please feel free to contact your program specialist or me at