Supporting practice through evaluation Deborah Rutman Carol Hubberstey

Supporting practice through evaluation Deborah Rutman, Carol Hubberstey, & Marilyn Van Bibber

Nota Bene Consulting Group Evaluation Team For Canadian FASD Mentors Project Deborah Rutman, Ph. D (Psychology) drutman@uvic. ca • • • Research & evaluation related to FASD prevention; FASD-informed approaches; supporting youth, women and adults living with FASD Experience working with Indigenous and community-based programs/organizations Founding Member, Canada FASD Research Network Action Team on FASD Prevention Carol Hubberstey, MA (Counselling) • • carolmarie@shaw. ca Program evaluator since 1995 Background in clinical supervision, working with families experiencing abuse Experience working with Indigenous and non-Indigenous programs/projects Mental health, substance use and FASD are factors in many evaluations Marilyn Van Bibber, Aboriginal nurse mvanbibber@shaw. ca • • • Extensive experience in Indigenous health development, research, program planning, program evaluation, and treaty negotiations in BC and the Yukon Founding member, Aboriginal Nurses Association of Canada Founding Board Member, Canada FASD Research Network

Some relevant evaluation projects: Toward an Evaluation Framework for Communitybased FASD Prevention Programs (2011 -2014) Project team: Nancy Poole, Deborah Rutman, Carol Hubberstey, Marilyn Van Bibber & Sharon Hume www. fasd-evaluation. ca

Evaluation of FASD-informed Practice Training (2014 -2015; 2015 -2016)

Why evaluate? ADJUST / ADAPT REFLECT / LEARN We believe that evaluation: Ø Is dynamic PLAN Ø Offers shared opportunities for learning Ø Supports strategic learning ASSESS IMPLEMENT Ø Provides useful information for how/where adjustments are needed

Role of Evaluation in FASD Mentoring Project ■ To learn whether and how the project is achieving its goals ■ To find out whether and how improvements can be made ■ To learn about the strengths and challenges ■ To find out what difference the initiative is making for FASD Mentors, Community Champions and community partners

National FASD Mentors Visual Evaluation Framework

Evaluatio n Process & Activities Ø Post-Gathering Questionnaire (Mentors, Project Team, Elders) Ø Semi-annual Feedback Forms (Mentors) Ø Post-Training Evaluation Questionnaire (AHSUNC Workshop Participants) Ø Telephone interviews (Mentors, Community Champions, Project Team, Elders) Ø Outputs Ø Review of program documents

Time Line – What to Expect March 2018 Post Gathering Questionnair e for Mentors, project team & Elder(s) 2018, 2019, & 2020 Semi. Annual Mentor Feedback Forms Dec 2018 & 2019 Mentor phone interviews Jan 2019 & 2020 Questionnair e/ interviews: project team, Elders, CC 2018 2020 Annual CC Questionnair e 20182020 AHSUNC workshop Questionnai re

How are FASD Mentors involved? Ø Complete Mentor Gathering Questionnaires Ø Complete the semi-annual Feedback Form Ø Collect output data Mentors are important partners Ø Hand out and gather Post-workshop Evaluation Questionnaire with AHSUNC participants Ø Take part in telephone two interviews (in 2019 and 2020)

Post training questionnaire for AHSUNC workshop participants Overall, at the FASD workshop: The presenter(s) were knowledgeable, engaging and encouraged reflection and discussion The presentations and learning activities re: culturally relevant approaches were useful The presentations and learning activities re: FASD & FASD-informed practice were useful The presentations, and learning activities about trauma-informed practice were useful I felt safe and respected sharing my knowledge, experiences and perspective The handouts and resources I received will be useful to me There was adequate time for networking and information-sharing between participants My needs were met in terms of increasing knowledge and skills re: culturally-relevant approaches and FASD My needs were met in terms of increasing knowledge and skills re: FASD-informed practice My needs were met in terms of increasing knowledge & skills re: trauma-informed practice Strongly Agree Neither agree nor disagree Disagree Strongly Disagree Don’t know 5 4 3 2 1 9 5 4 3 2 1 9 5 4 3 2 1 9

Post training questionnaire for AHSUNC workshop participants cont’d How did the FASD Workshop feed your HEAD, HEART & FEET? HEAD: The most valuable thing I learned was HEART: What I liked most about the FASD Workshop was… FEET: Something I will now do or do differently

Contact Information Deb Rutman drutman@uvic. ca Carol Hubberstey carolmarie@shaw. ca Questions? ? Comments Marilyn Van Bibber mvanbibber@shaw. ca