Contextualizing the Evaluand Contextual Influences and Constraints on

  • Slides: 11
Download presentation
Contextualizing the Evaluand: Contextual Influences and Constraints on Communicating Findings Kristi Pettibone, Ph. D

Contextualizing the Evaluand: Contextual Influences and Constraints on Communicating Findings Kristi Pettibone, Ph. D The Maya. Tech Corporation, With CDC’s National Center for Injury Prevention and Control American Evaluation Association November 13, 2009 The findings of this presentation are the responsibility of the authors and do not necessarily represent the official views of the Centers for Disease Control and Prevention

Review of Key Stakeholders • • CDC leadership NCIPC program staff ICRC program evaluation

Review of Key Stakeholders • • CDC leadership NCIPC program staff ICRC program evaluation workgroup ICRC directors External peer review panel Evaluation contractors Board of Scientific Counselors

Purpose of Evaluation & Report • Intended for internal use only, though some parts

Purpose of Evaluation & Report • Intended for internal use only, though some parts may be shared • Identify research gaps and areas for program improvement • Required by CDC policy to conduct program and portfolio reviews for research and scientific programs every 5 years

Potential Uses of Findings • • Demonstrate accountability Program improvement Future FOA requirements Documentation

Potential Uses of Findings • • Demonstrate accountability Program improvement Future FOA requirements Documentation of program history

Potential Uses of Findings (continued) • Talking points with Congress and state legislatures •

Potential Uses of Findings (continued) • Talking points with Congress and state legislatures • Success stories • Sharing through general publications and/or Extramural Research Program Office website

Implications for Sharing Findings with Stakeholders • Only few stakeholders will receive the full

Implications for Sharing Findings with Stakeholders • Only few stakeholders will receive the full report • Some stakeholders might receive only key findings • When possible, findings reported in format that prevents comparisons between centers

Contextual Influences/Constraints ICRC Directors • Wanted to promote their programs • Concerned about comparisons

Contextual Influences/Constraints ICRC Directors • Wanted to promote their programs • Concerned about comparisons among centers • Half of the centers reapplied for funding under the 2009 Funding Opportunity Announcement • Asked for additional funding for program

Contextual Influences/Constraints ICRC Portfolio Evaluation Workgroup • Comprised of – ICRC Directors – CDC

Contextual Influences/Constraints ICRC Portfolio Evaluation Workgroup • Comprised of – ICRC Directors – CDC Evaluators – NCIPC Leadership and Researchers • Designed to ensure that members had – Experience with other programs/centers – History with ICRCs – Representation from ICRCs

Contextual Influences/Constraints NCIPC • Showcased benefits of program • Identified areas for program improvement

Contextual Influences/Constraints NCIPC • Showcased benefits of program • Identified areas for program improvement Evaluation contractor • Guided by previous portfolio reviews • Financial constraints

Managing Competing Contexts • Discuss dissemination of findings early • Crosswalk data collection and

Managing Competing Contexts • Discuss dissemination of findings early • Crosswalk data collection and analysis activities with dissemination plans • Ensure budget supports dissemination activities • Clarify and manage expectations with all stakeholders in advance • Revisit these expectations throughout evaluation to address possible changes

Contact Information Kristi Pettibone The Maya. Tech Corporation kpettibone@mayatech. com

Contact Information Kristi Pettibone The Maya. Tech Corporation kpettibone@mayatech. com