Evaluation Plan March 7 2012 Evaluation General approach

Evaluation • General approach to evaluation is broad with the ability to support specificity.

Evaluation As of now, there isn't an emphasis on direct correlational measures of specific

Evaluation • Specifically – we’re going to release a survey for the Attending Nurses

Evaluation • Qualitatively, we’re going to: • Hold focus groups • Conduct observation studies

Evaluation • Quantitatively, we’re going to administer surveys: • Revised Professional Practice Environment •

Evaluation • Administrative data that you/ we collect as part of MGH operations such

Conceptual Schema Innovation Cluster Focus Areas * Patient Engagement Roles & Structures Throughout Admission

Evaluation • What do YOU think is important to evaluate in this work? •

Slides: 11

Download presentation

Evaluation Plan March 7, 2012

Evaluation • General approach to evaluation is broad with the ability to support specificity. • Collecting and evaluating multiple innovations using several methods: dashboard measures (fiscal, quality, patient and staff satisfaction, etc. ), administrative data, surveys, focus groups, observations and narratives.

Evaluation As of now, there isn't an emphasis on direct correlational measures of specific innovations. • This means…we don’t expect to be able to say (for example) that the new Welcome Packet helped improve satisfaction. What we will be able to say is that we implemented X, Y, Z innovations on this unit and there is a relationship between the innovation unit and patient satisfaction, or length of stay. • Please note, that if you have a specific idea or research interest, we can help design a research plan for those unit or individual specific interests.

Evaluation • Specifically – we’re going to release a survey for the Attending Nurses probably mid next week, and the survey will get repeated a few times over the next couple years. ARNs: A link will be in your email.

Evaluation • Qualitatively, we’re going to: • Hold focus groups • Conduct observation studies • Evaluate narratives

Evaluation • Quantitatively, we’re going to administer surveys: • Revised Professional Practice Environment • Patient Safety Culture • Patient’s Feeling Known by Their Nurses

Evaluation • Administrative data that you/ we collect as part of MGH operations such as: Indicators: Falls, Infections, Pressure Ulcers, etc. HCAHPS (Patient Satisfaction) Length of Stay (LOS) Cost per Case Mix Staff Retention Other: Unit specific innovations/ interventions

Conceptual Schema Innovation Cluster Focus Areas * Patient Engagement Roles & Structures Throughout Admission 1. Relationship-Based Care 2. Attending Nurse 3. Handover Rounding Checklist Pre-Admission 4. Pre-Admit Data Collection 5. Patient IU Welcome Packet During Admission 6. Domains of Practice 7. Interdisciplinary 8. Team Rounds 9. Electronic White Boards 10. Volte Communication 11. Tough books Post-Discharge 12. Discharge Follow-up Phone Calls Others as identified * The clusters are a lens with which we gain perspective on any particular intervention. ** May apply to any or all 3 of the cluster focus areas Quantitative • Culture of Safety Survey • HCAHPS • LOS Education Communication Evaluation (Pre, During, Post) Interventions ** • Quality Indicators • Patients Perceptions of Feeling Known (PPFKN) Qualitative • Focus Groups (Staff, Patients, Families, etc) • Observations • Narratives • Readmissions • Revised Perceptions of Practice Environment Scale (RPPE) • Cost per Case Mix • Staff Retention Other measures as identified January 2012

Evaluation

Evaluation • What do YOU think is important to evaluate in this work? • Thoughts, Comments, Concerns? ? ? • Feel free to email me jadams 9@partners. org