Translating outcomes into concrete and ask able questions

Translating outcomes into concrete and ask able questions: Examples Outcome: participants will be able to: Indicator of success/criteria for performance Data collection approach Sample question(s) Display enthusiasm about learning more about evaluation • 90% will ask questions beyond class time • Observation • 20% will use the tools in a work setting • Follow up interview 6 weeks after session is completed Tally sheet w/counts of #s of time people ask questions after or before session Could be open or closed ended question: In the last 5 days, how often have you used the following; Xxx, Yyy, Zzz or How have you used the information from the program evaluation session? List the major steps in program planning Questionnaire where people order steps and write their rationale for the ordering

Your program: translating outcomes into concrete and ask able questions Outcome participants will be able to Indicator of success/Criteria for performance Data collection Sample question(s ) Examples: Criteria for Performance for performance • With XX accuracy Desired outcome: Increased diversity of those involved in decision making • Getting 10/12 correct Criteria for performance: • Within X time frame (1). At least three different kinds of organizations will attend the meeting (e. g. , local environmental, social justice, etc. ) • With no mistakes (2). At least 20 postal codes will be at the meeting • With all who ask, etc. Data Collection approach: (1). Document (registration form): asak people what rganization they belong to, their zip/postal code (2). Observation: examine make-up of participants, record number sleeping, talking to neighbor, etc. every 15 minutes, etc.

Checklist Posing Questions Quality Criteria Yes NO Comments 1. A variety of audiences are taken into consideration when specifying questions 2. Questions selected are those with the highest priority 3. Each question chosen gathers useful information 4. Each question ask only one question (i. e. (extent of X, Y and Z is not appropriate) 5. It is clear how the question relates to the program’s logic model 6. The questions are specific about what information is needed 7. Questions capture “lesions learned” about your work along the way. 8. Questions capture “lesions learned about your program theory along the way. Evaluation Logic Model Guide, W. K. Kellogg Foundation, page 60.