ASSESSMENT AND EVALUATION METHODS OF EVALUATION What types

  • Slides: 19
Download presentation
ASSESSMENT AND EVALUATION

ASSESSMENT AND EVALUATION

METHODS OF EVALUATION

METHODS OF EVALUATION

What types of data will be collected? All four types (process, outcome, impact, and

What types of data will be collected? All four types (process, outcome, impact, and program) require data about: � people � educational program or activity � environment in which the activity takes place

What types of data will be collected? CATEGORIES OF TYPES OF DATA: � about

What types of data will be collected? CATEGORIES OF TYPES OF DATA: � about people �physical �cognitive �affective �psychomotor � about the program �cost �length �number of educators required

What types of data will be collected? CATEGORIES OF TYPES OF DATA: �materials required

What types of data will be collected? CATEGORIES OF TYPES OF DATA: �materials required �teaching-learning methods used � about the environment �temperature �lighting �location �layout �space �noise level

What types of data will be collected? CATEGORIES OF TYPES OF DATA: � quantitative

What types of data will be collected? CATEGORIES OF TYPES OF DATA: � quantitative – numeric and are expressed in statistics � qualitative – includes feelings, behaviors, words and phrases

From whom or what will data be collected? Data can be collected directly from

From whom or what will data be collected? Data can be collected directly from the people whose behavior/knowledge is being evaluated, from surrogates or representatives of these individuals, or from documentation or databases already created.

From whom or what will data be collected? Process evaluation data should be collected

From whom or what will data be collected? Process evaluation data should be collected from all who participated in the activity—including the educators. Content and outcome evaluations should include data from all learners.

How will data be collected? Methods for how data can be collected include the

How will data be collected? Methods for how data can be collected include the following: � Observation � Interview � Questionnaire or written examination � Record review � Secondary analysis of existing databases

When will data be collected? The timing depends on the type of evaluation and

When will data be collected? The timing depends on the type of evaluation and evaluation design structures.

When will data be collected? Process Evaluation during and immediately after an educational activity

When will data be collected? Process Evaluation during and immediately after an educational activity Outcome Evaluation some time after completion of education Impact Evaluation weeks to years after education program Program Evaluation prolonged period of time

Where will data be collected? Be careful not to make the decision about where

Where will data be collected? Be careful not to make the decision about where to collect data on the basis of convenience for the data collector. For content evaluation, a good setting may be in a classroom or a skills laboratory where learners have just completed training.

Where will data be collected? For outcome evaluation—specifically performance—would depend on the person to

Where will data be collected? For outcome evaluation—specifically performance—would depend on the person to be evaluated. If a nurse’s ability to perform a procedure in the ward is to be evaluated, this is best done in the ward. If it would be the performance of the patient doing self-care, this is best done at home.

Who will collect the data? It is commonly done by the educator who is

Who will collect the data? It is commonly done by the educator who is conducting the activity being evaluated. An observer could also be invited to evaluate the learners to have less biased results.

Who will collect the data? Data can also be collected by the learners themselves*,

Who will collect the data? Data can also be collected by the learners themselves*, by other colleagues within the institution, or someone outside the institution. * An example of which is a participant evaluation team—composed of a small number of randomly selected people scheduled to attend an educational program.

INTERACTION PROCESS ANALYSIS

INTERACTION PROCESS ANALYSIS

What is Interaction Process Analysis? This was developed by Robert Bales. In this system,

What is Interaction Process Analysis? This was developed by Robert Bales. In this system, you analyze the contributions of members in four general categories: � social-emotional positive contributions � social-emotional negative contributions � attempted answers � questions There are three subcategories under each general category.

shows solidarity SOCIAL-EMOTIONAL POSITIVE CONTRIBUTIONS shows tension release shows agreement SOCIAL-EMOTIONAL NEGATIVE CONTRIBUTIONS shows

shows solidarity SOCIAL-EMOTIONAL POSITIVE CONTRIBUTIONS shows tension release shows agreement SOCIAL-EMOTIONAL NEGATIVE CONTRIBUTIONS shows disagreement shows tension shows antagonism

gives suggestions ATTEMPTED ANSWERS gives options gives information asks for suggestions QUESTIONS asks for

gives suggestions ATTEMPTED ANSWERS gives options gives information asks for suggestions QUESTIONS asks for opinions asks for information