Internal Scenarios External Construct Validity Misc 1 pt

  • Slides: 51
Download presentation
Internal Scenarios External Construct Validity Misc 1 pt 1 pt 2 pt 2 pt

Internal Scenarios External Construct Validity Misc 1 pt 1 pt 2 pt 2 pt 3 pt 3 pt 4 pt 4 pt 5 pt 5 pt

Internal Validity 1 point Define Internal Validity

Internal Validity 1 point Define Internal Validity

Internal Validity 1 point What is the observed change in the dependent variable due

Internal Validity 1 point What is the observed change in the dependent variable due to a manipulation in the independent variable?

Internal Validity 2 points Naturally occurring changes over time could be confused with a

Internal Validity 2 points Naturally occurring changes over time could be confused with a treatment effect

Internal Validity 2 points What is Maturation?

Internal Validity 2 points What is Maturation?

Internal Validity 3 points In a randomized control trial, 70% of my participants in

Internal Validity 3 points In a randomized control trial, 70% of my participants in my treatment condition dropped out, and only 10% of my participants in my control condition dropped out

Internal Validity 3 points What is attrition?

Internal Validity 3 points What is attrition?

Internal Validity 4 points In quasi-experimental designs when there is no direct manipulation of

Internal Validity 4 points In quasi-experimental designs when there is no direct manipulation of a variable, such as in correlational analyses, and it is not clear which variable may influence another you have this threat.

Internal Validity 4 points What is ambiguous temporal precedence?

Internal Validity 4 points What is ambiguous temporal precedence?

Internal Validity 5 points Define threat “instrumentation. ”

Internal Validity 5 points Define threat “instrumentation. ”

Internal Validity 5 points What is the nature of a measure may change over

Internal Validity 5 points What is the nature of a measure may change over time or conditions in a way that could be confused with a treatment effect?

Scenarios 1 point The participants in my study consisted of 18 – 22 year

Scenarios 1 point The participants in my study consisted of 18 – 22 year old white college males.

Scenarios 1 point What is threat to external validity?

Scenarios 1 point What is threat to external validity?

Scenarios 2 points When I initially ran my study, I only had 20 participants

Scenarios 2 points When I initially ran my study, I only had 20 participants in the experimental group and 20 participants in the control group. Because I had so few participants I wasn’t sure if the lack of a significant finding was due to the treatment effect or too few participants, which created this type of threat

Scenarios 2 points What is threat to statistical conclusion validity or low statistical power?

Scenarios 2 points What is threat to statistical conclusion validity or low statistical power?

Scenarios 3 points In my study, I had to use the same research assistants

Scenarios 3 points In my study, I had to use the same research assistants to both administer the manipulation and take measurements so I had to tell them which participants were in the experimental group and which were in the control group

Scenarios 3 points What is threat to construct validity or experimenter expectancies?

Scenarios 3 points What is threat to construct validity or experimenter expectancies?

Scenarios 4 points I wanted to get a pre and post measure of intelligence

Scenarios 4 points I wanted to get a pre and post measure of intelligence in my experiment to see if students’ IQs increased due to my intervention so I administered the same test before and after the intervention

Scenarios 4 points What is threat to internal validity or testing?

Scenarios 4 points What is threat to internal validity or testing?

Scenarios 5 points In an experiment looking at a child with attention issues, I

Scenarios 5 points In an experiment looking at a child with attention issues, I measured a child’s attention through the report of teacher observations only. Then I chose students to participate in my study only if they had extremely severe attention issues or had no reported attention issues at all. This method results in two major validity threats

Scenarios 5 points What is Monooperation bias and regression?

Scenarios 5 points What is Monooperation bias and regression?

External Validity 1 point Define External Validity

External Validity 1 point Define External Validity

External Validity 1 point What is the extent to which the findings from a

External Validity 1 point What is the extent to which the findings from a study (or effect) can be generalized to other populations, settings, treatment variables, and measurements?

External Validity 2 points A study collected its sample from one undergraduate institution and

External Validity 2 points A study collected its sample from one undergraduate institution and excluded any participants who were under 18 and over 24 years old. The sample was 70% female, 30% male, 80% White, 15% Asian, and 5% Black. All participants were juniors or seniors. This study’s sample could be improved in several ways

External Validity 2 points What is recruit from multiple universities; try to sample community

External Validity 2 points What is recruit from multiple universities; try to sample community members, use a different sampling method that would yield a more representative sample of the population you would like to measure; expand the age range; make the sample more diverse in terms of education level and race?

External Validity 3 points A study looking at the effect of treatment on depression

External Validity 3 points A study looking at the effect of treatment on depression had a large effect size in a controlled, highly regulated setting, however there are doubts as to how the effect will translate into a community clinic or less rigid environment

External Validity 3 points What is interaction of the causal relationship with setting or

External Validity 3 points What is interaction of the causal relationship with setting or limitation of external validity of the setting?

External Validity 4 points In a study looking at the impact of an intervention

External Validity 4 points In a study looking at the impact of an intervention on depression, there was a treatment effect on depression as measured through the Beck Depression Inventory, but it is unclear how the intervention impacted overall quality of life, activity level, interpersonal relationships, etc.

External Validity 4 points What is interaction of the causal relationship with outcomes or

External Validity 4 points What is interaction of the causal relationship with outcomes or limitation of external validity of the outcome observation?

External Validity 5 points An explanatory mediator of a causal relationship in one context

External Validity 5 points An explanatory mediator of a causal relationship in one context may not mediate in another context

External Validity 5 points What is contextdependent mediation?

External Validity 5 points What is contextdependent mediation?

Construct Validity 1 point Define construct validity

Construct Validity 1 point Define construct validity

Construct Validity 1 point What is the degree to which a measurement/test/instrument measures what

Construct Validity 1 point What is the degree to which a measurement/test/instrument measures what it claims to measure?

Construct Validity 2 points Constructs that are supposed to be related are related and

Construct Validity 2 points Constructs that are supposed to be related are related and constructs that are supposed to be unrelated are unrelated

Construct Validity 2 points What is convergent and divergent (or discriminant) validity?

Construct Validity 2 points What is convergent and divergent (or discriminant) validity?

Construct Validity 3 points In my study, I only used selfreport measures to operationalize

Construct Validity 3 points In my study, I only used selfreport measures to operationalize all of my constructs. This causes a threat to construct validity

Construct Validity 3 points What is mono-method bias (or explanation of why this is

Construct Validity 3 points What is mono-method bias (or explanation of why this is a threat)?

Construct Validity 4 points Two ways to ensure strong construct validity

Construct Validity 4 points Two ways to ensure strong construct validity

Construct Validity 4 points What are using multiple operationalizations of the same construct and

Construct Validity 4 points What are using multiple operationalizations of the same construct and ensure your measure is correlated with a relevant behavioral outcome or with measures of similar constructs (+ other acceptable answers)?

Construct Validity 5 points Two ways to assess construct validity

Construct Validity 5 points Two ways to assess construct validity

Construct Validity 5 points What are face validity (does your measure look like what

Construct Validity 5 points What are face validity (does your measure look like what you want to measure) and content validity (does your measure contain all parts that theory indicates it should)?

Misc 1 point The appropriateness of a conclusion or decision

Misc 1 point The appropriateness of a conclusion or decision

Misc 1 point What is validity?

Misc 1 point What is validity?

Misc 2 points When trying to make a causal claim, we prioritize these two

Misc 2 points When trying to make a causal claim, we prioritize these two types of validity

Misc 2 points What are internal and construct validity?

Misc 2 points What are internal and construct validity?

Misc 3 points One way to protect against unreliable treatment (intervention) implementation

Misc 3 points One way to protect against unreliable treatment (intervention) implementation

Misc 3 points What is train your research assistants in a thorough and consistent

Misc 3 points What is train your research assistants in a thorough and consistent manner; monitor treatment implementation and provide consistent feedback to avoid continued errors?

Misc 4 points Random assignment predominantly influences _____ validity and random sampling predominantly influences

Misc 4 points Random assignment predominantly influences _____ validity and random sampling predominantly influences _______ validity

Misc 4 points What are internal and external?

Misc 4 points What are internal and external?

Misc 5 points A study that has strong internal, external, construct, and statistical conclusion

Misc 5 points A study that has strong internal, external, construct, and statistical conclusion validity

Misc 5 points What is (group briefly describes components that would strengthen each type

Misc 5 points What is (group briefly describes components that would strengthen each type of validity in a study they design)?