REPLICABILITY GENERALIZATION THE REAL WORLD Chapter 14 Learning

REPLICABILITY, GENERALIZATION, & THE REAL WORLD Chapter 14

Learning Objectives Describe the differences among direct replication, conceptual replication, and replication-plusextension studies Explain what a meta-analysis does and how it tells us about the weight of evidence for a particular topic Determine whether a study has been conducted in theory-testing mode or generalization mode and describe how this influences external validity Explain why it is essential for a study to be replicated and describe the reasons a finding might not be reproduced successfully Think critically about replicability, a study’s importance in the context of scientific progress,

Outline 1. To be important, a study must be replicable 2. To be important, must a study have external validity?

1. To be important, a study must be replicable A. B. C. Replication studies The replication debate in psychology What does the literature say? � � D. Literature review Meta-analysis Replicability, importance, and popular media

1 A. Replication Studies Direct Replication Conceptual Replication-Plus-Extension

Direct Replication Direct replication (aka exact replication) – replicate the original study as closely as possible � Same variables, same operationalizations FIGURE 14. 1 Direct replication of the birthday similarity effect. This graph shows the results for the original study (Study 5 a) and the direct replication study (Study 5 b), as they appeared in the original journal article. (Source: Jones et al. , 2004. )

Direct Replication

Conceptual Replication Same variables, different operationalizations

Conceptual Replication Same variables, different operationalizations Example from textbook Conceptual replication: manipulating and measuring the same variables with different operationalizations. The abstract (conceptual) level of the variables is the same, but the operational level of