Lecture Outline p Introduction to experimental research p

  • Slides: 32
Download presentation
Lecture Outline p Introduction to experimental research p Introduction to correlational research p Three

Lecture Outline p Introduction to experimental research p Introduction to correlational research p Three types of research validity p Class Activity

Experimental Research Overview and Major Features p p p An independent variable (IV) is

Experimental Research Overview and Major Features p p p An independent variable (IV) is manipulated A dependent variable(s) (DV) is measured Many basic experiments consist of two levels of the independent variable p p p Control over extraneous variables p p p experimental group control group holding constant randomizing effects A causal relationship between the independent and dependent variables can be established

Basic Goal of Experimental Design p Manipulate possible values of the IV p Observe

Basic Goal of Experimental Design p Manipulate possible values of the IV p Observe behavioral changes as indexed by values of the DV

Basic Characteristics of Experimental Designs p Subjects are randomly assigned to research groups n

Basic Characteristics of Experimental Designs p Subjects are randomly assigned to research groups n A given participant must be equally likely to be assigned to any of the given groups p p p Random number table Flip a coin In experimental designs, a causal relationship between the independent and dependent variables can be established

Independent Variable p p p Differing values of the IV are called “levels” May

Independent Variable p p p Differing values of the IV are called “levels” May vary quantitatively n 10 mg day n 20 mg day e. g. here are 2 levels of variable dosage May vary qualitatively n Zoloft n Imipramine n Prozac e. g. here are 3 levels of the variable medication type

Operational Definitions • An operational definition is a clearly defined set of procedures for

Operational Definitions • An operational definition is a clearly defined set of procedures for measuring or manipulating the construct of interest. • The key to an acceptable operational definition is that the procedure is specified precisely enough to allow replication by others. Examples: quality of memory -- accuracy of recall in a certain task depression -- Beck Depression Inventory (survey) score arousal -- galvanic skin response (conductivity of the surface of the skin)

Operational Definitions: Examples She is a good car salesperson Verbal Statement She: 1. Sells

Operational Definitions: Examples She is a good car salesperson Verbal Statement She: 1. Sells many cars 2. Points out + features 3. Is nice 4. Sells only good cars Operational Definition

Operational Definitions: Examples Stress Verbal Statement 1. Environment/Number of stressors a. Number negative Life

Operational Definitions: Examples Stress Verbal Statement 1. Environment/Number of stressors a. Number negative Life events b. Number of Examinations 2. Self-report Measurable Nervous mood 3. Behavior a. number of fidgets/minute b. Psychophysiological responses elevated Operational Definition

Identify Key Experimental Features p Social loafing refers to people’s tendency to slack on

Identify Key Experimental Features p Social loafing refers to people’s tendency to slack on group tasks. In one study on social loafing college participants cheered alone, and in groups of 2, 4, or 6 ppl. They were told to cheer as loud as possible at specific times so researchers could determine how much noise people made in social settings. The amount of noise made by each participant dropped as group size increased. p 1) What is the IV? 2) What is the DV? 3) Why is random assignment important here? p p

Correlational Research: Major Features p No independent variables are manipulated p Two or more

Correlational Research: Major Features p No independent variables are manipulated p Two or more variables are measured and a relationship established p Correlational research does not show causality p Don’t confuse statistics with research design p Correlation coefficients ( a statistic) can be used in correlational or experimental research designs (although they are more commonly used in correlational designs)

Correlational Research p 2 Variables Positive and Linear Negative and Linear

Correlational Research p 2 Variables Positive and Linear Negative and Linear

Example of Non-Linear Relationship Yerkes-Dodson Law Better Performance Worse Low Arousal High

Example of Non-Linear Relationship Yerkes-Dodson Law Better Performance Worse Low Arousal High

Correlation Does Not Imply Causation Causality – must demonstrate that changes in one variable

Correlation Does Not Imply Causation Causality – must demonstrate that changes in one variable can only be due to influence of the other variable p Directionality of Effect Problem p Third Variable Problem

Directionality of Effect Problem X Y X Y

Directionality of Effect Problem X Y X Y

Directionality of Effect Problem X Class Y Higher Attendance Higher Grades X Y Higher

Directionality of Effect Problem X Class Y Higher Attendance Higher Grades X Y Higher Class Attendance Higher Grades

Directionality of Effect Problem X Aggressive Behavior Y Viewing Violent TV X Y Viewing

Directionality of Effect Problem X Aggressive Behavior Y Viewing Violent TV X Y Viewing Violent TV Aggressive Behavior Viewing Violent TV Aggressive children may prefer violent programs or Violent programs may promote aggressive behavior

Third Variable Problem Y X Z

Third Variable Problem Y X Z

Class Exercise Identify the third variable that influences both X and Y

Class Exercise Identify the third variable that influences both X and Y

Third Variable Problem Number of Churches + Crime Rate

Third Variable Problem Number of Churches + Crime Rate

Third Variable Problem Class Attendance + GPA

Third Variable Problem Class Attendance + GPA

Third Variable Problem Ice Cream Consumed + Number of Drownings

Third Variable Problem Ice Cream Consumed + Number of Drownings

Measurement Considerations p Variables should be measured accurately and consistently. p Accuracy n Validity

Measurement Considerations p Variables should be measured accurately and consistently. p Accuracy n Validity p p Bathroom scale gives correct weight Consistency n Reliability p Bathroom scale gives same weight consistently

Evaluating Research: 3 Validities p Validity n p How accurate is the information from

Evaluating Research: 3 Validities p Validity n p How accurate is the information from our research? Three validities n n n Construct validity Internal validity External validity

Construct Validity

Construct Validity

Construct Validity p The degree to which the construct can be inferred from the

Construct Validity p The degree to which the construct can be inferred from the operational definition of that construct n Never one perfect operationalization p Schacter and Singer (1962) n Two-factor theory of emotion: p n Factor 1: AROUSAL p n Emotions require arousal and label Participants received epinephrine shots and either informed them of side-effects or not Factor 2: LABEL p Participants around "euphoric" or "angry“ confederate

How Valid are These Manipulations? p Euphoria n p Confederate shoots rubber bands, plays

How Valid are These Manipulations? p Euphoria n p Confederate shoots rubber bands, plays with hula hoops and crumples up paper and practices hook shots into wastebasket Anger n Confederate complains about the injection, adds negative comments about the questionnaire they are filing out and ends up ripping up the questionnaire.

Simplified Results Informed of epinephrine effects Uninformed of epinephrine effects Euphoria Condition Anger Condition

Simplified Results Informed of epinephrine effects Uninformed of epinephrine effects Euphoria Condition Anger Condition

Internal and External Validity p Internal validity n The extent to which the observed

Internal and External Validity p Internal validity n The extent to which the observed effect is caused only by the experimental treatment condition p p p The ability to draw conclusions about a causal relationship from our data Experiments usually high in this External validity n The extent to which the results can be applied to and across different persons, settings and times p p AKA generalizability Experiments often low in this

Generalizing From the Lab Setting p Mundane realism n p Psychological realism n p

Generalizing From the Lab Setting p Mundane realism n p Psychological realism n p The extent to which an experiment is similar to real-life situations The extent to which an experiment triggers relevant psychological and group processes Key point n n Lab experiments not automatically artificial When an experiment lacks mundane realism it may be very realistic in terms of psychological realism

Assess Internal & External Validity p Does lighting affect productivity? p Study 1: n

Assess Internal & External Validity p Does lighting affect productivity? p Study 1: n Give people a production task in a laboratory. The lab room is either bright or dim. Measure and compare their productivity (how quickly and accurately they perform the task). Study 2: n Give employees in a well-lit office and those in a dim office a production task. Measure and compare their productivity (how quickly and accurately they perform the task). p

The Tradeoff p Real life situations n n High external validity Hard to rule

The Tradeoff p Real life situations n n High external validity Hard to rule out other explanations p p Low internal validity Lab settings n n High internal validity Often artificial and findings can’t be generalized p Low external validity

Class Exercise p Hypothesis and Operational Definition Exercise

Class Exercise p Hypothesis and Operational Definition Exercise