Quantitative Research Experimental Designs Criteria Adequate experimental control

  • Slides: 14
Download presentation
Quantitative Research Experimental Designs Criteria Ø Adequate experimental control Ø Lack of artificiality Ø

Quantitative Research Experimental Designs Criteria Ø Adequate experimental control Ø Lack of artificiality Ø Basis for comparison Ø Adequate information from the data Ø Uncontaminated data Ø No confounding of relevant variables Ø Representativeness Ø Parsimony Ø Ø Ø Pretest-posttest control group design Posttest only control group design Solomon four group design Counterbalanced design Factorial design

Criteria #1 Adequate Experimental Control • There adequate restraints, or controls, on the conditions

Criteria #1 Adequate Experimental Control • There adequate restraints, or controls, on the conditions of the experiment. • With controls in place the researcher should be able to accurately interpret the results. • The experimental design should be structured in such a way that the experimental variable (or treatment) effect can be detected.

Criteria #2 Lack of Artificiality • The experiment must be conducted in such a

Criteria #2 Lack of Artificiality • The experiment must be conducted in such a way that the results will apply to the real educational world.

Criteria #3 Basis for Comparison • There must be some way to make a

Criteria #3 Basis for Comparison • There must be some way to make a comparison to determine whether or not there is an experimental effect. • In some cases a control group is used (control groups do not receive the experimental treatment). • In some cases multiple treatments may be studied against an external criterion (i. e. Different reading techniques may be examined to assess their relative impact on student reading scores).

Criteria #4 Adequate Information From the Data • There must be adequate data for

Criteria #4 Adequate Information From the Data • There must be adequate data for testing the hypothesis. • The data must be such that statistical testing will be precise enough for the researcher to make a decision about the hypothesis.

Criteria #5 Uncontaminated Data • The data should adequately reflect the experimental effects. •

Criteria #5 Uncontaminated Data • The data should adequately reflect the experimental effects. • The data should not be affected by poor measurement or errors in the experimental procedures. • Example: subjects in an experiment should not communicate across groups (control and experimental).

Criteria #6 No Confounding Variables • Confounding of variables occur when two or more

Criteria #6 No Confounding Variables • Confounding of variables occur when two or more variables cannot be separated. • Experimental controls should be such that variables can be isolated. • Translation: the relationship between independent variable and the dependant variable can be measured with confidence in that another variable is not contributing to the effect.

Criteria #7 Parsimony • Keep it simple! • This criterion means that, with all

Criteria #7 Parsimony • Keep it simple! • This criterion means that, with all other factors being equal, a simple design is preferred to a more complex one. • Note: simple designs are usually easier to implement, and may yield data that is easier to interpret.

Quantitative Experimental Designs This family of research designs is characterized by random selection of

Quantitative Experimental Designs This family of research designs is characterized by random selection of subjects. ******* The following experimental designs are based on the problem statement: The effects of teaching method(s) on history achievement.

Experimental Design #1 Pretest-Posttest Control Group Design Diagram O X 1 O O X

Experimental Design #1 Pretest-Posttest Control Group Design Diagram O X 1 O O X O

Experimental Design #2 Posttest-Only Control Group Design Diagram X 1 O X O

Experimental Design #2 Posttest-Only Control Group Design Diagram X 1 O X O

Experimental Design #3 Solomon Four Group Design Diagram X 1 O X O O

Experimental Design #3 Solomon Four Group Design Diagram X 1 O X O O X 1 O O X O

Experimental Design #4 Counterbalanced Design Diagram X 1 O X O X 1 O

Experimental Design #4 Counterbalanced Design Diagram X 1 O X O X 1 O

Experimental Design #5 Factorial Design Diagram Independent Variable #1 Teaching Method Lecture Only Independent

Experimental Design #5 Factorial Design Diagram Independent Variable #1 Teaching Method Lecture Only Independent Variable #2 Aptitude Reading/Lecture/Small Groups Randomly assigned 3 rd graders scoring above 85 on an aptitude test. Randomly assigned 3 rd graders scoring about 85 on an aptitude test. Randomly assigned 3 rd graders scoring below 60 on an aptitude test.