Step by Step In Vivo Experimentation Lecture 3
Step by Step In Vivo Experimentation Lecture 3 for the IV track of the 2012 PSLC Summer School Philip Pavlik Jr. University of Memphis In vivo experimentation: 1 July 8, 2008
So, you want to run an in vivo experiment? u What is in vitro? – Self-explanation (Chi, Bassok, Lewis, Reimann, & Glaser, 1989) u What is in vivo? – Example take from: u Booth, Siegler, Koedinger & Rittle-Johnson (2008) In vivo experimentation: 2 July 8, 2008
Step 0 u Become an expert in a content area (e. g. , electrodynamics). – Find a textbook – Talk to an expert – (Potentially the most time consuming step. ) In vivo experimentation: 3 July 8, 2008
Step 1 u Hypothesis – Self-explanation: A self-generated explanation of presented instruction that integrates the presented information with background knowledge and fills in tacit inferences. (from pslc wiki) – Correct examples u Facilitate construction of high-feature validity knowledge components. – Incorrect examples u Weaken low-feature validity knowledge components. In vivo experimentation: 4 July 8, 2008
Step 2 u Select a domain – Algebra, geometry, physics, chemistry, Chinese, English u Select a Learn. Lab site – Riverview High School – Central Westmoreland Career & Technology Center u Talk with instructors – Collaboratively identify “hot spots” in curriculum. In vivo experimentation: 5 July 8, 2008
Step 3 u Develop materials – Stimuli – Tutor implementation – Assessments In vivo experimentation: 6 July 8, 2008
Corrective self-explanation of incorrect worked example In vivo experimentation: 7 July 8, 2008
Typical self-explanation of correct worked example In vivo experimentation: 8 July 8, 2008
Step 4 Design Study Self-Explanation of Incorrect Examples Self-Explanation of Correct Examples In vivo experimentation: 9 No Yes “As-is” Control Typical Corrective Typical + Corrective (half of each) July 8, 2008
Step 5 u Formulate a Procedure – the steps with which the design is executed – Pretest u Two forms of the assessment – Intervention u Solve problems with Cognitive Tutor Algebra – Post-test u Take u Get alternate form of assessment IRB approval In vivo experimentation: 10 July 8, 2008
Step 6 u Run experiment – Collect log files – Collect paper-based assessments u Send Log Data to Data. Shop – Test Hypotheses In vivo experimentation: 11 July 8, 2008
Step 7 u Report your results to the scientific community – Create a wiki page – Give a conference talk – Write a journal paper In vivo experimentation: 12 July 8, 2008
Number of correctly answered problems In vivo experimentation: 13 July 8, 2008
Number of conceptual errors In vivo experimentation: 14 July 8, 2008
Goto Step 1 u Using the results from your in vivo experiment: – Replicate with a new population – Replicate with a new domain – Replicate and Extend in a lab experiment In vivo experimentation: 15 July 8, 2008
Summary u Step: 0. 1. 2. 3. 4. 5. 6. 7. Become an expert Generate a hypothesis (in vitro => in vivo) Select domain, site, instructors Develop materials Design study Formulate a Procedure Run experiment & log to Data. Shop Report your results u Goto Step 1 In vivo experimentation: 16 July 8, 2008
Any Questions? In vivo experimentation: 17 July 8, 2008
- Slides: 17