ComputerSupported Learning Environments Andy Carle acarlecs berkeley edu

Computer-Supported Learning Environments Andy Carle acarle@cs. berkeley. edu CS 260 – Fall 2006 3/3/2021 1

Outline 4 Review of learning principles 4 Design Patterns for Education * The Pedagogical Patterns Project * PACT 4 Constructionist Learning Systems: * * Microworlds Group Learning Systems Peer Instruction Systems Integrated Learning Environments 3/3/2021 2

Building Understanding 4 Learning is a process of building new knowledge using existing knowledge. 4 Knowledge is not acquired in the abstract, but constructed out of existing materials. 4 Like any other human process, HCI researchers/practitioners seek to mediate learning via technology. 3/3/2021 3

Constructivism 4 Piaget: Learners construct new knowledge from their experiences via cycles of accommodation and assimilation 4 Accommodation: The process of reframing one’s mental representation of the world to be in line with new experiences 4 Assimilation: Internalizing new experiences that fit the model one has already developed 4 Constructivism is not a pedagogy 3/3/2021 4

Constructionism 4 A pedagogy designed to explicitly facilitate the learning methods suggested by constructivism 4 Developed by Seymour Papert and colleagues at MIT in the 1960 s 4 Explicitly claims that the construction of external artifacts is critical to the building of internal models * Works even better with social artifacts 3/3/2021 5

Scaffolding 4 Refers to the process of shaping the learner’s experience while learning, by creating a “scaffold” to guide their actions. 4 Generally, the teacher begins by doing most or all of the task. 4 The task is repeated, with the learner doing more and more of it. 4 Eventually, the learner does the entire task themselves – the scaffold is removed. 3/3/2021 6

Scaffolding and ZPD 4 Scaffolding produces a steady progression through the learner’s ZPD (Zone of Proximal Development) ZPD Inaccessible Solo tasks Scaffolded learning 3/3/2021 7

Design Patterns 4 An abstraction of a commonly recurring design problem and its contextualized solution * Designed to inform users working in different contexts 4 Originated by Christopher Alexander in the study of architectural design problems * “Each pattern describes a problem which occurs over and over again in our environment, and then describes the core of the solution to that problem, in such a way that you can use this solution a million times over, without ever doing it the same way twice” - Alexander 4 A process by which ordinary people can capture the essence of a design decision by seeing how experts think about common problems in the domain 3/3/2021 Alexander, Ishikawa, & Silverstein, 1977. 8

The Pedagogical Patterns Project 4 Goals * Recreate the success of design patterns in architecture and software engineering in the space of pedagogical theory * Identify and disseminate context-neutral abstractions of best practices for teaching * Encourage instantiation of these patterns in diverse situations 4 Early work by Sharp, Manns, Prieto, and Mc. Laughlin focused on teaching object-oriented programming concepts * Subsequent work by Joe Bergin extended the focus to general CS education 4 Pattern Format: * Description of the problem * Forces governing the application of the pattern * Description of the solution * Advice on implementing the solution 3/3/2021 Sharp et al. , 2000. http: //www. pedagogicalpatterns. org/ 9

A Pedagogical Pattern: Early Warning 4 You teach a course in which ideas build upon one another and students will be lost if they do not understand early material 4 Your students may not realize that they are falling behind or that they have misconceptions, but you are in a better position to recognize it. Students may waste time and effort if they have fallen behind or have misunderstood, but time is short. If your students fall behind or miss early material it will be difficult for them to catch up and succeed. 4 Therefore, give them early warning when you see that they are not coping with the amount of work, or they have misunderstood some topic. Advice is best if it points a path to success, not just pointing out the roadblock. The earlier you give the advice, the better chance for success in the student. This can take many forms. If your course has special pitfalls for the student, you can publish these on your course FAQ. 4 It helps if you give frequent short exams and quickly return the marked papers. Some universities require exams in every course every Friday, for example. 3/3/2021 from: Bergin et al. , Feedback Patterns http: //www. pedagogicalpatterns. org/current/feedback. pdf 10

Problems in Practice 4 Pedagogical patterns have a tendency to be too abstract to be useful. * Difficult to apply to a new context 4 Pattern-informed environments rarely reveal clues about the underlying patterns to the untrained observer 4 Collaboration between content experts and pedagogical specialists is rare * Individuals that can fill both roles are even more scarce. 3/3/2021 11

Pattern Annotated Course Tool 4 Research project intended to bridge the gap between pedagogical patterns in theory and in practice 4 Visual editor in which expert course designers can create representations of their own courses, complete with references to pedagogical patterns 4 Novice instructors can see patterns instantiated in a context that they can relate to directly 3/3/2021 12

Learning Theory in PACT (1/2) 4 Make Thinking Visible * Enable virtual navigation for exploring complex (physical) systems * Model scientific thinking * Provide knowledge representation tools 4 Help Students Learn From Each Other * Encourage learners to learn from others * Scaffold the process of generating explanations 3/3/2021 13

Learning Theory in PACT (2/2) 4 Promote Autonomous Life Long Learning * Encourage reflection * Engage learners as critics 4 Make Theory Accessible * Connect to personally relevant examples * Provide students with templates to help reasoning * Reduce complexity to help learners recognize salient information 3/3/2021 14

Demo 4 PACT is available for download from http: //www. cs. berkeley. edu/~acarle/PACT/ 3/3/2021 15

Constructionist Learning Systems 4 Microworlds * Logo, Microworlds, Boxer 4 Group Learning Systems * TVI, DTVI, Livenotes 4 Peer Instruction Systems * Flashcards, PRS 4 Integrated Learning Environments * WISE, UC-WISE 4 Inquiry Based Systems * Thinker Tools, Inquiry Island 3/3/2021 16

Microworlds 4 Give students a sandbox in which they can explore and test their mental models 4 Provide far more functionality than would be obviously useful to beginners * Usually with no explicit scaffolding to keep them away from advanced features 4 Microworlds encourage less structured exploration by learners. 4 The learner’s discoveries should be driven more by their own goals, leading to better learning. 4 The structure of the Microworld should ensure that they make the right inferences. 3/3/2021 17

Patterns 4 Built-In-Failure 4 Test Tube 4 Try it Yourself 4 Larger than Life 4 Real World Experience 3/3/2021 18

Logo 4 The Logo project began in 1967 at MIT. 4 Seymour Papert had studied with Piaget in Geneva. He arrived at MIT in the mid-60 s. 4 Logo often involved control of a physical robot called a turtle. 4 The turtle was equipped with a pen that turned it into a simple plotter – ideal for drawing math. shapes or seeing the trace of a simulation. 4 Original turtle (Irving) could go forwards, backwards, left, right, and could ring a bell. 3/3/2021 19

Logo 4 Early deployments of Logo in the 1970 s happened in NYC and Dallas. 4 In 1980, Papert published “Mindstorms” outlining a constructionist curriculum that leveraged Logo. 4 Logo for Lego began in the mid-1980 s under Mitch Resnick at MIT. 3/3/2021 20

Logo 4 The “Microworlds” programming environment was created by Logo’s founders in 1993. It made better use of GUI features in Macs and PCs than Logo. 4 In 1998, Lego introduced Mindstorms which had a Logo programming language with a visual “brick-based” interface. 3/3/2021 21

Logo 4 Logo was widely deployed in schools in the 1990 s. 4 Logo is primarily a programming environment, and assignments need to be programmed in Logo. 4 Unfortunately, curricula were not always carefully planned, nor were teachers well-prepared to use the new technology. 4 This led to a reaction against Logo from some educators in the US. It remains very strong overseas (e. g. England, South America). 3/3/2021 22

Uses of Logo 4 Logo is designed to create “Microworlds” that students can explore. 4 The Microworld allows exploration and is “safe, ” like a sandbox. 4 Children “discover” new principles by exploring a Microworld. 4 e. g. they may repeat some physics experiments to learn one of Newton’s laws. 3/3/2021 23

Boxer 4 Boxer is a system developed at Berkeley by Andy di. Sessa (one of the creators of Logo). 4 Boxer uses geometry (nested boxes) to represent nested procedure calls. 4 It has a faster learning curve in most cases than pure Logo. 3/3/2021 24

Strengths of Logo Very versatile. Can create animations and simulations quickly. Avoids irrelevant detail. Tries to create “experiences” for students (from simulations). 4 Provides immediate feedback – students can change parameters and see the results right away. 4 Representations are rather abstract – which helps knowledge transfer. 4 4 3/3/2021 25

Weaknesses of Logo 4 Someone else has to program the simulations etc – their design may make the “principle” hard to discover. Usability becomes an issue. 4 The “experience” with Logo/Mindstorms is not real- world, which can weaken motivation and learning. 4 The “discovery” model de-emphasizes the role of peers and teachers. 4 It does not address meta-cognition. 3/3/2021 26

Group Learning Systems 4 Students tend to synthesize material more thoroughly when they feel that they are creating a social artifact 4 Strong mental associations are constructed between abstract course contents and concrete concepts, such as other people or a particular conversation 4 Patterns: * Invisible Teacher * Groups Work * Study Groups 3/3/2021 27

TVI 4 TVI (Tutored Video Instruction) was invented by James Gibbons, a Stanford EE Prof, in 1972. 4 Students view a recorded lecture in small groups (5 -7) with a Tutor. They can pause, replay, and talk over the video. 4 The method works with a live student group, but also with a distributed group, as per the figure at right. 3/3/2021 28

DTVI 4 Sun Microsystems conducted a large study of distributed TVI in 1999. 4 More than 1100 students participated. 4 The study showed significant improvements in learning for TVI students, compared to students in the live lecture (about 0. 3 sdev). 3/3/2021 29

DTVI 4 The DTVI study produced a wealth of interesting results: 4 Active participation was high (more than 50% of students participated in > 50% of discussions). 4 Amount of discussion in the group correlated with outcomes (exam scores). 4 Salience of discussion did not significantly correlate with outcome (any conversation is helpful? ? ). 3/3/2021 30

Livenotes 4 TVI requires a small-group environment (small tutoring rooms). 4 Livenotes attempts to recreate the small-group experience in a large lecture classroom. 4 Students work in small virtual groups, sharing a common workspace with wireless Tablet-PCs. 4 The workspace overlays Power. Point lecture slides, so that note-taking and conversation are integrated. 3/3/2021 31

Livenotes Interface 3/3/2021 32

Livenotes Findings 4 The dialog between students happens spontaneously in graduate courses – where student discussion is common anyway. 4 It was much less common in undergraduate courses. 4 Students have different models of the lecture – something to be “captured” vs. some that is collaboratively created. 3/3/2021 33

Livenotes Findings 4 But what was very common in undergraduate transcripts was student “dialog” with the Power. Point slides: 4 Students often add their own bullets. 3/3/2021 34

Peer Instruction Systems 4 Peer instruction (Mazur) is a pattern that encourages all these steps: 1. Students are given a multi-choice question 2. They write down an individual answer 3. The class “votes” their answer 4. Students discuss in small groups, then answer again. 5. Another vote is taken 6. The instructor explains the right answer. 3/3/2021 35

Patterns and Purpose 4 Invisible Teacher * Other students are able to recognize misconceptions in an individual that an instructor may not be able to anticipate 4 Active Student * Students that know they will need to prove their understanding to a peer tend to engage in the learning process more actively 4 Own Words and Early Warning * Students often under-appreciate the basic concepts of a course while focusing on the details of particular methods. By having students address non-trivial questions in their own words with their fellow students one can expose this underlying lack of understanding. 3/3/2021 36

Flashcards 4 Inexpensive and easy 4 Difficult to process 3/3/2021 37

Personal Response System 4 Completely anonymous response 4 Ensures near 100% participation 4 Allows recording of input, confidence levels, and instant summary of answers 3/3/2021 38

Inquiry-Based Systems 4 A development of Piaget based on similarities between child learning and the scientific method. 4 In this approach, learners construct explicit theories of how things behave, and then test them through experiment. 4 The “Thinker. Tools” system (White 1993) realized this approach for “force and motion” studies. 3/3/2021 39

Inquiry cycles 4 Inquiry-based learning makes student’s metacognitive strategy explicit. 4 It also treats learning as a kind of scientific research. 3/3/2021 40

Inquiry cycles 4 Question: a new problem for the learner 4 Hypothesis: Learner proposes a solution or a way to understand the problem better 4 Investigate: Learner figures a way to try out the hypothesis (often an experiment) 3/3/2021 41

Inquiry cycles 4 Analyze: understand the results of the investigation. 4 Model: Construct a model or principle for what’s going on. 4 Evaluate: Evaluate the model, the hypothesis, everything that came before. 3/3/2021 42

Thinker. Tools 4 The tools include simulation (for doing experiments) and analysis, for interpreting the results. 3/3/2021 43

Thinker. Tools 4 Students can modify the “laws of motion” in the system to see the results (e. g. F=a/m instead of ma). 3/3/2021 44

Agents: Inquiry Island 4 An evolution of the Thinker. Tools project. 4 Inquiry Island includes a notebook, which structures students inquiry, and personified (software agent) advisers. 3/3/2021 45

Inquiry Island 4 Task advisers: * Hypothesizer, investigator 4 General purpose advisers: * Inventor, collaborator, planner 4 System development advisers: * Modifier, Improver 4 Inquiry Island allows students to extend the inquiry scaffold using the last set of agents. 3/3/2021 46

Integrated Learning Environments 4 Web-Based Inquiry Science Environment (WISE) * UC Berkeley TELS group * Middle School ~ High School science classes 4 UC-WISE * TELS group + CS Division * UC Berkeley & Merced lower division CS courses 4 Sakai * Multiple institutions * Called b. Space in the UC system 3/3/2021 47

“The WISE Way” 4 Simple authoring environment to encourage iteration and experimentation by the teacher 4 Inquiry-driven learning environment in which students learn about a topic while constantly having their understanding checked 4 A gateway to peer instruction, group learning, and various microworlds 3/3/2021 48

UC-WISE Goals 4 to provide technology and curricula for laboratory-based higher education courses that incorporate online facilities for collaboration, inquiry learning, and assessment, and to investigate the most effective ways of integrating this technology into our courses 4 to allow instructors to customize courses, prototype new course elements, and collect review comments from experienced course developers. 3/3/2021 49

UC-WISE Features 4 Learning Management System * Cohesive collection of lessons, tasks, assignments, assessments, and related info 4 Collaborative Tools * Brainstorms, discussion forums, collaborative reviews 4 Inquiry-Based Tools * Web-Scheme, Eclipse exercises, Web-Java 4 Meta-Cognitive Tools * Quick quizzes, “extra brain, ” peer assessment 3/3/2021 50

Results 4 Early Warning patterns are easily instantiated using quizzes and brainstorms in UC-WISE * These activities have become the key to successful UC-WISE courses 4 Real time feedback affords TVI-like intervention by the lab TA 4 The courses are viewed as very timeintensive, but worthwhile 3/3/2021 51