DEVELOPING A FRAMEWORK FOR PROBLEM SOLVING COMPUTER COACHES

DEVELOPING A FRAMEWORK FOR PROBLEM SOLVING COMPUTER COACHES Evan Frodermann 1, Qing (Xu) Ryan 1, Kristin Crouse 1, Ken Heller 1, Leon Hsu 2, Bijaya Aryal 3 1. School of Physics and Astronomy, University of Minnesota –Twin Cities 2. Department of Postsecondary Teaching and Learning, University of Minnesota –Twin Cities 3. Center for Learning Innovation, University of Minnesota – Rochester General v 2 Coach Structure Supported in part by the National Science Foundation DUE-1226197 and the University of MN q “Primitive” Elements are treated as objects which are unlocked through the solving process. Goal and design • Expand the usability and effectiveness of an earlier version (v 1) of online computer coaches of problem solving. • Follow framework of a cognitive apprenticeship model. • The new version (v 2) of the coaches focus on addressing some limitations of the v 1 coaches. • Procedural limitations of v 1. • Over-repetitiveness of v 1 • Refocus the coaches to the learning needs of a defined target student population. • Ease of use to designing coaches in v 2 for instructors • 35 computer v 1 coaches were incorporated into calculus -based introductory mechanics courses • Data collected from students as well as instructor feedback were used to motivate the redesign of our coaching framework. • Data collected from students included: • FCI, CLASS, and a math diagnostic tests. • Midterm and end of term surveys about the version 1 coaches in Spring 2013. • Keystroke data from coaches. • The v 2 coaches will also be implemented into calculusbased electromagnetism courses to explore usefulness in a new course. Computer Coaches – Instructor’s Perspective q In version 1, instructors needed programming skills to modify coaches. q In version 1, adding and manipulating graphics was difficult and done externally. q In version 1, students cannot switch solutions paths once chosen. q In version 2, coaches can be duplicated and modified using a graphical user interface (GUI). q Adobe Flash q In version 2, all pictures and diagrams are stored in the SQLDB and manipulated within the GUI interface. q In version 2, students can “freely” choose how to solve the problem from available instructor-specified paths. q These paths are completely adjustable to the instructors course needs. q All information is stored in a SQL database. Interacts with Flash frontend through Java host server (Apache Tomcat). Picture elements are added to the database through the interface. Users navigate to different “parent” elements at any time through this menu. Coaches are edited in the “instructor” view “Primitive” elements are unlocked for the student after correct responses. Clients Instructor Server Host Java Web server Apache Tomcat Adobe Flash Player and internet connection My. SQL database All software based on free, open source packages. Students unlock elements of the diagram dynamically and drag unlocked elements to create diagram. Instructors edit pictures and diagrams within the GUI. “Children” elements are only unlocked for the student with correct responses to questions. Computer Coaches – Student’s Perspective Positives Shortcomings q Midterm survey q End-term survey q “Using the computer coaches made the q “The computer coaches did not help improve homework take too long” my problem solving in this class” q 49% of the 183 responses either “agree” or q 66% of the 135 responses either “disagreed” or “strongly agree” “strongly disagreed” q Midterm survey; Free response question q “What do you like most about the computer coaches? ” q 23% of 183 responses either mentioned “step by step” or “guide from beginning to end”. A more detailed analysis of the usage and usability data is shown at poster PST 2 C 14. q Midterm survey; Free response question q “What do you like least about the computer coaches? ” q 37% of the 183 responses either mentioned that they were “too long” or “too repetitive”. q One of the design goals is to be adaptable to the diverse desires of the student. q Reduce this time and over repetition for students who desire it. q Student controls the “grain size” of the coach q In version 1, every kinematic quantity defined whether useful or not, with the same set of questions. q In version 2, only useful quantities are defined using comprehensive modules; eg. the “quantity module”. Coaches are solved in the “student” view Quantities required to solve the problem must be defined. Other quantities can also be defined. Quantity categories are defined by instructor which include a list of required responses. Students choose which quantities to define with these minimal responses.