Seven Levers for Deeper Learning Researchbased Guidelines and
Seven Levers for Deeper Learning Research-based Guidelines and Strategies for Improving Teaching, Assessment & Learning An Interactive Keynote Session in the The 2017 Celebration of Teaching and Learning Sponsored by the Delphi Center The University of Louisville 9: 30 -11: 00 AM on Friday 10 February 2017 Tom Angelo
For all our efforts. . . Are we making any meaningful progress on promoting learning outcomes?
More than 33% of US adults have at least a 4 -year degree. About 42% have at least a 2 -year degree. Have those gains in attainment led to a more civil, just, equitable or sustainable society? Notice I didn’t even bother mentioning the 2016 election.
Page 1 Middle [ 1 ] Values Affirmation Jot down 2 or 3 educational/ professional values you hold that motivate you to invest time and energy in teaching and learning improvement efforts at U of L. _________________________________________ 4
Which value(s) did you mention? A. B. C. D. E. F. Improving student learning Improving teaching effectiveness Doing scholarship of teaching & learning Innovating in the classroom Making teaching less burdensome When’s the coffee break? 5
Page 1 bottom [ 2 ] Goal Ranking & Matching Exercise What are your Learning Goals and/or Burning Questions for this session? _________________________________________ 6
My Intended Learning Outcomes (ILOs) for this Session By the end of this workshop, you will have: 1. Identified at least two or three (2 -3) strategies, guidelines or techniques to improve teaching, assessment, feedback, and/or grading in your work 2. Identified at least two (2) useful resources and/or references for follow up 3. Committed to experimenting with at least one small change in your practice, and 4. Talked with at least two folks you don’t 7
In other words, I’m hoping you’ll end this session with. . . • • • Greater conceptual clarity Useful guidelines Useful strategies and techniques Useful references/resources More connections with colleagues 8
A First “Balcony” Question Could there be advantages to knowing something about your students’ goals? values? 9
Page 11 (The back page) Applications Ideas/Techniques Possible Applications 10
Background Knowledge Probe page 2 1. Of first-year students in 4 Y US colleges in Fall 2015, what percentage graduated A. A traditional public school? from: ___ % B. A charter/magnet public school? ___% C. A private religious/parochial school? ___ % D. A private independent prep school? ___% E. Were home schooled? ___% 11
Background Knowledge Probe page 2 2. Of those same students, what %-age rated the following as “very reasons to go to college: A. To important” be able to get a better job? ___ % B. To learn more about things that interest me? ___% for a specific career? C. To get training ___ % D. To gain a general ed. & appreciation for ideas? E. To be___% able to make more money? ___% F. To prepare myself for grad/prof school? ___% G. To make me a more cultured person ___% 12
Background Knowledge Probe page 2 3. Of those same students, what %-age thought they had a. A. “very good chance of doing the following in Socializing w/different racial/ethnic college: person? ___ % B. Earning at least a ‘B’ average? ___% C. Communicating regularly with profs? ___ % or demonstrating? D. Protesting ___% 13
Background Knowledge Probe page 2 4. About what %-age of the 2015 FYs had: A. First parent with at least a 4 -year degree? ___ % B. Second parent with at least a 4 -year degree? ___% 14
Second “Balcony” Question If you followed directions: Are you more interested in learning the answers to questions on p. 2 than you would have been if I’d simply told that information to you? 15
Background Knowledge Probe page 2 1. Of FY students in 4 Y US colleges in 2015, what percentage graduated from: A. A traditional public school? B. A charter/magnet public school? 74% 8% C. A private religious/parochial school? 10% D. A private independent prep school? 7% E. Were home schooled? 1% 16
Background Knowledge Probe page 2 2. Of those same students, what %-age rated the following as “very important” reasons to go to college: A. To be able to get a better job? 85% B. To learn more about things that interest me? 82% for a specific career? C. To get training 76 gain % a general ed. & appreciation for D. To ideas? E. To be 71% able to make more money? 70% F. To prepare myself for grad/prof school? 59% G. To make me a more cultured person 49% 17
Background Knowledge Probe page 2 3. Of those same students, what %-age thought they had a “very good chance of doing the following in A. Socializing w/different racial/ethnic college: person? 71% B. Earning at least a ‘B’ average? 68% C. Communicating regularly with profs? 44% D. Protesting or demonstrating? 9%* * Upon seeing these survey results, college presidents all over the US ordered their Admissions Offices to identify this 9%. 18
Background Knowledge Probe page 2 4. About what %-age of the 2015 FYs had: A. First parent with at least a 4 -year degree? 61% B. Second parent with at least a 4 -year degree? 60% 19
More “Balcony” Questions Imagine that your first-year students had similar responses: Could you see any implications for: • The courses you teach? • For your program? • For campus assessment efforts? 20
Page 3 [ 1, 2 & 4 ] Six Dimensions of Higher Learning Outcomes % Your Past? % Their Future? ____ Factual Learning _____ Conceptual Learning _____ Procedural Learning _____ Conditional Learning _____ Metacognitive Learning _____ Reflective Learning _____ 100%
3 rd Balcony Question Which of those six dimensions needs and deserves the most focus if we aim to foster: Creative thinking? Problem-solving? Innovation? Life-long learning?
Metacognition involves. . . • Self-Awareness Knowing that and when you are thinking • Self-Monitoring Noticing the quality/intensity of your thinking • Self-Regulation Directing/Correcting your thinking Reflection requires metacognition, but goes beyond it to affect/change values, beliefs, actions and/or habits
A Reflection-in-Action Exercise Rate your own learning approach thus far in the session: 1. Disengaged (I don’t see the point, or I already know all this. ) 2. Semi-attentive (Checking in and out, per my interests. ) 3. Engaged recipient (I’m taking it all in, but quietly. ) 4. Active Participant (I’m contributing & cooperating. ) 5. Reflective Synthesizer
HOT HIPs! Higher Order Thinking can be promoted effectively through High-Impact Practices 25
HIPs – High-Impact Educational Practices • First-Year Seminars and Experiences • Learning Communities • Collaborative Assignments and Projects • Undergraduate Research • Diversity/Global Learning • Service Learning/Community-Based Learning • Clinical Placements/Internships/Co-ops • Capstone Courses and Projects • Writing-Intensive Courses 26
What makes these HIPs so HOT? • • • High expectations Explicit direct instruction Metacognitive scaffolding Deliberate practice Effective feedback Focused collaboration 27
Page 4 – Top – [ 1 & 3 ] The Plus-Minus-Question Mark Technique • Prior knowledge and beliefs • Formative and summative assessment • Deliberate practice • Confirmation bias • Motivated reasoning • Stereotype threat • Bus, Parrot & Parking Lot Tests • Cognitive load • Metacognition • The Dance Floor & The Balcony • Novice-Expert differences
page 5 Create Bloom’s Taxonomy (revised) Anderson & Krathwohl, 2001 Assess Explain Critique Decide Determine Induce Question Appraise Adapt Apply Modify Verify Demonstrate Understand Arrange Categorise Convert Formulate Remember Identify Do simple procedure Generalise Invent Hypothesise Evaluate Analyse Design Justify
Page 5 – bottom [ 1, 3 & 4 ] “Blooming” – Categorizing Questions 30
The Parrot Test 31
Page 5 Categorizing Questions by Bloom’s Taxonomy Levels (Blooming) By systematically varying the elements of the task, we can better assess and promote transfer and deep learning. 32
Page 8 - top The Bondy Scale 33
Bondy’s Clinical Performance (Skills) Rating Scale [6. EXPERT] 5. INDEPENDENT 4. SUPERVISED 3. ASSISTED 2. MARGINAL 1. DEPENDENT Unsafe, Unaware & Unskilled Safe, Very proficient, Requires no support or direction Safe, Proficient, Requires only occasional support and direction Safe, Mostly proficient, Requires frequent support and direction Safe only when supervised, Unskilled, Requires continuous support and direction Independent plus capable of assessing, instructing and supporting
Page 7 – [ 4 ] A Detailed Assessment/Grading Rubric What matters most in this course? How do you know? 35
“From the student’s point of view, the assessment is the curriculum. ” Paul Ramsden
Handout Page 8 Why Give Learners Feedback? • TO IMPROVE PERFORMANCE & ACADEMIC SUCCESS • TO INCREASE INTEREST & MOTIVATION TO LEARN • TO ILLUMINATE AND UNDERMINE MISCONCEPTIONS • TO PROMOTE SELF-ASSESSMENT & SELFREGULATION 37 • TO DEVELOP INDEPENDENCE AS LIFELONG
Handout Page 8 TO USE FEEDBACK WELL, LEARNERS NEED M. O. M. • MOTIVATION – COMPELLING REASONS TO USE IT • OPPORTUNITIES – FOR SAFE, GUIDED PRACTICE • MEANS – KNOWLEDGE & SKILLS FOR IMPROVEMENT 38
HAVE YOU HEARD OF THE “FEEDBACK SANDWICH”? IT’S NOT THE MOST EDUCATIONALLY “NUTRITIOUS” FEEDBACK MEAL. 39
Handout Page 8 THE ORDER IN WHICH WE GIVE FEEDBACK MATTERS ST - GOOD NEWS: WHAT WAS DONE WELL 1 C ONSIDER THE FOLLOWING FIVE STEPS: 2 ND - BAD NEWS: WHAT STILL NEEDS IMPROVEMENT 3 RD - OPTIONS: WHAT CAN BE DONE TO IMPROVE IT 4 TH - PLANS: WHAT THE LEARNER INTENDS TO DO 5 TH - COMMITMENTS: WHAT BOTH PARTIES AGREE TO DO, 40 HOW, TO WHAT STANDARD, AND BY WHEN
Handout Page 9 A Draft Course/Teaching Feedback Form What values do our course and teaching evaluation systems convey to students? To faculty?
“The effectiveness of teaching is best evaluated by what the students do when the teacher is not present. ”
Page 11 (The Back Page) Applications Card – [ 1, 3 & 4 ] Interesting IDEAS/TECHNIQUES Possible APPLICATIONS 43
The Parking Lot Test 44
What, Why and How Choose one of your possible applications. Prepare to answer the three questions below about that specific application: • What is it? • Why do you think it might be useful? • How do you think you might use it? 45
- Slides: 45