Making written feedback more effective Tutors providing feedback

Making written feedback more effective Tutors: providing feedback how can we make it easier for students to understand our comments and act on them? Text Students: using tutor feedback what strategies can students use to unpack feedback and take actions to develop skills?

2 Support and additional materials available in Linked webfolio: http: //eportfolio. wlv. ac. uk/viewasset. aspx? oid =2211482&type=webfolio

3 Student view What is it like for students when they get their feedback? Imagine you are a student when you read the essay feedback on the next slide You can remind yourself about your essay on the following slide. What do you think you could do with the feedback? Set out the actions you might take on slide 6.

War Studies WR 1100 The Holocaust in an age of 4 total war Explore historical debates concerning two critical incidents in the path to Auschwitz. Student Number: Semester 2. 2009 Assessment Feedback Comments 1. Structure You made good use of the question in your exploration of selected evidence. However, you needed to identify each point more explicitly at the start of each section. 1. Argument You demonstrated an ability to make judgements on your selected points, this is good. You can develop your work by making a stronger link between the evidence to support such judgements, be it historical fact or theories constructed by scholars. There were also opportunities for you to explore the contradictory views of historians on the significance of particular incidents. 1. Sources Your essay seems to have been built on solid research, but it is important - appropriate range for you to think about how and when to use quotation. What do you think consulted a quote adds to your argument? How can you draw out the significance - appropriate referencing for your argument? Please follow a recognised system for your bibliography. 1. Clarity of expression Your writing is generally clear, although I did note a difference between - presentation your own introduction and conclusion, and the middle section of - writing style exploring the evidence. - grammar and spelling Overall Comments: Grade: Pass In your essay you were able to demonstrate an understanding of the major events in the path to Auschwitz. These conceptual strengths provide you with a platform on which you can work to develop your essay technique and thus take your work to the next level. In all the following points it is a case of building on what you are already doing quite well, to develop your work further.

5 Extract from student essay Endless reasons have been offered in order to explain why the Nazis killed millions in death camps like Auschwitz. On a timeline it is possible to see that the creation of Auschwitz wasn’t something spontaneous, it was a culmination of events and actions which ended in Hitler’s decision to enforce ‘the final solution’ with Auschwitz at the helm. To answer the question it is necessary to identify which of these incidents were most critical to the forming of Auschwitz From 1933 -37 , Buchenwald, Sachsenhausen and Dachau concentration camps opened. These were the first major of camps that the Nazis introduced to hold Jews, Gypsies, homosexuals, political prisoners and all those they despised in tight confined conditions as prisoners; ‘institutions of incarceration for opponents of the National Socialist regime who had committed no offence punishable in the traditional German courts’. Dachau was the original camp specifically used for holding political prisoners, with Buchenwald and Sachsenhausen holding ‘asocials’. These three were the nucleus of the concentration camp system. The opening of these camps has immense significance and had the Nazis not deemed them a success then perhaps there would have been no Auschwitz. This method of squeezing as many numbers as possible was the main strategy used to isolate and remove Jews from society. But the historic significance needs to be noted and there are not many incidents more critical in terms of the holocaust and Auschwitz. Dehumanisation was the stepping stone towards human annihilation and this ran parallel with the concentration to death camp developments. Bibliography Approaches to Auschwitz, Richard L Rubenstein & John K Roth, SCM Press Ltd 1987 pg 146 http: //fcit. usf. edu/Holocaust/resource/plays/Dachau. htm The Dark Valley; A Panarama of the 1930 s, Piers Brendon, Vintage (2002)

6 Actions on feedback Set out the things you would do to follow up this feedback:

7 Student views on Feedback It takes so long I can’t read the to get feedback, comments! that I can’t remember doing the work. Do any of these views apply to your reading of the feedback? Comments make judgements about my attitude or efforts that are not true. There is so much feedback that I can’t make sense of it. It only says Comments are good, but does brief and vague. not say why it is good. I can’t see a connection between the comments and the grade. The comments Often feedback is do not take me confusing and anywhere offers conflicting advice

8 Ways to make feedback more useful to students Students tend to see ‘feedback’ in a past tense and not take it forward to future learning Marking can help to indicate feedback/ feedforward

9 Divide comments into feedback/ feedforward Assessment Feedback 1. Structure Feedback You made good use of the question in your exploration Make sure that you introduce each new point. of selected evidence. However, you needed to identify each point more explicitly at the start of each section. Argument You demonstrated an ability to make judgements on your selected points, this is good. You can develop your work by making a stronger link between the evidence to support such judgements, be it historical fact or theories constructed by scholars. There were also opportunities for you to explore the contradictory views of historians on the significance of particular incidents. Sources Your essay seems to have been built on solid research, but it is important for you to think about how and when to use quotation. What do you think a quote adds to your argument? How can you draw out the significance for your argument? Please follow a recognised system for your bibliography. Clarity expression Feedforward of Your writing is generally clear, although I did note a difference between your own introduction and conclusion, and the middle section of exploring the evidence.

10 Assessment Feedback Feedforward 1. Structure You made good use of the question in your exploration of selected evidence. However, you needed to identify each point more explicitly at the start of each section. 2. Argument You demonstrated an ability to make judgements on your selected points, this is good. There were also opportunities for you to explore the contradictory views of historians on the significance of particular incidents. You can develop your work by making a stronger link between the evidence to support such judgements, be it historical fact or theories constructed by scholars. 3. Sources - appropriate range consulted - appropriate referencing 4. Clarity of expression - presentation - writing style - legibility, grammar and spelling Your essay seems to have been built on solid research, but it is important for you to think about how and when to use quotation. Please follow a recognised system for your bibliography. Your writing is generally clear, although I did note a difference between your own introduction and conclusion, and the middle section of exploring the evidence. What do you think a quote adds to your argument? You need to think about how can you draw out the significance for your argument in future assignments.

11 Suggestions How can we help students get more out of feedback? Suggestions?

12 Strategies to help students get more out of feedback? 1. In the way we provide feedback 2. In helping students unpack feedback 3. In helping students take action on feedback

13 Chart Helping students How can we help students get more out of feedback? Provision Unpacking Action Feedback/ Feedforward Preparing for a tutorial Provision of support materials -Information -Online tutorials -Skills tutorial -Exemplars Tutorial discussion Main area to work on Hyperlinks to follow up

14 Purposes What are the purposes of feedback? List the four main purposes.

15 Compare your purposes with these – do you agree with that purpose or not? 1. 2. 3. 4. 5. 6. 7. 8. 9. to justify the mark awarded; to show far learning outcomes have been achieved; to comment on the develop of subject academic literacy (planning, style, referencing); to motivate the student by praising achievements to identify areas that the student needs to develop; to suggest resources for the development of student learning; to explain why aspects are correct and worthy of praise; to explain why aspects are not appropriate and show what would be an appropriate expression; to identify the gap between current performance and desired performance at that level of study.

16 The ASK Approach Attitudes- change in attitude to prevent early closure on feedback Strategies- introduction of range of strategies for learning Knowledge- both cognitive and practical to guide student learning in relation to feedback.

17 ASK approach • ATTITUDE: Non-collection/ not following up advice We need to help students rethink their belief in assignment/learning closure Build into module design the need to receive and act on feedback, and ensure students are rewarded for doing so. • STRATEGIES (recognition of variety of learning styles/ needs): • electronic links: learning materials and resources • academic study skills feedback tutorials • self-and peer-assessment • subject feedback tutorials (formative and summative) • workshops (skills and developmental) • KNOWLEDGE (cognitive and practical): Understanding the need to act on feedback. Knowing how to act on feedback. Knowing that the development of skills is a personal investment of time. Acting – taking practical steps beyond merely acknowledging the need to or intentions to.

18 : Be prepared Activity: Be prepared – preparing students for your feedback How does your subject and module literature guide students on how to use tutor feedback? q. Do they know what kind of feedback to expect? q Do they know what to do with your feedback? q. Do you provide suggestions for tutorial, literature or electronic support?

19 Proforma with explanation Student Number: Use only your student number, do not include your name as we follow a policy on anonymous marking. Module code and title: Task: this helps you to ensure that you have focused on the set task. Learning outcomes: Set out the specific learning outcomes for this task. Referencing Structure Feedback Feedforward This section feeds back on how far your review met these requirements. This section offers suggestions for your future improvement. This may include hyperlinks to resources that help you develop your skills and understanding. Analysis Overall comment: Grade: Refer to the Scale to interpret your grade. Staff recommendation: main area for you to work on to improve your grades. This section helps you to prioritize your efforts by highlighting the main point from the feedback. This can help you take the first step for acting on feedback Student action: make a note of your intentions on reading this feedback This section is for you to complete when you have thought about this feedback. Make a record of your thoughts so you can put them into action before you start on your next assignment.

Tutors: providing feedback 20 Feedback/Feedforward to help students differentiate between feedback on work, and feedforward for future learning - help students move from being passive recipient of feedback - to help students see benefit of feedforward for developing skills - to help students see how to work on the feedback in specific ways - to motivate students by providing them with advice to improve their learning at the time they receive the feedback Feedback Feedforward Structure You showed a good level of engagement with the material, but your focus on the question could have been tighter. Explore this link for advice on structuring an argument http: //www. monas h. edu. au/lls/llonline /writing/arts/englis h/2. 2. xml

21 Proforma One area/ action Tutors: providing feedback to provide students with a starting point Too much information can be confusing May not know where to start Staff recommendation: Main area for you to work on to improve your grade:

Identify the one area that if improved would lead to a higher grade: 22 Assessment Feedback 1. Structure 2. Argument 3. Sources 4. Clarity expression of Feedback Feedforward You made good use of the question in your exploration of selected evidence. However, you needed to identify each point more explicitly at the start of each section. You demonstrated an ability to make judgements on your selected points, this is good. There were also opportunities for you to explore the contradictory views of historians on the significance of particular incidents. Your essay seems to have been built on solid research, but it is important for you to think about how and when to use quotation. Please follow a recognised system for your bibliography. What do you think a quote adds to your argument? How can you draw out the significance for your argument? Explore this information about referencing to develop a more academic use of quotation: You can develop your work by making a stronger link between the evidence to support such judgements, be it historical fact or theories constructed by scholars. Explore this tutorial to consider Your writing is generally clear, although I did note a difference between your own introduction and conclusion, and the middle section of exploring the evidence. Staff recommendation: Main area for you to work on to improve your grades.

23 Proforma One area/ action Tutors: providing feedback to provide students with a starting point With guidance on where to make such a start Staff recommendation: Main area for you to work on. You must take note of published sources to distinguish between summaries and opinions. Please explore this guidance on quotation to make appropriate use of both:

Tutors: providing feedback 24 Providing hyperlinks Try this tutorial on Stephani, 1998 Structurin http: //ww w. monash g an argu. edu. au/lls / ll online/writ ment students want information on ing/arts/en glish/2. 2. x ml how to develop their work. Students often fail to follow up tutor feedback because they don’t know what to do with it (Burke 2007). focus on ‘pedagogic role’ of written feedback, can ‘facilitate learning’ by making it easy for students to followup feedback advice This process can help to make transparent the ‘academic conventions’ that tutors may take for granted (Lillis & Turner, 2001: 66). use of subject specific examples helps students ‘see’ how skills requirements for planning, structuring and referencing look within their own discipline.

Select a hyperlink from the next slide to support your recommendation: 25 Assessment Feedback 1. Structure 2. Argument 3. Sources 4. Clarity expression of Feedback Feedforward You made good use of the question in your exploration of selected evidence. However, you needed to identify each point more explicitly at the start of each section. You demonstrated an ability to make judgements on your selected points, this is good. There were also opportunities for you to explore the contradictory views of historians on the significance of particular incidents. Your essay seems to have been built on solid research, but it is important for you to think about how and when to use quotation. Please follow a recognised system for your bibliography. What do you think a quote adds to your argument? How can you draw out the significance for your argument? Explore this information about referencing to develop a more academic use of quotation: You can develop your work by making a stronger link between the evidence to support such judgements, be it historical fact or theories constructed by scholars. Your writing is generally clear, although I did note a difference between your own introduction and conclusion, and the middle section of exploring the evidence. Staff recommendation: Main area for you to work on to improve your grades.

26 List of hyperlinks Information Online Tutorials Exemplars Check out this guidance on Writing critically: http: //www. monash. edu. au/lls/llo nline/writing/arts/history/1. xml#f aq 18 Try this tutorial on Analysing historical claims: http: //www. monash. edu. au/lls/llo nline/writing/arts/history/2. 2. xml Explore this student’s attempt to analyse the evidence: http: //www. monash. edu. au/lls/llo nline/writing/arts/history/3. 1. 3. x ml Check out this guidance on the Features of academic writing: http: //www. uefap. com/writing/wri tfram. htm Try this tutorial on Avoiding ‘I’: http: //www. monash. edu. au/lls/llo nline/writing/arts/sociology/2. 3. 1. xml See Renee’s use of precise and accurate language http: //www. monash. edu. au/lls/llo nline/writing/arts/sociology/3. 1. 3. xml Check out this guidance on using citations: http: //www. monash. edu. au/lls/llo nline/writing/general/essay/anal ysing-citations/index. xml Try this tutorial on using Harvard http: //www. monash. edu. au/lls/llo nline/writing/general/essay/anal ysing-citations/index. xml Look at this example of an essay with Harvard citations: http: //www. monash. edu. au/lls/llo nline/writing/general/essay/anal ysing-citations/2. xml

Example of hyperlinks to support learning 27 Assessment Feedback 1. Structure 2. Argument 3. Sources 4. Clarity expression of Feedback Feedforward You made good use of the question in your exploration of selected evidence. However, you needed to identify each point more explicitly at the start of each section. You demonstrated an ability to make judgements on your selected points, this is good. There were also opportunities for you to explore the contradictory views of historians on the significance of particular incidents. Your essay seems to have been built on solid research, but it is important for you to think about how and when to use quotation. Please follow a recognised system for your bibliography. What do you think a quote adds to your argument? How can you draw out the significance for your argument? Explore this information about referencing to develop a more academic use of quotation: You can develop your work by making a stronger link between the evidence to support such judgements, be it historical fact or theories constructed by scholars. Your writing is generally clear, although I did note a difference between your own introduction and conclusion, and the middle section of exploring the evidence. Staff recommendation: Main area for you to work on to improve your grades. Try this tutorial on using Harvard to help you make more of ‘quotation’ in future essays http: //www. monash. edu. au/lls/llonline/writing/general/essay/analysing-citations/index. xml

Tutors: providing feedback Students - 28 Linked webfolios are provided with a hyperlink to a webfolio this reminds students of the Consult the linked webfolio for initial guidance assessed task and illustrations of good practice: http: //pebblepad. wlv. ac. uk/webfolio. aspx? webf provides exemplars of student olioid= 966245 You can follow up this feedback by arranging a work on the specific task one-to-one session with a Skills Tutor in The breaks down the structure of the Student Support Office MC 238, Tel: 01902 323365. feedback form provides guidance on referencing short examples to illustrate good practice

29 Chart Helping students How can we help students get more out of feedback? Provision Unpacking Action Feedback/ Feedforward Preparing for a tutorial Provision of support materials -Information -Online tutorials -Skills tutorial -Exemplars Tutorial discussion Main area to work on Hyperlinks to follow up

Students: using tutor feedback Unpacking Feedback Good points Areas for improvement Note these so you do them again Draw out the main areas to work on 30

31 Preparing for a tutorial Students: using tutor feedback use of template can empower student preparation of actual questions moves through stages Activity: Invite students to complete the ‘Preparation for a tutorial section of the form. Use these prompts to prepare for a tutorial with your module tutor. Make an appointment with your tutor, take this form and your assignment to the tutorial. Feedback that Fill in the actions you intend to take on you understand these points and discuss with your tutor You should make I understand this to mean that when I more use of the include a quote I should draw out the quotations you implications that the quote has for my essay. include. The quote might back up the point I am making, or it might offer a different perspective so I can use it as a jumping off point for the next part of my essay. In either case I need to make explicit reference to my reason for including the quote. Feedback that you do not understand

Students: using tutor feedback Unpacking Feedback you understand What has your tutor written? What do you understand this to mean? Feedback you do not understand What has your tutor written? Questions you want to ask 32

33 Chart Helping students How can we help students get more out of feedback? Provision Feedback/ Feedforward Unpacking Preparing for a tutorial Tutorial discussion Main area to work on Hyperlinks to follow up Action Provision of support materials -Information -Online tutorials -Skills tutorial -Exemplars

Tutors: providing feedback 34 Recording a tutorial Template provides a way of structuring and recording tutorials The learning need identified in the essay feedback is identified discussion with student indicates their understanding of this learning need follow-up Feedback Tutorial Example information: online tutorials: Summary of Learning Needs to be developed: Your tutor noted that you demonstrated a good understanding of the Exemplars: general topic but that you needed to develop your planning so that you Hyperlink added form emailed. use the information to answer the set question. - specific feedback from We looked at the tutor feedback and Tutor comments on the text of your essay - identified from looking at to see where you could have used work material more explicitly, and also at the importance of cutting out material that was not relevant. Hyperlinks: These links will take you to sources that will support your learning: Try this tutorial on Structuring an argument http: //www. monash. edu. au/lls/llonline/writing/arts/english/2. 2. xml 34

35 Feedback Tutorial Template Download the template from the webfolio In pairs one act tutor/ one student Discuss essay Tutor to complete form and email to student

36 Where to go for help Planning Skills tutor Module tutor Grammar Skills tutor e. Tutor Referencing Subject librarian Module tutor Who to contact? Subject resources Subject librarian Module tutor Unpacking feedback Skills tutor Module tutor Stress Academic counselor Peers How am I doing? Personal tutor Module tutor Analysis Skills tutor Module tutor

37 Action Plan Issue Tutor advice Action to be taken Referencing To provide for citations, quotes and in bibliography Check out hyperlink Book session with Study Skills Advisor

Neville, C. (2009) How to Improve your assignment results. Mc. Graw-Hill. You have not answered the question. Your work is more descriptive than critical. You did not tell me anything new. Your English is weak; it was difficult to follow your arguments http: //books. google. com/books? id=RAXy. Nw. AACAAJ&d q=neville+How+to+Improve+Your+Assignment+Results &hl=en&ei=mpr. OTJv 5 Ls 6 Oswb 96 t 2 WCA&sa=X&oi=bo ok_result&ct=result&resnum=1&ved=0 CDIQ 6 AEw. AA

39 Student views ‘This exercise was interesting and helpful to complete, since I misunderstood some feedback I received and if I did not complete this exercise, I would have continued doing what I was, which would have had a negative impact on my work. ’ ‘I realize that in order to develop my study skills I have to make an effort. I need to research these topics in the same way I do other aspects of my work. ’

40 Questions/ issues for discussion

41 Follow up examples Follow up suggestions Bevan, R. , Badge, J. , Cann, A. , Willmott, C. and Scott, J. (2008) Seeing eye-to-eye? Staff and student views on feedback. Bioscience Education, 12(1). <http: // www. bioscience. heacademy. ac. uk/journal/vol 12/beej-12 -1. aspx> (accessed 4 August 2009). Useful article based around a survey with first year bioscience students on provision and utilization of feedback. Useful charts to show student views and also backed up by qualitative information from focus groups with students. Bloxham, S. and West, A. (2007) Learning to write in higher education: students’ perceptions of an intervention in developing understanding of assessment criteria. Teaching in Higher Education, 12(1): 77– 89. Useful article that shares the results of a follow-up survey with students to see how they continue to apply input on feedback in later learning. Duncan, N. (2007) ‘Feed-forward’: improving students’ use of tutors’ comments, Assessment and Evaluation in Higher Education, 32(3): 271– 83. Research in school of education on student perceptions of tutor feedback and their view of the value of interventions in the process of writing an essay. Duncan, N. , Prowse, S. , Burke, D. and Hughes, J. (2007) ‘. . . do that and I’ll raise your grade. ’ Innovative module design and recursive feedback. Teaching in Higher Education: 437– 45. Research in School of Education on student engagement with the opportunity to act on feedback on a draft before final submission.

42 Burke refs Burke, D. & Pieterick, J. (2010) Giving Students Effective Written Feedback. Maidenhead: Mc. Graw-Hill & Open University Press. Burke, D. (2007 a) Engaging students in personal development planning: profiles, skills development and acting on feedback. Discourse: Learning and Teaching in Philosophical and Religious Studies, 6(2): 107– 42. Report on personal development planning approach with Religious Studies students, which focused on the benefits of resubmitting assignments in the light of tutor feedback. Burke, D. (2007 b) Getting the most out of feedback, in D. Nutt and J. Tidd (eds) European First Year Experience: Conference April 2006, Teesside, University of Teesside: 36– 49. An exploration of the benefits for student learning from tutor feedback by way of the Using Feedback Effectively form. Burke, D. (2008) Using electronic sources to help students get more out of tutor feedback, in J. Pieterick, M. Lawton and R. Ralph (eds) European First Year Experience Conference 2008, University of Wolverhampton. Report on the use of hyperlinks in tutor feedback to direct students to materials to enable students follow up issues in feedback. Burke, D. (2009 a) Strategies for using feedback that students bring to their degree course: an analysis of first year perceptions at the start of a course in Humanities. Assessment and Evaluation in Higher Education, 34(1): 41– 50. Report on induction research with a large cohort of humanities students, which identified the range of starting points in relation to understandings of tutor feedback and its place in student learning. Burke, D. (2009 b) Linked Learning: Hyperlinks in Feedback Webfolio. http: //pebblepad. wlv. ac. uk/webfolio. aspx? webfolioid=1112466 (accessed 30 June 2009). Resource to support conference presentation at the Higher Education Academy conference in July 2009. Provides examples of resources used to support student learning from tutor feedback.