Briefing session on Online Student Evaluation of Teaching

Briefing session on Online Student Evaluation of Teaching and Learning for Administrative and Clerical Staff Prepared by Social Sciences Research Centre of The University of Hong Kong 1

SETL process 2 Ø This year, online process must cover all undergraduate courses (including Common Core courses) on 2 semesters system and TPG courses can be evaluated online if they also use 2 semester system. All other TPG courses must use the paper form for the evaluation Ø The online SETL evaluation will be conducted for 4 weeks until the start of the assessment period (e. g. this semester from Nov 8 to Dec 5, 2014) 2014 Ø SETL form covers course, teachers, tutors and demonstrators Ø Uses SIS database record of course/teacher/tutor/demonstrator Ø An option in SIS is available for joining different courses in the evaluation, only one overall report will be generated Ø For information, MBBS and Dentistry online SETL evaluation were handled separately

SETL process 3 Ø Must use standard forms unless Chairman of TLQC approves Ø Online yields lower response rates, but better open-ended responses, responses which is good for improvement Ø To ensure good response rates, need to ensure that students are given time at the end of a class to complete the form (although they can complete any time before the deadline) Ø Cannot currently change teacher names in system, which come from Human Resources Ø For the Department Items, a maximum 5 extra questions for both on -line and paper evaluation, please contact and confirm with SSRC staff, Ms. C. C. Ho at 3917 -1623 or hocc@hku. hk on or before 3 weeks until the assessment period (e. g. Oct. 24, 2014 for this semester)

SETL process Ø For the online SETL, all courses with enrollment of at least 2 students must undertake SETL, although the teacher/tutor/demonstrator parts are only done if there at least 2 students per teacher/tutor/demonstrator (unless Chairman of TLQC agrees) Ø For the paper SETL, all courses with enrollment of at least 5 students must undertake the evaluation (unless Chairman of TLQC agrees), although the teacher/tutor/demonstrator parts are only done if there are such persons for the class 4

SETL process Ø A maximum list of teacher/tutor/demonstrator is 25 names Ø Separate online forms for course, teacher, tutor, demonstrator as needed. Up to 25 teachers can be evaluated in each course by a student, but only 1 tutor/demonstrator selected by a student from a list (or evaluated as a group) of each course Ø All teachers/tutors/demonstrators must have staff ID/University No. (HKU requirement and needed for staff review) Ø Tutor means person running tutorials, demonstrator means person responsible for lab or field sessions (role descriptions) 5

SETL Workflow Prepared by Social Sciences Research Centre of The University of Hong Kong 6

SETL Workflow of the Online SETL Ø Departments/Centres/Schools/Institutions should enter/update the course enrollment information including all undergraduate and TPG courses in the Student Information System (SIS) especially the staff number linked to the name of teacher/tutor/demonstrator in each course and sub-class information 10 weeks before the assessment date (before the end of September 2014) Ø All information must be updated for the appropriate semester Ø Student enrollment should be updated automatically, but the rest of the information relies on the departments/centres/schools/institutions to update 7

SETL Workflow of the Online SETL Ø SIS unit exports the course enrollment information of all undergraduate and TPG courses including: ü Course code; ü Course title; ü Term (Semester 1/2/full Year); ü Student list in each course (student name and university no. ); ü Teacher name list in each course (teacher name and staff number); ü Tutor and Demonstrator name list in each course (teacher name and staff number); and ü Jointly evaluated courses (course list) 8

SETL Workflow of the Online SETL Ø The enrollment information received from SIS except the student list and indication of whether online or paper process will be sent out to departments/centres/schools/institutions on or before 3. 5 weeks before the assessment period (e. g. this semester mid of Oct, 2014), so departments can check for errors and missing information (Please refer to Course List, Teacher List, Tutor List and Demonstrator List) Ø Departments/Centres/Schools/Institutions should update any data amendments in the SIS system for 3 to 2. 5 weeks until the start of the assessment period between (e. g. this semester Oct 20 and 24, 2014) 9

SETL Workflow of the Online SETL Ø The final enrollment information of courses with teacher/tutor/demonstrator names will be sent out to departments on or before 1 week before the assessment period for the final check (e. g. this semester Oct 31, 2014). If any errors occurs, please contact SSRC through email setl@ssrc. hku. hk immediately (on or before Nov 4, 2014). Ø For information, SSRC will provide a student list to the Information Technology Services on Oct 28 for sending out reminder emails on November 8 and December 1, 2014 10

Instructions for Online SETL Before administration The teacher concerned should inform the students in advance the date of the online evaluation (soon after Nov 8, 2014), and that the students are encouraged to bring a mobile internet device (such as laptop, tablet or smartphone) to class at the scheduled time. 11

Instructions for Online SETL On the day of administration Similar to the paper exercise, the SETL questionnaire should NOT be administered by the course teacher, but faculty/department staff. The teacher should briefly explain the objectives of the student evaluation and then leave the room leaving it to faculty/department staff to oversee the process. 12

Instructions for Online SETL On the day of administration Faculty/Centre/Institution/Department staff should read out: Please go to the weblink http: //setl. hku. hk where you should see a list of all forms that you need to complete. Your evaluation will be saved anonymously, without any identification. There are separate forms for the course, teacher (and if appropriate) tutor and demonstrator. There are instructions, an FAQ link and a link for you to report any missing courses at the weblink. 13

Instructions for Online SETL During the evaluation period Students should ü ü ü 14 Access the SETL system via the weblink http: //setl. hku. hk/ where there are instructions, FAQ and a list of forms for completion (separate links for the course, teacher, tutor, demonstrator forms) Complete the forms for the class for four weeks until the start of the assessment period (e. g. this semester from Nov 8 to Dec 5, 2014) if they cannot find the course that they have enrolled in, send an email to SSRC using the link on the page so SSRC staff can rectify this promptly

Workflow for Paper SETL Ø Departments/Centres/Schools/Institutions should be responsible for the accuracy of SIS data before SSRC generates the SETL reports and inform SSRC about the course enrollment information for printing purpose. Ø For any amendment of the evaluation form (after received the Chairman of TLQC approval) should inform SSRC 4 weeks before the evaluation date. Ø Departments/Centres/Schools/Institutions should inform SSRC for printing at least 2 weeks before the evaluation date. Departments collects the blank forms one week before the evaluation date and carries out the evaluation. Ø For the paper evaluation forms, departments should deliver to SSRC all completed forms, completed cover sheet on the top of each envelope. 15

SETL Workflow for Reporting 16 Ø The SETL results will be generated upon notice from SSRC after the examination result release date (e. g. this semester 20 January 2015) and the following report will be provided to each department/centre/school/faculty/institution : ü an individual report of every teacher in each course; ü an overall teacher report of every course; ü a report for the tutor/demonstrator of every course (if applicable); ü a course evaluation report of every course; ü a soft copy of all open-ended questions’ answer using online SETL (in MS excel format by question number and course code); ü an overall report on the undergraduate courses; and ü an overall report on the TPG courses

SETL Workflow for Reporting Ø Additional requests may be entertained at cost Ø SSRC uploads the SETL results to the APA on or after 20 January 2015 (after the examination result release date 19 January 2015) Ø SSRC uploads the SETL results to the SSRC online SETL report system on or after 20 January 2015 (after the examination result release date 19 January 2015) 17

Instructions for Online SETL ü My colleague, Mr. Samson Lee, will now demonstrate Online SETL, so you can see how the process works in practice: http: //setl. hku. hk ü My colleague, Mr. Samson Lee, will now demonstrate Online SETL report system, so you can see how the process works in practice: http: //setl. hku. hk/report 18

Thank you! I am happy to answer questions. Prepared by Social Sciences Research Centre of The University of Hong Kong 19