Information Literacy Assessment Plan Diana Chan HKUST Enhancing

Information Literacy Assessment Plan Diana Chan, HKUST Enhancing Learning Experiences in Higher Education: International Conference 2 -3 December 2010

Information Literacy Program at HKUST o o Course Embedded IL sessions Open Workshops Total: 295 sessions for 6, 076 participants One-credit GE Course o o 2 GNED 008 Information Skills for Life-long Learning Online Information Literacy Tutorial

ABCLive Attributes of Graduates o o “A University Core that complement specialist knowledge with intellectual breadth through an extended program of general education in the humanities, social science, science and technology, and competency building in communications, mathematics, and information literacy and technology. ” From: Transforming Undergraduate Education – The Transition to the 4 yr Undergraduate Degree

Graduate Attributes of HKUST ABCLive o o o o Academic excellence Broad-based education Competencies and capacity building Leadership and teamwork International outlook Vision and an orientation to the future Ethical standards and compassion

Library: Intended Learning Outcomes Articulate information needs o Identify sources o Select tools to retrieve information o Evaluate information to determine reliability, validity, accuracy, authority, timeliness, point of view, and suitability o Understand issues in privacy, security, censorship, intellectual property, and copyright o Apply IL skills for life-long learning Comply with ACRL Competency Standards for Higher Education o

Information Literacy Competency Levels

Developing the Assessment Plan o A Proposal Submitted in Feb 2010 o o o GNED 008 credit course – pre and post test Course-specific/Open library classes Information literacy requirement Common Core Course Student Engagement and Satisfaction Questionnaire (Indirect Assessment) A standardized survey instrument – JM? , SAILS? , RRSA?

OBE Website

Partnership with CELT o o o Subject Librarians attended OBE workshops Director gave feedback on assessment proposal Associate Director gave assessment workshops o o James Madison ILT assessment results Other assessment tests Validity and reliability issues Creating a question bank

Partnership with SBM o o o o Attended SBM OBE meeting Mapped SBM‘s PILO – 30 courses Offered library sessions to some courses Developed Sample Rubrics on FINA 321 Piloted assessments on 3 courses Developed OBE website with rubrics, assignments, examples, ppts Will attempt to assess on program level

SILOs of SBM o Goal 7 – Graduates will be effective users of information technology and sources in business applications o Demonstrate proficiency in using IT applications in business and management o Locate, gather, organize, and evaluate information using appropriate information technology and systems.

Partnership with SENG o Center for Engineering Education Innovation o o o Workshop on Designing Rubrics Possible partnership on final year projects Other initiatives

GNED 008 Pre and Post Assessment 1 -credit GE course - Information Skills for Life-long Learning A 14 -MC Test was given at the beginning and at the end of the semester in 2010 Pre-Test o o o 22 students Mean score of 58 Std Deviation 17. 2 Post-Test o o o 23 students Mean score of 74 Std Deviation 17. 7

New Students Library Orientation o o ILOs focus on Library Catalog 208 students took a 13 -MC test in Sept 2010 ILOs Competency Find a record for an item in the Library Catalog 97% Look at a Catalog record and know where to go and get the item 97% Log-in to my account and know the basic functions of making holds and renewals 91% Know how and what to request via HKALL 83% Locate an item on Course Reserve 76% Under what circumstances one may make a request using the Library catalog 58%

Course-specific IL assessment Student # # of Qs Accuracy Confidence level FINA 221 MARK 222 MGMT 335 260 82 37 3 3 6 56%-97% 77%-88% 50%-89% 77% 80% 85% Competency Remarks 76% respondents scored 67/100 and above Limited time 2 shared a PC Reliability Low response

Student Engagement & Satisfaction Questionnaire Based on your own assessment, please rate how effective your UG education has been in helping you to develop the following abilities, knowledge and skills using a 5 point scale (5=very effective; 1=very ineffective) o o o Finding and evaluating information effectively Using information responsibly and ethically Applying information research skills in real life

Standardized Test o o o James Madison University Information Literacy Test (ILT) Administered by CELT in 2007 and 2010 A sample of 300 students o o o Entrance test Exit test Officially administered from Sept 2012+? US$7 per student Problem: a small sample, costs, frequency, local adaptation

Challenges & Opportunities Curriculum o No formal IL Program required by the University o Feeding assessment into OBE instruction Assessment Implementing institutional, school or program level assessment o Validity and reliability, reporting mechanism Partnership • CELT - IL Proficiency Test and a Standardized Test o Collaboration with faculty, depts & Language Center Resources $$ o