Understanding Use of Networked Information Content MINES for

Understanding Use of Networked Information Content: MINES for Libraries® Implementations at Scholars Portal Dana Thomas, Ontario Council of University Libraries Alan Darnell, Ontario Council of University Libraries Terry Plum, Simmons College Martha Kyrillidou, Association of Research Libraries

Why measure digital content use? • More than 60% of the library materials expenditures in major research libraries is spent on electronic resources • This proportion is even higher for smaller college and university libraries yet higher considering consortial and state • The amount is -wide and nation-wide deals from ARL Statistics Source: http: //interactive. arlstatistics. org CNI Fall 2011 Membership Meeting 1

Ontario Council of University Libraries 420, 000 FTE CNI Fall 2011 Membership Meeting 2

Consortial Licensing • Canadian Research Knowledge Network – National site licensing agency – Major publishers (e. g. Elsevier) • OCUL-IR – Standing committee of OCUL – Large and small publishers • Knowledge Ontario – Multi-sector CNI Fall 2011 Membership Meeting 3

Scholars Portal • Shared technology infrastructure hosted at University of Toronto • Shared services (e. g ILL, SFX, VR, Ref. Works) • Locally loaded content (aggregation and archiving) – Journals – Books – Microdata – GIS CNI Fall 2011 Membership Meeting 4

OCUL Scholars Portal • In 2004 the digital content was primarily e-journals (8. 2 million articles from 7, 219 full text electronic journals) • In 2010 Scholars Portal has 23 million journal articles from over 11, 200 full text electronic journals • Extensive growth has occurred in other formats: 350, 000 ebooks, statistical and geospatial data collections • SFX, the open-URL resolver that connects users to this digital content, is an integral component of the 2010 implementation of MINES for Libraries® since it acts as the delivery mechanism by which the patron encounters the survey CNI Fall 2011 Membership Meeting 5

What is MINES? • Action research – Historically rooted in indirect cost studies – Set of recommendations for research design – Set of recommendations for web survey presentation – Set of recommendations for information architecture in libraries – Plan for continual assessment of networked electronic resources – An opportunity to benchmark across libraries CNI Fall 2011 Membership Meeting 6

Library User Survey CNI Fall 2011 Membership Meeting 7

Library User Survey Patron Status CNI Fall 2011 Membership Meeting 8

Library User Survey Affiliation CNI Fall 2011 Membership Meeting 9

Library User Survey Location CNI Fall 2011 Membership Meeting 10

Library User Survey Purpose CNI Fall 2011 Membership Meeting 11

Goals for MINES for Libraries at OCUL 2010 -11 • demonstrate the value of the library • secure resources as needed • understand use of resources within the library, on campus outside the library, and off campus • understand use of resources across disciplines and user groups • understand why people are using electronic resources • Track the trajectory of the use of the resources since 2004 -05 CNI Fall 2011 Membership Meeting 12

OCUL MINES 2004 vs 2010 OCUL I : 2004 • Randomly selected 2 hour periods each month for a year • Mandatory OCUL II: 2010 • SFX as delivery mechanism • Systematic sampling (every nth) • Mandatory and optional versions • Additional question: contact pool CNI Fall 2011 Membership Meeting 13

Limitation: Variations in SFX as delivery mechanism Institution Uses az list? SFX from OPAC? Google Scholar? Citation linker? bx? BROCK YES NO YES CARLETON NO NO YES YES PRIMO? / Discovery layer? ALGOMA DURHAM GUELPH YES NO YES YES LAKEHEAD YES YES YES NO LAURENTIAN YES YES NO NO LAURIER YES NO YES YES MCMASTER YES YES YES NO NIPISSING YES NO YES YES NO OCAD YES NO NO OTTAWA YES NO NO QUEENS NO NO YES RYERSON YES YES NO NO TORONTO YES NO YES YES NO TRENT YES NO NO UOIT NO NO YES NO NO WATERLOO YES YES YES WESTERN YES YES YES NO WINDSOR YES YES YES NO YORK NO NO YES NO NO RMC CNI Fall 2011 Membership Meeting 14

MINES survey using Lime. Survey software. Ryerson's optional survey User gets directed to the proper MINES Survey or to their resource, as appropriate. CNI Fall 2011 Membership Meeting 15

SFX source with Get it! link CNI Fall 2011 Membership Meeting 16

SFX menu with full text target and other target services CNI Fall 2011 Membership Meeting 17

Introduction to OCUL Report and Institutional Reports • 34, 776 complete responses across all OCUL institutions • 4, 255 surveys from mandatory and 30, 521 from optional implementations • Summarized as: – PDF reports – Excel files – SPSS dataset(s) – SPSS syntax file(s) CNI Fall 2011 Membership Meeting 18

Distribution of OCUL Partner Institutions' Enrollments as of July 2010, Responses to MINES for Libraries(R), and SFX Statistics (Clicks) from 2/16/2010 to 2/17/2011 CNI Fall 2011 Membership Meeting 19

ARL Final Report • Available at http: //www. libqual. org/documents/Lib. Qual/publications/MINES_ OCUL 2011. pdf CNI Fall 2011 Membership Meeting 20

Findings: Frequency of Use of Electronic Resources by User Status (10/11) CNI Fall 2011 Membership Meeting 21

Findings: Frequency of Use of Electronic Resources by Primary Purpose of Use (10/11) CNI Fall 2011 Membership Meeting 22

Findings: Frequency of Use of Electronic Resources by Location (10/11) Off Campus use up 23. 5% On Campus not in library down 15. 9% Library use down 7. 7% CNI Fall 2011 Membership Meeting 23

Findings: Frequency of Use of Electronic Resources by Affiliation (10/11) CNI Fall 2011 Membership Meeting 24

MINES for Libraries ® for CNI SFX provided information to add six additional variables for each survey response: • ISSN / ISBN • Normalized Publisher or Vendor Name • Database Name • Resource Type: EJournal, ebook. Database • Subscription Type: Consortial, Local, or Free/Open Access • Consortia: OCUL, CRKN, Knowledge Ontario CNI Fall 2011 Membership Meeting 25

Consortia / Local / Open Access CNI Fall 2011 Membership Meeting 26

Consortial Breakdown CNI Fall 2011 Membership Meeting 27

Titles available in SFX: Subscription Type Large School Uses in MINES: Subscription Type Large School Free/Open Access 0% Local 30% Local 46% Consortial 67% CRKN 14% OCUL 42% Consortial CRKN 20% Knowledge Ontario 5% N/A 3% Local 26% Knowledge Ontario 5% Free 22% Uses in MINES: Subscription Type Small School OCUL 13% 32% Titles available in SFX: Subscription Type Small School Local 9% OCUL 34% OCUL 47% Consortial 71% CRKN 20% Free 19% Knowledge CNI Fall 2011 Ontario Membership Meeting 4% KO 29% CRKN 10% 28

Does purpose of use vary by subscription type? CNI Fall 2011 Membership Meeting 29

Resource Type CNI Fall 2011 Membership Meeting 30

MINES: Publisher / Vendor Breakdown CNI Fall 2011 Membership Meeting 31

Which resources are used for funded research? CNI Fall 2011 Membership Meeting 32

Publisher use by discipline CNI Fall 2011 Membership Meeting 33

Are there differences in recommendations from librarians vs. faculty? CNI Fall 2011 Membership Meeting 34

MINES: Are there differences in recommendations from librarians vs. faculty? n=6336 n=2467 CNI Fall 2011 Membership Meeting 35

Publisher/Vendor Uses in MINES for Libraries® CNI Fall 2011 Membership Meeting

Within each publisher what is the breakdown by user role? User Group By Publisher 70, 00% 60, 00% 50, 00% Undergraduate Graduate 40, 00% Faculty Staff 30, 00% Library Staff Other 20, 00% 10, 00% Elsevier Wiley Pro. Quest CNI Fall 2011 Membership Meeting Ebsco

Within each user role what is the breakdown by publisher? % of Category Share by Publisher 80, 00% 70, 00% 60, 00% Undergraduate 50, 00% Graduate Faculty 40, 00% Staff Library Staff 30, 00% Other 20, 00% 10, 00% Elsevier Wiley Pro. Quest CNI Fall 2011 Membership Meeting Ebsco

Within each publisher what is the breakdown by affiliation? Affiliation by Publisher 35, 00% 30, 00% Applied Science and Engineering Business 25, 00% Education Environmental Studies 20, 00% Fine Arts Humanities 15, 00% Law Medical/Health Sciences 10, 00% Social Sciences Other 5, 00% 0, 00% Elsevier Wiley Proquest CNI Fall 2011 Membership Meeting Ebsco

Within each affiliation what is the breakdown by publisher? Affiliation by Publisher (% Share of Category) 30, 00% 25, 00% Applied Science and Engineering Business 20, 00% Education Environmental Studies Fine Arts 15, 00% Humanities Law Medical/Health Sciences 10, 00% Sciences Social Sciences Other 5, 00% 0, 00% Elsevier Wiley Proquest CNI Fall 2011 Membership Meeting Ebsco

Within each publisher what is the breakdown by purpose of use? Purpose of Use by Publisher 70, 00% 60, 00% 50, 00% Funded Research Non-Funded Research 40, 00% Teaching Coursework/Assignment 30, 00% Patient Care Other Activities 20, 00% 10, 00% Elsevier Wiley Pro. Quest CNI Fall 2011 Membership Meeting Ebsco

Within specific purpose of use what is the breakdown by publisher? Purpose of use by Publisher (% Share of Category) 25, 00% 20, 00% Funded Research 15, 00% Non-Funded Research Teaching Coursework/Assignment 10, 00% Patient Care Other Activities 5, 00% 0, 00% Elsevier Wiley Pro. Quest CNI Fall 2011 Membership Meeting Ebsco

Practical Implications/Value • What are the implications of running the survey in session mode vs link-resolver? • How does the use of consortial products compare to that individually-licensed content? • What conclusions can be drawn about the efficacy of surveying users via an open-URL resolver? • How will MINES fit into the overall assessment program for OCUL? • How useful is the contextual information from MINES in understanding user workflows? • Are there any lessons learned regarding discoverability? CNI Fall 2011 Membership Meeting 43

What else would be useful to query? – the relation between mandatory and optional survey methods – informing collection development decisions, – understanding the impact of open access, etc. – …… CNI Fall 2011 Membership Meeting 44

Credits • The presenters thank: – Catherine Davidson for her work contributing to the slides – Vidhya Pathasarathy, Bilal Khalid, Agnes Bai, Gary Roebuck and other systems staff for their work on the survey – Kevin Wong for writing a program to complete a first pass at parsing target urls CNI Fall 2011 Membership Meeting 45

Thank you Alan Darnell Project Director, Scholars Portal alan. darnell@utoronto. ca Dana Thomas Evaluation and Assessment Librarian, Scholars Portal dana. thomas@utoronto. ca Terry Plum, Assistant Dean, Simmons Graduate School of Library and Information Science terry. plum@simmons. edu Martha Kyrillidou Senior Director, Statistics and Service Quality Programs, Association of Research Libraries martha@arl. org CNI Fall 2011 Membership Meeting 46