Building Frameworks of Organizational Intelligence Library Assessment Conference
Building Frameworks of Organizational Intelligence Library Assessment Conference, 2008 Seattle Joe Zucca Director for Planning and Communication University of Pennsylvania Libraries
Building Frameworks of Organizational Intelligence Sample Data Structure I: Data Farm Funds Report - Biology
Building Frameworks of Organizational Intelligence Sample Data Structure I: Data Farm Funds Report - Casalini Libri
Building Frameworks of Organizational Intelligence Sample Data Structure II - Data Farm Table - Funds Process
Building Frameworks of Organizational Intelligence Sample Data Structure III - Voyager Funds Schema bib_ master bib_text invoice_ status Invoice_ line_item fund invoice_ line_item _funds purchase_ order vendor
Building Frameworks of Organizational Intelligence Leveraging data structures Information Loop Service Environment Catalog ERED Funds SFX | ERM? Circulation DYNIX Borrow. Direct WEB Apache ezproxy Data Farm Environment Integrate Inform Report Builder Ref|Instruct Dashboard Data Streams People and Network Data Clean | Anonymize Normalize Data Bureau
Building Frameworks of Organizational Intelligence Data Farm Oracle Space-Overview 30+ gb, in 162 tables, for collecting and disseminating management info E-Resource Use Circulation Reference Contact Web Analytics Acquisitions Funds Resolve Resource Image Collection Use Holdings Resolve People Consortia ILL/Doc. Del Tech Processing Workflow Resolve Places Digital Library 70 -Member ILL Coop. Copier | Printer Use Voyager-Supported Services Building Use Staff Census Gate Swipes Reference & Instruction (dynamic) Resolution Services Administration LDAP
Building Frameworks of Organizational Intelligence Service Environment Data Farm Silos Catalog ERED Funds SFX | ERM? Circulation DYNIX Borrow. Direct WEB Apache ezproxy Ref|Instruct funds
Building Frameworks of Organizational Intelligence A different take on a management information framework
Building Frameworks of Organizational Intelligence Sample Data Structure: EZ-Proxy Log xxx|-|zucca|[26/Jul/2007: 15: 41: 01 -0500]| GET https: //proxy. library. upenn. edu: 443/login? proxy. Session. ID=10335905&url= http: //www. csa. com/htbin/dbrng. cgi? username=upenn 3&access=upenn 34& cat=psycinfo&adv=1 HTTP/1. 1| 302|0|http: //www. library. upenn. edu/cgibin/res/sr. cgi? community=59| Mozilla/5. 0 (Macintosh; U; PPC Mac OS X; en) Apple. Web. Kit/418. 9. 1 (KHTML, like Gecko) Safari/419. 3| NGpmb 6 d. T 6 JXsw. QH|__utmc=94565761; ezproxy=NGpmb 6 d. T 6 JXsw. QH; hp=/; proxy. Session. ID=10335514; __utmc=247612227; __utmz=247612227. 1184251774. 1. 1. utmccn=(direct)| utmcsr=(direct)|utmcmd=(none); UPenn. Library=AAAAAUa. WP 5 o. AACa 4 Aw. OOAg==; sfx_session_id=s 6 A 37 A 3 E 0 -3 B 8 E-11 DC-80 E 9 -85076 F 88 F 67 F
Building Frameworks of Organizational Intelligence Sample Data Structure: EZ-Proxy Log xxx |-|zucca|[26/Jul/2007: 15: 41: 01 -0500]| GET https: //proxy. library. upenn. edu: 443/login? proxy. Session. ID=10335905&url= http: //www. csa. com/htbin/dbrng. cgi? username=upenn 3&access=upenn 34& cat=psycinfo&adv=1 HTTP/1. 1| 302|0|http: //www. library. upenn. edu/cgibin/res/sr. cgi? community=59| Mozilla/5. 0 (Macintosh; U; PPC Mac OS X; en) Apple. Web. Kit/418. 9. 1 (KHTML, like Gecko) Safari/419. 3| NGpmb 6 d. T 6 JXsw. QH|__utmc=94565761; ezproxy=NGpmb 6 d. T 6 JXsw. QH; hp=/; proxy. Session. ID=10335514; __utmc=247612227; __utmz=247612227. 1184251774. 1. 1. utmccn=(direct)| utmcsr=(direct)|utmcmd=(none); UPenn. Library=AAAAAUa. WP 5 o. AACa 4 Aw. OOAg==; sfx_session_id=s 6 A 37 A 3 E 0 -3 B 8 E-11 DC-80 E 9 -85076 F 88 F 67 F xxx =. edu | on-campus | Van Pelt Library | staff office July 26, 2007: 3: 41 p. m. Device= Mac | OSX Browser= Safari
Building Frameworks of Organizational Intelligence Sample Data Structure: EZ-Proxy Log xxx|-|zucca|[26/Jul/2007: 15: 41: 01 -0500]| GET https: //proxy. library. upenn. edu: 443/login? proxy. Session. ID=10335905&url= http: //www. csa. com/htbin/dbrng. cgi? username=upenn 3&access=upenn 34& cat=psycinfo&adv=1 HTTP/1. 1| 302|0|http: //www. library. upenn. edu/cgibin/res/sr. cgi? community=59| Mozilla/5. 0 (Macintosh; U; PPC Mac OS X; en) Apple. Web. Kit/418. 9. 1 (KHTML, like Gecko) Safari/419. 3| NGpmb 6 d. T 6 JXsw. QH|__utmc=94565761; ezproxy=NGpmb 6 d. T 6 JXsw. QH; hp=/; proxy. Session. ID=10335514; __utmc=247612227; __utmz=247612227. 1184251774. 1. 1. utmccn=(direct)| utmcsr=(direct)|utmcmd=(none); UPenn. Library=AAAAAUa. WP 5 o. AACa 4 Aw. OOAg==; sfx_session_id=s 6 A 37 A 3 E 0 -3 B 8 E-11 DC-80 E 9 -85076 F 88 F 67 F Referring URL = library web page listing resources on Psychology (community 59) | Olson, Coordinating Bibliographer
Building Frameworks of Organizational Intelligence Sample Data Structure: EZ-Proxy Log xxx |-|zucca|[26/Jul/2007: 15: 41: 01 -0500]| GET https: //proxy. library. upenn. edu: 443/login? proxy. Session. ID=10335905&url= http: //www. csa. com/htbin/dbrng. cgi? username=upenn 3&access=upenn 34& cat=psycinfo&adv=1 HTTP/1. 1| 302|0|http: //www. library. upenn. edu/cgibin/res/sr. cgi? community=59| Mozilla/5. 0 (Macintosh; U; PPC Mac OS X; en) Apple. Web. Kit/418. 9. 1 (KHTML, like Gecko) Safari/419. 3| NGpmb 6 d. T 6 JXsw. QH|__utmc=94565761; ezproxy=NGpmb 6 d. T 6 JXsw. QH; hp=/; proxy. Session. ID=10335514; __utmc=247612227; __utmz=247612227. 1184251774. 1. 1. utmccn=(direct)| utmcsr=(direct)|utmcmd=(none); UPenn. Library=AAAAAUa. WP 5 o. AACa 4 Aw. OOAg==; sfx_session_id=s 6 A 37 A 3 E 0 -3 B 8 E-11 DC-80 E 9 -85076 F 88 F 67 F zucca [Penn authentication key] = Provost cntr | LIBRARY | staff
Building Frameworks of Organizational Intelligence Sample Data Structure: EZ-Proxy Log xxx |-|zucca|[26/Jul/2007: 15: 41: 01 -0500]| GET https: //proxy. library. upenn. edu: 443/login? proxy. Session. ID=10335905&url= http: //www. csa. com/htbin/dbrng. cgi? username=upenn 3&access=upenn 34& cat=psycinfo&adv=1 HTTP/1. 1| 302|0|http: //www. library. upenn. edu/cgibin/res/sr. cgi? community=59| Mozilla/5. 0 (Macintosh; U; PPC Mac OS X; en) Apple. Web. Kit/418. 9. 1 (KHTML, like Gecko) Safari/419. 3| NGpmb 6 d. T 6 JXsw. QH|__utmc=94565761; ezproxy=NGpmb 6 d. T 6 JXsw. QH; hp=/; proxy. Session. ID=10335514; __utmc=247612227; __utmz=247612227. 1184251774. 1. 1. utmccn=(direct)| utmcsr=(direct)|utmcmd=(none); UPenn. Library=AAAAAUa. WP 5 o. AACa 4 Aw. OOAg==; sfx_session_id=s 6 A 37 A 3 E 0 -3 B 8 E-11 DC-80 E 9 -85076 F 88 F 67 F Session. ID 10335905=Psyc. Info (resource identifier 7014)
Building Frameworks of Organizational Intelligence Sample Data Structure: EZ-Proxy Log xxx |-|zucca|[26/Jul/2007: 15: 41: 01 -0500]| GET https: //proxy. library. upenn. edu: 443/login? proxy. Session. ID=10335905&url= http: //www. csa. com/htbin/dbrng. cgi? username=upenn 3&access=upenn 34& cat=psycinfo&adv=1 HTTP/1. 1| 302|0|http: //www. library. upenn. edu/cgibin/res/sr. cgi? community=59| Mozilla/5. 0 (Macintosh; U; PPC Mac OS X; en) Apple. Web. Kit/418. 9. 1 (KHTML, like Gecko) Safari/419. 3| NGpmb 6 d. T 6 JXsw. QH|__utmc=94565761; ezproxy=NGpmb 6 d. T 6 JXsw. QH; hp=/; proxy. Session. ID=10335514; __utmc=247612227; __utmz=247612227. 1184251774. 1. 1. utmccn=(direct)| utmcsr=(direct)|utmcmd=(none); UPenn. Library=AAAAAUa. WP 5 o. AACa 4 Aw. OOAg==; sfx_session_id=s 6 A 37 A 3 E 0 -3 B 8 E-11 DC-80 E 9 -85076 F 88 F 67 F sfx_session_id=Journal of Experimental Child Psychology, “Relations Among Musical Skills, Phonological Processing and Early Reading Ability in Preschool Children. ”
Building Frameworks of Organizational Intelligence Sample Data Structure: EZ-Proxy Log xxx|-|zucca|[26/Jul/2007: 15: 41: 01 -0500]| GET https: //proxy. library. upenn. edu: 443/login? proxy. Session. ID=10335905&url= http: //www. csa. com/htbin/dbrng. cgi? username=upenn 3&access=upenn 34&cat=psycinfo&adv=1 HTTP/1. 1| 302|0|http: //www. library. upenn. edu/cgi-bin/res/sr. cgi? community=59| Mozilla/5. 0 (Macintosh; U; PPC Mac OS X; en) Apple. Web. Kit/418. 9. 1 (KHTML, like Gecko) Safari/419. 3| NGpmb 6 d. T 6 JXsw. QH|__utmc=94565761; ezproxy=NGpmb 6 d. T 6 JXsw. QH; hp=/; proxy. Session. ID=10335514; __utmc=247612227; __utmz=247612227. 1184251774. 1. 1. utmccn=(direct)| utmcsr=(direct)|utmcmd=(none); UPenn. Library=AAAAAUa. WP 5 o. AACa 4 Aw. OOAg==; sfx_session_id=s 6 A 37 A 3 E 0 -3 B 8 E-11 DC-80 E 985076 F 88 F 67 F TRANSLATION: • July 26, 2007 at 3: 41 pm • A library staff (Provost’s center affiliate) • Using a staff computer (MAC|OSX|Safari) located in Van Pelt Library • Logged into Psych. Info (CSA) and in the same session, • Made an open-url connection to an article on reading aptitude published in the Journal of Experimental Child Psychology.
Building Frameworks of Organizational Intelligence Events: a Structure for Library Decision Metrics Org|Program Staff Unrestricted Restricted Level Dept Library Program Course Descriptor Fund Code Service Genre Budget Expnd Amt Client Program EVENT Bibliographic Content Dept Reqmnt School URL Client Environment School IP-Domain Dept Rank Date|Time Major Campus Location
Building Frameworks of Organizational Intelligence Service Environment Data Farm Silos Catalog ERED Funds SFX | ERM? Circulation DYNIX Borrow. Direct WEB Apache ezproxy Ref|Instruct funds
Building Frameworks of Organizational Intelligence Data Farm Tiered Framework Service Environment Repository processes Catalog ERED Funds SFX | ERM? Circulation WEB Apache ezproxy DYNIX Borrow. Direct Ref|Instruct Analysis DATA STORE XML query (sql) parse, resolve, anonymize, secure! oracle perl XL
Building Frameworks of Organizational Intelligence Event Elements Articulated in an XML Schema METRIDOC <ENVIRONMENTAL> <v. domain> <p. domain> <date> <time> <session> <url> </ENVIRONMENTAL> Library Program Budget Client Program EVENT Content Client Environment <CLIENT> <school> <dept> <rank> </CLIENT> <LIBRARY PRGRM> <service genre> <staff_name> <staff_org> <staff_prgm> </LIBRARY PRGRM> <CONTENT> <title> <author> <holdings> <call_no> <isbn> <issn> <url> <res_id> <sfx_id> </CONTENT>
Building Frameworks of Organizational Intelligence URL Event Elements Articulated in an XML Schema Date|Time Library Program Budget Client Program EVENT Content Client Environment METRIDOC IP-Domain <ENVIRONMENTAL> <v. domain> <p. domain> <date> Environment <time> <session> <url> </ENVIRONMENTAL> Campus Location <CLIENT> <school> <dept> <rank> </CLIENT> <LIBRARY PRGRM> <service genre> <staff_name> <staff_org> <staff_prgm> </LIBRARY PRGRM> <CONTENT> <title> <author> <holdings> <call_no> <isbn> <issn> <url> <res_id> <sfx_id> </CONTENT>
Building Frameworks of Organizational Intelligence METRIDOC Event Elements Articulated in an XML Schema <ENVIRONMENTAL> <v. domain> <p. domain> <date> <time> <session> <url> </ENVIRONMENTAL> School Library Program Dept Budget Client Program Client Major EVENT Content Client Environment Rank <CLIENT> <school> <dept> <rank> </CLIENT> <LIBRARY PRGRM> <service genre> <staff_name> <staff_org> <staff_prgm> </LIBRARY PRGRM> <CONTENT> <title> <author> <holdings> <call_no> <isbn> <issn> <url> <res_id> <sfx_id> </CONTENT>
Building Frameworks of Organizational Intelligence METRIDOC Event Elements Articulated in an XML Schema <ENVIRONMENTAL> <v. domain> <p. domain> <date> <time> <session> <url> </ENVIRONMENTAL> Library Program Budget Service Genre Client Program EVENT Content Client Environment Library Program Org|Program Staff <CLIENT> <school> <dept> <rank> </CLIENT> <LIBRARY PRGRM> <service genre> <staff_name> <staff_org> <staff_prgm> </LIBRARY PRGRM> <CONTENT> <title> <author> <holdings> <call_no> <isbn> <issn> <url> <res_id> <sfx_id> </CONTENT>
Building Frameworks of Organizational Intelligence METRIDOC Event Elements Articulated in an XML Schema <ENVIRONMENTAL> <v. domain> <p. domain> <date> <time> <session> <url> </ENVIRONMENTAL> Library Program <CLIENT> <school> <dept> <rank> </CLIENT> Budget Client Program <LIBRARY PRGRM> <service genre> <staff_name> <staff_org> <staff_prgm> </LIBRARY PRGRM> EVENT Content Client Environment Bibliographic Content <CONTENT> <title> <author> <holdings> <call_no> <isbn> <issn> <url> <res_id> <sfx_id> </CONTENT>
Building Frameworks of Organizational Intelligence Data Farm Multi-Tiered Architecture Metridoc Setting MIS Tools & Services Tier III XML XLS Oracle RSS Admin Interface Data Ingest Tier I Raw data ingest and handoff for resolving into Metridoc Admin users create metridoc schema, specifying structures for raw data sources Repository Tier II Schema Repository SQL Generator spawns tables following user-defined schema Client Resolver Process Data Issues data as event-level metridoc xml Logs & other Data sources Voyager | People Data | ERM Soap Connection Like a prism, the SQL Generator parses metridoc info into relational structures within the Data Repository Soap Connection SQL Generator Data Repository
Building Frameworks of Organizational Intelligence
Building Frameworks of Organizational Intelligence
Building Frameworks of Organizational Intelligence Use of Electronic Journals, Subject Correlations AGRI SCI ARTS & BUS HUM ECON EARTH ENGN- ENVIRO HEALTH INFO CHEM SCI RNG SCI SCI INFO TECH LAW LIFE SCI MATR'L MATH SCI PHYS SOC SCI TELE COM 1 ARTS & HUM -0. 115 1 BUSECON -0. 142 0. 148 1 AGRISCI CHEM 0. 753 -0. 044 -0. 079 EARTHSCI 0. 591 -0. 022 0. 015 0. 637 1 ENGNRNG 0. 478 -0. 084 0. 001 0. 791 0. 477 1 ENVIRO Sci 0. 773 0. 043 -0. 040 0. 961 0. 766 0. 663 1 HEALTH Sci 0. 484 0. 041 -0. 036 0. 760 0. 092 0. 521 0. 681 1 INFOSCI INFOTECH LAW -0. 164 0. 899 0. 173 -0. 135 -0. 002 -0. 176 -0. 003 0. 034 1 0. 189 0. 199 0. 388 0. 443 0. 452 0. 810 0. 382 0. 142 0. 156 1 -0. 090 0. 607 0. 425 -0. 058 0. 092 -0. 090 0. 098 0. 042 0. 732 0. 231 1 LIFESCI 0. 711 0. 001 -0. 079 0. 952 0. 401 0. 697 0. 885 0. 872 -0. 105 0. 300 -0. 020 1 MATR'L SCI 0. 338 -0. 200 -0. 077 0. 521 0. 692 0. 799 0. 474 0. 037 -0. 213 0. 773 -0. 175 0. 281 1 MATHSCI 0. 717 0. 025 -0. 015 0. 980 0. 670 0. 858 0. 932 0. 676 -0. 077 0. 589 -0. 030 0. 906 0. 617 1 PHYS 0. 353 -0. 172 -0. 050 0. 518 0. 710 0. 797 0. 473 0. 000 -0. 214 0. 790 -0. 174 0. 272 0. 988 0. 624 1 0. 265 0. 111 -0. 219 0. 070 -0. 215 1 0. 132 0. 408 SOCSCI TELECOM -0. 060 0. 720 0. 474 0. 044 0. 038 -0. 024 0. 170 0. 231 0. 804 0. 060 -0. 121 0. 035 0. 278 0. 238 0. 796 0. 129 0. 000 -0. 182 0. 954 0. 848 -0. 148 0. 835 0. 839 -0. 159 1
Building Frameworks of Organizational Intelligence Penn’s Use of Electronic Journals by Subject: Multi-Dimensional Scaling Model Source data: Ezproxy logs, June-August 2007 and February-March 2008. 215, 000 observations total Multidimensional Scale of E-Resource Use by Subject – All Users Dimension II “Humanistic-Science” Dimension II “Qualitative-Quantitative”
Building Frameworks of Organizational Intelligence Penn’s Use of Electronic Journals by Faculty: Multi-Dimensional Scaling Model Source data: Ezproxy logs, June-August 2007 and February-March 2008. 215, 000 observations total Multidimensional Scale of E-Resource Use by Faculty Grouped by School Dimension II “Humanistic-Science” Dimension II “Qualitative-Quantitative”
Building Frameworks of Organizational Intelligence Penn’s Use of Electronic Journals Example of text mining on article keywords
- Slides: 31