Subject To Change automatic catalog enrichment with subject

Subject To Change automatic catalog enrichment with subject headings and codes 10 th IGe. LU conference Budapest, 3. 9. 2015 Marcus Zerbst Zentralbibliothek Zürich, Systems Librarian

Overview Background →Desire to align legacy data with GND and LCSH and DDC data →The Digital Assistant Automatic catalog enrichment with subject headings and codes →Parameters, technical workflow, numbers and statistics Prospect →Plan to use more subject cataloging data from external sources Subject To Change, Marcus Zerbst, IGe. LU conference, 3. Sept 2015 2

Excuse me, what is GND? Subject To Change, Marcus Zerbst, IGe. LU conference, 3. Sept 2015 3

What‘s GND? GND → The Integrated Authority File (GND) is an authority file for Persons, Corporate bodies, Conferences and Events, Geographic Information, Topics and Works. It is used above all for the cataloguing of literature by libraries […] It is operated cooperatively by the German National Library, all German-speaking library networks […] →In April 2012 the GND replaced [various] previously separate authority files. (from http: //www. dnb. de/EN/Standardisierung/GND/gnd_node. html) Subject To Change, Marcus Zerbst, IGe. LU conference, 3. Sept 2015 4

Background Subject To Change, Marcus Zerbst, IGe. LU conference, 3. Sept 2015 5

Desire: Subject Indexing of older records with GND/LCSH data → Since Autumn 2012: Cease homegrown system for subject indexing in favour of GND → Standards in German speaking market instead of local peculiarities → Desire for better searchability of all titles by consistent indexing per GND data → Idea: Enrich old records with GND data – manual cataloging not an option Subject To Change, Marcus Zerbst, IGe. LU conference, 3. Sept 2015 6

The Digital Assistant → In production in the parameters of computer-aided subject indexing since October 2013 → Helps subject librarians with indexing by suggesting subject entries according GND → Generates suggestions based on external database entries, translation and statistical analysis of table of contents → Is used in an intuitive web client → Daily import of fields for processed titles to Aleph Subject To Change, Marcus Zerbst, IGe. LU conference, 3. Sept 2015 7

DA – Flow Chart ILS Aleph Import in DA Import • Load TOC • Load metadata (Z 39. 50) • Daily by FTP • Info e. Mail Export from DA Enrichment • Daily in Aleph seq format • GND/S headings, scope 072, loc. fields • Subject heading from World. Cat, … and Autocat Editing in DA • Choice / addition of headings • Suggestions, headings lists Subject To Change, Marcus Zerbst, IGe. LU conference, 3. Sept 2015 8

Technology Components DA To. C Subject To Change, Marcus Zerbst, IGe. LU conference, 3. Sept 2015 9

Project Rekat automatic catalog enrichment with subject headings and codes Subject To Change, Marcus Zerbst, IGe. LU conference, 3. Sept 2015 10

Project Rekat Parameters → Enrichment of all our records from publication years 1960 -2012 • From Autumn 2012 on: subject indexing with GND → Around 1. 8 million titles → Matching records against World. Cat → Enrichment with GND, LCSH and DDC Subject To Change, Marcus Zerbst, IGe. LU conference, 3. Sept 2015 11

Retrospektive Erschliessung– Ablaufschema Aleph / EBI 01 Import Export • Consortium cataloging rules • Avoid duplicates • One-time • marc. XML Match World. Cat • GND, LCSH, DDC Subject To Change, Marcus Zerbst, IGe. LU conference, 3. Sept 2015 12

Technical Workflow Subject To Change, Marcus Zerbst, IGe. LU conference, 3. Sept 2015 13

Find match in World. Cat Order of precedence: ISBN Author & title • all terms from 245$$a/$$b and 100$$a • Both to exist mandatory As 2. , but no stop words Author a & title a/b/c in full record, no stop words. Same no of terms Search=Find Subject To Change, Marcus Zerbst, IGe. LU conference, 3. Sept 2015 14

Import of Data: Adaption I → Transfer of records found in World. Cat → Received: • All subjects of all matches • All DDC codes → Avoid duplicates: → Check against data in NEBIS catalog → On text level, no Aleph routine Subject To Change, Marcus Zerbst, IGe. LU conference, 3. Sept 2015 15

Import of Data: Adaption II → Local routine adjusts MARC 21 to KIDS (Swiss MARC rules) → Avoid duplicates Received: • 000085853 0820_ $$a 501 • 000085853 08204 $$a 501 Adapted and deduplicated: • 000085853 0820_ $$a 501 Subject To Change, Marcus Zerbst, IGe. LU conference, 3. Sept 2015 16

Import of data: Adaption III Technical difference after adaption • In 082 all 2 nd indicators are stripped during import, afterwards identical fields are purged. But if 1 st, valid indicator differs, then fields with identical content are technically different, and will be imported. Received: • 000077241 082_4 $$a 709. 493 • 000077241 08204 $$a 709. 493 • 000077241 08214 $$a 709. 493 Adapted: • 000077241 082__ $$a 709. 493 • 000077241 0820_ $$a 709. 493 • 000077241 0821_ $$a 709. 493 Subject To Change, Marcus Zerbst, IGe. LU conference, 3. Sept 2015 17

Testing Subject To Change, Marcus Zerbst, IGe. LU conference, 3. Sept 2015 18

Testing → Every 5 th year is checked by a subject cataloger (12 years). • Inspection of correct attribution of subject terms to title • Inspection of correct and complete import to Aleph → By these measures several problems could be detected and eliminated. Subject To Change, Marcus Zerbst, IGe. LU conference, 3. Sept 2015 19

Problems identified → Form/type heading «Online Publication» might be wrong and so was eliminated in general → LCSH: 650_0 not identical to 65000: Import of non LCSH subjects in various languages – not intended → Music material (notes etc. ) without ISBN tend to bring bad results, so were eliminated. Subject To Change, Marcus Zerbst, IGe. LU conference, 3. Sept 2015 20

Assumed issues → 000080919 650 0 L $$a. Physics$$x. Early works to 1800 → 000080919 650 0 L $$a. Physics$$y. Early works to 1800 → 000196066 651 0 L $$a. Switzerland$$v. Bibliography → 000196066 651 0 L $$a. Switzerland$$x. Bibliography → 000229817 650 0 L $$a. Administrative law$$v. Cases$$z. Switzerland → 000229817 650 0 L $$a. Administrative law$$z. Switzerland$$v. Cases → 000229817 650 0 L $$a. Administrative law$$z. Switzerland$$x. Cases Subject To Change, Marcus Zerbst, IGe. LU conference, 3. Sept 2015 21

Assumed issues → 000080919 650 0 L $$a. Physics$$x. Early works to 1800 → 000080919 650 0 L $$a. Physics$$y. Early works to 1800 → 000196066 651 0 L $$a. Switzerland$$v. Bibliography → 000196066 651 0 L $$a. Switzerland$$x. Bibliography → 000229817 650 0 L $$a. Administrative law$$v. Cases$$z. Switzerland → 000229817 650 0 L $$a. Administrative law$$z. Switzerland$$v. Cases → 000229817 650 0 L $$a. Administrative law$$z. Switzerland$$x. Cases Subject To Change, Marcus Zerbst, IGe. LU conference, 3. Sept 2015 22

Numbers and Statistics Subject To Change, Marcus Zerbst, IGe. LU conference, 3. Sept 2015 23

Statistics → Records sent: 2. 5 million → Records enriched: 1. 8 m • Matches by ISBN: 1. 45 m → Enrichment: • GND: 1. 12 m • DDC: 1. 33 m • LCSH: 1. 21 m Subject To Change, Marcus Zerbst, IGe. LU conference, 3. Sept 2015 24

Processed / Enriched Titles Subject To Change, Marcus Zerbst, IGe. LU conference, 3. Sept 2015 25

Match Types from Total Match

Subject Types from Success

Prospect Subject To Change, Marcus Zerbst, IGe. LU conference, 3. Sept 2015 28

Project FRED – automatic daily enrichment → Trigger • On item creation or • On item arrival → Continuous search for external data • until final edit by subject specialist or • item status is «loanable» → Stop flag • by subject specialists or • during final item handling → Subjects are imported to Aleph, CAT field → Different start and stop flags for ebooks Subject To Change, Marcus Zerbst, IGe. LU conference, 3. Sept 2015 29

Conclusion → Just started to load enrichment → Success and acceptance yet to be discovered → High demand of automatic processes → Changes in tasks and function of subject specialists → Reduced demand in larger community environment expected Subject To Change, Marcus Zerbst, IGe. LU conference, 3. Sept 2015 30