Update on UDFR Unified Digital Format Registry NDIIPP

Update on UDFR (Unified Digital Format Registry) NDIIPP Meeting June 25, 2009 Andrea Goethals

Today’s agenda • Why do we need a format registry for digital preservation? • UDFR background and process

Why do we need a format registry for digital preservation?

Usability • A key goal of digital preservation is to maintain the usability of the information content stored in digital form • We need to be able to: – Determine if it’s already or likely to become unusable – Make plans to take action if its already or likely to become unusable

Using information content information HW (paper) content information content symbols bits formats SW HW language HW (paper) Analog book Digital book Unmediated use Technology-mediated use

s te up ch p no ort lo ing gi es d co igi nt tal en t Formats are key to determining usability information content bits formats SW HW Formats are the bridge between the content we want to preserve and supporting technologies

How do we know if it’s usable? 1. Determine content’s format 2. Based on format, assess content – What current technologies can render this format? – Are there sustainability issues related to this format? – How is this format viewed by the preservation community?

What do we do if its unusable? • Based on the format, develop plan for action – What alternative formats could be used for the content? – What software can transform between these formats? – What technologies can emulate this format? – Is there enough documentation to write a renderer for this format?

Format registry: pooled knowledge Repository A • What current technologies can render this format? Repository C • Are there sustainability issues related to this format? For these formats… • How is this format viewed by the preservation community? For these formats… • What alternative formats could be used for the content? Repository B For these formats… • What software can transform between these formats? • What technologies can emulate this format? • Is there enough documentation to write a renderer for this format? Repository D For these formats…

Format Registry • Format information + much more • Common format model & identifiers

A base for a network of preservation tools and services Repository C Assessment Services Format Transformation Tools Repository A Tech. Watch Services Format Registry Migration Services Format Validation Tools Repository D Repository B Format Identification Tools Emulation Services

UDFR background and process

Unified Digital Format Registry • Combination of two format registry initiatives – PRONOM (UK National Archives) • Make use of software and reuse data – Global Digital Format Registry (GDFR) • Support use cases, data model and distributed architectural model • Plus additional features – Local registry extensions – Distributed data input & quality vetting

UDFR Governance • Interim governing body (April - Nov. 2009) –Library and Archives Canada –The National Archives UK –Harvard University Library –The British Library –University of Illinois UC –Georgia Institute of Technology –NARA –Koninklijke Bibliotheek –Library of Congress • Permanent governing body (Nov. 2009 -)

Interim Process: 2 working groups • Technical working group – Subset of interim governing body members + some additional experts/consultants • Governance working group – All interim governing body members

Schedule • Have a 1. 5 year roadmap • It’s very ambitious! Maybe too ambitious?

June-September 2009 • Technical Working Group – Use cases / functional requirements – Data model – Investigate technologies for distributed data input – Phase 1 registry requirements – Phase 1 development plan

June-September 2009 • Governance Working Group – Organizational structure – Financial model – Registry operations – Membership constraints and responsibilities – IP policy for registry software and data

September – October 2009 • Invitation for public comment on: – Proposed governance charter – Proposed registry policy for IP – UDFR Phase 1 functional requirements – UDFR Phase 1 development plan

October 2009 • Technical working group – Oversee technical specification development • Governance working group – Proposal for editorial process for vetting contributed data

November 2009 • Permanent governing body established – Establishes funding model – Takes over all interim body work – Revises schedule if necessary • UDFR Phase 1 development begins

According to plan… • • Feb. 2010: UDFR Phase 1 ready for testing March 2010: UDFR Phase 1 in production June 2010: UDFR Phase 2 ready for testing July 2010: UDFR Phase 2 in production – Includes editorial process for data contributions

Questions? • http: //www. udfr. org • Pam Armstrong (pam. armstrong@lac-bac. gc. ca) • Andrea Goethals (andrea_goethals@harvard. edu)