Digital Preservation Reformatting FLICC Summer Institute 2009 James

Digital Preservation & Reformatting FLICC Summer Institute 2009 James Hodson Digital Conversion Specialist Preservation Reformatting Division Library of Congress

Digital Preservation & Reformatting What I Intend to discuss Provide an overview of digital preservation (DP) & reformatting issues Discuss how LC PRD handles digital reformatting Identify some useful resources for further information

Digital Preservation & Reformatting Digital Preservation: A Sisyphean Enterprise? “The failure of a digital preservation system will become evident in finite time, but is success will forever remain unproven. ” Rosenthal et. al. Diginews. Nov. 05, 2005.

Digital Preservation & Reformatting A “Big Picture” View includes: Individual and group awareness of risks, processes and best practices Institutional awareness, planning, and commitment. Business rules. Cultural awareness and cooperative arrangements Legal infrastructure to support DP & Reformatting Long-term financial support Technical standards and infrastructure

Digital Preservation & Reformatting Individual Intention and awareness Educating oneself as to risks, options Visiting sites and/or reading on the topic- suggestions later

Digital Preservation & Reformatting ARL’s View on Digital Preservation l. Findable…is it preserved? l. Completely replicated…is it preserved? l. Accurately replicated…is it preserved? l. Affordable…is it preserved? l. Usable…is it preserved? l. Verified…is it preserved? l. Adequately stored…is it preserved?

Digital Preservation & Reformatting Institutional Policies for Digital Preservation Acquisition Conversion Storage Migration Refreshing Repository Staff training and audit Funding for all of the above

Digital Preservation & Reformatting Cultural Issues: many players Internet Users Corporations- e. g. Google, Microsoft, Yahoo, Amazon, Apple, etc. Publishers Governments Libraries can influence, but not control what & how things become digital

Digital Preservation & Reformatting Legal & Social Issues Copyright and fair use http: //www. loc. gov/section 108/ Hidden Web Societal support for digital preservation Cooperative arrangements between institutions

Digital Preservation & Reformatting Costs Startup Operational ongoing Contingency costs Indirect costs Storage costs

Digital Preservation & Reformatting Risks to Digital Media failure Hardware failure Software failure Communication errors Network failure Media software, and hardware obsolescence Human error Natural Disaster

Digital Preservation & Reformatting More Risks to Digital Media External attack Bandwidth & Display Technology Evolution Internal attack Economic failure Organizational failure Funding failure Change of mission Failure to preserve (omission) Failure of preservation (commission)

Digital Preservation & Reformatting Trends in Storage Costs

Digital Preservation & Reformatting The Scale of what is at stake Print, film, magnetic and optical storage media produced about 5 exabytes of new information in 2002, the last year surveyed. 92% of the new information was stored on magnetic or optical media. Only 0. 01% is paper l. Source: How Much Information? 2003. lhttp: //www. sims. berkeley. edu/research/projects/how-much-info/

Digital Preservation & Reformatting The Effects of Technology Evolution & Change Bandwidth Monitors Storage File Formats Operating systems

Digital Preservation & Reformatting BANDWIDTH An an estimated 63% of US internet surfers had broadband access in April, 2009, according to the Pew Internet study. http: //www. pewinternet. org/

Digital Preservation & Reformatting Monitor Resolution

Digital Preservation & Reformatting FILE FORMATs l. LC’s Digital Preservation Website has looked at the sustainability of several digital file formats. lhttp: //www. digitalpreservation. gov/formats/intro/format_eval_rel. shtml

Digital Preservation & Reformatting Digital Preservation Methods Replication Migration Emulation Encapsulation Computer Museum “Digital Archaeology”

Digital Preservation & Reformatting From General to Specific: Preservation Reformatting at LC Program has existed for 10 years We have a hybrid and user-driven approach- preservation photocopies and digital only We function as a service bureau responding to preservation issues prioritized by various divisions of Library Services Largest focus has been embrittled materials identified by our Collections Access and Loan Division- especially Interlibrary Loan.

Digital Preservation & Reformatting Digital Preservation Reformatting at LC: Workflow Divisions respond to an annual call for services Some on-demand requests are also handled as possible throughout the year Items are evaluated, repaired or prepared for scanning If items are in copyright, preservation photocopies are made If copyright does not apply, digital files are produced (or both) as requested They are sent to scan centers, internal or external (outsourced) Upon return, items are reviewed, then put on servers for page-turner display. We also create a searchable, accessible PDF. Handles are produced Both page-turners and PDFs are permanently linked from the catalog.

Digital Preservation & Reformatting Digital Preservation Reformatting at LC: Examples A typical monographic Interlibrary loan exiample: http: //catalog. loc. gov/cgi-bin/Pwebrecon. cgi? DB=local&CMD=lccn+%2280458057%22&CNT=10+records+per+page A recently new serials example: http: //lcweb 2. loc. gov/diglib/vols/loc. gdc. sr. sn 82007064/default. html If a preservation photocopy, the original is boxed and usually put into remote high-density storage at our Ft. Meade facility.

Digital Preservation & Reformatting Library of Congress Sites –http: //www. digitalpreservation. gov/ –http: //memory. loc. gov/ammem/about/tech. In. html –http: //www. loc. gov/ndnp/index. html –http: //www. loc. gov/preserv/prd/

Digital Preservation & Reformatting l. OCLC –http: //www. oclc. org/services/collection/default. htm l. Council on Library and Information Resources (CLIR) –http: //www. clir. org/pubs/reports/pub 107/contents. html l. Institute of Museum and Library Services (IMLS) –http: //www. imls. gov/about/digital. Corner. shtm –Digital Library Federation (DLF) –http: //www. diglib. org/preserve. htm l. Joint Information Systems Committee (JISC)(UK) –http: //www. jisc. ac. uk/whatwedo/topics/digitalpreservation. aspx l. NARA Electronic Records Archiving (ERA) –http: //www. archives. gov/era/papers/thic-04. html –National Library of Australia –http: //www. nla. gov. au/preserve/digipres/

Digital Preservation & Reformatting Guides to Standards for Digital Reformatting Digital Library Federation –http: //www. diglib. org/produce. htm Library of Congress (American Memory, NDNP, ) –http: //memory. loc. gov/ammem/about/tech. In. html –http: //www. loc. gov/ndnp/techspecs. html –http: //www. loc. gov/standards/ (Overview) OCLC’s –http: //www. oclc. org/digitalpreservation/why/standards/default. htm California Digital Library Image Standards –http: //www. cdlib. org/inside/diglib/guidelines/bpgimages/

Digital Preservation & Reformatting QUESTIONS?