31 March 2000 Wendy Watkins INTRODUCTION DLI ORIENTATION

31 March, 2000 Wendy Watkins

INTRODUCTION DLI ORIENTATION PROGRAM 31 March, 2000 Wendy Watkins EDMONTON, DECEMBER 5, 2001

DLI ORIENTATION PROGRAM GOLDILOCKS AND THE THREE BEARS 31 March, 2000 Wendy Watkins EDMONTON, DECEMBER 5, 2001

Chuck - POPPA BEAR 31 March, 2000 Wendy Watkins

Elizabeth - MOMMA BEAR 31 March, 2000 Wendy Watkins

Garth - BABY BEAR 31 March, 2000 Wendy Watkins

Mike - …!!! 31 March, 2000 Wendy Watkins EDMONTON, DECEMBER 5, 2001

31 March, 2000 2001 Wendy Watkins

31 March, 2000 Wendy Watkins

The Need to Liberate The Data 31 March, 2000 Wendy Watkins EDMONTON, DECEMBER 5, 2001

Why the heck do we need a DLI? 31 March, 2000 Wendy Watkins

The Need to Liberate The Data n n Historically Stats Canada made published data available to public through the DSP These were regular paper publications and did not include electronic numeric files (ie. Public use micro data files) Data files were available to researchers at marginal costs Custom tables were another, more costly, method to access unpublished data 31 March, 2000 Wendy Watkins

The Need to Liberate The Data n n n In 1980’s federal budget cuts resulted in Stats Canada’s increased emphasis on cost recovery In early 1990’s the cost of public use microdata files underwent a dramatic increase This pushed most data files became out of reach for majority of academic researchers & students 31 March, 2000 Wendy Watkins

The Need to Liberate The Data n The cost of Stats Canada data in the late 80’s and early 90’s can be compared to the gas prices of just a few months ago. To many academic researchers and students these files cost. . . 31 March, 2000 Wendy Watkins

The Need to Liberate The Data n n A consortium of universities had been created to gain access to 1986 Census data This idea was well received by STC and led to a movement within academic community to Liberate the rest of STC’s electronic datafiles A paper in 1991: “Liberating the Data: Proposal for a Proposal” led to a working group to further investigate this idea Group made up of reps. from: universities, SSFC, CARL, CAPDU, as well as STC and DSP 31 March, 2000 Wendy Watkins

The Need to Liberate The Data n n n Champions within both the academic community and Statistics Canada came forth to push this idea Informal approval was received in 1995 This was followed by the creation of: An internal STC Steering Committee A Project Team An External Advisory Committee n n n 31 March, 2000 Wendy Watkins

The Need to Liberate The Data n n A Licence Agreement was drafted and approved Author divisions were asked to provide there data to the Initiative Institutions were invited to join the initiative Other Gov’t agencies became involved and formal approval for 5 -year pilot received from Treasury Board in early 1996 31 March, 2000 Wendy Watkins

The Need to Liberate The Data n n n Funding for initiative was to be mostly from participating institutions with CARL members paying $12, 000 and CASUL members paying $3, 000 One time funding from: TB, IC, MRCC A 5 year funding commitment from: HC, HRDC, SSHRC, STC 31 March, 2000 Wendy Watkins

The Need to Liberate The Data Use of Internet as a dissemination tool seen as a key component of initiative Established mechanisms for communications, storage, finding and ordering data Created an FTP Site at STC DLILIST - a forum for questions and sharing of information DLIORDER & WWW DLI ORDER DESK - for placing orders for products not on the FTP site Began disseminating files in 1996 31 March, 2000 Wendy Watkins n n n

The Need to Liberate The Data n n Before DLI about 15 institutions offered a data service Therefore co-operative training of members was seen as an extremely important aspect due to varying degrees of experience of members. Established a training committee and began to develop a curriculum, identify trainers, establish budgets Regional training workshops were begun in 1997 31 March, 2000 Wendy Watkins

The Need to Liberate The Data n n Training workshops have been given in each region on an annual basis since then Have just had a review of training and a report was presented to EAC last fall One suggestion was to have another Orientation session for new members who missed the one in 1997 This workshop and this special Orientation session part of continuing co-operative training 31 March, 2000 Wendy Watkins

The Need to Liberate The Data n n n In 1996 there were 50 post secondary members In 1998 there were 61 Today there are 66 members There are over 13, 000 files in the DLI collection including data files, documentation, CD’s etc. Can now access the collection via DLI Web Site as well as FTP 31 March, 2000 Wendy Watkins

The Need to Liberate The Data n n n The DLI is now a permanent program at Stats Canada located within the Library and Information Centre Today’s graduates have had the opportunity to use Canadian data throughout their studies The DLI has been described as one of the most important developments in the social sciences in Canada for the past 50 years! 31 March, 2000 Wendy Watkins

31 March, 2000 Wendy Watkins

What is The Data Liberation Initiative? 31 March, 2000 Wendy Watkins DECEMBER , 2001 EDMONTON,

n The Products n The Licence n The Service n The Community 31 March, 2000 Wendy Watkins

THE PRODUCTS n n n DLI provides access to Stats Canada data produced as standard electronic products available to the public These data are digitally encoded and stored in a file structure These include: Micro data Files n Geography Files n Databases 31 March, 2000 Wendy Watkins n Aggregate data in table format n

THE PRODUCTS n Main focus of DLI Collection on Socio. Economic data: n n n n Health Education, Literacy Labour Market, Income Travel Justice Census, Demographic Etc. 31 March, 2000 Wendy Watkins

THE PRODUCTS n n n Few products related to Business data in DLI Collection Not usually produced as a standard electronic product for public dissemination DLI includes some business products such as: Trade data n Financial Performance Indicators CD n Inter-Corporate Ownership n Fleet Report 31 March, 2000 Wendy Watkins n Survey of Manufacturing n

THE PRODUCTS Standard Electronic Product n An “off the shelf ” electronic product available to the public n Not included are standard publications available in electronic form as these are usually part of DSP n Registered in STC Catalogue of Products and Services and has a Product Number 31 March, 2000 Wendy Watkins

THE PRODUCTS l l 82 F 0077 XIE Report on smoking prevalence in Canada 82 -003 -XPB 980034138 Attitudes toward smoking First 2 characters = Major Subject Group Third character = Product Class (e. g. F = Fixed, M = Microdata product, C = Custom product, etc) Fourth - seventh Wendy character = unique product Watkins l 31 March, 2000

THE PRODUCTS l l 82 F 0077 XIE Report on smoking prevalence in Canada 82 -003 -XPB 980034138 Attitudes toward smoking Eighth character = variable descriptor (e. g. . P = Preliminary, U = Update, X = Not Applicable, G = Guide, etc) Ninth character = medium (e. g. . T = tape, D = diskette, I = Internet, C = CD, etc) 31 March, 2000 Wendy Watkins

THE PRODUCTS l 11 -008 -XPE 960032868 Youth smoking in Canada This article was published in Canadian social trends, catalogue number 11 -008 -XPE, Winter 1996 no. 43 l l 82 M 0011 XDB Youth Smoking Survey, 1994 82 M 0011 GPE Youth Smoking Survey, 1994 Microdata user's guide 31 March, 2000 Wendy Watkins

THE PRODUCTS n n n Metadata available in both Official Languages whenever available New data products continually being added to Collection Includes: n n n Updated data from regular on-going surveys Data from ad-hoc special surveys -one time only Data from new surveys in STC program 31 March, 2000 Wendy Watkins

THE PRODUCTS n Updates may be provided in different format than earlier version: n n n For example PUMF Beyond 20/20 As new versions are received have to decide to either replace data or add to Collection Over 13, 000 files in Collection including: Data files n Metadata & Readme files n Census & Geography 31 March, 2000 Wendy Watkins n CD’s n

THE PRODUCTS n n n Not all products in DLI Collection are standard electronic products Have some “special” products just for DLI which contain non-public data: KLEMS database n n An experimental database of productivity data Justice Statistics n Complete set of Beyond 20/20 tables normally only available to members of CCJS Initiative 31 March, 2000 Wendy Watkins

THE PRODUCTS n n No longer included in the DLI Collection are: E-STAT n n n Received CD once per year E-STAT now free on-line to subscribing institutions CANSIM received a CD of CANSIM once a year n With introduction of CANSIM II this no longer happens n CANSIM data included 31 March, 2000 Wendy Watkins on E-STAT n

THE LICENCE n n DLI is open to all accredited Post Secondary Institutions in Canada Data made available on a subscription basis All member institutions must sign a Licence Agreement Data made available to Educators, Students and Other Staff while they have such status at the Institution E. g. . A student who goes to USA to do Masters 31 March, 2000 Wendy Watkins no longer has access to data n

THE LICENCE n Data is made available for: n n n Academic Research and Publishing Teaching Planning of academic/educational services Use of data in textbooks falls under a different set of STC licences and permissions n Data not to be used in any commercial or private activities (even if no $$ involved) n DLI Contact responsible to ensure eligible 31 March, 2000 Wendy Watkins use of data n

31 March, 2000 Wendy Watkins

THE LICENCE Other questions to help determine if use falls under definition of academic research n If publishing - is use strictly for publishing in academic or scholarly journal? n Is use under a contract with outside agency/organization? - Any $$ involved? n Do $$ come thru institution’s “grants dept”? n Even if no $$ involved did contract come thru regular institutional channels? 31 March, 2000 Wendy Watkins n Is data expected to be shared with outside n

THE LICENCE Other important elements of the Licence Agreement: n Data & products offered “as is “ n STC remains owner of intellectual property only access to data is provided n Users must not link data or otherwise try to identify individual respondents n DLI Contact to implement data security measures 31 March, 2000 Wendy Watkins n

THE LICENCE Plans to create document on Web to address more common data use elegibility questions n Have gathered all questions since 1996 n This to be done as soon as time and resources permit n Until then if unsure send message to Team for consideration n All questions reviewed by DLI Manager & Director as well Wendy as Co-Chairs of EAC 31 March, 2000 Watkins n

THE LICENCE n n n In process of finalizing new Licence Agreement to reflect move from pilot to permanency This to be sent to Library Directors soon Until then will continue to operate under original Licence Agreement 31 March, 2000 Wendy Watkins

THE SERVICES DLI was conceived to be a Internet based means of dissemination - internet the main mode of data transfer and communications n DLI Team offers both an FTP and a Web based service for access to Collection n DLILIST - forum for making enquires, sharing of information and general communication between and among members n DLIORDER & WWW DLI ORDER 31 March, 2000 Wendy Watkins DESK - processes to order hard copy n

THE SERVICES The DLI Team n DLI activities at STC are performed by a small Team situated in the Library and Information Center - currently there are 6 members on the Team n Have just lost one Team member who was responsible for Liaison/Communications and whose duties included: Responding to enquires in DLILIST 31 March, 2000 Wendy Watkins n Liaison with author divisions n

THE SERVICES n n n Other Team members include: André Blondin Responsible for: n n Quality Control of data and metadata Maintenance of FTP site directories Loading of files on FTP site Overseeing creation of SPSS 31 March, 2000 Wendy Watkins

THE SERVICES n André Blondin 31 March, 2000 Wendy Watkins

THE SERVICES n n n Other Team members include: Christiane Rousseau Responsible for: n n n Assistant Liaison/Communication DLIORDER/WWW DLI ORDER DESK and hardcopy products Maintaining library of CD’s and print documentation 31 March, 2000 Wendy Watkins

THE SERVICES n Christiane Rousseau 31 March, 2000 Wendy Watkins

THE SERVICES n n n Other Team members include: Roger Arsenault Responsible for: n Creation and validation of SPSS 31 March, 2000 Wendy Watkins

THE SERVICES n Roger Arsenault 31 March, 2000 Wendy Watkins

THE SERVICES n n n Other Team members include: Marie Josée Bourgeois Responsible for: n n Web page creation and development Web links to data and metadata 31 March, 2000 Wendy Watkins

THE SERVICES n Marie Josée Bourgeois 31 March, 2000 Wendy Watkins

THE SERVICES n n n Other Team members include: Jackie Godfrey Responsible for: n n Project on-line infrastructure Data security i. e. . Passwords, IP validation, etc FTP & Web listservs 31 March, 2000 Wendy Watkins

THE SERVICES 31 March, 2000 Wendy Watkins

THE SERVICES n Others who are connected to Team n Anne Chartrand - Administrative Assistant n n Carole Paradis - Cataloguing of DLI Collection Ernie Boyko - Director of Library 31 March, 2000 Wendy Watkins

31 March, 2000 Wendy Watkins

THE SERVICES Although the Licence states “as is “ this is not really the case n When a product is received by Team a number of steps are performed before it is placed in the Collection: n First of all check to ensure that all files data, metadata (French & English) have been received n Open each file to ensure it is what it says it is 31 March, 2000 Wendy Watkins (e. g if a. DOC then file is a WORD file, etc) n

THE SERVICES n Run program against data file to verify: n n n Number of records Record length Overall size of file Compare results against codebook and/or record layout n If SAS and/or SPSS received run against file n If no SPSS - create it Rename all files Wendy to conform to DLI standards 31 n March, 2000 Watkins n

THE SERVICES n n n Create FTP path & directories Create Readme file Load all files into appropriate place Update all related Web pages ( Site Additions, List of Products, Product Release Table and Web Site page, etc. ) Announce addition on DLILIST 31 March, 2000 Wendy Watkins

THE SERVICES To help users keep track of receipt of product we have Product Release Table on Web n When data availability announced in Daily we add product to table n Must first ensure that a DLI product (e. g. PUMF) will be produced n Contact division to determine date of release of PUMF n Monitor and update Product Release Table 31 March, 2000 Wendy Watkins on ongoing basis n

31 March, 2000 Wendy Watkins

THE SERVICES The Daily is the official release vehicle of STC n All data must first be announced in Daily before being disseminated to public n Data announced in Daily does not mean that a public file is available n Could just be an announcement of data availability - i. e. for custom requests n Look at DLI Update of Fall 2000 for a 31 March, 2000 Wendy Watkins n

31 March, 2000 Wendy Watkins

THE SERVICES DLI Update n A newsletter designed as a means to inform, teach and share information containing articles written by various DLI Contacts and Team members n Produced by Liaison/Communications Officer n Originally intended to be produced on a semi - regular basis (there were 3 in 1997, 2 in 98, 31 March, 2000 Wendy Watkins 1 in 99 and 2 in 2000)

THE SERVICES SPSS n Many files have not come with SPSS descriptions - these are created by DLI Team n Often older files do not have French versions of documentation so extremely difficult to create French SPSS n Creation of these SPSS labels can take some time after receipt of documentation, depending on workload, size of file, and if 31 March, 2000 Wendy Watkins any documentation in electronic format

THE SERVICES SPSS n Starting to receive some kind of SPSS descriptors from author divisions n If and when SPSS supplied by author division they can require major editing to fit with “DLI Users” requirements (e. g. length of variable and value labels) n The preparation of SPSS is a major undertaking and the DLI Team expends 1+ 31 March, 2000 Wendy Watkins FTE on this activity

THE SERVICES Training n DLI project subsidises annual Regional Training Workshops n DLI Web page will provide links to various training materials Team members assist in training workshops 31 March, 2000 Wendy Watkins if and when required n

THE SERVICES CA*NET 3 - new service being offered by DLI n A separate internet line connecting individual universities, federal & provincial government labs and research institutes through provincially based Regional Advanced Networks (RAN) n Developed by CANARIE and private industry and is the world’s first national 31 March, 2000 optical internet Wendy Watkins n

THE COMMUNITY The DLI is a partnership between Statistics Canada and the participating post secondary institutions n There are currently 66 member institutions (BCIT left but Red Deer College joined) n Have received enquiries from some CEGEP’s n We are thinking about foreign institutions with Canadian Studies programs 31 March, 2000 Wendy Watkins n

THE COMMUNITY Major activities and direction of project guided by members themselves through the External Advisory Committee (EAC) n EAC meets twice a year to review and discuss major issues n Co-Chairs are in frequent contact with DLI Manager and Director at STC n New governance document on EAC to be on Web soon 31 March, 2000 Wendy Watkins n

THE COMMUNITY n EAC made up of following academic members: Elizabeth Hamilton - UNB n Mary Mac. Leod - Acadia n Gaetan Drolet - Laval n Barbara Znamirowski - Trent n Wendy Watkins - Carleton (Co-Chair) n Mark Leggott - U of Winnipeg n Chuck Humphrey - U of Alberta (Co-Chair) 31 March, 2000 Wendy Watkins n Walter Piovesan - Simon Fraser n

THE COMMUNITY n Other voting members: n n n Bruno Gnassi - DSP Jeffery Smith - Asst Director Special Surveys Ernie Boyko - STC Mike Sivyer - STC Other participants include: Rest of DLI Team n Often invite members of different STC divisions to make presentations to EAC on their products, 31 March, 2000 Wendy Watkins etc. n

THE COMMUNITY There a number of advantages to belonging to DLI: n The DLI provides academic community with “one stop shopping” for SCT products at affordable prices n Provide a forum for sharing information and obtaining advice n Value added to basic STC products (e. g. SPSS) 31 March, 2000 Wendy Watkins n

31 March, 2000 Wendy Watkins

31 March, 2000 Wendy Watkins