Dissemination technologies for population and housing censuses Ilpo

Dissemination technologies for population and housing censuses Ilpo Survo, United Nations ESCAP, Bangkok, survo. unescap@un. org for UNECE Training Workshop on Census Technology for SPECA member countries, Astana, 7 -8 June 2007 1

Content A. Changing IT environment and its impact on dissemination B. Today’s technologies for data dissemination C. Sample applications and additional topics 2

A. Changing IT environment and its impact on dissemination 3

Trends 1/3 – Today’s applications are • Inter-connected • Mobile but location-specific • Visually attractive • Interactive • User-friendly • Fast 4

Trends 2/3 - Standards development • Statistical standards – More complex and comprehensive standards – Quality and quantity of metadata – Convergence and harmonization of methodologies and metadata – Administrative data as source of official statistics • Data exchange standards – SDMX – Statistical Data and Metadata Exchange – DDI - Data Documentation Initiative – Dublin Core Metadata Initiative 5

Trends 3/3 - Technology and standards applied together • Increase productivity in all statistical, administrative and management operations • Provide seamless 24/7 access to data from anywhere • Allow differentiated access and charging options • Provide new content options • Facilitate flexible and diverse product development • Allow data interchange and update without manual intervention => Census organizations can focus on their primary business, such as measuring the change in the society for just and targeted policy making 6

Dissemination challenges • Changing the conventional dissemination mindset – Digital products are a must (image and service) – One-stop access to data irrespective which organizational unit produced the data – Outsourcing of selected parts of related IT • Human resources: recruitment, training, retention • Project management • Development of dynamic data retrieval/mining system • Graphical presentation of data • Map-based data presentation Census planning starts from clients and dissemination 7

Understanding clients 1/3 - Types of clients • Government • Ordinary interested citizens, students • Commercial users – Enterprises – Data re-packagers – Location-specific data users • National vs international users 8

Understanding clients 2/3 - Demanding users – Statisticians, scientists (metadata and microdata) – Technologically advanced users – Politicians – Other nationally important clients – International clients 9

Understanding clients 3/3 - Respondents as clients – Disseminating information about forthcoming census – Promoting use of forthcoming census – Providing feedback data to respondents 10

Understanding the value of census data • Uses of data today • Uses in future • Adding value by linking census data – With previous and future censuses – With other data sets • Surveys • Administrative data 11

Access, availability and realized use Data use can only take place if Data are posted on a web site AND Users know about it AND Users can find it when they need data AND Users can retrieve data where and when they need it AND Users understand data and are able to present it 12

Seeing the big picture and future needs • Documenting and preserving census data as part of cultural heritage • Documented and structured from the beginning is half -done • User friendliness in a broad sense: access and presentation 13

B. Today’s technologies for data dissemination 14

Understanding available technologies Traditional publishing concepts are outdated IT is a tool and only the sky is the limit Classification of dissemination technology • Passive => active • Offline => online • Static => dynamic • Non-Internet => Internet • Push => pull • Analogue, print => digital • Sending files manually => automatic web services 15

Developing a dissemination website – Architecture • Separate from production and business critical applications and databases • Structure and clarity through classification and navigation – Global navigation elements – Content/subject-sensitive navigation elements – Local elements • Database-driven data and metadata display • Tracking user access and behaviour 16

Developing a dissemination website – Web pages 1/3 • General principles – Physical size of the page – Resolution-independent design – Browser-independent design – Consistency across the site – style sheets 17

Developing a dissemination website – Web pages 2/3 • Static pages – For frequently accessed information – small pages for speed – For stable information • Documents, publications • Fixed tables, graphs, maps • Organizational information – Simple to create, laborious to keep up-to-date – Generally not for large volumes of data 18

Developing a dissemination website – Web pages 3/3 • Dynamic pages – Require expertise to create – Maintenance effort is low compared to volume of data – Flexible database access through drop-down lists – Web-enabled tabulation – Dynamic graphic presentation 19

Developing a dissemination website - Responsibilities • Technical development strategy required today – Use third-party expertise if needed • Representative editorial board – responsible for – Site structure – Site functionality – Procedures for the site updates – Content – Layout • Subject-matter specialists responsible for updating their content • Technical maintenance and development by IT department 20

Developing a dissemination website – Organization’s image • Web site is today one of the most important image creators of an organization • Bad presentation spoils good intentions and turns users away • Present statistics according to the needs of various user groups – Search and navigation – Integrate data from different collections, including from the past • Keep up-to-date, include posting date • Include links to other official statistics and relevant third parties to demonstrate relevance, and cooperation and service attitude 21

Developing a dissemination website – Metadata • A centralised database is a preferred way for maintaining metadata – Ensures consistency across data holdings – Manage definitions, methodology information, variable information, data collection information in one place – Approach useful for planning, data collection, processing, analysis and dissemination 22

Developing a dissemination website – Graphical presentation - Maps • Maps are ideal for presenting census results on the web – UN Second Administrative Level Boundaries data set project (SALB, http: //www. who. int/whosis/database/gis/salb_home. htm) – Examples of maps 23

Developing a dissemination website – Graphical presentation – Charts (1/2) • SVG - open standard for scalable vector graphics – Language for describing text-based two-dimensional vector graphics and graphical applications in XML, http: //www. w 3. org/Graphics/SVG/, http: //www. adobe. com/svg/ – Web browsers integrate SVG viewer as a plug-in – Also for mobile phones – Open source and commercial editors, e. g. • GLIPS Graffiti • Adobe Illustrator • A number of importers, exporters and converters 24

Developing a dissemination website – Graphical presentation – Charts (2/2) • Flash - animation and interactivity • Gapminder, http: //www. gapminder. org/ • OECD/ISTAT Seminar on Dynamic Graphics for Presenting Statistical Indicators, http: //www. oecd. org/document/26/0, 2340, en_21571361_319383 49_38241306_1_1, 00. html 25

Discussion: Feasible dissemination technology for the 2010 round census 26

C. Sample applications and additional topics 27

Selected applications • Dev. Info, http: //www. devinfo. org/ • PC-Axis and PX-Web, http: //www. pc-axis. scb. se/ • Super. STAR software suite, http: //www. str. com. au/ • Beyond 20/20, http: //www. beyond 2020. com/ 28

Advanced topic – SDMX • Statistical Data and Metadata Exchange • Statistical community defines tags and structured template • Data provider uses XML to describe and structure data and metadata and makes available on a web server • Data collectors fetch the data at their initiative • See – UN Comtrade, http: //comtrade. un. org/db/help/Comtrade. SDMX. aspx – SDMX sponsors, http: //www. sdmx. org/ 29

Advanced topic – Web services • ‘Web service’ is software system designed to support interoperable machine-to-machine interaction over a network • XML-based automatic data update • Suitable for frequently changing data, such as short term indicators • Examples – UN ECLAC trade data from Comtrade, http: //www. eclac. org/estadisticas/ – Other 30

Additional topic - Understanding the cost of dissemination technology • Cost for not disseminating – Data not used are the most expensive data – If nobody uses the results, do not collect the data • Investing on productivity and better services • NSO dissemination vs. national dissemination • Cost savings measures – Key results in print, detailed in electronic format – Standardize and integrate agency-wide databases and dissemination applications, incl. web content creation – Use open source and free applications, but note that they have a cost involved – Negotiate and use bargaining power to reduce cost of licences 31

Thank you! 32