Metadata Management Case Study Date 10212008 M D

  • Slides: 24
Download presentation
Metadata Management Case Study Date: 10/21/2008 M D Metadata Solutions Dan Mc. Creary President

Metadata Management Case Study Date: 10/21/2008 M D Metadata Solutions Dan Mc. Creary President Dan Mc. Creary & Associates dan@danmccreary. co 1 m Copyright 2008 Dan Mc. Creary & Associates

Overview • • The Challenge Why XRX is an Ideal Solution Screen Images Results

Overview • • The Challenge Why XRX is an Ideal Solution Screen Images Results M D 2 Copyright 2008 Dan Mc. Creary & Associates

Gartner on Metadata cast into formal logics will drive interoperability, automation, cost cutting, better

Gartner on Metadata cast into formal logics will drive interoperability, automation, cost cutting, better search capabilities and new business opportunities. Semantic Web Drives Data Management, Automation and Knowledge and Discovery Alexander Linder March 2005 G 00125145 M D 3 Copyright 2008 Dan Mc. Creary & Associates

The Challenge • Allow the business people (not the IT department or developers) to

The Challenge • Allow the business people (not the IT department or developers) to manage all aspects of metadata – Definitions – Approval – ISO/IEC Metadata Registry – Shopping Cart – Wantlist Management – Automatic Form Generation M D 4 Copyright 2008 Dan Mc. Creary & Associates

Semantic Triangle A pattern of neural activity in our brain Concept Refers To Symbolizes

Semantic Triangle A pattern of neural activity in our brain Concept Refers To Symbolizes Symbol Referent Stands For M Physical Objects D “cat” “gato” (Spanish) “katze” (German) Ogden, C. K. , & Richards, I. A. (1923) The Meaning of Meaning 5 Copyright 2008 Dan Mc. Creary & Associates

Semantic Web Standards Stack Source: Tim Berners-Lee www. w 3 c. org Trusted Semantic

Semantic Web Standards Stack Source: Tim Berners-Lee www. w 3 c. org Trusted Semantic Web Proof Ontology (OWL) Encryption Rules/Query Signature Logic RDF Model & Syntax XML Query XML URI/IRI M XML Schema Namespaces Unicode http: //www. w 3. org/Consortium/Offices/Presentations/Semantic. Web/34. html D 6 Copyright 2008 Dan Mc. Creary & Associates

Example of K-12 Registry M D 7 Copyright 2008 Dan Mc. Creary & Associates

Example of K-12 Registry M D 7 Copyright 2008 Dan Mc. Creary & Associates

A (meta) Data Registry Goal: create semantic maps to a federal & state metadata

A (meta) Data Registry Goal: create semantic maps to a federal & state metadata standard, not many standards R 2 RN R 3 R 7 R 6 M D RN R 4 R 7 NIEM R 6 R 5 Mapping from Minnesota's metadata registry to N other metadata registries: The O(N 2) problem NIEM R 5 R 2 R 3 R 4 Mapping from Minnesota's metadata registry to counties & federal The O(N) problem Copyright 2008 Dan Mc. Creary & Associates 8

Evolving Metadata Standards UML XML ISO/IEC 11179 MDR XML Doc ISO commercial schemas Federal

Evolving Metadata Standards UML XML ISO/IEC 11179 MDR XML Doc ISO commercial schemas Federal XML Developer’s Guide (xml. gov) eb. XML Non-ISO schemas Public Schemas XLin k x. BRL GJXDM NIEM Federal XML Naming and Design Rules Federal Data Reference Model (DRM) Dept Stds. Division Stds M D Minnesot a Data Standard s UBL MOF XMI Future Standards (? ) CWM OASIS Standards ISO standards dominate most metadata registries Copyright 2008 Dan Mc. Creary & Associates 9

Minnesota Enterprise Technical Architecture M • Follow established Minnesota metadata standards D Copyright 2008

Minnesota Enterprise Technical Architecture M • Follow established Minnesota metadata standards D Copyright 2008 Dan Mc. Creary & Associates 10

Build an Inventory of Data Elements Sample Data Element M D 11 Copyright 2008

Build an Inventory of Data Elements Sample Data Element M D 11 Copyright 2008 Dan Mc. Creary & Associates

Examples of Federal Meta Data Registries • • NIEM – National Information Exchange Model

Examples of Federal Meta Data Registries • • NIEM – National Information Exchange Model GJXDM – Global Justice XML Data Model eb. XML – Extensible Business XML UBL – Universal Business Language EPA – Environmental Protection Agency DOD – Department of Defense Metadata Registry x. BRL – XML Business Reporting Language M D 12 Copyright 2008 Dan Mc. Creary & Associates

Examples of Local Metadata Registries • Minnesota Department of Education Registry • Minnesota Department

Examples of Local Metadata Registries • Minnesota Department of Education Registry • Minnesota Department of Revenue Property Taxation Registry • Financial Institution M D 13 Copyright 2008 Dan Mc. Creary & Associates

Property Taxation Example M D 14 Copyright 2008 Dan Mc. Creary & Associates

Property Taxation Example M D 14 Copyright 2008 Dan Mc. Creary & Associates

Example: NIEM. gov Fill your shopping cart with Data elements M D Easily create

Example: NIEM. gov Fill your shopping cart with Data elements M D Easily create subschemas for different needs Copyright 2008 Dan Mc. Creary & Associates 15

Registry helps track data source mapping Table Column Metadata Registry A OLTP RDBMS Table

Registry helps track data source mapping Table Column Metadata Registry A OLTP RDBMS Table Column Data Warehouse • Local Registry or database M D • • Registry data elements can map to one or more data sources. Concepts usually map to tables and properties map to columns. Mappings can be used to facilitate transfers Mapping can be stored directly in the registry Tools are frequently used to create initial mappings Organizations can create mappings between their internal systems and a central metadata registry 16 Copyright 2008 Dan Mc. Creary & Associates

Requirements & data needs Metadata Registry Workflow Funnel Glossary Of Terms Draft Data Elements

Requirements & data needs Metadata Registry Workflow Funnel Glossary Of Terms Draft Data Elements Create the Registry • • • Define your glossary and data elements Review & make changes Approve & publish by stakeholders Review & Edit Approve The registry defines the data we exchange and keeps our need for code changes to a minimum Use the Registry • • Generate data schemas (XML) by selecting and organizing data elements Add new items to the registry as needs change 17 Copyright 2008 Dan Mc. Creary & Associates

Federated Search • Federation: When many different sources can return search results from a

Federated Search • Federation: When many different sources can return search results from a single search Search Business Terms Web. Site Terms RDMS Columns Data Elements ACORD Other Standards M D 18 Copyright 2008 Dan Mc. Creary & Associates

Federated Search Results M D 19 Copyright 2008 Dan Mc. Creary & Associates

Federated Search Results M D 19 Copyright 2008 Dan Mc. Creary & Associates

Metadata Shopper M D 20 Copyright 2008 Dan Mc. Creary & Associates

Metadata Shopper M D 20 Copyright 2008 Dan Mc. Creary & Associates

Why XRX? • Metadata is complex • Many nested structures • Metadata needs to

Why XRX? • Metadata is complex • Many nested structures • Metadata needs to be quickly customized to meet the needs of different stakeholders • Data governance is a collaborative process M D 21 Copyright 2008 Dan Mc. Creary & Associates

Before XRX • Staffing/Skills – – – – XML Schemas XSLT to transform data

Before XRX • Staffing/Skills – – – – XML Schemas XSLT to transform data elements into HTML DBAs to create RDBMS tables and indexes One or more Java Developers HTML Forms and Reports CSS Reporting tools (Crystal Reports etc) Limited form functionality (no AJAX) • Six people, 9 months $250, 000 to $500, 000 M D 22 Copyright 2008 Dan Mc. Creary & Associates

After XRX • Skills – XForms, REST and XQuery • Steps – Import data

After XRX • Skills – XForms, REST and XQuery • Steps – Import data definitions from spreadsheets and XML sources – Create data element registry – Create shopping cart tools with XForms – Generate XML sub-schemas for importing into document exchanges – Higher quality user experience (suggest items) • One Person Three Months: $40, 000 M D 23 Copyright 2008 Dan Mc. Creary & Associates

Thank You! Please contact me for more information: • • • Metadata Management Metadata

Thank You! Please contact me for more information: • • • Metadata Management Metadata Registries Service Oriented Architectures Business Intelligence and Data Warehouse Semantic Web Native XML Databases Dan Mc. Creary, President Dan Mc. Creary & Associates Metadata Strategy Development dan@danmccreary. com (952) 931 -9198 M D 24 Copyright 2008 Dan Mc. Creary & Associates