Metadata Management Case Study Date 10212008 M D
























- Slides: 24
Metadata Management Case Study Date: 10/21/2008 M D Metadata Solutions Dan Mc. Creary President Dan Mc. Creary & Associates dan@danmccreary. co 1 m Copyright 2008 Dan Mc. Creary & Associates
Overview • • The Challenge Why XRX is an Ideal Solution Screen Images Results M D 2 Copyright 2008 Dan Mc. Creary & Associates
Gartner on Metadata cast into formal logics will drive interoperability, automation, cost cutting, better search capabilities and new business opportunities. Semantic Web Drives Data Management, Automation and Knowledge and Discovery Alexander Linder March 2005 G 00125145 M D 3 Copyright 2008 Dan Mc. Creary & Associates
The Challenge • Allow the business people (not the IT department or developers) to manage all aspects of metadata – Definitions – Approval – ISO/IEC Metadata Registry – Shopping Cart – Wantlist Management – Automatic Form Generation M D 4 Copyright 2008 Dan Mc. Creary & Associates
Semantic Triangle A pattern of neural activity in our brain Concept Refers To Symbolizes Symbol Referent Stands For M Physical Objects D “cat” “gato” (Spanish) “katze” (German) Ogden, C. K. , & Richards, I. A. (1923) The Meaning of Meaning 5 Copyright 2008 Dan Mc. Creary & Associates
Semantic Web Standards Stack Source: Tim Berners-Lee www. w 3 c. org Trusted Semantic Web Proof Ontology (OWL) Encryption Rules/Query Signature Logic RDF Model & Syntax XML Query XML URI/IRI M XML Schema Namespaces Unicode http: //www. w 3. org/Consortium/Offices/Presentations/Semantic. Web/34. html D 6 Copyright 2008 Dan Mc. Creary & Associates
Example of K-12 Registry M D 7 Copyright 2008 Dan Mc. Creary & Associates
A (meta) Data Registry Goal: create semantic maps to a federal & state metadata standard, not many standards R 2 RN R 3 R 7 R 6 M D RN R 4 R 7 NIEM R 6 R 5 Mapping from Minnesota's metadata registry to N other metadata registries: The O(N 2) problem NIEM R 5 R 2 R 3 R 4 Mapping from Minnesota's metadata registry to counties & federal The O(N) problem Copyright 2008 Dan Mc. Creary & Associates 8
Evolving Metadata Standards UML XML ISO/IEC 11179 MDR XML Doc ISO commercial schemas Federal XML Developer’s Guide (xml. gov) eb. XML Non-ISO schemas Public Schemas XLin k x. BRL GJXDM NIEM Federal XML Naming and Design Rules Federal Data Reference Model (DRM) Dept Stds. Division Stds M D Minnesot a Data Standard s UBL MOF XMI Future Standards (? ) CWM OASIS Standards ISO standards dominate most metadata registries Copyright 2008 Dan Mc. Creary & Associates 9
Minnesota Enterprise Technical Architecture M • Follow established Minnesota metadata standards D Copyright 2008 Dan Mc. Creary & Associates 10
Build an Inventory of Data Elements Sample Data Element M D 11 Copyright 2008 Dan Mc. Creary & Associates
Examples of Federal Meta Data Registries • • NIEM – National Information Exchange Model GJXDM – Global Justice XML Data Model eb. XML – Extensible Business XML UBL – Universal Business Language EPA – Environmental Protection Agency DOD – Department of Defense Metadata Registry x. BRL – XML Business Reporting Language M D 12 Copyright 2008 Dan Mc. Creary & Associates
Examples of Local Metadata Registries • Minnesota Department of Education Registry • Minnesota Department of Revenue Property Taxation Registry • Financial Institution M D 13 Copyright 2008 Dan Mc. Creary & Associates
Property Taxation Example M D 14 Copyright 2008 Dan Mc. Creary & Associates
Example: NIEM. gov Fill your shopping cart with Data elements M D Easily create subschemas for different needs Copyright 2008 Dan Mc. Creary & Associates 15
Registry helps track data source mapping Table Column Metadata Registry A OLTP RDBMS Table Column Data Warehouse • Local Registry or database M D • • Registry data elements can map to one or more data sources. Concepts usually map to tables and properties map to columns. Mappings can be used to facilitate transfers Mapping can be stored directly in the registry Tools are frequently used to create initial mappings Organizations can create mappings between their internal systems and a central metadata registry 16 Copyright 2008 Dan Mc. Creary & Associates
Requirements & data needs Metadata Registry Workflow Funnel Glossary Of Terms Draft Data Elements Create the Registry • • • Define your glossary and data elements Review & make changes Approve & publish by stakeholders Review & Edit Approve The registry defines the data we exchange and keeps our need for code changes to a minimum Use the Registry • • Generate data schemas (XML) by selecting and organizing data elements Add new items to the registry as needs change 17 Copyright 2008 Dan Mc. Creary & Associates
Federated Search • Federation: When many different sources can return search results from a single search Search Business Terms Web. Site Terms RDMS Columns Data Elements ACORD Other Standards M D 18 Copyright 2008 Dan Mc. Creary & Associates
Federated Search Results M D 19 Copyright 2008 Dan Mc. Creary & Associates
Metadata Shopper M D 20 Copyright 2008 Dan Mc. Creary & Associates
Why XRX? • Metadata is complex • Many nested structures • Metadata needs to be quickly customized to meet the needs of different stakeholders • Data governance is a collaborative process M D 21 Copyright 2008 Dan Mc. Creary & Associates
Before XRX • Staffing/Skills – – – – XML Schemas XSLT to transform data elements into HTML DBAs to create RDBMS tables and indexes One or more Java Developers HTML Forms and Reports CSS Reporting tools (Crystal Reports etc) Limited form functionality (no AJAX) • Six people, 9 months $250, 000 to $500, 000 M D 22 Copyright 2008 Dan Mc. Creary & Associates
After XRX • Skills – XForms, REST and XQuery • Steps – Import data definitions from spreadsheets and XML sources – Create data element registry – Create shopping cart tools with XForms – Generate XML sub-schemas for importing into document exchanges – Higher quality user experience (suggest items) • One Person Three Months: $40, 000 M D 23 Copyright 2008 Dan Mc. Creary & Associates
Thank You! Please contact me for more information: • • • Metadata Management Metadata Registries Service Oriented Architectures Business Intelligence and Data Warehouse Semantic Web Native XML Databases Dan Mc. Creary, President Dan Mc. Creary & Associates Metadata Strategy Development dan@danmccreary. com (952) 931 -9198 M D 24 Copyright 2008 Dan Mc. Creary & Associates