Data Management Body of Knowledge DMBOK Guide Introduction

Mark Mosley q Principal Consultant with EWSolutions q 25 years experience in data management q Member of the Chicago DAMA chapter q Certified Data Management Professional q Editor for DAMA Data Management Body of Knowledge (DMBOK©) Guide 2007/04/10 © DAMA International 2007 -- All Rights Reserved 2

Agenda q Our Maturing Profession q What is the DMBOK© Guide? q Who’s Involved? q What’s Been Done So Far? q What’s Still to Come? q How Can I Get Involved? 2007/04/10 © DAMA International 2007 -- All Rights Reserved 3

Our Maturing Profession q Data and information are increasingly recognized as enterprise assets. q Data management is the development, execution and supervision of plans, policies, programs and practices that control, protect, deliver and enhance the value of data and information assets. Data management is an important function for enterprises in the Information Age. Data management is a shared responsibility between business data stewards and data management professionals. Data management is a new and maturing profession – and DAMA is leading the way! q q q 2007/04/10 © DAMA International 2007 -- All Rights Reserved 4

Hallmarks of a Maturing Profession q A professional community q Continuing professional education q Professional certification q Higher education curriculum q A recognized Body of Knowledge Ø Standard terms and definitions Ø Standard processes, roles and deliverables Ø Guiding principles Ø Best practices 2007/04/10 © DAMA International 2007 -- All Rights Reserved 5

What Is a Body of Knowledge? q The collective experience of the profession q What is generally recognized as “true” q Large and constantly growing q Evolving Ø Acceptance, Improvement, Innovation q Summarized by a “Guide to the BOK” Ø 2007/04/10 Primer and Starting Point © DAMA International 2007 -- All Rights Reserved 6

What Is the DMBOK© Guide? q A Guide to the Data Management Body of Knowledge (DMBOK© Guide) q A book to be published by DAMA International q A project sponsored by The DAMA Foundation q Written and edited by DAMA members q An integrated view q A “definitive introduction” q Modeled after other BOK documents: Ø Ø PMBOK (Project Management Body of Knowledge) SWEBOK (Software Engineering Body of Knowledge) BABOK (Business Analysis Body of Knowledge) CITBOK (Canadian IT Body of Knowledge) 2007/04/10 © DAMA International 2007 -- All Rights Reserved 7

DMBOK © Guide Goals q To develop, build consensus and foster adoption for a generally accepted view of data management. q To provide standard definitions for data management functions, roles, deliverables and other common terminology. q To identify “guiding principles”. q To introduce widely adopted practices, methods and techniques, without references to products and vendors. q To identify common organizational and cultural issues. q To guide readers to additional resources. 2007/04/10 © DAMA International 2007 -- All Rights Reserved 8

DMBOK © Guide Audiences q q q q 2007/04/10 Data management professionals IT professional colleagues Data stewards Managers and executives Knowledge workers Consultants Educators Researchers © DAMA International 2007 -- All Rights Reserved 9

DMBOK © Guide Uses q q q q q Inform a diverse audience about data management Build consensus across the data management community Help all participants understand their responsibilities Point readers to additional sources of knowledge Help data management professionals prepare for Certified Data Management Professional (CDMP) exams Assist organizations in their enterprise data strategy Basis for effectiveness & maturity assessments Guide implementation & process improvement efforts Guide development of higher education curriculum Suggest academic research topics 2007/04/10 © DAMA International 2007 -- All Rights Reserved 10

Data Management Functions Meta Data Management Data Architecture, Analysis & Design Document, Record & Content Management Database Management Data Governance Data Warehousing & Business Intelligence Management Reference & Master Data Management 2007/04/10 Data Security Management Data Quality Management © DAMA International 2007 -- All Rights Reserved 11

Function Scope Summary 2007/04/10 © DAMA International 2007 -- All Rights Reserved 12

Data Governance & Stewardship Data Architecture, Analysis and Design Data Quality Management Reference & Master Data Management Database Management Data Security Management Data Warehousing & Business Intelligence Management Data Mgmt Services Data Stewardship Data Governance Document, Record & Content Management Meta Data Management 2007/04/10 © DAMA International 2007 -- All Rights Reserved 13

The DMBOK © Functional Framework q 9 Data Management Functions q Decomposed into many Activities Ø Planning Activities Ø Control Activities Ø Development Activities Ø Operational Activities q Activities result in Deliverables q Activities performed by Roles 2007/04/10 © DAMA International 2007 -- All Rights Reserved 14

DMBOK Activity Outline… 1. Data Governance 1. Data Management Planning 1. 2. 3. 4. 5. 6. 7. 8. 9. 2. Identify Strategic Enterprise Data Needs (P) Develop and Maintain the Data Strategy (P) Establish the Data Management Professional Organizations (P) Identify and Appoint Data Stewards (P) Establish Data Governance & Stewardship Organizations (P) Develop, Review and Approve Data Policies, Standards and Procedures (P) Review and Approve Data Architecture (P) Plan and Sponsor Data Management Projects and Services (P) Estimate Data Asset Value and Associated Costs (P) Data Management Supervision and Control 1. 2. 3. 4. 5. Supervise the Data Management Professional Staff and Organizations (C) Coordinate Data Governance Activities (C) Manage and Resolve Data Related Issues (C) Monitor and Ensure Regulatory Compliance (C) Communicate, Monitor and Enforce Conformance with Data Policies, Standards, Procedures and Architecture (C) 6. Oversee Data Management Projects and Services (C) 7. Communicate and Promote the Value of Data Assets (C) 2007/04/10 © DAMA International 2007 -- All Rights Reserved 15

DMBOK Activity Outline… 2. Data Architecture, Analysis and Design 1. Enterprise Data Architecture 1. 2. 3. 4. 5. 6. 7. Develop the Enterprise Data Model (P) Align with Other Business Models (P) Define the Database Architecture (P) (same as 3. 3. 2) Define the Data Integration / MDM Architecture (P) (same as 6. 2) Define the Data Warehouse / BI Architecture (P) (same as 7. 2) Define the Metadata Architecture (P) (same as 9. 2) Define Enterprise Taxonomies and Namespaces (P) 2. Data Modeling and Specification 1. Define Information Needs (D) 2. Develop and Maintain Logical Data Models (D) 3. Develop and Maintain Physical Data Models (D) 3. Data Model Quality Management 1. Develop Data Modeling Standards (P) 2. Review Data Model Quality (C) 3. Manage Data Model Versioning and Integration (C) 2007/04/10 © DAMA International 2007 -- All Rights Reserved 16

DMBOK Activity Outline… 3. Database Management 1. Database Development 1. 2. 3. 4. 5. 6. 7. 8. 9. Define Database Design Standards (P) Design Physical Databases (D) Review Database Design Quality (C) Develop Data Access Services (D) Develop Information Products ((D) Implement Development / Test Database Changes (C) Create and Maintain Test Data (D) Migrate and Convert Data (D) Test and Validate Data Requirements (D) 2. Database Production Support 1. 2. 3. 4. 5. 6. 7. 8. 9. Implement Production Database Changes (C) Obtain Externally Sourced Data (O) Plan for Data Recovery (P) Backup and Recover Data (O) Set Database Performance Service Levels (P) Monitor & Tune Database Performance (O) Plan for Data Retention (P) Archive, Retrieve and Purge Data (O) Manage Specialized Databases (O) 3. Data Technology Management 1. 2. 3. 4. 5. 6. 7. 2007/04/10 Understand Data Technology Requirements (P) Define the Database Architecture (P) (same as 2. 1. 3) Implement and Maintain Database Environments (C) Evaluate Data Technology (P) Install and Administer Data Technology (O) Inventory & Track Data Technology Licenses (C) Support Data Technology Usage & Issues (O) © DAMA International 2007 -- All Rights Reserved 17

DMBOK Activity Outline… 4. Data Security Management Ø Understand Data Privacy, Confidentiality and Security Needs (P) Ø Define Data Privacy and Confidentiality Standards (P) Ø Define Password Standards and Procedures (P) Ø Implement Data Security Controls (D) Ø Manage Users, Passwords and Group Membership (C) Ø Manage Data Access Views (C) Ø Manage Data Access Permissions (C) Ø Monitor User Authentication and Access Behavior (C) Ø Classify Information Confidentiality (C) Ø Audit Data Security (C) 5. Data Quality Management 1. Develop and Promote Data Quality Awareness (O) 2. Define Data Quality Metrics (P) 3. Define Data Quality Requirements and Business Rules (D) 4. Analyze / Profile / Measure / Monitor Data Quality (C) 5. Set Data Quality Service Levels (P) 6. Certify Data Quality (C) 7. Identify, Escalate and Resolve Data Quality Issues (C) 8. Conduct Clean-up Campaigns (O) 9. Design and Implement Operational DQM Procedures (D) 10. Monitor Operational DQM Procedures (C) 11. Test and Validate Data Quality Requirements (D) 12. Audit Data Quality (C) 2007/04/10 © DAMA International 2007 -- All Rights Reserved 18

DMBOK Activity Outline… 6. Reference and Master Data Management Ø Understand Reference & Master Data Integration Needs (P) Ø Define the Data Integration / MDM Architecture (P) (same as 2. 1. 4) Ø Implement Reference and Master Data Management Solutions (D) Ø Control Code Values and Other Reference Data (C) Ø Integrate Master Data (O) Ø Replicate Reference and Master Data (O) Ø Maintain Dimensional Hierarchies (O) 7. Data Warehousing and Business Intelligence Management 1. Understand Business Intelligence Data Needs (P) 2. Define the Data Warehouse / BI Architecture (P) (same as 2. 1. 5) 3. Implement Data Warehouses and Data Marts (D) 4. Implement Business Intelligence Tools and User Interfaces (D) 5. Implement Enterprise Reporting (D) 6. Implement Management Dashboards and Scorecards (D) 7. Implement Analytic Applications (D) 8. Train Business Professionals (O) 9. Replicate and Transform Data for Business Intelligence (O) 10. Monitor and Tune Data Warehousing Processes (C) 11. Support Business Intelligence Activity (O) 12. Monitor and Tune BI Activity and Performance (C) 2007/04/10 © DAMA International 2007 -- All Rights Reserved 19

… DMBOK Activity Outline 8. Document, Record and Content Management 1. Manage Electronic Documents (text, graphics, image, audio, video) 2. Manage Physical Records (paper, fiche) 3. Manage Information Content (search engine indexes, taxonomies, XML namespaces, report and document format standards) 9. Meta Data Management 1. Understand Meta Data Requirements (P) 2. Define the Meta Data Architecture (P) (same as 2. 1. 6) 3. Develop and Maintain Meta Data Standards (P) 4. Implement a Managed Meta Data Environment (D) 5. Create, Capture, Store and Maintain Meta Data (O) 6. Maintain Meta Data Source Data Stores 7. Extract, Reconcile, Integrate and Share Meta Data (C) 8. Manage the Meta Data Repository (C) 9. Query, Report and Analyze Metadata (O) 10. Manage Meta Data Distribution and Delivery to Glossaries, Directories and Other Meta Data Marts (C) 2007/04/10 © DAMA International 2007 -- All Rights Reserved 20

The DMBOK© Functional Framework Data Management Functions Meta Data Management Document, Record & Content Management Environmental Elements Organization & Culture Data Architecture, Analysis & Design Database Management Technology Data Governance Data Warehousing & Business Intelligence Management Reference & Master Data Management 2007/04/10 Activities Goals & Principles Data Security Management Data Quality Management Practices & Techniques Deliverables Roles & Responsibilities © DAMA International 2007 -- All Rights Reserved 21

Environment Scope Summary 2007/04/10 © DAMA International 2007 -- All Rights Reserved 22

DMBOK Functional Framework 2007/04/10 © DAMA International 2007 -- All Rights Reserved 23

DMBOK Functional Framework q q Framework Paper Written as Board Proposal Available on DAMA Website Since July 2006 1000 Downloads Worldwide To Date To 40 Countries Ø Ø Ø Ø USA Unknown Canada Australia UK India South Africa Brazil 48% 18% 7% 6% 3% 3% 3% 1% q Now Averaging 30 per Week q Version 2 Soon To Be Posted 2007/04/10 © DAMA International 2007 -- All Rights Reserved 24

Version 2 Framework Changes q Renamed Functions Ø Data Stewardship & Governance renamed to simply Data Governance Ø Data Architecture & Design renamed to Data Architecture, Analysis & Design Ø Database Administration renamed to Database Management Ø Data Quality Improvement renamed to Data Quality Management Ø Data Warehousing & Business Intelligence renamed to Data Warehousing & Business Intelligence Mgmt Ø Unstructured Data Management renamed to Document, Record & Content Management Ø Metadata Management renamed to Meta Data Management q Function Presentation Sequence Changes Ø Data Quality Management moved before Reference & Master Data Management Ø Reference & Master Data Management moved before Data Warehousing & Business Intelligence Management Ø Meta Data Management moved to the concluding position q Renamed Environmental Elements Ø Goals & Objectives renamed to Goals & Principles Ø Process & Activities renamed to just Activities Ø Principles & Practices renamed to Practices & Techniques Ø Organizational & Cultural Issues renamed to Organization & Culture. 2007/04/10 © DAMA International 2007 -- All Rights Reserved 25

DMBOK© Guide Chapters… q Chapter 1: Introduction q Chapter 2: Data Management Overview Ø Activities, Deliverables, Roles, Technology q Chapters 3 – 11: DM Functions Ø Ø Ø Ø Ø 2007/04/10 3: Data Governance 4: Data Architecture, Analysis & Design 5: Database Management 6. Data Security Management 7. Data Quality Management 8. Reference & Master Data Management 9. Data Warehousing & Business Intelligence Management 10. Document, Record & Content Management 11. Meta Data Management © DAMA International 2007 -- All Rights Reserved 26

…DMBOK© Guide Chapters q Chapter 12: Professional Development q Appendices Ø A: Bibliography Ø

…Standard Chapter Format (3 -11) q q Introduction Ø Defining Key Terms Ø Goals Ø Context Diagram Concepts & Activities Ø Key Concepts and Guiding Principles Ø Roles Performing Activities to Create Deliverables Ø Using Best Practices & Common Techniques Ø Using Technology Summary Ø Guiding Principles Recap Ø Process Summary – Activities, Deliverables, Roles Ø Org & Cultural Issues Recommended Reading 2007/04/10 © DAMA International 2007 -- All Rights Reserved 28

Sample Context Diagram 2007/04/10 © DAMA International 2007 -- All Rights Reserved 29

Dictionary of Data Management q Vital Need for a DMBOK Glossary Ø The Semantics of our own Profession q Large Enough to Publish Separately… Ø 900 Terms Ø 100 Pages q As DAMA Dictionary of Data Management Ø Version 1. 0 2007/04/10 © DAMA International 2007 -- All Rights Reserved 30

DMBOK Development Roles DAMA International and DAMA Foundation Executive Boards DAMA Chapter President’s Council DAMA Professional Groups Deborah Henderson President, DAMA Foundation Executive Sponsor Mark Mosley DMBOK Chief Editor Administrative Assistant DMBOK Editorial Board Contributors 2007/04/10 Reviewers Review Workshop Participants © DAMA International 2007 -- All Rights Reserved 31

DMBOK© Guide Editorial Board q Mark Mosley, DMBOK editor (Chicago) q Deborah Henderson, sponsor (Toronto) q Bobbie Adderson (Chicago) q Michael Brackett (Washington) q Larry Burns (Washington) q Mike Connor (Chicago) q Patricia Cupoli (Philadelphia) q Alex Friedgan (Chicago) q q q q q Lowell Fryman (Chicago) Mahesh Haryu (New York) Gil Laware (Chicago) Jim Mc. Quade (Pittsburgh) Mike Miller (Chicago) Cathy Nolan (Chicago) Kathy Sivier (Chicago) Anne Marie Smith (Philadelphia) Eva Smith (Washington) The local DAMA chapter for each Editorial Board is shown in parentheses – “Washington” (state) refers to the Puget Sound chapter 2007/04/10 © DAMA International 2007 -- All Rights Reserved 32

Chapter Development Team Leaders 3 -- Data Governance Mark Mosley 4 -- Data Architecture, Analysis & Design Steve Hoberman 5 -- Database Management Larry Burns 6 -- Data Security Mgmt: Corinna Martinez 7 -- Data Quality Management: David Loshin 8 -- Reference & Master Data Management: ? ? 9 -- DW / Business Intelligence Mgmt: Mike Connor 10 – Records & Content Management: Pat Cupoli 11 – Meta Data Management: Mike Jennings 12 – Professional Development: Pat Cupoli 2007/04/10 © DAMA International 2007 -- All Rights Reserved 33

Collaboration Strategy DMBOK Development Diary News & Public Comments Project Discussion Chat Room Chapter

What’s Been Done So Far? q December 2005: Deborah Henderson Meets with DAMA Chicago Chapter q April 2006: DMBOK Framework Proposal Accepted q June 2006: DMBOK Framework Paper Posted q July 2006: Development Strategy Drafted q August 2006: First Drafts of Chapters 1 & 2 & Glossary q March 2007: Data Governance Focus Group Workshop q March 2007: First Drafts of Chapters 3, 4, 5 and 12 q April 2007: DMBOK Blog: http: //dmbok. blogspot. com q April 2007: DAMA Dictionary of Data Management, V. 1 2007/04/10 © DAMA International 2007 -- All Rights Reserved 35

What’s Next in 2007? q Publishing the Dictionary q Drafts and Revisions of Each Chapter q More Conference Calls & Focus Groups q Publicity Articles q DAMA Local Chapter Presentations q Final Review by DAMA Executive Board 2007/04/10 © DAMA International 2007 -- All Rights Reserved 36

Development Schedule q Chapters 3, 12 1 Q q DMBOK Blog 1 Q q Chapters 4, 5, 6, 7, 9 2 Q q Chapters 8, 10, 11 3 Q q DAMA Executive Board Review 4 Q q General Availability / Published 1 Q 2008 2007/04/10 © DAMA International 2007 -- All Rights Reserved 37

How Can I Get Involved? q Review and Comment on Current Drafts q Review and Comment on the Dictionary of Data Management q Participate in This Week’s Workshops q Volunteer to Participate as a Chapter Reviewer / Contributor q Volunteer to Participate as a Chapter Team Leader q Participate on the DMBOK Blog q Inform Your Local DAMA Chapter q Invite a Speaker for a DAMA Chapter Intro/Update Contact Mark Mosley at DMBOKeditorinchief@dama. org 2007/04/10 © DAMA International 2007 -- All Rights Reserved 38

The DAMA Curriculum Framework Green = completed Yellow = underway Brown = future Job Clusters & Employment - NWCET & others Education Delivery Channels Acceptance by N. A. Accreditation Bodies Topics & Clusters Courses DAMA Curriculum Framework Career Ladders Certification/ Designation CDMP Body of Knowledge (DMBOK) Detail/ texts 2007/04/10 © DAMA International 2007 -- All Rights Reserved 39