Data Warehousing: Data Marting and Metadata DATA WAREHOUSING IN THE REAL WORLD Chapters 6 – 9 Sam Anahory Dennis Murray Presented by Lance Kelson 10/25/00
Data Warehousing: Data Marting and Metadata • Chapter 6: PARTITIONING STRATEGY • Chapter 7: AGGREGATIONS • Chapter 8: DATA MARTING • Chapter 9: METADATA
Data Warehousing: Data Marting and Metadata Chapter 6: PARTITIONING STRATEGY Horizontal
Data Warehousing: Data Marting and Metadata Chapter 6: PARTITIONING STRATEGY • Vertical – Normalization – Row Splitting • Machine – Striping Data Across MPP Nodes – Horizontal
Data Warehousing: Data Marting and Metadata Chapter 7: AGGREGATIONS Purpose: Balance Operating Effort with Query Times • • Approx 70% Query Times Reasonable Start w/50, End Up w/200 Min, Max, Avg Most Common Grouping
Data Warehousing: Data Marting and Metadata Chapter 8: DATA MARTING Purpose: PERFORMANCE!
Data Warehousing: Data Marting and Metadata Chapter 9: METADATA Purpose: • Data Transformation and Load • Data Management • Query Generation
Data Warehousing: Data Marting and Metadata Chapter 9: METADATA Data Transformation and Load • Source • Destination • Transformation
Data Warehousing: Data Marting and Metadata Chapter 9: METADATA Data Management • Tables • Indexes • Views • Constraints • Fields • Tables • Aggregations • Partitions
Data Warehousing: Data Marting and Metadata Chapter 9: METADATA Query Generation Records Queries: • Tables • Restrictions • Joins • Aggregations • Group By • Sort By • Syntax • Resources • When, Who