Greenplum has different Nodes Copyright Coffing Data Warehousing

  • Slides: 19
Download presentation
Greenplum has different Nodes Copyright Coffing Data Warehousing 2008 Phone 937 855 -4838

Greenplum has different Nodes Copyright Coffing Data Warehousing 2008 Phone 937 855 -4838

Open Data Flow Processing Engine Map Reduce – Mini Program Perl SQL Python C

Open Data Flow Processing Engine Map Reduce – Mini Program Perl SQL Python C Functions Copyright Coffing Data Warehousing 2008 Postgres allows Greenplum flexibility Phone 937 855 -4838

External Tables Data can be internal or external Web data, Flat files, or remote

External Tables Data can be internal or external Web data, Flat files, or remote databases Remote Servers Example: 450 SQL Server databases seen as one Greenplum Table Greenplum allows a table to define data sources and transports and Transforms data

Greenplum Summary Partnered with SUN to provide Speed Demon in Data Warehouse Market Commodity

Greenplum Summary Partnered with SUN to provide Speed Demon in Data Warehouse Market Commodity Hardware and Open Source Postgres make Greenplum affordable Highly Optimized for throughput and streaming Scale across many processors and servers Can use Map Reduce – SQL, Perl, Python, C Can process data from remote systems Copyright Coffing Data Warehousing 2008 Phone 937 855 -4838

Dataupia Founded 2005 by Foster Hinshaw Father of Data Warehouse Appliance Co-founder of Netezza

Dataupia Founded 2005 by Foster Hinshaw Father of Data Warehouse Appliance Co-founder of Netezza I refer to Foster as the “Thomas Edison of our time” Foster Hinshaw Coffing Data Warehousing Partner Copyright Coffing Data Warehousing 2008 Phone 937 855 -4838 5

Dataupia Concept Dataupia turns your Oracle DB 2 SQL Server Database into MPP Copyright

Dataupia Concept Dataupia turns your Oracle DB 2 SQL Server Database into MPP Copyright Coffing Data Warehousing 2008 Phone 937 855 -4838 6

Dataupia Satori Server Sa • to • ri [suh-tawr-ee] – noun. Key concept in

Dataupia Satori Server Sa • to • ri [suh-tawr-ee] – noun. Key concept in Zen Buddhism. Refers to deep or lasting enlightenment. Ex. With the Dataupia. TM Satori Server, you can realize the full potential of your data. Copyright Coffing Data Warehousing 2008 Phone 937 855 -4838 7

Satori Server Specs Satori uses Linux based Blades consist of dual 64 -bit AMD

Satori Server Specs Satori uses Linux based Blades consist of dual 64 -bit AMD Opteron processors. Each Blade comes with 2 TBs of storage Each Blade has eight RAID-5 Drives Dataupia Software on the host computer Captures SQL, parses it, and then executes It on the Dataupia Satori server. Dataupia Utilities can extract or replicate data from existing databases, and while Loading to Dataupia, create fast indexing. Copyright Coffing Data Warehousing 2008 Phone 937 855 -4838 8

Dataupia Satori Server Integrated bundle of commodity hardware, operating system, Storage, database interfaces and

Dataupia Satori Server Integrated bundle of commodity hardware, operating system, Storage, database interfaces and a dynamic aggregation engine Bundled into a single blade. System can be build from 2 to n blades. Each blade has 2 TB of Disk Space. Designed to handle a mixed workload of queries Underlying SQL is all 92 standards and will support all BI applications from vendors including open source. System installation takes hours, not weeks, and a $19, 500 entry price is hard to resist. Copyright Coffing Data Warehousing 2008 Phone 937 855 -4838 9

Dataupia Concept Applications work the same Integration is easy Cost effective Increased Speed Fastest

Dataupia Concept Applications work the same Integration is easy Cost effective Increased Speed Fastest way to turn SMP into MPP Copyright Coffing Data Warehousing 2008 Only Appliance that doesn’t make you change databases Phone 937 855 -4838

Dataupia Summary Single Vendor Appliance Database Transparency Linear Scalability Support of many Applications Mixed

Dataupia Summary Single Vendor Appliance Database Transparency Linear Scalability Support of many Applications Mixed Workload “Rip and Replace” Compellingly low TCO Foster Hinshaw is a proven star Copyright Coffing Data Warehousing 2008 Phone 937 855 -4838 11

HP’s Neoview Released in 2007 Challenging Teradata Built with enormous amounts of memory Wal-Mart

HP’s Neoview Released in 2007 Challenging Teradata Built with enormous amounts of memory Wal-Mart one of their biggest customers Coffing Data Warehousing built the Neoview Courseware Copyright Coffing Data Warehousing 2008 Phone 937 855 -4838 12

Neoview Terminology Node – A single processor and its components Segment – A series

Neoview Terminology Node – A single processor and its components Segment – A series of 16 nodes System Area Network – Connects all nodes and segments SQL Engine ESAM Teradata’s PE Encapsulated SQL Access Manager is like Teradata’s AMP Logical Disk Copyright Coffing Data Warehousing 2008 Phone 937 855 -4838 13

Neoview Architecture SQL Engine Server Net ESAM ESAM LDV LDV LDV Copyright Coffing Data

Neoview Architecture SQL Engine Server Net ESAM ESAM LDV LDV LDV Copyright Coffing Data Warehousing 2008 Phone 937 855 -4838 14

Neoview Data Distribution ESAM Neoview has two Type of tables: A B C D

Neoview Data Distribution ESAM Neoview has two Type of tables: A B C D Copyright Coffing Data Warehousing 2008 A B C E A B C D Partitioned – Spread Across all ESAMs like Tables A, B, and C. Non-Partitioned – a Table that resides on A single ESAM like Tables D, E, and F. Phone 937 855 -4838 15

Neoview Multi-Segment Architecture Neoview Segment Copyright Coffing Data Warehousing 2008 Phone 937 855 -4838

Neoview Multi-Segment Architecture Neoview Segment Copyright Coffing Data Warehousing 2008 Phone 937 855 -4838 16

Teradata and Neoview Similarities Both Designed to be Enterprise Data Warehouses Both use Parallel

Teradata and Neoview Similarities Both Designed to be Enterprise Data Warehouses Both use Parallel Processing and spread the data across the processors Both are extremely scalable Each has a similar architecture and design Both were led by HP CEO Mark Hurd Copyright Coffing Data Warehousing 2008 Phone 937 855 -4838 17

Teradata and Neoview Differences Neoview is less expensive Neoview had the advantage of learning

Teradata and Neoview Differences Neoview is less expensive Neoview had the advantage of learning from Teradata and made improvements Teradata gives each AMP more disk space where Neoview gives each ESAM much more memory Teradata has more customers and 20 years experience compared to Neoview Copyright Coffing Data Warehousing 2008 Phone 937 855 -4838 18

Neoview Summary HP is a huge name Mark Hurd has excellent leadership and DW

Neoview Summary HP is a huge name Mark Hurd has excellent leadership and DW focus Enterprise Data Warehouse Campaign Going directly after Teradata HP also owns EDS and Knightsbridge Consulting Lower costs than Teradata Design improves on Teradata knowledge Copyright Coffing Data Warehousing 2008 Phone 937 855 -4838 19