Taking Netezza on a test drive The Netezza

Taking Netezza on a test drive – The Netezza Emulator Abhik Roy Experian Session Code: E 09 May 25, 2016 (08: 00 AM – 09: 00 AM) | Platform: <Insert Platform(s) here> Photo by Steve from Austin, TX, USA

Taking IBM Netezza on a test drive – The Netezza Emulator • • • Introduction to IBM Netezza Introduction to Netezza Emulator Introduction to R and Machine Learning and its importance in the data science domain Technology Platforms for Machine Learning IBM Netezza and Open. R Reference Architecture Use the Netezza Emulator and Open. R to build a predictive data analytics platform. This will enable you to develop truly scalable data science products optimized to take advantage of the Netezza hardware. A quick tour of the powerful graphical capabilities of R Where can Machine Learning take us If you liked E 03 – Succeeding with Predictive Analytics and unlocking the power of Data Science with R on Netezza, and want to get into developing R algorithms on Netezza, this presentation will tell you how to build the data processing platform. 2

Introduction to IBM Netezza • • • Plug and Play database appliance Dedicated device to do only one thing very well Built for a specific kind of workload Brings processing close to data through FPGA’s Easily scalable by adding units of processing, memory, disk and FPGAs • Minimal effort in setup and tuning • A relational database engine built on Postgre. SQL • This appliance is currently called IBM Pure. Data System for Analytics 3

Introduction to Netezza Emulator The IBM Netezza Emulator is a virtual image of a Netezza appliance that could be used for developing applications and as a platform for learning the technology. Similar to virtual machines for Cloudera hadoop distributions, IBM Big. Insights VM etc 4

Introduction to Machine Learning and its importance in the data science domain • Machine learning explores the study and construction of algorithms that can learn from and make predictions on data. • Deep capability of understanding patterns in data • Uses principals of mathematics, computational statistics and computer processing to develop predictive data models. 5

Types of Machine Learning Supervised Learning • The computer is provided training data which teaches it the relationships between predictor and target variables. • The computer is then presented with test data set consisting of the predictor variables, and asked to predict the value of the target variables. • No training sets are provided, leaving it on its own to find structures and patterns in data. Unsupervised • Examples include clustering data based on similar attributes Learning • A computer program interacts with a dynamic environment to perform a certain goal and has to be intelligent enough to understand how it is progressing in its goal. Reinforcement • Example include automatically droving a car Learning 6

Introduction to R and its importance in the data science domain • R is a language and environment for statistical computing and graphics. • It is a GNU project which is similar to the S language and environment which was developed at Bell Laboratories (formerly AT&T, now Lucent Technologies) by John Chambers and colleagues. • R is available as Free Software under the terms of the Free Software Foundation’s GNU General Public License in source code form. • It compiles and runs on a wide variety of UNIX platforms and similar systems (including Free. BSD and Linux), Windows and Mac. OS. For more information on R, visit https: //www. r-project. org/about. html 7

Technology platform for Machine learning • Machine learning involves very complex computations, and CPU and memory intensive number crunching. • Development of machine learning algorithms is a very expensive process, hence the processing platform must be able to scale horizontally as the data processing size grows. • Fault tolerant and redundant systems to ensure minimal impact during hardware component failures. • Ideally support open source computational and statistical processing languages like R and Python. 8

IBM Netezza with its massive data processing capability and built in redundancy / fault tolerance of the disks and Snippet processing Units, forms an ideal platform to build Predictive Data Analytics Platforms. 9

IBM Netezza and Open. R Reference Architecture NZ Host R INZA RODBC R R Studio R INZA SPUn R INZA SPU 2 R INZA SPU 1 IBM Pure Data for Analytics – Netezza Appliance NZR, NZA, NZMATRIX 10

Data Processing with R on IBM Netezza NZ Data Frames R code and Functions / ANSI SQL NZ Matrics and Analytics Packages IBM Netezza Pack R code in SQL based clients 11

IBM Netezza and Open. R Setup using the Netezza Emulator Netezza Admin Client R Studio NZR, NZA, NZMATRIX IBM Netezza Emulator NZ Analytics Open. R NZR, NZA, NZMATRIX Base. R Virtualization environment User PC 12

IBM Netezza and Open. R Setup using the Netezza Emulator PC Configuration 16 GB RAM Windows Professional 64 bit Enable virtualization setting in bios Install Winscp from https: //winscp. ne t/eng/download. p hp For video instructions and demonstration, please visit http: //www. theanalyticsuniverse. com/build-a-predictive-data-analytic-s-platformin-your-pc-using-open-r-and-ibm-netezza-emulator 13

IBM Netezza and Open. R Setup using the Netezza Emulator 14

IBM Netezza and Open. R Setup using the Netezza Emulator Install Netezza Administration Tool PC Configuration 16 GB RAM Windows Professional 64 bit Enable virtualization setting in bios For video instructions and demonstration, please visit http: //www. theanalyticsuniverse. com/build-a-predictive-data-analytic-s-platform -in-your-pc-using-open-r-and-ibm-netezza-emulator 15

IBM Netezza and Open. R Setup using the Netezza Emulator 16

IBM Netezza and Open. R Setup using the Netezza Emulator Install Vmware workstation player PC Configuration 16 GB RAM Windows Professional 64 bit Enable virtualization setting in bios For video instructions and demonstration, please visit http: //www. theanalyticsuniverse. com/build-a-predictive-data-analytics-platform-in-your-pc-using-open-r-and-ibm-netezza-emulator 17

IBM Netezza and Open. R Setup using the Netezza Emulator 18

IBM Netezza and Open. R Setup using the Netezza Emulator Install Netezza Emulator Vmware Virtualization environment PC For video instructions and demonstration, please visit http: //www. theanalyticsuniverse. com/build-a-predictive-data-analytic-s -platform-in-your-pc-using-open-r-and-ibm-netezza-emulator 19

IBM Netezza and Open. R Setup using the Netezza Emulator 20

IBM Netezza and Open. R Setup using the Netezza Emulator 21

IBM Netezza and Open. R Setup using the Netezza Emulator 22

IBM Netezza and Open. R Setup using the Netezza Emulator 23

IBM Netezza and Open. R Setup using the Netezza Emulator 24

IBM Netezza and Open. R Setup using the Netezza Emulator 25

IBM Netezza and Open. R Setup using the Netezza Emulator 26

IBM Netezza and Open. R Setup using the Netezza Emulator Vmware Virtualization environment Install NZ Analytics Netezza Emulator PC For video instructions and demonstration, please visit http: //www. theanalyticsuniverse. com/build-a-predictive-data-analytic-splatform-in-your-pc-using-open-r-and-ibm-netezza-emulator 27

IBM Netezza and Open. R Setup using the Netezza Emulator 28

IBM Netezza and Open. R Setup using the Netezza Emulator 29

IBM Netezza and Open. R Setup using the Netezza Emulator 30

IBM Netezza and Open. R Setup using the Netezza Emulator 31

IBM Netezza and Open. R Setup using the Netezza Emulator 32

IBM Netezza and Open. R Setup using the Netezza Emulator 33

IBM Netezza and Open. R Setup using the Netezza Emulator 34

IBM Netezza and Open. R Setup using the Netezza Emulator 35

IBM Netezza and Open. R Setup using the Netezza Emulator 36

IBM Netezza and Open. R Setup using the Netezza Emulator 37

IBM Netezza and Open. R Setup using the Netezza Emulator 38

IBM Netezza and Open. R Setup using the Netezza Emulator Vmware Virtualization environment Install Open. R in the Netezza Emulator PC For video instructions and demonstration, please visit http: //www. theanalyticsuniverse. com/build-a-predictive-data-analytic-splatform-in-your-pc-using-open-r-and-ibm-netezza-emulator 39

IBM Netezza and Open. R Setup using the Netezza Emulator 40

IBM Netezza and Open. R Setup using the Netezza Emulator 41

IBM Netezza and Open. R Setup using the Netezza Emulator 42

IBM Netezza and Open. R Setup using the Netezza Emulator 43

IBM Netezza and Open. R Setup using the Netezza Emulator 44

IBM Netezza and Open. R Setup using the Netezza Emulator 45

IBM Netezza and Open. R Setup using the Netezza Emulator 46

IBM Netezza and Open. R Setup using the Netezza Emulator Install base R for windows and R studio in your pc PC For video instructions and demonstration, please visit http: //www. theanalyticsuniverse. com/build-a-predictive-data-analytics-platform-in-your-pc-using-open-r-and-ibm-netezza-emulator 47

IBM Netezza and Open. R Setup using the Netezza Emulator 48

IBM Netezza and Open. R Setup using the Netezza Emulator 49

IBM Netezza and Open. R Setup using the Netezza Emulator 50

IBM Netezza and Open. R Setup using the Netezza Emulator 51

52

The Powerful Graphical capabilities of R 53

Where can machine Learning take us? ural Language Processing Machine Learning For blogs on Data Analytics, Machine Learning, Natural Language processing , Apache Spark, Netezza and Big Data Stacks Please visit www. theanalyticsuniverse. com 54

Abhik Roy Experian roy. abhik@gmail. com Linked. In : https: //www. linkedin. com/in/abhik-roy-98620412 Technical Blogs: www. theanalyticsuniverse. com Please fill out your session evaluation before leaving! Session : E 09 Title : Taking Netezza on a test drive – The Netezza Emulator Photo by Steve from Austin, TX, USA