Lets find the patterns and anomalies Ana Mara

Let's find the patterns and anomalies Ana María Bisbé York @ambynet Business Intelligence Consultant MS Partner on Power BI | Microsoft Data Platform MVP Power. BIWorld. Tour. com #PBIWorld. Tour

Bio • Ana María Bisbé York • • Business Intelligence Consulting Partner Microsoft Power BI Microsoft Data Platform MVP @ambynet anabisbe@amby. net https: //www. linkedin. com/in/ambynet/ https: //amby. net/ Power. BIWorld. Tour. com #PBIWorld. Tour

Session Agenda • Introduction to data mining • Microsoft Data Mining tools before Power BI • • Quick Analysis on server side Finding patterns using Power BI visuals Finding patters using custom visuals Power BI + R visuals Power. BIWorld. Tour. com #PBIWorld. Tour

Introduction to Data Mining and Machine Learning Power. BIWorld. Tour. com #PBIWorld. Tour

Data analysis to find out …Why? • Discover the reasons of the success or failure of an operation • Understand products, customers and ourselves • Get the knowledge to guide the business over the base of data analysis. • • • Risk assessment for customers Customer clustering Products or services that are purchased together Sales forecasting Potential customers forecasting Power. BIWorld. Tour. com #PBIWorld. Tour

CRISP model • https: //es. wikipedia. org/wiki/Cross_Industry_Standard_Process_for_Data_Mining Power. BIWorld. Tour. com #PBIWorld. Tour

SQL Server Analysis Services Data Tools Power. BIWorld. Tour. com #PBIWorld. Tour

Data mining model viewers in SSAS • Naïve Bayes Power. BIWorld. Tour. com #PBIWorld. Tour

Data mining model viewers in SSAS • Decision tree Power. BIWorld. Tour. com #PBIWorld. Tour

Data mining model viewers in SSAS • Neural Networks Power. BIWorld. Tour. com #PBIWorld. Tour

Data mining model viewers in SSAS • Clustering Power. BIWorld. Tour. com #PBIWorld. Tour

Validate model with Lift Chart Power. BIWorld. Tour. com #PBIWorld. Tour

Build predictions in SSAS with designer Power. BIWorld. Tour. com #PBIWorld. Tour

MS Office Excel – Table and data mining tools Power. BIWorld. Tour. com #PBIWorld. Tour

Data Mining with MS Office Excel • Data mining add-on • Connected to SQL Server Analysis Services Power. BIWorld. Tour. com #PBIWorld. Tour

Detection of fraud (anomalies) - Excel DM Power. BIWorld. Tour. com #PBIWorld. Tour

SQL Server Management Studio Power. BIWorld. Tour. com #PBIWorld. Tour

Data Mining Expression (DMX) • Detection of fraud or anomalies with DMX Power. BIWorld. Tour. com #PBIWorld. Tour

R Language Power. BIWorld. Tour. com #PBIWorld. Tour

R language • Open source and free • Available for Windows, Mac, and Linux • http: //cran. r-Project. org • Big and active community • Everything included: language and IDE • More than 5000 packages • Visible from: • SQL Server 2016 , Power BI y Azure ML Power. BIWorld. Tour. com #PBIWorld. Tour

Modeling with R packages • Naive Bayes model Power. BIWorld. Tour. com #PBIWorld. Tour

Modeling with R packages • Decision tree model Power. BIWorld. Tour. com #PBIWorld. Tour

MS Azure Machine Learning Power. BIWorld. Tour. com #PBIWorld. Tour

Microsoft Azure Machine Learning • Machine learning platform (DM) • Part of Microsoft cloud (Azure). • Azure provides two components • To experiment and to implement as web services. Power. BIWorld. Tour. com #PBIWorld. Tour

Microsoft Azure Machine Learning • Three concepts • Data, Experiments and Web services. • Experiment – how to create a model • Data • Algorithm + Data => training - > measure • Model evaluation Power. BIWorld. Tour. com #PBIWorld. Tour

MS Azure Machine Learning Algorithms Power. BIWorld. Tour. com #PBIWorld. Tour

Azure ML • Detect anomalies • Data engineering • Visualization Power. BIWorld. Tour. com #PBIWorld. Tour

Azure ML – Validate models & visualize results Power. BIWorld. Tour. com #PBIWorld. Tour

MS Power BI Quick insights Power. BIWorld. Tour. com #PBIWorld. Tour

Data Mining by Power BI Server • Quick analysis Power. BIWorld. Tour. com #PBIWorld. Tour

Quick Insights • Majority (Major factors) • Category outliers • Clusters • Correlation • Steady shared • Low variance • Seasonality in time series • Time series outliers • Overall trends in time series Power. BIWorld. Tour. com #PBIWorld. Tour

MS Power BI Native visuals Power. BIWorld. Tour. com #PBIWorld. Tour

Statistics with Power BI • Find patterns dynamically Power. BIWorld. Tour. com #PBIWorld. Tour

Find pattern with clustering and segmentation Power. BIWorld. Tour. com #PBIWorld. Tour

Trend and forecast Power. BIWorld. Tour. com #PBIWorld. Tour

Trend and forecast Power. BIWorld. Tour. com #PBIWorld. Tour

Analyze by Date – Increase vs Decrease • Analyze – Explanation of increase or decrease • Results of algorithms • Add charts to the report Power. BIWorld. Tour. com #PBIWorld. Tour

Maps • Arc. GIS Heat map Power. BIWorld. Tour. com #PBIWorld. Tour

Maps • Arc. GIS Clustering Power. BIWorld. Tour. com #PBIWorld. Tour

MS Power BI Custom visuals Power. BIWorld. Tour. com #PBIWorld. Tour

Time series outliers Power. BIWorld. Tour. com #PBIWorld. Tour

Distribution • Histogram Power. BIWorld. Tour. com #PBIWorld. Tour

Distribution • Find anomalies with boxplot Power. BIWorld. Tour. com #PBIWorld. Tour

Relationship - networks • Force Power. BIWorld. Tour. com #PBIWorld. Tour

Stationality • Pulse Power. BIWorld. Tour. com #PBIWorld. Tour

Correlation • Density Power. BIWorld. Tour. com #PBIWorld. Tour

Category outliers • Heat table Power. BIWorld. Tour. com #PBIWorld. Tour

MS Power BI R visuals Power. BIWorld. Tour. com #PBIWorld. Tour

R Visuals • Correlation • Histogram Power. BIWorld. Tour. com #PBIWorld. Tour

Explore data using graphs with R • Boxplot Power. BIWorld. Tour. com #PBIWorld. Tour

R Custom Visuals • Decision Tree Power. BIWorld. Tour. com Associations rules #PBIWorld. Tour

R Custom Visuals • Time Series Power. BIWorld. Tour. com Clustering #PBIWorld. Tour

Recap • Data mining • Quest for knowledge • Biggest part of the project • Data exploration • Cleaning • Attribute or variable definition • Exploring, mining, looking at the patterns #Happy. Mining Power. BIWorld. Tour. com #PBIWorld. Tour

Don’t forget to join your local PUG to enjoy year-round networking and learning.