Windows Azure Technical Evangelist DPE Microsoft http blog

  • Slides: 22
Download presentation
Windows Azure 大数据 方�, Technical Evangelist DPE, Microsoft 我的博客:http: //blog. csdn. net/shaunfang Azure技���� (QQ):

Windows Azure 大数据 方�, Technical Evangelist DPE, Microsoft 我的博客:http: //blog. csdn. net/shaunfang Azure技���� (QQ): 289913970

大数据是具备高效益地分析大型的数据集和数 据集之间相关性、提升行业决策和执行能力( 如,发现商务趋势,审核科研质量,防御疾病, 疏通交通、治理环境、打击犯罪行为等)的软 硬件基础设施和应用技术的总称。 Exabytes (10 E 18) Petabytes (10 E 15) Terabytes

大数据是具备高效益地分析大型的数据集和数 据集之间相关性、提升行业决策和执行能力( 如,发现商务趋势,审核科研质量,防御疾病, 疏通交通、治理环境、打击犯罪行为等)的软 硬件基础设施和应用技术的总称。 Exabytes (10 E 18) Petabytes (10 E 15) Terabytes (10 E 12) Sensors / RFID / Devices Social Sentiment 数据量 Volume Variety Variability Velocity �感器等�� Gigabytes (10 E 9) Mobile Advertising ERP / CRM Payables Audio / Video WEB 2. 0 e. Commerce Log Files Collaboration Spatial & GPS Coordinates Data Market Feeds Digital Marketing Contacts Payroll Deal Tracking Inventory Sales Pipeline Wikis / Blogs Search Marketing e. Gov Feeds Web Logs Weather Recommendation Text/Image 复杂性: 多样性, 变化和速度 Variety, variability & Velocity WEB 2. 0 ERP / CRM 硬盘价格/GB 1980 19万$ 1990 9, 000$ 2000 15$ �感器等�� 2010 0. 07$

No. SQL

No. SQL

数据服� 服�名 �明 Azure Tables Windows Azure上的列存�服� Azure SQL Windows Azure上的关系型数据服� Azure HDInsight Windows

数据服� 服�名 �明 Azure Tables Windows Azure上的列存�服� Azure SQL Windows Azure上的关系型数据服� Azure HDInsight Windows Azure上的Hadoop服� 可部署在Iaa. S虚�机上的大数据技� 技� 安装位置 Mongo. DB VM�� Cassandra VM�� Neo 4 j VM�� SQL server Azure内置� My. SQL VM��

Windows Azure HDInsight 服�

Windows Azure HDInsight 服�

Windows版的HDP,加上一些微�的�展 HDInsight 3. 0 HDP 2. 0 Hadoop 2. 2 HDInsight 2. 1 HDP

Windows版的HDP,加上一些微�的�展 HDInsight 3. 0 HDP 2. 0 Hadoop 2. 2 HDInsight 2. 1 HDP 1. 3 Hadoop 1. 1. 2 HDInsight 1. 6 HDP 1. 1 Hadoop 1. 0. 3

HDInsight 生�系� Distributed Processing (Map. Reduce) Distributed Storage (HDFS) ODBC Query (Hive) Legend Red

HDInsight 生�系� Distributed Processing (Map. Reduce) Distributed Storage (HDFS) ODBC Query (Hive) Legend Red = Core Hadoop Blue = Data processing Purple = Microsoft integration points and value adds Orange = Data Movement Green = Packages

 • New-Azure. HDInsight. Cluster • • • New-Azure. HDInsight. Hive. Job. Definition New-Azure.

• New-Azure. HDInsight. Cluster • • • New-Azure. HDInsight. Hive. Job. Definition New-Azure. HDInsight. Map. Reduce. Job. Definition New-Azure. HDInsight. Pig. Job. Definition New-Azure. HDInsight. Sqoop. Job. Definition New-Azure. HDInsight. Streaming. Map. Reduce. Job. Definition

Hive, Pig, Mahout, Cascading, Scalding, Scoobi, Pegasus… C#, F# Map/Reduce, LINQ to Hive, .

Hive, Pig, Mahout, Cascading, Scalding, Scoobi, Pegasus… C#, F# Map/Reduce, LINQ to Hive, . NET management clients Java. Script Map/Reduce, Node. js management clients Power. Shell, Cross Platform CLI tools

熟悉的 具 Power View 商务智能平台 Excel with Power. Pivot Predictive Analytics Embedded BI SSAS

熟悉的 具 Power View 商务智能平台 Excel with Power. Pivot Predictive Analytics Embedded BI SSAS 分析服� SSRS �表服� Connectors Hadoop On Windows Azure 非结构化数据 & 关系数 据 Sensors Hadoop On Windows Server Devices Microsoft EDW 企�数据�� Bots Crawlers ERP CRM LOB APPs

 • HDinsight介� http: //www. windowsazure. com/enus/documentation/articles/hdinsight-get-started • Hadoop http: //hadoop. apache. org/ •

• HDinsight介� http: //www. windowsazure. com/enus/documentation/articles/hdinsight-get-started • Hadoop http: //hadoop. apache. org/ • HDP http: //hortonworks. com/products/hdp-windows/

© 2011 Microsoft Corporation. All rights reserved. Microsoft, Windows Vista and other product names

© 2011 Microsoft Corporation. All rights reserved. Microsoft, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U. S. and/or other countries. The information herein is is for informational purposes only and represents the current view of of Microsoft Corporation as as of of the date of of this presentation. Because Microsoft must respond to to changing market conditions, itit should not be be interpreted to to be be aa commitment on on the part of of Microsoft, and Microsoft cannot guarantee the accuracy of of any information provided after the date of of this presentation. MICROSOFT MAKES NO NO WARRANTIES, EXPRESS, IMPLIED OR OR STATUTORY, AS AS TO TO THE INFORMATION IN IN THIS PRESENTATION.