2013 Splunk Inc Introducing Hunk Splunk Analytics for

  • Slides: 32
Download presentation
© 2013 Splunk Inc. Introducing Hunk ™ Splunk Analytics for Hadoop Brett Sheppard Director,

© 2013 Splunk Inc. Introducing Hunk ™ Splunk Analytics for Hadoop Brett Sheppard Director, Big Data Product Marketing data@splunk. com

Safe Harbor Statement During the course of this presentation, we may make forward looking

Safe Harbor Statement During the course of this presentation, we may make forward looking statements regarding future events or the expected performance of the company. We caution you that such statements reflect our current expectations and estimates based on factors currently known to us and that actual events or results could differ materially. For important factors that may cause actual results to differ from those contained in our forward-looking statements, please review our filings with the SEC. The forward-looking statements made in this presentation are being made as of the time and date of its live presentation. If reviewed after its live presentation, this presentation may not contain current or accurate information. We do not assume any obligation to update any forward looking statements we may make. In addition, any information about our roadmap outlines our general product direction and is subject to change at any time without notice. It is for informational purposes only and shall not be incorporated into any contract or other commitment. Splunk undertakes no obligation either to develop the features or functionality described or to include any such feature or functionality in a future release. 2

The Accelerating Pace of Data Volume | Velocity | Variety | Variability Machine data

The Accelerating Pace of Data Volume | Velocity | Variety | Variability Machine data is the fastest growing, most GPS, RFID, complex, most valuable area of big data Hypervisor, Web Servers, Email, Messaging, Clickstreams, Mobile, Telephony, IVR, Databases, Sensors, Telematics, Storage, Servers, Security Devices, Desktops 3

Make machine data accessible, usable and valuable to everyone. 4

Make machine data accessible, usable and valuable to everyone. 4

Splunk Company Overview Company (NASDAQ: SPLK) Business Model / Products 2004 founded 2006 first

Splunk Company Overview Company (NASDAQ: SPLK) Business Model / Products 2004 founded 2006 first software release In the cloud San Francisco Saa. S HQ On-premise 5 Customers 6000+ 60+ of the Fortune 100 Largest license: 100 Terabytes/day

Delivers Value Across IT and the Business App Dev and App Mgmt. IT Operations

Delivers Value Across IT and the Business App Dev and App Mgmt. IT Operations Security and Compliance Digital Intelligence Business Analytics Developer Platform (REST API, SDKs) Small Data. Big Data. Huge Data. 6 Industrial Data and Internet of Things

Getting Value from Data in Hadoop is Challenging Easy storage but hard analytics: difficult

Getting Value from Data in Hadoop is Challenging Easy storage but hard analytics: difficult to explore, analyze, visualize Wide Range of Open Source Projects for Hadoop Analytics Pig H i Sqoop v YARN Data. Fu e Mahout Complex technology: many open source projects Azkaban Hard-to-staff skills: must write Map. Reduce jobs or fixed schemas Hadoop (Map. Reduce & HDFS) 7

PEAK OF INFLATED EXPECTATIONS “ Many Hadoop customers TECHNOLOGY TRIGGER My most advanced Hadoop

PEAK OF INFLATED EXPECTATIONS “ Many Hadoop customers TECHNOLOGY TRIGGER My most advanced Hadoop clients are also getting disillusioned … The only consistent success, reported by my clients, is with Splunk. “ VISIBILITY What Does Gartner Say? Svetlana Sicular, Gartner Research Director, January 22, 2013 SLOPE OF ENLIGHTENMENT PLATEAU OF PRODUCTIVITY TROUGH OF DISILLUSIONMENT 8 8 TIME

We Began to Address This Challenge Real-time Collection and Analysis > > > Dashboards,

We Began to Address This Challenge Real-time Collection and Analysis > > > Dashboards, Reports, Access Controls Splunk Hadoop Connect > > > • Bi-directional data transfer Splunk App for Hadoop Ops • Troubleshoot and monitor 9

© 2013 Splunk Inc. Introducing Hunk™ Splunk Analytics for Hadoop New product from Splunk

© 2013 Splunk Inc. Introducing Hunk™ Splunk Analytics for Hadoop New product from Splunk delivers interactive data exploration, analysis and visualizations for Hadoop

Integrated Analytics Platform for Hadoop Data Full-featured, Integrated Product Explore Analyze Visualize Insights for

Integrated Analytics Platform for Hadoop Data Full-featured, Integrated Product Explore Analyze Visualize Insights for Everyone Works with What You Have Today Hadoop (Map. Reduce & HDFS) 11 11 Dashboards Share

Validation from Partners “I'm super excited about Hunk is solving one of the top

Validation from Partners “I'm super excited about Hunk is solving one of the top issues that our customers have – access to the skills and know-how to leverage the data inside of Hadoop. Splunk has a very beautiful UI that is very easy to learn. So it bridges that gap and makes it very easy to access the data inside of Hadoop. " "Hunk will help Hortonworks customers explore, analyze and visualize data in Apache Hadoop, driving more intelligent decisions across the entire organization. " 12 "The fact that Splunk is bringing ease-of-use to sophisticated Hadoop problems is welcome from every angle. The power of Hunk comes across in how easy it is to just plug it in, throw it in there, and suddenly you have all of your answers. I wish every product worked this nicely. ”

Explore, Analyze and Visualize Data On-the-fly Virtual Index • Enables seamless use of the

Explore, Analyze and Visualize Data On-the-fly Virtual Index • Enables seamless use of the Splunk technology stack on data wherever it rests • Handles Map. Reduce Schema-on-the-fly • Structure applied at search time • No brittle schema • Automatically find patterns and trends 13 Flexibility and Fast Time to Value • Interactive search • Preview results while Map. Reduce jobs run • Drag-and-drop analytics

Derive Actionable Insights from Raw Data 1 Point Hunk at Hadoop Cluster 2 Explore

Derive Actionable Insights from Raw Data 1 Point Hunk at Hadoop Cluster 2 Explore Analyze Visualize Hadoop Storage 14 Dashboards Share Immediately start exploring, analyzing and visualizing raw data in Hadoop

Challenges With Alternative Approaches OPTION 1 “Do it yourself” Hadoop / Pig Problems Need

Challenges With Alternative Approaches OPTION 1 “Do it yourself” Hadoop / Pig Problems Need to know Map. Reduce Wait for slow jobs to finish No interactive exploration Hive or SQL on OPTION 2 Hadoop OPTION 3 Problems Pre-defined fixed schema Need knowledge of data Miss data that “doesn’t fit” 15 Extract to in-memory store Data too big to move Limited drill down to raw data Another data mart

Powerful Analytics Anyone Can Use – Now on Hadoop Interactive Search Preview results and

Powerful Analytics Anyone Can Use – Now on Hadoop Interactive Search Preview results and interactively search across one or more Hadoop clusters Data Model Provides more meaningful representation of underlying raw machine data Pivot Enables non-technical users to build complex reports without learning the search language 16

Empowering Business and IT Stakeholders Interactive Search Enterprise Architect Data Model Business Analyst •

Empowering Business and IT Stakeholders Interactive Search Enterprise Architect Data Model Business Analyst • Adapt your architecture for big data • Save time by just pointing at Hadoop • Hadoop shared-service departments • Avoid fixed-schemas and low-level tooling offer self-service analytics • Free data scientists for custom analytics, not be data butlers Development Environment Pivot • Answer questions iteratively without waiting for Map. Reduce jobs to finish 17 Developer • • Build scalable big data apps on top of data in Hadoop Use the development languages and tools you know and like

Fast Deployment and Configuration Just point at Hadoop Connect to one or multiple Hadoop

Fast Deployment and Configuration Just point at Hadoop Connect to one or multiple Hadoop clusters • Certified integration with all major Hadoop distributions • Choose 1 st-gen Map. Reduce or YARN • Create Virtual Indexes across one or more clusters • From download to searching data in < 60 minutes YARN certified 18

Connect Hunk to HDFS and Map. Reduce Connect to Apache HDFS and Map. Reduce

Connect Hunk to HDFS and Map. Reduce Connect to Apache HDFS and Map. Reduce or your choice of Hadoop distribution Hadoop Cluster 1 19

Hunk Scales With Your Hadoop Deployments Connect Hunk to multiple Hadoop clusters Hadoop Cluster

Hunk Scales With Your Hadoop Deployments Connect Hunk to multiple Hadoop clusters Hadoop Cluster 1 Hadoop Cluster 2 Hadoop Cluster 3 20

Search and Explore from One Place Rapidly interact with data Pause or stop Map.

Search and Explore from One Place Rapidly interact with data Pause or stop Map. Reduce jobs • Powerful Search Processing Search interface • Ad-hoc exploratory analytics Preview results Language (SPL™) across massive datasets • Preview results • No fixed schemas • No requirement to “understand” data upfront Drill down to raw data 21

Powerful, Easy-to-use Analytics Pivot • Drag-and-drop interface enables anyone to analyze raw, unstructured data

Powerful, Easy-to-use Analytics Pivot • Drag-and-drop interface enables anyone to analyze raw, unstructured data • Build complex queries and reports without learning search language All chart types available in the chart toolbox Save report to share Time window Select fields from data model • Click to visualize any chart type; reports dynamically update when fields change 22

Define Relationships in Big Data Model • Describes how underlying Hierarchical object view of

Define Relationships in Big Data Model • Describes how underlying Hierarchical object view of underlying data machine data is represented and accessed Add constraints to filter out events • Defines meaningful relationships in the data • Enables single authoritative view of underlying raw data 23

Visualize and Share Data with Role-based Security Build and personalize • Rapidly build advanced

Visualize and Share Data with Role-based Security Build and personalize • Rapidly build advanced graphs • • and charts on-the-fly Combine charts, views and external data in dashboards and reports View and edit on any desktop or mobile device Drill down to raw data Protect data with role-based access controls 24

Build Big Data Apps on Top of Hadoop Pick your favorite tools • Use

Build Big Data Apps on Top of Hadoop Pick your favorite tools • Use a standards-based web Build Big Data Apps framework and REST API • Customize dashboards and UIs with Simple XML, Java. Script or Django Web Framework Extend and Integrate Hunk Simple XML SDKs Data Models Java. Script Ruby Java. Script C# PHP Python Search Extensibility Django REST API • Choose among SDKs for Java, Java. Script, Python, Ruby, C# and PHP Hadoop (Map. Reduce & HDFS) 25

Drive Value Across the Enterprise Unlock the value of big data in Hadoop to

Drive Value Across the Enterprise Unlock the value of big data in Hadoop to address business challenges Multi-Channel Retail Management Financial Risk Management 26 Synthesize Data from all Customer Touch Points – 360° View

Multi-Channel Retailer Otto Group Sales operations can see the big picture and drill down

Multi-Channel Retailer Otto Group Sales operations can see the big picture and drill down to individual SKUs Corporate strategists can access market conditions for 400 stores in 20 countries Analysts can more quickly explore data and create visualizations for in-store inventory 27

Petabytes of seemingly “random numbers” in Hadoop More, higher-complexity risk calculations RISK MANAGEMENT AT

Petabytes of seemingly “random numbers” in Hadoop More, higher-complexity risk calculations RISK MANAGEMENT AT MAJOR GLOBAL BANK 28 Analysis showed the level of core Tier 1 capital ratio that the bank needs to hold against its balance sheet given their current risk profile

 this se e z y l Ana e, diver iv mass ts in

this se e z y l Ana e, diver iv mass ts in se data p o Hado MORE COMPLETE CUSTOMER VIEW FOR FASHION RETAILER ar w e n vie a in ree rs a t g Ob 0 de ome 36 cust of op: o d a H ta in ogs, a d Raw e web l h Apac erce site mage m i ecom y, Akamai d ui it activ g logs, Sq n hosti logs proxy 29

Demo 30

Demo 30

Hunk™: Splunk Analytics for Hadoop FAST TO DEPLOY AND DRIVE VALUE FULL-FEATURED ANALYTICS Simply

Hunk™: Splunk Analytics for Hadoop FAST TO DEPLOY AND DRIVE VALUE FULL-FEATURED ANALYTICS Simply point Hunk at your Hadoop cluster and start exploring data immediately Explore, analyze and visualize data in Hadoop from one integrated platform INTERACTIVE SEARCH RICH DEVELOPER ENVIRONMENT Interact with data, change perspectives and preview results as Map. Reduce jobs run 31 Build big data apps on data in Hadoop using standard web languages and frameworks

Thank You www. splunk. com/hunk

Thank You www. splunk. com/hunk