Streamline Business Operations with Advanced IT Operations Analytics
Streamline Business Operations with Advanced IT Operations Analytics © 2014 IBM Corporation
Today’s Companies are virtually without limits when it comes to generating Big Data Fueled by Disruptive Technology Factors Cloud Computing Social Media Mobile Internet of Things Big Data is the Next Natural Resource “We have for the first time an economy based on a key resource (Information) that is not only renewable, but self-generating. Running out of it is not a problem, but drowning in it is. ” -- John Naisbitt (Author & Public Speaker – Futures Studies) © 2013 IBM Corporation
The need to shift to agile and leaner operations IT Operations is a Big Data challenge • Typical Large Enterprise: 5000 servers + network + storage + middleware generates ~1. 3 TB of availability & performance management data per day • Multi-national / MSP with 20, 000 servers + … generates ~4. 5 TB per day • Dev. Ops & Agile Development required by web- & mobile applications leading to frustration • APM Digest 2012: 75% of Senior IT Execs dissatisfied with traditional management approaches, 30% claim they cannot predict potential outages Operations & Line of Business demands insights to … Availability? Performance? Capacity? Utilization? Composition? Smarter Infrastructure becoming a Big Data opportunity • Typical Enterprise generates 27 million tickets and 20 million work orders to manage 15 million unique assets – 1 TB of unstructured data a day • Intelligent networked assets themselves produce data: voltage, power, temp, flow … example: CEPCO managing 11 million residential smart-meters • Opportunities to provide insights & trends on asset performance, reliability & cost management © 2013 IBM Corporation
IBM has invested heavily in Analytics ü More than $16 B in Acquisitions Since 2005; more than any other company 2013 ü Most comprehensive portfolio, from business to IT Analytics, while most other vendors offer only point solutions Social Analytics/Consumer Insight Workload Optimized Systems ü C&SI’s suite of analytics products leverage best of breed capabilities from across all of IBM’s portfolio Advanced Case Management Content Analytics Decision Management Stream Computing Pervasive Content pure. Scale pure. XML Deep Compression Developer Productivity Autonomic Operations 2005 © 2013 IBM Corporation
Introducing IBM Smart. Cloud Analytics Business Outcome Capabilities Proactive Outage Avoidance Faster Problem Resolution Optimized Performance Predict Search Optimize Predict problems before they occur Search quickly across massive amounts of data Optimize across your IT app infrastructure Smart. Cloud Analytics IBM Big Data Platform Streams IBM or 3 rd Party Solutions SPSS Cloud Insights Info. Sphere Big. Insights Rave Watson Documentation Application Performance System & Log Monitoring Transactions Assets & Workorders Alerts, Alarms & Events Operational Environment Applications | Systems | Workloads | Wireless | Network | Voice | Security | Mainframe | Storage | Assets © 2013 IBM Corporation
Predict Challenge: Reacting to performance thresholds is not enough – to ensure your mission critical applications are always available 24 X 7, you must prevent outages by predicting problems before they become service impacting Watson DNA inside Uses fully automated behaviour learning algorithms to establish “normal”. Then applies real-time assessment of current conditions, to detect anomalies as they are emerging and before they become service impacting © 2013 IBM Corporation
The Problem Why aren’t operations teams preventative today? Too much data to analyze manually Existing analytic techniques, such as standard thresholds, are not up to the task They cannot detect problems while they are emerging (before business impact) Set threshold too high, insufficient warning before total failure. Set threshold too low, too much noise, everything is ignored If no there is no ‘early detection’ before the outage, operations teams can only react while outage is already in effect and already losing money. . . © 2013 IBM Corporation
Introducing Smart. Cloud Analytics – Predictive Insights A new offering purpose-built to anticipate and help you prevent application degradations and service outages Product Highlights Behavioural learning solution for quick time -to-value Understands how your IT & network infrastructure is inter-related from a holistic viewpoint Utilizes real-time, streaming analytics to provide early warning alerts for abnormal issues Leverages existing performance & monitoring management solutions Consolidates and unifies performance data Works with IBM & non-IBM management solutions © 2014 IBM Corporation
Search Challenge: To diagnose service problems in applications and the infrastructure supporting them involves analyzing incredible amounts of data Search and Visualize Insight Packs IT Operations App Support Service Desk Normalize Consolidate Collect Documentation Logs Metrics Events © 2014 IBM Corporation
Key Product Capabilities Log collection technology Search technology Visualize through reports and dashboards Expert guidance Ability to build insight packs for domain/application © 2014 IBM Corporation
Search IBM Smart. Cloud Analytics – Solution Benefits Breadth of Searchable Data Include User Documentation, Metrics, Events and Logs in your analysis Distributed & Mainframe Support Search System z logs in addition to all your other structured and unstructured data IBM Expertise Built-in IBM & partners expert knowledge extend solution with applications & infrastructure Insight Packs Embedded Analytics Extend log-search analytics capabilities included in Web API Mgmt and Worklight. Built on IBM’s Big Data platform © 2013 IBM Corporation
Insight Packs, Applications, Toolkits Insight Packs add expertise to Log Analysis on how to find and diagnose and resolve middleware, application and other IT issues. Types include: • Data collection or data loading - provide support for loading and performing metadata searches against specific logs • Apps – provide support for tasks like searching through the collected log data and visualizing search results as charts or graphs. Eg. Anomaly Detection, Saved Searches • Toolkits – provide methods for clients to load their own data by creating custom insight packs. • Community – ‘As-Is’ Insight Packs developed by the Tivoli community Insight Pack - Apps Insight Pack Toolkits Insight Pack - Community Web. Sphere Application Server DSV Toolkit RSS Feed DB 2 Logstash Integration Toolkit ITM Generic Annotation OMNIbus Insight Pack Tooling Web Application App Syslog Web. Sphere Application Server for z/OS Javacore App Web Server Access Logs (Apache, Tomcat, Jboss) Windows OS Event Logs Javacore OMNIbus z/OS Insight Packs (WAS, DB 2, Syslog) © 2014 IBM Corporation
z/OS Insight Pack Offerings • Two independent product offerings for z/OS Insight Packs; SYSLOG and WAS • WAS Insight Pack – enables search for WAS z/OS log data. Provides insights to enhance problem determination of WAS-related problems. • SYSLOG Insight Pack – enables search for DB 2®, CICS®, MQ and IMS z/OS log data. Provides insights to enhance problem determination of DB 2 -related problems. SYSLOG Insight Pack WAS Insight Pack © 2014 IBM Corporation
WAS for z/OS Troubleshooting App – Top 5 messages, exceptions Out-of-the-box application views – Example – Display message counts and java exceptions © 2013 IBM Corporation
Enhancing the value with Netcool Operations Insight Powered by Netcool/Omnibus the #1 Operations Management solution in the market. Provides Event Search and Analytics for faster problem identification and resolution. Improves operational agility and efficiency. Powered by Smart. Cloud Analytics - Log Analysis “Netcool Operations Insight now with analytics, is something that Claranet is really excited about because we can use that in turn to improve the responsiveness to our customers’ issues” Mark Whitehead, Manager of Operational Management Systems, Claranet Proactive notification of application degradations and service outages via seamless integration with Smart. Cloud Analytics-Predictive Insight IT Operations Analytics, a natural extension to further Simplify Operations Predict IBM Smart. Cloud Analytics Predictive Insights, IBM z. Aware Log FIles Documentation IBM Confidential Search IBM Smart. Cloud Analytics Log Analysis Performance Metrics Optimize IBM Smart. Cloud Monitoring, IBM Smart. Cloud Virtual Storage Center Transactions Alerts, Alarms & Events © 2013 IBM Corporation
IBM Netcool Operations Insights - Highlights Business Intelligence Dashboards for IT Visualize the performance and health of entire operations environment • 98% Reduction in Critical events: ~22 critical & ~100 major events per week • Improved focus and utilization of first- and second-line staff Search Analytics for Operational Efficiency Embedded Event search, integrated with predictive analytics identifies opportunities for efficiency in Operations • • 30% alarm & alert reduction increased Operations productivity Reduced time spent on Break/Fix activities in Operations Large North American Bank Predictive Analytics for Agility Ability to Leverage innovative behavior learning predictive solutions to spot emerging problems sooner, reduce time to value, and increase efficiency – • • IBM Confidential Detected 100% of major incidents … including silent failures Reduced need for setting manual thresholds $300 K USD annual productivity improvement in Ops © 2013 IBM Corporation
Event Analytics - for Seasonal Event Identification Provides opportunities for event reduction, thus improving operational efficiency • Easily see related Events that may be candidates for suppression • Identify “difficult to spot” seasonal events that often result in regular periodic problems • Leverage visualizations that help you quickly isolate these problems as being more severe/significant © 2014 IBM Corporation IBM Confidential
Demo © 2014 IBM Corporation
Media - ZON Group Implemented Netcool/OMNIbus Manager of Managers • • • Reduced Mean Time to Detect Simplified Automation Reduced from 8000 critical events per day to 22 IBM Confidential © 2013 IBM Corporation
Large retail bank increased online banking application availability through predictive analytics Need • Ensure critical retail banking applications were online 24 x 7 for high customer satisfaction • Proactive anomaly detection was needed to ensure adequate time to resolve major incidents before they became service impacting Benefits • Alerted 10 major incidents in a 4 week period in advance of customer detection • Simultaneously monitors over 80 servers and 40 K metrics • Estimated savings with outage avoidance analytics was $600 K for this 4 week period Predict © 2014 IBM Corporation
Consolidated Communications avoids network outages and improves customer service “IBM Smart. Cloud Analytics helped detect 100 percent of the major incidents that occurred, including silent failures, and helped us eliminate manual thresholds, which will result in a cost avoidance of $300 K USD annually” - Chris Smith, Director Tools and Automation Consolidated Communications Holdings, Inc. Need • Monitoring a customer base of 250 k access lines, 125 k Internet, and 30 k video is a challenge • Managing manual thresholds within this networking environment is a nightmare Benefits • Using Smart. Cloud Analytics, behavioral learning techniques generate alerts automatically when something is not normal • Enable earlier detection and insight into issues not detected by existing monitoring systems • Easily obtain impact analysis into how the network copes with various failure conditions Predict © 2014 IBM Corporation
Barclays Bank improves customer insight and intelligence Need • Limited traceability and auditability of infrastructure and applications • Lacked a single location to process myriad collection of log data • Required improved customer channel intelligence Benefits • Using Smart. Cloud Analytics, was able to identify customer patterns from log data and apply this to channel intelligence • Improves customer insight from operational data sources Search • Created a one-stop shop for data discovery, and data processing of log file sources © 2014 IBM Corporation
Optimize Challenge: In todays dynamic virtualized environments, lack of clarity on resource allocation can result in increased costs if overallocated or risking SLA commitments if under-allocated Optimize server capacity to accommodate growth while reducing costs Balance storage performance across a selection of datastores © 2014 IBM Corporation
Why is Capacity Management Critical to Cloud Management? Helps consolidate and reduce IT costs o Reduces HW and labor costs o Fewer physical servers needed o Reduce hypervisor license costs o Increase VM density to drive Cloud ROI o Predict how many more customers / VMs can be serviced Helps ensure application availability and reduce risk o Are any resources overloaded? When will physical resources reach their limits? o Have there been any significant changes in my environment recently? o Identify trends to predict bottlenecks, or free up space and balance workloads o Ensure supply can meet demand o Ensure technical and business policies are met to reduce risk Helps optimize resource utilization o Right size virtual machines and allocate based on usage, over-commit within known risk limits o Pack VMs on the infrastructure to optimize resources © 2012 IBM Corporation
Vmware Expense Reduction Report Unbalanced Nearly out of capacity and unbalanced Unbalanced On one screen, I can check all of the key resources to see if my workload is balanced © 2012 IBM Corporation
Policy-Driven Capacity Planning Policy Based Capacity Planning Out of the box rules for: • co-location/anti-location • All Oracle VMs in 1 cluster • Boundary Rules • Place Win 2003 32 -bit on the same ESX server • Utilization Rules • Provide 20% growth for key business application XML based Rules language to define your own rules Select any number of rules and perform the analysis SPECint data used for analysis © 2012 IBM Corporation
Capacity Planning Results Recommendations to optimize workloads; reduce risk while eliminating or repurposing servers Started with 47 ESX servers and 883 VMs The tool always includes headroom to ensure you don’t run out of capacity 27 Reduce from 47 ESX servers down to 21 while lowering memory and CPU utilization Utilization projections accommodated growth © 2012 IBM Corporation
Actively Manage the Cost of Your Virtualized Data Center Rip the cost out of your Virtualized environment and Intelligently Manage Your Future Usage ROI Calculator to Optimized VMware Environment maximize savings! Out of the Box Reporting • Resources Available • Historical Utilization • Predictive Utilization Best fit based on detailed System Benchmarking © 2012 IBM Corporation
Leading pharmaceutical company optimizes VMWare server resources, realizing an annual cost savings of $150 K Need • Customer was lacking formal analysis of resource capacity • Unclear if resources were overallocated with associated increased costs or under-allocated risking SLA commitments Benefits • Capacity optimization solution provided clear visibility and insight into virtualization usage patterns Optimize • Ability to right-size virtual machine resources to efficiently service workloads while reducing costs © 2014 IBM Corporation
Acknowledgements and Disclaimers Availability. References in this presentation to IBM products, programs, or services do not imply that they will be available in all countries in which IBM operates. The workshops, sessions and materials have been prepared by IBM or the session speakers and reflect their own views. They are provided for informational purposes only, and are neither intended to, nor shall have the effect of being, legal or other guidance or advice to any participant. While efforts were made to verify the completeness and accuracy of the information contained in this presentation, it is provided AS-IS without warranty of any kind, express or implied. IBM shall not be responsible for any damages arising out of the use of, or otherwise related to, this presentation or any other materials. Nothing contained in this presentation is intended to, nor shall have the effect of, creating any warranties or representations from IBM or its suppliers or licensors, or altering the terms and conditions of the applicable license agreement governing the use of IBM software. All customer examples described are presented as illustrations of how those customers have used IBM products and the results they may have achieved. Actual environmental costs and performance characteristics may vary by customer. Nothing contained in these materials is intended to, nor shall have the effect of, stating or implying that any activities undertaken by you will result in any specific sales, revenue growth or other results. © Copyright IBM Corporation 2013. All rights reserved. • U. S. Government Users Restricted Rights - Use, duplication or disclosure restricted by GSA ADP Schedule Contract with IBM Corp. • Please update paragraph below for the particular product or family brand trademarks you mention such as Web. Sphere, DB 2, Maximo, Clearcase, Lotus, etc IBM, the IBM logo, ibm. com, [IBM Brand, if trademarked], and [IBM Product, if trademarked] are trademarks or registered trademarks of International Business Machines Corporation in the United States, other countries, or both. If these and other IBM trademarked terms are marked on their first occurrence in this information with a trademark symbol (® or ™), these symbols indicate U. S. registered or common law trademarks owned by IBM at the time this information was published. Such trademarks may also be registered or common law trademarks in other countries. A current list of IBM trademarks is available on the Web at “Copyright and trademark information” at www. ibm. com/legal/copytrade. shtml If you have mentioned trademarks that are not from IBM, please update and add the following lines: [Insert any special 3 rd party trademark names/attributions here] Other company, product, or service names may be trademarks or service marks of others. © 2014 IBM Corporation
Thank You! For More Information, visit us on the web at: http: //www. ibm. com/it-operations-analytics Follow us: #itoa Servicemanagement 360. com ITOA Community Service Management Connect © 2014 IBM Corporation
© 2014 IBM Corporation
- Slides: 32