Intro to Open Stack Trove Database as a
Intro to Open. Stack Trove & Database as a Service Open. Stack Toronto Meetup Doug Shelley, VP Product Development, Tesora March 30, 2016
A word about our sponsors • Tesora, the Trove company • Leading contributor to Trove • Makers of Tesora “DBaa. S Platform” – – Enterprise product based on Trove Additional capabilities Additional datastores Support and Services • Located in Boston and Toronto – We’re hiring 3/30/2016 Intro to Open. Stack Trove & DBaa. S Open. Stack Toronto Meetup 2
Today’s Database Challenges “I need a No. SQL DB for my app to scale” “I need my environment NOW” “I have to release it next month or else” “I only need it for a couple of weeks” “I’ll just use AWS” Developer 3/30/2016 “I just don’t understand these developers. . . ” Intro to Open. Stack Trove & DBaa. S – Open. Stack Toronto Meetup IT Guy 3
Today’s Database Challenges “These Ops guys don’t get it. . . ” “My budget and team aren’t getting any bigger” “Why can’t they just use Oracle? ” “We need time to do it right” Developer 3/30/2016 “We have no idea what they are putting on the public cloud” “I know that they are putting our customer data at risk” IT Guy Intro to Open. Stack Trove & DBaa. S – Open. Stack Toronto Meetup 4
Transformation of Cloud Data Management Traditional IT Cloud • • • Provisioning by admins Database management by specialists Waterfall development Few large machines / bare metal Oracle Enterprise licenses • Captive audience • • • 3/30/2016 • • • Self Service Provisioning Developers manage their own databases Agile development Many small machines / virtualization Many data management technologies Competition with AWS Intro to Open. Stack Trove & DBaa. S Open. Stack Toronto Meetup 5
The Solution: Database as a Service • The delivery of database software & related storage “as-a-service” • Available on-demand, without any hardware or software installation or configuration • A fully managed service maintained & administered by the service provider 3/30/2016 Intro to Open. Stack Trove & DBaa. S Open. Stack Toronto Meetup 6
Amazon is demonstrating the importance of DBaa. S • Dynamo. DB was the fastest growing service in AWS history in 2012 – Werner Vogels, Amazon CTO, AWS Blog June 2012 • Redshift is now the fastest growing AWS service ever – Werner Vogels, Amazon CTO, The Register, April 2015 • 45% of Amazon customers have implemented and are expanding use of RDS – Jeffrey Hammond, Forrester Blog, September 2013 • AWS database business currently on a $1 billion revenue run rate – Andy Jassy, the SVP of AWS - Tech. Crunch, October 2015 • Amazon’s #1 hiring focus – 84 open positions in DBaa. S in November 2015 – Deutsche Bank Markets Research - Network. World, November 2015 3/30/2016 Intro to Open. Stack Trove & DBaa. S – Open. Stack Toronto Meetup 7
What is Trove? RDS for Open. Stack Red. Shift RDS EC 2 … 3/30/2016 S 3 EBS Open. Stack Developer API Trove No. SQL Intro to Open. Stack Trove & DBaa. S Open. Stack Toronto Meetup DW RDBMS Nova … Swift …and API’s for Dev. OPs Operations API Dynamo. DB Amazon Internal API …and Dynamo. DB …and Red. Shift Amazon AWS Developer API Cinder 8
Open. Stack Trove Mission Statement The Open. Stack Open Source Database as a Service Mission: To provide scalable and reliable Cloud Database as a Service provisioning functionality for both relational and nonrelational database engines, and to continue to improve its fully-featured and extensible open source framework. https: //wiki. openstack. org/wiki/Trove 3/30/2016 Intro to Open. Stack Trove & DBaa. S – Open. Stack Toronto Meetup 9
What is Open. Stack Trove? • Provisioning – Launching a new database instance • Complex Database Topologies – Clustering, Replication • Automation – Backup & Restore, Failover, Resizing, Cluster Scaling • Multiple Database Technologies, Common API’s – Relational, Non-Relational, … (mostly FOSS) • Management Interface – CLI, REST API, Web based UI 3/30/2016 Intro to Open. Stack Trove & DBaa. S – Open. Stack Toronto Meetup 10
Complete Database Lifecycle Management Provision Secure • On demand • Wide DB selection • Clusters & single instances • Users/permissions • Restricted root access Manage Tune • Manage schemas • Create replicas for scale & availability • Backup/restore • Manage log files • API’s to tune fleets of servers, not just single instances • Sane defaults 3/30/2016 Intro to Open. Stack Trove & DBaa. S Open. Stack Toronto Meetup 11
The Trove Architecture Trove API Trove Guest Agent Application Database Software Storage Swift Operating System Nova Instance Cinder Trove Guest Agent Database Software Operating System Guest Image Glance Storage 3/30/2016 Keystone Trove Task Manager Neutron Trove Conductor Glance Trove Intro to Open. Stack Trove & DBaa. S – Open. Stack Toronto Meetup 12
The data plane and the management plane 3/30/2016 Intro to Open. Stack Trove & DBaa. S – Open. Stack Toronto Meetup 13
Trove Multi-Datastore Architecture Datastore-agnostic code in Trove Controller and Dashboard API Task Manager Trove Dashboard (Horizon) 3/30/2016 Datastore specific code isolated to guest agents Guest Agent Guest Agent Guest Agent Conductor Trove Controller Intro to Open. Stack Trove & DBaa. S Open. Stack Toronto Meetup 14
Multi-database – support for 13 different databases No. SQL 3/30/2016 Intro to Open. Stack Trove & DBaa. S Open. Stack Toronto Meetup 15
What’s new in Mitaka • • • 3/30/2016 Cassandra clustering, backup & restore, configuration groups, user functions Couch. DB backup and restore, user functions DB 2 backup and restore Improvements to Mongo Cluster grow/shrink support Extend My. SQL replication to include Maria. DB GTID replication Percona Xtra. DB Cluster grow/shrink support, root enable Vertica configuration groups, cluster grow/shrink Improved Ceilometer notifications Bug fixes Intro to Open. Stack Trove & DBaa. S – Open. Stack Toronto Meetup 16
What’s on deck for Newton • Here are some projects currently under consideration – – – – Guest upgrade support Support for anti-affinity of replica/cluster nodes Extend persistent storage to include more than Cinder/Ephemeral Python 3 support Management client for Trove, use the Open. Stack client Filter available volume types by datastore Guest improvements • Incremental backup, streaming replication for Postgre. SQL • Clustering for Couchbase 3/30/2016 Intro to Open. Stack Trove & DBaa. S – Open. Stack Toronto Meetup 17
Let’s see a demo… 3/30/2016 Intro to Open. Stack Trove & DBaa. S – Open. Stack Toronto Meetup 18
Learn More about Trove • • • Trove Wiki – https: //wiki. openstack. org/wiki/Trove Source – https: //git. openstack. org/cgit/openstack/trove On IRC - #openstack-trove • Getting Started Videos – http: //tesora. com/videos/ • • Download Tesora Platform - http: //tesora. com/downloads Contact information Trove Day – http: //tesora. com/troveday – http: //slideshare. net/tesoracorp • 3/30/2016 Linked. In - Open. Stack Trove Group Contact Tesora info@tesora. com www. tesora. com @tesoracorp Intro to Open. Stack Trove & DBaa. S – Open. Stack Toronto Meetup Contact Doug doug@tesora. com www. tesora. com @dougshelley 66 IRC: dougshelley 66 19
Open. Stack East – August 23 -24 - New York City • Official Open. Stack event • Community-driven • Focus on enterprise users • Retail • Financial services • Telecom More at Open. Stack. East. com 3/30/2016 Intro to Open. Stack Trove & DBaa. S – Open. Stack Toronto Meetup 20
- Slides: 20