Use Kolla for Better Life A real case
Use Kolla for Better Life: A real case study for Kolla Yongsheng Gong gong. yongsheng@99 cloud. net presenting for Weiting Chen weiting. chen@intel. com Jeffrey Zhang zhang. lei. fly@99 cloud. net
AGENDA • Background • Why we use Kolla • How we use Kolla • Kolla’s Future System Technologies & Optimization (STO) 2
BACKGROUND Open. Stack is leading the private cloud solution in the market in recent years. Big data is also growing very fast. Enterprise are looking for a new way to integrate both solutions into the same IT infrastructure. Thru Open. Stack, Big data as a service is on the way to provide an elastic and ease to use solution with unified management. Big Data • Open. Stack Sahara • Open. Stack Kolla • Other Open. Stack Projects System Technologies & Optimization (STO) Cloud 3
Our Focus • • • Develop Big Data-as-a-Service Solutions Contribute to Open Source Projects like Open. Stack. Target for Spark/Hadoop source code development. Focus on Cloud performance tuning. Collaborate with Global ISVs. System Technologies & Optimization (STO) 4
THE MOTIVATION 500+ Servers Software Dev. Large Cluster Scaling Software Version Control Big Data Services Software Testing System Technologies & Optimization (STO) Quick Deploy Cloud Infra. Hardware Maint. 5
WHY USE OPENSTACK KOLLA • Open. Stack helps to resolve multi-tenants problem cross multiple team’s development • Docker helps to cover all the software dependency issue by using container technology. • Kolla use micro service concept to run Open. Stack services, to debug or upgrade services become an easy way. • Quick Open. Stack services deployment with a high availability cloud architecture design. • Open. Stack services maintenance and upgrade. System Technologies & Optimization (STO) 6
Kolla benefits us System Technologies & Optimization (STO) 7
LAB NETWORK TOPOLOGY Gateway(1 Gb) - 10. 239. x. x Other Team’s Servers 172. 16. x. x Public Network(10 Gb) - 10. 0. 0. 1/16 Storage Network(10 Gb) - 30. 0. 0. 1/24 Controller + Network w/ HA Nova Compute x 6 (IVB) Bare Metal for Performance Ceph Open. Stack Cloud Nova Compute x 20 (SNB) Ceph MON Nova Compute x 20 (BDW) Ceph OSD x 7 Spark/Hadoop Master Workers Private Network(10 Gb) - 20. 0. 0. 1/24 Manage Network(1 Gb) - 40. 0. 0. 1/24 System Technologies & Optimization (STO) 8
Use Kolla-ansible for Open. Stack installation 1. Prerequisite on deployment server Docker, Ansible, Open. Stack client libraries, NTP installation, “/etc/hosts” to contain managed nodes, be able to passwordless ssh to manged nodes 2. Prerequisite on managed nodes: Docker 3. Download Docker Open. Stack Images 4. Create Docker Local Registry and Load it with downloaded images 5. Edit “multinode” file in “$/kolla/ansible/inventory” to speficy what nodes are taking what roles 6. Edit “globals. yml” file in “/etc/kolla” to specify or config to-be-installed openstack features 7. Verify your config files: kolla-ansible prechecks -i $multinode_file 8. Start to deploy: kolla-ansible deploy -i $multinode_file System Technologies & Optimization (STO) 9
Miscellaneous • Enable HA via Kolla’s globals. xml config file haproxy, keepalived, cron, …etc will be installed via Kolla • Set up Ceph by using Virtual Storage Manager(VSM) and config Cinder file manually Reference: https: //github. com/01 org/virtual-storage-manager • Set up gateway bridge for public network Edit “l 3_agent. ini” for “external_gateway_bridge = br-ex” • Set up public network via horizon • Use the container - “heka” to check Open. Stack logs System Technologies & Optimization (STO) 10
ISSUES HIGHLIGHT 1. Maria. DB issue during installing Kolla. During deploy, mariadb could be fail to connect and must re-try the deploy command. 2. Upgrade Issues via “kolla-ansible upgrade” command. (Mitaka -> Newton) Ansible must be upgraded to a new version since new version Kolla requires a new version Ansible support. Keep to use the related version of config file for multinode/globals; Use a wrong version config file could get fails during upgrade. 3. Downgrade issue with failed “kolla-ansible upgrade” command. What is the measures when "kolla-ansible upgrade" failed? 4. Recover database if it crashes via “kolla-ansible mariadb_recovery” 5. Check the version of docker and keep all the nodes use the same version. 6. Customize config items of type Multi. Str. Opt & List. Opt System Technologies & Optimization (STO) 11
Kolla’s Future Plan New features in Ocata • More stable • Support more Open. Stack projects Future Plan • Kolla Kubernetes Support • Multi Arch Support • Multi region / Cell deployment • Better CI jobs System Technologies & Optimization (STO) 12
enjoy the life under clear sky System Technologies & Optimization (STO) 13
enjoy the life, with beer, noodle and without computer System Technologies & Optimization (STO) 14
INTEL NOTICE & DISCLAIMER No license (express or implied, by estoppel or otherwise) to any intellectual property rights is granted by this document. Intel disclaims all express and implied warranties, including without limitation, the implied warranties of merchantability, fitness for a particular purpose, and non-infringement, as well as any warranty arising from course of performance, course of dealing, or usage in trade. This document contains information on products, services and/or processes in development. All information provided here is subject to change without notice. Contact your Intel representative to obtain the latest forecast, schedule, specifications and roadmaps. The products and services described may contain defects or errors known as errata which may cause deviations from published specifications. Current characterized errata are available on request. Copies of documents which have an order number and are referenced in this document may be obtained by calling 1 -800548 -4725 or by visiting www. intel. com/design/literature. htm. Intel, the Intel logo, Intel® are trademarks of Intel Corporation in the U. S. and/or other countries. *Other names and brands may be claimed as the property of others Copyright © 2016 Intel Corporation. System Technologies & Optimization (STO) 15
- Slides: 16