Docker Practice in Alibaba Cloud Yi Li Alibaba

Docker Practice in Alibaba Cloud Yi Li Alibaba Cloud Architect

Agenda • • Cloud and Docker Status Update in China Successful Stories • Aliyun Container Service • Dedicated Cloud Powered By Container • Scalable Docker Image Distribution

Alibaba Cloud: A Global Player for Cloud Computing Russia Europe Japan US West CN North US East CN South Middle East CN East Hong Kong Singapore Existed Planned

Alibaba Cloud: 93 Cloud Services Public Available

Cloud and Docker Status Update in China l China’s cloud spending to reach 24. 5% of the West by 2018 from 5. 7% in 2015 l More than 80% respondents are already using or plan to use containers, but only 10% used in production environment. China cloud relative to the West – DB Docker Adoption in China Survey result from 350+ feedbacks by Alibaba Cloud, June 2016

Aliyun Container Service From container to cloud native application version: '2' services: wordpress: image: wordpress: 4. 5 restart: always links: - 'db: mysql' volumes: - 'wp_upload: /var/www/html/wp-content/uploads' environment: - WORDPRESS_DB_USER=blog - WORDPRESS_DB_PASSWORD=xxxxxx - WORDPRESS_DB_NAME=wordpress - availability: az==2 labels: aliyun. probe. url: http: //container aliyun. routing. port_80: http: //wordpress aliyun. scale: '3' aliyun. log_store_wordpress: stdout db: external: host: rdsxxxxxx. mysql. rds. aliyuncs. com ports: - 3306 volumes: wp_upload: driver: ossfs driver_opts: bucket: acs-sample-wordpress • Fully compatible to Docker Compose/Swarm http: //wordpress. alicontainer. com Load Balancing Service AZ-a AZ-b OSSFS One click to deploy in cloud My. SQL Instance from RDS OSSFS Bucket from Object Store Service Cluster of VM nodes

Aliyun Container Service From container to cloud native application version: '2' services: wordpress: image: wordpress: 4. 5 restart: always links: - 'db: mysql' volumes: - 'wp_upload: /var/www/html/wp-content/uploads' environment: - WORDPRESS_DB_USER=blog - WORDPRESS_DB_PASSWORD=xxxxxx - WORDPRESS_DB_NAME=wordpress - availability: az==2 labels: aliyun. probe. url: http: //container aliyun. routing. port_80: http: //wordpress aliyun. scale: '3' aliyun. log_store_wordpress: stdout db: external: host: rdsxxxxxx. mysql. rds. aliyuncs. com ports: - 3306 volumes: wp_upload: driver: ossfs driver_opts: bucket: acs-sample-wordpress • Fully compatible to Docker Compose/Swarm • Assemble the container and cloud services in declarative way http: //wordpress. alicontainer. com Load Balancing Service AZ-a AZ-b OSSFS One click to deploy in cloud My. SQL Instance from RDS OSSFS Bucket from Object Store Service Cluster of VM nodes

Aliyun Container Service From container to cloud native application version: '2' services: wordpress: image: wordpress: 4. 5 restart: always links: - 'db: mysql' volumes: - 'wp_upload: /var/www/html/wp-content/uploads' environment: - WORDPRESS_DB_USER=blog - WORDPRESS_DB_PASSWORD=xxxxxx - WORDPRESS_DB_NAME=wordpress - availability: az==2 labels: aliyun. probe. url: http: //container aliyun. routing. port_80: http: //wordpress aliyun. scale: '3' aliyun. log_store_wordpress: stdout db: external: host: rdsxxxxxx. mysql. rds. aliyuncs. com ports: - 3306 volumes: wp_upload: driver: ossfs driver_opts: bucket: acs-sample-wordpress • Fully compatible to Docker Compose/Swarm • Assemble the container and cloud services in declarative way http: //wordpress. alicontainer. com • Enable micro-service architecture Load Balancing Service AZ-a AZ-b OSSFS One click to deploy in cloud My. SQL Instance from RDS OSSFS Bucket from Object Store Service Cluster of VM nodes

Aliyun Container Service DBaa. S My. SQL, , Mongo … Application Middleware Services Access Monitoring Auto Scaling Service Registration, Discovery Rolling update, A/B test, Canary … Scheduling Container Orchestration Cluster Management 路由 Docker Image Compose template Repository Container Storage Block Storage, Network FS, Object Storage Public Cloud Configuration Management Docker Engine SCM Dev. Ops Service Access Control CI/CD 3 rd Extensions Logging Load balancing, Routing Caching Service Messaging Service Application Extensions Networking Classic/VPC, Hybrid Cloud, 3 rd Extensions Dedicate Cloud Governance

Aliyun Container Service Integrates with cloud services Dev. Ops by design Supports. Application different workload Application Web/Mobile, HPC, Event-driven, etc. Middleware Services Access Monitoring Auto Scaling Enables micro-service architecture Rolling update, A/B test, Canary … Service Registration, Discovery 3 rd Extensions Dev. Ops Service Access Control Scheduling Container Orchestration Cluster Management 路由 CI/CD SCM Logging Load balancing, Routing Caching Service Messaging Service App Secure, Controllable, and Extensible DBaa. S My. SQL, , Mongo … Docker Image Compose template Repository Configuration Management Docker Engine Container Fully. Storage compatible to Docker ecosystem Networking Classic/VPC, Hybrid Cloud, Optimized volume/networking for Alibaba Cloud Block Storage, Network FS, Object Storage Public Cloud Extensions Dedicate Cloud 3 rd Extensions Governance

Reference Customers and Partners

Full Stack Dedicated Cloud Management and Operation Open API (REST, SDK, Orchestration Template) Big Data Security Services Application Services Elastic Compute Storage Services VPC Internet Scale Middleware Services Database Services Apsara Kernel : Unified, large scale, distributed computing framework Distributed storage Service Distributed resource management and scheduling Distributed Data Center Management Distributed Coordination Service Enterprise Security Framework Apsara Stack- Customer-owned Infrastructure 100+ controller services developed by different teams Each service has different dependencies of runtimes and libs Challenges l Deliver the full stack cloud efficiently l Minimize the resource overhead l HA and self-managed system l Continuing evolution

Deploy Dedicated Cloud in Few Person Days Unified service description for all controller services (In Docker Compose style format with extensions) Docker Image Registry Capabilities (provides) Probes 4 Management Agent Healthy & monitoring Image Constrains HA, placement, … 1 3 S 1 S 3 S 2 2 Lookup configuration Clone the controller nodes from base OS image with Docker Engine Management Agent S 4 S 6 Service Controller Container VXLAN/ VLAN Network Plugin n + 1 hot backup Recover node failure in minutes Configuration Management Service Worker (Elastic Computing, Storage, Big Data, etc. ) X 86 Server Linux. X 86 (Ali. OS) Server 5 Service Controller Container X 86 Server Data Center Management Determine execution plan by resolving the dependencies among services automatically Service Controller Container Docker Engine (Docker with Ali Extensions) X 86 Server Linux (Ali. OS) Properties Requirements (depends) Deploy and configure service controllers as Docker containers S 7 X 86 Server Clone the worker nodes from base OS image, deploy and configure the service workers on baremetal

Scalable Docker Image Distribution in Alibaba Group Headquarter Docker Registry with Index Server CI/CD DC 1 DC 2 Mirror Massive, secure and highly reliable object storage service OSS Mirror OSS Other data centers in China and around the world … OSS Proxy with P 2 P minion client Docker tracker Proxy with P 2 P minion client Docker Docker Engine enhanced with private registry mirror 10 K+ servers concurrent pulling image within one Data Center 30% faster layer download through p 2 p distribution

Thank you!