Open Cloud Platforms Cloud Services Zhong Ou Postdoc

Open Cloud Platforms & Cloud Services Zhong Ou Post-doc researcher Data Communications Software (DCS) Lab, Department of Computer Science and Engineering, Aalto University Zhong Ou Aalto University 26/09/2014

Cloud technology videos • http: //www. youtube. com/watch? v=txv. GNDn. KNWw&feat ure=related • http: //www. youtube. com/watch? v=QJnc. Firhj. Pg 2

Open cloud platforms • • Eucalyptus Open Cirrus Open. Nebula Apache Cloud. Stack Open. Stack … Apache Spark 3

Open. Stack 4 Image source: http: //www. openstack. org/brand/openstack-logo/logo-download/

What is Open. Stack? • Open. Stack is a cloud operating system that controls large pools of compute, storage, and networking resources throughout a datacenter, all managed through a dashboard that gives administrators control while empowering their users to provision resources through a web interface. Source: http: //www. openstack. org/software/5

A bit detail • A a pilot project launched by Rackspace and NASA founded in July 2010. • To avoid “vendor lock-in”, Open Cloud Computing Interface (OCCI) emerged as standard to provide a solution for this by defining interoperable, portable and integration standards. • Open. Stack was launched as an independent implementation of OCCI and offers a flexible and accommodating cloud service. • Open. Stack has got more momentum considering big names are a part of its project (AT&T, IBM, HP, REDHAT, Cisco, Dell, etc). • Supports Xen, KVM, VMWare hypervisor underneath. 6 Source: http: //getcloudify. org/2014/07/10/what-is-openstack-tutorial. html

Components Component name Description Compute (Nova) allows the user to create and manage virtual servers using the machine images. It is the brain of the Cloud. Open. Stack compute provisions and manages large networks of virtual machines Networking (Neutron) pluggable, scalable and API-driven system for managing networks (VLAN, IP address, firewalls etc) Block Storage (Cinder) provides persistent block storage to running instances Object Storage (Swift) stores and retrieves unstructured data objects through the HTTP based APIs, fault tolerant due to its data replication and scale out architecture Image Service (Glance) provides the discovery, registration and delivery services for the disk and server images Identity Service (Keystone) provides a central directory of users mapped to the Open. Stack services, provides an authentication and authorization service for other services Dashboard (Horizon) provides a web-based portal to interact with all the underlying services Telemetry Service (Ceilometer) monitors the usage of the Cloud services and decides the billing accordingly Orchestration Heat manages multiple Cloud applications through an Open. Stack-native REST API and a Cloud. Formation-compatible Query API Database as a Service (Trove) allows users to quickly and easily utilize the features of a relational database without the burden of handling complex administrative tasks Messaging as a Service (Marconi) cloud messaging and notification service for developers building applications on top of Open. Stack 7

Example flow (1/5) 8 Source: http: //getcloudify. org/2014/07/18/openstack-wiki-open-cloud. html

Example flow (2/5) 9

Example flow (3/5) 10

Example flow (4/5) 11

Example flow (5/5) After getting the image, Nova mounts it on a VM host. During the boot process of the VM, it requests Neutron (DHCP component) for an IP address. 12

Structure Source: http: //de. wikipedia. org/wiki/Open. Stack 5 13

Open. Stack Compute (Nova) • Component based architecture enabling quicker additions of new features; • Fault tolerant, recoverable and provides API-compatibility with systems like Amazon EC 2; • Built on a messaging architecture and all of its components can typically be run on several servers; enable communications among components through message queue; • Nova together with its components share a centralized SQL-based database; for larger deployments an aggregation system will be in place to manage the data across multiple data stores; • Supports virtualization technology: KVM, Xen. Server, Linux Container (LXC); • Supports ARM and x 86 etc hardware architectures. 14 Source: http: //blog. flux 7. com/blogs/openstack/tutorial-what-is-nova-and-how-to-install-use-it-openstack

Nova Components • DB: SQL database for storing data • Web Dashboard: External component to communicate with the API • API: Component that uses the queue or http to communicate with other components and to receive http requests • Auth Manager: A python class used by all components to communicate with the backend DB or LDAP. Also, this component is responsible for users, projects and roles. • Object Store: Replication of S 3 API allowing storage and retrieval of images • Scheduler: Allocates hosts to the appropriate VMs • Network: Responsible for IP forwarding, bridges and vlans • Compute: Controls the communication between the hypervisor and VMs 15 Source: http: //blog. flux 7. com/blogs/openstack/tutorial-what-is-nova-and-how-to-install-use-it-openstack

Example Nova configurations (1/2) 16 Source: https: //wiki. openstack. org/wiki/Understanding. Flat. Networking

Example Nova configurations (2/2) 17 Source: https: //wiki. openstack. org/wiki/Understanding. Flat. Networking

Open. Stack Networking (Neutron) • Pluggable, scalable and API-driven system for managing networks and IP addresses; • Providing a variety of network services ranging from L 3 forwarding and NAT to load balancing, edge firewalls and IPSEC VPN; • Managing software-defined networking (SDN) and can be configured for advanced virtual network topologies, such as pertenant private networks and others; • Its object abstractions include networks, subnets and routers. Each has functionality that mimics its physical counterpart: networks contain subnets, and routers route traffic between different subnets and networks. 18 Source: http: //blog. flux 7. com/blogs/openstack/tutorial-what-is-neutron-how-to-install-and-use-it

Neutron setup • External network represents network that is accessible outside the Open. Stack installation. IP addresses on the Neutron external network are accessible by anyone outside the network and DHCP is disabled. • Internal networks are software-defined networks connect directly to VMs. – Only VMs on any given internal network, or those on subnets connected through interfaces to a similar router, can access VMs directly connected to that network. – Outside network to access VMs, and vice versa, requires routers between them. • Supports security groups that enable administrators to define firewall rules in groups. • Firewall-as-a-Service (FWaa. S) and Load-Balancing-as-a-Service (LBaa. S) plug-ins are available. 19 Source: http: //blog. flux 7. com/blogs/openstack/tutorial-what-is-neutron-how-to-install-and-use-it

Neutron setup example 20 Source: http: //blog. flux 7. com/blogs/openstack/tutorial-what-is-neutron-how-to-install-and-use-it

Open. Stack Storage • Block Storage – Cinder • Object Storage – Swift 21

Open. Stack Cinder • Persistent block level storage device for use with Open. Stack compute instances; • Managing the creation, attachment and detachment of block devices to servers; • Providing unified storage support for numerous other storage platforms, including Ceph, Net. App, Nexenta, Solid. Fire and Zadara; • Providing snapshot management functionality for backing up data stored on block storage volumes that can be restored or used to create new block storage volumes. 22 Source: http: //blog. flux 7. com/blogs/openstack/tutorial-what-is-cinder-and-how-to-install-and-use-it

Cinder components • cinder-api: Accepts API requests and routes them to cinder-volume for action. • cinder-volume: Responds to requests to read from and write to a block storage database to maintain state by interacting with other processes, like cinder-scheduler, through a message queue, and to act directly upon block-storage providing hardware or software. It can interact with a variety of storage providers through driver architecture. • cinder-scheduler: Picks the optimal block storage provider node to create the volume. • Messaging queue: Routes information between Block Storage Service processes. 23 Source: http: //blog. flux 7. com/blogs/openstack/tutorial-what-is-cinder-and-how-to-install-and-use-it

Cinder example 24 Source: http: //blog. flux 7. com/blogs/openstack/tutorial-what-is-cinder-and-how-to-install-and-use-it

Open. Stack Swift • Object storage system provided under the Apache 2 open source license; • Powering the largest object storage clouds, including Rackspace Cloud Files, the HP Cloud, IBM Softlayer Cloud and countless private object storage clusters; • Like Amazon S 3, has an eventual consistency architecture; – Which is in contrast against strong consistency in filesystems and block storage • All objects, or files, stored in Swift have a URL; • Applications store and retrieve data in Swift via an industry-standard RESTful http API; Source: https: //swiftstack. com/openstack-swift/architecture/ 25

Swift Overview -Server processes • Proxy server – Responsible for tying together the rest of the Swift architecture – Looking up the location of the account, container, or object in the ring and route the request accordingly – Handling failure cases • Account server – Responsible for listings of containers • Container server – Handling listings of objects – It doesn’t know where those object’s are, just what objects are in a specific container • Object server – Simple blob storage server that can store, retrieve and delete objects stored on local devices – Objects are stored as binary files on the filesystem with metadata stored in the file’s extended attributes (xattrs) 26

Swift Overview -Consistency services • • Auditors – Running in the background on every storage node and continually scan the disks to ensure that the data stored on disk has not suffered any bit-rot or file system corruption. There account auditors, container auditors and object auditors which run to support their corresponding server process; – If an error is found, the auditor moves the corrupted object to a quarantine area. Replicators – Account, container, and object replicator processes run in the background on all nodes that are running the corresponding services; – Continuously examine its local node and compare the accounts, containers, or objects against the copies on other nodes in the cluster; – If one of other nodes has an old or missing copy, then the replicator will send a copy of its local data out to that node (only push, no pull); – Handles object and container deletions. • Object deletion starts by creating a zero-byte tombstone file that is the latest version of the object. This version is then replicated to the other nodes and the object is removed from the entire system. • Container deletion can only happen with an empty container. It will be marked as deleted and the replicators push this version out. 27

Open Cirrus -A Global Cloud Computing Testbed 28

Motivation • Applications researchers in areas such as machine learning and scientific computing can get access to large-scale cluster resources, e. g. data centers provided by Amazon, Microsoft, Yahoo!, Google, and IBM. • System researchers, who are developing the techniques and software infrastructure to support cloud computing, still have trouble obtaining low-level access to such resources. • Open Cirrus aims to address this problem by providing a single testbed based on a range of heterogeneous distributed data centers for systems, applications and services. 29

Participants 30

Geo-distribution 31

High-level architectural choices • Systems versus application-only research. – Open Cirrus enables research using physical machines in addition to virtualized machines. • Federated versus unified sites – Open Cirrus federates numerous sites with various hardware, services, and tools, in contrast to a unified architecture such as Planet. Lab. • Data-center focus versus centralized homogeneous infrastructure. – Open Cirrus revolves around multiple data centers, compared to a centralized approach such as Emulab. 32

Service stack architecture • PXE: Preboot Execution Environment • IPMI: Intelligent Platform Management Interface 33

Service stack architecture -Zoni • Responsible for managing physical resources in the cluster and is crucial to providing users with bare-metal server access to conduct system research. • Provides five key functions: • • • allocation of server nodes; isolation of node groups, called domains; provisioning of key software in a domain; out-of-band server management; and debugging of allocated nodes. 34

Service stack architecture -Primary domain services • To support users working with very large data sets, a cluster storage system, in particular the Hadoop distributed file system (HDFS), is used to aggregate the storage of all the nodes in the domain. • To support a diverse set of user needs, the recommended primary domain services include a virtual machine management (VMM) layer, which provides a convenient mechanism for allocating resources to various users and services. – – – • Different sites may select any VMM service as long as it supports the EC 2 interface from Amazon Web Services (AWS). – – • Data location service (DLS) Tashi Eucalyptus Data Location Service (DLS) – • Hadoop Maui + Torque MPI a clearinghouse for data location information independent of a storage mechanism, Resource Telemetry Service (RTS) – provides a means to obtain an abstract distance measure between two location identifiers. 35

Tashi • The Tashi project aims to build a software infrastructure for cloud computing on massive Internet-scale datasets (what is called Big Data). The idea is to build a cluster management system that enables the Big Data that are stored in a cluster/data center to be accessed, shared, manipulated, and computed on by remote users in a convenient, efficient, and safe manner. • While Tashi is similar to other systems that manage logical clusters of VMs, it was developed to support research in coscheduling computation, storage, and power. http: //incubator. apache. org/tashi/ 36

Example service in Open Cirrus 37

Service stack architecture -Site utility services • A monitoring service (such as Ganglia) not only enables the site administrator to monitor the cluster’s health, it also facilitates collection of cluster operational data that may inform future research projects. • Some conventional network file system storage is convenient for storing user scripts, small data sets, and small output files. • Site utilities also include facilities for tracking resources consumed by users and managing the cluster’s power consumption. 38

basic characteristics of the current Open Cirrus sites Approximately 100 research projects at 10 sites use Open Cirrus at the systems and applications levels. 39

Open Cirrus economic model • Single site – Suppose a medium-sized company which needs the same resource as UIUC Open Cirrus site: 128 servers (1, 024 cores) and 524 Tbytes. – AWS rates: US$0. 12 per Gi. B/month and $0. 10 per CPU-hour. – Renting a cloud: • Monthly storage cost : 524 × 1, 000 × $0. 12=$62, 880 • Total monthly cost: $62, 880 + 1, 024 × 30 × $0. 10 = $136, 608 – Owning a cloud: • Amortized monthly costs: hardware (45%) + power (40%) + network (15%) • Service lifetime: M months • Monthly storage cost (assuming $300 1 -Tbyte disks) and scaling for power and networking: 524 × $300/0. 45/M=$349, 333/M • Total monthly cost: $700, 000/0. 45/M + $7, 500=$1, 555/M + $7, 500 – The break-even point • Storage: $349, 000/M < $62, 880, or M > 5. 55 months • Overall: $1, 555/M + $7, 500 < $136, 608, or M > 12 months. Conclusion: If the service runs for more than 12 months, owning the cloud 40 infrastructure is preferable to renting it. Similarly, it’s better to own storage if you use it for more than 6 months.

Open Cirrus economic model (Cont. d) • Single site – Underutilization – With X percent resource utilization, the break-even time becomes 12 × 100/X months. – Given the typical hardware lifetime of 36 months, the breakeven resource utilization is 12 × 100/X < 36, or X > 33. 3%. Conclusion: Even at the current 20% CPU utilization rates observed in industry, storage utilization greater than 47% would make ownership preferable, as storage and CPU account evenly for costs. 41

Open Cirrus economic model (Cont. d) -Federated sites Costs incurred by a single under-provisioned cloud for three options: offloading only to Amazon Web Services (existing data center), offloading to five federated clouds (Open Cirrus 6) and AWS, and offloading to 49 federated clouds (Open Cirrus 50) and AWS. 42

Comparison of cloud computing testbed 43

Cloud services • Infrastructure-as-a-Service (Iaa. S) – – • Platform-as-a-Service (Paa. S) – – • Google Apps Salesforce 37 Signals ZOHO Cloud storage – – – • Google App Engine Microsoft Azure Software-as-a-Sservice (Saa. S) – – • Amazon Web Services (AWS) Microsoft Azure Rackspace Google Compute Engine Box. net Mobile. Me (Apple) Ovi store (Nokia) Dropbox Google Drive Cloud appliances – – – Pogoplug Ctera Tonidoplug 44

Cloud service 45

Public cloud service(AWS) Infrastructure as a Service (Iaa. S) • • One of the biggest public cloud providers. Has an incredible array of cloud computing services, called Amazon Web Services (AWS), including: – – – – • • • Amazon S 3 (Simple Storage Service): cloud storage Amazon EC 2 (Elastic Compute Cloud): cloud computing Amazon VPC (Virtual Private Cloud): secure bridge between private cloud and public cloud Amazon Elastic Map. Reduce: processing data-intensive tasks Amazon Cloud. Front: content delivery Amazon RDS (Relational Database Service): cloud database Amazon SNS (Simple Notification Service): cloud notification A basic Linux server starts at $. 085 per hour and a Windows server at $. 12 per hour. For Amazon S 3 storage, $. 15 per GB/month. Amazon has a solution for huge volume of storage with their Import/Export service, which allows for secure shipping of a USB or SATA drive to Amazon to copy data into the cloud. The data should be encrypted prior to shipping to keep it secure. 46

Iaa. S-Rackspace • Has been in the hosting business since 1998 and has 9 data centers throughout the world. • Its cloud services include: – Cloudserver • Similar cloud service as Amazon EC 2. • Starting at $0. 015/ hour ($10. 95 / month). – Cloudsites • Host scalable and reliable websites • Starting at $149 / month. – Cloudfiles • Provides unlimited file storage & hosting. • Similar cloud storage service as Amazon S 3. • Starting at $0. 15/GB. 47

Public cloud service(Windows Azure) Platform as a Service (Paa. S) • Windows Azure provides what’s commonly called Platform as a Service (Paa. S). – It provides a platform that lets customers run applications without worrying about administering the environment they run in. • A simple Windows server on Microsoft’s cloud is $. 12 per hour. Storage, as with Amazon is $. 15 per GB/month. • http: //www. microsoft. com/windowsazure/resources/default. aspx? pmc=NO-CARE-01 48

Windows Azure 49

Windows Azure (Compute) 50

Windows Azure (Storage) 51

Windows Azure App. Fabric 52

Windows Azure App. Fabric (Service Bus) 53

Windows Azure App. Fabric (Access Control) 54

Windows Azure App. Fabric (Caching) 55

SQL Azure 56

SQL Azure (SQL Azure Database) 57

SQL Azure (SQL Azure Data Sync) 58

Windows Azure Marketplace 59

Windows Azure Marketplace (Data. Market) 60

Paa. S-Google App Engine • Google App Engine (Platform-as-a-Service) – Enables you to build and host web apps on the same systems that power Google applications. – The sandbox isolates your application in its own secure, reliable environment. – Each application costs $8 per user per month, up to a maximum of $1000 a month. – SDK for JAVA, SDK for Python, Plugin for Eclipse. 61

Cloud services-Cloud applications (Software as a Service, Saa. S) • Google – The Google. Apps suite for business provides email, calendaring, documents and other software for $50 per user per year. • It eliminates the need for installing and maintaining office applications like Outlook, Excel, Power Point and Word, and provides on line storage for emails and files. 62

Cloud services-Cloud applications (Salesforce) • • Provides cloud Customer Relationship Management (CRM) software solutions. Sales Cloud – Has an amount of features, including a customer database, sales lead tools, workflow, integration to desktop applications (like Office), search tools, reporting, and access to other cloud applications. – Is priced at $5 to $250 per user per month depending on the features selected. • Service Cloud – Includes customer trouble reporting and management tools, integration to social media sites like Twitter and Facebook, and other services to care for your customers. – Is priced at $65 to $265 per user per month, depending on the features selected. • Chatter – Updates on people, groups, documents, and your application data come straight to you in your real-time feeds. • Force. com – Give developers a platform to create rich, collaborative custom apps fast-without buying hardware or installing software. 63

Salesforce (Cont. d) 64

Cloud services-Cloud applications (37 Signals) • • The “sole investor” in 37 Signals is Jeff Bezos of Amazon. com. Basecamp – Project management and collaboration. – Is priced from $49/month to $149/month. • Highrise – Contact and customer management. – Is priced from $24/month to $99/month. • Backpack – Share information with the team, internal communication. – Is priced from $24/month to $149/month. • Campfire – Team collaboration with real time chat. – Is priced from $12/month to $99/month. 65

Cloud services-Cloud applications (ZOHO, Saa. S) • Zoho provides a wide, integrated portfolio of rich online applications for businesses. • Services include: 66

ZOHO (Cont. d) Screenshot 67

Cloud services-Storage • Box. net – – • cloud service that provides on line access to all your files and content, can not only store files and data, it has other services including document management, project management, plus FTP and other file transfers. Billing • Free personal option for 1 GB of online storage; • 10 GB of data $9. 99/month; • 15 GB $19. 99/month; • Business: $15/mo/user product for storing up to 15 GB/user. Apple’s Mobile. Me – – Cloud computing product. Store your email, contacts, and calendar and sync them to your i. Phone, PC, and i. Pad. – A free 60 day trial, after 60 days, Mobile. Me will run you $99/year. • • • Ovi Store Dropbox Google Drive 68

Cloud appliances (Pogoplug) • You connect one or more USB drives to the physical Pogoplug device. The Pogoplug software allows you to access the files from anywhere in the cloud, either on your network or over the Internet, with either a PC or a PDA. • Products include: – Pogoplug • £ 99 / 99€ – Pogoplug Pro • $99 • Exclusively available now at U. S. – Pogoplug Biz • $299/£ 249/€ 249 • Share massive amounts of content with clients and co-workers. 69

Cloud appliances (CTERA) • • • Provides storage and data protection for SMBs (Small and Medium Businesses) and enterprise branch offices, by combining cloud storage services with on-premises storage appliances. Access to more than 20, 000 VARs (Value-Added Resellers) and MSPs (Managed Service Providers) Products include: – Cloud. Plug • Converts any external USB/e. SATA drive into Network Attached Storage • – CTERA C 200 • Cloud Attached Storage appliance • Data is synchronized between individual PCs on the network • – with secure cloud backup, remote access and collaboration services, and allows to share and synchronize files on your local network. Approximately $200. and the C 200 drives, then backed up using CTERA's integrated online backup service. Approximately $371. CTERA C 400 • Boasts up to 8 TB of local storage space, with RAID 5/6 capability • and four hot-swappable drive bays. Retails for a price of $1, 499. 70

Cloud appliances (Tonido. Plug) • Tonido. Plug is a tiny, low-power, low-cost personal home server and NAS device powered by Tonido software that allows you to access your files, music and media from anywhere via a web browser (Powered by Tonido ® software). • Like the Pogo. Plug and Ctera C 200, it is a physical device and requires supplying and connecting a USB drive for storage. • Running on top of embedded Ubuntu Jaunty Linux OS, based on GHz ARM processor. • Price: $99. 71

Future of Cloud computing • According to Marketsand. Markets, the lucrative sector will increase from $37. 8 billion in 2010 to $121. 1 billion in 2015 at a CAGR of 26. 2% from 2010 to 2015. • Intel’s cloud 2015 vision – Federated – Automated – Client-aware 72

Future of cloud computing (Cont. d) 73

References • Virtualization for dummies. Bernard Golden. Wiley Publishing, Inc. ISBN: 978 -0 -470 -14831 -0. • Wikipedia. • http: //www. smallcloudbuilder. com/everythingelse/articles/123 -introduction-to-small-cloud-computingpart-2 • David Chappell & associates. Introducing the Windows Azure platform. 74