Cloud Computing CS 596 -015 Infrastructure-as-a-Service Iaa S

Cloud Computing, CS 596 -015 Infrastructure-as-a-Service (Iaa. S) 1

Outline n n Cloud Architecture Infrastructure-as-a-Service (Iaa. S) ¨ ¨ ¨ ¨ n Motivation Overview The Iaa. S Stack Migration Strategy What to Watch for? VM for Iaa. S Environment Infrastructure Services Effect of Virtualization & Cloud Computing on Data Centers Summary and Conclusion 2

Cloud Architecture 3

Cloud Architecture e. g. , Web browser Saa. S , e. g. , Google Docs Paa. S, e. g. , Google App. Engine Iaa. S, e. g. , Amazon EC 2 4

Cloud Architecture Paa. S Iaa. S Amazon EC 2 Clients can rent virtualized hardware, can control the software stack on the rented machines Microsoft Azure Clients can choose languages, but can’t change the operating system or runtime Google App. Engine Provides a programmable platform that can scale easily 5

Iaa. S: Motivation - On-Premise Application Lifecycle 6

Iaa. S: Overview n n n Iaa. S Platform should allow you to automatically provision servers, storage, and network elements with flexible billing options Iaa. S should provide “building blocks” that allow you to shape your infrastructure to fit your changing needs of your business and to respond quickly as needs change Benefits: ¨ ¨ ¨ No upfront cost Multi-tier auto provisioning within hours Scalability, services/resources are provided on demand Flexible/Secure direct connectivity SLA with 99. 9% uptime 7

Iaa. S: Overview n Iaa. S provides an environment for running user built virtualized systems in the cloud 8

Iaa. S: The Stack n n Many players; the cloud is just beginning In the future, expect to see all large vendors riding on the complete stack 9

Iaa. S: Migration Strategy: Staged or Direct Migration Virtualized Instance P 2 V Hardware V 2 V Public Cloud P 2 V Virtualized Instance Hardware Virtualized Instance V 2 V Hardware Private Cloud 10

Iaa. S: What to Watch For? n n n Check your security policies can be satisfied by the Cloud provider Does the SLA meet availability requirements? You are now porting your OS and upper stack ¨ You will need to maintain it Remember the Cloud is its infancy It’s immature We all have lots to learn 11

Iaa. S: Building VM for an Iaa. S Environment n n n Runtime environment is shown to the RHS Once a VM is uploaded to an Iaa. S Environment, it can be configured to use the Iaa. S’s raw storage VM is ready to run and the application within it Building application to run in an Iaa. S is similar to building it to run on premise Developers use familiar tools, programming languages, and any needed licensed products (DBMS, workflow, etc. ) Once app development is completed, the application and any licensed software installed on a VM; VM is thought of as a container that insulate the app from the runtime environment 12

Iaa. S: Inside VM Built for an Iaa. S Environment 13

Iaa. S: Infrastructure Services n n Iaa. S can be viewed as three categories: Servers, Storage and Connectivity Cloud Providers would offer virtual Server instances on which the customer can install and run a custom image. Persistent storage is a separate service which the customer can purchase. Finally, several offerings for extending connectivity options Amazon is the de-facto standard for Iaa. S. Most Iaa. S offerings are either complements to Amazon Web Services (AWS) or competitive to them There is an open source equivalent to AWS and roughly compatible to its APIs, Eucalyptus (Elastic Utility Computing Architecture for Linking Your Programs To Useful Systems); shipped with Ubuntu since version 9. 4 14

Iaa. S: Infrastructure Services n Servers: ¨ ¨ ¨ Servers represent compute resources along with minimal storage and IO channels Server outsourcing model is divided into three allocation options: (1) Physical, (2) Dedicated Virtual, and (3) Shared Virtual Physical means dedicated hardware. Dedicated Virtual means dedicated hardware but with a hypervisor so the customer can run multiple OS. Shared Virtual are exposed to customers as pool of VMs Amazon is Shared Virtual, each is based on Amazon Machine Image (AMI). Customer can use pre-packaged AMIs from Amazon or build their own A challenge for Virtual servers is that they do not maintain local storage; any configuration information has to be stored externally 15

Iaa. S: Infrastructure Services ¨ n Some offerings such as Rackspace Cloud offers local persistent storage as well as large pool of dedicated IP addresses on all instances Storage: Moving from storage Networks (SAN) to Storage-as-a-Service. It is characterized by a location-agnostic, virtualized data store with the illusion of infinite capacity while easy to use. q Storage services are also useful for archiving, content delivery, disaster recovery, and web application development q To cater to cloud, vendors like EMC with their Atoms product, have begun to deliver h/w and s/w that is specifically designed for geographically dispersed content depots with replication, versioning, de-duplication, and compression capabilities q 16

Iaa. S: Infrastructure Services q q q On-demand storage services, relevant factors include persistence, replication, and access speed and latency Due to synchronization requirements of Content Delivery Networks (CDN - Akamai), you may observe very different speeds for Read and Write data Amazon offers two persistent storage capabilities: (1) S 3 (Simple Storage Service) and (2) EBS (Elastic Block Storage) Amazon AMI do not have persistent storage but locally mounted disks can be used for logs, interim data, etc. S 3 is accessible through REST and SOAP APIs. It offers distributed, redundant buckets that are replicated using Amazon’s Cloud. Front CDN across Europe, Asia, and US. S 3 can accommodate data sizes from 1 Byte – 5 GB and provide permissions for access control based on AWS authentication 17

Iaa. S: Infrastructure Services S 3 provides versioning so that customers can recover accidently deleted or overwritten objects q EBS is intended for high-performance virtual hard disk. It can be formatted as a file system and then mounted on any EC 2 instance. The size can range from 1 GB – 1 TB. q Amazon provides a mechanism to store an EBS snapshot in S 3 for long term durability q Other storage services include: q The Rackspace Cloud: similar to S 3 with REST Access API q Go. Grid: no access API; mechanisms such as secure Copy (SCP), FTP, Samba and rsync q Layered. Tech: The Dynavol service supports mirroring and many access mechanisms in cluding: HTTP, FTP, SSH, SCP, rdiff, rdist, rsync, and smbfs q 18

Iaa. S: Infrastructure Services Hadoop HDFS: partitions large files across several network hosts. It delivers blocks of data over the network using propitiatory protocol or HTTP for browser access. Data nodes communicate with each other to rebalance data and to maintain replication of data high (default is 3) q Amazon also provides Cloud Database (Amazon Simple DB) for structured data. While data is tabular, it is not conformant and doe not support JOIN, foreign keys, triggers, and stored procedures q Simple DB does not use schema; instead it defines “domains” with items that consist of up to 256 attributes and values. Value can be from 1 B to 1 KB. Simple DB supports simple operators. Queries are confined to a single domain q 19

Iaa. S: Infrastructure Services Simple DB does not use schema; instead it defines “domains” with items that consist of up to 256 attributes and values. Value can be from 1 B to 1 KB. Simple DB supports simple operators. Queries are confined to a single domain q Other interesting data services include: q Google Big Table: extremely large scale DBMS in the PB range q Dynamo: Amazon’s version of Big Table q Cassandra: Facebook distributed storage system q n Network: q Amazon EC 2 instance will receive single DHCP (Dynamic Host Configuration Protocol) address. Additional addresses, static or persistent domain addresses, can be requested separately 20

Iaa. S: Infrastructure Services q q q Two other network-related functions are available: (1) provisioning for network segmentation and mechanism to bridge segments. (2) Load balancing. Amazon allow customers to define firewalls which restrict the inbound/outbound traffic to specific IP range and port numbers Other Cloud providers, such as App. Nexus, provides each customer with a private VLAN, i. e. , avoids being exposed to broadcast traffic Amazon Virtual Private Cloud, 2009, enhances and secures connectivity between cloud services. It allows an Enterprise to create a VPN between the Enterprise and Amazon AWS Once connectivity is established, the next task is ensuring that it performs! Two factors defining network performance: (1) latency. (2) Throughput or bandwidth available from the network 21

Iaa. S: Infrastructure Services q n Many providers offer Load Balancing capability. One option is to use a DNS Round-Robin that involves adding multiple IP addresses to the same DNS Domain. Alternatively is to use either software or hardware load balancer Integration: After setting the network connectivity, next step is to configure the application to be able to exchange data. In theory, Iaa. S is not the right level to facilitate integration; it is rather an added value provided by many of the Cloud providers q Amazon provides Simple Queue Service (SQS): it is unlimited number of queues and messages with message size is up to 8 KB. q Apache Hadoop provides a framework for tightly coordinated interaction of applications (Job Tracker, Task Tracker) q 22

Iaa. S: Infrastructure Services n Management: Iaa. S components are managed through the vendor virtualization facilities. Depending on the hypervisor used, there are 3 rd party and native components for Xen, Vmware, Hyper-V, KVM, etc. q In addition, there may be an umbrella management framework such as BMC Patrol, CA Unicenter, IBM’s Tivoli, etc. q For Public Cloud, there are services that help manage established infrastructure providers: Elastra, Right. Scale, en. Stratus, etc. which provides F/Es for managing Amazon EC 2 as well as other Iaa. S offerings q n Payment and Billing: q Monetization of utilities-based services relies on: (1) fine grained metering. (2) Simple and trustworthy payment system 23

Iaa. S: Infrastructure Services q q q Many Cloud offerings are from international communication giants such as BT, NTT, etc. e. Commerce companies are also visible in that space such as Pay. Pal Still many Cloud providers developed their own instrumentation and billing system Iaa. S is frequently used as Saa. S enabler, i. e. , not providing only raw compute, storage, and network resources but also help to facilitate Saa. S with payment and billing services Amazon Flexible Payments Service (FPS) is a service for developers, that leverages Amazon’s sophisticated retail billing system. The customer can use the same identity, shipping details and payment information as they would for ordering directly with Amazon 24

Iaa. S: Effect of Virtualization and Cloud Computing on Data Centers n Multi-tier hierarchical networking structure: Typically 3 -4 layers including access layer switches, aggregation switches, and core switches. These core switches usually contain the vast majority of the intelligence in the network 25

Iaa. S: Effect of Virtualization and Cloud Computing on Data Centers n Today’s applications are more distributed, often multitiers, and are oriented toward service delivery n The above applications architecture results in: Greater network traffic on the Ethernet network, including storage traffic such as i. SCCI q More storage traffic as applications use distributed file system q Higher server-2 -server traffic or VM-2 -VM traffic q 26

Iaa. S: Effect of Virtualization and Cloud Computing on Data Centers n Limitations of hierarchical networking structure: The more network traffic, the more limitations with hierarchical networks including: Spanning Tree Protocol (STP) Limitations: STP detects and prevents loops in L 2 networks by allowing only one active path from one switch to another q Oversubscription: is an issue in the aggregation layer, e. g. Cisco Universal Computing System (UCS) may have oversubscription rates of anywhere from 4: 1 to 32: 1 in the aggregation layer! q Port Extension Technology: IEEE is developing a “port extender, ” which is physical switch with limited functionality q Latency: can be more of a challenge than oversubscription and row bandwidth; due to the nature of traffic within an application q 27

Iaa. S: Effect of Virtualization and Cloud Computing on Data Centers 28

Iaa. S: Effect of Virtualization and Cloud Computing on Data Centers n Changing Business Applications: 29

Iaa. S: Effect of Virtualization and Cloud Computing on Data Centers n Server Virtualization (VM): q Increase in VM density and with more powerful CPU & memory subsystems resulted in greater performance demand on the network subsystem at the server-network edge. q Moving workloads dynamically requires VMs to stay within a common VLAN in the same layer-2 30

Iaa. S: Effect of Virtualization and Cloud Computing on Data Centers 31

Iaa. S: Effect of Virtualization and Cloud Computing on Data Centers n Client Virtualization (Virtualized Desktop Infrastructure VDI): q a specialized type of VM is the client virtualization technology such as Virtual Desktop Infrastructure (VDI). VDI creates a client desktop as a VM. The VDI instance is more than simple VM, it includes real-time compilation of the enduser’s data, personal settings, and application settings with a core OS instance and a shared generic profile. q Applications and user personality are injected into the core desktop VM, and a brokering mechanism manages connecting the end-users to the VM 32

Iaa. S: Effect of Virtualization and Cloud Computing on Data Centers 33

Summary and Conclusion n n Cloud architecture consists of Iaa. S, Paa. S, and Saa. S Iaa. S is the foundation of Cloud Computing Virtualization is central technology for Iaa. S provides set of services: Servers, Storage, Network, Integration, Management, and Payment/Billing Virtualization and Cloud has a significant impact on the Data Centers 34

END 35