1 / 14

Fair & Elastic Resource Allocation in Cloud Computing Environments

Fair & Elastic Resource Allocation in Cloud Computing Environments. GT : Mukil Kesavan , Ada Gavrilovska , Karsten Schwan VMware : Orran Krieger, Irfan Ahmad, Ravi Soundararajan. Goals. Scalable resource management ~ 10k hosts Load-Balance Resource Consumption

jessica-blanchard
Download Presentation

Fair & Elastic Resource Allocation in Cloud Computing Environments

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Fair & Elastic Resource Allocation in Cloud Computing Environments GT: MukilKesavan, AdaGavrilovska, KarstenSchwan VMware: Orran Krieger, Irfan Ahmad, Ravi Soundararajan

  2. Goals • Scalable resource management ~ 10k hosts • Load-Balance Resource Consumption • Work for Broad Class of Workloads • Elasticity: Demand based allocation of resources

  3. Cloud Architecture CC CC CC CC Cluster Cluster Cluster Cluster Cluster Cluster Cluster Cluster

  4. Imbalance across Cloud CC CC CC CC CC Cluster Cluster Cluster Cluster Cluster Cluster Customer Customer Customer Customer Customer Customer

  5. Dealing with Imbalance CC CC CC CC Customer Customer Customer Customer Cluster Cluster Cluster Cluster

  6. Automation Actions • Move capacity across management hierarchy • Preserve association of VMs to management agents • Granularity: Hosts • Deploy existing centralized solutions with management agents

  7. Hierarchical RM Architecture CCC Cloud RM Auto CC CC CC CC RM Auto CC RM Auto CC RM Auto Cluster Cluster Cluster Cluster Cluster Cluster RM scalability achieved by two additional levels of automated load balancing

  8. Algorithm Design • Resource Demand based allocation • Measure, Aggregate & Predict • Honor Static Constraints • Reservations, Limits, Fault Tolerance etc. • Time Scales of Operation • Scalability • Host Selection

  9. DNS DHCP Server Server Techway Infrastructure Setup VMs/Apps APP APP APP APP APP OS OS OS OS OS Infra. Software PXE vSphere Client Server Hosts NFS SNMP Force 10 Switch RAID Array Sensors

  10. Load Balancing Testbed Out-of-Band Perf. Validator Cloud Resource Manager VM Resource Allocations VM VM VM VM VM VM VM VM VM VM VM VM VM VM VM VM VM VM VM VM VM VM VM VM VC (250 Hosts) VC (250 Hosts) VC (250 Hosts) Cloud Workload QoS Metrics Clus Clus Clus Clus Clus Clus 750 Hosts Cloud Workload VMs

  11. Benchmarks • VMMark • Hadoop • Nutch: Map-Reduce Web Search • Voldemart/YCSB: Distributed K/V Store • Linpack HPL: MPI Based HPC Code • Berkeley CloudStone: Self-Scaling Web

  12. Evaluation Plan • Cloud Resource Utilization • Load Imbalance across CCs & Clusters • Workload Quality Metric (e.g. Search Query Time) • Algorithm Overhead – Resource Consumption

  13. Other Research Projects • Storage I/O Allocation with Isolation at the App Level • Black-box Monitoring & VM Ensemble Detection • Power-centric Mgmt & Billing • Generic, Flexible Management Overlays

  14. Thank You

More Related