Private Cloud at Wipro

Cloud computing based on Condor

© 2009 Wipro Ltd - Confidential

 Agenda

1 Background

2 Wipro Private Cloud

3 System architecture

2 © 2009 Wipro Ltd - Confidential

 Background
Need:
• Share physical infrastructure between multiple projects and CoE's (Center of
Excellence) to reduce server sprawl and number of physical labs
• Provide an environment for evaluating new technologies, developing solutions and
enabling collaboration between multiple labs
• Centralize infrastructure procurement and management
• Reduce infrastructure cost of CoE's by enabling multiple development
environments

Solution:
• Setup a private cloud for virtual compute and application infrastructure
• Build a self-service portal for on-demand provisioning to reduce process overheads
• Support multiple types of virtualization software
• Reuse existing physical infrastructure, procure minimal new infrastructure

3 © 2009 Wipro Ltd - Confidential

 Wipro Private Cloud

4 © 2009 Wipro Ltd - Confidential

 Wipro Private Cloud
Wipro Users
SaaS
User Intranet Developers

SaaSApp

SaaS Mgmt
Virtual Lab
SaaS Enablers

Managed
Managed
Network
Network

Wipro Cloud Portal / Web Services API Layer

Wipro Cloud Core

• Virtual Machines • Automated Provisioning Cloud

OA&M Portal
• Shared Storage • Multi-tenancy & Isolation Admin
• Virtual Appliances • Cloud Accounting & Auditing

Cloud
• Application Services • Performance & Fault Monitoring
• Automated Network & Security

Physical Resource Pool

- Servers, Storage, Network

5 © 2009 Wipro Ltd - Confidential

 Cloud Services catalogue

Service Element Service Feature

Virtual desktop – equivalent to 1.2GHz,512MB RAM,10GB HDD,25Mbps N/w

Compute Servers Low End Server – equivalent to 2x1.2GHz, 2GB RAM, 20GB HDD, 25Mbps N/w
High End Server – equivalent to 4x1.2GHz, 4GB RAM, 40GB HDD, 25Mbps N/w

OS types Linux (CentOS, RHEL) and Windows XP/Server on Intel x86, x86_64 architecture

ISCSI (RAID 5), NFS and CIFS

Storage Data persistence across power-off, suspend & resume of VM’s
Ready-to-use public images
Public images/  RHEL 5, Windows XP, LAMP (CentOS 5.2, Apache, Axis, Tomcat, MySQL,
appliances PHP, Python)
Preconfigured Software load balancer, firewall appliances
Isolation between CoE's resources
Network IPSec, SSL based VPN
Public and Private IP Addresses with NAT support

Private images Can Upload VMware Server, VMware ESX and Xen Virtual Machine Image formats

Reports Reporting on CPU, Storage and memory usage back to user

6 © 2009 Wipro Ltd - Confidential

 Levels of Service

• L1 - Virtual Servers on demand

• Virtual servers, desktops, storage
• Migration assistance
• Self-service portal
• L2 – Application infrastructure on demand
• Appliances of standard software
• Managed backup, proactive monitoring and help-desk
• Itemized billing and charge-back
• L3 – Business service infrastructure on demand
• Scalable business services
• Multi-tenant application infrastructure (content management,
identity management, database, load balancer, firewall, ...)

7 © 2009 Wipro Ltd - Confidential

 System Architecture

8 © 2009 Wipro Ltd - Confidential

 Private Cloud – in Action
Customer
Developers Business Users
OA & M Access Operations

•Configuration &
OA&M Portal & Change mgmt
•Design, Test Web Service
•Package, Deploy Network Control Gateway Alarms

Cloud Management
Service design Service

Provisioning
•SLA’s, Policies, rules,
Layer Service
priorities
•Packaging

Monitoring
•Custom agents Load LB - Active LB - passive
•Shared Services Balancer
•Billing parameters

App Inst 1 Inst 2 Inst n

Layer

Virtual M/c design Virtual

•Standardize Machine VM 1 VM 2 VM n
•Automate Layer
•Agile
•Caching
•Appliances
Provisioning Monitoring Management
•Resource mgmt •Performance •Service Governor
Bare-metal design •Workload mgmt •Availability •Policy enforcement
•Standardize Bare-metal •Alarms
•Auto recovery •Incident mgmt
•Automate Layer •Billing
•Task & Process •Optimizer
•Re-provisioning
Automation •Contention

9 © 2009 Wipro Ltd - Confidential

 Architecture & Service layers

Cloud service

10 © 2009 Wipro Ltd - Confidential

 System Components

Web Service
Customer Portal
Gateway

Charge-back Service Governor Alerts VM Caching

Workflow
Metrics Monitor Grid Scheduler Cloud State
Manager

N/W Plug- Storage Bare-metal Nagios

VM Plug-in VM Repo
in Plug-in Plug-in plug-in

N/W Storage Bare-metal VM N/W (nagios) Identity

provisioning provisioning provisioning provisioning Monitoring Management

Legend: Developed in Wipro In Development 3rd Party components

11 © 2009 Wipro Ltd - Confidential

 Deployment Example

Project X
Router, firewall
192.168.5.0/24
VPN Server, IPS, IDS, NAT
VM Project Y
192.168.6.0/24

Virtual VM
Virtual Project Z
Storage
Machines 192.168.7.0/24
Cloud Backbone
10.201.72.0/24 VM

Isolated
network per
Storage project
Mgmt Server
HA Pair
Switch Fabric
Cloud physical systems

Cloud Mgmt
192.168.3.0/24

12 © 2009 Wipro Ltd - Confidential

 Use of Condor

13 © 2009 Wipro Ltd - Confidential

 Why Condor?
• Trusty old features
– Flexibility – ClassAd mechanism, configurations and policies
– Web Services API
– High availability
– Resource utilization of jobs
• Newer features we like
– VM Universe
– Partitionable Slots
– Lease management
– Integration with Amazon EC2 (public cloud)
• Proven in large scale deployments
• Condor-users and condor-admin support
• Open source

14 © 2009 Wipro Ltd - Confidential

 How are we using Condor?

• Mostly standard configuration

• A few custom class ads in jobs and machines
• Schedd and Collector configured in HA mode
• Condor spool for VM persistence
• Virtual machine provision request handled by Condor
– VM job to physical machine match-making, file transfer
• Partitionable slots for dynamic partitioning of physical machine
resources
• Customized condor_vm_* files for configuring and starting VM's
– VLAN control, Swap disk and additional storage creation, ...
• Lease management for limiting the number of running instances
of a licensed image

15 © 2009 Wipro Ltd - Confidential

 Observations, Workarounds, Wish list

Working with Condor:

– With advanced Condor skills, a lot can be achieved without modifying
condor code
Workarounds:
– Passing number of virtual CPUs to VMware
– Patch to pass proxy username and password to gSOAP for EC2 integration
– Patch to get VM resource usage details on ESX
– Special configuration to handle 2 hour delay in detecting a few execute
node failures (Thanks Todd!)
Feature wish list:
– Remote IWD support for VM universe, to avoid any file transfer
– Live migration of VM jobs

16 © 2009 Wipro Ltd - Confidential

 Thank You

nitin.narkhede@wipro.com
sateesh.potturu@wipro.com

© 2009 Wipro Ltd - Confidential