Professional Documents
Culture Documents
VSphere 6.0 Architecture Overview
VSphere 6.0 Architecture Overview
VSphere 6.0 Architecture Overview
0
Knowledge Transfer Kit
Architecture Overview
Agenda
Architecture Overview
VMware ESXi
Virtual machines
VMware vCenter Server
New Platform Services Controller
Recommendations
VMware vSphere vMotion
Availability
VMware vSphere High Availability
VMware vSphere Fault Tolerance
Content Library
VMware Certificate Authority (CA)
Storage
iSCSI Storage Architecture
NFS Storage Architecture
Fibre Channel Architecture
Other Storage Architectural Concepts
Networking
Scheduler
2
Architecture Overview
Manage
Application
Services
VMware
VMware vSphere
vSphere vMotion
vMotion
VMware
VMware vSphere
vSphere Storage
Storage
vMotion
vMotion
VMware
VMware vSphere
vSphere High
High
Availability
Availability
VMware
VMware vSphere
vSphere FT
FT
VMware
VMware Data
Data Recovery
Recovery
Scalability
Cluster
Storage
Infrastructure
Services
ESXi
ESXi
ESXi
vSphere VMFS
VMware Virtual
Volumes
VMware Virtual SAN
Thin Provisioning
VMware vSphere
Storage I/O Control
Network
Standard
Standard vSwitch
vSwitch
Distributed
Distributed vSwitch
vSwitch
VMware
VMware NSX
NSX
VMware
VMware vSphere
vSphere
Network
Network I/O
I/O Control
Control
Physical Resources
App
vRealize
Application
Blueprinting
App
Deployment
Services
Standardizati
on
Infrastructure Service
TEXT
Catalogs and
Self-Service
Low Admin
StandardAutomation
VMware vRealize
User Portal
Overhead
Templates
SDDC Foundation
VMware
Core
vSphere
Virtualization
Monitoring
vRealize
with
Operations
Performance
vSphere
Manager
and
Capacity
Infrastructure
Cloud
App
Publishi
ng
Cloud Ready
Orchestratio
vRealize
n
with
Orchestrator
Workflow
Library
Navigator
Hyperic
Software-Defined
Software-Defined Networking
Networking
vRealize Log
vRealize Log
Virtualization of
Physical
Assets
Insight
VMware
Virtual
SDS
SAN
VMware
SDN
NSX
vRealize
Compliance
Config.
Manager
SRM
VR
BCDR
vDPA
VMware
VMware
Hybrid
Financial
vCloud
vRealize
Cloud
Connector
Business
5
VMware ESXi
ESXi 6.0
ESXi is bare metal VMware vSphere
Hypervisor
ESXi installs directly onto the physical
VMware ESXi
host
7
ESXi Architecture
CLI Commands
for Configuration
and Support
ESXi Host
Agentless
Systems
Management
Agentless
Hardware
Monitoring
VMware
Management
Framework
Common
Information
Model (CIM)
VMware
Management
Framework
VMware
Management
Framework
VMkernel
Virtual Machines
Virtual Machines
Virtual Machine
App
App
App
Operating System
virtualized
CPU
RAM
Keyboard
Mouse
Disk
Network /
Video Cards
SCSI
CD / DVD
Controller
ESXi Host
10
vSphere environments
Provides much of the feature set that comes
with vSphere, such as vSphere High
Availability
Also provides SDK access into the
environment for solutions such as VMware
vRealize Automation
vCenter Server is available in two flavors
vCenter for Windows
vCenter Server Appliance
parity
A single vCenter Server 6.0 can manage
1000 hosts
10,000 virtual machines
13
14
External
Platform Services
Controller
Embedded
Platform Services
Controller
15
VMware KB article, List of Recommended topologies for vSphere 6.0 (2108548 (http
://kb.vmware.com/kb/2108548)
16
17
Description
Scalability
Maximum
Maximum Platform Services Controllers per vSphere site (behind a single load
balancer)
1,000,000
10
18
Additional Services:
Database
Server
Core and
Distributed
Services
User
Access
Control
VMware
vSphere
API
VMware vSphere
Client
Microsoft Active
Directory Domain
Third-Party
Applications
ESXi Management
Plug-Ins
ESXi hosts
vCenter Server
Database
19
TCP 443
vpxd
TCP
443, 9443
TCP/UDP
902
TCP/UDP
902
hostd
vpxa
ESXi Host
20
vSphere vMotion
vSphere vMotion allows for live migration
NEW
NEW
NEW
Over long distances
as long as RTT is
<100ms
22
following components
23
ESXi Host 1
ESXi Host 2
VM A
VM A
Memory
Bitmap
vMotion
Network
Memory Pre-Copy
Production
Network
VM End User
24
ESXi Host 1
VM A
VM A
Memory
Bitmap
vMotion
Network
Checkpoint Data
Production
Network
VM End User
25
Read/Write
I/O to Virtual
Disk
It works as follows
1. Initiate storage migration
2. Use the VMkernel data mover or VMware
VM
VM
Mirror Driver
VMkernel
Data Mover
Source Datastore
VAAI
Destination Datastore
ESXi
Host
Datastore
Network
vCenter
Network B
VMware ESXi
VMware ESXi
vCenter
Server
vCenter
Server
27
Availability
VMware vSphere High Availability
VMware vSphere Fault Tolerance
VMware vSphere Distributed Resource Scheduler
Performance
Maintain standard vSphere
vMotion guarantees
29
Availability
VMware vSphere High Availability
NEW
Infrastructure
Connectivity
Application
Host failures
Host network
isolated
Guest OS
hangs/crashes
VM crashes
Agents on the
Datastore incurs
Application
PDLhosts
or APD monitor
hangs/crashes
ESXi
for the
event
31
Network heartbeats
Storage heartbeats
Master
32
Master
33
Master
Master declares
slave host dead
34
Master
Master
36
Master
37
Master
38
Master
39
Availability
VMware vSphere Fault Tolerance
vSphere FT
vSphere FT is an availability solution that
learning
Supports up to 4 NEW
vCPUs in VMs with
vSphere 6.0
Uses fast check pointing rather than
record/replay functionality
41
vSphere FT Architecture
vSphere FT creates two complete virtual machines when enabled with vSphere 6.0
This includes a complete copy of
VMX configuration files
VMDK files including the ability to use separate datastores
Primary VM
Secondary VM
.vmx file
VMDK
VMDK
Datastore 1
VM Network
.vmx file
VMDK
VMDK
Datastore 2
VM Network
42
VM A
ESXi Host 2
VM A
Memory
bitmap
vSphere FT
Logging network
Production
network
VM End User
43
Availability
VMware Sphere Distributed Resource Scheduler
DRS
DRS
VMware DPM
VMs
Can be used in three ways
Fully automated where DRS acts on
recommendations automatically
Partially automated where DRS only acts for initial
45
DRS Architecture
ESXi Host 1
ESXi Host 1
ESXi Host 2
ESXi Host 2
ESXi Host 3
ESXi Host 3
ESXi Host 1
ESXi Host 2
ESXi Host 2
ESXi Host 3
ESXi Host 3
nd
Sta
ost
H
by
47
Content Library
Content Library
The Content Library is new to vSphere 6.0 and is a distributed template, media and script
Similar to the VMware vCloud 5.5 Content Catalog and VMware vCloud Connector Content
Sync
Tracks versions for generational content, cannot be used to revert to older versions
vCenter
vCenter
3
21
Content Library
(Publisher)
2
1
2
1
2
3
Content Library
(Subscriber)
Subscribe
Sync
1
2
2
1
49
Templates
vCenter
HTTP GET
Other
Transfer Service
Transfer Service
Content Library Service
vCenter
HTTP GET
Transfer Service
Content Library Service
VCDB
lib.json
items.json
VMware Content
Subscription Protocol
(vCSP)
item.json
Transfer Service
Content Library Service
VCDB
51
In vSphere 6.0, the various listening ports have been replaced with a single endpoint
Reverse
Web Proxy
(port 443)
vCenter
Server
Service
Inventory
Service
vCenter
Single
Sign-On
vSphere
Web Client
vSphere
Update
Manager
Storage
Policy
Service
This is the reverse HTTP proxy, which will route traffic to the appropriate service based on the
type of request
An instance of the VMware CA is included with each Platform Services Controller node
Issues certificates for VMware components under its personal authority in the vSphere eco-
system
VMware CA issues certificates only to clients that present credentials from VMDirectory in its
It also posts its root certificate to its own server node in VMware Directory Services
54
55
in key stores
56
Solution key-stores
Following key stores hold private keys and solution user certificates
Machine Account Key Store (Platform Service Controller, Management, Embedded nodes)
VPXD Key Store (Management, Embedded nodes)
VPXD Extension Key Store (Management, Embedded nodes)
VMware vSphere Client Key Store (Management, Embedded nodes)
57
Storage
iSCSI Storage Architecture
NFS Storage Architecture
Fibre Channel Architecture
Other Storage Architectural Concepts
Storage
Both local and/or shared storage are a core
VMware
ESXi
hosts
vSphere
Local disks
Datastore
types
NFS
File
system
NAS SANs
Virtual SAN
Virtual Volumes (VVOLs)
Storage
technology
Local
Disks
FC
FCoE
iSCSI
VSAN
or
VVOL
NAS
59
Supports Boot
from SAN
Supports
Supports
VMware vSphere vSphere High
vMotion
Availability
Supports DRS
Supports Raw
Device Mapping
Fibre Channel
FCoE
iSCSI
NFS
Direct Attached
Storage
Virtual SAN
VMware Virtual
Volumes
60
Storage
iSCSI Storage Architecture
62
access
63
64
Storage
NFS Storage Architecture
Directory to share
with the ESXi host
over the network
VMkernel port
defined on virtual
switch
66
192.168.81.33
configurations
192.168.81.72
VMkernel port
configured with
IP address
67
Storage
Fibre Channel Architecture
The exception here is when using Fibre Channel over Ethernet (FCoE)
69
70
Hardware FCoE
Software FCoE
ESXi Host
Network
Driver
Network
Driver
FC
Driver
Converged
Network
Adapter
10 Gigabit
Ethernet
are allowed
Hardware adapters are often called
NIC
with FCoE
Support
FCoE Switch
Software
FC
Ethernet IP Frames
to LAN Devices
LAN
FC Frames to FC
Storage Arrays
FC
SAN
71
Storage
Other Storage Architectural Concepts
Multipathing
Multipathing enables continued access to
73
Data
Mining
With
With vSphere
vSphere
Storage
Storage
I/O
I/O Control
Control
Without
Without vSphere
vSphere
Storage
Storage I/O
I/O
Control
Control
Print
Server
Online Microsoft
Store Exchange
Data
Mining
Print
Server
Online
Store
Microsoft
Exchange
storage infrastructure
Monitors device latency and acts when it
74
Datastore Clusters
A collection of datastores with shared resources similar to ESXi host clusters
Allow for management to be done as a shared management interface
Storage DRS can be used to manage the resource and ensure they are balanced
Can be managed by using the following constructs
Space utilization
I/O latency load balancing
Affinity rules for virtual disks
75
Software-Defined Storage
Software-defined storage is a software
center
Both Virtual Volumes and Virtual SAN are
76
Networking
Networking
Networking is also a core resource for vSphere
Two core types of switches are provided
Standard virtual switches
Virtual switch configuration for a single host
Networking Architecture
VM1
VM2
VM3
Management
Network
VMkernel
79
Distributed vSwitch
80
81
storage infrastructure
Monitors device latency and acts when it
82
Software-Defined Networking
Software-Defined Networking is a software
of traffic
Key tenant to the software-defined data
center (SDDC)
83
Questions
84
VMware, Inc.
3401 Hillview Ave
Palo Alto, CA 94304
Tel: 1-877-486-9273 or 650-427-5000
Fax: 650-427-5001