Professional Documents
Culture Documents
HP - File or Block - Choosing Storage Protocols
HP - File or Block - Choosing Storage Protocols
HP - File or Block - Choosing Storage Protocols
Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
BUILD
Whats Next
ACCELERATE
Time to Results
MSA
EVA
XP
Tape
StoreOnce
LeftHand
IBRIX
3PAR
ESTABLISHED PLATFORMS
2 Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
CONVERGED STORAGE
Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Block or file?
Choosing the right storage for a VMware virtualized environment Eric Siebert, Solutions Manager June 2012
Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Agenda
1. Storage requirements of VMware environments 2. Overview of storage protocols 3. Strengths & weaknesses of each storage protocol for VMware environments 4. Storage protocol myth busting 5. Which storage protocol is right for you 6. Q & A
Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Fiber Channel
iSCSI
NAS/NFS
DAS
Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
High Efficiency
Highly efficient to optimize storage costs
Simple Management
Integrated management features
High Availability
Highly available, no single points of failure
Certification
Tested and certified with vSphere
7 Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Integration
vSphere API and SRM integration,
Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
File protocols
Storage device manages file system Data is written/read into variable length files Remote storage referred to as NAS Often thin provisioned by default Disk configured through file system, assigned shares that map to folders Requires a client to access, storage device sends SCSI commands to disk
Typical implementation:
10
Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Fiber Channel
Advantages
Commonly deployed enterprise storage architecture, many environments may have existing SANs that they can utilize Typically best performing storage due to higher available bandwidth & lower latency Isolated FC fabrics are more secure, LUN zoning & masking is often used to control access Able to boot from FC storage so no local host storage is needed (Boot from SAN) Block level storage that can be used with vSphere VMFS volumes & RDMs
Disadvantages
Typically more expensive to implement from scratch Requires specialized components such as switches, cables and host bus adapters Can be complex to implement and manage, typically requires dedicated storage administrators Less security controls available, authentication and encryption is complicated to implement
11
Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
iSCSI architecture
Block storage like Fiber Channel but uses traditional Ethernet network components Uses initiators (hardware/software) to send SCSI commands to targets Software initiators use traditional NICs, hardware initiators use special NICs w/ TOEs Provides benefits of block storage with reduced cost & complexity iSCSI shares similarities to both Fiber Channel & NFS Block storage like FC, can use HBA, uses software client and same components as NFS Easy to implement and manage, so easy a server admin could do it Performs very well on 1Gbps networks, 10Gbps can really give it a huge boost
Typical implementation:
12 Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Disadvantages
Slight additional host CPU overhead when using software based storage initiators Performance is typically not as great as that of Fiber Channel SANs May not achieve very large scale as Fiber Channel Network latency can reduce performance
13
Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
NAS architecture
NAS devices provide file-based data storage services, can be dedicated or an OS service NAS uses file-based protocols such as NFS, SMB/CIFS, FTP or AFP NAS provides both storage and a file system, off-loads storage device functions from the host server NFS uses software client built into hypervisor that uses host NIC to communicate with NFS server Provides file-based datastore to a host, cannot use VMFS or RDMs Added to a host by selecting Network File System, then choosing a NFS server and a folder NFS doesnt support multi-pathing, only a single TCP session will be opened to an NFS datastore NFS uses the network stack not the storage stack for high availability and load balancing by using NIC teaming and link aggregation
Typical implementation:
14
Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Disadvantages
Booting directly from a shared storage device isnt supported with NFS devices CPU overhead as the hypervisor must use a software client to communicate with the NFS server Some vendors do not recommend NFS storage for sensitive transactional applications due to latency Support for new virtualization features lags compared to block storage devices Doesnt support using multi-pathing from a host to an NFS server which can limit its performance More difficult to manage as scale to larger NAS deployments
General comparison
Feature
Adapter
Scope IP Routable Transport
NAS
NIC
LAN/MAN/WAN Yes TCP/IP No High Yes
iSCSI
NIC
LAN/MAN/WAN Yes TCP/IP No High Yes
FCoE
CNA
Data Center No CEE Yes Low No
Fiber Channel
HBA
Data Center No Fiber Channel Yes High N/A
Speed
1Gbe/10Gbe
1Gbe/10Gbe
10Gbe
1Gb/2Gb/4Gb/8Gb
16
Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
VMware Comparison
Feature
Load Balancing High Availability
NAS
None single session NIC teaming
iSCSI
VMware PSA/MPIO VMware PSA via SATP Combination of Physical & Protocol-based (CHAP) security Yes Yes Yes Yes Yes iSCSI s/w initiator, RDM
FCoE
VMware PSA/MPIO VMware PSA via SATP Uses FC Security model Yes Yes Yes (CNA) Yes Yes Raw-device mapping
Fiber Channel
VMware PSA/MPIO VMware PSA via SATP Mainly Physical, zoning/masking Yes Yes Yes Yes Yes Raw-device mapping
Security VMFS/RDM VAAI Support Boot from SAN Supports vMSC Supports SRM Direct to VM
17
Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
VMFS is purpose built for virtualization, NFS is purpose built for file services VMware initially looked at NFS in the first ESX release but found it lacking and choose to build their own file system instead VMFS evolves with each vSphere release, VMware has direct control over it New storage features and integration get baked into VMFS first RDMs have limited value, very specific use cases Use RDMs for practical reasons, not performance reasons
LUN Locking (SCSI reservations) has become a non-issue with VAAI (Atomic Test & Set)
18
Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
19
Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Bandwidth, Cache, Disk speed, RAID, Bus speeds, Data striping, CPU speed, Memory
Less about speed of the transport, more about the storage system architecture
20
Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
This paper demonstrates that the four network storage connection options available to ESX Server are all capable of reaching a level of performance limited only by the media and storage devices. And even with multiple virtual machines running concurrently on the same ESX Server host, the high performance is maintained. The data on CPU costs indicates that Fiber Channel and hardware iSCSI are the most CPU efficient, but in cases in which CPU consumption is not a concern, software iSCSI and NFS can also be part of a highperformance solution.
Source: http://www.vmware.com/files/pdf/storage_protocol_perf.pdf
21 Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
23
Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
LeftHand 4800
Performance is important, need to ensure you have a properly configured & sized storage array that can handle your workloads regardless of protocol
While Fiber Channel is a well-established storage platform, dont be afraid to try iSCSI devices, even if you already have a FC SAN Why not more than one, Fiber Channel, iSCSI & NAS devices can all work together in a VMware environment Storage is the most critical design decision you will make for your virtual environment so spend the time researching all the solutions so you understand them
25
Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Points to ponder
VMware development focus is primarily on block storage
Features like VAAI, Storage I/O Control, SRM support all came to block first Traditional NAS is made for this, certain applications are easier to implement with NFS Can easily do this with block using a Windows VM running CIFS/NFS Services w/RDM Run a NAS head in front of your block storage
Consider having the best of both worlds, block storage with a NFS gateway
If you need to use RDMs or Boot from SAN then youll need block storage If you want to use new block-only vSphere features youll need block storage
26
Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Integration: support vSphere integration - VAAI, VASA, vCenter Server, SRM, etc High performance: be able to support random, moving, unpredictable workloads High availability: if your storage fails, your VMs fail, HA & FT dont matter High efficiency: be able to maximize VM density while minimizing costs
LeftHand and 3PAR is storage built for virtualization, not adapted to accommodate it
Features like Zero Detect, Adaptive Queuing, Thin Technologies, Wide Striping, Network RAID, VSA and Snapshot Integration make a difference
27
Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
On many occasions Ive been asked for an opinion on the best storage protocol to use with vSphere. And my response is normally something along the lines of VMware supports many storage protocols, with no preferences really given to any one protocol over another.
However, actions speak louder then words, development preference seems to lean toward block because its the majority of what customers are using
28
Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
MSA 2000
iSCSI, Fiber Channel, DAS
1Gbe, 10Gbe, 8Gb FC
LeftHand 4000
iSCSI
1Gbe, 10Gbe
EVA 6000
iSCSI, Fiber Channel, FCoE
1Gbe, 10Gbe, 8Gb FC
3PAR
iSCSI, Fiber Channel, FCoE
1Gbe, 10Gbe, 8Gb FC
X3000
CIFS/SMB, NFS, HTTP, FTP, iSCSI
1Gbe, 10Gbe
X5000
CIFS/SMB, NFS, HTTP, FTP, iSCSI
1Gbe, 10Gbe
VMware certified VAAI/VASA support Snapshots Replication Highly affordable Easily managed SAS/SATA SRM/vCenter Integration
VMware certified VAAI/VASA support Thin provisioning Storage clustering Replication VMware snapshot SAS/SSD SRM/vCenter Integration
VMware certified VAAI/VASA support Thin provisioning Simplicity Dynamic Capacity Management - FC/FATA/SSD - SRM/vCenter Integration
VMware certified VAAI/VASA support Thin provisioning Wide-striping VMware snapshot Auto Zero Detect Autonomic Tiering FC/SATA/SSD SRM/vCenter Integration
- VMware certified - File & Block - Tight Windows integration - File De-duplication - Snapshots - SAS
- VMware certified - File & Block - Tight Windows integration - File De-duplication - Snapshots - SAS
29
Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
SIMPLIFY
provisioning and management
App Aware Snapshot Manager vCenter Management VASA and SRM support Autonomic Groups vCenter Management VASA and SRM support Simplified management Centralized backup of remote sites Application integration
SAVE
on storage costs
All-inclusive SAN software suite Thin provisioning Scale w/ clustered nodes Thin provisioning, conversion & persistence Zero detection Adaptive optimization Pay as grow scalability Couplet based licensing De-duplication reduces backup up to 20x
LeftHand
Small to midsized business
Network RAID Multi-site storage Peer motion mobility Wide striping Mixed workload support VMware VAAI support Autonomic restart Built-in HW redundancy 28 TB/hr backup speeds
3PAR
StoreOnce
Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Q&A
Any questions?
Your feedback is important to us. Please take a few minutes to complete the session survey.
31
Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Thank you
Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Download Now