HP Storage Thin Provisioning

HP StorageWorks XP Thin Provisioning
M d l 06 Module u8443s E.00

HP Education Services
2010 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice
Objectives
By the end of this course, students should be able to:
State the advantages and the customer benefits of implementing THP Describe Thin Provisioning (THP) concepts and basic functionality List the main components of THP List the specifications for THP Describe the THP write process Define V-VOL and THP Pool, , and how they y relate to THP functionality. Define and configure THP volumes
u8443sE.00
2010 Hewlett-Packard Development Company, L.P.
62
XP Thin Provisioning (THP) Overview

Features
HP StorageWorks XP Thin Provisioning (THP) id a h host t with ith virtual i t l capacity it volumes, l provides allocating actual area in the volume from a pool of physical capacity Just-enough and Just-in-Time for a write request from the host. THP V V-Volumes Volumes are backed backed-up up by a pool of physical storage
Writes
100GB
Benefits
No server reconfiguration required - configure future capacity it requirements i t upfront f t Data is spread across all spindles in the pool reducing or eliminating hot spots without the need for manual complex interleaving of volumes Only O l actually t ll needed d d & near ti time growth th capacity it needs to be purchased resulting in power and cost savings Fully supported with other XP array software like XP AutoLUN XP Business Copy and XP Continuous AutoLUN, Access etc
100GB Virtual Volume
THP Virtual Volumes
Physical capacity pool

63
u8443sd.01
THP main components (1 of 2)

THP pool volume
A raw LDEV whose capacity contributes to the capacity of the pool
Write
Host
Read/Write Read
THP pool
Where the data in THP volumes are stored. A collection of pool volumes
Host access volumes
THP Vol.
THP volume
Virtual volume that the host accesses accesses. Each THP Virtual volume is associated with a pool Pool space is assigned when host first writes to THP volume
Cache Shared Memory Shared Memory
Capacity M Monitoring
Dynamic Dynamic Mapping Mapping Table Table
Actual area for THP shared h d data
THP Pool
Capacity monitoring
Manages free storage of the THP pool and reports used storage space to users.
u8443sd.01
Pool volumes
backup area
DMT
XP24K
64
THP main component (2 of 2)

V-VOL Management table
Control information for Thin Provisioning Stored in dedicated Shared Memory (2 copies) Maps V-VOLs O to pool pages
Write
Host
Read/Write Read
Host access volumes
THP Vol.
Management g table backup p

Dedicated area stored on the head pool volume Stored on SVP Hard Drive when the XP is powered down
Cache Shared Memory Shared Memory
Capacity M Monitoring
Dynamic Dynamic Mapping Mapping Table Table
Actual area for THP shared h d data
THP Pool
Pool volumes
backup area
DMT
XP24K
u8443sd.01
65
XP Thin Provisioning (THP) Functionality Overview

THP
OS visible 7.9TB 7 9TB 1 2TB 1.2TB 1 2TB 1.2TB 1 2TB 1.2TB 1 2TB 1.2TB 1 2TB 1.2TB 1 6TB 1.6TB
Traditional
OS visible 7.9TB 7 9TB
LUNS: THP volumes (Virtual volumes) 1.2TB 0.6TB of actually y written data 2TB THP pool 1 4TB f 1.4TB free 30% occupied Provisioned Capacity p y 2TB 80x 25GB LDEVs
u8443sE.00
1.1TB
0.1TB 0.
1.5TB
0.15TB
1.2TB
0 04TB 0.04TB
1.3TB
0.06TB
1.6TB
0.15TB
LUNS: Physically y y provisioned capacity 7.9TB
0.1TB
No pool
LDEV LDEV LDEV LDEV LDEV LDEV LDEV LDEV LDEV LDEV LDEV LDEV LDEV LDEV LDEV LDEV
Array groups/Disk drives

Provisioned Capacity p y 7.9TB 316x 25GB LDEVs

66
THP performance optimization

As servers write to the V-Vol data is written to the THP pool in 42MB chunks, which are distributed across all LDEVs in the assigned THP pool THP striping i i prevents h hot-spots and d guarantees hi high h single i l LUN performance f Max XP backend performance is not affected but CHA load may increase by 10 - 20% Ideal for systems without a decent volume managers that can provide wide striping
V-Vol 1
V-Vol 2
V-Vol n
THP Pool
XP20/24000
Hi h speed High d XP crossbar b
DKA DKA DKA DKA
Pooled LDEVs
67
u8443sE.00
THP platform benefit summary

Host
HP_UX Windows
FS
JFS NTFS XFS
Volume configuration simplification

Yes Yes Yes Yes Yes Yes Y Yes Yes
Performance optimization
Yes Yes Yes Yes Yes Yes Y Yes Yes
Capacity usage optimization

Yes Yes Yes Yes Yes
No. Data is written every 52MB
Linux
ext2 ext3 UFS
Solaris
V FS VxFS ZFS
Y Yes Yes
u8443sE.00
68
THP platform benefit summary (continued)

Host FS
S JFS AIX JFS2 VxFS
Volume configuration simplification

Yes Yes Yes
Performance optimization
Yes Yes Yes
Capacity usage optimization

No. Data is written every 8MB Yes Yes Yes (If eagerzeroedthick is not used) Yes Yes Yes Yes
69
ESX
VMFS
Y Yes
Y Yes
OpenVMS p
VMS VFS
Yes Yes Yes Yes

Yes Yes Yes Yes
Tru64 AdvFS NonStop

u8443sE.00
NSK
THP usage with other Program Products

Program Product
Business Copy LUN Manager LUSE LUN Security CVS Server Priority Manager DB Validator Data Retention Utility AutoLUN Storage Partitioning Continuous Access Sync/Async/Journal Snapshot* Cache LUN External Storage This is supported for both THP and POOL volumes. THP volumes are supported as P-VOL P VOL and S S-VOL VOL POOL volumes not supported as P-VOLs or S-VOLs THP volumes supported as snapshot P-VOL This cannot be set for either THP volumes or Pool volumes Can be used as Pool-VOLs
A THP POOL For For
Specification
THP volumes, both P-VOL and S-VOL are supported. POOL volumes, neither P-VOL or S-VOL are supported
volume can be defined to a port like a normal volume volumes are not managed from this function
u8443sE.00
6 10
THP BC usage details

A Pool volume is not supported for use as either the BC P-VOL or SVOL.
BC P-VOL
THP volume
BC S-VOL
THP volume
Supported. Supported Quick
Specification
THP volume
Restore is unavailable when the P-VOL is a THP Normal volume volume and the S-VOL is a normal volume This combination consumes the same capacity as the normal volume (P-VOL) Pages containing zeros can be reclaimed after the copy completes
6 11
Normal volume
THP volume
u8443sE.00
THP usage with partitioning

It is not necessary to define a CLPR when defining a THP volume, but if you do;
The THP volume and the THP pool it uses must be located in the same CLPR A THP pool cannot belong to more than one CLPR A THP volume cannot belong to more than one CLPR.
THP VOL
THP VOL
THP VOL
THP VOL
THP VOL
THP Pool CLPR

u8443sE.00
THP Pool THP Pool

CLPR
SLPR
6 12
THP operation sequence
u8443sE.00
6 13
THP pool
An XP24000 array has up to 128 THP pools Max volumes in a pool = 1024 LDEVs/pool (Minimum 8GB/Maximum 4TB) Max V-VOLs in a pool = 8192 V-VOLs/pool (THP volumes) V-VOL size = 46MB 4TB Each pool volume is divided into 42MB chunks, called a PAGE
Volumes can be dynamically added to a pool

Data will be re-balanced across the pool (FW 60-05)
Pool volumes can not be removed Alerts sent when thresholds reached 42MB Volumes can not be shared by 1 2 3 Multiple pools 4
. 29 30 xx . . . . .
VDEV slot pages
u8443sE.00
6 14
Thin Provisioned volume implementation

1. Create the THP V-VOL group recommend one V-VOL per V-VOL group 2. 3. 4 4. 5. Setup the V-VOL size Assign CU and LDEV-ID Att h th Attach the THP V V-VOL VOL to t a pool l Present THP V-VOL to a host
Note: The THP Volume are identified with an X notation to differentiate it from other XP volumes
Example (LDKC:CU:LDEV):
u8443sE.00
THP volume (00:FF:00 X) SnapShot volume (00:EE:00 V) External storage volume (00:AA:00 #) Regular volume (00:00:00)
6 15
THP volume specifications

Item
Definition
Specification
Create from the V-VOL group for a THP volume
Recommended configuration and restrictions

The V-VOL g group p for a THP volume cannot be shared with a Snapshot group
Deletion Maximum number of defined volumes
Remove the association When de-installing a THP volume from the pool, the with the host group and free space in the THP pool increases, due to the the THP pool LDEV format performed for the THP volume Maximum 8192/pool
Capacity
46MB to 4TB
Em lation t Emulation type pe
OPEN V OPEN-V When unassigned V-VOL capacity * threshold > free space in pool an alert will occur
From
5% to 300% is given by SIM or SNMP Trap for each
Threshold
Warning
LUN LUN.
Email
alert can be configured

6 16
u8443sE.00
THP V-VOL Management tables

To process a host I/O the XP24000 must be able to:
1. Correlate the V-VOL logical address to a Pool ID and a VVOL in i this thi pool l 2. Convert the host address to the V-VOL logical address 3 Convert the logical address to physical address on a given 3. page in the Pool 4. Locate the physical LDEV that hosts the page 5. Locate the I/O address position within the 42MB page 6. Maintain the ECC RAID level for the pool LDEVs on the array group level
The V-VOL Management tables are stored in the VFS SYS AREA within the Shared Memory.
u8443sE.00
6 17
Page slot control block

The page slot control block (PSCB) manages the 42MB page in a THP pool as units. The storage area is called a page. When actual area is allocated in a THP volume, , it is on a page p g basis. The XP needs to lookup Shared Memory to find out the: Information for managing the address of the page #, and where the page is on a given LDEV
Information for managing the data and free capacity in a page
u8443sE.00
6 18
THP Unallocated Reads

If the host issues a read I/O request to an area where a page has not yet been allocated (from previous host write activity) in the THP volume, 0 data in the THP p pool is responded p to the request. q When this process occurs, a new page is not allocated in the THP volume (no additional capacity in the THP pool is consumed).
u8443sE.00
6 19
THP Unallocated Writes

If the host issues a write I/O request to an area where a page has not yet been allocated in the THP volume, the XP allocates a page in the THP p pool to the corresponding p g area in the volume.
Host Write THP-VOL Address Table
XXXX THP-VOL Cache Memory
PSCB SYS AREA (Shared Memory)
Page N THP POOL
u8443sE.00
6 20
THP allocated writes and reads

If the host issues a read or write I/O request to an area where a page has already been allocated in the THP volume, the XP resolves the address of the area in the THP p pool and then accesses the data. The allocated page is overwritten; no new allocation occurs (no capacity in the pool is consumed).
Host Read/Write THP-VOL Address Table
XXXX THP-VOL VO Cache Memory
PSCB SYS AREA (Shared Memory)

u8443sE.00 2010 Hewlett-Packard Development Company, L.P.
Page N THP POOL
6 21
Insufficient THP pool free area

If a host issues a read I/O request to an area where a page has not yet been allocated (from previous host write activity) in the THP volume, 0 data in the THP p pool is responded p to the request. q If the pool is full, then an illegal request is returned. When this process occurs, a new page is not allocated in the THP volume (no additional capacity in the THP pool is consumed) consumed).
Access area Page unassigned area Page assigned area
I/O type yp Read Write Read W it Write
Reported p content Illegal request Write protect Read enable W it enable Write bl
6 22
u8443sE.00
THP Thresholds
Pool Threshold (set for each pool):
Percentage of used capacity to total capacity Threshold 1 User configurable 5-95%. Threshold 2 80% SIM and SNMP trap sent when threshold reached
V-VOL V VOL Threshold (set for each V-VOL): V VOL):

User configurable 5-300%
V-VOL
assigned unassigned Alert when unassigned V-VOL Capacity * Threshold > unassigned pool capacity
Pool
assigned
unassigned
6 23
THP CHA performance

If shooting h ti f for equivalent i l t performance, f thi think k about b t using i more paths th and d CHAs when planning for THP volumes, than you use for normal volumes. CHA overhead h d is i increased i d when h processing i I/O f for a THP volume l The difference of overhead between #1 and #2 in the below table is large. Unless it is clear that the processing is for the case #1, use #2 for estimation (CHA usage rate increase is high).
Estimated CHA usage rate increase 1.2 times 1.8 times 1.2 times
6 24
Item Write to an area where page is allocated (update created file) Write to an area where page is not allocated ( (create t new file fil or increase i fil file size) i ) Read (regardless if page is allocated or not to the area)
ThP space reclamation

Some of the allocated pool space can be reduced by a simple deduplication mechanism known as zero page reclamation
Initiated via the Web Console GUI. Use cases:
After data restore from volume level backups After migration from standard to ThP V-VOL with AutoLUN After migration from old storage to XP with External Storage and AutoLUN Support added with 60-05 firmware
Initiated from the host using the unmap option of the WRITE SAME SCSI command
VxVM/VxFS version 5.x or later Storage Foundation Thin Reclamation feature
fsadm R /mnt or vxdisk rclm disk=<device>
Support added with 60-06 firmware
THP Best Practices

The number of parity groups in a THP pool
For better performance, include as many parity groups, across as many DKAs as possible in the pool The number of parity groups can be estimated from I/Os or the I/O patterns of the THP volume that shares the pool
RAID levels of parity groups that form the THP pool

As with normal volumes, determine RAID level for better performance and reliability The RAID level should be the same for all LDEVs assigned to a pool group
How to use LDEVs in a parity group

Di Divide id Parity P it Group G into i t # of f LDEVs LDEV that th t match t h number b of f data d t disks. Ex. 7+1 divide into 7 LDEVs Use the entire parity group for the pool if at all possible Avoid A id mixing i i hi high h I/O d demanding di & h hard dt to move LDEV LDEVs in i the th same parity group with THP pool Volumes. (example: SnapShot pool volumes & CA-JNL volumes)
6 26
THP Things to Avoid

Excessive write processing from a host can result in the sudden consumption of the capacity of the THP Pool
Defrag operations Stress tests including I/O meter Volume level restores
u8443sE.00
6 27
THP CONFIGURATION
u8443sE.00
6 28
THP pool creation (1 of 4)
u8443sE.00
6 29
2 3 4
u8443sE.00
6 30
1 3 4
u8443sE.00
6 31
1
6 32
Changing the Pool threshold
3 4
5
6 33
Increasing THP pool size
2 3 5
6 34
Deleting a pool
3
6 35
V-VOL Creation (1 of 3)
2 3 4
5 6
6 36
V-VOL creation (2 of 3)
1 2 3 4 5 1
10
1 1
u8443sE.00
6 37
V-VOL creation (3 of 3)
2 1
u8443sE.00
6 38
Assocoate V-VOL with a pool (1 of 2)
u8443sE.00
6 39
Assocoate V-VOL with a pool (2 of 2)
Volume threshold: 5-300% (default 5%)
u8443sE.00
6 40
Assigning THP LUNs
THP volumes will have an X suffix
u8443sE.00
6 41
Viewing V-VOL Usage rates

Go Volume Manager V-VOL
File Reports XP Thin Provisioning
u8443sE.00
6 42
XP ThP space reclamation
u8443sE.00
6 43
ThP LUN Expansion

On-line expansion of ThP LUNs Support for Windows 2008
December 2008 or later Firmware required
Support for HP-UX HP UX 11 11.31 31 and OpenVMS

June 2010 or later Firmware required
Use RAID Manager to grow ThP volumes

raidvchkset vext option
Set Host Group p Option p 40 for OS to be notified of V-VOL expansion

6 44
Releasing a V-VOL connection

Remove all paths to V-VOL Release V-VOL from Pool - This returns V-VOL pages to the pool
u8443sE.00
6 45
Deleting a V-VOL group
u8443sE.00
6 46
Lab activity
Thi Provisioning Thin P i i i
u8443sE.00
6 47
u8443sE.00
6 48

HP Storage Thin Provisioning

Uploaded by

Document Information

Original Title

Copyright

Available Formats

Share this document

Share or Embed Document

Sharing Options

Did you find this document useful?

Is this content inappropriate?

Copyright:

Available Formats

HP Storage Thin Provisioning

Uploaded by

Copyright:

Available Formats

HP StorageWorks XP Thin Provisioning

M d l 06 Module u8443s E.00

2010 Hewlett-Packard Development Company, L.P.

XP Thin Provisioning (THP) Overview

100GB Virtual Volume

THP Virtual Volumes

Physical capacity pool

2010 Hewlett-Packard Development Company, L.P.

THP main components (1 of 2)

Host access volumes

Cache Shared Memory Shared Memory

Actual area for THP shared h d data

2010 Hewlett-Packard Development Company, L.P.

THP main component (2 of 2)

Host access volumes

Management g table backup p

Cache Shared Memory Shared Memory

Actual area for THP shared h d data

2010 Hewlett-Packard Development Company, L.P.

XP Thin Provisioning (THP) Functionality Overview

LUNS: Physically y y provisioned capacity 7.9TB

Array groups/Disk drives

Provisioned Capacity p y 7.9TB 316x 25GB LDEVs

THP performance optimization

2010 Hewlett-Packard Development Company, L.P.

THP platform benefit summary

Volume configuration simplification

Capacity usage optimization

ext2 ext3 UFS

2010 Hewlett-Packard Development Company, L.P.

THP platform benefit summary (continued)

Volume configuration simplification

Capacity usage optimization

Yes Yes Yes Yes

Yes Yes Yes Yes

Tru64 AdvFS NonStop

THP usage with other Program Products

2010 Hewlett-Packard Development Company, L.P.

THP BC usage details

2010 Hewlett-Packard Development Company, L.P.

THP usage with partitioning

THP Pool CLPR

THP Pool THP Pool

THP operation sequence

2010 Hewlett-Packard Development Company, L.P.

Volumes can be dynamically added to a pool

VDEV slot pages

2010 Hewlett-Packard Development Company, L.P.

Thin Provisioned volume implementation

THP volume specifications

Recommended configuration and restrictions

Deletion Maximum number of defined volumes

Em lation t Emulation type pe

5% to 300% is given by SIM or SNMP Trap for each

alert can be configured

2010 Hewlett-Packard Development Company, L.P.

THP V-VOL Management tables

2010 Hewlett-Packard Development Company, L.P.

Page slot control block

2010 Hewlett-Packard Development Company, L.P.

THP Unallocated Reads

2010 Hewlett-Packard Development Company, L.P.

THP Unallocated Writes