Professional Documents
Culture Documents
IBm TS7650G Protectier Deduplication 3.2.2
IBm TS7650G Protectier Deduplication 3.2.2
IBm TS7650G Protectier Deduplication 3.2.2
Note
Before using this information and the product it supports, be sure to read the information in the "Safety and environmental
notices" and "Notices" sections of this publication.
Edition notice
This edition applies to the TS7650G and the TS7650 Appliance with ProtecTIER version 3.2 installed and to all
subsequent releases and modifications until otherwise indicated in new editions. This edition replaces
GA32-0918-04.
Copyright IBM Corporation 2011, 2012.
US Government Users Restricted Rights Use, duplication or disclosure restricted by GSA ADP Schedule Contract
with IBM Corp.
Contents
Figures . . . . . . . . . . . . . . . v
Tables . . . . . . . . . . . . . . . vii
Safety and Environmental notices . . . ix
Safety notices . . . . . . . . . . . . . . ix
Power cords . . . . . . . . . . . . . . x
Environmental notices . . . . . . . . . . . xi
Homologation statement . . . . . . . xiii
About this document . . . . . . . . xv
Terminology . . . . . . . . . . . . . . xv
Who should read this document. . . . . . . xviii
What's new in this release . . . . . . . . . xviii
Getting information, help, and service . . . . . xviii
Getting help online . . . . . . . . . . . xx
Before you call for service . . . . . . . . xx
Getting help by telephone . . . . . . . . xxi
Web sites . . . . . . . . . . . . . . . xxi
Related publications . . . . . . . . . . . xxii
TS7650G publications . . . . . . . . . xxii
Gateway server (3958 DD5) publications . . . xxii
TS7650 Appliance publications . . . . . . xxii
Integrated Management Module publications xxiii
System console (TSSC) publication . . . . . xxiii
Tape device driver publications . . . . . . xxiii
How to send your comments . . . . . . . . xxiii
Chapter 1. Introduction . . . . . . . . 1
TS7650G hardware components . . . . . . . . 3
Gateway server (3958 DD5) . . . . . . . . 8
TS7650 Appliance hardware components . . . . 13
Appliance server (3958 AP1) FC 3170 . . . . . 24
Disk controller (1814 70H) FC 3706 or (1814 94H)
3708 . . . . . . . . . . . . . . . . 28
Software . . . . . . . . . . . . . . . 29
ProtecTIER Manager . . . . . . . . . . 29
ProtecTIER VTL . . . . . . . . . . . . 30
OpenStorage . . . . . . . . . . . . . 30
FSI . . . . . . . . . . . . . . . . 31
TSSC microcode . . . . . . . . . . . . 32
Supported hardware and software. . . . . . . 33
Supported virtual devices . . . . . . . . 33
Supported SAN switches . . . . . . . . . 33
Supported LUNs . . . . . . . . . . . 34
Supported operating systems . . . . . . . 34
Supported device drivers . . . . . . . . . 34
Data management and advanced features . . . . 34
RAID . . . . . . . . . . . . . . . 35
Fencing. . . . . . . . . . . . . . . 35
Two-node active-active support. . . . . . . 36
LUN masking . . . . . . . . . . . . 36
Replication . . . . . . . . . . . . . 36
Remote support through Call Home . . . . . . 40
Chapter 2. Physical planning
specifications. . . . . . . . . . . . 43
Site preparation . . . . . . . . . . . . . 43
Lighting considerations . . . . . . . . . . 43
Upgrade considerations . . . . . . . . . . 44
Accommodating cables . . . . . . . . . . 44
Calculating space requirements . . . . . . . . 44
Dimensions and weights . . . . . . . . . 44
Operator and service clearances . . . . . . 47
Height requirements . . . . . . . . . . 48
Floor requirements . . . . . . . . . . . 48
Security considerations . . . . . . . . . . 49
Operating environment requirements . . . . . . 49
Electrical power ratings . . . . . . . . . . 51
Acoustic declaration . . . . . . . . . . . 52
Safety issues . . . . . . . . . . . . . . 52
Providing a fire-suppression system . . . . . 53
Earthquake effects . . . . . . . . . . . 53
Chapter 3. Components and feature
codes . . . . . . . . . . . . . . . 55
TS7650G feature codes. . . . . . . . . . . 55
3958 DD5 gateway server feature codes . . . . 55
5639-PTA ProtecTIER Enterprise Edition V3.2
Base Software . . . . . . . . . . . . 64
TS7650 Appliance feature codes . . . . . . . 65
Feature codes for 3958 AP1 appliance server . . 66
5639-PTB ProtecTIER Appliance Edition V3.2
Software . . . . . . . . . . . . . . 77
Chapter 4. Sizing, configuration, and
usage considerations . . . . . . . . 79
Chapter 5. Customer installation
responsibilities . . . . . . . . . . . 81
System responsibilities. . . . . . . . . . . 82
ProtecTIER Manager workstation requirements 82
Hardware, cabling, and infrastructure
responsibilities . . . . . . . . . . . . . 83
Cache configuration best practices . . . . . . . 83
Security, auditability, and control . . . . . . . 85
Chapter 6. IBM service installation
responsibilities . . . . . . . . . . . 87
Chapter 7. Planning data migration . . 89
Appendix A. IBM-provided TS7650G
equipment and documents . . . . . . 91
Copyright IBM Corp. 2011, 2012 iii
Appendix B. IBM-provided TS7650
Appliance equipment and documents . 93
Appendix C. Company information
worksheet . . . . . . . . . . . . . 95
Appendix D. IP address worksheet. . . 99
Appendix E. Replication settings
worksheet . . . . . . . . . . . . . 109
Appendix F. Example cache
configuration file . . . . . . . . . . 111
Accessibility for publications and
ProtecTIER Manager . . . . . . . . 117
About the Windows-based accessibility features 117
About the Java-based tools . . . . . . . . . 118
Installing the Java Runtime Environment . . . 118
Installing the Java Access Bridge . . . . . . 119
Using a screen reader to install ProtecTIER
Manager . . . . . . . . . . . . . . . 120
Enabling the Windows High Contrast option . . . 121
Using the Windows high contrast scheme with
ProtecTIER Manager . . . . . . . . . . . 123
Customizing the color palette . . . . . . . . 126
Notices . . . . . . . . . . . . . . 129
Trademarks . . . . . . . . . . . . . . 130
Electronic emission notices . . . . . . . . . 131
Federal Communications Commission statement 131
Industry Canada compliance statement . . . . 132
European Union Electromagnetic Compatibility
Directive . . . . . . . . . . . . . . 132
Australia and New Zealand Class A Statement 132
Germany Electromagnetic compatibility
directive . . . . . . . . . . . . . . 132
People's Republic of China Class A Electronic
Emission statement . . . . . . . . . . 134
Taiwan Class A compliance statement . . . . 134
Taiwan contact information. . . . . . . . 134
Japan Voluntary Control Council for Interference
(VCCI) Class A Statement . . . . . . . . 134
Japan Electronics and Information Technology
Industries Association (JEITA) Statement (less
than or equal to 20 A per phase) . . . . . . 135
Korean Communications Commission (KCC)
Class A Statement . . . . . . . . . . . 135
Russia Electromagnetic Interference (EMI) Class
A Statement . . . . . . . . . . . . . 135
Index . . . . . . . . . . . . . . . 137
iv IBM System Storage TS7650 and TS7650G ProtecTIER Deduplication Solutions: Introduction and Planning Guide
Figures
1. TS7650G stand-alone server frame components 5
2. TS7650G single cluster frame components 6
3. TS7650G dual cluster frame components . . . 7
4. 3958 DD5 server rear view with VTL
configuration . . . . . . . . . . . . 8
5. 3958 DD5 server rear view with OpenStorage
configuration, Feature Code 3456 . . . . . 10
6. 3958 DD5 server rear view with OpenStorage
configuration, Feature Code 3457 . . . . . 10
7. Gateway server front view . . . . . . . 11
8. Gateway server operator information panel 12
9. Front view of a 2 drawer TS7650 Appliance 16
10. Rear view of a 2 drawer TS7650 Appliance 17
11. Front view of a 4 drawer TS7650 Appliance 18
12. Rear view of a 4 drawer TS7650 Appliance 19
13. Front view of an 8 drawer TS7650 Appliance 20
14. Rear view of a 8 drawer TS7650 Appliance 21
15. Front view of an 8 drawer clustered TS7650
Appliance . . . . . . . . . . . . . 22
16. Rear view of an 8 drawer clustered TS7650
Appliance . . . . . . . . . . . . . 23
17. 3958 AP1 server rear view with VTL
configuration . . . . . . . . . . . . 24
18. 3958 AP1 server rear view with OpenStorage
configuration, Feature Code 3456 . . . . . 25
19. 3958 AP1 server rear view with OpenStorage
configuration, Feature Code 3457 . . . . . 26
20. Appliance server front view . . . . . . . 27
21. Appliance server operator information panel 28
22. Tape library emulation . . . . . . . . . 30
23. OpenStorage . . . . . . . . . . . . 31
24. TS3000 System Console Screen Login screen 32
25. TS7650 Appliance frame plan view. . . . . 46
26. TS7650 Appliance frame isometric view 47
27. Dedicated zone topology . . . . . . . . 85
28. Display tab . . . . . . . . . . . . 122
29. Settings for High Contrast . . . . . . . 123
30. ProtecTIER Manager window . . . . . . 124
31. Preferences dialog box . . . . . . . . 125
32. Normal contrast versus high contrast 125
33. Color selection, Swatches tab . . . . . . 126
34. Default color versus custom color. . . . . 127
Copyright IBM Corp. 2011, 2012 v
vi IBM System Storage TS7650 and TS7650G ProtecTIER Deduplication Solutions: Introduction and Planning Guide
Tables
1. IBM websites for help, services, and
information . . . . . . . . . . . . xix
2. 3958 DD5 server rear view: Slot assignments,
ports, and connections for VTL . . . . . . 8
3. 3958 DD5 server rear view: Slot assignments,
ports, and connections for OpenStorage and
FSI . . . . . . . . . . . . . . . 10
4. Gateway server front view . . . . . . . 11
5. Operator information panel . . . . . . . 12
6. IBM System Storage TS7650 ProtecTIER
Deduplication Appliance hardware component
configurations. . . . . . . . . . . . 15
7. Feature codes for components in a 2 drawer
TS7650 Appliance . . . . . . . . . . 16
8. Feature codes for components in a 2 drawer
TS7650 Appliance . . . . . . . . . . 17
9. Feature codes for components in a 4 drawer
TS7650 Appliance . . . . . . . . . . 18
10. Feature codes for components in a 4 drawer
TS7650 Appliance . . . . . . . . . . 19
11. Feature codes for components in an 8 drawer
TS7650 Appliance . . . . . . . . . . 20
12. Feature codes for components in an 8 drawer
TS7650 Appliance . . . . . . . . . . 21
13. Feature codes for components in an 8 drawer
clusteredTS7650 Appliance . . . . . . . 22
14. Feature codes for components in an 8 drawer
clustered TS7650 Appliance . . . . . . . 23
15. 3958 AP1 server rear view: Slot assignments,
ports, and connections for VTL . . . . . . 24
16. 3958 AP1 server rear view: Slot assignments,
ports, and connections for OpenStorage and
FSI . . . . . . . . . . . . . . . 26
17. Appliance server front view . . . . . . . 27
18. Operator information panel . . . . . . . 28
19. Maximum number of FSI streams and host
connections . . . . . . . . . . . . 31
20. Remote support capabilities . . . . . . . 41
21. TS7650G component dimensions . . . . . 45
22. TS7650G gateway server weight. . . . . . 45
23. Dimensions of the TS7650 Appliance frame 45
24. Maximum weight of TS7650 Appliance (cluster
with 36 TB of storage) . . . . . . . . . 45
25. Dimensions of the TS7650 Appliance server 45
26. Temperature and humidity requirements 49
27. Limits for particulates and gases . . . . . 51
28. Recommended power ratings for stand-alone
TS7650G 3958 per line cord . . . . . . . 51
29. Recommended power ratings for clustered
TS7650G 3958 per line cord . . . . . . . 51
30. FC 3437 Cluster Connection Kit power
requirements . . . . . . . . . . . . 52
31. TS7650 Appliance electrical power ratings per
line cord for a maximum configuration . . . 52
32. FC 3437 Cluster Connection Kit power
requirements . . . . . . . . . . . . 52
33. Acoustic declaration for the gateway and
appliance servers. . . . . . . . . . . 52
34. Feature codes . . . . . . . . . . . . 66
35. Power cord features. . . . . . . . . . 76
36. Company information worksheet . . . . . 95
37. Country codes . . . . . . . . . . . 97
38. Factory-default server IP addresses for a
stand-alone VTL ProtecTIER server (3958 DD5
or 3958 AP1) . . . . . . . . . . . . 100
39. Factory-default server IP addresses for a
stand-alone OpenStorage or FSI ProtecTIER
server (3958 DD5 or 3958 AP1). . . . . . 101
40. Factory-default server IP addresses for a
clustered VTL ProtecTIER system (3958 DD5
or 3958 AP1) . . . . . . . . . . . . 101
41. Factory-default server IP addresses for a
clustered OpenStorage ProtecTIER system
(3958 DD5 or 3958 AP1) . . . . . . . . 103
42. Customer IP addresses . . . . . . . . 104
43. Customer and Replication IP addresses for
VTL or OpenStorage systems . . . . . . 105
44. Host names and DNS settings for setting up
the TSSC with the TS7650G . . . . . . . 106
45. TSSC IP addresses . . . . . . . . . . 107
46. Base Clusters and Additional Storage
Component IP addresses . . . . . . . . 108
47. Replication policy information . . . . . . 109
Copyright IBM Corp. 2011, 2012 vii
viii IBM System Storage TS7650 and TS7650G ProtecTIER Deduplication Solutions: Introduction and Planning Guide
Safety and Environmental notices
This section contains information about safety notices that are used in this guide
and environmental notices for this product.
Safety notices
Observe the safety notices when using this product. These safety notices contain
danger and caution notices. These notices are sometimes accompanied by symbols
that represent the severity of the safety condition.
Most danger or caution notices contain a reference number (Dxxx or Cxxx). Use
the reference number to check the translation in the IBM Systems Safety Notices,
G229-9054 manual.
The sections that follow define each type of safety notice and give examples.
Danger notice
A danger notice calls attention to a situation that is potentially lethal or extremely
hazardous to people. A lightning bolt symbol always accompanies a danger notice
to represent a dangerous electrical condition. A sample danger notice follows:
DANGER: An electrical outlet that is not correctly wired could place
hazardous voltage on metal parts of the system or the devices that
attach to the system. It is the responsibility of the customer to ensure
that the outlet is correctly wired and grounded to prevent an electrical
shock. (D004)
Caution notice
A caution notice calls attention to a situation that is potentially hazardous to
people because of some existing condition, or to a potentially dangerous situation
that might develop because of some unsafe practice. A caution notice can be
accompanied by one of several symbols:
If the symbol is... It means...
A generally hazardous condition not represented by other
safety symbols.
This product contains a Class II laser. Do not stare into the
beam. (C029) Laser symbols are always accompanied by the
classification of the laser as defined by the U. S.
Department of Health and Human Services (for example,
Class I, Class II, and so forth).
A hazardous condition due to mechanical movement in or
around the product.
Copyright IBM Corp. 2011, 2012 ix
If the symbol is... It means...
This part or unit is heavy but has a weight smaller than 18
kg (39.7 lb). Use care when lifting, removing, or installing
this part or unit. (C008)
Sample caution notices follow:
Caution
The battery is a lithium ion battery. To avoid possible explosion, do not
burn. Exchange only with the IBM-approved part. Recycle or discard the
battery as instructed by local regulations. In the United States, IBM
has a
process for the collection of this battery. For information, call
1-800-426-4333. Have the IBM part number for the battery unit available
when you call. (C007)
Caution
The system contains circuit cards, assemblies, or both that contain lead
solder. To avoid the release of lead (Pb) into the environment, do not burn.
Discard the circuit card as instructed by local regulations. (C014)
Caution
When removing the Modular Refrigeration Unit (MRU), immediately
remove any oil residue from the MRU support shelf, floor, and any other
area to prevent injuries because of slips or falls. Do not use refrigerant
lines or connectors to lift, move, or remove the MRU. Use handholds as
instructed by service procedures. (C016)
Caution
Do not connect an IBM control unit directly to a public optical network.
The customer must use an additional connectivity device between an IBM
control unit optical adapter (that is, fibre, ESCON
, FICON
) and an
external public network . Use a device such as a patch panel, a router, or a
switch. You do not need an additional connectivity device for optical fibre
connectivity that does not pass through a public network.
Power cords
For your safety, IBM provides a power cord with a grounded attachment plug to
use with this IBM product. To avoid electrical shock, always use the power cord
and plug with a properly grounded outlet.
IBM power cords used in the United States and Canada are listed by
Underwriters Laboratories (UL) and certified by the Canadian Standards
Association (CSA).
For units intended to be operated at 115 volts: Use a UL-listed and CSA-certified
cord set consisting of a minimum 18 AWG, Type SVT or SJT, three-conductor cord,
a maximum of 15 feet in length and a parallel blade, grounding-type attachment
plug rated 15 amperes, 125 volts.
For units intended to be operated at 230 volts (U.S. use): Use a UL-listed and
CSA-certified cord set consisting of a minimum 18 AWG, Type SVT or SJT,
x IBM System Storage TS7650 and TS7650G ProtecTIER Deduplication Solutions: Introduction and Planning Guide
three-conductor cord, a maximum of 15 feet in length and a tandem blade,
grounding-type attachment plug rated 15 amperes, 250 volts.
For units intended to be operated at 230 volts (outside the U.S.): Use a cord set
with a grounding-type attachment plug. The cord set should have the appropriate
safety approvals for the country in which the equipment will be installed.
IBM power cords for a specific country or region are usually available only in that
country or region.
Environmental notices
The environmental notices that apply to this product are provided in the
Environmental Notices and User Guide, Z125-5823-xx manual. A copy of this manual
is located on the publications CD.
Safety and Environmental notices xi
xii IBM System Storage TS7650 and TS7650G ProtecTIER Deduplication Solutions: Introduction and Planning Guide
Homologation statement
Attention: This product is not intended to be connected directly or indirectly by
any means whatsoever to interfaces of public telecommunications networks,
neither to be used in a Public Services Network.
Copyright IBM Corp. 2011, 2012 xiii
xiv IBM System Storage TS7650 and TS7650G ProtecTIER Deduplication Solutions: Introduction and Planning Guide
About this document
This section describes the content in this publication.
This document provides you with introductory and planning information for either
of the following solutions:
v IBM System Storage
TS7650G ProtecTIER
v HDS AMS1000
v HDS AMS2300
v HP EVA 8100
v HP EVA 8400
v EMC CX series
The TS7650 Appliance uses the self-contained IBM System Storage DS4700 disk
storage unit for data compression and storage.
Important: As of 3 April 2012, systems for which IBM has the responsibility for
installation must be made available to IBM for installation within six months of
shipment or else a fee will be charged.
2 IBM System Storage TS7650 and TS7650G ProtecTIER Deduplication Solutions: Introduction and Planning Guide
TS7650G hardware components
For TS7650 Appliance hardware components, see TS7650 Appliance hardware
components on page 13.
The TS7650G is available in stand-alone and clustered configurations. For a
stand-alone configuration, one IBM machine type and model 3958 DD5 server is
required. For a clustered configuration, two 3958 DD5 servers are required, along
with an FC 3437 Cluster Connection Kit, which consists of:
v two 1 Gb (gigabit) Ethernet switches, SMC model 8126L2
v one network power switch, Western Telematic, Inc. (WTI) model VMR-8HD20-2
v power cables
v Ethernet cables
v mounting hardware
Notes:
v The following cluster server combinations are supported:
two 3958 DD5 servers
one 3958 DD5 server and one 3958 DD4 server
one 3958 DD5 server and one 3958 DD3 server
one 3958 DD5 server and one 3958 DD1 server (by RPQ only)
In all cases, the clustered servers must be installed in the same frame.
v IBM does not support more than one clustered pair of TS7650G servers in a
single frame.
Red Hat Linux version 5.6 is required to run on the gateway server. For more
information, see TS7650G feature codes on page 55.
An IBM Total Storage System Console (TSSC) and the accompanying
Keyboard/Video/Monitor (KVM kit) (purchased separately) are also required for
installation, service, and maintenance of the TS7650G. IBM recommends that the
TSSC be installed in the same rack as the gateway server. However, an existing
TSSC may be used, provided it is within 100 feet of the gateway server.
For the TS7650G to be fully functional, additional hardware components
(purchased separately) are required. These components include frame(s), disk
controller(s), and disk expansion modules.
The lists below outline the additional hardware purchases recommended for each
deployment option of the TS7650G:
Stand-alone Gateway
v One customer-supplied server frame
v One customer-supplied disk storage frame
Clustered Gateway
v One customer-supplied server frame
v One or more customer-supplied disk storage frames
Replication Gateway
v Two customer-supplied server frames
Chapter 1. Introduction 3
v One or more customer-supplied disk storage frames per server frame
Each customer-supplied frame must contain from two to four 220V power
distribution units, and provide sufficient rack space in order to accommodate the
following scenarios.
v In a stand-alone configuration, the server frame must provide either 8u or 10u of
rack space.
2u of rack space for a KVM tray and its associated Ethernet switch
1u of rack space for one 26-port Ethernet switch used for the TSSC network,
or no additional rack space if an existing TSSC network is used
1u of rack space for one TSSC, or no additional rack space if an existing TSSC
is used.
4u of rack space for one gateway server
2u of rack space for two power distribution units
Figure 1 on page 5 identifies the server components present in a fully configured
TS7650G in a stand-alone configuration.
4 IBM System Storage TS7650 and TS7650G ProtecTIER Deduplication Solutions: Introduction and Planning Guide
v In a single cluster configuration, the server frame must provide 15u or 17u of rack
space.
2u of rack space for a KVM tray and its associated Ethernet switch
1u of rack space for one 26-port Ethernet switch used for the TSSC network,
or no additional rack space if an existing TSSC network is used
1u of rack space for one TSSC, or no additional rack space if an existing TSSC
is used.
8u of rack space for two gateway servers
2u of rack space for two Ethernet switches
1u of rack space for one network power switch
2u of rack space for two power distribution units
Figure 2 on page 6 identifies the server components present in a fully configured
TS7650G in a single cluster configuration.
t
s
7
6
1
1
6
4
36
35
34
33
32
31
30
29
28
27
26
25
24
23
22
21
20
19
18
17
16
15
14
13
12
11
10
9
8
7
6
5
4
3
2
1
ProtecTIER Server (4u)
Empty (1u)
Empty (1u)
Empty (1u)
Empty (1u)
Empty (1u)
TSSC (1u)
Empty (1u)
Empty (1u)
Power Distribution Unit (1u)
Power Distribution Unit (1u)
KVM Tray (1u)
EIA
Unit
EIA
Holes
106
103
100
97
94
91
88
85
82
79
76
73
70
67
64
61
58
55
52
49
46
43
40
37
34
31
28
25
22
19
16
13
10
7
4
1
36
35
34
33
32
31
30
29
28
27
26
25
24
23
22
21
20
19
18
17
16
15
14
13
12
11
10
9
8
7
6
5
4
3
2
1
EIA
Unit
EIA
Holes
106
103
100
97
94
91
88
85
82
79
76
73
70
67
64
61
58
55
52
49
46
43
40
37
34
31
28
25
22
19
16
13
10
7
4
1
Empty (1u)
Empty (1u)
Empty (1u)
Empty (1u)
Empty (1u)
Empty (1u)
Empty (1u)
Empty (1u)
Empty (1u)
Empty (1u)
Empty (1u)
Empty (1u)
KVM Switch
Empty (1u)
Empty (1u)
Empty (1u)
Empty (1u)
Empty (1u)
Empty (1u)
TSSC 1GB Network Switch (1u)
Empty (1u)
Figure 1. TS7650G stand-alone server frame components
Chapter 1. Introduction 5
v In a dual cluster configuration, the server frame must provide 28u or 30u of rack
space.
2u of rack space for a KVM tray and its associated Ethernet switch
1u of rack space for one 26-port Ethernet switch used for the TSSC network,
or no additional rack space if an existing TSSC network is used
1u of rack space for one TSSC, or no additional rack space if an existing TSSC
is used.
16u of rack space for two gateway servers
4u of rack space for four Ethernet switches
2u of rack space for two network power switch
4u of rack space for four power distribution units
Figure 3 on page 7 identifies the server components present in a fully configured
TS7650G in a dual cluster configuration.
t
s
7
6
1
1
6
5
Empty (1u)
Empty (1u)
Empty (1u)
Empty (1u)
Empty (1u)
TSSC (1u)
EIA
Unit
EIA
Holes
106
103
100
97
94
91
88
85
82
79
76
73
70
67
64
61
58
55
52
49
46
43
40
37
34
31
28
25
22
19
16
13
10
7
4
1
EIA
Unit
EIA
Holes
106
103
100
97
94
91
88
85
82
79
76
73
70
67
64
61
58
55
52
49
46
43
40
37
34
31
28
25
22
19
16
13
10
7
4
1
KVM Switch
Empty (1u)
Empty (1u)
Empty (1u)
Empty (1u)
Empty (1u)
Empty (1u)
Empty (1u)
Empty (1u)
Empty (1u)
Empty (1u)
Empty (1u)
Empty (1u)
ProtecTIER Server A (4u)
1 Gb Network Switch (1u)
Empty (1u)
Network Power Switch (1u)
Empty (1u)
Power Distribution Unit (1u)
Power Distribution Unit (1u)
ProtecTIER Server B (4u)
1 Gb Network Switch (1u)
36
35
34
33
32
31
30
29
28
27
26
25
24
23
22
21
20
19
18
17
16
15
14
13
12
11
10
9
8
7
6
5
4
3
2
1
36
35
34
33
32
31
30
29
28
27
26
25
24
23
22
21
20
19
18
17
16
15
14
13
12
11
10
9
8
7
6
5
4
3
2
1
KVM Tray (1u)
TSSC 1GB Network Switch (1u)
Figure 2. TS7650G single cluster frame components
6 IBM System Storage TS7650 and TS7650G ProtecTIER Deduplication Solutions: Introduction and Planning Guide
When configured for replication, the server frames required depend on the
planned hardware configuration of the source and destination server(s). If
stand-alone to stand-alone, duplicate the stand-alone configuration listed above for
the second frame. If the source and destination frames are clustered, duplicate the
clustered configuration listed above for the second site.
Possible existing gateway upgrade scenarios:
v Existing TS7650G installation with DD3 servers, adding new DD5 servers for
replication.
v Existing TS7650G installation with DD4 servers, adding new DD5 servers for
replication.
v Existing TS7650G installation with DD3, DD4, or DD5 servers, adding replication
functionality, no new hardware required for DD5, DD4 or DD3. For DD1, a
second Ethernet adapter is needed (Feature Code 3448).
v Existing DD3 clustered with a new DD5 VTL system.
t
s
7
6
1
1
6
6
EIA
Unit
EIA
Holes
106
103
100
97
94
91
88
85
82
79
76
73
70
67
64
61
58
55
52
49
46
43
40
37
34
31
28
25
22
19
16
13
10
7
4
1
36
35
34
33
32
31
30
29
28
27
26
25
24
23
22
21
20
19
18
17
16
15
14
13
12
11
10
9
8
7
6
5
4
3
2
1
KVM Tray (1u)
TSSC 1GB Network Switch (1u)
36
35
34
33
32
31
30
29
28
27
26
25
24
23
22
21
20
19
18
17
16
15
14
13
12
11
10
9
8
7
6
5
4
3
2
1
ProtecTIER Server A (4u)
Cluster 1
Empty (1u)
Empty (1u)
Empty (1u)
Empty (1u)
Network Power Switch (1u)
Power Distribution Unit (1u)
KVM Switch
TSSC (1u)
1 Gb Network Switch (1u)
Empty (1u)
Network Power Switch (1u)
Empty (1u)
Power Distribution Unit (1u)
Power Distribution Unit (1u)
ProtecTIER Server B (4u)
Cluster 1
1 Gb Network Switch (1u)
Power Distribution Unit (1u)
ProtecTIER Server A (4u)
Cluster 2
ProtecTIER Server B (4u)
Cluster 2
1 Gb Network Switch (1u)
1 Gb Network Switch (1u)
EIA
Unit
EIA
Holes
106
103
100
97
94
91
88
85
82
79
76
73
70
67
64
61
58
55
52
49
46
43
40
37
34
31
28
25
22
19
16
13
10
7
4
1
Figure 3. TS7650G dual cluster frame components
Chapter 1. Introduction 7
v Existing DD4 clustered with a new DD5 VTL system.
v DD5 VTL system clustered with another DD5 VTL system.
v DD5 OpenStorage system clustered with another 3958 DD5 OpenStorage system.
Possible new gateway installation scenarios:
v New TS7650G installation, clustered or stand-alone, with replication (VTL or
OpenStorage).
v New TS7650G installation, clustered or stand-alone, without replication (VTL or
OpenStorage).
v New TS7650G installation, stand-alone only, with or without replication (FSI).
For the disk storage frame(s), the amount of rack space and the number of frames
required varies depending on the type of disk storage that is being used. For
example, one IBM System Storage DS4700 disk controller and six IBM System
Storage DS4000 EXP810 disk expansion modules require 21u of rack space in the
frame. In a clustered configuration with two controllers and 12 expansion modules,
an additional disk storage frame may be required.
Gateway server (3958 DD5)
The gateway server provides the connections to the TSSC and the customer SAN
network (for connection to the client hosts and virtual tape libraries).
Server rear view, VTL
When configured for VTL, the 3958 DD5 servers are equipped with:
v two Emulex Fibre Channel Host Bus Adapters (HBA)
v two QLogic Fibre Channel HBAs
v one 1 gigabit (Gb) quad-port Ethernet adapter
v two on-board Ethernet ports
See Figure 4 and Table 2.
Table 2. 3958 DD5 server rear view: Slot assignments, ports, and connections for VTL
Item VTL use
ethX value (if
applicable)
1 Slot 1: Emulex Fibre Channel Host Bus Adapter (HBA)
v Label port 1 = Fibre Channel port 2
v Label port 2 = Fibre Channel port 3
t
s
7
6
0
7
5
2
ProtecTIER Server
1
2
1 1 1
2 2 2
1 2 3 4 5 6 7
E1
E2
1
3
2
4
P1 P2
8
A1 A2
9
B
V
E3
E4
S
Figure 4. 3958 DD5 server rear view with VTL configuration
8 IBM System Storage TS7650 and TS7650G ProtecTIER Deduplication Solutions: Introduction and Planning Guide
Table 2. 3958 DD5 server rear view: Slot assignments, ports, and connections for
VTL (continued)
Item VTL use
ethX value (if
applicable)
2 Slot 2: Emulex Fibre Channel HBA
v Label port 1 = Fibre Channel port 0
v Label port 2 = Fibre Channel port 1
3 Slot 3: not used
4 Slot 4: not used
5 Slot 5: Intel Pro Quad-port gigabit Ethernet
adapter
v eth0 (port 1)
v eth1 (port 2)
v eth2 (port 3)
v eth3 (port 4)
6 Slot 6: QLogic HBA
7 Slot 7: QLogic HBA
8 QPI Slot 1: not used
9 QPI Slot 2: not used
A1 Integrated Ethernet 1 port eth4
A2 Integrated Ethernet 2 port eth5
B SYS MGMT Ethernet port: System management Ethernet port used
by the IMM as a web interface for system-management information
control; for example, for access to the IMM Event log.
V IMM Video port
S Serial Attached SCSI (SAS) port
E1 Universal Serial Bus (USB) port 1
E2 USB port 2
E3 USB port 3
E4 USB port 4
P1 Power connection
P2 Power connection
Server rear view, OpenStorage and FSI
When configured for OpenStorage or FSI, the 3958 DD5 servers are equipped with
v one of the following Ethernet adapter configurations:
If two instances of Feature Code 3456 are installed, three 1 Gb quad-port
Ethernet adapters (Figure 5 on page 10)
If two instances of Feature Code 3457 are installed, two 10 Gb dual-port
Ethernet adapters for use with Fibre Channel cabling and one 1 Gb quad-port
Ethernet adapter (Figure 6 on page 10)
v two dual-port QLogic Fibre Channel HBAs
v two on-board Ethernet ports.
Chapter 1. Introduction 9
Table 3. 3958 DD5 server rear view: Slot assignments, ports, and connections for
OpenStorage and FSI
Item OpenStorage or
FSI use, FC 3456
ethX value (if
applicable), FC
3456
OpenStorage or
FSI use, FC 3457
ethX value (if
applicable), FC
3457
1 Slot 1: not used
2 Slot 2: not used
3 Slot 3: Intel Pro
Quad-port gigabit
Ethernet adapter
v eth4 (port 1)
v eth5 (port 2)
v eth6 (port 3)
v eth7 (port 4)
Slot 3: Dual-port
10 gigabit Ethernet
adapter
v eth4 (port 1)
v eth5 (port 2)
4 Slot 4: Intel Pro
Quad-port gigabit
Ethernet adapter
v eth8 (port 1)
v eth9 (port 2)
v eth10 (port 3)
v eth11 (port 4)
Slot 4: Dual-port
10 gigabit Ethernet
adapter
v eth6 (port 1)
v eth7 (port 2)
5 Slot 5: Quad-port
gigabit Ethernet
adapter
v eth0 (port 1)
v eth1 (port 2)
v eth2 (port 3)
v eth3 (port 4)
Slot 5: Quad-port
gigabit Ethernet
adapter
v eth0 (port 1)
v eth1 (port 2)
v eth2 (port 3)
v eth3 (port 4)
6 Slot 6: QLogic HBA
7 Slot 7: QLogic HBA
8 QPI Slot 1: not used
9 QPI Slot 2: not used
t
s
7
6
0
7
5
3
ProtecTIER Server
1 1 1 1
2 2 2 2
1 2 3 4 5 6 7
E1
E2
1
3
4
3 3
2
4 4
P1 P2
8
A1 A2
9
B
V
E3
E4
S
Figure 5. 3958 DD5 server rear view with OpenStorage configuration, Feature Code 3456
Figure 6. 3958 DD5 server rear view with OpenStorage configuration, Feature Code 3457
10 IBM System Storage TS7650 and TS7650G ProtecTIER Deduplication Solutions: Introduction and Planning Guide
Table 3. 3958 DD5 server rear view: Slot assignments, ports, and connections for
OpenStorage and FSI (continued)
A1 Integrated
Ethernet 1 port
eth12 Integrated
Ethernet 1 port
eth8
A2 Integrated
Ethernet 2 port
eth13 Integrated
Ethernet 2 port
eth9
B SYS MGMT Ethernet port: System management Ethernet port used by the IMM
as a web interface for system-management information control; for example, for
access to the IMM Event log.
V IMM Video port
S SAS port
E1 USB port 1
E2 USB port 2
E3 USB port 3
E4 USB port 4
P1 Power connection
P2 Power connection
For additional information about the gateway server ports, see Hardware, cabling,
and infrastructure responsibilities on page 83.
The following illustration shows the controls, LEDs, and connectors on the front of
the server.
Table 4. Gateway server front view
Callout Description
1 Electrostatic discharge connector
2 DVD-eject button: Press this button to
release a CD or DVD from the DVD drive.
3 DVD drive activity LED: When this LED is
lit, it indicates that the DVD drive is in use.
4 USB connectors: Connect USB devices to
these connectors.
t
s
7
6
0
7
6
9
1
2
3
4 5 6
7
8
Figure 7. Gateway server front view
Chapter 1. Introduction 11
Table 4. Gateway server front view (continued)
5 Scalability LED
6 Operator information panel: This panel
contains controls and LEDs.
7 Hard disk drive activity LED: On some
server models, each hot-swap hard disk
drive has an activity LED. When this LED is
flashing, it indicates that the drive is in use.
8 Hard disk drive status LED: On some server
models, each hot-swap hard disk drive has a
status LED. When this LED is lit
continuously, that individual drive is faulty.
When the drive is connected to the
integrated SAS controller with RAID
capabilities, a flashing status LED indicates
that the drive is a secondary drive in a
mirrored pair and the drive is being
synchronized.
The following illustration shows the controls and LEDs on the operator
information panel.
Table 5 describes the LEDs and controls on the operator information panel.
Table 5. Operator information panel
Item Description
1 Information LED: When this LED is lit, it indicates that there is a suboptimal
condition in the server and that light path diagnostics will light an
additional LED to help isolate the condition. This LED and LEDs on the
light path diagnostics panel remain lit until you resolve the condition or you
press the remind button.
2 System-error LED: When this LED is lit, it indicates that a system error has
occurred. An LED on the light path diagnostics panel is also lit to help
isolate the error.
3 Locator button/locator LED: Press this button to turn the locator LED on
and off manually. In multi-node configurations, press this button to turn the
locator LED on and off in all nodes in the configuration.
4 Ethernet port activity LEDs: When these LEDs flash, they indicate that there
is activity between the server and the network on the indicated port.
5 Power control button cover: Slide this cover over the power-control button to
prevent the server from being turned off accidentally.
1 2
1
2
3 4 5
6
7
t
s
7
6
0
1
7
1
Figure 8. Gateway server operator information panel
12 IBM System Storage TS7650 and TS7650G ProtecTIER Deduplication Solutions: Introduction and Planning Guide
Table 5. Operator information panel (continued)
6 Power control button/power-on LED: Press this button to turn the server on
and off manually.
7 Ethernet icon LED: This LED lights the Ethernet icon.
TS7650 Appliance hardware components
The TS7650 Appliance consists of four hardware machine types and the ProtecTIER
software.
For TS7650G hardware components, see TS7650G hardware components on page
3.
The 3952 F05 Frame is used to house the components of the TS7650 Appliance. The
TS7650 Appliance is available in the following stand-alone and clustered
configurations.
Replication is available in both stand-alone and clustered configurations.
Replication requires that the source and destination systems be separate and
identical in size and configuration, that is, stand-alone to stand-alone or clustered
to clustered.
Note: You must have a license for the replication feature for each ProtecTIER
server in the replication grid.
Each system can function as a hub or as a spoke. Replication does not require that
the source and destination systems be identical in size and configuration.
Important: Both the source and the destination must be completely installed and
configured before replication can be enabled. Resources should be planned so that
the destination machine is able to receive replications from all source machines.
The space allocated for replication in the destination machine should be larger than
the sum of all the data in the sources that need to be replicated. When planning for
the performance of the destination, the amount of data that needs to be replicated
and the time allocated for replication should be considered.
There are two types of replication grid:
Many-to-one
In a many-to-one environment, replication groups are created where
multiple source repositories (spokes) can receive local backups and replicate
to a single destination (hub). The destination repository can then act as a
Disaster Recovery site for any number of the source repositories while still
allowing local backups and replication from the active source repositories.
Many-to-one replication defines the following two roles in a replication
grid:
v Spoke - A backup target that can only replicate to a single hub, may not
be a target for replication.
v Hub - A replication and backup target, may receive replication from up
to 12 spokes, may not replicate (besides failback).
A group of one hub and one or more spokes is referred to as a topology
group. A single grid may include up to eight hubs and therefore up to eight
topology groups. Spokes do not need physical connections between them.
Chapter 1. Introduction 13
All repositories need a network connection to the replication manager
server (a PT or dedicated host via RPQ approval).
Currently, the only many-to-one topology group supported is a VTL
12-way configuration, which consists of one to twelve spokes associated
with one hub.
Note: When upgrading from one-to-one replication to many-to-one
replication, the Replication Manager server automatically upgrades the
grid's database; therefore all replication pairs will be set as hub and spoke
accordingly. The GUI behaves as its multiple many-to-one pairs.
Many-to-many
In a many-to-many environment, replication groups are created where
multiple repositories can replicate to each other. A many-to-many
replication group can be defined with multiple repositories, where each
repository assumes the responsibility of a hub repository and can receive
local backups, replicate data to remote hub repositories, as well as receive
replicated data from remote hub repositories.
The following many-to-many topology groups are supported:
VTL 4-way
In a VTL configuration, up to four repositories act as both hub and
spoke.
OpenStorage 12-way
In an OpenStorage configuration, up to twelve repositories act as
both hub and spoke.
FSI 16-way
In an FSI configuration, up to sixteen repositories act as both hub
and spoke.
For all many-to-one and many-to-many configurations, the same cartridge can be
replicated from its principal repository to up to three destination repositories.
Different cartridges can be replicated between multiple hub repositories in a
bidirectional manner.
For a stand-alone configuration, one IBM machine type and model 3958 AP1 server
is required. For a clustered configuration, two 3958 AP1 servers are required, along
with an FC 3437 Cluster Connection Kit, which consists of:
v two 1 Gb (gigabit) Ethernet switches, SMC model 8126L2
v one network power switch, Western Telematic, Inc. (WTI) model VMR-8HD20-2
v power cables
v Ethernet cables
v mounting hardware
Red Hat Linux version 5.6 is required to run on the appliance server. For more
information, see TS7650 Appliance feature codes on page 65.
FC 2722 provides an IBM Total Storage System Console (TSSC) and the
accompanying Keyboard/Video/Monitor (KVM) switch. These items are required
for installation, service, and maintenance of the TS7650 Appliance. IBM
recommends that the TSSC be installed in the same rack as the appliance server.
However, an existing TSSC may be used, provided it is within 100 feet of the
appliance server. For additional information on hardware requirements, see
Chapter 5, Customer installation responsibilities, on page 81.
14 IBM System Storage TS7650 and TS7650G ProtecTIER Deduplication Solutions: Introduction and Planning Guide
Table 6 describes the possible hardware component configurations for the IBM
System Storage TS7650 ProtecTIER Deduplication Appliance.
Table 6. IBM System Storage TS7650 ProtecTIER Deduplication Appliance hardware
component configurations
Configuration description Illustration
2 drawer stand-alone TS7650
Appliance (9 TB)
v Figure 9 on page 16 shows the front view of a 2 drawer
TS7650 Appliance.
v Figure 10 on page 17 shows the rear view of a 2 drawer
TS7650 Appliance.
4 drawer stand-alone TS7650
Appliance (18 TB)
v Figure 11 on page 18 shows the front view of a 4 drawer
TS7650 Appliance.
v Figure 12 on page 19 shows the rear view of a 4 drawer
TS7650 Appliance.
8 drawer stand-alone TS7650
Appliance (36 TB)
v Figure 13 on page 20 shows the front view of an 8 drawer
TS7650 Appliance.
v Figure 14 on page 21 shows the rear view of an 8 drawer
TS7650 Appliance.
8 drawer clustered TS7650
Appliance (36 TB)
v Figure 15 on page 22 shows the front view of an 8 drawer
clustered TS7650 Appliance.
v Figure 16 on page 23 shows the rear view of an 8 drawer
clustered TS7650 Appliance.
Chapter 1. Introduction 15
Table 7. Feature codes for components in a 2 drawer TS7650 Appliance
Key Feature code
1 FC 2722
2 FC 3170
3 FC 3707
4 FC 3708
Note: For a detailed description of feature codes, see Feature codes for 3958 AP1
appliance server on page 66.
t
s
7
6
0
5
7
3
Empty (1U)
Empty (1U)
Empty (1U)
Empty (1U)
Empty (1U)
Empty (1U)
TSSC (1U)
KVM + TSSC Network Sw. (1U)
EXP (FC 3707)
CN (FC 3708)
3
9
5
2
F
0
5
B
a
s
e
F
r
a
m
e
Empty (1U)
Empty (1U)
Empty (1U)
Empty (1U)
Empty (1U)
Empty (1U)
Empty (1U)
Empty (1U)
Empty (1U)
Empty (1U)
Empty (1U)
Empty (1U)
Empty (1U)
Empty (1U)
Empty (1U)
Empty (1U)
Empty (1U)
Empty (1U)
1
2
3
4
ProtecTIER
server (4U)
Figure 9. Front view of a 2 drawer TS7650 Appliance
16 IBM System Storage TS7650 and TS7650G ProtecTIER Deduplication Solutions: Introduction and Planning Guide
Table 8. Feature codes for components in a 2 drawer TS7650 Appliance
Key Feature code
1 FC 2722
2 FC 3170
3 FC 3707
4 FC 3708
Note: For a detailed description of feature codes, see Feature codes for 3958 AP1
appliance server on page 66.
TSSC (1U)
TSSC + KVM Network Sw. (1U)
EXP (FC 3707)
CN (FC 3708)
Empty (1U)
Empty (1U)
Empty (1U)
Empty (1U)
K
V
M
S
w
i
t
c
h
t
s
7
6
0
5
7
2
P
o
w
e
r
D
i
s
t
r
i
b
u
t
i
o
n
U
n
i
t
(
B
)
TJ5
TJ4
TJ8
TJ1
P
o
w
e
r
D
i
s
t
r
i
b
u
t
i
o
n
U
n
i
t
(
T
)
Top
PDU
Bot
PDU
36U
Frame
BJ5
BJ4
BJ8
BJ3
BJ1
Empty (1U)
Empty (1U)
Empty (1U)
Empty (1U)
Empty (1U)
Empty (1U)
Empty (1U)
Empty (1U)
Empty (1U)
Empty (1U)
Empty (1U)
Empty (1U)
Empty (1U)
Empty (1U)
Empty (1U)
Empty (1U)
Empty (1U)
Empty (1U)
Empty (1U)
Empty (1U)
1
2
3
4
ProtecTIER
server (4U)
Figure 10. Rear view of a 2 drawer TS7650 Appliance
Chapter 1. Introduction 17
Table 9. Feature codes for components in a 4 drawer TS7650 Appliance
Key Feature code
1 FC 2722
2 FC 3170
3 FC 3707
4 FC 3708
Note: For a detailed description of feature codes, see Feature codes for 3958 AP1
appliance server on page 66.
t
s
7
6
0
1
6
3
Empty (1U)
Empty (1U)
Empty (1U)
Empty (1U)
Empty (1U)
Empty (1U)
TSSC (1U)
KVM + TSSC Network Sw. (1U)
3958-AP1
7233-PAF (4U)
EXP810 (3U)
DS4700 (3U)
3
9
5
2
F
0
5
B
a
s
e
F
r
a
m
e
Empty (1U)
Empty (1U)
Empty (1U)
Empty (1U)
Empty (1U)
Empty (1U)
Empty (1U)
Empty (1U)
Empty (1U)
Empty (1U)
Empty (1U)
Empty (1U)
EXP810 (3U)
EXP810 (3U)
1
2
3
4
3
3
Figure 11. Front view of a 4 drawer TS7650 Appliance
18 IBM System Storage TS7650 and TS7650G ProtecTIER Deduplication Solutions: Introduction and Planning Guide
Table 10. Feature codes for components in a 4 drawer TS7650 Appliance
Key Feature code
1 FC 2722
2 FC 3170
3 FC 3707
4 FC 3708
Note: For a detailed description of feature codes, see Feature codes for 3958 AP1
appliance server on page 66.
Empty (1U)
Empty (1U)
Empty (1U)
Empty (1U)
Empty (1U)
Empty (1U)
TSSC (1U)
KVM + TSSC Network Sw. (1U)
EXP810 (3U)
DS4700 (3U)
Empty (1U)
Empty (1U)
Empty (1U)
Empty (1U)
Empty (1U)
Empty (1U)
Empty (1U)
Empty (1U)
Empty (1U)
Empty (1U)
Empty (1U)
Empty (1U)
EXP810 (3U)
EXP810 (3U)
K
V
M
S
w
i
t
c
h
t
s
7
6
0
1
6
4
TJ5
TJ4
TJ8
TJ1
P
o
w
e
r
D
i
s
t
r
i
b
u
t
i
o
n
U
n
i
t
(
T
)
Top
PDU
Bot
PDU
BJ5
BJ4
BJ8
BJ3
BJ1
BJ2 TJ2
P
o
w
e
r
D
i
s
t
r
i
b
u
t
i
o
n
U
n
i
t
(
B
)
1
2
3
4
3
3
ProtecTIER
server (4U)
Figure 12. Rear view of a 4 drawer TS7650 Appliance
Chapter 1. Introduction 19
Table 11. Feature codes for components in an 8 drawer TS7650 Appliance
Key Feature code
1 FC 3707
2 FC 3708
3 FC 2722
4 FC 3170
Note: For a detailed description of feature codes, see Feature codes for 3958 AP1
appliance server on page 66.
t
s
7
6
0
1
5
8
Empty (1U)
Empty (1U)
Empty (1U)
Empty (1U)
Empty (1U)
Empty (1U)
EXP810 (3U)
EXP810 (3U)
EXP810 (3U)
DS47000 (3U)
TSSC (1U)
KVM + TSSC Network Sw. (1U)
ProtecTIER
server (4U)
EXP810 (3U)
EXP810 (3U)
EXP810 (3U)
DS4700 (3U)
3
9
5
2
F
0
5
B
a
s
e
F
r
a
m
e 1
2
3
4
1
1
1
1
1
2
Figure 13. Front view of an 8 drawer TS7650 Appliance
20 IBM System Storage TS7650 and TS7650G ProtecTIER Deduplication Solutions: Introduction and Planning Guide
Table 12. Feature codes for components in an 8 drawer TS7650 Appliance
Key Feature code
1 FC 3707
2 FC 3708
3 FC 2722
4 FC 3170
Note: For a detailed description of feature codes, see Feature codes for 3958 AP1
appliance server on page 66.
Empty (1U)
DS47000 (3U)
EXP810 (3U)
EXP810 (3U)
EXP810 (3U)
TSSC (1U)
TSSC + KVM Network Sw. (1U)
EXP810 (3U)
EXP810 (3U)
EXP810 (3U)
DS47000 (3U)
Empty (1U)
Empty (1U)
Empty (1U)
Empty (1U)
Empty (1U)
K
V
M
S
w
i
t
c
h
t
s
7
6
0
1
6
0
P
o
w
e
r
D
i
s
t
r
i
b
u
t
i
o
n
U
n
i
t
(
B
)
TJ7
TJ6
TJ5
TJ4
TJ8
TJ2
TJ1
P
o
w
e
r
D
i
s
t
r
i
b
u
t
i
o
n
U
n
i
t
(
T
)
Top
PDU
Bot
PDU
BJ7
BJ6
BJ5
BJ4
BJ8
BJ3
BJ2
BJ1
1
1
1
2
3
2
4
1
1
1
ProtecTIER
server (4U)
Figure 14. Rear view of a 8 drawer TS7650 Appliance
Chapter 1. Introduction 21
Table 13. Feature codes for components in an 8 drawer clusteredTS7650 Appliance
Key Feature code
1 FC 3437
2 FC 3707
3 FC 3708
4 FC 3170
5 FC 2722
Note: For a detailed description of feature codes, see Feature codes for 3958 AP1
appliance server on page 66.
t
s
7
6
0
1
5
9
3
9
5
2
F
0
5
B
a
s
e
F
r
a
m
e
Network Sw. (1U)
Network Sw. (1U)
DS47000 (3U)
EXP810 (3U)
EXP810 (3U)
EXP810 (3U)
ProtecTIER
server (4U)
TSSC (1U)
KVM + TSSC Network Sw. (1U)
EXP810 (3U)
EXP810 (3U)
EXP810 (3U)
DS47000 (3U)
1
2
3
4
5
2
4
2
2
2
3
2
ProtecTIER
server (4U)
Figure 15. Front view of an 8 drawer clustered TS7650 Appliance
22 IBM System Storage TS7650 and TS7650G ProtecTIER Deduplication Solutions: Introduction and Planning Guide
Table 14. Feature codes for components in an 8 drawer clustered TS7650 Appliance
Key Feature code
1 FC 3437
2 FC 3707
3 FC 3708
4 FC 3170
5 FC 2722
Note: For a detailed description of feature codes, see Feature codes for 3958 AP1
appliance server on page 66.
Network Sw. (1U)
DS47000 (3U)
EXP810 (3U)
EXP810 (3U)
EXP810 (3U)
TSSC (1U)
KVM + TSSC Network Sw. (1U)
EXP810 (3U)
EXP810 (3U)
EXP810 (3U)
DS47000 (3U)
K
V
M
S
w
i
t
c
h
t
s
7
6
0
1
6
5
TJ5
TJ4
TJ1
Top
PDU
Bot
PDU
BJ5
BJ4
BJ3
BJ1
Network Sw. (1U)
BJ7
TJ8
BJ8
NPS
BJ6
BJ2
TJ10
BJ10
TJ7
TJ6
TJ2
P
o
w
e
r
D
i
s
t
r
i
b
u
t
i
o
n
U
n
i
t
(
T
)
P
o
w
e
r
D
i
s
t
r
i
b
u
t
i
o
n
U
n
i
t
(
B
)
3
4
2
2
2
2
2
2
5
4
1
3
5
1
2
3
4
5
6
7
8
ProtecTIER
server (4U)
ProtecTIER
server (4U)
Figure 16. Rear view of an 8 drawer clustered TS7650 Appliance
Chapter 1. Introduction 23
Appliance server (3958 AP1) FC 3170
The appliance server provides the connections to the TSSC and the customer SAN
network (for connection to the client hosts and virtual tape libraries).
Server rear view, VTL
When configured for VTL, the 3958 AP1 servers are equipped with:
v two Emulex Fibre Channel Host Bus Adapters (HBA)
v two QLogic Fibre Channel HBAs
v one 1 gigabit (Gb) quad-port Ethernet adapter
v two on-board Ethernet ports
See Figure 17 and Table 15.
Table 15. 3958 AP1 server rear view: Slot assignments, ports, and connections for VTL
Slot, Port, or Connection VTL use
1 Slot 1 Emulex Fibre Channel Host Bus Adapter (HBA)
v Label port 1 = Fibre Channel port 2
v Label port 2 = Fibre Channel port 3
2 Slot 2 Emulex Fibre Channel Host Bus Adapter (HBA)
v Label port 1 = Fibre Channel port 0
v Label port 2 = Fibre Channel port 1
3 Slot 3 Blank
4 Slot 4 Blank
5 Slot 5 Intel Pro Quad-port gigabit Ethernet adapter
(Port 1 = eth0, Port 2 = eth1, Port 3 = eth2, Port 4 = eth3)
6 Slot 6 QLogic HBA
7 Slot 7 QLogic HBA
8 QPI Slot 1 Not used
9 QPI Slot 2 Not used
A1 Integrated Ethernet 1
port
(eth4)
A2Integrated Ethernet 2
port
(eth5)
t
s
7
6
0
7
5
2
ProtecTIER Server
1
2
1 1 1
2 2 2
1 2 3 4 5 6 7
E1
E2
1
3
2
4
P1 P2
8
A1 A2
9
B
V
E3
E4
S
Figure 17. 3958 AP1 server rear view with VTL configuration
24 IBM System Storage TS7650 and TS7650G ProtecTIER Deduplication Solutions: Introduction and Planning Guide
Table 15. 3958 AP1 server rear view: Slot assignments, ports, and connections for
VTL (continued)
Slot, Port, or Connection VTL use
B SYS MGMT Ethernet port System management Ethernet port used by the IMM as a
web interface for system-management information control;
for example, for access to the IMM Event log.
V IMM Video port
S Serial Attached SCSI
(SAS) port
E1 Universal Serial Bus
(USB) port 1
E2 Universal Serial Bus
(USB) port 2
E3 Universal Serial Bus
(USB) port 3
E4 Universal Serial Bus
(USB) port 4
P1 Power connection
P2 Power connection
Server rear view, OpenStorage and FSI
When configured for OpenStorage or FSI, the 3958 AP1 servers are equipped with
v one of the following Ethernet adapter configurations:
If two instances of Feature Code 3456 are installed, three 1 Gb quad-port
Ethernet adapters (Figure 18)
If two instances of Feature Code 3457 are installed, two 10 Gb dual-port
Ethernet adapters for use with Fibre Channel cabling and one 1 Gb quad-port
Ethernet adapter (Figure 19 on page 26)
v two dual-port QLogic Fibre Channel HBAs
v two on-board Ethernet ports.
t
s
7
6
0
7
5
3
ProtecTIER Server
1 1 1 1
2 2 2 2
1 2 3 4 5 6 7
E1
E2
1
3
4
3 3
2
4 4
P1 P2
8
A1 A2
9
B
V
E3
E4
S
Figure 18. 3958 AP1 server rear view with OpenStorage configuration, Feature Code 3456
Chapter 1. Introduction 25
Table 16. 3958 AP1 server rear view: Slot assignments, ports, and connections for
OpenStorage and FSI
Item OpenStorage or
FSI use, FC 3456
ethX value (if
applicable), FC
3456
OpenStorage or
FSI use, FC 3457
ethX value (if
applicable), FC
3457
1 Slot 1: not used
2 Slot 2: not used
3 Slot 3: Intel Pro
Quad-port gigabit
Ethernet adapter
v eth4 (port 1)
v eth5 (port 2)
v eth6 (port 3)
v eth7 (port 4)
Slot 3: Dual-port
10 gigabit Ethernet
adapter
v eth4 (port 1)
v eth5 (port 2)
4 Slot 4: Intel Pro
Quad-port gigabit
Ethernet adapter
v eth8 (port 1)
v eth9 (port 2)
v eth10 (port 3)
v eth11 (port 4)
Slot 4: Dual-port
10 gigabit Ethernet
adapter
v eth6 (port 1)
v eth7 (port 2)
5 Slot 5: Quad-port
gigabit Ethernet
adapter
v eth0 (port 1)
v eth1 (port 2)
v eth2 (port 3)
v eth3 (port 4)
Slot 5: Quad-port
gigabit Ethernet
adapter
v eth0 (port 1)
v eth1 (port 2)
v eth2 (port 3)
v eth3 (port 4)
6 Slot 6: QLogic HBA
7 Slot 7: QLogic HBA
8 QPI Slot 1: not used
9 QPI Slot 2: not used
A1 Integrated
Ethernet 1 port
eth12 Integrated
Ethernet 1 port
eth8
A2 Integrated
Ethernet 2 port
eth13 Integrated
Ethernet 2 port
eth9
B SYS MGMT Ethernet port: System management Ethernet port used by the IMM
as a web interface for system-management information control; for example, for
access to the IMM Event log.
V IMM Video port
S SAS port
E1 USB port 1
E2 USB port 2
E3 USB port 3
Figure 19. 3958 AP1 server rear view with OpenStorage configuration, Feature Code 3457
26 IBM System Storage TS7650 and TS7650G ProtecTIER Deduplication Solutions: Introduction and Planning Guide
Table 16. 3958 AP1 server rear view: Slot assignments, ports, and connections for
OpenStorage and FSI (continued)
E4 USB port 4
P1 Power connection
P2 Power connection
For additional information about the appliance server ports, see Hardware,
cabling, and infrastructure responsibilities on page 83.
The following illustration shows the controls, LEDs, and connectors on the front of
the server.
Table 17. Appliance server front view
Callout Description
1 Electrostatic discharge connector
2 DVD-eject button: Press this button to
release a CD or DVD from the DVD drive.
3 DVD drive activity LED: When this LED is
lit, it indicates that the DVD drive is in use.
4 USB connectors: Connect USB devices to
these connectors.
5 Scalability LED
6 Operator information panel: This panel
contains controls and LEDs.
7 Hard disk drive activity LED: On some
server models, each hot-swap hard disk
drive has an activity LED. When this LED is
flashing, it indicates that the drive is in use.
t
s
7
6
0
7
6
9
1
2
3
4 5 6
7
8
Figure 20. Appliance server front view
Chapter 1. Introduction 27
Table 17. Appliance server front view (continued)
8 Hard disk drive status LED: On some server
models, each hot-swap hard disk drive has a
status LED. When this LED is lit
continuously, that individual drive is faulty.
When the drive is connected to the
integrated SAS controller with RAID
capabilities, a flashing status LED indicates
that the drive is a secondary drive in a
mirrored pair and the drive is being
synchronized.
The following illustration shows the controls and LEDs on the operator
information panel.
Table 18 describes the controls and LEDs on the operator information panel.
Table 18. Operator information panel
Item Description
1 Information LED: When this LED is lit, it indicates that there is a suboptimal
condition in the server and that light path diagnostics will light an
additional LED to help isolate the condition. This LED and LEDs on the
light path diagnostics panel remain lit until you resolve the condition or you
press the remind button.
2 System-error LED: When this LED is lit, it indicates that a system error has
occurred. An LED on the light path diagnostics panel is also lit to help
isolate the error.
3 Locator button/locator LED: Press this button to turn the locator LED on
and off manually. In multi-node configurations, press this button to turn the
locator LED on and off in all nodes in the configuration.
4 Ethernet port activity LEDs: When these LEDs flash, they indicate that there
is activity between the server and the network on the indicated port.
5 Power control button cover: Slide this cover over the power-control button to
prevent the server from being turned off accidentally.
6 Power control button/power-on LED: Press this button to turn the server on
and off manually.
7 Ethernet icon LED: This LED lights the Ethernet icon.
Disk controller (1814 70H) FC 3706 or (1814 94H) 3708
The disk controller supports sixteen 450 GB (15k rpm), 4 Gbps, fibre channel disk
drive modules (DDMs). It comes with two RAID controllers, two power supplies,
1 2
1
2
3 4 5
6
7
t
s
7
6
0
1
7
1
Figure 21. Appliance server operator information panel
28 IBM System Storage TS7650 and TS7650G ProtecTIER Deduplication Solutions: Introduction and Planning Guide
and two cooling units. The disk controller provides dual redundant controllers,
redundant cooling, redundant power, and battery backup of the RAID controller
cache.
The disk controller is designed to provide maximum host and drive-side
redundancy, enabling full redundant drive loop support to additional disk storage
capacity in the expansion frames via the drive loop port from each RAID
controller. In addition, each RAID controller supports direct attachment of two
servers that contain two fibre channel host bus adapters each. External cables and
small form-factor pluggable (SFP) modules connect the disk controller to the
expansion units and the servers. For optimum performance, RAID 5 configuration
is recommended.
Currently, the only expansion unit that can be attached to the 1814 70H disk
controller is the 1812 81H disk expansion module.
For more support information about the disk controller, go to www.ibm.com/
servers/storage/support/disk/ and select Disk Systems > DS4700 Express.
Disk expansion module (1812 81H) FC 3707
The disk expansion module supports sixteen 450 GB (15k rpm), 4 Gbps, fibre
channel disk drive modules (DDMs). For optimum performance, RAID 5
configuration is recommended.
The disk expansion module supports redundant, dual-loop configurations with the
disk controller and other disk expansion modules. External cables and SFP
modules connect the controller to the disk expansion module. The disk expansion
module provides continuous, reliable service and uses hot-swap technology.
Software
ProtecTIER is a disk-based data storage system. It uses data deduplication
technology to store data to disk arrays. With Feature Code 9022, the ProtecTIER
Virtual Tape Library (VTL) service emulates traditional automated tape libraries.
With Feature Code 9023, the TS7650G and the TS7650 Appliance can be configured
as OpenStorage and integrated with Symantec NetBackup. With Feature Code
9024, a stand-alone TS7650G or TS7650 Appliance can be configured as FSI.
Note: A single repository only supports either Feature Code 9022 (VTL emulation),
9023 (OpenStorage) or 9024 (FSI); the three options cannot be combined in a single
repository in any way.
ProtecTIER Manager
The ProtecTIER Manager workstation is a customer-supplied workstation that runs
the ProtecTIER Manager software. The ProtecTIER Manager software provides the
management GUI interface to the TS7650G and the TS7650 Appliance.
System requirements for the workstation are provided in this document in
ProtecTIER Manager workstation requirements on page 82.
Complete information about installing and using the ProtecTIER Manager
workstation is provided in the IBM System Storage ProtecTIER User's Guide for
Enterprise Edition and Appliance Edition, GA32-0922.
Chapter 1. Introduction 29
Note: ProtecTIER Manager will not be optimal on all resolutions. 1024 768 is the
minimum supported; 1280 1024 is recommended.
ProtecTIER VTL
The ProtecTIER VTL service emulates traditional tape libraries. By emulating tape
libraries, ProtecTIER VTL enables you to transition to disk backup without having
to replace your entire backup environment. Your existing backup application can
access virtual robots to move virtual cartridges between virtual slots and drives.
The backup application perceives that the data is being stored on cartridges while
ProtecTIER actually stores data on a deduplicated disk repository on the appliance
storage. ProtecTIER supports an absolute maximum of 62,000 virtual cartridges,
slots, and tape drives, although the maximum number might be lower for
individual systems because of available storage space.
OpenStorage
With OpenStorage , ProtecTIER can be integrated with NetBackup to provide the
means for backup-to-disk without having to emulate tape. Using a plug-in that is
installed on an OpenStorage-enabled media server, ProtecTIER can implement a
communication protocol that supports data transfer and control between the
backup server and the ProtecTIER server. Therefore, to support the plug-in,
ProtecTIER implements a storage server emulation.
Server Running
Backup Application
ProtecTIER Server
Virtual Tape Drives
Virtual
Robot
Virtual Cartridges and Slots
Port 0
Port 1
Storage Fabric
Virtual Library
Repository
Virtual Library
t
s
7
6
0
4
3
5
Figure 22. Tape library emulation
30 IBM System Storage TS7650 and TS7650G ProtecTIER Deduplication Solutions: Introduction and Planning Guide
FSI
When configured for FSI, ProtecTIER emulates a network attached storage (NAS)
backup target capable of using both HyperFactor and ProtecTIER Native
Replication bandwidth reduction techniques for storing and replicating
deduplicated data. ProtecTIER FSI enables backup servers running backup
applications to connect over IP networks to ProtecTIER, without the use of Fibre
Channel connectivity, and allows you to use your existing tools and capabilities to
integrate a ProtecTIER NAS-based backup target into your environment.
FSI systems support:
v Sixteeen-way, many-to-many, replication topology groups
v Creation of backup images produced by backup applications (not intended for
primary storage deduplication)
v File system access security through the use of a Microsoft workgroup domain
(default) or Active Directory domain
v The maximum number of concurrent streams and host connections listed in
Table 19
Restriction: Because backup applications might assign a backup job to more
than one stream, the maximum number of backup jobs available at your
installation might be lower than the maximum number of streams supported by
FSI listed in Table 19.
Table 19. Maximum number of FSI streams and host connections
Maximum number of
concurrent... For the 3958 DD5 server For the 3958 AP1 server
streams 192 32
host connections 64 16
ProtecTIER exposes virtual interfaces to the host, such as a media server with the
plug-in installed. In version 3.2, the physical Ethernet ports are assigned to one
virtual application interface. Currently, the physical ports are assigned to virtual
interface ost1 or fsi1, depending on the server configuration. This assignment
option is used to group several physical interfaces into a single virtual interface,
and create a bond configuration of several physical interfaces. Each virtual
interface used must be configured with a corresponding IP address.
ProtecTIER Server
PT Repository
STS
L
S
U
2
LSU1
t
s
7
6
0
7
3
5
0
M
IBM
ProtecTIER
plug-in
Server Running
Backup Application
TCP/IP
Comm
Server
Comm
Client
Storage
Server
ProtecTIER
Core
Figure 23. OpenStorage
Chapter 1. Introduction 31
Attention: Each configured IP address on the same server needs to be on a
different subnet, and each subnet needs to be on a different VLAN. If separate
subnets and VLANs are not used, in certain environments and networks, network
packets can move to other subnets, which can harm network performance and
potentially reduce the network's quality of service.
In addition, each virtual interface containing more than one physical interface
(configured as a bond) needs to be configured with a load balancing method. For a
server with 10 Gb interfaces, where bonding is implemented, the recommended
load balancing method is LACP with L3L4.
For more information about bonding, the different load balancing methods, and
whether to configure bonds at all, refer to the Best Practices Guide for IBM System
Storage TS7600 ProtecTIER Deduplication Solutions, GA32-0924 or the IBM ProtecTIER
Implementation and Best Practices, IBM Redbooks
publication SG24-8025.
TSSC microcode
If you are using an existing TSSC, before installing or upgrading ProtecTIER, the
TSSC microcode must be 5.12.x or later. To check the version, go to the TS3000
System Console Screen Login screen as shown in Figure 24.
If an update is required, contact IBM Service.
t
s
7
6
0
7
9
0
Figure 24. TS3000 System Console Screen Login screen
32 IBM System Storage TS7650 and TS7650G ProtecTIER Deduplication Solutions: Introduction and Planning Guide
Supported hardware and software
This section provides support information for the TS7650G and the TS7650
Appliance in the following areas:
v Supported virtual devices
v Supported operating systems on page 34
v Supported device drivers on page 34
v Supported SAN switches
v Supported LUNs on page 34
Supported virtual devices
The latest firmware and driver code requirements for connection to these devices
are posted on the IBM website.
The following virtual tape libraries and drives are supported:
v DTC VTF 0100 virtual tape libraries
v ATL P3000 0100 virtual tape libraries
v Quantum DLT 7000 drives
v IBM LTO-2 drives
v IBM LTO-3 drives (TS7650 Appliance only)
v IBM TS3500 virtual tape libraries
v IBM V-TS3500 100 (TS7650 Appliance only)
The latest firmware and driver code requirements for connection to these devices
are posted on the IBM website:
www.ibm.com/storage/support/
Select Tape Systems from the Product family menu and select either TS7650G or
TS7650 Appliance, as appropriate, from the Product menu. Click the Plan or
Upgrade tab, and under Product Considerations, click TS7650G product
information or TS7650 Appliance product information, as appropriate.
Supported SAN switches
The TS7650G and the TS7650 Appliance support a wide variety of switches in the
SAN environment. All switches attached directly to the TS7650G or TS7650
Appliance must be loop protocol capable.
For information on supported switches and required code levels for the switches,
do one of the following:
v For a list of compatible switches for the TS7650G or TS7650 Appliance, visit the
web at:
www.ibm.com/storage/support/
Select Tape & optical from the Product family menu and select TS7650
Appliance or TS7650G, as appropriate, from the Product menu.
v Contact your IBM Sales Representative.
v If you attach your TS7650G or TS7650 Appliance to a non-IBM platform with
non-IBM software, IBM recommends that you contact your software vendor to
obtain a matrix of compatible hardware, software, firmware revisions, and
adapter cards.
Chapter 1. Introduction 33
v The customer must use an additional connectivity device between the optical
fiber directly connected to optical adapters (for example, Fibre Channel, ESCON,
or FICON) and an external public network. It can be a patch panel, router,
switch, or other suitable device. Optical fiber connectivity that does not go over
a public network does not require an additional connectivity device.
Supported LUNs
This section lists the LUN limits for a TS7650G setup.
Note: The following specifications apply to the TS7650G only.
v The maximum LUN size supported for the TS7650G is 8 TB. This includes both
metadata and user data LUN classifications.
v The minimum LUN size supported for the TS7650G is 1 GB, the minimum for
the quorum LUN.
v The maximum number of LUNs supported for the TS7650G is 1000.
v The minimum number of LUNs supported for a ProtecTIER Gateway is four:
one for user data, one for the quorum LUN, and two for metadata.
Supported operating systems
The TS7650G and the TS7650 Appliance can be accessed by a wide variety of
servers, operating systems, and adapters.
To determine the latest attachments, or to get a comprehensive list of compatible
software, perform one of the following:
v For a list of compatible software, operating systems, and servers to access the
TS7650G or TS7650 Appliance, visit the web at:
www.ibm.com/storage/support/
Select Tape & optical from the Product family menu and select either TS7650G
or TS7650 Appliance, as appropriate, from the Product menu.
v Contact your IBM Sales Representative.
Note: If you attach your TS7650G or TS7650 Appliance to a non-IBM platform
with non-IBM software, IBM recommends that you contact your software vendor
to obtain a matrix of compatible hardware, software, firmware revisions, and
adapter cards.
Supported device drivers
This section identifies ways to determine the latest device drivers for the drives of
the TS7650G and the TS7650 Appliance.
IBM provides device driver support for the TS7650G and the TS7650 Appliance.
IBM maintains the latest levels of device drivers and driver documentation. IBM
Service provides device driver support as needed.
Data management and advanced features
The TS7650G and the TS7650 Appliance are designed with data management and
advanced features that allow you to securely process and access your data
according to your business needs, 24 hours a day and 7 days a week.
34 IBM System Storage TS7650 and TS7650G ProtecTIER Deduplication Solutions: Introduction and Planning Guide
RAID
Redundant array of independent disks (RAID) is a method of configuring multiple
disk drives in a storage subsystem for high availability and high performance. The
collection of two or more disk drives presents the image of a single disk drive to
the system. In the event of a single device failure, data can be read or regenerated
from the other disk drives in the array.
The TS7650G and the TS7650 Appliance support the following RAID
configurations:
v RAID 1 for the appliance server's internal hard disk drives
v RAID 5 for user data on attached disk storage
v RAID 6 for user data on attached SATA disk storage (TS7650G only)
v RAID 10 for meta data on attached disk storage
Configure other items such as block size, channel protection, and so on, in
accordance with your disk storage manufacturer's instructions and with the Best
Practices Guide for IBM System Storage TS7600 ProtecTIER Deduplication Solutions,
GA32-0924.
Fencing
This section provides a description of fencing.
The fencing option for servers in the TS7650G and the TS7650 Appliance provides
higher availability for operations by eliminating the down time that can occur
should a hardware or software failure occur in a server. Two-node active-active
support permits the sharing of all disk storage between two servers in a clustered
configuration.
In the fencing design for the TS7650G and the TS7650 Appliance, two servers are
installed in the same frame and configured to monitor each other. In the event that
one server fails to fulfill its responsibilities to the SAN clients it is serving, the
other server will reset the server and allow for an orderly reconstruction of the
servers resources.
Fencing requirements
Fencing is available only in a clustered TS7650G or TS7650 Appliance
configuration.
Follow these requirements when setting up a fencing configuration, depending
upon the solution:
For the TS7650G
You must have one of the following combinations of gateway servers in a single
frame:
v two 3958 DD5s
v two 3958 DD4s
v one 3958 DD5 and one 3958 DD3
v two 3958 DD3s
v one 3958 DD3 and one 3958 DD1
v two 3958 DD1
Notes:
Chapter 1. Introduction 35
v The 3958 DD1 and 3958 DD4 gateway servers cannot be clustered.
v The 3958 DD1 and 3958 DD5 gateway servers can be clustered by RPQ only.
v Fencing with two gateway servers in different frames is not possible, because
both gateway servers must be connected to the same network power switch.
For the TS7650 Appliance
You must have two 3958 AP1 appliance servers in a single frame. One appliance
server is located at the bottom of the frame (node A, the lower server in the rack)
and the other appliance server is located at the top of the frame (node B, the upper
server in the rack).
Note: Fencing with two appliance servers in different frames is not possible,
because both servers must be connected to the same power supply.
Two-node active-active support
This section applies only to the TS7650G.
The use of two-node active-active support in the storage subsystem permits the
sharing of all disk storage between two gateway servers in a clustered
configuration, although the DS3000, DS4000, and DS5000 families are only capable
of active-passive support.
LUN masking
This section describes the LUN masking function.
LUN masking is used to control device visibility by allowing specific devices (for
example, tape drives or robots) to be seen only by a selected group of host
initiators. A host initiator is the WWN, or the physical address of a port of a fiber
card of the host (that is, the server that the backup application is installed on).
LUN masking allows you to assign specific devices to a specific host running
backup application modules. It enables multiple initiators to share the same target
FC port without having conflicts on the devices being emulated.
The LUN masking setup can be monitored and modified at all times during
system operation. LUN masking in ProtecTIER influences the visibility of the
devices by the hosts systems. Keep in mind that every modification to LUN
masking in ProtecTIER may affect the host configuration and may require
rescanning by the hosts.
Replication
This section describes the replication function.
Note: You must have a license for the replication feature for each ProtecTIER
server in the replication grid.
The replication function provides complete system backup and allows ProtecTIER
deployment to be distributed across sites. Each site has a single or clustered
ProtecTIER environment. Each ProtecTIER environment has at least one ProtecTIER
server. The ProtecTIER server that is a part of the replication grid has two
dedicated ports that are used for replication. Replication ports are connected to the
customer's WAN and are configured on two subnets by default.
36 IBM System Storage TS7650 and TS7650G ProtecTIER Deduplication Solutions: Introduction and Planning Guide
Note: Do not configure the replication ports on the same subnet as the external
LAN port, eth0 or on the same subnets as each other. Doing so may cause
replication errors.
Use the pt_net_perf_util utility to test maximal replication performance between
two future ProtecTIER repositories by emulating the network usage patterns of
ProtecTIER's Native Replication component. This utility will not predict replication
performance, but it may discover performance bottlenecks.
Many-to-one replication
ProtecTIER many-to-one replication supports both single node and clustered
ProtecTIER configurations.
Many-to-one replication provides the following functionality and support:
v Setting replication performance limits - This feature allows the user to set
system-wide physical and/or nominal limits in order to indicate to the
replication engine the maximal replication transfer rate allowed in the network
for a specific repository. The performance limits refer to overall resource
consumption of the system, and is reflected on the network transfer rate.
Performance limits are based on the Replication Rate Control (RRC). Current
RRC is used when a user does not provide a time frame and the system
replicates continuously. The rate calculation uses performance limits to
understand the maximum rate possible in both levels of system usage (IDLE,
BUSY), and then it normalizes the rate accordingly.
v Reserving space for hub repository - This feature provides the ability to
exclusively assign a fragment of a hub repository's capacity for local backups. In
large deployments with many spokes replicating, capacity management done by
the user might cause a situation where replication is trying to occupy all the
space in hub repository. Since the assumption is that backup has precedence
over replication, this feature has been added to ensure that capacity is reserved
only for local backup, so that replication cannot be written to this storage
fragment. Error notifications appear in the event the capacity reserved for the
local backup or the capacity reserved for replication on the repository hub is
running out of space.
v Enhanced monitoring of repository space consumption - This enhancement is
displayed in the GUI as a nominal data pie, where a user can get at-a-glance the
proportion of the nominal data out of the repository and the internal capacity
distribution of replication data vs. local backup data and free space.
v Additional Replication information in Repository's cartridge view - This
feature reports cartridge replication properties such as: last update time,
destination, etc. to a replication view that displays replication properties for
cartridges which are also displayed in the regular cartridge view. This feature
allows the user to see replication properties for a batch of cartridges each in a
single row. Sorting capability for the replication fields is equivalent to the sorting
capabilities for the rest of the cartridge fields.
v Disaster Recovery site replaces production site operation - This feature
supports a scenario where a disaster recovery site (the hub) is chosen to replace
one of its spokes permanently. The feature allows the user to take over the
responsibility for the cartridges of the old spoke after running the replace
repository wizard from the Replication Manager.
v Enhanced Timeframe support - This feature enhances the repository timeframe
attribute to be a weekly scheduler on a repository level. The timeframe is a set
of 30 minute time intervals across a full week. The user chooses at which time
Chapter 1. Introduction 37
interval the replication should run during a single week. The timeframe also
uses the performance limits feature for limiting the replication rate when in
timeframe.
v Command Line Interface for Disaster Recovery - This feature is a Command
Line Interface (CLI) that allows a user to run complex queries on cartridges and
provides cartridge batch move operation during a manual DR procedure. The
feature allows the user to query ProtecTIER in order to obtain a list of cartridges
that falls under specific criteria. The query criteria are cartridge replication
properties and cartridge location properties.
Replication grid
The replication grid is defined as an entity that supports replication between its
members. The replication grid members are PT repositories and are configured
using a Replication Manager (RM). The RM is a software component that may be
installed on a dedicated host or on a PT machine. The RM should be able to detect
all members of the various networks that the RM handles on both replication
subnets.
A replication grid defines a set of PT repositories and actions between them. The
RM is server software that is separately deployed on the customer's WAN or on a
PT machine. The RM on a stand-alone installation can manage the configuration of
multiple replication grids in an organization. An agent on each PT system
(specifically on every node) interacts with the server and maintains a table of its
grid's members.
There are two types of replication grid:
Many-to-one
In a many-to-one environment, replication groups are created where
multiple source repositories (spokes) can receive local backups and replicate
to a single destination (hub). The destination repository can then act as a
Disaster Recovery site for any number of the source repositories while still
allowing local backups and replication from the active source repositories.
Many-to-one replication defines the following two roles in a replication
grid:
v Spoke - A backup target that can only replicate to a single hub, may not
be a target for replication.
v Hub - A replication and backup target, may receive replication from up
to 12 spokes, may not replicate (besides failback).
A group of one hub and one or more spokes is referred to as a topology
group. A single grid may include up to eight hubs and therefore up to eight
topology groups. Spokes do not need physical connections between them.
All repositories need a network connection to the replication manager
server (a PT or dedicated host via RPQ approval).
Currently, the only many-to-one topology group supported is a VTL
12-way configuration, which consists of one to twelve spokes associated
with one hub.
Note: When upgrading from one-to-one replication to many-to-one
replication, the Replication Manager server automatically upgrades the
grid's database; therefore all replication pairs will be set as hub and spoke
accordingly. The GUI behaves as its multiple many-to-one pairs.
Many-to-many
38 IBM System Storage TS7650 and TS7650G ProtecTIER Deduplication Solutions: Introduction and Planning Guide
In a many-to-many environment, replication groups are created where
multiple repositories can replicate to each other. A many-to-many
replication group can be defined with multiple repositories, where each
repository assumes the responsibility of a hub repository and can receive
local backups, replicate data to remote hub repositories, as well as receive
replicated data from remote hub repositories.
The following many-to-many topology groups are supported:
VTL 4-way
In a VTL configuration, up to four repositories act as both hub and
spoke.
OpenStorage 12-way
In an OpenStorage configuration, up to twelve repositories act as
both hub and spoke.
FSI 16-way
In an FSI configuration, up to sixteen repositories act as both hub
and spoke.
For all many-to-one and many-to-many configurations, the same cartridge can be
replicated from its principal repository to up to three destination repositories.
Different cartridges can be replicated between multiple hub repositories in a
bidirectional manner.
Important: Be sure to coordinate between the source and destination sites to
ensure that the servers at both locations are fully configured before the you use the
ProtecTIER Replication Manager GUI to create the replication grid. Consult with
Solutions Assurance and your IBM Representative for assistance and information.
Supported replication configurations
v DD5 (source server) + DD5 (destination server) - (s+s), (c+c), (c+s), (s+c)
v DD5 (source server) + DD4 (destination server) - (s+s), (c+c), (c+s), (s+c)
v DD4 (source server) + DD5 (destination server) - (s+s), (c+c), (c+s), (s+c)
v DD4 (source server) + DD4 (destination server) - (s+s), (c+c), (c+s), (s+c)
v DD4 (source server) + DD3 (destination server) - (s+s), (c+c), (c+s), (s+c)
v DD3 (source server) + DD4 (destination server) - (s+s), (c+c), (c+s), (s+c)
v DD1 (source server) + DD1 (destination server) - (s+s), (c+c), (c+s), (s+c)
v DD1 (source server) + DD3 (destination server) - (s+s), (c+c), (c+s), (s+c)
v DD3 (source server) + DD3 (destination server) - (s+s), (c+c), (c+s), (s+c)
v DD5 (source server) + AP1 (destination server) - (s+s), (c+c), (c+s), (s+c)
v DD4 (source server) + AP1 (destination server) - (s+s), (c+c), (c+s), (s+c)
v DD3 (source server) + AP1 (destination server) - (s+s), (c+c), (c+s), (s+c)
v DD1 (source server) + AP1 (destination server) - (s+s), (c+c), (c+s), (s+c)
v AP1 (source server) + AP1 (destination server) - (s+s), (c+c), (c+s), (s+c)
Legend: s = stand-alone c = cluster
Note: The DR node or cluster should be of a higher capability when used as a
multiple destination.
Chapter 1. Introduction 39
Remote support through Call Home
Remote support is available for the TS7650G and the TS7650 Appliance through
the Call Home capability on the TSSC. The Call Home feature reports failures
detected by the ProtecTIER servers. Whenever a failure is detected, Call Home
sends detailed error information to IBM (home). The IBM Service Representative
can then prepare an action plan to handle the problem before traveling to the
affected installation. The appliance or gateway might also periodically send
support information (such as configuration, code versions, and error logs) to IBM.
Doing so speeds-up problem determination and fault resolution. When enabled on
the appliance and gateway, Call Home uses a connection on your Ethernet network
to transmit hardware and software problem reports to IBM. Call Home is enabled
and tested by IBM Service Representatives during initial system installation.
Tip: To enable Call Home, go to the TSSC General Settings page. The Call Home
option allows you to select either a Modem or Ethernet interface. Set the Call
Home option to use the Ethernet interface for the most reliable error notification.
When the Reliability, Availability, and Serviceability (RAS) software on the
ProtecTIER server detects an error condition, Call Home sends detailed error
information through the TSSC to IBM (home). If the error indicates a problem with
a field replaceable unit (FRU), an IBM Service Representative can then prepare an
action plan to handle the problem before traveling to your site.
The TS7650G and the TS7650 Appliance provide four Call Home capabilities:
Problem Call Home, Heartbeat Call Home, Test Call Home, and User-Initiated Call
Home; descriptions follow. RAS sends data files that may be helpful to IBM
Support Center personnel for all four types of Call Home. These data files include
error logs and configuration information, such as the Machine Reported Product
Data (MRPD) log.
Test Call Home
The IBM Service Representative sends a Test Call Home signal after
enabling the Call Home feature during initial installation. You can also
send a Test Call Home to ensure that the setup is correct and that the
appliance or gateway can successfully open a Problem Management
Record (PMR) in the IBM Remote Technical Assistance Information
Network (RETAIN).
Problem Call Home
When RAS detects a problem, RAS initiates a Call Home operation to
create a PMR in RETAIN. The PMR is a single page of text data that
enables the Support Center or the Service Representative to access an
action plan and a list of applicable FRU components.
Heartbeat Call Home
To ensure proper ongoing Call Home functionality, the system sends a
Heartbeat Call Home on a regularly-scheduled basis. The heartbeat interval
is user-defined.
User-Initiated Call Home
You can manually initiate Call Home from the TSSC GUI to collect a
product engineering (PE) package.
40 IBM System Storage TS7650 and TS7650G ProtecTIER Deduplication Solutions: Introduction and Planning Guide
Call Home through the TSSC
The TSSC is a service tool that must be present in an IBM-supported TS7650G or
TS7650 Appliance. You can either order a TSSC with your appliance or gateway, or
use a TSSC already installed at your site.
Attention: While it is possible to operate a TS7650G or TS7650 Appliance without
a connected TSSC, note that IBM does not support this configuration.
For both the TS7650G and the TS7650 Appliance, FC 2722 provides a new TSSC,
while FC 2714 and FC 2715 allow connection of an existing TSSC. For more
information on these feature codes, see the IBM System Storage TS7650 ProtecTIER
Deduplication Appliance and TS7650G Deduplication Gateway Introduction and Planning
Guide, GA32-0918.
Table 20 presents the capabilities of remote support with a TSSC.
Table 20. Remote support capabilities
Customer site Call Home events
v Error initiated
v Heartbeat (regular interval)
v Test
TSSC support capability
v Error-initiated problem reporting for up
to 43 subsystems
v Staged, error-specific data gathering
v Subsystem and system console heartbeat
reporting
v Wellness checking
v Log file storage (daily)
v Code image and documentation
repository (from media and RETAIN Fix
Distribution Library)
TSSC and remote
support service tools
v Code image broadcast
v Call home event log review
v End-of-call completion report
IBM support TSSC remote access
v Authenticated, secure remote access
v Simultaneous call in and call home
v Data transmission (TCP/IP) supported
IBM call home database
v 24/7 access by IBM support staff
v Error analysis and search capability
Chapter 1. Introduction 41
42 IBM System Storage TS7650 and TS7650G ProtecTIER Deduplication Solutions: Introduction and Planning Guide
Chapter 2. Physical planning specifications
This section provides physical planning and site specifications for the TS7650G and
the TS7650 Appliance.
Before the TS7650G or TS7650 Appliance is installed at your site, verify that the
planned installation site meets these requirements, or prepare the site so that it
does meet these requirements. Preparations might involve meeting area
requirements, environmental requirements, and electrical requirements for
installation, service, and operation.
Site preparation
This section describes the preparation involved for installation.
Use the following information to prepare a location for installation of the system's
components.
Prepare a floor plan that includes the following information:
v Power outlet locations, types, and ratings
v Frame locations
v Operator and service clearances
v Dimensions of the area containing all system components
Before hardware installation can begin, the local installation planning
representative must verify that all installation planning and preparation is
complete. Additional user responsibilities include planning for the following:
v Cabling and wiring for connections to the host
v Cooling and heating
v Telephone service (If not using Internet Call Home and support)
v Safety and security
v Fire detection and suppression
v Floors (both raised and non-raised) that meet the operational and structural
requirements necessary for the system components
Important: You must have a license for the replication feature for each ProtecTIER
server in the replication grid. For replication to be enabled, the servers at both
source and destination locations must be fully installed and configured before any
other steps are taken. Use this information for planning at both sites as needed.
Consult with Solutions Assurance and your IBM Representative for assistance and
information.
Lighting considerations
The TS7650G and the TS7650 Appliance are designed for lights-out operation. No
special lighting considerations apply.
Copyright IBM Corp. 2011, 2012 43
Upgrade considerations
Consult your IBM representative for current planning information regarding
upgrades to the TS7650G or TS7650 Appliance.
Accommodating cables
This section lists considerations when planning for cabling accommodations.
Review the following considerations when planning for cabling accommodations:
Electrical power cabling
Plan in advance of delivery for the TS7650G or TS7650 Appliance. This
planning includes cabling for a second source if the dual power option has
been ordered and if independent sources are intended to be used.
Fibre Channel cabling
Plan in advance for the TS7650 Appliance adapters to attach to your
servers or switch fabric. For the TS7650G, Fibre Channel cabling from the
TS7650G adapters to the attaching customer servers or customer switch
fabric should be included in the planning, as well as Fibre Channel cabling
to any attached physical disk storage. In addition, customers should plan
for the Fibre Channel cabling from the server frame to the disk storage
frame.
Cat-5e Ethernet cabling
Required for attaching the TS7650G or TS7650 Appliance to the TSSC,
operator console or consoles, and to the network for replication and for
call-home reporting. For OpenStorage, you also need Ethernet cables for
host connectivity.
Clustered configurations
Required for a network connection for the corresponding Ethernet ports on
the two TS7650G or TS7650 Appliance servers for mutual operational state
monitoring.
Analog phone line
Required for remote access to the TSSC for TS7650G or TS7650 Appliance
support (if not using Internet Call Home and support).
Calculating space requirements
This section contains information useful for calculating space requirements, such as
dimensions, clearances, and weights, for your data deduplication solution.
When you plan the installation location, first calculate the total amount of space
that is needed for the TS7650G or TS7650 Appliance units, including all service
clearances and weight distribution areas. See the following subsections:
v Dimensions and weights
v Operator and service clearances on page 47
v Height requirements on page 48
v Floor requirements on page 48
Dimensions and weights
When you are planning the floor and space requirements for your storage units,
consider the dimensions and weights of your configuration components.
44 IBM System Storage TS7650 and TS7650G ProtecTIER Deduplication Solutions: Introduction and Planning Guide
For the TS7650G, see TS7650G dimensions and weights.
For the TS7650 Appliance, see TS7650 Appliance dimensions and weights.
TS7650G dimensions and weights
For the TS7650 Appliance, see TS7650 Appliance dimensions and weights.
Table 21 lists the TS7650G component dimensions.
Table 21. TS7650G component dimensions
Component Height Width Depth
3958 DD5 178.0 mm (7.0 in) 483.0 mm (19.0 in) 711.0 mm (28.0 in)
The total weight of the TS7650G depends on the number of components installed.
Table 22 displays the weight of the gateway server.
Table 22. TS7650G gateway server weight
Unit Weight
TS7650G 3958 DD5 43.2 kg (95.25 lb)
TS7650 Appliance dimensions and weights
This section describes the TS7650 Appliance dimensions and weights.
For the TS7650G, see TS7650G dimensions and weights.
Table 23. Dimensions of the TS7650 Appliance frame
Component Height Width Depth
3958 AP1 frame 1804 mm (71.0 in.) 649.0 mm (25.6 in) 1098 mm (43.2 in.)
Table 24. Maximum weight of TS7650 Appliance (cluster with 36 TB of storage)
Unit Weight
Maximum weight of the TS7650 Appliance 3958 AP1 728.0 kg (1,605 lb)
Table 25. Dimensions of the TS7650 Appliance server
Component Height Width Depth
3958 AP1 Server 178.0 mm (7.0 in) 483.0 mm (19.0 in) 711.0 mm (28.0 in)
Chapter 2. Physical planning specifications 45
Layout specifications:
Leveling pad
Caster
Power cord exit
Cable exit area
a
8
3
0
0
0
8
4
Figure 25. TS7650 Appliance frame plan view
46 IBM System Storage TS7650 and TS7650G ProtecTIER Deduplication Solutions: Introduction and Planning Guide
Operator and service clearances
Clearances are required around system components for the operator and the
service representative to perform certain tasks. The service clearance is the area
required to open the service covers and to pull out components for servicing. The
weight distribution area is the area required to distribute the weight of the storage
unit.
Notes:
v Size is defined by the depth from the outside of the frame and either the width
of a stand-alone frame or the length along any frames installed side-by-side. The
width is on a frame-to-frame basis; space required in front or behind each frame
is additive. The access space for individual frames overlaps.
v Required clearance around the frame is listed below:
Front: 690 mm (27.2 in.)
Back: 660 mm (26.0 in.)
Side: 0 mm (0 in.)
v Unlike weight distribution areas that are required to handle floor loading, keep
in mind that service clearances of adjacent unrelated storage units can overlap.
Figure 26. TS7650 Appliance frame isometric view
Chapter 2. Physical planning specifications 47
Note: The terms service clearance and weight distribution area are often confused
with each other. The service clearance is the area required to open the service
covers and to pull out components for servicing. The weight distribution area is the
area required to distribute the weight of the storage unit.
Aisle and door clearances
Two persons should be available to move system components between locations.
The following are the minimum aisle and door dimensions for moving components
from one location to another:
Roof Height
1830 mm (72 in.)
Aisle and Door Width
736 mm (29 in.)
Corner Radius
2237 mm (88 in.)
Ramp Inclination
15
Height requirements
The minimum floor-to-ceiling clearance required for installation as well as the
required operating and service clearances are determined by the dimensions of the
frames. For the TS7650G, IBM recommends that server components be installed in
a separate frame from disk storage components.
For more information, refer to TS7650G hardware components on page 3 or
TS7650 Appliance hardware components on page 13.
Floor requirements
A frame can be installed on a raised or solid floor meeting the minimum leveling
and floor-loading capacity requirements.
Floor level requirements
This section describes floor level requirements.
The maximum out-of-level condition is 25.4 mm (1 in.) over the frame's length and
width.
For the TS7650G, the customer-supplied frame should provide leveling pads that
can be adjusted to compensate for an uneven floor where the frame is to be
installed.
For the TS7650 Appliance, the frame supplies leveling pads that can be adjusted to
compensate for an uneven floor where the frame is to be installed.
Weight distribution and floor loading
The floor loading (FL) for your TS7650G or TS7650 Appliance must not exceed the
floor load rating (FLR) of the location where it will be installed.
As an example: the heaviest possible frame configuration is that of a clustered
TS7650 Appliance with 36 TB of storage, for a total weight of 728 kg (1605 lb.).
Using the guidance given in IBM Corporate Standard: Machine Mobility, Stability, Size
and Mass: Design Requirements, C-S 1-3705, the FL for this configuration calculates
48 IBM System Storage TS7650 and TS7650G ProtecTIER Deduplication Solutions: Introduction and Planning Guide
to 249 kg/m
2
(49.3 lb./ft
2
). Therefore, the FLR at the location where this
configuration would be installed must equal or exceed 249 kg/m
2
(49.3 lb./ft
2
).
This does not include additional transient loading by personnel or equipment
traffic.
If the frame is installed on a raised floor, the raised floor should be stabilized to
prevent a horizontal shift of the raised floor structure.
Security considerations
This section describes the security measures that need to be taken with the
TS7650G and the TS7650 Appliance.
Controlling access to the TS7650G or TS7650 Appliance is the customer's
responsibility. The system should be installed in a controlled-access area to prevent
unauthorized access to the system's internal components, the TSSC, and
ProtecTIER Manager console.
For troubleshooting purposes, an IBM service representative may need to use the
TSSC to open an SSH session on the appliance server. To do so, the IBM service
representative will need the ptadmin account password. If the customer has
changed the default password, the customer must make the new password
available to the IBM service representative upon request.
Operating environment requirements
You must meet specific operating environment requirements at all the air intake
locations of your models.
The operating points vary depending on the state of the model. The models can be
in the Operating, Non-operating, Storage, or Transit states.
Temperature and humidity
Table 26 lists the acceptable temperature and humidity ranges in which the
TS7650G and the TS7650 Appliance are designed to operate.
Table 26. Temperature and humidity requirements
Condition Parameter Requirement
Temperature
1
Operating range [Altitude: 0 to 914
meters (0 to 3,000 feet)]
10.0 - 35.0 C (50 - 95 F)
Operating range [Altitude: 900 to
2133 meters (3,000 to 7,000 feet)]
10.0 - 32.0 C (50 - 90 F)
Note: Above 900 m, decrease
maximum operating temperature
by 1 C.
Recommended operating range 20.0 - 25.0 C (50 - 87.2 F)
Non-operating range 10 - 43 C (50 - 95 F)
Storage range 0 - 60 C (32 - 140 F)
Transit range -40 C to 60 C (-40 F to 140 F)
Chapter 2. Physical planning specifications 49
Table 26. Temperature and humidity requirements (continued)
Condition Parameter Requirement
Relative humidity
(no condensation)
Operating range 8% to 80%
Recommended operating range 40% to 55%
Non-operating range 8% to 80%
Storage range 5% to 80%
Transit range 5% to 100%
Wet bulb
temperature
(maximum)
Operating range 23 C (73 F)
Non-operating range 27 C (80 F)
Storage range 29 C (84 F)
Transit range 29 C (84 F)
1
The non-operating environment must not exceed the operating environment
limits for longer than 60 days.
2
The storage environment must not exceed the operating environment limits
for longer than one year.
3
Substantial deviations from the suggested operating range, in either direction,
if sustained for extended periods of time, exposes the unit to greater risk of
failure from external causes.
Particulates and reactive gases
Attention: Airborne particulates (including metal flakes or particles) and reactive
gases acting alone or in combination with other environmental factors such as
humidity or temperature might pose a risk to the server in the TS7650G or the
TS7650 Appliance. Risks that pare posed by the presence of excessive particulate
levels or concentrations of harmful gases include damage that might cause the
server to malfunction or cease functioning altogether. This specification sets forth
limits for particulates and gases that are intended to avoid such damage. The
limits must not be viewed or used as definitive limits, because numerous other
factors, such as temperature or moisture content of the air, can influence the impact
of particulates or environmental corrosives and gaseous contaminant transfer. In
the absence of specific limits that are set forth in this document, you must
implement practices that maintain particulate and gas levels that are consistent
with the protection of human health and safety. If IBM determines that the levels
of particulates or gases in your environment have caused damage to the server,
IBM might condition provision of repair or replacement of servers or parts on
implementation of appropriate remedial measures to mitigate such environmental
contamination. Implementation of such remedial measures is a customer
responsibility.
50 IBM System Storage TS7650 and TS7650G ProtecTIER Deduplication Solutions: Introduction and Planning Guide
Table 27. Limits for particulates and gases
Contaminant Limits
Particulate
v The room air must be continuously filtered with 40% atmospheric
dust spot efficiency (MERV 9) according to ASHRAE Standard
52.2
a
.
v Air that enters a data center must be filtered to 99.97% efficiency
or greater, using high-efficiency particulate air (HEPA) filters that
meet MIL-STD-282.
v The deliquescent relative humidity of the particulate
contamination must be greater than 60%
b
.
v The room must be free of conductive contamination such as zinc
whiskers.
Gaseous
v Copper: Class G1 as per ANSI/ISA 71.04-1985
c
v Silver: Corrosion rate of less than 300 in 30 days
a
ASHRAE 52.2-2008: Method of Testing General Ventilation Air-Cleaning Devices for
Removal Efficiency by Particulate Size. Atlanta: American Society of Heating,
Refrigerating and Air-Conditioning Engineers, Inc.
b
The deliquescent relative humidity of particulate contamination is the relative
humidity at which the dust absorbs enough water to become wet and promote
ionic conduction.
c
ANSI/ISA-71.04-1985. Environmental conditions for process measurement and
control systems: Airborne contaminants. Instrument Society of America, Research
Triangle Park, North Carolina, U.S.A.
Electrical power ratings
This section describes the electrical power requirements for the deduplication
solutions.
For the TS7650G, see Electrical power ratings for the TS7650G. For the TS7650
Appliance, see Electrical power ratings for the TS7650 Appliance on page 52.
Electrical power ratings for the TS7650G
The customer must supply two 220V power distribution units in the
customer-supplied frame.
Table 28. Recommended power ratings for stand-alone TS7650G 3958 per line cord
Product Input
voltage
Input
frequency
Current Inrush
current
Power Apparent
power
KBtu/hr
3958 DD5 200 - 240V ac 50 - 60 Hz 7 A 250 A 1400 W 1.4 kVA 4.8
Table 29. Recommended power ratings for clustered TS7650G 3958 per line cord
Product Input
voltage
Input
frequency
Current Inrush
current
Power Apparent
power
KBtu/hr
3958 DD5 200 - 240V ac 50 - 60 Hz 14 A 250 A 2800 W 2.8 kVA 9.6
Note: The clustered TS7650G is connected through an included remote network
power switch. These quantities refer to the requirements for that configuration.
Chapter 2. Physical planning specifications 51
Table 30. FC 3437 Cluster Connection Kit power requirements
Unit Input voltage
Input
frequency
Maximum
load per outlet
Maximum
load per bus
Maximum
load per unit Power
WTI Network
Power Switch,
Model
VMR-8HD20-2
100 - 240 V ac 50 - 60 Hz 10 A 16 A 32 A
SMC Networks
Ethernet
switch, Model
8126L2
100 - 240 V ac 50 - 60 Hz 38 W
Electrical power ratings for the TS7650 Appliance
Table 31. TS7650 Appliance electrical power ratings per line cord for a maximum configuration
Unit
Input
voltage
Input
frequency Current
Inrush
current Power
Apparent
power KBtu/hr
3958 AP1 200 - 240 V
ac
50 - 60 Hz 24 A 250 A 4800 W 4.8 kVA 16.4
Table 32. FC 3437 Cluster Connection Kit power requirements
Unit Input voltage
Input
frequency
Maximum
load per outlet
Maximum
load per bus
Maximum
load per unit Power
WTI Network
Power Switch,
Model
VMR-8HD20-2
100 - 240 V ac 50 - 60 Hz 10 A 16 A 32 A
SMC Networks
Ethernet
switch, Model
8126L2
100 - 240 V ac 50 - 60 Hz 38 W
Acoustic declaration
Table 33 describes the acoustical noise emissions for the 3958 DD5 gateway server
(for the TS7650G) and the 3958 AP1 appliance server (for the TS7650 Appliance).
Table 33. Acoustic declaration for the gateway and appliance servers
Sound power
Operating Idling
6.3 bel declared 5.8 bel declared
Note: 10 dB (decibel) = 1 B (bel)
Safety issues
You must consider various safety issues when you plan your TS7650G or TS7650
Appliance location.
The following list identifies some of the safety issues you must consider:
v Fire suppression
52 IBM System Storage TS7650 and TS7650G ProtecTIER Deduplication Solutions: Introduction and Planning Guide
v Earthquake safety
Providing a fire-suppression system
You are responsible for providing a fire suppression system for your TS7650G or
TS7650 Appliance.
IBM designs and manufactures equipment to internal and external standards that
require certain environments for reliable operation. Because IBM does not test any
equipment for compatibility with fire-suppression systems, IBM does not make
compatibility claims of any kind. IBM does not provide recommendations on
fire-suppression systems.
Consult your insurance underwriter, local fire marshal, or local building inspector
about selecting a fire-suppression system that provides the proper level of coverage
and protection.
Earthquake effects
There is no guarantee against equipment damage as a result of an earthquake.
Many factors influence the stress imposed on system equipment, including:
v Intensity and duration of the earthquake
v Equipment structural strength and durability
v Equipment location within a structure
v Equipment installation method
v Building type
v Soil conditions
Guarantees of equipment reliability cannot be made for all earthquakes and
conditions. The damaging effects of an earthquake are minimized by appropriate
installation and planning techniques. Significant sliding and rocking of equipment
during an earthquake might directly or indirectly result in damage. The following
steps can help minimize damage:
v Position equipment far enough from walls to prevent or minimize collision.
v Ensure that power and accessory cables are long enough to accommodate sliding
and flexing during an earthquake.
v Ensure that cable clamps or other strain reliefs are secured properly to
equipment.
v Secure several tall units together to form a more stable structure.
v Use a flexible restraint that allows a limited amount of movement,
approximately 75 mm to 150 mm (3 in. to 6 in.), to dissipate energy imparted by
the earthquake.
Chapter 2. Physical planning specifications 53
54 IBM System Storage TS7650 and TS7650G ProtecTIER Deduplication Solutions: Introduction and Planning Guide
Chapter 3. Components and feature codes
This chapter describes the components in the TS7650G and the TS7650 Appliance
and lists the required and optional feature codes for each component.
Red Hat Linux version 5.6 is shipped on a recovery disk which can be used to
restore the operating system on the appliance server in the event of a hardware
failure.
For TS7650G components and feature codes, see TS7650G feature codes.
For TS7650 Appliance components and feature codes, see TS7650 Appliance
feature codes on page 65.
TS7650G feature codes
This section discusses in detail the required and optional features for the TS7650G.
This section discusses in detail the required and optional features for the TS7650G.
For TS7650 Appliance components and feature codes, see TS7650 Appliance
feature codes on page 65.
Feature codes are provided for the following components:
v 3958 DD5 gateway server feature codes
v 5639-PTA ProtecTIER Enterprise Edition V3.2 Base Software on page 64
Attention: The license keys required for TS7650G feature enablement require that
the TS7650G console software be installed and functional before any IBM System
Storage TS7650G ProtecTIER Deduplication Gateway features can be enabled.
3958 DD5 gateway server feature codes
This section lists the feature codes to use when you order the required and
optional features for the gateway server.
The TS3000 System Console is required for servicing the TS7650G Gateway. FC
2715 provides connectivity to an existing TS3000 System Console. FC 2724 provides
the first TS3000 System Console.
The connection to a working TSSC is required for the 3958 DD5 server. The TSSC
is the service console and supports remote access and Call Home functions.
The 3958 DD5 server gathers logs and sends them to the TSSC as part of a Call
Home packet sent to RETAIN
Runtime Environment (JRE) first, and then install the Java Access
Bridge (JAB). Both of these tools must be installed before you install the
ProtecTIER Manager software.
i
For simplicity, download the Java-based tools by using the ProtecTIER
Manager workstation on which you are installing the JRE and JAB. If this is not
possible, try to use another computer that is running Windows.
Installing the Java Runtime Environment
About this task
The JRE includes the Java Virtual Machine (JVM). These tools are necessary for
your computer to run Java-based applications.
Procedure
1. Go to http://www.java.com. The Java website opens.
The java.com website auto-detects the operating system and Internet browser of
the computer you use when you access the site.
2. Click Free Java Download, and proceed as appropriate:
v If the Download Java for Windows page opens, go on to step 3
v If the Download Java for... page title contains the name of an operating
system other than Windows, do the following:
a. Click the See all downloads here link.
The list of available downloads, categorized by operating system,
displays.
b. In the Windows section, click Windows 7/XP/Vista/2000/2003/2008
Online.
3. Review the information provided, and then click Agree and Start Free
Download.
The download dialog box opens.
4. Follow the on-screen instructions to save the executable (.exe) installer file to
the hard disk drive.
5. After the download is complete, find the installer file on the hard disk drive
and write down the full path to the location of the file. For example:
C:\Program Files\Java\jre6\bin\java.exe. This path is needed during ProtecTIER
Manager installation.
6. Proceed as appropriate:
118 IBM System Storage TS7650 and TS7650G ProtecTIER Deduplication Solutions: Introduction and Planning Guide
v If you downloaded the installer on the ProtecTIER Manager workstation on
which you are installing the JRE, go on to step 7.
v If you downloaded the installer on a PC other than the applicable
ProtecTIER Manager workstation, do the following:
a. Copy the installer file onto a CD, flash memory drive, or other form of
removable media.
b. Copy the installer file from the removable media to the hard disk drive of
the ProtecTIER Manager workstation.
c. Go on to step 7.
7. Double-click the installer file to start the Java installation wizard.
The Java Setup Welcome window opens.
8. Click Install and follow the on-screen instructions to complete the installation
process.
9. When you have successfully installed the JRE, go on to Installing the Java
Access Bridge.
Installing the Java Access Bridge
About this task
The Java Access Bridge (JAB) makes it possible for you to use Java-based screen
readers with the ProtecTIER Manager installation wizard and software.
Procedure
1. Go to: http://java.sun.com/products/jfc/accessibility.html.
The Java SE Desktop Accessibility page of the Oracle website opens.
2. Read the information provided, then click Access Bridge.
3. Scroll down to the Java Access Bridge for Microsoft Windows Operating
System x.x.x (where x.x.x is the most recent version listed) section. Click the
Download Java Access Bridge x.x.x link.
The Software License Agreement page opens.
4. Read the license agreement, and then select the I agree to the Software
License Agreement check box.
The Download Java Access Bridge for Windows Operating System x.x.x
page opens.
5. In the Required Files list, click the link to download the Access Bridge x.x.x,
accessbridge-x.x.x.exe file.
The download dialog box opens.
6. Follow the on-screen instructions to save the executable (.exe) installer file to
the hard disk drive.
7. When the download is complete, locate the installer file on the hard disk drive
and proceed as appropriate:
v If you downloaded the installer by using the ProtecTIER Manager
workstation on which you are installing the JAB, go on to step 8 on page
120.
v If you downloaded the installer by using a PC other than the applicable
ProtecTIER Manager workstation, do the following:
a. Copy the installer file onto a CD, flash memory drive, or other
removable media device.
b. Copy the installer file from the removable media device to the hard disk
drive of the ProtecTIER Manager workstation.
Accessibility for publications and ProtecTIER Manager 119
c. Go on to step 8.
8. On the ProtecTIER Manager workstation, double-click the
accessbridge-x.x.x.exe installer file.
A security warning dialog box displays.
9. Click Run.
The Java Access Bridge InstallShield Wizard opens.
10. Read the welcome information, then click Next and follow the on-screen
instructions to complete the installation.
11. When the installation is complete, restart the workstation as directed.
You now have the necessary Java tools for compatibility between the
ProtecTIER Manager installation wizard and screen reader software.
12. Follow the instructions in Using a screen reader to install ProtecTIER
Manager to start the ProtecTIER Manager installation wizard by using a
screen reader.
Using a screen reader to install ProtecTIER Manager
About this task
Install ProtecTIER Manager according to the following command line-based
instructions.
i
When entering the commands, type them exactly as shown, including any
spaces or quotation marks. Any deviation in the procedure can cause the
installation to start in the non-accessible mode, or fail completely.
Procedure
1. If your workstation is configured to automatically open DVDs, temporarily
disable the Windows AutoPlay feature for the CD/DVD device. Use the
Windows Help or other Windows documentation for instructions, and then go
on to step 2.
2. Insert the IBM System Storage ProtecTIER Manager V3.2 DVD into the CD/DVD
drive of the ProtecTIER Manager workstation.
3. Access the command prompt on the ProtecTIER Manager workstation:
a. Click Start > Run....
The Run dialog box opens.
4. In the Open field, type: cmd and click Ok.
The command window opens.
5. Browse to the ProtecTIER Manager installation directory on the DVD. To do so:
a. At the command prompt, type: D: (where D: is the letter assigned to the
CD/DVD drive of the workstation) and press <enter>.
b. At the command prompt, list the contents of the DVD. Type: dir and press
<enter>.
c. Locate the name of the ProtecTIER Manager directory on the DVD. For
example: PT_Manager_V3.2.
d. At the command prompt, change to the ProtecTIER Manager directory.
Type: cd <directory name> and press <enter>. For example:
cd PT_Manager_V3.2 <enter>.
e. At the command prompt, change to the Windows directory. Type:
cd windows and press <enter>.
120 IBM System Storage TS7650 and TS7650G ProtecTIER Deduplication Solutions: Introduction and Planning Guide
f. At the command prompt, type: Install.exe LAX_VM "C:\Program Files\
Java60\jre\bin\java.exe" and press <enter>, where the path contained
within the quotation marks is the same as the path that you noted in step 5
on page 118.
The screen-reader-enabled ProtecTIER Manager installation wizard starts.
g. Follow the spoken prompts to compete the installation.
6. When the installation completes, proceed as appropriate:
v If you do not want to enable the Windows High Contrast option or
customize the color palette, resume your regular use of ProtecTIER Manager.
v To change the contrast mode for ProtecTIER Manager, go to Enabling the
Windows High Contrast option. To customize the color palette, go to
Customizing the color palette on page 126.
Enabling the Windows High Contrast option
About this task
To make it possible for ProtecTIER Manager display in high contrast, you must
first enable the Use High Contrast option in Windows.
Procedure
1. On the ProtecTIER Manager workstation, go to Windows > Control Panel >
Accessibility Options.
The Accessibility Options dialog box opens.
2. Select the Display tab.
3. In the High Contrast area of the Display tab, select the Use High Contrast
check box, as shown in Figure 28 on page 122:
Accessibility for publications and ProtecTIER Manager 121
4. Click Settings.
The Settings for High Contrast dialog box displays, as shown in Figure 29 on
page 123:
t
s
7
6
0
8
9
8
Figure 28. Display tab
122 IBM System Storage TS7650 and TS7650G ProtecTIER Deduplication Solutions: Introduction and Planning Guide
By default, the High Contrast Black (large) scheme is selected.
5. Do one of the following:
v To use the default, High Contrast Black (large), scheme:
a. Click Ok to close the Settings for High Contrast dialog box.
b. Click Ok to close the Accessibility Options dialog box.
After a few moments, the display changes to the new color scheme.
c. Go on to Using the Windows high contrast scheme with ProtecTIER
Manager.
v To use a different high contrast scheme:
a. Click the arrow to show the list of available color schemes.
b. Select the high contrast scheme that you want to use.
c. Click Ok to close the Settings for High Contrast dialog box.
d. Click Ok to close the Accessibility Options dialog box.
After a few moments, the display changes to the new color scheme.
e. Go on to Using the Windows high contrast scheme with ProtecTIER
Manager.
Using the Windows high contrast scheme with ProtecTIER Manager
About this task
Now that you have changed the contrast scheme in Windows, you must enable the
Support system settings option in ProtecTIER Manager.
Procedure
1. Launch ProtecTIER Manager:
t
s
7
6
0
8
9
7
Figure 29. Settings for High Contrast
Accessibility for publications and ProtecTIER Manager 123
a. Click: Start > All Programs > IBM > ProtecTIER Manager > IBM
ProtecTIER Manager.
The ProtecTIER Manager window opens, as shown in: Figure 30.
2. On the toolbar, click: Tools > Preferences.
The Preferences dialog box opens with the Appearance tab selected, as shown
in Figure 31 on page 125:
t
s
7
6
0
8
9
9
Figure 30. ProtecTIER Manager window
124 IBM System Storage TS7650 and TS7650G ProtecTIER Deduplication Solutions: Introduction and Planning Guide
3. On the Appearance tab, select the Support system settings check box.
You are returned to the ProtecTIER Manager window.
4. Exit and restart ProtecTIER Manager so the contrast settings take effect:
a. On the ProtecTIER Manager toolbar, click: File > Exit.
The ProtecTIER Manager window closes.
b. Click: Start > All Programs > IBM > ProtecTIER Manager > IBM
ProtecTIER Manager.
When the ProtecTIER Manager window opens, the display reflects the
contrast change, as shown in: Figure 32.
5. Proceed as appropriate:
v If you want to change one or more of the colors used in the ProtecTIER
Manager display, continue to Customizing the color palette on page 126.
v If you do not want to customize the color palette, resume your regular use of
ProtecTIER Manager.
t
s
7
6
0
8
7
9
Figure 31. Preferences dialog box
t
s
7
6
0
8
8
3
Figure 32. Normal contrast versus high contrast
Accessibility for publications and ProtecTIER Manager 125
Customizing the color palette
About this task
Use this procedure to customize the color palette for ProtecTIER Manager to
improve visibility in the display, or to suit your personal preferences.
Procedure
1. If necessary, start ProtecTIER Manager as described in step 1 on page 123.
2. Open the Preferences dialog box, as described in 2 on page 124.
3. Scroll down (if necessary) to see the entire Color selection list, and then select
the color you want to change.
The Color selection dialog box opens, with the Swatches tab selected, as
shown in Figure 33:
The color that is currently defined for your selection is shown in the Preview
pane.
4. Select a new color from the color palette.
i
You can also specify a new color by using the Hue/Saturation/Brightness
(HSB) or Red/Green/Blue (RGB) color models. To do so, click the tab for the
model you want to use and enter the required values.
5. When you have finished selecting or specifying the new color, click Ok.
You are returned to the Appearance tab.
6. To change another color, repeat steps 3 through 5.
t
s
7
6
0
8
8
1
Figure 33. Color selection, Swatches tab
126 IBM System Storage TS7650 and TS7650G ProtecTIER Deduplication Solutions: Introduction and Planning Guide
7. When you are finished making changes in the Appearance tab, click Ok.
You are returned to the ProtecTIER Manager window.
8. Exit and restart ProtecTIER Manager (as described in step 4 on page 125) so the
color palette changes take effect.
After you log in to ProtecTIER Manager and add a node, the display reflects
your custom color selections.
An example of the default color versus a custom color for Allocable resources,
is shown in: Figure 34
9. Proceed as appropriate. Return to the task from which you were sent to these
instructions or resume your regular use of ProtecTIER Manager.
t
s
7
6
0
8
8
2
Figure 34. Default color versus custom color
Accessibility for publications and ProtecTIER Manager 127
128 IBM System Storage TS7650 and TS7650G ProtecTIER Deduplication Solutions: Introduction and Planning Guide
Notices
This information was developed for products and services offered in the U.S.A.
IBM may not offer the products, services, or features discussed in this document in
other countries. Consult your local IBM representative for information on the
products and services currently available in your area. Any reference to an IBM
product, program, or service is not intended to state or imply that only that IBM
product, program, or service may be used. Any functionally equivalent product,
program, or service that does not infringe any IBM intellectual property right may
be used instead. However, it is the user's responsibility to evaluate and verify the
operation of any non-IBM product, program, or service.
IBM may have patents or pending patent applications covering subject matter
described in this document. The furnishing of this document does not give you
any license to these patents. You can send license inquiries, in writing, to:
IBM Director of Licensing
IBM Corporation
North Castle Drive
Armonk, NY 10504-1785
U.S.A.
The following paragraph does not apply to the United Kingdom or any other
country where such provisions are inconsistent with local law:
INTERNATIONAL BUSINESS MACHINES CORPORATION PROVIDES THIS
PUBLICATIONS "AS IS" WITHOUT WARRANTY OF ANY KIND, EITHER
EXPRESS OR IMPLIED, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED
WARRANTIES OF NON-INFRINGEMENT, MERCHANTABILITY OR FITNESS
FOR A PARTICULAR PURPOSE. Some states do not allow disclaimer of express or
implied warranties in certain transactions, therefore, this statement may not apply
to you.
This information could include technical inaccuracies or typographical errors.
Changes are periodically made to the information herein; these changes will be
incorporated in new editions of the publication. IBM may make improvements
and/or changes in the product(s) and/or the program(s) described in this
publication at any time without notice.
Any references in this information to non-IBM Web sites are provided for
convenience only and do not in any manner serve as an endorsement of those Web
sites. The materials at those Web sites are not part of the materials for this IBM
product and use of those Web sites is at your own risk.
IBM may use or distribute any of the information you supply in any way it
believes appropriate without incurring any obligation to you.
Any performance data contained herein was determined in a controlled
environment. Therefore, the results obtained in other operating environments may
vary significantly. Some measurements may have been made on development-level
systems and there is no guarantee that these measurements will be the same on
generally available systems. Furthermore, some measurement may have been
Copyright IBM Corp. 2011, 2012 129
estimated through extrapolation. Actual results may vary. Users of this document
should verify the applicable data for their specific environment.
Information concerning non-IBM products was obtained from the suppliers of
those products, their published announcements or other publicly available sources.
IBM has not tested those products and cannot confirm the accuracy of
performance, compatibility or any other claims related to non-IBM products.
Questions on the capabilities of non-IBM products should be addressed to the
suppliers of those products.
All statements regarding IBM's future direction or intent are subject to change or
withdrawal without notice, and represent goals and objectives only.
This information is for planning purposes only. The information herein is subject to
change before the products described become available.
This information contains examples of data and reports used in daily business
operations. To illustrate them as completely as possible, the examples include the
names of individuals, companies, brands, and products. All of these names are
fictitious and any similarity to the names and addresses used by an actual business
enterprise is entirely coincidental.
Trademarks
The following terms are trademarks of the International Business Machines
Corporation in the United States, other countries, or both:
v AIX
v DS4000
v Enterprise Storage Server
v ESCON
v FICON
v i5/OS
v iSeries
v IBM
v ProtecTIER
v pSeries
v S/390
v ServeRAID
v System x
v System Storage
v TotalStorage
v Wake on LAN
v z/OS
v zSeries
Cut or Fold
Along Line
Cut or Fold
Along Line
Fold and Tape Please do not staple Fold and Tape
Fold and Tape Please do not staple Fold and Tape
NO POSTAGE
NECESSARY
IF MAILED IN THE
UNITED STATES
BUSINESS REPLY MAIL
FIRST-CLASS MAIL PERMIT NO. 40 ARMONK, NEW YORK
POSTAGE WILL BE PAID BY ADDRESSEE
IBM
Corporation
Information Development, Dept. GZWA
9000 S Rita Road
Tucson, AZ
USA 85744-0001
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
_
_
_
_
_
_
_
_
_
_
_
_
_
_
_
_
_
_
_
_
_
_
_
_
_
_
_
_
_
_
_
_
_
_
_
_
_
_
_
_
_
_
_
_
_
_
_
_
_
_
_
_
_
_
_
_
_
_
_
_
_
_
_
_
_
_
_
_
_
_
_
_
_
_
_
_
_
_
_
_
_
_
_
_
_
_
_
_
_
_
_
_
_
_
_
_
_
_
_
Printed in USA
GA32-0918-05