Toaz.info Data Center Design and the Ansi Tia 942 Standard Pdfdrive Pr 8c6d8787d8df07579ac8f5b74266322b

Fiber Connect, Inc.
Fiber Optic Overview & Training
Data Center Design

and the
ANSI/TIA-942 Standard
BICSI Regional Meeting – Charleston, WV

April 20, 2006
Rick Foster RCDD,TLT
Communications Infrastructure Group
Maurice Zetena
Fiber Connect
Fiber Connect ©2003

Fiber Connect, Inc.
Data Center Design and the

Standards
– TIA-942
– NFPA-70 Article 645
– NFPA-75
– NFPA-76
– International Standards & BICSI
Practical Applications of ANSI/TIA-942

– “Any to All” = Structure
– Trunk Cabling Copper & Fiber

Fiber Connect, Inc.

THE TECHNOLOGY GAP

PERFORMANCE
Y GAP
O G
O L
H N
C
TE
CODES & STANDARDS

EVOLUTION
TIME
Fiber Connect, Inc.

CODES vs STANDARDS
• CODE: A regulation that is enforceable.
It is the Law !
• STANDARD: A recommend practice and

performance requirements.
It is our Profession !
Fiber Connect, Inc.

Business Risk
Proper Design = Redundancy = Continuity
• Room Layout
• Equipment Types
• Environmental - HVAC & Power
• Change Control
• Fire & Safety
• Security Issues
• IT Infrastructure – Physical Layer
Structured Design approach
Fiber Connect, Inc.

TR’s CP Backbone
WAO EF’s Admin
Horizontal
Enterprise Cabling
Are they really any different?

Data Center Cabling
EDA ZDA Backbone
MDA DATA CENTER CR
HDA Horizontal

Fiber Connect, Inc.

Why another standard?

“Thepurpose of this standard is to provide
requirements and guidelines for the design
and installation of a data center or computer
room. It is intended for use by designers who
need a comprehensive understanding of the
data center design including the facility
planning, the cabling system and the
network design.”
Source: ANSI/TIA-942 2005

Fiber Connect, Inc.

Data Center Design ANSI/TIA-942

Design Process = Critical Coordination
– Telecommunications cabling system

– Equipment floor plan
– Electrical plans
– Architectural plan
– HVAC
– Security
– Lighting systems
Fiber Connect, Inc.

TIA 942 Design Considerations

Fiber Connect, Inc.

– Defines new terms
– Recommends media
selections
Correlation to existing
ANSI/TIA/EIA 568 & 569
– Defines the physical

environment

Fiber Connect, Inc.

Spaces
– Computer Room
– Telecommunications Room Source: ANSI/TIA-942 2005
– Entrance Room
– Main Distribution Area (MDA)
– Horizontal Distribution Area (HDA)
– Equipment Distribution Area (EDA)
– Zone Distribution Area (ZDA)
Fiber Connect, Inc.

Cabling & Topology
– Backbone
– Horizontal
– Main cross-connect Source: ANSI/TIA-942 2005
– Horizontal cross-connect
– Cross-connect in the entrance room or MDA
– Zone outlet
– EDA outlet

Fiber Connect, Inc.

Spaces
Data Center
Computer Room
MDA EDA
HAD ZDA

Fiber Connect, Inc.

Data Center Telecommunications Spaces

Main Distribution Area (MDA)
-It’s the central space where the point of

distribution for the structured cabling system in
the data center is located
- The data center shall have at least one MDA
- The core routers and core switches for the

data center are often located in or near the
MDA
Could be a Equipment Room
Fiber Connect, Inc.


Horizontal Distribution Area (HDA)
-It’s the space that supports cabling to the
equipment distribution areas
- LAN, SAN and KVM switches that support the

end equipment are also typically located in the
HDA
- There should be a minimum of one horizontal

distribution area per floor
Could be a Telecom Room
Fiber Connect, Inc.


Equipment Distribution Areas (EDA)
- Are spaces allocated for the end equipment, including computer

systems and communications equipment
-End equipment is usually standing equipment or equipment

mounted in cabinets or racks
- Horizontal cables are terminated in equipment distribution

areas or connecting hardware mounted in cabinets or racks
- Point-to-point cabling is permitted between equipment located

in the equipment distribution area. Cable should be greater than
15 m and should connect equipment in adjacent racks or
cabinets in the same row
Could be a Work Area
Fiber Connect, Inc.


Zone Distribution Area (ZDA)
- Should be limited to serving a maximum of 288 coaxial

or twisted pair connections
- Cross-connection shall not be used in the ZDA
- No more than one ZDA shall be used within the same

horizontal cable run
- There shall be no active equipment in the zone

distribution area, except DC powering equipment
Could be a Consolidation Point

Fiber Connect, Inc.

Recognized Media
100Ω ohm twisted-pair copper cable
• Cat-5e
• Cat-6 recommended
Multimode fiber optic cable

• 62.5/125 µm or 50/125 µm
• 50/125 µm 850 nm laser optimized MMF recommended
Single Mode Fiber Optic Cable
75 Ω ohm Coax Cable

Fiber Connect, Inc.

Data Center Redundancy

•Tiers - Annex G of ANSI/TIA-942
Tier 1 – Basic data center

Tier 2 – Redundant components
Tier 3 – Concurrently maintainable
Tier 4 – Fault tolerant
Corresponds to the tier ratings defined by the

Uptime Institute

Fiber Connect, Inc.

Data Center Tiers

Fiber Connect, Inc.

Data Center Tiers

Tier I Tier II Tier III Tier IV
Building Type Tenant Tenant Stand-alone Stand-alone
Staffing None 1 Shift 1 + Shifts "24 by
Forever"
Useable for Critical Load 100% N 100% N 90% N 90% N
Initial Gross Watts per Square Foot 20-30 40-50 40-60 50-80
(W/ft2) (typical)
Ultimate Gross W/ft2 (typical) 20-30 40-50 100-150 1,2,3 150+1,2
Uninterruptible Cooling None None Maybe Yes
Support Space to Raised-Floor Ratio 20% 30% 80-90%2 100+%
Raised-Floor Height (typical) 12" 18" 30-36"2 30-36"2
2
Floor Loading Lbs/ft (typical) 85 100 150 150
Utility Voltage (typical) 208, 480 208, 480 12 - 15 kV2 12 - 15 kV2
Single Points-of Failure Many + Many + Some + None +
human error human error human error human error
Annual Site-Caused IT Downtime 28.8 hours 22.0 hours 1.6 hours 0.4 hours
Source: Uptime Institute (actuals)
Site Availability 99.671% 99.749% 99.982% 99.995%
Months to Implement 3 3-6 15 - 20 15 - 20
Year First Deployed 1965 1970 1985 1995
Construction Cost (+-30%) 1,2,3
Raised Floor $220/ft2 $220/ft2 $220/ft2 $220/ft2
Useable UPS Output $10,000/kW $11,000/kW $20,000/kW $22,000/kW
Uptime Institute© 1100 W/ft2 maximum for air-cooling over large areas, water or alternate cooling methods greater than 100 W/ft2 (added cost excluded).
2Greater W/ft2 densities require greater support space (100% at 100 W/ft2 and up to 2 or more times at greater densities), higher raised floor, and, if
required over large areas, medium voltage service entrance.
3Excludes land; architectural, engineering, and commissioning fees; permits and other fees; interest; and abnormal civil cost. These can be several
million dollars. Assumes minimum of 15,000 ft2 of raised floor, architecturally plain, one-story building, with power backbone sized to achieve
ultimate capacity with installation of additional components or systems. Make adjustments for NYC, Chicago, and other high cost areas.

Fiber Connect, Inc.

Summary – ANSI/TIA- 942

1. Standard specifies data center planning and design
procedures. Structured approach.
2. Provides guidelines and recommendations for data centers

implementation, embraces much more than
telecommunications infrastructure (power, pathways, fire
protection, doors, walls treatment, and others)
3. Determines four tiers for data center redundancy
4. Considers ‘568-B, ‘569-B, ‘606-A and ‘607 for the cabling,

pathways, administration and earthing design, installations
and other procedures

Fiber Connect, Inc.

National Electric Code

• Protects people and property from hazards arising
from the use of electricity.
• It is not a “DESIGN SPECIFICATION” or training

manual for the untrained individuals .
645.1 Scope. This article covers equipment, power-supply
wiring, equipment interconnecting wiring, of
information technology equipment and systems,
including terminal units, in an information technology
equipment room.
FPN: For further information, see NFPA 75-2003, Standard

for the Protection of Electronic Computer/Data Processing
Source: NEC 2005 NFPA 70
Equipment.
Fiber Connect, Inc.



Fiber Connect, Inc.

National Electric Code
NFPA-70 Article - 645 Modifications to Chapter 3
645.2 Special Requirements for Information Technology
Equipment Room. This article shall
apply, provided 1. Conductor sizing – derated for some
all the following conditions are met: equipment
(1) Disconnecting means complying with 645.10 are provided.
(2) A separate heating/ventilating/air-conditioning (HVAC) 2. Connection methods – attachment

system is provided that is dedicated for information plugs - 4’ to 15’
technology equipment use and is separated from other
areas of occupancy. Any HVAC system that serves
other occupancies shall be permitted to also serve the
information technology equipment room if fire/smoke 3. Interconnecting cable types – non-
dampers are provided at the point of penetration of the
room boundary. Such dampers shall operate on activation
plenum rated and allows vendor
of smoke detectors and also by operation of the specific interconnecting cabling under
disconnecting means required by 645.10.
FPN: For further information, see NFPA 75-1999, Standard the raised floor – Check with the
for the Protection of Electronic Computer/Data Processing
Equipment, Chapter 8, 8-1, 8-1.1, 8-1.2, and 8-1.3. (AHJ)
(3) Listed information technology equipment is installed.
(4) The room is occupied only by those personnel needed 4. Wiring methods for HVAC – Require
for the maintenance and functional operation of the
installed information technology equipment. smoke detection and shutdown.
(5) The room is separated from other occupancies by fireresistant-
rated walls, floors, and ceilings with protected 5. Room construction defined
openings.
FPN: For further information on room construction requirements,
see NFPA 75-1999, Standard for the Protection
of Electronic Computer/Data Processing Equipment, Chapter 3.

Fiber Connect, Inc.

NFPA – 75
Standard for the Protection of Electronic Computer/Data
Processing Equipment.
NFPA-70 National Electric Code
645.1 Scope. This article covers equipment, power-supply wiring, equipment interconnecting wiring, of
information technology equipment and systems, including terminal units, in an information
technology equipment room.
FPN: For further information, see NFPA 75- 2003, Standard for the
Protection of Electronic Computer/Data Processing Equipment.
ANSI/TIA-942
Fiber Connect ©2003 Source: ANSI/TIA-942 2005

Fiber Connect, Inc.

NFPA Standard NFPA - 75

1.1 Scope. This standard covers the
requirements for the protection of
information technology equipment
and information technology
equipment areas.
1.2* Purpose. The purpose of this

standard is to set forth the minimum
requirements for the protection of
information technology equipment
and information technology
equipment areas from damage by
fire or its associated effects —
namely, smoke, corrosion, heat, and
Source: NFPA -75
water.
How to build it – A systems approach
Fiber Connect, Inc.

NFPA Standard NFPA - 75

Reduce Risk = Business Continuity
Chapter 4 Risk Considerations
4.1* Risk Factors. The following factors shall be considered

where determining the need for protecting the environment,
equipment, function, programming, records, and supplies:
(1) Life safety aspects of the function (e.g., process controls,

air traffic controls)
(2) Fire threat of the installation to occupants or exposed
property
(3) Economic loss from loss of function or loss of records
(4) Economic loss from value of equipment
4.2 Telecommunications Risks.

In assessing and evaluating the damage and interruption
potential of the loss of information technology equipment
room operations, attention shall be given to the impact of the
loss of data and communications lines. If these functions
are vital to the operation, rooms housing the services shall
be constructed in accordance with Chapter 5 and protected
Source: NFPA -75 in accordance with Chapter 8. These rooms shall be
secured, locked, and free of extraneous combustibles.
Fiber Connect, Inc.

Source: NFPA -75

Fiber Connect, Inc.

NFPA Standards NFPA - 76

1.1* Scope. This recommended practice provides
recommendations for fire protection of
telecommunications facilities where telephone,
data, cellular, internet, and video services are
rendered. Telecommunications facilities include
telecommunications equipment spaces, cable
entrance facilities, power areas and battery
spaces, main distribution frames, standby engine
areas, technical support areas, administrative
areas, and building services and support areas
within both large and small facilities. This
recommended practice includes fire protection of
telecommunications service, property protection,
and life safety for people in telecommunications
facilities. It provides for both performance-based
and prescriptive options.
Central Office Space
Source: NFPA -76

Fiber Connect, Inc.

NFPA Standards NFPA - 76

Reduce Risk = Business Continuity
4.2 Communications Risks. In assessing

and evaluating the damage and
interruption potential of the loss of
communication operations, attention
should be given to the impact of the loss
of data, voice, and video
communications links. The complexity
and scope of switching equipment
operations can make it necessary to
provide internal redundancy, alternative
routing, and in some cases dual access
terminal in order to prevent
communication outages.
Source: NFPA -76
Fiber Connect, Inc.

Practical Infrastructure Topologies
Structured Cabling System in the

Data Center - (TIA/EIA 942)
“Any to All” = Structure

Change equipment not infrastructure

Fiber Connect, Inc.

Don’t Let This Happen To You

No Clear Migration
Improper Bend Radius Path

Fiber Connect, Inc.

Proper Planning Makes The Difference

– Equipment Placement - Cabinet Layout
• Switch Location
• Server Cabinet
Patch Panel
• Use of Cable
Management Panels
• Use of Vertical
Cable Managers
Example of Poor Use of Rack Space, No Migration

Planning, & Poor Cable Management.

Fiber Connect, Inc.

“Any to All” = Structure”
HDA or EDA
Connectivity design will support MDA or HDA
multiple equipment and
applications.
Change out equipment not

infrastructure

Fiber Connect, Inc.

• Critical Design Factors

– Talk the same Language ie.
Strands vs. Channels
– Enclosure / Cabinets
– Connector types
– Define Polarity Method
– Cable Types
– Equipment & Migration Path
– Redundancy
– Environment

Fiber Connect, Inc.

“Structured Advantages ”
• Allows for faster “roll outs”
• Designed “Zones” with multiple connections

– as required by equipment design
• Reduce the number of cable pulls
• Managed cabling strategy – Trunk cables
• Adapt to frequently changing connection models or media

types

Fiber Connect, Inc.

Traditional Point to Point - Non Structured

– Jumper Cable /
Point to Point (Traditional)
• Difficult to administer
• Requires Under Floor
Access to Increase
Capacity
• Not Suitable for
Rapid Deployment
• Inconsistent Channel to
Channel Characteristics
• Difficult to Maintain
” Day 2” organization

Fiber Connect, Inc.

Fiber / Copper - Structured

Fiber Connect, Inc.

MDA / HDA - Structured –Fiber SAN

Fiber Connect, Inc.

Structured Approach
Design Strategy
Utilizing “Trunk Cabling”

Fiber Connect, Inc.

Trunk Cables
What are the Advantages?

What’s Available?
Plug & Play?

Fiber Connect, Inc.

Why use Trunk Cables?

– Media Choice: – Price:
• Fiber • Material Cost
• Copper • Labor Cost
• Less Scrap
– Performance:
• Quality Assurance – Installation:
• Application • Design
• Warranty • Future Growth
• Installer Skill Level
– Availability:
• Accessibility
• Schedule
• Install Time
• Logistics
• Environment

Fiber Connect, Inc.

Copper Trunk Cables

Fiber Connect, Inc.

MDA / HDA - Structured Non-MTP

Fiber Connect, Inc.

MDA / HDA - Structured MTP

Fiber Connect, Inc.

Fiber Trunk Cable Assemblies

– Cables can be
doubled ended or
single ended
– Factory Terminated
and Tested
– Connectors can be
different types
SC,LC,MTP, MU, other

Fiber Connect, Inc.

Plug & Play

Assemblies
• What Are They?
Factory terminated
modules that utilize
multifiber (MTP/MPO)
connector with breakout kit
to individual fiber
connectors for interconnect

Fiber Connect, Inc.

Plug & Play: Alternate Building Blocks
Is Plug & Play Limited to

Cassettes?
– MTP Brackets:
Reduce number of “Hops”.
Reduce System Loss.
Reduce System Cost.
Work above the Floor.

Fiber Connect, Inc.

Plug & Play: Alternate Building Blocks

MTP - “X” Harness Assemblies:
The Mix & Match Advantage
MTP - SC Duplex MTP - MT-RJ
MTP - LC Duplex
Fiber Connect, Inc.

Trunk Cabling Systems

Advantages
• Simplified Installation
• Reduce human errors *
• Less time in the floor
– less disruption and debris
• Factory terminated and pre-tested
– minimizes points of failure
• Uniform design and consistent documentation
scheme

Fiber Connect, Inc.

ADVANTAGES OF MTP TRUNK / HARNESS

SWITCH CABLING
Trunk and Harness Technology:
– Trunk / Harness Technology
• Simplifies administration
• Simplifies Visual
Identification
• Future Growth Is Built In
• Allows Pre-Cabling to
Cabinets for Rapid
Deployment (servers)
• Consistent Channel to Channel
Characteristics
Fiber Connect, Inc.

EXAMPLE OF MTP TRUNK / HARNESS SWITCH CABLING
Trunk / Harness Configuration
Proper Bend
Radius Adherence
Fan Intake
Remains Clear
Trunk Cable Feed

From Under floor

Fiber Connect, Inc.

Hot and Cold Aisles

Future Equipment Grow th Relocated Equipment
UPS PDU
UPS PDU
UPS PDU
UPS PDU
UPS PDU
COLD CORRIDORE
COLD CORRIDORE
COLD CORRIDORE
COLD CORRIDORE
COLD CORRIDORE
COLD CORRIDORE
HOT CORRIDORE
HOT CORRIDORE
HOT CORRIDORE
HOT CORRIDORE
HOT CORRIDORE
zzzzzzzzzzzzz
PDU UPS
PDU UPS
PDU UPS
PDU UPS
PDU UPS
PDU UPS
AC Package Unit AC Package Unit AC Package Unit
DB-A DB-B

Fiber Connect, Inc.

Hot and Cold Aisles

Fiber Connect, Inc.

Don’t Forget Cable Routing

– Cable Routing
• Defined Pathways
• Minimize “Zig Zag”
• Overhead Distribution
• Under floor Distribution
• Coordination with other room utilities

Fiber Connect, Inc.

Additional Standards
International
CENELEC EN 50173-5
“Information Technology –Generic Cabling
Systems – Part 5 Data Centers
CENELEC EN 50174-2
Annex on Data Center planning
ISO/IEC
Proposed “Generic Cabling or Data Centers”
Data Center sub-committee to standards group
Best Practices Document

Fiber Connect, Inc.

References
• American Society of Heating, Refrigerating and Air-Conditioning
Engineers (ASHRAE) - http://www.ashrae.org/
• ASHRAE Thermal Guidelines for Data Processing Environments
• Electronic Industries Association (EIA) – www.eia.org

• EIA-310-D Cabinets, Racks, Panels, and Associated Equipment
• National Fire Protection Association (NFPA) - http://www.nfpa.org

• NFPA 75 Standard for the Protection of Information Technology Equipment
• NFPA 70 National Electrical Code are and NFPA 101 Life Safety Code also
applicable

Fiber Connect, Inc.

References
• Telecommunications Industry Association (TIA) -
http://www.tiaonline.org/
TIA-942 (Proposed) Telecommunications Infrastructure Standard
for Data Centers
Other TIA cabling standards (568, 569, 606, 607, 758) are also
applicable.
• Telecordia Technologies - http://www.telcordia.com/

Telcordia GR-63-CORE (NEBS) Requirements: Physical
Protection A central office specification, but referenced by
TIA-942 for seismic specifications, vibration testing, floor loading
capacity measurement and test methods.

Fiber Connect, Inc.

Data Center User Groups

and
Information Exchanges
• 7x24 Exchange - http://www.7x24exchange.org/
• AFCOM – www.afcom.com
• Institute for Data Center Professionals (IDCP) – www.idcp.org
• International Facility Management Association (IFMA) –
www.ifma.org
• Uptime Institute – www.upsite.org
• Construction Specification Institute – www.csinet.org
• The Data Center Journal - www.datacenterjournal.com

Fiber Connect, Inc.

Thank you!
&
Questions

Toaz.info Data Center Design and the Ansi Tia 942 Standard Pdfdrive Pr 8c6d8787d8df07579ac8f5b74266322b

Uploaded by

Document Information

Copyright

Available Formats

Share this document

Share or Embed Document

Sharing Options

Did you find this document useful?

Is this content inappropriate?

Copyright:

Available Formats

Toaz.info Data Center Design and the Ansi Tia 942 Standard Pdfdrive Pr 8c6d8787d8df07579ac8f5b74266322b

Uploaded by

Copyright:

Available Formats

Fiber Connect, Inc.

Fiber Optic Overview & Training

Data Center Design

BICSI Regional Meeting – Charleston, WV

Fiber Connect ©2003

Data Center Design and the

Practical Applications of ANSI/TIA-942

Fiber Connect ©2003

Data Center Design and the

THE TECHNOLOGY GAP

CODES & STANDARDS

Data Center Design and the

• STANDARD: A recommend practice and

Data Center Design and the

Data Center Design and the

Are they really any different?

Fiber Connect ©2003

Data Center Design and the

Why another standard?

Source: ANSI/TIA-942 2005

Fiber Connect ©2003

Data Center Design and the

Data Center Design ANSI/TIA-942

– Telecommunications cabling system

Data Center Design and the

TIA 942 Design Considerations

Source: ANSI/TIA-942 2005

Data Center Design and the

– Defines new terms

– Defines the physical

Fiber Connect ©2003

Data Center Design and the

Data Center Design and the

Cabling & Topology

Fiber Connect ©2003

Data Center Design and the

Source: ANSI/TIA-942 2005

Data Center Design and the

Data Center Telecommunications Spaces

-It’s the central space where the point of

- The data center shall have at least one MDA

- The core routers and core switches for the

Data Center Design and the

Data Center Telecommunications Spaces

- LAN, SAN and KVM switches that support the

- There should be a minimum of one horizontal

Data Center Design and the

Data Center Telecommunications Spaces

- Are spaces allocated for the end equipment, including computer

-End equipment is usually standing equipment or equipment

- Horizontal cables are terminated in equipment distribution

- Point-to-point cabling is permitted between equipment located

Data Center Design and the

Data Center Telecommunications Spaces

- Should be limited to serving a maximum of 288 coaxial

- Cross-connection shall not be used in the ZDA

- No more than one ZDA shall be used within the same

- There shall be no active equipment in the zone

Could be a Consolidation Point

Data Center Design and the

Multimode fiber optic cable

Single Mode Fiber Optic Cable

75 Ω ohm Coax Cable

Fiber Connect ©2003