Data Centre Cable PDF

Designing a Fiber Structured Cabling
System for the Data Center
A Web Conference Presented by the

TIA Fiber Optics LAN Section
John M. Struhar, Director

Fiber SCS Solutions
Ortronics/Legrand
jstruhar@ortronics.com
1 11/18/05 JS Copyright 2005 Ortronics/Legrand. All rights reserved.

TIA Fiber Optics LAN Section (FOLS)
Founded in 1993 as a Section of the TIAs Fiber
Optics Division
Mission: Educate system designers, architects,
consultants, engineers, contractors, end users & the
media about the technical advantages that optical
transmission brings to customer-owned networks
Stimulates development of new fiber standards and
promotes optical-based applications in customer-
owned networks

Todays Agenda
Designing a Fiber SCS for the Data Center
Introduction to new standards-based data

center & storage area network design
Selecting the optimal fiber structured
cabling system for your data center &
storage area network

Information generation & storage trends
Data center & storage area network growth
Introduction to the new TIA-942 data center
standard

New Information Generation
Significant Annual Increases
2002 new information production: 5 exabytes
1 exabyte 1,000,000,000,000,000,000 bytes
New digital information = 1 Library of Congress every 15 minutes
Four primary physical media
Print
Film New information doubled in last 3 years
Magnetic
Optical
350% more information communicated than stored (2002: 18 exabytes)
Four electronic channels
Telephone
Radio
Television
Internet
Source: How Much Information 2003?, School of Information
Management & Systems at University of California at Berkeley

Why is Network Traffic Growing?
A Global Bandwidth Binge
New bandwidth intensive
Worldwide Available Bandwidth

applications growing
62% new capacity added in 2003
42% increase in bandwidth
demand in 2004
Demand for video could strain
networks
2002 2003
Source: TeleGeography, April 2005
11/18/05 JS Copyright 2005 Ortronics/Legrand. All rights reserved.

Why Are Data Center & SANs Growing?
U.S. Legislation & Recommendations
Sarbanes-Oxley Act
Health Insurance Portability & Accountability Act (HIPAA)
Graham-Leach-Bliley Financial Services Modernization Act
U.S Federal Reserve
Securities & Exchange Commission Rule 17a
SB 1386 - California

standard

Definitions
Data Center & Storage Area Network
Data Center Storage Area Network (SAN)
The factory floor of the High-speed special purpose network
information age (or subnetwork) that interconnects
ISP: Specialized facility that different kinds of data storage
houses web sites & provides devices with associated data
data serving & other services servers on behalf of a larger
for other companies network of users
Enterprise: Central data Usually located in Data Center
processing facility and/or the
group of people who manage
the enterprises data
processing & networks
Source: http://www.whatis.com
The Integrated Enterprise Network
LAN, Data Center & SAN
Physical layer
Copper & optical
fiber cabling
subsystems
Interconnect
devices
Hubs, switches &
directors
Translation devices
Host bus adapters
Routers
Gateways
Bridges

Data Center Growth
Rapid & Significant
Large enterprise 50% yearly data growth

Undergoing major technological shifts
$7.4 billion market by 2009
Sources: Yankee Group & IDC reports, 2004 & 2005

Networked Storage Growth
Outpaces Overall Storage Market Growth
Network Attached Storage (NAS)

& Storage Area Networks (SANs) 140.0
120.0
2004: 50% of overall storage market
100.0
12% CAGR vs. 5% 80.0

60.0
2005: 38% Fibre Channel port 40.0
shipment growth 20.0
Dollars invested 0.0

2004 2005
18% of total I.T. budget

Fibre Channel Port Shipments
60% of hardware budget
Source: Dell Oro Group 2005, iSuppli Corporation, 2004

Data Center/SAN Media Mix
Estimated Percentages Copper & Fiber
Data Center Media Mix SAN Media Mix
20% 10%
80% 90%
Copper Copper
Fiber Fiber

Fibre Channel Technology in SANs
Short Wavelength VCSELs the Dominant Device
20,000
15,000
8 Gbps
10,000 4 Gbps
2 Gbps
5,000 1 Gbps
0
2001 2002 2003 2004 2005 2006 2007 2008
Fibre Channel Units in Thousands

Source: High Speed Optical Data Link Modules,
Market Review & Forecast, Strategies Unlimited, 2002

Remote Data Centers & SANs
Cost-effective DWDM/CWDM Technology FSP Management
Suite
Servers Servers
Fiber Fiber
Service Service
Platform Platform
Data Channel director

CWDM or DWDM
Channel director Backup
over single-mode fiber
Center Center
Fiber Fiber
Service Service
Platform Platform
Storage Storage
Source: Lightwave, January 2004,

Todd Bundy, ADVA Optical Networking

Data Center Upgrade Example
For 50% Annual Storage Capacity Growth
10,000 ft2 data center

50% annual capacity increase typical
Doubling of floor space required every 3-5 years
Data center floor space cost: $700-1200/ft2
Upgrade cost: $8-12 million over 3 year period
Source: The Meta Group, Room at the Data Center? 8-01

Insufficient DC/SAN Infrastructure Investment
The Costs are Staggering
Ramifications
Minimized customer transactions, interactions
& sales volumes
Decreased revenues
Network downtime estimates:
Pay-per-view TV operator: $125,000 per hour
Credit card authorization company:
$2,600,000 per hour
Retail brokerage: $6,400,000 per hour
Source: Lightwave, January 2004

Todd Bundy, ADVA Optical Networking

standard

Premises Structured Cabling System
TIA/EIA-568-B Defines 7 Subsystems
Work Area
Horizontal
Telecom Room
Backbone
Entrance Facilities
Equipment Room
Administration

Do We Really Need Another Standard?
Dont We Already Have Too Many?

Data Center Cabling Standards
Structured Cabling Systems for the Data Centers & SANs
TIA-942
Telecommunications Infrastructure Standard for Data Centers
Published: April 2005
Order from Global Engineering Documents (www.global.ihs.com)
CENELEC
EN 50173-5
Information technology - Generic cabling systems Part 5: Data Centres
Expected publication: Early 2006
EN 50174-2 Amendment
Adds Annex on Data Center planning & installation
ISO/IEC
Generic Cabling for Data Centres Proposed
ISO/IEC JTC-1/SC 25/WG 3

TIA-942 Data Center Standard
Objective
Requirements & guidelines for the design &

installation of a data center or computer room
Intended for use by designers needing thorough
understanding of data center design
Comprehensive document
Cabling Architectural design Fire protection
Network Design Environmental design Water intrusion
Location Electrical design Redundancy
Access

Data Center Structured Cabling System
9 Elements Comprise TIA-942
1. Computer room
2. Telecommunications room
3. Entrance room Spaces
4. Main distribution area
5. Horizontal distribution area
6. Zone distribution area
7. Equipment distribution area
8. Backbone cabling
9. Horizontal cabling
Cabling subsystems

Data Center Cabling
For the Backbone & Horizontal Cabling Subsystems
Backbone subsystem (fiber)

Backbone cables
Main cross-connects
Horizontal cross-connects
Mechanical terminations
Patch cords
Horizontal subsystem (fiber or
copper)
Horizontal cables
Mechanical terminations
Patch cords
Zone outlet or consolidation point (optional)

TIA-942 Data Center Standard
Supported Architectures
Basic data center topology

Distributed data center topology
Reduced data center topology
Centralized fiber optic cabling topology

Basic Data Center Topology
And TIA/EIA-568-B Counterparts
Entrance Room
Analogy: Entrance Facility
Main Distribution Area (MDA)
Analogy: Equipment Room
Horizontal Distribution Area
(HDA)
Analogy: Telecom Room
Zone Distribution Area (ZDA)
Analogy: Consolidation Point
Equipment Distribution Area
(EDA)
Analogy: Work Area

Distributed Data Center Topology
With Multiple Entrance Rooms
May be required for large
data centers
Circuit distance
limitations may require
multiple entrance rooms
Primary entrance room
has no direct
connections to HDA
Secondary entrance
room may be directly
connected to HDA
conditionally

Reduced Data Center Topology
For Many Enterprise Installations
HDA combined with MDA

Telecom room can also
be consolidated into
MDA
Copper or fiber in the
horizontal

Data Center Centralized Fiber Cabling
Significant Cost Savings Possible
Alternative to optical cross-
connection in the horizontal
distribution area
No electronics in horizontal
distribution area (HDA)
Centralized electronics
Cost reduction factors
Smaller, simpler HDA
Faster & easier installation &
testing
Fewer idle ports
Centralized administration
Simplified moves, adds &
Visit TIA Fiber Optics LAN Section web site for changes
information on centralized fiber cabling: www.fols.org

TIA-942 & Draft EN 50173-5 Compared
Similarities & Differences
TIA/EIA-942 (2005) EN 50173-5 (2006)
Distribution
EO
Zone
Distribution Area
Area
Distribution Area
ZD LDP EO
Horizontal
Equipment EO
Main
Distribution MD
Area EO
ZD EO
EO
ENI
Entrance Room ENI
Connection point to the outside world Equipment Network Interface (ENI)

Functional distribution element within the MDA Main Distributor (MD)
Functional distribution element within the HDA Zone Distributor (ZD)
Connection point within the ZDA Local Distribution Point (LDP)
Connection point within the EDA Equipment Outlet (EO)
Courtesy: Mike Gilmore, e-Ready Building Limited (2004)

Media Selection
Design Considerations per TIA-942
Flexibility with respect to supported services

Required useful life of cabling
Facility site/size & occupant population
Channel capacity within the cabling system
Equipment vendor recommendations or specifications
Same facility architecture if different media types used

Data Center Cabling Recommendations
Transmission Media Normative Required
100-ohm twisted-pair copper cable
Category 3 or 5e allowed
Category 6 recommended
Multimode fiber optic cable
62.5/125 m or 50/125 m allowed
50/125 m 850 nm laser optimized multimode fiber
recommended
Singlemode optical fiber cable
75-ohm coaxial cable Per TIA-942
Type 734 & 735 cable
Type T1.404 coaxial connector

Data Center Cabling
Design Recommendations (Informative) - Optional
Copper design (informative)

Adequate spacing for labeling on each patch panel
Label each port per Annex B and ANSI/TIA/EIA-606-A
Fiber design (informative)
Installation time reductions
Multi-fiber increments & multi-fiber connectors
Pre-calculated, pre-terminated multi-fiber ribbon assemblies
Consider performance effects of additional connections
Per TIA-942
Data Center Standard
Multiple Benefits to Designers & Managers
Consistency in design
Predictable level of performance
More choice in the marketplace
Interoperability between different vendors products
Economies of scale

Selecting the optimal fiber structured
cabling system for your data center &
storage area network

Agenda
Selecting the Optimal Fiber SCS for your Data Center & SAN
Why is the choice of a fiber structured cabling system so

important in data centers & SANs?
Guidelines for selecting the fiber termination method
Connecting the system elements together

Higher Speed Networks More Demanding
Fiber, Cable & Connectivity Choices Critical
Fiber cable plant loss budgets continue to decrease

Widely perceived 2.6 dB budget for 10 Gbps Ethernet
& Fibre Channel
Installation techniques more challenging
Advanced fiber SCS technology provides new options

Multimode Fibers
Industry Standard Types
Min
Fiber type Wavelength Max Bandwidth 1 Gb/s 10 Gb/s
(nm) (MHzxkm)
Loss Reach Reach
(dB/km) OFL EMB (meters) (meters)
62.5 m (OM1) 850 3.5 200 n.s.* 275 33
1300 1.5 500 n.s. 550 300
50 m (OM2) 850 3.5 500 n.s. 550 82
1300 1.5 500 n.s. 550 300
850-nm 10G Laser- 850 3.5 1500 2000 1000 300
Optimized 1300 1.5 500 n.s. 600 300
50 m (OM3)
OM1, OM2, OM3 designations OFL = Overfilled launch

Per ISO/IEC 11801, 2nd Edition EMB = Effective modal (laser) bandwidth
*n.s. = Not specified

Multimode Fiber Types
Bandwidth Comparison
62.5/125 m
200/500 MHz-km
50/125 m
500/500 Hz-km
OM3 (50/125 m)
2,000/500 MHz-km

Ethernet Fiber Loss Budgets Decreasing
Due to Ever Increasing Speeds
Year Application Data Rate Designation Standard Cable Plant

Loss Budget
(db)
Early 80s Ethernet 10 Mbps 10BASE-FL IEEE 802.3 12.5
Early 90s Fast Ethernet 100 Mbps 100BASE-FX IEEE 802.3 11.0
Late 90s Short Wavelength 10/100 Mbps 100BASE-SX TIA/EIA-785 4.0

Fast Ethernet
2000 1 Gigabit Ethernet 1,000 Mbps 1000BASE-SX IEEE 802.3z 3.56
2004 10 Gigabit Ethernet 10,000 Mbps 10GBASE-SR* IEEE 802.3ae 2.60
Insertion loss values are for maximum distance specified in the standard
& can vary based on the distance & number of connections

Fibre Channel Loss Budgets Also Decreasing
The Predominant Protocol in Storage Area Networks
Application Data Designation Supported Cable Plant Loss

Rate Distance (m)* Budget (db)
Fibre Channel 1 Gbps 100-M5-SN-I 0.5 860* 4.62
Insertion loss values are for maximum distance specified in the standard
& can vary based on the distance & number of connections
*Supported distances using 2,000 MHz-km

850 nm laser optimized 50 m multimode fiber

Key Elements of a Robust DC/SAN
To Support Multiple Generations of Electronics
Reliable, high bandwidth networks required

The optimal solution: systems engineered, manufactured &
independently verified to meet & exceed worldwide standards
requirements
Performance of individual fiber network elements critical
1. Electronics: Fully qualified devices with high laser coupling efficiency
2. Fiber: Low DMD or high EMBc
3. Cable: Low attenuation
4. Apparatus: Reduced insertion loss per mated pair

Ethernet & Fibre Channel Transceivers
Look For High Laser Coupling Efficiency
850 nm operating wavelength more

cost effective
Small Form Factor Pluggable (SFP)
modules dominant
Broad manufacturer availability
Fully qualified devices
recommended
Most power is inside 850 nm laser
9-38 m donut spot projected
on 50 m fiber core

Cable Design & Manufacturing
Can Affect 10 Gbps Performance
Cables with low attenuation

tested & verified not to
degrade fiber performance
in 10 Gbps networks
Tight control over buffer
uniformity & concentricity for
highest connector
performance

Small-Form-Factor Fiber Connectors
High Density Critical for Space-Limited Data Centers
VF-45 OptiJack LX.5
MT-RJ LC

Optimum Connector Performance
Creates a Lens at the Tip of the Connector
Look for polishing techniques yielding ideal tip geometry
End-face quality a key factor for maximum link performance
Objectives: minimum insertion loss; maximum return loss
Poor polish: fiber depressed into Ideal polish: connector ferrule/fiber

ferrule, causing poor performance end-face scan showing ideal contour
Maximum 10 Gbps system performance

10 Gbps Multimode Cabling System
IEEE Link Model 850 nm Serial, 2,000 MHz-km MMF
Power budget consumed by Cross noise

various impairments Receiver eye opening
Total Available Power in dB

Cross noise Relative intensity noise
Receiver eye opening Mode partition noise
Relative intensity noise
Mode partition noise Inter-symbol interference (ISI)
Inter-symbol interference (ISI)
Channel insertion loss
Robust fibre solutions
Low insertion loss Channel insertion loss (ChIL)
Low Differential Mode Delay (DMD)
75% of total penalty
Borrow budget from other areas for
channel insertion loss

Reallocating ISI Loss Penalty
Using State-of-the-Art Fiber Technology
Ideal application to MTP/MPO-based systems

Ideal for data centers & SANs
Exchange ISI for channel insertion loss

Easy to Configure Data Center Systems
Fibre Channel Example, 2 MTP/MPOs & 3 LC Connections
LC
Example SAN or data FC-AL Hub
center fiber link design MTP/MPO
Standard OM-3 fiber may Modular Ribbon

backbone
pre-terminated
not support number of optical cassette cable or
systems distribution
connections cable
State-of-the-art LOMF MTP/MPO

fiber & low insertion loss
LC
connectors LC
Patch panel
FC Switch (interconnect)
MT
Agenda
Selecting the Optimal Fiber SCS for your Data Center & SAN


Available Fiber Termination Methods
Multiple Solutions for Data Centers & SANs
Multimode Single-mode
Cassette-based Cassette-based
Pre-terminated Pre-terminated
Field-terminated Field-terminated

Cassette-Based DC/SAN Solution
Ribbon Backbone or Ribbonized Fiber Cable
Definition: Ribbon backbone or reduced diameter loose tube
cable terminated with MTP/MPO connectors designed to
interface with optical cassette system
Ideal for use in the Zone Distribution Area (ZDA)

Cassette-Based DC/SAN Solution
Selection Criteria
Design Element Advantage
Highly reliable Ideal for data centers & SANs
Factory terminated solution Guaranteed optical performance
Integrated system Designed for interoperability
Easy, fast, error-free installation Significant cost savings
Distributes optical signals to common LC & SC interfaces Integration with existing systems
Cassette supports multiple fibers Greatly simplified connectivity
Compliant with TIA SP-3-4424-AD7* Standards-based system
*to become TIA/EIA-568-B.3, Addendum 7

Pre-Terminated DC/SAN Solution
Time & Labor Saving Backbone Cable Designs
Definition: Backbone cable with factory installed connectors

extending from rear of adapter panel to mating end of another
adapter panel in another rack

Pre-Terminated DC/SAN Solution
Selection Criteria

Factory terminated solution Guaranteed optical performance
Multiple optical links contained in one sheath Facilitates cable routing & dressing
Fast & easy installation Reduced on-site time & labor costs
Smaller overall cable diameter & cross-sectional areas Better air flow & less congestion
Distribution, armored, or reduced diameter plenum cable Solution for every application

Field-Terminated DC/SAN Solution
Time & Labor Saving Backbone Cable Designs
Definition: Field-installable fiber optic connectors installed on-site

with local installation crews
LC
SC
Fiber connector field termination kit

Adhesive/polish Termination
Popular Field-Installable Connector
Cordage secured in Adhesive holds the fiber firmly

connector by adhesive in the connector ferrule
method Excess fiber is
scored &
removed
The remaining fiber and adhesive

is polished down to the end-face
of the ferrule
Fiber end polished to same
radius curve as ferrule end-face

No-polish Termination
Reduced On-Site Labor Costs
Mechanical splice joins factory-installed
Adhesive holds the
fiber stub and fiber being terminated
factory-installed fiber stub
firmly in the connector
ferrule
Fiber end
polished and
tested at the
factory to same
radius curve as
ferrule end-face
Drop of index-matching gel provides
optical interface for cleaved fibers

Field-Terminated DC/SAN Solution
Selection Criteria

Wide range of popular connector types available Integration with existing systems
Connector choices may unique to specific data center/SAN Minimize hybrid patch cords
No polish connector requires less consumables Reduced on-site labor costs
Anaerobic adhesive connector requires no heating oven Reduced on-site labor costs
State-of-the-art fiber connector designs Good choice for skilled installers
Look for complete, easy to understand instructions Fewer installation errors

Agenda
Structured Cabling Systems in Data Centers & SANs


Cassette-Based Data Center Solution
Channel Components for 10 Gbps Multimode System

Pre-Terminated Data Center Solution
Channel Components for Single-mode System
Cable Management Cable Management

Rack Rack
SC Adapter Panel
LC Adapter Panel 12 Fiber
24 Fiber
Rack Mount Single Mode

Fiber Patch Cabinet Single Mode Rack Mount Duplex Patch Cord
Duplex Patch Cord Fiber Patch Cabinet

Field-Terminated Data Center Solution
Channel Components for 10 Gbps Multimode System
Cable Management Cable Management

Rack Rack
Rack Mount
SC Adapter Panel
Fiber Patch Cabinet
12 Fiber
LOMF Fiber
Patch Cord
LOMF Fiber
Patch Cord
Rack Mount
LC Adapter Panel
Fiber Patch Cabinet
24 Fiber

Summary
Data Centers & SANs: Rapidly Growing SCS Applications
Vast amounts of new information being created,

communicated & stored
Legislation & other business priorities impacting data center &
storage area network growth
The TIA-942 Data Center Standard applies structured cabling
principles as TIA/EIA-568 did for commercial buildings
Careful choice of structured cabling system products should
span multiple of generations of data center systems

Designing a Fiber Structured Cabling System
for the Data Center

Data Centre Cable PDF

Uploaded by

Document Information

Original Title

Copyright

Available Formats

Share this document

Share or Embed Document

Sharing Options

Did you find this document useful?

Is this content inappropriate?

Copyright:

Available Formats

Data Centre Cable PDF

Uploaded by

Copyright:

Available Formats

Designing a Fiber Structured Cabling

System for the Data Center

A Web Conference Presented by the

John M. Struhar, Director

1 11/18/05 JS Copyright 2005 Ortronics/Legrand. All rights reserved.

2 11/18/05 JS Copyright 2005 Ortronics/Legrand. All rights reserved.

Introduction to new standards-based data

3 11/18/05 JS Copyright 2005 Ortronics/Legrand. All rights reserved.

4 11/18/05 JS Copyright 2005 Ortronics/Legrand. All rights reserved.

5 11/18/05 JS Copyright 2005 Ortronics/Legrand. All rights reserved.

New bandwidth intensive

Worldwide Available Bandwidth

Source: TeleGeography, April 2005

11/18/05 JS Copyright 2005 Ortronics/Legrand. All rights reserved.

7 11/18/05 JS Copyright 2005 Ortronics/Legrand. All rights reserved.

8 11/18/05 JS Copyright 2005 Ortronics/Legrand. All rights reserved.

10 11/18/05 JS Copyright 2005 Ortronics/Legrand. All rights reserved.

Large enterprise 50% yearly data growth

Sources: Yankee Group & IDC reports, 2004 & 2005

11/18/05 JS Copyright 2005 Ortronics/Legrand. All rights reserved.

Network Attached Storage (NAS)

12% CAGR vs. 5% 80.0

Dollars invested 0.0

18% of total I.T. budget

Source: Dell Oro Group 2005, iSuppli Corporation, 2004

11/18/05 JS Copyright 2005 Ortronics/Legrand. All rights reserved.

Data Center Media Mix SAN Media Mix

13 11/18/05 JS Copyright 2005 Ortronics/Legrand. All rights reserved.

Fibre Channel Units in Thousands

14 11/18/05 JS Copyright 2005 Ortronics/Legrand. All rights reserved.

Data Channel director

Source: Lightwave, January 2004,

15 11/18/05 JS Copyright 2005 Ortronics/Legrand. All rights reserved.

10,000 ft2 data center

Source: The Meta Group, Room at the Data Center? 8-01

16 11/18/05 JS Copyright 2005 Ortronics/Legrand. All rights reserved.

Source: Lightwave, January 2004

17 11/18/05 JS Copyright 2005 Ortronics/Legrand. All rights reserved.

18 11/18/05 JS Copyright 2005 Ortronics/Legrand. All rights reserved.

19 11/18/05 JS Copyright 2005 Ortronics/Legrand. All rights reserved.

20 11/18/05 JS Copyright 2005 Ortronics/Legrand. All rights reserved.

21 11/18/05 JS Copyright 2005 Ortronics/Legrand. All rights reserved.

Requirements & guidelines for the design &

22 11/18/05 JS Copyright 2005 Ortronics/Legrand. All rights reserved.

23 11/18/05 JS Copyright 2005 Ortronics/Legrand. All rights reserved.

Backbone subsystem (fiber)

24 11/18/05 JS Copyright 2005 Ortronics/Legrand. All rights reserved.

Basic data center topology

25 11/18/05 JS Copyright 2005 Ortronics/Legrand. All rights reserved.

26 11/18/05 JS Copyright 2005 Ortronics/Legrand. All rights reserved.

27 11/18/05 JS Copyright 2005 Ortronics/Legrand. All rights reserved.

HDA combined with MDA

28 11/18/05 JS Copyright 2005 Ortronics/Legrand. All rights reserved.

29 11/18/05 JS Copyright 2005 Ortronics/Legrand. All rights reserved.

Connection point to the outside world Equipment Network Interface (ENI)

Courtesy: Mike Gilmore, e-Ready Building Limited (2004)

Flexibility with respect to supported services

Same facility architecture if different media types used

31 11/18/05 JS Copyright 2005 Ortronics/Legrand. All rights reserved.

32 11/18/05 JS Copyright 2005 Ortronics/Legrand. All rights reserved.

Copper design (informative)

34 11/18/05 JS Copyright 2005 Ortronics/Legrand. All rights reserved.

35 11/18/05 JS Copyright 2005 Ortronics/Legrand. All rights reserved.