[Reference Design 102]

46 MW (IEC), Chilled Water, 40000 m2

DESIGN OVERVIEW
Data Centre IT Capacity
Initial delivery of 3.8 MW
Scalable to 45.8 MW
Regional Voltage and Frequency
90-140kV, 10-15kV, 400V
50Hz
Redundancy Levels
Power: 2N distribution to load, 2N
UPS, N+2 generators
Cooling: N+2 CRAHs, N+1
pumps, N+1 chillers
INTRODUCTION
This Reference Design is optimized for large colocation companies with an emphasis on
redundancy, time to market (TTM), and initial capital expense (CapEx). The data centre
is to be built out in twelve increments of 3.8 MW blocks. Each block contains two
electrical rooms, two IT rooms, and a cooling system that serves the entire block. Each
IT room has two distinct zones: a high density zone containing 112 racks at 9kW/rack,
and a lower density zone containing 150 racks at 6 kW/rack. Together, these rooms and
systems constitute the building blocks for the data centre. Each data centre expansion,
therefore, is designed to occur in increments of 3816 kW of IT load.

DESIGN HIGHLIGHTS
High reliability
Reduced TTM
Scalable design
Minimized initial CapEx
Flexible IT space
[Reference Design 102] 2

Facility Power
UTILITY CONNECTION
The data centre is designed for a maximum demand of 80 MVA, which requires a connection to the electric utility’s high voltage (HV)
sub-transmission network. Depending on the country, the supply voltage can vary from 90 kV (e.g. France), to 110 kV (e.g.
Finland), and up to 132 kV (e.g. UK). The utility company will be responsible for building the HV substation that provides metered
power supplies “A” and “B”. Therefore, the change of ownership occurs after the metering point, which means that the data centre
owner will specify and procure the HV/MV transformer.

PRIMARY MEDIUM VOLTAGE (MV) DISTRIBUTION

The HV/MV substation design allows for concurrent maintenance of the equipment without needing to run the generator set. Two HV
utility incomers feed two HV single busbars, which are connected through a bus section for 2N redundancy. Four 40 MVA Minera
power transformers with on-load tap changer (OLTC) supply six IT blocks. The MV distribution voltage can be chosen according to
country practices (e.g. 10 kV in Finland, 11 kV in UK, and 15 kV in Belgium). The short circuit impedance of the HV/MV transformer
is chosen at 17% to avoid exceeding 25 kA short circuit current on the MV distribution network. The MV distribution is 2N redundant,
comprising four PIX air insulated switchgear lineups rated at 17.5 kV and 25 kA (3s) with a 2500 A busbar, ensuring better cost
optimization. Each pair of these PIX lineups feed six IT load blocks for A and B-side distribution.

HV/MV Substation and Primary MV Distribution

Utility A Utility B

KWh KWh

HV HV HV HV
40MVA 40MVA 40MVA MV 40MVA
MV MV MV

MV Primary Dist. MV Primary Dist. MV Primary Dist. MV Primary Dist.

SWG A1 SWG A2 SWG B1 SWG B2 PiX
2500A 10kV 2500A 10kV 2500A 10kV 2500A 10kV

BLOCKS BLOCKS BLOCKS BLOCKS

1-3 4-6 7-9 10-12

FACILITY POWER HV/MV SUBSTATION ATTRIBUTES

Name Value Unit

Utility voltage 90 < Un < 140 kV © 2015 Schneider Electric. All rights reserved.
Number of blocks supported 12
Power path Dual
Quantity of HV/MV transformer(s) 4
HV/MV transformer size 40 MVA
HV/MV transformer short circuit impedance 17 %
Quantity of MV primary distribution switchgear lineups 4
MV primary distribution bus amps 2500 A
MV primary distribution bus voltage 10 < Un < 15 kV
MV primary distribution switchgear short time withstand
25 (3) kA (s)
current

Document Number RD102DS Revision 0

[Reference Design 102] 3

Facility Power
SECONDARY MEDIUM VOLTAGE DISTRIBUTION

This design aims for a simple MV distribution, optimizing the number of MV feeders in order to minimize MV cabling cost. Each section
feeds a group of three IT blocks, as does a dedicated MV backup diesel generator power plant. Automatic transfer between the mains
power and backup generators is built into the design.
Eight Premset switchgear lineups, rated at 17.5 kV, 1250 A and 25 kA (3s) make up the entire MV secondary distribution. Each pair of
Premset lineups feeds three IT blocks in a 2N architecture, to provide A- and B-side power. The two switchgear lineups are connected
by a “coupling cable” to maintain redundancy downstream of a failure. The diesel generator backup power is connected to the MV
distribution network via a Premset switchoard. Thirteen 2500 kVA, 400 V generators with N+2 redundancy are coupled to the MV
network with a LV/MV step-up 2500 kVA Trihal cast resin transformer with a 6% short circuit impedance. This backup generator plant
configuration provides high reliability and safety, while minimizing cost. For full Tier III compliance, a set of redundant Premset MV
switchgear could be added to the design. Fuel storage and piping can also be added to the design in accordance with country habits
and regulations.
MV Distribution to Blocks
MV Primary Dist. MV Primary Dist.
SWG B
SWG A
DESIGN OPTIONS
Three Blocks This reference design can be modified
G
13x 2500 kVA units
G as follows without a significant effect on
LV LV the design’s performance attributes:
MV MV

Genset SWG 1250A, <15kV

 Redundant generator switchgear set
ATS ATS

MV Secondary MV Secondary  Provision for load bank

Dist. SWG A Dist. SWG B Premset
 Add/change standby generator options:
1250A, 10kV 1250A, 10kV
o Location
BLOCK
o Tank size
BLOCK o Fuel type
BLOCK

FACILITY POWER MV DISTRIBUTION ATTRIBUTES

Name Value Unit

Per 3 blocks
Number of MV secondary distribution switchgear lineups 2
MV secondary distribution bus amps 1250 A
MV secondary distribution bus voltage 10 < Un < 15 kV
© 2015 Schneider Electric. All rights reserved.

MV secondary distribution switchgear short time withstand current 25 (3) kA (s)

Generator redundancy N+2
Number of Generators 13
Generator size 2500 kVA
Generator voltage 400 V
Number of MV Generator switchgear lineups 1 (per generator)
MV Generator bus amps 1250 A
MV Generator bus voltage 10 < Un < 15
MV Generator switchgear short time withstand current 25 (3) kA (s)

Document Number RD102DS Revision 0

[Reference Design 102] 4

Facility Power
LOW VOLTAGE DISTRIBUTION

Downstream of the MV secondary distribution, each block is composed of three pairs of A-side and B-side MV/LV transformers that
serve LV switchboards. Two of these pairs are dedicated to the two IT rooms in the block, while the third pair is dedicated to the block’s
cooling system and auxiliaries. In A total of 72 Trihal 2500 kVA transformers are used to transform voltage from 17.5 kV to 400 V with
6% impedance, in a close-coupled installation.
Similarly, 72 Okken LV switchgear lineups make up the complete LV distribution sub-system, with each lineup rated at 400 V and 80 kA
(1s) with a 4000 A bus. This busbar nominal current rating is maximized to achieve cost-effectiveness and make the most of IT
capacity.The power train for each IT room is made up of two Okken lineups that feed Galaxy 7000 UPSs in a 2N configuration, allowing
for A and B-side power distribution in the IT room. Finally, a combination of LV switchgear and iBusway systems with built-in
intelligence feeds 2N power to the IT load. The power train for a single block’s cooling system and auxiliaries is comprised of two Okken
LV switchgear lineups providing A and B-side distribution to chillers, pumps, lighting, monitoring, security and automation systems, etc.,
while providing fault protection to cooling units in the IT and electrical rooms
The facility power system is designed to also support integrated peripheral devices like fire panels, access control systems, and
environmental monitoring and control devices. Power meters in the electrical path monitor power quality and allow for predictive
maintenance & diagnostics of the system. These meters also integrate with StruxureWare Power Monitoring Expert.
Every component in this Reference Design is built and tested to the applicable IEC standards. Further design details and schematics
are available in the engineering package available upon request.
LV Distribution to final loads per Block
MV Secondary MV Secondary
Dist. SWG A Dist. SWG B
DESIGN OPTIONS
This reference design can
One Block
Trihal be modified as follows
MV 2.5MVA MV MV 2.5MVA MV MV 2.5MVA MV
LV LV LV LV LV LV without a significant effect on
Okken
LV Crit. SWB A LV Crit. SWB B LV Crit. SWB A LV Crit. SWB B LV Crit. SWB A LV Crit. SWB B the design’s performance
4000A, 400V 4000A, 400V 4000A, 400V 4000A, 400V 4000A, 400V 4000A, 400V
attributes:
UPS UPS UPS UPS
 Change UPS batteries
 Location
LV Dist. A LV Dist. B LV Dist. A LV Dist. B

 Type
IT Room 1: 1.9MW IT Rooml 2: 1.9MW Cooling for one Block

FACILITY POWER LV DISTRIBUTION ATTRIBUTES

DESIGN OPTIONS
Name Value This reference
Unitdesign can
IT in each block
be
Cooling in each block
modified as follows
without a significant effect on
Number of MV/LV transformer 4 2
the design’s performance
MV/LV transformer size 2.5 2.5 MVA
© 2015 Schneider Electric. All rights reserved.

attributes:
Number of LV critical switchgear 4 2
LV critical bus amps 4000 4000 A
 Change UPS batteries
LV critical bus voltage 400 400 V
 Location
LV critical switchgear short time withstand current 80 (1) 80 (1) kA (s)
 Type
2N: IT room CRAHS and
UPS redundancy 2N secondary pumps
N: UPS-room CRAHs
Total UPS capacity per block 4500 360 kW
UPS runtime @ rated load 5 5 minutes
UPS output voltage 400 400 V

Document Number RD102DS Revision 0

[Reference Design 102] 5

Facility Power
POWER MONITORING

The power monitoring system is part of the DCIM

(Data Center Infrastructure Management System)
system which measures, monitors tracks, and
controls all aspects of the physical data centre in a
real time. In addition, it optimizes planning, as well
as continuous improvement in asset management to User
User
drive operational efficiency. Power monitoring Interface
Interface
system offers the following features:
Preserve availability and reliability of the
Electrical Distribution system
Optimize quality of power
Reduce maintenance costs
Quick diagnosis helps reduce time to resolve
issues Block 1,2,3 Block 4,5,6 Block 7,8,9 Block 10,11,12
MV SWBD MV SWBD MV SWBD MV SWBD

Centralization in one or several places of all control

and monitoring information for the electrical network
Block1 Block 1 Block 1 Block 4 Block 4 Block 4 Block 7 Block 7 Block 7 Block 10 Block 10 Block 10
Historic and archival data building for analysis IT room 1 IT room 2 Mechanical IT room1 ITroom 2 Mechanical ITroom 1 ITroom 2 Mechanical ITroom1 ITroom2 Mechanical

and capacity planning. Block2 Block 2 Block 2 Block 5 Block 5 Block 5 Block 8 Block 8 Block 8 Block 11 Block 11 Block 11
ITroom 1 ITroom 2 Mechanical ITroom1 ITroom 2 Mechanical ITroom 1 ITroom 2 Mechanical ITroom1 ITroom2 Mechanical

Block3 Block 3 Block 3 Block 6 Block 6 Block 6 Block 9 Block 9 Block 9 Block 12 Block 12 Block 12
ITroom 1 ITroom 2 Mechanical ITroom1 ITroom 2 Mechanical ITroom 1 ITroom 2 Mechanical ITroom1 ITroom2 Mechanical

POWER MONITORING SYSTEM MAIN FEATURES

© 2015 Schneider Electric. All rights reserved.

Document Number RD102DS Revision 0

[Reference Design 102] 6

Facility Cooling
This facility cooling system is optimized for oceanic climates, in Cooling system for 1 Block
places like Dublin or San Francisco, with warm summers and cool (Shown 1 of 12)
winters, though it can be easily adapted to work in other types of CHWR CHWS CHWS CHWR
IT & ER IT & ER IT & ER IT & ER
climates.
The design is made up of twelve identical stand-alone cooling DAS DAS

VFD
VFD

VFD

VFD

VFD

VFD
systems, one dedicated for each block. Each chilled water system ET ET

is comprised of a dual-path piping system with six air-cooled

Uniflair BREF-4212A packaged chillers with free cooling, Thermal
Storage
Thermal
Storage
accompanied by a primary-secondary pumping scheme, with
variable speed secondary pumps, all in an N+1 configuration.
Also, a redundant piping system across all the IT and electrical
distribution rooms in the block provide an alternate path for chilled Chiller Chiller Chiller Chiller Chiller Chiller

water, in case of equipment failure.

Economization is achieved with dry coolers integrated within each
Piping in electrical and IT rooms
chiller, to save energy during favorable outdoor conditions. In
addition, thermal storage systems are offered to provide

CHWR
continuous cooling after a power outage or chiller restart. These
ER A

CHWS CHWS
tanks would be sized accordingly for the ramp-up time of the
chillers and building topology. IT Room IT Room
1 2
The redundant piping architecture of the mechanical system feeds
InRow RC units in the IT rooms and Uniflair chilled water room-

CHWR
ER B
based computer room air handlers (CRAHs) in both IT rooms and
in the LV electrical room. Additional air handling units are added
to supply fresh air in the building and direct expansion (DX) units
are provisioned for the rooms containing the generator switchgear,
MV switchgear and UPS batteries.
DESIGN OPTIONS
This reference design can be modified as follows without a
This design is instrumented to work with StruxureWare Building
significant effect on the design’s performance attributes:
Operation for cooling control and monitoring. Further design
details such as dimensions, equipment placement, temperature
 Add StruxureWare Building Operation
set points, pipe sizing, flow rates, and pressure drops are
available in the engineering package.
FACILITY COOLING ATTRIBUTES

Name Value Unit

Total facility cooling capacity 66 MW
Name Each block Value Unit
Total facility cooling capacity 66 MW
© 2015 Schneider Electric. All rights reserved.
Sub-system cooling capacity 5500 kW
Input voltage 400 Each block V
Sub-system
Heat rejection medium cooling capacity Chilled water 5500 kW
Number ofInput voltage
chillers 6 400 V
Heat
Mechanical rejection medium
redundancy N+1 Chilled water
Number of chillers 6
Packaged air-cooled chiller
Outdoor heat exchange
Mechanical redundancy with free-coolingN+1

Coolant supply temperature 15

Packaged chiller with free-°C
Outdoor heat exchange
cooling
Coolant return temperature 20.6 °C
EconomizerCoolant
type supply temperature Water-side 15 °C
Coolant return temperature 20.6 °C
Document Number RD102DS Storage tank size per sub-system 65.6 m3 Revision 0

Ride-through time 5 minutes

Economizer type Water-side

FACILITY COOLING ATTRIBUTES

[Reference Design 102] 7

IT Space
Twelve independent IT blocks can be built one by one to make up the IT DESIGN OPTIONS
space of this design. One block includes two IT rooms of 1908 kW This reference design can be
apiece. Each room is split into two zones: a medium-density area with
modified as follows without a
150 NetShelter racks of 6 kW each, and a high-density area with 112
significant effect on the design’s
NetShelter racks of 9 kW each. Altogether, they constitute 45.8 MW of IT
performance attributes:
capacity for the whole site.
In this design, each IT room is powered by redundant (2N) iBusway  Add environmental and security
systems. Every rack has the capacity to accept dual power feeds, since management
each is configured with redundant (2N) metered rack-mount power  Change rack options
distribution units (PDUs) which offer remote monitoring for improved  Tall
efficiency and capacity management.  Wide
 Deep
In medium-density zones, heat is removed by Uniflair chilled water room-  Change rack power distribution options
based CRAHs in an N+2 redundant configuration at the room level. In  Basic
high-density zones, heat is removed by InRow RC-HT units in an N+2  Metered
redundant configuration for each pair of rows. Considerations can be  Switched
made with respect to return air ducting systems and/or raised floors, to  Add StruxureWare Data Center Expert
improve the coolers’ performance. Redundant valves and piping are also
added to ensure continuous cooling with high reliability.
The security of the room is maintained at multiple points. At the rack
level, access is controlled by a door lock and sensor. At the room level,
security cameras are utilized for monitoring.

IT SPACE ATTRIBUTES

Name Value Unit

Total IT load 45.8 MW
Total number of blocks 12
IT load per block 3816 kW
IT room per block 2
IT load per room 1908 kW
IT floor space per room 730 m2
High Density Zone Medium Density Zone
IT zone load 1008 900 kW
Supply voltage to IT 230 / 400 230 / 400 V
Average density 9 6 kW/rack © 2015 Schneider Electric. All rights reserved.

Number of racks 112 150 racks

Single or dual cord Dual Dual
Chilled water InRow-HT Chilled water room-
CRAC/CRAH type
CRAHs based CRAHs
CRAC/CRAH redundancy N+2 per pair of rows N+2 per room

Document Number RD102DS Revision 0

[Reference Design 102] 8

Advantages of this Reference Design

 Extra-large size aims to deliver data centers for multi-tenant, co-location businesses with heterogeneous IT loads
 Highly scalable to control initial Capital Expenses and improve ROI
 Highly reliable with predictable performance
 Flexibility to populate IT space with different levels of power density, without compromising space utilization and efficiency
 This "end-to-end" solution considers constraints from utility to rack, for consistency and right sizing throughout the entire facility
 Chosen switchgear ratings are optimized to meet a balance between cost-efficiency and high performance
 Operating principles available to understand dynamics, maintenance and recovery situations
 High-end power monitoring systems are included to manage real time values, planning, and support optimization throughout
the entire life cycle of the data center

Schneider Electric Life-Cycle Services

Team of over 7,000 trained specialists covering
every phase and system in the data centre

Standardized, documented, and validated

methodology leveraging automation tools and
repeatable processes developed over 45 years

Complete portfolio of services to solve your

technical or business challenge, simplify your
life, and reduce costs

Get more information on this design

Contact your Schneider Electric Account Manager to receive the Engineering Package for
this design which contains the electrical one line diagrams, piping diagrams, dimensioned
© 2015 Schneider Electric. All rights reserved.

floor layouts, and equipment lists.

Document Number RD102DS Revision 0