SMARTAISLETM

COLD AISLE
CONTAINMENT
Laura Rigato
Business Development Manager Integrated Systems
26/01/2017
AGENDA

Mechanical Containment

Why Not Just Containment?

Pressure Control in the Raised Floor

Starting from the Server

Not Only Efficiency

2
PROBLEMS WITH TRADITIONAL AIR COOLING

3
TRADITIONAL AIR COOLING TROUBLES

10-15°C

4
THE FIRST STEP: HOT-COLD SEPARATION

20-26°C

5
THE FIRST STEP: HOT-COLD SEPARATION

By just applying a proper separation between cold and hot air we can obtain:
• A more efficient air distribution
• Improved temperatures in front of the servers
• Higher temperatures behind the cooling units (which will then operate with higher evaporating
temperatures or water temperatures)
• Increase the number of freecooling hours, in case a freecooling system is used

This, however, is just the first step, the key point is how a cooling system can better adapt to
an application with containment…

6
WHY NOT JUST CONTAINMENT?

P1 < P2
P2 (Pa)

Return air

Control
Cold

CRAC Unit
sensor
Aisle
Supply air

• Servers are not getting enough air P1 (Pa) sensor

• Risk of hot air intrusion into the cold aisle

• Over-blowing server fans
• Loss of cold air = low efficiency
P1 >> P2
• Reducing server fans life-time P2 (Pa)
Leakages

Return air

Control
Cold

CRAC Unit
sensor
Aisle
Supply air
P1 (Pa) sensor

7
THE ANSWER TO CUSTOMERS’ NEEDS

Addressing Cooling Needs Only Real Focus on IT Equipment Needs

Emerson Network Power Emerson Network Power

… But there is a way to do it

better…

Supply or Return
Air Control Raised floor pressure SmartAisle™
with control with containment best
Containment efficiency

Efficiency

8
PRESSURE CONTROL IN THE RAISED FLOOR

Type of control to keep a constant pressure

in the raised floor
0 Pa Room Pressure

Control based on the differential pressure

Cooling Units
ICOMTM control with
sensor placed sensor

Rack
Differential
pressure
2 readings: sensor tube
• Inside the unit body (room pressure) Underfloor
• In the raised floor, cca 1.5 m – 2 m distance pressure

from the unit (underfloor pressure) 50 Pa

cca 1.5 – 2 m

9
PRESSURE CONTROL IN THE RAISED FLOOR

Each Unit with its own Sensor  More Redundancy

All Units Sharing the readings  Improved Room Coverage
Typical Application:
• Open architecture: the sensor will typically work in the range of 50 – 100 Pa
• Hot / cold aisle containment: the sensor will typically work in the range of 15 - 20 Pa
It is thus important that sensors are calibrated according to its application

10
A CLEVER WAY TO MANAGE THE SYSTEM

Cascade By Pressure
• Always have the right number of units operating
• Work with EC Fans at the most efficient working point as long as possible
• Grant the proper airflow management
Fans running at minimum fan speed
Pressure > set point

Fans running at minimum fan speed

Pressure < set point

Running units
Stand-by units

11
PRESSURE CONTROL LIMITATIONS

A good solution, but with some drawbacks…

12
CONTROL AND DIFFERENT IT LOADS PER AISLE

Pressure Control

May be Critical!

13
THE ANSWER TO CUSTOMERS’ NEEDS

Addressing Cooling Needs Only Real Focus on IT Equipment Needs

Emerson Network Power

… But there is a
way to do it even
better…

Supply or Return Raised Floor

Pressure Control SmartAisle™
Air Control with
with Containment best
Containment efficiency

Efficiency

14
HOW CAN WE IMPROVE EVEN FURTHER?

Pressure control still focuses on the single unit, it is a control method which is
self-referential!

How Can We Improve Even Further?

… We Need to Take One Step Back…

15
… STARTING FROM THE SERVER

16
WHEN IT WORKS, IT MAKES HEAT

Hot Air Discharge

Cold Air Supply

17
“EQUIVALENT CIRCUIT”

Variable fan speed

depending upon the
inlet temperature

Variable power input

depending upon the
fan speed

18
AIRFLOW CAN VARY

Our Thermal Solution Always Needs to Match It!

q1 Servers’ Airflow
qservers = q1 + q2 + ...qn

q2

Cooling Unit Airflow

qn qcooling = qservers

19
SERVER AIRFLOW DYNAMIC CONTROL

20
SERVER AIRFLOW DYNAMIC CONTROL: SENSORBOX

21
CONTROL AND DIFFERENT IT LOADS PER AISLE

Server Airflow Dynamic Control

Perfect Solution!

22
EFFICIENCY AT PART LOADS: ECONOMY STAND-BY

A Higher Level System Efficiency

Economy Stand-by:
• Calls the units in operation

OFF
OFF

ON
Smart Aisle Temp Sensor

ON
according to their specific
remote sensors (still shared
among the team)
• Calls the units in operation

OFF
OFF

ON
ON
maintaining them in the
optimal working speed for the
Normal Team Work: EC Fan
• Activates the unit according to the internal ID
number Economy Stand-by:
• This may result in having the unit pushing air from • Using Cooling Closest to the Heat
the other side of the room Load
• Normal teamwork also induces unit 1 to full • Improving System Efficiency and
capacity before activating unit 2 Increasing Components Life (less
demanding operating point)

23
SUPPLY COMPENSATION

Extending the Server Airflow Dynamic Logic to Open Architecture

24°C

26°C 26⁰ C Cold

Aisle
Server Server
Rack Rack
Hot Hot
26⁰ Aisle
Aisle 24⁰

22⁰ 18⁰

Supply
Air
Sensor
Set
point
16°C

16⁰ C

24
SUPPLY COMPENSATION

Extending the Server Airflow Dynamic Logic to Open Architecture

Compensation is the link between the control sensors:
• The control evaluates the rack sensor and the fan speed
• If the fan is operating at 100% and the rack temperature is above the set point, the supply
temperature set point will be lowered to provide colder air

In this way we can ensure

the appropriate cooling even
in case of a poor air
distribution

25
SYSTEM EFFICIENCY

In Row Units
Perimetral
Chilled Water
Liebert® CRV - In the
In the Row Row Data Center
(DX/CW)
Cooling Units
Chilled Water Systems • Optimize fan operation
• Better return temperature
Liebert® AFC and Liebert® HPC
• Higher heat density per
- Data Center Chillers
rack
• Maximized Freecooling effect with
fluid temperature up to 26ºC DX Systems
Liebert® PCW - Room Cooling Liebert® PDX – Direct
Units Perimetral Expansion Cooling units
Direct
• Optimized Fan Speed Control Expansion • Optimize fan operation
System • Better return temperature
• Optimized water loop based on • Modulating Capacity Solution
real Data Center Loads

26
SERVER AIRFLOW DYNAMIC CONTROL

Row Cooling Case Study 1: 90 kW Traditional Approach

Thermal Load
Increase in Temperature = Increase in

Row cooling
Fan speed
IT Racks
31ºC
Capacity

>80%
18ºC
• Compressor works at a lower modulation
• Fans work at a lower speed
• Lower consumption of fans and compressor
SmartAisle

Containment Maximizes Air Utilization

Liebert CRV
Fan speed
IT Racks
37ºC

69%
30% 8,188 € 20ºC

Energy Yearly
Saving Savings
In the Row Direct Expansion Chilled Water
Note: Saving calculated in comparison with Traditional In the Row solution without
Containment and Control, load: 90 kW, city: Frankfurt

27
SERVER AIRFLOW DYNAMIC CONTROL

DX Cooling Case Study 2: 300 kW Traditional Approach

24ºC

Thermal Load

Fan Speed

Cooling Unit
IT Racks

IT Racks

Precision
100%
• Integrates the benefits of containment with 14ºC

the capabilities of the control for optimized 14ºC

cooling
Cold Aisle Containment
• The control matches cooling capacity with 28ºC

heat load

Fan Speed

Cooling Unit
IT Racks

IT Racks

Precision
85%
- Variable speed fans 17ºC

- Variable capacity compressors 17ºC

• Containment maximizes air utilization SmartAisle

32ºC

60% 79,322 €

Fan Speed

Cooling Unit
IT Racks

IT Racks

Precision
60%
Energy Yearly 19ºC

Saving Savings 19ºC

Note: Saving calculated in comparison to Traditional DX Floor Mount AC fan solution without
Containment and Control, load: 300 kW, city: Frankfurt) In the Row Direct Expansion Chilled Water

28
DIRECT EXPANSION SOLUTION pPUE

1.0 1.12 2.6

Outdoor Condensers:
- Reduced refrigerant charge, with
micro-channel coils
- Intelligent communication with
Floor mount units

Direct Expansion Floor Mounts:

- Designed to suit 38°C of return
temperature
- Includes the economizer to
provide direct freecooling for the
data center, or indirect freecooling

Control of airflow and temperature

in front of the servers:
- Always provides the right quantity
of air at the right temperature
ENERGY CONSUMPTION OF DIFFERENT DX SYSTEMS

Energy Yearly Consumption / 1 kW Cooling

Floor Mount - Scroll, TXV, base fans at 24°C 50% RH

Floor Mount - Scroll, EEV, premium fans at 24°C 50% RH

PDX Premium Digital plus Air Economizer

PDX Premium Digital plus Smart Aisle

PDX Premium Digital plus Pumped Refrigerant Economizer

0,00 0,05 0,10 0,15 0,20 0,25 0,30 0,35 0,40

kWh / kW of Cooling Capacity
LIEBERT PDX – FROM 5 TO 120 KW
Liebert ® EC Fan 2.0
- Increased Efficiency
- Reduced Noise
- New Blade Design
iCOMTM Control
- First Networking Controller
- IP based
- Featuring teamwork capabilities with
other Liebert units thus optimizing
resources within the controlled space
Freecooling Modes
- Direct Freecooling
- Water/Indirect Freecooling
- Liebert® EconoPhaseTM – Pumped
Refrigerant Economizer
Liebert® MC – Microchannel Condenser
- Integrated in the iCOMTM Control
- Microchannel Coil
- EC Fan To Maximize Efficiency at Part Load
Digital Scroll Compressor
- Capacity modulation
- Quick adaptation to changing heat loads
- Strongly reduces energy consumption with
SmartAisle™
SERVER AIRFLOW DYNAMIC CONTROL

CW Cooling Case Study 3: 460 kW Traditional Approach

Thermal Load
• Rates the benefits of containment with the
capabilities of the control for optimized cooling
• The control matches cooling capacity with heat
load
• Containment maximizes air utilization
- Increasing the return air temperature to room Cold Aisle Containment + Floor-mount
Chilled Water Unit & Freecooling Chiller
cooling units, which consequently increase also
fluid temperatures.
- By enlarging the delta T between air and fluid it is
possible to lower the fan speed, as the cooling
capacity provided by room cooling unit is much
higher. 30,740 €
63% on CRAC Unit
Yearly
67% on Freecooling Chiller
Savings
Energy Saving
In the Row Direct Expansion Chilled Water
Note: Saving calculated in comparison to Traditional CW Floor Mount AC fan solution without
Containment and Control and Freecooling Chiller)

32
CHILLED WATER SOLUTION pPUE

1.0 1.11 2.6

Freecooling Chillers:
- Maximizes the freecooling effect
- Increases CW temperatures (up to
26/20°C CWT)

CW Floor Mount units:

- Full range from 30 to 200 kW
- Up to 70% improvements
compared to industry standards
- Economizer to provide Direct
Freecooling for Data Center

Control of air flow and temperature

in front of the servers:
- Always provides the right quantity
of air at the right temperature
- Freecooling chillers and floor
mount control and set point
integration
CHILLED WATER SYSTEMS FOR HIGH WATER TEMP. 20 / 32°C
NEXT LEVEL EFFICIENCY FOR CW SYSTEMS
Energy Yearly Consumption / 1 kW Cooling

Chiller at 15/10°C and Floor Mount

Year
HPC Freecooling chiller at 26/20°C water and Floor Mount
2008

HPC Freecooling chiller at 26/20°C water and PCW

2010

AFC at 26/20°C water 2012

AFC at 26/20°C water and variable water flow

2014

CW System at 20 / 32°C
2016
Chiller & Pump
0,00 0,10 0,20 0,30 0,40 0,50
Floor Mount kWh 2017

2017 – CW System at 20 / 32°C –

pPUE 1.06
LIEBERT PCW – FROM 5 TO 220 KW
Liebert Economizer
Direct freecooling for data
centers using outside air
when appropriate thus
enabling energy optimization
Liebert® EC Fan2.0
New fans technology with
composite material fans
to optimize unit efficiency
iCOMTM Control
 Control and Monitoring
through the iCOM control
 Delivering BMS & NMS
Connectivity
 IS Cards available as
standard option
Aerodynamic Internal Design
- Unique unit design granting the
best efficiency
- Reduces unit pressure drop via:
coil geometry, distance between
fans and coil, filter positioning
LIEBERT HPC: FREECOOLING CHILLER SPECIFICALLY
DESIGNED FOR DATA CENTRES
Fast Start Ramp
Fast restart after power failure:
first compressor ON after 20
seconds
Cooling Range
50 – 1600 kW
iCOMTM Control
Strategies for system efficiency:
- Freecooling chiller teamwork
and integration with Liebert®
floor mount units
- Complete monitoring product offer
Freecooling with SmartAisle™
High water temperatures allow for a high
freecooling effect: high system
efficiency
p pPUE
1.0 1.11 2.6
High Efficiency Components
- EC Fan
- Electronic expansion valve
- Scroll / Screw compressors
- Pumps with efficiency class IE3
DATA CENTER OPERATING THRESHOLDS

The definition of the data center required temperature and humidity

relies also on the external environment conditions.

The increase in operating temperatures within which IT

infrastructure functions, allows the application of new technologies
such as evaporative and adiabatic cooling.
COOLING WITH WATER

Water Evaporation removes surrounding heat and thus cools down the air
temperature.
Colder air allows the transition from Dry Bulb to Wet Bulb Temperature (the
graph shows the change from 30°C to 20°C)
LONDON –
DRY/WET BULB AND THE EVAPORATIVE EFFECT
EXTERNAL DRY BULB Temperature
D (London / Gatwick)
600

r 93% Recommended 2011 500

Number of hours/year
y 98% Allowable A1 400
100% Allowable A2-A4
300
B
u 200

l 100

b 0

W 0
100
e 200

Number of hours/year
t 300
Extreme Max 400
WET BULB 500
B (London / Gatwick) 100% Recommended 2011 600
23.6°C
u 100% Allowable A1-A4 700
800
l EXTERNAL WET BULB Temperature
(London / Gatwick)
900
1000
b
FRANKFURT –
DRY/WET BULB AND THE EVAPORATIVE EFFECT

400
EXTERNAL DRY BULB Temperature
D (Frankfurt) 93% Recommended 2011 350

Number of hours/year
r 98% Allowable A1 300
y 99% Allowable A2 250
100% Allowable A3-A4 200
B 150
u 100
l 50
b 0
0
W
100
e
t Extreme Max
200
WET BULB

Number of hours/year
(Frankfurt)
23.5°C 300
B
u 400

l 100% Recommended 2011

500
b 100% Allowable A1-A4
600
EXTERNAL WET BULB Temperature
(Frankfurt)
700
ANKARA –
DRY/WET BULB AND THE EVAPORATIVE EFFECT

350
D
300

Number of hours/year
r 87% Recommended 2011
250
y 96% Allowable A1
200
99% Allowable A2
150
B 100% Allowable A3-A4
100
u
50
l
0
b
W 0

e 100
t Extreme Max
WET BULB 200
(Ankara) 300

Number of hours/year
27°C
B 400
u 500
l 600
b
700
100% Recommended 2011
100% Allowable A1-A4
ADIABATIC CHILLED WATER SOLUTION pPUE

1.0 1.08 2.6

Adiabatic Freecooling Chillers:

- Maximizes the freecooling effect
- Increases CW temperatures (up to
26/20°C CWT)

CW Floor Mount Units:

- Full range from 30 to 200 kW
- Up to 70% improvements
compared to industry standards
- Economizer to provide Direct
Freecooling for Data Center

Control of airflow and temperature in

front of the servers:
- Always provides the right quantity
of air at the right temperature
- Freecooling chillers and floor
mount control and set point
integration
LIEBERT® AFC - ONE UNIT, 3 COOLING
TECHNOLOGIES
Patent
Pending
Freecooling
ADIABATIC
PAD

Adiabatic Cooling

pPUE

1.0 1.08 2.6

100% Compressor Back-up

BRINGING AFC TECHNOLOY AT A HIGHER LEVEL

Freecooling
pPUE
Big Freecooling capacity
with modular V coils 1.0 1.06 2.6

Adiabatic Cooling

Patent
Pending

100% Screw Compressor Back-up

High efficiency screw compressors, to ensure 100% cooling
availability under all conditions.

44
LIEBERT® AFC – OPERATING MODES

The new iCOMTM Control logic constantly measures the external temperature
and humidity in order to activate the most efficient operating mode

LOW
EXT. TEMP FREECOOLING

ADIABATIC
FREECOOLING

HYBRID COOLING

HIGH ADIABATIC
EXT. TEMP
MECHANICAL COOLING
Range
From 500 kW to 1450 kW
During
50 Hz and 60 Hz Water BACKUP MODE
Shortages
UTMOST EFFICIENCY AT THE DATA CENTER
SYSTEM LEVEL

Liebert® AFC
Adiabatic Freecooling
Chiller

Liebert® PCW

SmartAisle™

iCOM™ Control

pPUE pPUE
The SUPERSAVER:
1.0 1.08 2.6 1.0 1.06 2.6

THE SOFTWARE LOGIC OPTIMIZING THE ENTIRE COOLING SYSTEM

INDIRECT EVAPORATIVE SOLUTION pPUE

1.0 1.03 2.6

Evaporative Cooling Units

- Indirect evaporative freecooling
- Range: 100 and 350 kW
- Perimeter or roof installation
- Reduced installation costs, located
outside the white space

Racks Arrangements
- Hot or cold aisle containment
- Control of air at servers level

Optimizing the System

Control of air flow and temperature in
front of the servers
Always provides the right quantity of air
at the right temperature
WHERE LIEBERT® EFC WORKS

DX/CW
Integration:
- At 24°C and 90%
relative humidity, the
unit might require
DX/CW integration.
Dry Operation: The unit - But, at 30°C
can cool the data center just (higher temperature)
via the air-to-air Heat and 35% (lower
Exchanger thus using only relative humidity) the
external cold air. unit can work just
with the evaporative.

WET
DRY Operation
Operation
WET Operation: The
unit can here exploit the
Assumptions:
evaporative effect via
- Data Center 36°C  24°C
- 100% of Full Load per Unit humidification.
LIEBERT® EFC: OPERATION MODES

Optional

Summer

Winter

EXTERNAL AIR TEMPERATURE IS TOO

HIGH TO HAVE 100% COOLING WITH
EVAPORATIVE, THE DX MODULE IS
THUS INTEGRATED TO COVER THE
MISSING CAPACITY
AIR-TO-AIR HEAT EXCHANGE VIA
THE SPRAYING OF WATER TO
THE EXTERNAL AIR SIDE DX/CW
Integration
AIR-TO-AIR HEAT EXCHANGE
WITHOUT SPRAYING WATER
WET
Operation
Dry
Operation
LIEBERT EFC 300 -EVAPORATIVE MODULE

Exhaust Air OUT

FROM DC TO DC

External Air IN
UNIT CONTROL – THE SMARTAISLE™

Does the cooling unit have the right TEMPERATURE & AIRFLOW CONTROL?
• SmartAisle control logic optimizes internal air volumes and temperatures
following the specific servers’ needs.
• SmartAisle control logic allows Liebert® EFC to exactly match servers’ airflow
thus ensuring that not a single Watt is wasted in moving or cooling unrequired air.

iCOM T&H iCOM T&H

Sensor Sensor
Rack

Rack

Hot aisle or cold aisle containment can be

managed in the same way
UNIT CONTROL – THE COST FUNCTION

WATER or ELECTRICITY, what costs less?

The user-friendly control, enables users to select the exact temperature at which the
evaporative device starts to spray water in the air. This is how Liebert® EFC can optimize
the operation based upon different customer’s needs.
LIEBERT® EFC – AVAILABILITY, CAPACITY &
EFFICIENCY

Availability
• Cooling Continuity & Control Always ON
• Reduced Risk of Unit Failure
• Components Redundancy
• LIFETM

Capacity
• 100% Capacity Modulation
• Scalability
• Adaptation to Indoor/Outdoor Conditions
• Teamworking & Electrical Infrastructure Optimization

Efficiency
• Best pPUE
• Cost Function (Electricity – Water)
• Winter Saver
• SmartAisleTM Teamwork
THE ANSWER TO CUSTOMERS’ NEEDS

Addressing Cooling Needs Only Real Focus on IT Equipment Needs

Supply or Return Raised Floor Server Airflow

Dynamic Control
Air Control with Pressure Control Highest Efficiency
Containment with Containment Levels

Efficiency

55
Questions & Answers

56