Session 4 Ancillary Systems

Makeup Water System

• Backup on-site makeup water storage is required for sites using
evaporative cooling
• The makeup water system must meet applicable topology
criteria by Tier to point of delivery for a minimum duration of
12-hours
• Technical Paper Series provides additional information about
typical water volumes

Session 4 Ancillary Systems

Makeup Water Tier Criteria

12 Hour Capacity

12 Hour Capacity

Bulk Water Storage –

No Topology Requirements

65
Session 4 Ancillary Systems

Makeup Water Tier Criteria – Tier III

N+1 Components

Session 4 Ancillary Systems

Makeup Water Tier Criteria – Tier III

N+1 Components

66
Session 4 Ancillary Systems

Makeup Water Tier Criteria – Tier IV

Compartmentalization

2N Components

Session 4 Ancillary Systems

Engine-Generator Fuel System

• Storage tanks
• Piping systems
• Pumps
• Day tanks
• Controls
• Filtration

67
Session 4 Ancillary Systems

Fuel System Tier Progression

• Tier I – 12-hours fuel storage for engine generator(s)
• Tier II – Redundant tanks and pumps for 12-hour supply (at least
2)
• Tier III – Concurrently Maintainable 12-hour fuel supply system
to “N” engine generators while in operation
› Identical to minimum makeup water system storage requirement
• Tier IV – Autonomous control response to component or path
failure

Session 4 Ancillary Systems

Fuel System Tier Criteria – Tier I & II

Bulk Fuel Storage –
No Topology Requirements

Tier I –
Total of 12 Hours Fuel

Tier II –
Redundant 12 Hours Fuel

Tier III and Tier IV –

Other Fuel System Requirements

68
Session 4 Ancillary Systems

Fuel System Tier Criteria – Tier III

N+1 Components

Session 4 Ancillary Systems

Fuel System Tier Criteria – Tier III

N+1 Components

69
Session 4 Ancillary Systems

Fuel System Tier Criteria – Tier IV

Compartmentalization

2N Components

Session 4 Ancillary Systems

Fuel System Consideration

• A single equalization valve is not Concurrently Maintainable nor

Fault Tolerant
• Use double valves for Concurrent Maintainability

70
Session 4 Ancillary Systems

Fuel System Consideration

• A single equalization valve is not Concurrently Maintainable nor

Fault Tolerant
• Use double valves for Concurrent Maintainability
• Provide Compartmentalization for Fault Tolerance
• Manually operated “Normally Closed” valves avoid Fault Tolerant
automation requirements

Session 4 Ancillary Systems

Fuel Polishing Systems

• Fuel polishing (filtration and bio-treatment) is not required
for any Tier
› Fuel polishing is an Operational Sustainability issue
• Fuel polishing must be carefully integrated to avoid
compromising Tier III or Tier IV criteria

71
Session 4 Ancillary Systems

Fuel Polishing Configuration

• This configuration is limited to supplying

no more than the redundant number of
engine-generator subsystems

Session 4 Ancillary Systems

Fuel Polishing Configuration

Filter
System

Engine Fuel Supply

• This fuel filtration configuration can be

isolated without affecting fuel supply to
engine generators

Fuel Storage Tank

72
Session 4 Ancillary Systems

Building Automation
• Includes
› Supervisory control and data acquisition (SCADA)
› Plant controls: building automation system (BAS) and building
management system (BMS)
› Emergency power off (EPO)
• Principal Tier IV Consideration
› Tier IV requires autonomous response to failure

Session 4 Ancillary Systems

Tier IV Autonomous Response

• Operator intervention shall not be required to respond to single
system failure
• Control system failure shall not disrupt critical environment
› Critical environment must remain stable with failed control system
• Tier IV data center facility infrastructure control systems shall
› Detect system failure
› Isolate and contain failure
› Sustain “N” capacity after failure of any component or path

73
Session 4 Ancillary Systems

Electrical System Control Considerations

• No special consideration for Tier I or Tier II
• Control maintenance or a single control failure shall not disrupt
subordinate control systems (e.g., chiller plant control)
• Control systems must comply with Tier criteria while engine
generators are supporting the site load
› Concurrently Maintainable for Tier III
› Fault Tolerant for Tier IV
› A single failure (including software instance) shall not prevent autonomous
engine-generator start/operation in Tier IV sites

Session 4 Ancillary Systems

Plant and Temperature Controls

• Common names
› Building automation system
(BAS)
› Building management systems
(BMS)
› Direct digital controls (DDC)
• Scope of system
› “Head-end” server
› Communications (may include site network)
› Building node control panel,
local control panel
› Sensor, actuator, input/output
cards, power supplies

74
Session 4 Ancillary Systems

Plant and Temperature Controls

• No special controls requirements for Tier I and Tier II
• Tier III requires that the critical environment must remain
stable with any control element out of service for calibration,
repair, or replacement on a scheduled basis
• Tier IV data center facility infrastructure control systems shall
› Detect system failure
› Isolate and contain failure
› Sustain “N” capacity after failure of any component or path

Session 4 Ancillary Systems

Active Control Systems

• Active: Requires continuous modulation and feedback to
manage system
Will fail

• Control elements that must change state in response to failure

must be physically independent of failed component
› Power source
› Control cabinet or node
› Sensors

75
Session 4 Ancillary Systems

Active Control Impact

• Design represents
traditional Primary–
Secondary loops Valve “A”

• “Normal” operation
uses valve “A” to
control temperature in
secondary loop

Session 4 Ancillary Systems

Active Control Impact

• Design represents
traditional Primary–
Secondary loops
Valve “B”
• “Normal” operation uses
valve “A” to control
temperature in secondary
loop
• Variations in primary loop
pressure adversely
impact secondary loop
temperature stability
• “Abnormal” operation
uses valve “B” to control
loop temperature

76
Session 4 Ancillary Systems

Active Control Impact

• Design represents traditional
Primary – Secondary loops
• “Normal” operation uses valve
“A” to control temperature in
secondary loop
• Variations in primary loop
pressure adversely impact
secondary loop temperature
stability
• “Abnormal” operation uses
valve “B” to control loop
temperature
• Control failure drives system
to full-cold—and loss of
sensible capacity

Session 4 Ancillary Systems

Fire Protection Considerations

• Gaseous fire suppression is permissible but not required by any
Uptime Institute Tier Classification level
• Integration of fire detection system into other facility
infrastructure systems shall be
› Concurrently Maintainable (Tier III) or
› Fault Tolerant (Tier IV)
• Combined fire detection and EPO systems are suspect
› Detracts from Operational Sustainability

77
Session 4 Ancillary Systems

Fire Protection Considerations

• The connection of the fire systems to the cooling units can defeat
Concurrent Maintainability and Fault Tolerance
• The location and state of the relays when the fire system is maintained or
suffers a fault are a critical consideration

FACP
+
NO

NARM
CRAH

- NC

Network Addressable Relay Module

NO
NO
CRAH
Relay 1

NC
NARM CRAH
NC
NO

Network Addressable Relay Module

Relay 2
CRAH
NC

Fire Alarm Control Panel

Session 4 Ancillary Systems

EPO Considerations
• The Tier Standard does not require an EPO if not required by AHJ
• Standing-voltage EPO systems have not been shown to be
compliant with Tier III or Tier IV
› Often integrated into distributed components
› Centralized Applied Voltage systems are effective
▪ Applies to both the push-button activation circuit and the shunt-trip circuit
• The EPO system shall be
› Concurrently Maintainable for Tier III
› Fault Tolerant for Tier IV

78
Session 4 Ancillary Systems

Compartmentalization
• Applies to complementary systems and distribution paths in
Tier IV topology
• Tier IV requires physical isolation to prevent a single event from
simultaneously impacting more than the number of redundant
components or systems
• Each compartment shall contain no more than the number of
redundant components

Session 4 Ancillary Systems

Effective Compartmentalization

Secondary Chilled Water Pumps N=3 (R=1) Chilled Water Machines and Primary Pumps N=4 (R=2)

79
Session 4 Ancillary Systems

Electrical Compartmentalization

Session 4 Ancillary Systems

Electrical Compartmentalization

80
Session 4 Ancillary Systems

Electrical Compartmentalization

Session 4 Ancillary Systems

Telecommunication Routing
• These recommendations apply to communications connections
from site property line to data center communications point of
demarcation, including intermediate vaults, rooms, and closets
› Tier III recommends diverse conveyances, but may share path
› Tier IV recommends diverse conveyances and physical isolation to
prevent a single event from simultaneously impacting more than the
number of redundant paths
• Remember, power and cooling for active communication
components must meet the requirements of the Tier objective

81
Session 4 Ancillary Systems

Site Communications Path

POP A POP A

POP B POP B
Section

Section

• Concurrently Maintainable
paths recommended for Tier III

Session 4 Ancillary Systems

Site Communications Path

POP A POP A

POP B POP B

• Compartmentalized path
recommended for Tier IV

82
Session 4 Ancillary Systems

Other Ancillary Systems

• No Tier-level specific or Certification criteria
› Building pressurization (Makeup air systems)
› Battery room ventilation
› Reverse-osmosis systems
› Free-cooling or economizer systems
› Lightning protection
› Grounding
› Load bank
• Integrate carefully!

Session 4 Ancillary Systems

Ancillary Systems Recap

• Compartmentalization is Required for Tier IV
• Critical ancillary systems must meet same criteria as power and
cooling system at each Tier level
› Tier II – Redundant Components
› Tier III – Concurrently Maintainable
› Tier IV – Fault Tolerant
• Reminder: Some ancillary systems are not critical but may
inadvertently compromise Tier

83