CloudEdge V100R018C10 Hardware System (E9000) Training Slides-B-V1.0 - OK

CloudEdge
V100R018C10
Hardware System (E9000) Training Slides
www.huawei.com
Author/ Email: huangting (employee ID: 00418852)

Version: V1.0 (2017-08-09)
Copyright © 2017 Huawei Technologies Co., Ltd. All rights reserved.

Agenda
1 Overview of CloudEdge Hardware System
2 E9000 Hardware System Architecture
3 Introduction to E9000 Boards
4 Introduction to CloudEdge Auxiliary Equipment
5 Introduction to CloudEdge Cabinet Power Distribution Solutions
Copyright © 2017 Huawei Technologies Co., Ltd. All rights reserved. Page2
Overview of the CloudEdge Solution
U2000  MANO: lifecycle management software of the Huawei

CloudEdge solution in NFV mode.
VNF MANO
 FusionSphere: a Huawei cloud management platform
based on the OpenStack and Kernel-based Virtual
NFVO Machine (KVM).
vUSN vUGW vCG
 F8000: an x86-based universal hardware platform
VNFM
providing basic hardware resources.
 E9000: designed for enterprise-level high-end and high-
performance servers using elastic computing and telecom
computing. It can converge computing, storage, and
network resources, and applies to high-end core
applications of carriers and enterprises.
FusionSphere
FusionSphere(UVP) (OpenStack)
F8000 E9000
Components of the CloudEdge Solution
NMS/OSS
OAM
U2000 Web LMT CHR tool CloudEdge client
CloudEdge Solution
MANO vUSN vUGW vCG
Fusionsphere
F8000/E9000
Overview of CloudEdge Hardware System
 Two E9000 subracks in a cabinet are interconnected using

switches. The interconnection switches are configured in
stacking mode, where the CE6851 is for management and
storage at layer I.
 Each cabinet is configured with two E9000 subracks, two
CE6851 switches, and two S5500 V3 disk arrays. If the
two S5500 V3 disk arrays deployed in cabinet 1 meet
service deployment requirements of cabinet 2, cabinet 2
does not require S5500 V3 disk arrays.
 The CE6851 functions as the layer-1 management and
storage Top of Rack (TOR).
 The TORs of different cabinets are interconnected using
deployed End Of Rack (EOR) switches (CE12804s).
Three-cabinet cascading
Overview of CloudEdge Hardware System
Hardware configuration of CloudEdge solution:

• A cabinet with two E9000 subracks
• Two CE6851 switches
• Two S5500 V3 disk arrays
Agenda
Converged NFV Infrastructure: Addressing NFV Multi-NE Deployment
Challenges Using Convergent IT/CT Technologies
The E9000 provides a converged NFV infrastructure solution, which is targeted at enterprise-level high-end, and high-performance servers using elastic computing and telecom
computing. It can converge computing, storage, and network resources, and support high-end core applications of carriers and enterprises.
A single subrack can be configured with a maximum of 64 Romely EP CPUs (130 W),
1
Computing
Computing density
density
Industry-leading
Industry-leading
which is the highest density in the industry.
Provides a floating-point computing capability of 16.5 TFlops for each subrack.
A full-width CH222 board is equipped with 15 built-in 2.5-inch hard disks.

2 Storage
Storage density
density
Industry-leading
Industry-leading
A single subrack has 120 built-in 2.5-inch hard disks and a highest built-in storage capacity.
The E9000 switching module works based on industry-leading Huawei data center switch
technology.
Switching
3 capability
Industry-leading
Industry-leading
Provides a backplane switching capacity of 15.6 T and supports the evolution from
10GE optical ports to 40GE and 100GE optical ports.
• Computing A single subrack provides a maximum of 128 10GE optical ports on the uplink.
Is compatible with multiple port types, such as Ethernet, IB, and FC ports.
Provides seven types of computing nodes and fully
supports the E5-2600, E5-4600, and E7-4800.
Supports continuous running under a high temperature of 40°C.
4
Reliability
• Storage Industry-leading
Industry-leading Has a product failure rate 15% lower than that of competitors.
Provides cost-effective solutions for big data application
using distributed storage.
• Network Ranks the first in multiple competitive tests with China Mobile and China Unicom.
5
Energy efficiency
Has nine network modules: GE/10GE/FCoE/FC/IB Industry-leading
Industry-leading Passes the China Energy Conservation and Environmentally-Friendly Certification.
QDR/FDR.
• Management Supports card plug-and-play and does not require re-configuration after device replacement.
Improves management efficiency by 70% with unified
management of eSight.
6 Easy
Easy O&M
O&M Provides automatic parameter configuration and transferring.
Server Specifications in the IT Field
1 Temperature 2 Applicable cabinets
•Entire system operating temperature: Cabinets with a depth of 1000 mm
•
•5°C to 40°C installed in typical data equipment rooms

•Cabinets with a depth of 1200 mm
•Power module operating temperature: installed in IT equipment rooms

•–5°C to +50°C
•Fan module operating temperature:

•–10°C to +70°C
4 Noise meeting the ETSI
standard
• COP: 89 (30% higher than competitors)
• Noise: 72 dB
5 Weight
6 Slot heat dissipation

•Weight of an empty subrack (with
backplane): 70 kg
•When the temperature is 35°C:
•Weight of a subrack fully
•Half-width slot: 900 W
configured with computing nodes:
•Full-width slot: 1800 W
220 kg
•When the temperature is 40°C:
•Weight of a subrack with fully
•Half-width slot: 700 W
configured storage nodes: 300 kg
•Full-width slot: 1400 W
Highest computing density in the industry, floor area reduced by 20%, and Coefficient of Performance(COP) increased by 30%
Easy O&M
Offline
First deployment Batch deployment
configuration
Configuration Configuration binding

Device replacement
retaining and plug-and-play
Configuration Configuration migration

Device migration
with devices
migration
• Computing node or switch • Supporting plug-and-play and requiring no re-configuration during device replacement • Device replacement duration
module deployment, • Automatic parameter configuration and transferring, including BIOS configuration, network card, shortened from 20 minutes to 2
replacement, and migration minutes
and RAID configuration
Comparison of E9000 and Latest Products in the Industry
Key
Competitiveness Key Specification HP C7000 G8 IBM FlexSystem Dell M1000e Huawei E9000
Engineering Power supply and heat dissipation capabilities

Comparison with E9000 with competitors' latest products
1200 W/100 W 1200 W/100 W 1400 W/280 W 1400 W/280 W

capability of front and rear slots
Computing
Computing capability of an entire subrack 32 (E5-2600) 56 (E5-2400) 64 (E5-2400) 64 (E5-2600)
capability
Memory capacity Memory capacity of an entire subrack 8.2 T 10.8 T 12.3 T 12.3 T
Number of 2.5-inch HDDs in a single slot 12 12 4 15

Storage
capability External SAN
Integrated computing and storage External SAN Built-in SAN External SAN
Built-in distributed storage
Backplane bandwidth 6.144 Tbit/s 7.168 Tbit/s 7.292 Tbit/s 15.6 Tbit/s
10GE/FCoE/8G FC/IB port switching Y Y Y Y

Network
40GE N Y Y Y
switching
RoCE N Y N Y
16G FC N Y Y N
PCIe slot
PCIe resource expansion slot N 2xPCIe 8x+2xPCIe 16x N 4xPCIe 8x or 2xPCIe 16x
expansion
Operating
Ambient temperature 5°C to 35°C 5°C to 40°C 5°C to 35°C 5°C to 40°C
environment
Providing NFV/MEC Series Solutions: Supporting Deployment Scenarios of
Edge, Aggregation, and Centralization
* Computing nodes form computing clusters using
interconnection of multiple E9000 subracks over the InfiniBand Desktop cloud application scenario
ports.
* Computing nodes configured with hard disk groups
* Ethernet switching networks connect to external backbone
provide highly reliable distributed storage of up to
networks for receiving data computing tasks and returning data
dozens of TBs.
calculation results.
* Computing nodes configured with GPU cards
* The InfiniBand switching network serves as the internal
support VM applications of professional graphics
computing cluster network and provides parallel computing
processing workstations.
networks with high bandwidths and low delays.
* Built-in switch modules provide multiple service
switching planes.
* All data is stored in the FC SAN or IP SAN.

* By deploying multiple VMs on half-width computing
nodes and starting service processes, such as MS
SharePoint, Exchange, and SQL Server, on these VMs,
you can establish a collaborated large-capacity mail
and office environment.
High-performance computing application scenario IT application scenario
E9000 Chassis
Front view Rear view
Half-width slot Fan 1E 4E

module Switching
module
E9000 chassis
Management
Power module
module
Single full-width slot
2X 3X
Chassis Specifications
Chassis specifications
• The subrack dimensions are 530.2 mm x 442 mm x 840 mm (H x W x D), and the subrack (12 U) can be installed in a standard 19-inch cabinet.
• Provides 16 half-width service slots or eight full-width service slots. These slots can be combined flexibly. A full-width slot is formed when the barrier strip between
two half-width slots is removed.
• Management modules work in 1+1 backup mode and support management protocols and interfaces, such as the IPMI 2.0, SOL, SSL, SSH, and web.
• Configured with a maximum of six power modules (AC 3000 W, DC 2500 W). Supports N+N backup, N+1 backup, and dynamic energy saving management
(hibernation).
• Provides 14 fan modules. Each module contains two fan units, and each partition supports N+1 redundancy.
E9000 Chassis Front View
8 16 CH121 V3 16
7 15
CH222 V3
15
6 14 14
5 13 13
4 12 12
3 11 11
2 10 10
1 9 9
Slot numbers of half-width slots Slot numbers of full-width slots
A front slot can be configured with 16 half-width or 8 full-width computing nodes.

Depending on the computing node type, full-width slots are numbered as follows:
•When full-width computing nodes CH240, CH242, and CH242 V3 are being installed, the slots are numbered from 1 to 8 from bottom to top.
•When full-width computing nodes CH220, CH221, and CH222 are being installed, the slots are numbered from 9 to 16 from bottom to top. The three full-width
computing nodes are extended from the half-width node CH121.
Chassis Screen
Main features of the chassis screen:
 Querying subrack information, such as the position and name

 Querying installation and alarm information about boards, power
modules, and fan modules
Position of the chassis screen in a subrack  Setting the IP address of management modules
 Setting the upper limit for subrack power
E9000 Power Module
DC
AC
High-voltage DC
Item Specification Item Specification

Rated voltage AC: 110 V AC to 240 V AC
Rated voltage range –48 V DC to –60 V DC range High-voltage DC: 240 V DC
Maximum
90 V AC to 264 V AC
Maximum voltage voltage range
–38 V DC to –72 V DC
range
Rated current 16 A
Maximum current 80 A
3000 W when the input voltage ranges
•Six power modules work in 3+3 backup from 220 V AC to 240 V AC
Rated power 2500 W 2500 W when the input voltage ranges
mode. Rated power
from 200 V AC to 219 V AC
•AC and DC power supply modes are * Supports N+1 and N+N redundancy modes or no 1200 W when the input voltage ranges
redundancy. from 110 V AC to 130 V AC
supported.
E9000 Heat Dissipation (1)
* The E9000 subrack uses rear ventilation.

Fan modules have three control modes.
1. Start mode. After a fan module is powered on, the default speed is 30% of the full speed and the
duration is 3s.
2. Automatic control mode. Before a fan module communicates with the active management module,
the fan module automatically adjusts the speed based on its built-in temperature sensor.
3. Main control mode. After the fan module communicates with the active management module, the
active management module controls the fan speed based on the actual temperature of the chassis
and each component.
E9000 Heat Dissipation (2)
6 14 13 12
5 11
4 10
3 9
2 8
1 7
* The 14 fan modules in the chassis are divided into three partitions, and each fan module consists of two fan units.
* If a fan module in a partition, or any fan unit in a fan module malfunctions, heat dissipation is not affected.
* Fan module partitions are as follows:
1. FAN 1, FAN 2, FAN 3, FAN 7, FAN 8, and FAN 9 form a partition and correspond to front nodes Node 1, Node 2, Node 3, Node 4, Node 9, Node 10, Node 11, and
Node 12.
2. FAN 4, FAN 5, FAN 6, FAN 10, FAN 11, and FAN 12 form a partition and correspond to front nodes Node 5, Node 6, Node 7, Node 8, Node 13, Node 14, Node 15,
and Node 16.
3. FAN 13 and FAN 14 form a partition and correspond to rear modules 1MM, 2MM, 1E, 2X, 3X, and 4E.
E9000 Logical Structure
The computing system, switching system, and management & electro-mechanical system can work both
independently and dependently, and form a unified switching architecture. The management & electro-
mechanical system provides unified device management interfaces for this architecture.
High-Speed E9000 Backplane Connections
Backplane
Three IO connectors are reserved for each half-width
blade slot on the backplane. 1E
8X
Mezz 1
B B 8X
Half-width slot
C Backplane C LOM
A A for computing LOM
(Reserved 2X
(Reserved
blades capability)
capability) 2X
Switch board
Mezz 2
8X
Half-width blade Half-width blade
3X
2X
• Three IO connectors are reserved on the backplane for each half-width blade slot: A, B, and C
• Connector A is reserved for future use.
• Connector B is used for the Mezz 1 network adapter (located on the upper daughter card).
• Connector C is used for the Mezz 2 network adapter (located on the lower daughter card). 8X
4E
Remarks: The existing blade servers on the E9000 do not provide LAN on motherboard (LOM). Connector
A is reserved only for future extension.
Connector B
for Mezz 1 Mezz 2 • A blade server consists of the server baseboard and Mezz 1 network adapter
Mezz 1 B (daughter card). The mother board on the same blade server is configured with
C Connector A reserved
A different Mz network adapters for different bandwidths.
• The current server blade can be configured with two different Mz network cards,
namely Mezz 1 and Mezz 2, as shown in the left figure.
Connector C for • As shown in the figure above, each Mezz network adapter implements service
Mezz 2
transmission with the switching boards in different slots for different bandwidths.
Half-width blade
E9000 Switching Plane Connections
Backplane
1E
 Each computing module has two groups of SerDes connected to

switching module slots.
Mezz 1: 8X SerDes connected to 2X/3X slots 2X
Mezz 1
Mezz 2: 10X SerDes connected to 1E/4E slots
Half-width
 10X SerDes are reserved between slots 2X and 3X. slot for the
computing
 10X SerDes are reserved between slots 1E and 4E. blade
3X
 The actual capabilities of switching slots (1E, 2X, 3X, and 4E) Mezz 2
depend on the configured switch module.
8X SerDes 4E
8X SerDes
10X SerDes
E9000 Management Plane
PWR 1
。。。
The management module provides centralized out-of- Server1 BMC PWR 3
Server2 BMC
band device management functions. PWR 4
。。。
…
Management PWR 6
 Two management modules work in active/standby mode and module 1 Two I2C buses
Server15 BMC
communicate with each other using heartbeat monitoring signals and Five I2C FAN 1
Server16 BMC 。。。
buses
data synchronization channels. Heartbeat monitoring FAN 3
signals and
active/standby data
 Each management module provides two I2C buses for power module X2 BMC synchronization channels FAN 4
。。。
Switch Management
management. module 2
Two I2C
buses
FAN 6
X3 BMC FAN 7
 Each management module provides five I2C buses for fan module Switch
。。。
Five I2C buses
FAN 9
management.
E1 BMC FAN 10
。。。
 Each management module provides Ethernet switching for BMC out- E4 BMC FAN 12
of-band management of the front slots and switching slots. FAN 13
 The system can provide external management ports using Internal Ethernet switching
FAN 14
management modules and switch modules. I2C bus
External management port
E9000 Power Supply System
Power supply line 1 Power supply line 2
PWR PWR PWR PWR PWR PWR
Channel combination on the backplane

System power
* The power supply system provides AC and DC power modules.

* Six power modules support power supply modes of N+N, N+1, and no backup.
Agenda
E9000 Hardware Deployed on PS Networks
10GE switching
AC 3000 W module
Front view DC 2500 W Rear view
Power
Half-width slot
module
1E 4E CX310
MM910 10G/40G switchin

module
CH121 V3
CH121H V3
CH121 V5
CX920
10G/40Gswitching
Management module
module 2X 3X
Component Model Description

CX320
Switching board CX310 10GE converged switching module
40GE switching
Switching board CX710 40GE converged switching module module
Switching board CX920 10GE/40GE converged switching module
Switching board CX320 10GE/40GE converged switching module
Half-width server CH121 The half-width slot supports heat dissipation of 700 W
CX710
MM910 Management Module
Installation:
 Installed in slots M1 and M2.
 Two MM910 modules work in active/standby
mode.
Feature:
 Manages devices in the subrack, sensors,
Management serial
and events. port
RS232
 Automatically adjusts the fan rotation s Cascading network port
Management network port
peed.
KVM interface
 Provides external interfaces for seconda (1xVGA, 2xUSB)
Power distribution
ry development of IPMI and SNMP. management port RS485
 Delivers KVM Over IP and centralized KVM

display.
 Provides CLI or web management for user
s.
CX310: 10GE Converged Switching Module
Panel indicator
Offline button BMC serial port 16 x 10GE SFP+
SYS serial port
Feature:
• 10GE Ethernet port switching at layer 2 or layer 3 ：
 Supports 16 10GE optical ports on the uplink (16 external 10GE optical ports provided).
 Supports 32 10GE optical ports on the downlink (two 10GE optical ports for a single half-width slot).
Provides one 40 GE optical port for module stacking over the backplane.
 To obtain higher stacking bandwidths, add ports on the panel to provide more stacking connections.
 Supports stacking of a maximum of four switching modules in a subrack.
• Use of GE optical ports in the CX310:
Provides SFP optical ports and supports single-mode and multimode SFP optical modules.
Supports SFP electrical modules.
• Use of 10GE optical ports in the CX310:
Provides SFP+ optical ports and supports single-mode and multimode SFP+ optical modules.
Supports SFP+ cables (10GE), active high-speed cables (7 m and 10 m), and passive high-speed cables (1
m, 3 m, and 5 m).
CX710: 40GE Converged Switching Module
to r
indica
Panel button
Offline
8x40GE SFP+
SYS serial port
STAT
BMC serial port
 Uplink port
HLY BMC
 8×40GE
2 x RJ45
 Six 40GE optical ports can be split into four 10GE optical ports.
Backplane
 Matching MEZZ daughter card: MZ710
 Use of 10GE optical ports in the CX710:
 One 40GE port can be split into four 10GE ports and connected by the QSFP-4xSFP+ or MPO-4xDLC cable.
 One 40GE port connecting the computing node can be split into two 10GE ports for connecting to the 10GE MEZZ
daughter card and supporting the existing 10GE devices.
Use of 40GE optical ports in the CX710: 40GE
8 x QSFP+
 Provides QSFP+ optical ports and supports multimode QSFP+ optical modules. Ethernet
 Supports QSFP+ cables (40GE) and passive high-speed cables (1 m, 3 m, and 5 m).
CX920: 40GE+10GE Converged Switching Module
Panel indicator
SYS serial port
Offline button
40GE*8
10GE*8
BMC 串口
BMC serial port
CX920 is based on the cutting-edge hardware platform. It provides a super-high port density and a line-speed STAT
forwarding capability. It supports next-generation server applications that require super high performance and HLY BMC
density. 2 ×RJ45
The 10GE switching plane provides:
Backplane
8 10GE SFP+ optical ports for uplink switches
8× 10GE
16 10GE Ethernet ports for onboard network adapters on high-performance server boards
SFP+ Ethernet
1 40GE port for interconnections on the 10GE switching plane
The 40GE switching plane provides:
8 40GE QSFP+ optical ports for uplink switches 8× 40GE
16 40GE Ethernet ports for connecting high-performance server MEZZ network adapters QSFP+ Ethernet
2 40GE ports for interconnections on the 40GE switching plane
CX320: 40GE+10GE Converged Switching Module
The CX320 is a switching control unit that provides data switching functionality for compute node
STAT
slots in the system and centrally provides service and management ports to connect to external
HLY BMC
devices.
The 10GE switching plane provides ： RJ45
Backplane
8 10GE SFP+ optical ports for uplink switches
16 2*10GE Ethernet ports for onboard network adapters on high-performance server boards 8×
The 40GE switching plane provides: SFP+
10GE/40GE
2 40GE QSFP+ optical ports for uplink switches
Ethernet
1 40GE ports for interconnections on the 40GE switching plane
2×
QSFP+
MZ312: 10GE Converged Switching Module
MZ312: dual-chip Ethernet card module with four ports,

MZ710: Ethernet card module with two ports,
providing four 10GE optical modules.
providing two 40GE optical modules.
A blade server consists of the mother

board and MZ card.
CH121 V3
CH121 Half-Width Computing Node
Front view Specification Description

Number of CPUs Two
CPU model Intel Xeon E5-2600 V3 （ 12 core ）
Memory slot 24 DDR3 DIMM slots (only 16 memory of 16 GB used)
Number of hard disks Two 2.5-inch 900 G hard disks or or 1.6 TB SSD
RAID supported Supports RAID 0 and RAID 1.
Axial view
PCIe slot expansion Mz312 and Mz712
Microsoft Windows Sever 2008/2012

Red Hat Enterprise Linux
OS supported SUSE Linux Enterprise Server
Citrix XenServer
VMware ESX
operating temperature 5°C to 40°C

Dimensions (H x W x D) 215 mm x 525 mm x 60.46 mm
CH121H V3 Half-Width Computing Node
Specification Description
Front view
Number of CPUs Two
Number of hard disks Two 2.5-inch 600 GB HDD disk

Axial view PCIe slot expansion Mz710 and Mz710

Citrix XenServer
VMware ESX
operating temperature 5°C to 40°C

Note: Compared with CH121 V3, CH121H V3 supports 10GE

onboard network adapters.
CH121H V3 Half-Width Computing Node (with Accelerator Card)
Item Specifications
Front view
Number of CPUs Two
Axial view Hardware accelerator card
Accelerator card
Citrix XenServer
VMware ESX
Operating temperature 5°C to 40°C
Note: Compared with CH121 V3, CH121H V3 supports 10GE

onboard network adapters.
CH121H V3 Half-Width Computing Node (high performace applications)
Item Specifications
Front view
Number of CPUs Two
Axial view Hardware accelerator card
Accelerator card
Citrix XenServer
VMware ESX
Operating temperature 5°C to 40°C
Note:
If blades with 22-core CPUs are used:
 1. Each CPU consumes 145 W power and a single E9000 chassis consumes up to 8800 W power. A cabinet with two chassis consumes up to 20000 W power.
 2. AC power supply of over 220V voltage is required. DC power supply cannot meet the 3+3 power supply needs.
 3. A single cabinet also supports two disk controller enclosures and two CE6851 switches, but does not support the standard 1+1 disk array configuration.
 Confirm with the customer about the equipment room cooling capability before deployment due to the high single-cabinet power consumption.
CH121 V5 Half-Width Control Node(14 Core)
Front view Item Specifications
Number of CPUs Two
CPU model Intel Xeon Gold 5120T-14core
Number of hard disks Two 2.5-inch 800 GB SAS SSD disk

Axial view
PCIe slot expansion 2*MZ710
SUSE Linux Enterprise Server
OS supported Citrix XenServer
VMware ESX
Operating temperature 5℃-40℃

Dimensions (H x W x D) 210 mm*537.2mm*60.46mm
CH121 V5 Half-Width Control Node(20 Core)
Number of CPUs Two
Number of hard disks Two 2.5-inch 800 GB SAS SSD disk

Axial view
VMware ESX

CH121 V5 Half-Width Computing Node(20 Core)
Number of CPUs Two
Number of hard disks Two 2.5-inch 600 GB SAS HDD disk

Axial view
VMware ESX

Page38
CH121 V5 Half-Width Computing Node(14 Core)
Number of CPUs Two
Number of hard disks Two 2.5-inch 600 GB SAS HDD disk

Axial view
VMware ESX

Page39
CH121 Half-Width Computing Node Application
Backplane
CX710 8*40GE
1E 40GE
switch
2X CX310
10GE 16x10GE
switch
2x10GE
1*40GE
Mezz 1
(MZ312)
CH121 V3 3X CX310
16x10GE
10GE
2x10GE switch
Mezz 2
（ MZ710)
4E
CX710
8*40GE
1*40GE 40GE
switch
The mother board is configured with different NICs for different switching rates.
CH121 Half-Width Computing Node Application(CX320)
背
板 CX710
8*40GE
1 40GE
E Switch
2 CX320
X 8*10GE
10GE
Switch
2*10GE
MEZZ1 1*40GE
(MZ312)
CH121 V3 3
X
CX320
8*10GE
10GE
2*10GE Switch
MEZZ2
（ MZ710)
1*40GE CX710
4 8*40GE
E 40GE
Switch
CH121H V3 Half-Width Computing Node Application
Backplane
背板
CX710 8*40GE
1
40GE
E
Switch
1*40GE CX920
2
X 10GE 8*10GE
1*10GE Switch
8*40GE
1*40GE 40GE
MEZZ1 Switch
(MZ710)
82599
(LOM) CX920
CH121H V3 1*10GE 10GE

Switch
8*10GE
3
1*40GE X 8*40GE
MEZZ2 40GE
（ MZ710) Switch
1*40GE
CX710 8*40GE
4
E 40GE
Switch
CH121 V5 Half-Width Computing Node Application
Backplane
背板
CX710 8*40GE
1
E 40GE
Switch
1*40GE CX920
2
X 10GE 8*10GE
1*10GE Switch
8*40GE
1*40GE 40GE
MEZZ1 Switch
(MZ710) PCH
(LOM) CX920
CH121 V5 1*10GE 10GE

Switch
8*10GE
3
1*40GE X 8*40GE
MEZZ2 40GE
（ MZ710) Switch
1*40GE
4 CX710
E 8*40GE
40GE
Switch
Optical Modules and Cables Supported By E9000
SFP/SFP+ port
Remarks: This page only lists the

supported types of optical ports and
cables. For details about actual port
GE SFP optical module 10GE SFP+ optical module FC SFP+ optical module 1000Base-T SFP
Optical fiber interface 10GE SFP+ DAC cable transceiver modules and cable
Optical fiber interface Optical fiber interface electrical module
Cables are delivered
RJ45 electrical ports codes, see the configuration
with interface
modules and the cable quotation tool. The number of
length is limited.
configured items depends on
customer requirements for
interconnection and must be
clarified to specific customers.
Category 5 twisted pair:
Optical fiber CAT5/CAT5e STP, RJ-45
QSFP/QSFP+ port RJ45 port
InfiniBand QDR QSFP or FDR QSFP+ cables

Cables are delivered with interface modules and InfiniBand QDR QSFP or FDR QSFP+ cables
the cable length is limited. Cables are delivered with port modules. Category 5 twisted pair: CAT5/CAT5e STP, RJ-45
System Networking – Rear Cable Routing for Easy Maintenance
Signaling Core
Listening Interworking Charging Maintenance access Signaling
network network network network network network
The cables for connecting Stacking

switching boards are routed Internal & external traffic and traffic of various services are
Storage iSCSI exchanged on the layer-2 network of the database center.
in a centralized manner for LSW 1 LSW 2
bandwidth sharing. The network is composed of external LAN switches for
network resource sharing. VLANs are logically isolated.
10GE Ethernet port or n x 10GE Ethernet trunks
Base + eFabric
Cabling of each subrack is

Switching board
Switching board homogeneous. Switching board
Switching board
eFabric
Base
…
Server
Interface Server
Interface
Interface Interface
Interface
board
board Interface
board
board
board
board board
board
• External networks and internal networks are connected to the TOR switch using the switch outbound interface. External and internal traffic
share the bandwidth of the outbound interface.
Agenda
Auxiliary CloudEdge Equipment – 5500 V3 Disk Array
Front panel
Specification Description Value
Dimension HxWxD 582.0 mm x 446.00 mm x 86.1mm
Rated AC input voltage range 100 V to 127 V or 200 V to 240 V
Maximum AC power consumption 718 W

1 Coffer disk label 2 Disk module handle Power supply
3 Disk module latch 4 Information plate (with ESN) Rated DC input voltage range –48V to –60V
5 ID display of the controller enclosure 6 Power indicator/Power button
Maximum DC power consumption 718 W

Rear panel
1 Power-BBU module 2 Power-BBU module handle

3 Power-BBU module latch 4 SmartIO port
5 Interface module handle 6 16 Gbit/s Fibre Channel port
7 Power socket 8 Serial port
9 Maintenance network port 10 Management network port
11 USB port 12 Mini SAS HD expansion port
13 Controller handle
Auxiliary CloudEdge Equipment – 5500 V5 Disk Array
Front panel
Maximum AC power consumption 629W

Power supply
Rated DC input voltage range –48V to –60V
Maximum DC power consumption 629 W
Rear panel
Auxiliary CloudEdge Equipment – 2U Disk Enclosure
Maximum AC power consumption 322.5 W

Power supply
Rated DC input voltage range –48V to –60V
Maximum DC power consumption 322.5 W
Auxiliary E9000 Equipment – CE6851/CE6855 Switch
Front panel
Specification Description
350 W DC
Power
600 AC
10GE ports: 48
Number of ports
40GE ports: 6
1, 2: Power module slot
3, 4: Fan slot Both AC and DC power supply modes are supported.
5: Console port Power supply
Power modules work in 1+1 backup mode.
6: Ethernet port
7: Electronic label (for querying the MAC address and serial No.) Power CE6851:245W(max)
8: USB port
consumption CE6855:216W(max)
• Supported modules and cables: 40GE optical module

• 10 m QSFP+AOC optical fiber (QSFP-QSFP+)
• 1 m, 3 m, and 5 m QSFP+ high-speed cable (QSFP-4xSFP+)
• 1 m, 3 m, and 5 m QSFP+ high-speed cable (QSFP-QSFP+)
9: 10GE or GE optical port

10: 40GE optical port
Agenda
1 E9000 Product Overview
4 E9000 Power Distribution Solution
Power Supply System in an Entire Equipment Room
Our concerns
Equipment room infrastructure
Concern 1: Concern 2:
Number of power distribution inputs Maximum power consumption of all
Voltage and current devices in an entire cabinet
Power generation Electrical substation PDB Cabinet assembly Power module

Power network PDF
IT PDU
E9000 Power Distribution
* 200 V to 219 V
2500 W
* 220 V to 248 V
3000 W
* C19
AC power module
DC power module
CloudEdge System Power Consumption Estimation
The following table describes typical power consumption and maximum power consumption of each board.
The total power consumption is the sum of the results of power consumption per device multiplied by device quantity.
Maximum power consumption:
3000 （ E9000 ） *6+245 （ CE6851 ） *2+718 （ 5500 V3 ） *2=19926W
Device Name Typical Power Maximum Power Quantity

Consumption Consumption
Server Fan module 15 15 14
CH121 board 320 400 16
CX310 100 112 2
CX710 150 180 2
CX920 150 180 2
CX320 118 142 2
Switch CE6851 168 245 2
Disk array 5500 V3 553 719 2
Auxiliary E9000 Cabinets
DC cabinet (1 m) AC cabinet (1 m) AC cabinet (1.2 m)
Two E9000 cabinets (AC cabinet and DC cabinet) in two

telecom equipment rooms are developed for the CloudEdge
solution.
PDB installation guides are customized for cabinets (1.2
m) in an IT equipment room.
DC Cabinet Power Distribution Solution – Introduction to PDB
 The PDB is installed on the top of a cabinet (the item marked 1 is 2 U PDB and that marked 2 is
4 U PDB in the left figure) to feed devices in the cabinet and provide single or combined
functions of power distribution, control, protection, and detection. A PDB is classified by
functional module and includes the components shown in the following figure.
Introduction to PDB – DPD80-16-16 Electrical Connection Diagram
 DPD80-16-16 is a DC PDB (4 U) supporting a maximum of 16 inputs and 16 outputs.

The highest single input is 80 A and used to feed F8000 subracks.
 DPD80-16-16 DC PDB supports two input modes: dual 8-way 80 A inputs and dual 4-
way 100 A inputs (maximum specifications).
 Mode 1: Uses dual 8-way inputs with a maximum of 80 A for each input. Area A (A1
to A8) and area B (B1 to B8) of the PDB are two independent areas and use 1+1
backup power supply. In this case, each input supports a maximum current of 80 A,
and each output and input are mapped, that is, the input ends A[n] and B[n]
correspond to output SW[n] (n ranges from 1 to 8).
 Mode 2: Uses dual 4-way inputs with a maximum of 100 A for each input. In this
mode, two adjacent input terminals can be connected using dedicated short-circuiting
copper bars. During actual use, dual 8-way inputs can be used with short-circuiting of
different combinations as required. Dual 8-way input terminals can be split into dual
4-way inputs (A1/A2, A3/A4, A5/A6, A7/A8, B1/B2, B3/B4, B5/B6, and B7/B8),
with each input corresponding to two outputs.
DC Cabinet Power Distribution Solution: Introduction to PDB – DPD
80-16-16 Front View
Component Quantity Description
Connects input power cables and provides transparent

Input terminal 32
protection covers for input terminal blocks.
Specifies whether the PDB emits alarm tones when an

alarm is generated.
The buzzer switch is turned off by default.
Buzzer switch 1 When the buzzer switch is turned on, the buzzer emits a
sound if the PDB generates an alarm.
When the buzzer switch is turned off, the buzzer does
Identifier Status Description not emit any sound if the PDB generates an alarm.
The RUN indicator blinks
green slowly, at the frequency
The PDB is working properly.
of 0.5 Hz (on for one second
and off for one second).
Protects an electrical circuit from damage caused by a
The RUN indicator blinks current overload or short circuit. When a current
RUN green quickly, at the
frequency of 4 Hz (on for
The PDB and main control board overload or short circuit occurs, the circuit breaker
are not communicating properly. switches from ON to OFF.
0.125 second and off for
0.125 second). When a circuit breaker is set to ON, the breaker is
Alarm indicator Circuit breaker 16
The power input is unavailable or
connected.
Steady off When a circuit breaker is set to OFF, the breaker is
Buzzer switch
the indicator is faulty.
disconnected.
An alarm is generated and the
Steady red
PDB is faulty.
Generally, circuit breakers are not installed on PDBs.
ALM Users can install circuit breakers as required.
Steady off The PDB is working properly.
DC Cabinet Power Distribution Solution: DPD80-16-16 Rear View
Output terminal 32 Uses the OT terminal and connects to the output power cable.
Provides two groups of signals for active and standby RS485 serial
ports, respectively.
Used for communicating with the main control board and reporting
related values about the PDB status to the main control board. DB15
DB15 serial port 1
ports are used.
Functions as the cascading port. For example, to cascade two PDBs, the
Area A DB15 serial port on one PDB must be connected to the RJ45 serial port
Area B
on the other PDB.
J1 is the active RS485 serial port, and J2 is the standby RS485 serial
port.
Used for communicating with the main control board and reporting the
related values about the status of the PDB to the main control board.
RJ45 serial port. 2
RJ45 ports are used.
DB15 serial port on one PDB must be connected to the RJ45 serial port
on the other PDB.
Small 4-pin ports are used.

External Boolean
Ports J3, J4, and J6 are connected to Boolean sensors, such as the door
signal ports J3, J4,
status sensor and the smoke sensor.
J5, and J6
Port J5 is connected to the water sensor.
DC Cabinet Power Distribution Solution: Introduction to PDB –D
PD80-16-16 Parallel Connection
 Connect external input power cables to the left side, and use a plastic cover on the other side to prevent incorrect
connection. In this case, the maximum current of each short circuit input is 100 A and the total current of the corresponding
outputs cannot exceed 100 A.
DC Cabinet Power Distribution Solution ： Introduction to PDB – D
PD100-2-20 Electrical Connection
 DPD100-2-20 is a DC PDB (2 U) supporting a maximum of two inputs and 20
outputs. The highest single input is 100 A and the PDB is used to feed devices except
for E9000 in the cabinet.
 The PDB receives two –48 V DC inputs, with one for area A and the other for area B.
The total output currents in each area cannot exceed 100 A.
 Areas A and B of the PDB are two independent areas using different inputs and
cooperate to feed devices in the cabinet and to provide 1+1 power supply backup.
 Branch switches SW1 to SW8 in areas A and B control the power supply. The branch
switches are electromagnetic circuit breakers and provide overcurrent protection.
 Position of circuit breakers: for outputs 1 and 2, each output supports a maximum of
50 A. For outputs 3 and 4, each output supports a maximum of 32 A. For outputs 5 to
10, each output supports a maximum of 15 A. (Maximum configuration indicates that
the internal cable current-carrying capacity is designed based on the maximum
current.)
DC Cabinet Power Distribution Solution: DPD100-2-20 Front View
Quan
Component Description
tity
Specifies whether the PDB emits alarm tones

when an alarm is generated.
The buzzer switch is turned off by default.
When the buzzer switch is turned on, the buzzer
Buzzer switch 1
emits a sound if the PDB generates an alarm.
Identifier Status Description
When the buzzer switch is turned off, the buzzer
does not emit any sound if the PDB generates an
The RUN indicator blinks green alarm.
slowly, at the frequency of 0.5 Hz The PDB is working
(on for one second and off for one properly.
second).
Protects an electrical circuit from damage caused

The RUN indicator blinks green
RUN
quickly, at the frequency of 4 Hz (on
The PDB and main control by a current overload or short circuit. When a
board are not
for 0.125 second and off for 0.125
communicating properly.
current overload or short circuit occurs, the
Running indicator second). circuit breaker switches from ON to OFF.
When a circuit breaker is set to ON, the breaker
Alarm indicator The power input is
Steady off unavailable or the indicator
Circuit breaker 20 is connected.
is faulty. When a circuit breaker is set to OFF, the breaker
Buzzer switch
is disconnected.
Steady red
An alarm is generated and Generally, circuit breakers are not installed on
the PDB is faulty.
ALM
PDBs. Users can install circuit breakers as
The PDB is working
required.
Steady off
properly.
DC Cabinet Power Distribution Solution: DPD100-2-20 Rear View
Input terminal 4 Supports two inputs and connects to the input power cable.
Supports dual 10-way outputs, connects to the output power cable, and
Output terminal 20
uses cord end terminals.
Provides two groups of signals for active and standby RS485 serial ports,
respectively.
Used for communicating with the main control board and reporting
related values about the PDB status to the main control board. DB15
DB15 serial port 1
ports are used.
on the other PDB.
J1 is the active RS485 serial port, and J2 is the standby RS485 serial port.
Used for communicating with the main control board and reporting the
related values about the status of the PDB to the main control board.
RJ45 serial port. 2
RJ45 ports are used.
on the other PDB.
Small 4-pin ports are used.

External Boolean
Ports J3, J4, and J6 are connected to Boolean sensors, such as the door
signal ports J3, J4,
status sensor and the smoke sensor.
J5, and J6
Port J5 is connected to the water sensor.
DC Cabinet Power Distribution Solution
If an E9000 cabinet is initially configured with one subrack, the number of initial inputs in the cabinet can be reduced. You can increase
power inputs during future capacity expansion.
63 A power distribution solution

(default configuration) 1. If 63 A power inputs are
provided onsite, an E9000
1. If 63 A power inputs can cabinet requires dual 7-way
be provided onsite, dual 4- (63 A) inputs.
way 63 A inputs are 2. Dual 7-way (63 A) inputs are
required for an E9000 connected to PDB 2 on the
cabinet. cabinet, and feed two E9000
2. Dual 4-way 63 A inputs subracks, which means that
are connected to PDB 2 on each dual 3-way (63 A) input
the cabinet and feed an supports one E9000 subrack.
E9000 subrack. 3. PDB 1 feeds two CE6851
3. PDB 1 feeds two CE6851 switches and two S5500 V3
switches and two S5500 disk arrays.
V3 disk arrays.
AC Cabinet Power Distribution Solution: Introduction to PDB –
APD32-6-24 Electrical Connection
 APD32-6-24 AC PDB (3 U) supports dual 3-way single-phase AC inputs by
default, with a maximum current of 32 A for each input. Output terminals are
divided into two groups (A and B) of redundant dual 12-way outputs to feed
internal devices in the cabinet.
 APD32-6-24 AC PDB is configured with dedicated input short-circuiting bars,
using which input short-circuit can be implemented, supporting multiple input
modes.
 Areas A and B of the PDB are two independent areas using different inputs
and cooperate to feed devices in the cabinet and to provide 1+1 power supply
backup. The left figure shows only one area.
 Branch switches SW1 to SW12 in areas A and B control the power supply.
The branch switches are electromagnetic circuit breakers and provide
overcurrent protection. The default configuration for each circuit breaker is 16
A.
AC Cabinet Power Distribution Solution: APD32-6-24 Front View
Protects an electrical circuit from damage caused by a

current overload or short circuit. When a current
overload or short circuit occurs, the circuit breaker
switches from ON to OFF.
When a circuit breaker is set to ON, the breaker is
connected.
Circuit breaker 24 When a circuit breaker is set to OFF, the breaker is
disconnected.
The 24 circuit breakers are divided into groups A and

B. Each group contains 12 circuit breakers numbered
from SW1 to SW12 from left to right. Each group of
12-way circuit breakers are marked 16 A.
AC Cabinet Power Distribution Solution: DPD100-6-20 Rear View
Input Input
Area B Area A
Connects to the input power cable.
18
Supports dual 3-way inputs by default. Input short-
(L, N, and PE
Input terminal circuit can be achieved using dedicated short-
terminals for each
circuiting bars, supporting dual 2-way or dual-way
input) x 6
inputs.
Output Output Connects to the output power cable.
24 (each terminal
Output terminal Supports dual 12-way outputs, with a maximum
Area B Area A contains L, N, and PE)
current of 16 A for each output.
An APD32-6-24 AC PDB does not provide

the power monitoring function. You can
lead power to a third-party monitoring
device using output terminals.
AC Cabinet Power Distribution Solution: Introduction to PDB –A
PD32-6-24 Parallel Input Connection
Power Input Connection Mapping Between Input and Output Remarks
Position for binding Input terminal short-circuiting not required

short-circuit Dual 3-way Three L cables are connected to L1, L2, and L3. Input 1 maps outputs SW1 to SW4. Default
single-phase Three N cables are connected to N1, N2, and N3. Input 2 maps outputs SW5 to SW8. connection
connectors: PDB AC input Three PE cables are connected to PE1, PE2, and Input 3 maps outputs SW9 to SW12. upon delivery
side wall PE3.
L2 and L3 are short-circuited.

N2 and N3 are short-circuited.
Two L cables are connected to L1 and L2, Onsite
Dual 2-way
respectively. Input 1 maps outputs SW1 to SW4. selectable
single-phase
Two N cables are connected to N1 and N2, Input 2 maps outputs SW5 to SW12. connection
AC input
respectively. mode
Short-circuit Two PE cables are connected to PE1 and PE2,
connectors: respectively.
2PIN x 4
Terminals L1, L2, and L3 are short-circuited.
3PIN x 4 Onsite
Dual-way Terminal N1, N2, and N3 are short-circuited.
selectable
single-phase One input L cable is connected to L2. Input 2 maps outputs SW1 to SW12.
connection
AC input One N cable is connected to N2.
mode
One PE cable is connected to PE2.
Short-circuiting: Only N1, N2, and N3 terminals are short-

circuited. Onsite
Short-circuit Dual-way
Three input L cables are connected to L1, L2,
Input 1 maps outputs SW1 to SW4.
selectable
three-phase Input 2 maps outputs SW5 to SW8.
connectors are used AC input
and L3, respectively.
Input 3 maps outputs SW9 to SW12.
connection
One N cable is connected to N2. mode
in an input terminal. One PE cable is connected to PE2.
AC Cabinet Power Distribution Solution
An E9000 IT cabinet can be configured with a maximum of two subracks. You are advised to distribute power based on the maximum power
configuration. Considering the number of available power inputs and current situation of each input, typical power distribution solutions are
recommended.
1. Dual 2-way inputs (220

1. Dual 3-way inputs (220 V, 32 A) are connected to
V, 32 A) are connected to the PDB.
the PDB. 2. Each input corresponds
2. Each input corresponds to four outputs. There are
to four outputs. There are 16 outputs (8+8) in total.
24 outputs (12+12) in These inputs feed two
total. These inputs feed E9000 subracks, two
two E9000 subracks, two CE6851 switches, and
CE6851 switches, and two S5500 V3 disk
two S5500 V3 disk arrays.
arrays.
AC Cabinet Power Distribution Solution: IT Scenario
In an IT equipment room where the PDU supplies power, the power distribution mode is the same for one cabinet with one
subrack and one cabinet with two subracks.
Power distribution principles ：

1. An E9000 IT cabinet can be
configured with a maximum of
two subracks. You are advised to
distribute power based on the
maximum power configuration.
Dual -way AC inputs (32 A,
380 V) are provided onsite.
2. Two PDUs (02120644) feed two
E9000 subracks, two CE6851
switches, and two S5500 V3 disk
arrays.
Thank you
www.huawei.com

CloudEdge V100R018C10 Hardware System (E9000) Training Slides-B-V1.0 - OK

Uploaded by

Document Information

Original Title

Copyright

Available Formats

Share this document

Share or Embed Document

Sharing Options

Did you find this document useful?

Is this content inappropriate?

Copyright:

Available Formats

CloudEdge V100R018C10 Hardware System (E9000) Training Slides-B-V1.0 - OK

Uploaded by

Copyright:

Available Formats

CloudEdge

Author/ Email: huangting (employee ID: 00418852)

Copyright © 2017 Huawei Technologies Co., Ltd. All rights reserved.

1 Overview of CloudEdge Hardware System

2 E9000 Hardware System Architecture

3 Introduction to E9000 Boards

4 Introduction to CloudEdge Auxiliary Equipment

5 Introduction to CloudEdge Cabinet Power Distribution Solutions

U2000  MANO: lifecycle management software of the Huawei

U2000 Web LMT CHR tool CloudEdge client

MANO vUSN vUGW vCG

 Two E9000 subracks in a cabinet are interconnected using

Hardware configuration of CloudEdge solution:

1 Overview of CloudEdge Hardware System

2 E9000 Hardware System Architecture

3 Introduction to E9000 Boards

4 Introduction to CloudEdge Auxiliary Equipment

5 Introduction to CloudEdge Cabinet Power Distribution Solutions

A full-width CH222 board is equipped with 15 built-in 2.5-inch hard disks.

•5°C to 40°C installed in typical data equipment rooms

•Power module operating temperature: installed in IT equipment rooms

•Fan module operating temperature:

6 Slot heat dissipation

Configuration Configuration binding

Configuration Configuration migration

Engineering Power supply and heat dissipation capabilities

1200 W/100 W 1200 W/100 W 1400 W/280 W 1400 W/280 W

Number of 2.5-inch HDDs in a single slot 12 12 4 15

10GE/FCoE/8G FC/IB port switching Y Y Y Y

* All data is stored in the FC SAN or IP SAN.

High-performance computing application scenario IT application scenario

Half-width slot Fan 1E 4E

Slot numbers of half-width slots Slot numbers of full-width slots

A front slot can be configured with 16 half-width or 8 full-width computing nodes.

Main features of the chassis screen:

 Querying subrack information, such as the position and name

Item Specification Item Specification

* The E9000 subrack uses rear ventilation.

 Each computing module has two groups of SerDes connected to

depend on the configured switch module.

The management module provides centralized out-of- Server1 BMC PWR 3

of-band management of the front slots and switching slots. FAN 13

management modules and switch modules. I2C bus

External management port

Power supply line 1 Power supply line 2

PWR PWR PWR PWR PWR PWR

Channel combination on the backplane

* The power supply system provides AC and DC power modules.

1 Overview of CloudEdge Hardware System

2 E9000 Hardware System Architecture

3 Introduction to E9000 Boards

4 Introduction to CloudEdge Auxiliary Equipment

5 Introduction to CloudEdge Cabinet Power Distribution Solutions

MM910 10G/40G switchin

Component Model Description

Switching board CX320 10GE/40GE converged switching module

 Delivers KVM Over IP and centralized KVM

2 40GE ports for interconnections on the 40GE switching plane

MZ312: dual-chip Ethernet card module with four ports,

A blade server consists of the mother

Front view Specification Description

Memory slot 24 DDR3 DIMM slots (only 16 memory of 16 GB used)

Microsoft Windows Sever 2008/2012