Xfusion Server v7

You might also like

Download as pdf or txt
Download as pdf or txt
You are on page 1of 46

New-Generation FusionServer V7

Provide Ultimate Performance Experience for Customers


Hardware Upgrade Software Upgrade

CPU Upgrade for Higher Performance BMC System Upgrade


50% increase in the maximum number of cores, and 35%+ BMC software security certified by CC EAL4+, ensuring a
higher computing performance securer system

Memory Upgrade for Faster Speed BIOS System Upgrade


DDR4 upgraded to DDR5, increasing the speed by 50% 25% faster system boot speed compared with the previous
generation and faster recovery of services after the system restart

PCIe Upgrade for Higher Bandwidth Cluster Management Software Upgrade


PCIe 4.0 upgraded to 5.0, improving the bandwidth by 100% Third-party server management, supporting online O&M
and supporting PCIe 5.0 GPU cards and NVMe devices and mobile O&M
FusionServer V7 Intelligent Servers
of All Series
FusionServer V7 Series Products

Have Been Ranked No. 1 in Multiple Tests


No. 1 in No. 1 in No. 1 in No. 1 in No. 1 in
CPU Performance Power Efficiency Virtualization Performance HPC Performance AI Performance
1100 18000 520000
62 0.016

900 500000 60
0.012
58
700 14000 480000
0.008
56
500 460000
54 0.004

300 10000 440000


52 0
2S Int-rate 2S fp-rate Power efficiency scores max-jOPS
OMP ResNet RNN-T
xFusion Vender A xFusion Vender A
xFusion Vender A xFusion Vender A xFusion Vender A

Leading the 2nd one Leading the 2nd one Leading the 2nd one Leading the 2nd one Leading the 2nd one

6.7% 8% 7.9% 9.1% 15.8%


*: Based on the ranking testing data of the FusionServer V7 servers released by SPEC on January 11, 2023
**: Based on the ranking testing data of the G5500 8 x A30 GPUs released by MLPerf on November 9, 2022.
New-Generation FusionServer V7
Certified by International Authorities in
Respect of Energy Saving, Security, and
Reliability
World's first
World's only World's first World's first World's first
Authoritative security
security test Intertek carbon footprint TÜV Rheinland TÜV SÜD energy
certification in the financial
CC EAL4+ certification reliability certification efficiency certification
payment industry

The first CC EAL4+ security test of Reducing carbon emissions by 7% Liquid-cooled rack-scale servers, Liquid cooling PUE World's first x86 server that complies
x86 servers (EM2) compared with the previous generation which is valid for 10 years pPUE < 1.06 with the PCI DSS 4.0 security
standards
Exclusive Patented Technologies, Helping Enterprises Save Energy and Reduce Emissions

Under the same configuration and workload,


MPC+PID speed regulation energy savings up to 8%
technology
• Dynamic power consumption adjustment by AI Virtual sensor technology
algorithms, finding the lowest power consumption
point of servers via the CPU leakage current and fan • High-precision virtual temperature sensors by AI algorithms,
power consumption fully covering the areas for heat dissipation and speed
adjustment
Efficient VRD energy saving Intelligent voltage adjustment
technology technology
No.1 in SPEC power efficiency • Component voltage adjustment is in multi-level
• DrMOS technology
linkage, reducing conversion path loss.
• Energy saving based on the automatic 20000
phase adjustment through load sensing
16000 Processor DEMT technology
Light-load and efficient PSU 12000 • DEMT, enabling dynamic power
technology adjustment for processors
8000
• Processors hibernation when they are
• Bridgeless PFC technology, unique
idle
(ultra-Titanium) PSUs certified by the 4000
CQC level 6, leading ahead for over one
year in the mainstream industry 0
• Dynamic inductance adjustment Energy efficiency score
technology
xFusion Vendor A

According to statistics, the customer with 12,000 servers that are under 50% load can save USD 1,000,000 a year on electricity bills.

7
Self-Developed PSUs: Three Core Technologies for Safe and Efficient Operations

① Power density 15% ② Power loss 12.5% ③ Power failure rate 50%
higher than industry lower than industry low than industry

Power density 15% higher


Advanced engineering technology
110
104
105 Efficiency
100
Efficient topology, professional magnetic
95 90
90 design, and advanced technology
85
80
Industry xFusion

Loss rate 12.5% lower


4.5%
Multiphase 4%
Bridgeless PFC magnetics Gallium nitride 4.0% 3.50
integration %
High conversion Higher efficiency
High power density 3.5%
efficiency Higher density
Reliability Intelligence
3.0%
Industry xFusion Simulation analysis; over 1,000 Intelligent management;
professional tests black box

8
Built-In AI Technology and Intelligent Management Software Accelerate Evolution to Data
Centers with Unmanned O&M

AI-Powered Memory Fault Self-Healing Technology


• Millions of samples for cloud training, local real-time inference, FusionDirector
and self-recovery without disrupting services
• System downtime 66% lower than the industry average
BMC

AI-Powered Patented Drive Fault Prediction Technology


• AI drive fault prediction, predicting risky drives 7 to 30 days in
advance
• Slow drive fault prediction 5 minutes in advance, ensuring no
+ Intelligent management
software

Five intelligent technologies 2.0


impact on services Intelligent deployment, O&M,
upgrade, energy saving, and asset
management
AI-Powered FDM Fault Diagnosis Technology
• Up to 96% system fault diagnosis accuracy
• Fast root cause location of faults caused by the CPU, memory,
or OS for restoring services

9
Intelligent Memory Fault Recovery, Reducing the Failure Rate by 66%

4. FusionDirector
• Memory faults disrupt services but cannot be avoided.
Other: result display
39% Memory: • Memory failures account for 61% system crash.
61%
• Memory faults can only be repaired manually. Inference results

Memory status data

AI-Powered Memory Fault Self-Healing Technology


1. Big data training 2. Fault inference 3. Fault self-healing
platform module module
Data created Breakdown rate
5 million+ Hard isolation
O&M equipment
1 million+
Cloud-based big
data training
platform
Fault model AI fault
inference
module
Inference results
Soft isolation 66 %
O&M DIMMs
10 million+ Fault warning

Local real-time Self-healing without


Cloud training
inference disrupting services

Millions of training samples Continuous self-optimization Soft/Hard isolation and repair

10
AI-based Drive Fault Prediction, Providing More Secure Data

Predicting risky drives 7 to 30 days in advance

Real-time Accurate Reliable Efficient


Inference of drive data Forecast accuracy ≥ 90 Simultaneous failure rate Manpower problem locating
reduction of multiple drives reduction by 90%

FusionDirector
local inference

3 Inference results
Inference Drive status
model data

Latest inference Real-time data


model collection

1 Fault 2 HDD/SSD
running data
feature Drive status
Real-time
model data
Millions of drive data Real-time
Massive samples updated fault
Model training diagnosis
continuously iBMC
Self-evolution

Cloud FusionServer Service devices on the live


data lake network

11
AI-powered FDM Intelligent Fault Diagnosis, with a Fault Diagnosis Rate of 96%

All parts monitoring Expert diagnosis and warning library


1. Health status monitoring of all out-of-band hardware 1. BMC automatic fault data collection
components and sensors 2. Over 20 years experience in x86 servers; expert library analysis
2. In-band and out-of-band data links, data detection between and matching fault
normal and abnormal OSs, and full status monitoring 3. Intelligent management chip for the fault analysis and diagnoses

CPU CPU System normal In-band


collection
In-band data detection Original data
Information
receiving
Mainboard, Failure Out-of-band
PCIe
board-level
power supply,
iBMC occurrence collection
System crash
link, PSU, and Management
fan
chip
Out-of-band data detection Parsing data
Parsing Diagnosis
expert
Memory library

module Output
Storage
Pre-
warning
expert
library
Logical diagram of Logical diagram of fault
information collection locating

12
FusionServer V7 Server Family Builds System-Level Competitive Advantages

General-purpose rack servers High-density servers GPU Server

• Balance: 1288H V7/2288 V7/2288H V7 • X6000 V7 • Entry-level: 2288H V7


• High performance: 2488H V7/5885H V7 • Node: XH321 V7 • Storage: G5200 V7
• Storage: 5288 V7 • Node: XH321E V7 • Mainstream: G5500 V7
• Flagship: G8600 V7/G8600E V7

13
Server Height

5288 V7 5885H V7
4U
Ultra-large storage High Performance and
Video analysis Scalability

More storage 2288H V7 2488H V7 X6000 V7


More expandability 2U 2288 V7 High Performance Peerless Computing
Flexible Big Memory Power Density

1288H V7
1U
High-Density

2 CPUs 4 CPUs 8 CPUs Number of Processors

More computing power


FusionServer 1288H V7: Supreme Computing Power and High-Density Flexible Deployment

• Virtualization
• Cloud computing
• Big data
• Distributed storage
• IT core business

High reliability Ultimate performance Flexible expansion Unique value

• Carrier-class component • 2 x 4th Gen Intel® Xeon® Scalable • 2 x hot-swappable OCP 3.0 NICs • FDM technology, patented fault
diagnosis and management technology,
specifications and 100% derating Processors (Sapphire Rapids), up to
• 3 x standard PCIe slots, 2 of which with fault locating accuracy up to 96%
design 120 x compute cores, with TDP up to
support PCIe 5.0 • Intelligent drive fault prediction,
350 W per processor
• Redundancy design: 2 x PSUs in • 2 x M.2 SSD cards, supporting hot
predicting risky drives 7 to 30 days in
1+1 redundancy and 8 x hot- • 32 x DDR5 DIMMs, up to 4800 MT/s, advance
swap and hardware RAID
swappable counter-rotating fan delivering up to 8 TB memory • Intelligent energy saving, saving 8%
• 8 x hot-swappable counter-rotating more power than the industry average
modules in N+1 redundancy capacity
fan modules in N+1 redundancy • Intelligent memory fault self-recovery,
• Up to 10 x NVMe SSDs
reducing downtime by 66%
• 2 x PSUs in 1+1 redundancy
• Up to 32 x E1.s drives • Five intelligent technologies,
improving O&M efficiency by 30%

15
1288H V7 Architecture

32 x 4800 MT/s 2-socket scalable processors


DDR5 DIMMs with TDP up to 350 W

1 x PCIe x16 half-height slot 4 x 3.5" SAS/SATA drives

2 x PCIe x16 slots


(1 full-height and 1 half-height) 8 x 2.5" SAS/SATA drives

10 x 2.5" SAS/SATA drives

Management 10 x 2.5" drives (2 to 4 x NVMe SSD


network port, drives and 6 to 8 x SAS/SATA drives)
serial port

10 x 2.5" NVMe drives


FlexIO slot 1 FlexIO slot 2 8 x hot-swappable counter-rotating
(supports OCP3.0 NIC) (supports OCP3.0 NIC) fan modules in N+1 redundancy mode
32 x E1.s drives

PSUs in 1+1 redundancy

16
FusionServer 2288H V7: Adapting to Multiple Loads with Ultimate Performance and Flexible
Configuration

• Core IT business
• Cloud computing
• Virtualization
• Distributed storage
• Big data analysis
• AI inference or training

Ultra-large Storage Supreme compute power Flexible configuration Intelligent management

• Up to 45 x 2.5" drives or 34 x • 2 x 4th Gen Intel® Xeon® Scalable • 2 x hot-swappable OCP 3.0 NICs • FDM technology, patented fault
diagnosis and management technology,
NVMe U.2 or 36 x E1.s drives, Processors (Sapphire Rapids), up to
• Up to 17 x standard PCIe slots and with fault locating accuracy up to 96%
meeting high-capacity storage 120 x compute cores, with TDP up to
14 PCIe 5.0 slots • Intelligent drive fault prediction,
requirements 350 W per processor
predicting risky drives 7 to 30 days in
• 2 x M.2 SSD cards, supporting hot
• 32 x 4800 MT/s DDR5 RDIMMs • 4 x 300 W full-height full-length advance
swap and hardware RAID
and 16 x DDR5 or DDR4 DIMMs (FHFL) dual-width GPU accelerator • Intelligent energy saving, saving 8%
• 2 x 3000 W PSUs in 1+1 more power than the industry average
supported by the CXL technology; cards or 14 x half-height half-length
redundancy • Intelligent memory fault self-recovery,
up to 48 x DIMMs delivering up to (HHHL) GPU accelerator cards,
reducing downtime by 66%
12 TB memory capacity providing super heterogeneous • 4 x hot-swappable counter-rotating
computing power fan modules in N+1 redundancy • Five intelligent technologies,
improving O&M efficiency by 30%

17
8 x 2.5" SAS/SATA drives
2288H V7-HE Architecture
8 x 3.5" SAS/SATA drives

8 x full-height PCIe slots Drive box, hosting up to 4 x 3.5" or 10


x 2.5" SAS/SATA drives
(2 x PCIe 5.0 x16 slots + 2 x PCIe 4.0 x16
slots + 4 x PCIe 4.0 x8 slots) 12 x 3.5" SAS/SATA drives

32 x 4800 MT/s 2-socket scalable


DDR5 DIMMs processors with TDP
up to 350 W 12 x 3.5" drives (8 x SAS/SATA + 4 x SAS/SATA/NVMe)

12 x 2.5" drives (4 x SAS/SATA + 8 x NVMe)

Management network
24 x 2.5" drives (8 x SAS/SATA + 16 x NVMe)
port, serial port

FlexIO slot 1, supporting FlexIO slot 2, supporting


an OCP 3.0 NIC an OCP 3.0 NIC 24 x 2.5" NVMe drives

Rear board configured with 4 x FHFL dual-width 24 x 2.5" SAS/SATA drives


GPU cards

25 x 2.5" SAS/SATA drives

4 x hot-swappable counter-rotating fan


3000 W PSUs in 1+1 redundancy modules in N+1 redundancy
36 x E1.s drives

18
2288H V7 Specifications

Stronger computing power


• 120-core general computing power

Larger storage • 4 x 300 W FHFL dual-width GPUs


• 14 x HHHL single-width GPUs
• Up to 45 x 2.5" drives
• Up to 34 x NVMe SSDs
• Up to 36 x E1.s drives
• Up to 12 TB memory capacity

Flexible configuration
• 2 x hot-swappable OCP 3.0 NICs
• Up to 17 x standard PCIe slots and 14
x PCIe 5.0 slots
• 2 x M.2 SSDs, supporting hot swap
• Patented design, and hardware RAID
hot-swappable drives
• 2 x 3000 W PSUs in 1+1 redundancy

19
2288 V7 (16 DIMMs) Architecture

16 x 4800 MT/s Built-in RAID 2-socket scalable processors


DDR5 DIMMs controller card with TDP up to 225 W
1 x PCIe 4.0 x16 slot 8 x 2.5" SAS/SATA drives
or 2 x PCIe 4.0 x8 half-height
2 x 3.5" or 2 x 2.5" slots
SAS/SATA drives or 4 x 2.5" SAS/SATA/
NVMe drives

4 x PCIe 4.0 x16 half- 12 x 3.5" SAS/SATA drives


height slots

12 x 3.5" drives (8 x SAS/SATA + 4 x SAS/SATA/NVMe)

Management network 25 x 2.5" SAS/SATA drives


port, serial port

FlexIO card
OCP 3.0 NIC

2000 W PSUs in 1+1 redundancy 4 x hot-swappable counter-rotating fan modules in N+1 redundancy

20
FusionServer 5288 V7: Providing Warm and Cold Storage for Video Analysis Server

• Layered deployment for


warm and cold storage
• Cloud storage
• Big data

Ultra-large local storage Supreme video analysis storage Flexible configuration Intelligent management

• Hybrid storage architecture and • 2 x 4th Gen Intel® Xeon® Scalable • 2 x hot-swappable OCP 3.0 NICs • FDM technology, patented fault
diagnosis and management technology,
tiered data storage Processors (Sapphire Rapids), up to • 10 x PCIe slots, supporting PCIe 5.0 with fault locating accuracy up to 96%
120 x compute cores, with TDP up to
• Up to 44 x 3.5" drives for warm • 2 x M.2 SSDs, supporting hot swap • Intelligent drive fault prediction,
350 W per processor
and cold data storage and 8 x predicting risky drives 7 to 30 days in
and hardware RAID
2.5" NVMe SSDs for high-speed • 10 x HHHL GPU accelerator cards advance
• 2 x 3000 W PSUs in 1+1
storage and 36 x 3.5" drives that meet • Intelligent energy saving, saving 8%
redundancy more power than the industry average
requirements for video analysis and
• 32 x DDR5 DIMM slots, delivering
large-capacity storage • 4 x hot-swappable fan modules in • Intelligent memory fault self-recovery,
up to 8 TB memory capacity reducing downtime by 66%
N+1 redundancy
• Five intelligent technologies,
improving O&M efficiency by 30%

21
5288 V7 Architecture

Drive box, hosting up to


4 x 3.5"SAS/STA drives
8 x full-height PCIe slots
6 x PCIe 4.0 x8 slots + 2 x PCIe 5.0 x16 slots (slot 1 and slot 4) 32 x 4800 MT/s
2-socket scalable processors
DDR4 DIMMs
with TDP up to 350 W

24 x 3.5" SAS/SATA drives

Management network
port, serial port

FlexIO slot 1, supporting FlexIO slot 2, supporting


an OCP 3.0 NIC an OCP 3.0 NIC

4 x 2.5" rear NVMe SSDs

3000 W PSUs in 1+1 redundancy 4 x hot-swappable fans in N + 1 redundancy

22 12 x 3.5" rear SAS/SATA drives


FusionServer 2488H V7: Mission-Critical Servers with High Stability and Reliability

• Virtualization
• Cloud computing
• HPC
• Database
• In-memory database (SAP HANA)
• AI reasoning and training

High reliability Ultimate performance Unique value Innovative design

• Carrier-class component • 4 x 4th Gen Intel® Xeon® Scalable • FDM technology, patented fault • Up to 11 x PCIe slots, including 1 x
specifications and 100% derating Processors (Sapphire Rapids), up to diagnosis management, with the fault hot-swappable standard OCP 3.0 NIC
design 240 x compute cores, with TDP up to locating accuracy of 96% and
• 25 x 2.5" SAS/SATA drives and up to
350 W per processor prediction of 7 to 30 days in advance
• PSUs in 1+1 redundancy and fan 8 x NVMe SSDs
to reduce the OPEX
modules in N+1 redundancy • 64 x DDR5 DIMMs, up to 4800 MT/s, • Type-C access to iBMC for agile O&M
delivering up to 16 TB memory • Intelligent energy saving, saving 8%
capacity more power than the industry average

• Up to 8 x NVMe SSDs • Boot acceleration storage


technology (BSST), with 2 x M.2
SSDs for high-speed OS boot,
supporting hot swap and hard RAID

23
2488H V7 Architecture

2 x PCIe 4.0 x16 full-height slots 4 x SPR Intel® Xeon® Scalable processors
8 x 2.5" SAS/SATA drives
+ 1 x PCIe 5.0 x16 full-height slot with TDP up to 350 W

3 x PCIe 4.0 x8 half-height slots

2 x PCIe 4.0 x16 full-height slots


+ 1 x PCIe 5.0 x16 full-height slot

4 x 2.5" SAS/SATA drives + 8 x 2.5" NVMe drives

1 x standard OCP 3.0 NIC 1 x serial port, management


supporting hot swap network port, and VGA port, 25 x 2.5" SAS/SATA drives
and 2 x USB 3.0 ports

2 x hot-swappable PSUs 6 x hot-swappable fan modules


in 1+1 redundancy in N+1 redundancy

64 x 4800 MT/s DDR5 DIMMs, delivering up


to 16 TB memory capacity

24
5885H V7: High Performance and Scalability

• Virtualization
• Cloud computing
• High-performance
computing (HPC)
• Database
• AI inference or training

High reliability Ultimate performance Unique value Innovative design

• Carrier-class component • 4 x 4th Gen Intel® Xeon® Scalable • FDM technology, patented fault • 21 x standard PCIe slots, the most in
specifications and 100% derating Processors (Sapphire Rapids), up to diagnosis management, with the fault the industry for diverse applications
design 240 x compute cores, with TDP up to locating accuracy of 96% and
• Up to 52 x 2.5" drives, meeting high-
350 W per processor prediction of 7 to 30 days in advance
• PSUs in 1+1 redundancy and fan capacity storage requirements
to reduce the OPEX
modules in N+1 redundancy • 64 x DDR5 DIMMs, up to 4800 MT/s, • 4 x hot-swappable PSUs in 2+2
delivering up to 16 TB memory • Intelligent energy saving, saving 8%
• 99.9999% availability redundancy
capacity more power than the industry average
• 15% fewer failures than the • 36 x E1.S drives, improving storage
• 4 x 350 W FHFL dual-width GPU • Boot acceleration storage
industry average density and I/O performance
accelerator cards or 14 x HHHL GPU technology (BSST), with 2 x M.2
accelerator cards, providing super SSDs for high-speed OS boot,
heterogeneous computing power supporting hot swap and hard RAID

25
5885H V7 Architecture 8 x 2.5" SAS/SATA drives

Slot 10, 11, 12, and 13 as FHHL PCIe 4.0 x8 slots


or slots 10 and 12 as FHFL PCIe 5.0 x16 slots
4-socket scalable processors
with TDP up to 350 W
Slots 14, 15, 16, and 17 as PCIe 4.0 x8 HHHL slots 4 x 2.5" SAS/SATA drives + 8 x 2.5" NVMe drives

Slots 18, 19, 20, and 21 as FHHL PCIe 4.0 x8 slots


or slots 18 and 20 as FHFL PCIe 5.0 x16 slots

24 x 2.5" SAS/SATA drives or 24 x 2.5" NVMe drives

25 x 2.5" SAS/SATA SSDs

1 x OCP card 4 x PSUs 50 x 2.5" SAS/SATA drives or 25 x 2.5"


SAS/SATA drives + 24 x 2.5" NVMe drives
2 x USB 3.0 ports

Serial port, management network port

Slots 7 and 9 as FHHL PCIe 4.0 x16 slots


Slot 8 as a FHHL PCIe 5.0 x16 slot 36 x E1.S drives
64 x 4800 MT/s 8 x fan modules in N+1
Slots 4, 5, and 6 as PCIe 4.0 x8 HHHL slots DDR4 DIMMs redundancy
Slots 1 and 3 as FHHL PCIe 4.0 x16 slots
Slot 2 as a FHHL PCIe 5.0 x16 slot
26
Extreme Heat Dissipation, Excellent Power Supply, and Peerless Computing Power Density
Unleash the Ultimate Performance

Superior Performance
• 8 x 4th Gen Intel® Xeon® Scalable processors, over 29 TFLOPS computing
power in the chassis
• 8-channel DDR5 DIMMs, 50% higher memory bandwidth, and up to 16 TB
24-drive configuration 8-drive configuration memory capacity
• 24 x NVMe SSDs

Extreme Heat Dissipation


• Wukong high-pressure airfoil counter-rotating fan modules, increasing air
volume by 50%
X6000 V7 high-density server • Large-size VC conjoined heat sink, increasing heat dissipation area by 70%
• Drives without backplanes, increasing the backplane air volume by 150%
• Built-in PSUs supporting the 218 mm (8.58 in.) widest high-density nodes,
increasing the air intake area of the node by 22%
• Air ducts with the lowest flow resistance, improving heat dissipation
performance by more than 10%
• Rear door heat exchanger (RDHx) + board-level full liquid cooling
solutions providing 100% liquid cooling

XH321 V7 air-cooled node XH321E V7 liquid-cooled node Excellent Power Supply


• 4 x 3000 W PSUs in 2+2 redundancy
HPC Virtualization Web apps Cloud computing • Total output power, doubling that of the industry average
• Titanium PSUs with up to 96.5% conversion efficiency
• Intelligent energy-saving technology, saving energy by up to 8%

27
XH321 V7 Node: Industry's Strongest Computing Power

Internal view Superior Computing Performance Flexible Deployment


16 x DIMM slots 68 mm (2.68 in.) built-in PSU
• 4th Gen Intel® Xeon® Scalable processors, • InfiniBand (IB) HDR 200 Gbit/s high-speed
40% higher performance interconnection network
Rear drive • 8-channel DIMMs, 50% higher memory • NVMe SSD storage
backplane bandwidth

Hardware Specifications
RAID controller 140 mm (5.51 in.) VC
card conjoined heat sink 2 x 4th Gen Intel® Xeon® Scalable processors (6400/8400 series), with TDP up to 350 W,
Processor
ambient temperature of 35°C (95°F), and 7.25 TFLOPS/node

DIMM slot 16 x DDR5 DIMM slots, up to 4800 MT/s (8-channel)


Rear view
Drives 6 x 2.5" SAS/SATA/SSD/NVMe drives (NVMe SSDs support 2+4 balanced configuration.)
PCIe slot 1 PCIe slot 2 PSU
RAID controller card RAID 0, 1, 5, 6, 10, 50, or 60; supercapacitor for power failure protection

2 x PCIe 5.0 x16 half-height half-length (HHHL) standard expansion slots, one of which can
PCIe expansion
be configured to support multi-host

OCP expansion 1 x OCP x16 slot

OCP slot iBMC aggregated Operating temperature 5ºC to 45ºC (41°F to 113°F)
management network port
Dimensions (H x W x D) 218.7 mm x 632 mm x 40.7 mm (8.61 in. x 24.88 in. x 1.60 in.)

28
XH321E V7 Liquid-Cooled Node: 45ºC (113°F) Warm Water Cooling Brings Down the TCO by 20%

High Energy Efficiency and Cabinet-Level Deployment


Liquid cooling of processors and DIMMs PUE ≤ 1.1 Robust Reliability Solution
(board-level liquid cooling solution) liquid cooling ratio:
80%
• Optimized liquid cooling design for • Accommodated in a FusionServer liquid-cooled cabinet,
CPU/memory/VRD; heat dissipation ratio of board- which has manifolds inside and can be connected to
level liquid cooling reaching 80% the main pipe
• 45ºC (113°F) warm water cooling, 20% less TCO • Up to 72 liquid-cooled nodes in a liquid-cooled cabinet

Hardware Specifications

2 x 4th Gen Intel® Xeon® Scalable processors (6400/8400 series), TDP up to


Processor
PUE ≤ 1.06 350 W, ambient temperature of 40℃ (104°F), and 7 TFLOPS/node
Liquid cooling of processors and DIMMs
+ RDHx (full liquid cooling solution) liquid cooling ratio:
100% DIMM slot 16 x DDR5 DIMM slots, up to 4800 MT/s (8-channel)

6 x 2.5" SAS/SATA/SSD/NVMe drives (NVMe SSDs support 2+4 balanced


Drive
configuration.)

RAID controller card RAID 0, 1, 5, 6, 10, 50, or 60; supercapacitor for power failure protection

+ PCIe expansion

OCP expansion
1 x PCIe 5.0 x16 HHHL standard slots, which can be configured with
different riser cards to support multi-host
1 x OCP x16 slot

Operating temperature 5ºC to 45ºC (41°F to 113°F)


RDHx
Dimensions (W x D x H) 218.7 mm x 632 mm x 40.7 mm (8.61 in. x 24.88 in. x 1.60 in.)

29
GPU Servers
Series AI - V7 GPU Server Product Overview

Basic Storage Mainstream Flagship

Medium-scale AI training
AI inference AI training & AI Large-scale AI training
& AI inference
for large-capacity storage inference and HPC

2/4 GPU 4 GPU 10GPU 8 GPU modules

2288H V7 G5200 V7 G5500 V7 G8600/G8600E V7

31
G5200 V7 Product Specifications

G5200 V7
G5200 V7 front view
Application Scenarios Medium-scale AI training/inference and large-capacity storage

Category 4U 2P GPU server

GPU Supports four dual-width GPU cards or ten single-width GPU cards.
G5200 Product Pictures

1 or 2 x 4th Gen Intel® Xeon® Scalable processors (Sapphire Rapids) with


CPU
TDP up to 350 W per processor

Multiple hot-swappable drives with the following configurations:


G5200 V7 rear view • Up to 32 x 3.5" SAS/SATA drives
Drive
• Up to four NVMe SSDs
• 2 x M.2 SSDs

Provides RAID 0, 1, 10, 1E, 5, 50, 6, 60; supports optional supercapacitor


RAID
for cache data power failure protection.

Up to 10 x standard PCIe slots, among which 6 x PCIe x16 slots support


IO
PCIe 5.0.

Power Supply 4 x hot-swappable PSUs

Fan Module 8 x hot-swappable counter-rotating fan modules in N+1 redundancy

Temperature 5℃ to 35℃ (41℉ to 95℉)

Dimensions 175 mm x 447 mm x 798 mm (6.89 in. x 17.60 in. x 31.42 in.) (H x W x D)

32
G5500 V7 Product Specifications

G5500
Application
Large-scale AI training/inference, high-performance/balanced models
Scenarios
G5500 V7 front view
Category 4U 2P GPU server

GPU Up to ten dual-width GPU cards (4/8 recommended)

2 x 4th Generation Intel® Xeon® Scalable processors (Ice Lake), up to 350 W TDP per
CPU
G5500 Product Pictures

processor

Multiple hot-swappable drives with the following configurations:


• Up to 24 x 3.5"/2.5" SAS/SATA drives
Drive
• Up to 12 NVMe SSDs
• 2 x M.2 SSDs

Provides RAID 0, 1, 10, 1E, 5, 50, 6, 60; supports optional supercapacitor for cache data
RAID
G5500 V7 rear view power failure protection.

A maximum of 14 standard PCIe 5.0 x16 slots and a maximum of 10 dedicated GPU slots, all
supporting PCIe 5.0 x16
IO
A maximum of three OCP 3.0. Supports PCIe 5.0 x8, and one OCP slot supports Socket
Direct

Power Supply 4 x hot-swappable PSUs in N+N/N+M redundancy

Fan Module 6 x hot-swappable counter-rotating fan modules in N+1 redundancy

Temperature 5℃ to 35℃ (41℉ to 95℉)

Dimensions 175 mm x 447 mm x 898 mm (6.89 in. x 17.60 in. x 35.35 in.) (H x W x D)

33
G5500 V7 Main Feature

Excellent Performance
• Supports ten dual-width training GPU cards
• Supports GPU Direct RDMA, Storage, and P2P
• Supports double communication bandwidth from CPU to GPU x32

Flexible Architecture
• Online one-click switchover of AI and HPC topologies, flexibly adapting to
different scenario
• Supports PCIe Switch pass-through design, reducing hardware investment

On-demand Resource Expansion


• Decoupling between the GPU computing area and the network I/O area, and
on-demand resource expansion
• Only 3 x OCP NICs in the industry, easily meeting I/O requirements

34
G5500 V7 Architecture
2 x GPU, a maximum of 350 W power
consumption per GPU
8 x PCIe 5.0 x16 full-height dual-width slots

8 x GPU, a maximum of 350 32 x DDR4 DIMMs 2-socket Scalable


W power 4800 MT/s Processors, TDP 350 W
consumption per GPU
Standard rear
window
Supports PCIe
SW 24 x 3.5"/2.5" SAS/SATA drives
Supports 8 x NVMe drives

FLEX IO slot 1, 4 x PSUs


supporting an OCP
3.0 NIC
Management network Flex IO slot 2, supporting
port, serial port an OCP 3.0 NIC

4 x PCIe 5.0 x16 Flex IO slot 3, supporting an


standard cards 12x NVMe + 8 x SAS/SATA 2.5" drives
OCP 3.0 NIC

8 x PCIe 5.0 x16 full-height dual-width slots

Basic rear window


8 x GPU pass-
through
Standard board 6 hot-swappable fan modules, N+1
PSU, N+M redundancy
Basic board redundancy
A maximum of 3000 W Titanium

OCP 3.0 OCP 3.0 OCP 3.0


Management network
4 x PSUs
35 port, serial port
One-Click GPU Topology Switchover, Flexible Support for AI/HPC Applications

G5500 V7 Servers Supporting One-Click AI/HPC Topology Switchover


G5500 V7 configured with 8 x H800/A800 (in China) and 8 x H100/A100 (outside China)

CPU CPU NIC CPU CPU


NIC NIC
NIC

PCIe Switch PCIe Switch


PCIe Switch PCIe Switch

GPU GPU GPU GPU GPU GPU GPU GPU


GPU GPU GPU GPU GPU GPU GPU GPU

Cascaded Topology: CPU:GPU = 1:8, Balanced Topology: CPU:GPU = 1:4,


AI Training AI Cloud Acceleration, HPC

36
G8600 Product Specifications
G8600
G8600 V7 front view Application
Ultra-large-scale AI training
Scenarios

Category 8U 2P GPU server

GPU NVLink module: 8 x GPU modules

2 x 4th Generation Intel® Xeon® Scalable processors (Sapphire Rapids), up to 350 W TDP
CPU
per processor
G8600 Product Architecture

Multiple hot-swappable drives with the following configurations:


• Up to 25 x 2.5" SAS/SATA drives
Drive
• Up to 8 NVMe SSDs
• 2 x M.2 SSDs

Provides RAID 0, 1, 10, 5, 50, 6, 60; supports optional supercapacitor for cache data power
RAID
failure protection.
G8600 V7 rear view
High-performance topology: 8 x standard PCIe cards, 1 x OCP 3.0 NICs, and 8 x NVMe 5.0
drives, in which eight NVMe drives can be replaced with eight standard PCIe cards.
IO
Balanced topology: 12 x standard PCIe cards, 1 x OCP3.0 NICs, and 8 x NVMe 5.0 drives, in
which eight NVMe drives can be replaced with eight standard PCIe cards

6 x 54 V dual-input hot-swappable PSUs and 2 x 12 V hot-swappable PSUs, all supporting


Power Supply
N+N redundancy

GPU: 10 x 54 V fan modules, supporting N+1 redundancy


Fan Module
CPU: 5 x 12 V fan modules, supporting N+1 redundancy

Temperature 5℃ to 35℃ (41℉ to 95℉)

Dimensions 356 mm x 447 mm x 898 mm (14.02 in. x 17.60 in. x 35.35 in.) (H x W x D)

37
G8600 Components

25 x 2.5" EXP backplane

54 V dual-input PSU 2.5 "drive

Chassis

Air duct
Fan module in GPU
Product Exploded View

Fan module in compute

RAID controller card battery box


HGX 8-GPU Nvlink module

Mainboard

CPU

Heat sink

DIMM
BMC&OCP module +
220 V adapter board module
I/O riser module
12 V PSU

38
G8600 Main Features

Unparalleled Computing Power


• Two Sapphire Rapids CPUs, supporting up to 350 W
• Supports 8 x GPU modules with the industry's leading computing power
• Leading architecture design, cable-free, and retimer-free support for PCIe
5.0 devices

Efficient Energy Saving


• Efficient heat dissipation: xFusion fan 8080++, industry-leading MPC algorithm
• High-efficiency power supply: Titanium xFusion-developed high-efficiency PSU,
54 V and 12 V PSUs in two partitions

High Reliability
• Modular and easy O&M: module replacement without removing the server from
the cabinet, reducing maintenance time by 2.5 times
• High-reliability power supply architecture: dual-bus 54 V PSUs, achieving fewer
PSUs and higher redundancy

40
GPU Cards Supported and its Corresponding Application Scenarios
Vendor Form Factor Scenario Model
NVIDIA Standard PCIe card H100
NVIDIA Standard PCIe card H800
NVIDIA Standard PCIe card A100 80GB
Computing: training/HPC/data analysis
NVIDIA Standard PCIe card A800 80GB

NVIDIA Standard PCIe card - liquid cooling A100 80GB liquid cooling

NVIDIA Standard PCIe card Computing: AI inference/medium HPC A30


NVIDIA Standard PCIe card A2
NVIDIA Standard PCIe card Calculations and graphs: edge AI/small-scale inference/edge video processing/mobile cloud games T4
NVIDIA Standard PCIe card L4
NVIDIA Standard PCIe card A40

NVIDIA Standard PCIe card Graphics: metaverse/cloud rendering fastest light speed tracking/maximum rendering model L40

NVIDIA Standard PCIe card Graphics: virtual workstation/video conferencing/4K cloud gaming A10

NVIDIA Standard PCIe card A16


Graphics: virtual desktops, virtual workstations, and video streams with the most encoding/decoding

NVIDIA Standard PCIe card RTX A6000


NVIDIA Standard PCIe card Workstation-level graphics, graphics processing RTX 6000 Ada
NVIDIA Standard PCIe card RTX A4000
Intel Standard PCIe card Graphics: Windows cloud games/virtual desktops/android cloud games M150

Cambricon Standard PCIe card Inference: high-efficiency-ratio on cloud-based AI inference, 128 TB (INT8) supporting MLU270-S4-16GB
INT16/INT8/INT4/FP32/FP16
Han Bo Standard PCIe card Inference: inference/200 TB (INT8)/video encoding/decoding VA1A PCIe-16GB
Han Bo Standard PCIe card Inference/Graphics: general AI inference/video encoding/decoding VA1 PCIe-16GB
Video/Graphics: cloud-based intelligent video acceleration, video encoding/decoding, image detection,
Han Bo Standard PCIe card VA1V PCIe-16GB
classification, segmentation, enhancement, and overcommitment
HiSilicon Standard PCIe card Inference/Graphics: search recommendation/content review/OCP system Atlas 300I Pro
Biren Standard PCIe card Computing: training/HPC/data analysis BR104P
41
Hardware Upgrade Software Upgrade

CPU Upgrade for Higher Performance BMC System Upgrade


50% increase in the maximum number of cores, and 35%+ BMC software security certified by CC EAL4+, ensuring a
higher computing performance securer system

Memory Upgrade for Faster Speed BIOS System Upgrade


DDR4 upgraded to DDR5, increasing the speed by 50% 25% faster system boot speed compared with the previous
generation and faster recovery of services after the system restart

PCIe Upgrade for Higher Bandwidth Cluster Management Software Upgrade


PCIe 4.0 upgraded to 5.0, improving the bandwidth by 100% Third-party server management, supporting online O&M
and supporting PCIe 5.0 GPU cards and NVMe devices and mobile O&M
FusionServer V7 Intelligent Servers
of All Series
No. 1 in No. 1 in No. 1 in No. 1 in No. 1 in
CPU Performance Power Efficiency Virtualization Performance HPC Performance AI Performance
1100 18000 520000
62 0.016

900 500000 60
0.012
58
700 14000 480000
0.008
56
500 460000
54 0.004

300 10000 440000


52 0
2S Int-rate 2S fp-rate Power efficiency scores max-jOPS
OMP ResNet RNN-T
xFusion Vender A xFusion Vender A
xFusion Vender A xFusion Vender A xFusion Vender A

Leading the 2nd one Leading the 2nd one Leading the 2nd one Leading the 2nd one Leading the 2nd one

6.7% 8% 7.9% 9.1% 15.8%


*: Based on the ranking testing data of the FusionServer V7 servers released by SPEC on January 11, 2023
**: Based on the ranking testing data of the G5500 8 x A30 GPUs released by MLPerf on November 9, 2022.
FusionServer V7 Server Family Builds System-Level Competitive Advantages

General-purpose rack servers High-density servers GPU Server

• Balance: 1288H V7/2288 V7/2288H V7 • X6000 V7 • Entry-level: 2288H V7


• High performance: 2488H V7/5885H V7 • Node: XH321 V7 • Storage: G5200 V7
• Storage: 5288 V7 • Node: XH321E V7 • Mainstream: G5500 V7
• Flagship: G8600 V7/G8600E V7

44
Wide Recognition from Clients

FusionServer as a digital transformation partner of 211 of the Fortune Global 500 companies and 48 of the Global Top 100 companies

Finance industry

Carrier industry

Internet industry

Transportation and
energy industries

Other industries

Serves 10,000+ industry customers worldwide, covering 1/3 of the world's population
45
让数字世界无限可能
Thank you. Fusion X, Digital Infinity

Copyright©2022 xFusion Digital Technologies Co., Ltd.


All Rights Reserved.

The information in this document may contain predictive


statements including, without limitation, statements regarding
the future financial and operating results, future product
portfolio, new technology, etc. There are a number of factors that
could cause actual results and developments to differ materially
from those expressed or implied in the predictive statements.
Therefore, such information is provided for reference purpose
only and constitutes neither an offer nor an acceptance. xFusion
may change the information at any time without notice.

You might also like