High performance Cloud with

Hardware Acceleration

Cloud BU, Huawei

 Huawei Cloud Architecture
MarketPlace and
Partner Marketplace … API/SDK网站 …
工
金 企
石 智 业 科 生 医 重 远 现 商 智 在 中
全 车 融 B 物 业
汽 油 能 仿 学 命 疗 疾 程 代 电 油 抄 贸 电 园 物 慧 铁 机 公 保 线 媒 渲 小 游
Industry Solutions 渠 联 公 E 联 云
车 勘 工 真 计 科 影 随 医 医 力 气 表 连 商 区 流 家 路 场 路 险 教 资 染 企 戏
道 网 共 S 网 通
探 厂 设 算 学 像 访 疗 疗 锁 庭 育 业
云 讯
计

制造 科研 医疗 能源 商业 交通 金融 运营商 其他

General
SAP on Cloud Cloud Dedicated Web & Migration
Purpose HPC FCS IoT Hosting
Cloud DR
Service
Cloud Office Communication Mobile
Solutions

Management Services DevOps IT Services Enterprise

ProjectMan CodeCheck CloudPipeline CloudIDE WBS SBS WES Workspace
CES ICMS CodeHub TestMan CloudRelease WeLink LSB DMB RES IoT
IAM TMS CloudBuild CloudDeploy MobileTest MBS RBS AMS IoTPlatform
CTS RTS Application Services Data and AI Communication
CCS CAS DMS FunctionStage MRS DPS UQuery CSS Logistics Meeting CloudIPCC
Images
CRS SMN DDM DWS MLS OCR Forms Recognition Deblur IM VoiceCall
ServiceStage XX DIS CDM CloudTable USearch CloudPBX MSGSMS
Services Computing Storage Services Network DB Security
ECS DeC EVS CDN VPC RDS Anti-DDoS SSA HWAF AAG
CCE DeH VBS CSBS ELB DDS SIS WTP WAF AAD
BMS FGS OBS DSS DirectConnect DCS KMS HIDS SAS HSS
AS IMS DES DESS DNS DRS ARS WebScan DBSS
SFS VPN SCS HVD SCA

Cloud OS FusionSphere
Infrastructure Server Storage Network Security
2
 The world is changing - more devices, more conns,
more data

Billion Tens of Billions 100 ~ 1000 of Billions

Desktop Internet Mobile Internet Internet of Things

The PC brought the internet The Mobile Revolution put computing and instant Now!
access to billion, during the access to information in the hands of billions,
1990s in the early 2007s
3
 Moore’s law is slowing

Single-threaded perf Keeping Moore’s law alive in Data Center

Customi Smart Cloud KunLun - Powerful X86

1.1x per year Server (768 cores, 32T)
zed CPU NIC SSD

1.5x per year

1990 2000 2010 2020

SDI Heterogeneous computing
(Service Driven Infrastructure) platform
Memory VS CPU
Compute

Memory
Bandwidth
4
2000 2010 2020
 Smart NIC

5
 Under the hood: Network Virtualization

Host-based SDN:
separate a centralized control plane
VM VM VM from a data plane on the host, and VM VM VM
implement almost all virtual
networking features, to connect VMs
vSwitch to physical network vSwitch

Physical Network

vSwich is most important

6
 History of Huawei eVS
eVS – Elastic Virtual Switch

eVS 1.0 eVS 2.0

• Start from 2015
• Start from 2013 • DPDK
• Kernel-based OVS • General Packet Filtering Platform
• Enhanced features (CT/BUM） • Optimized SIMD and Multi-threaded
• 8Gbps/900Kpps scheduling
• 20Gbps/5Mpps

Limited by Kernel Limited by CPU frequency,

memory bandwidth

7
 How to break the bottleneck of vSwitch?

Our way:
Combination of software and self-developed hardware

And additional benefits:

flexibility, high performance, low cost, high availability

8
 eVS 3.0 - First Tens of Millions PPS
virtual network switch

40Gbps 10Mpps

Hardware High High

Acceleration Performance Availability

Smart NIC Offloads Virtio-Direct Hot upgrade

9
 Huawei Smart NIC: u-NIC
Self-developed smart chip: 𝐮-NIC

RDMA PCIe, SR-IOV，Virt-IO

TCP
Intelligent Application
network
NIC protocol
processor QoS
OVS
HD
VxLAN p-Switch Security
Memory

… Ethernet

Features
• Programmable high performance packet forwarding platform
• Network-specific optimization engine （ PPE ）
• Large flow table and security rules
• High precision hard QoS

10
 Architecture: Integrated Flow Table and Offload

ext VM
eVS data plane action

virtio-net
upcall
GFP
ovs datapath

Flow Table(IFE)
Offload virtio-direct
Engine

First pocket
Rest of u-NIC
11
 Virtio-Direct: Virtual I/O

• High performance virtio data path VM

Offload virtio head
virtio-net
Zero Copy
IRQ Aggregation

• High Availability, Smooth migration

virtio-direct
Standard virtio-net
Non-intrusive GuestOS
Support Live migration
u-NIC VF

12
 Hot upgrade, both Hardware and Software

QEMU
virtio-net
No user impact
Active/Standby Mode eVS 3.0
Hot upgrade/downgrade Active Standby
Independent hot upgrade
Joint hot upgrade PCIe

FW FW
Active Standby
u-NIC

ETH ETH ETH ETH

13
 Flexibility, Performance, Availability

Other Smart NIC

Virtio-Direct
SR-IOV
Virtual I/O Mode Software & Hardware Hardware

Performance
Non-intrusive
GuestOS
Live migration

Hot upgrade
14
 SDI

15
 SDI
VM VM ... VM VM VM ... VM PM
Hypervisor A Hypervisor B APP

Release more CPUs to user SDI Control Plane

High perf on basic services: Computing Storage All IP
pool pool network
storage and network
Based on self-developed chip S D I

16
 SDI

X86 X86
CPU CPU
Storage Storage Network Network

RAID Storage Storage

SDI Network Network
NIC

• Resource Competition
• Resource isolation
• 20+% Cores wasted
• 100% Cores for users
• Weak reliability
17
 SDI Architecture
Cloud Scale Application

VM VM ... VM VM VM ... VM Bare

Metal
Hypervisor A Hypervisor B APP

SmartEP Driver @ PCIe

Power
Management Storage Network Accelerator Extension External
interface accelerator
Euler OS
Storage Network PCIe
Software Accelerator Interface Interface Interface
Hardware Accelerator
18
 Customized CPU

Application

• Single Core Integer25%↑*

Cloud • Single Core Linpack70%↑*
CPU • Memory Bandwidth 62%↑*
Customized
Server

Data Center
↑*:6151 vs 2680v4

19
 C3ne - with u-NIC, Virtio-Direct, SDI

C3ne

2.5x
Up 15% 2x

CPU PPS bps

20
 Simultaneous online players from 30k to 13M
Before：

Player Game Server

PPS 3Mpps 30k Player

 The first listed company

430%
that offers game-
now： 13Mpps 13M players
accelerating services in the
world.
 lower ping, no packet loss,
Player Server
no login failure C3ne C3ne

21
 Thanks

22