AI Enables All Walks of Life

Huawei Atlas Intelligent Edge AI Inference Solution

Towards an AI Era On the Verge of an Innovation Explosion
 Trends

Intelligent Devices Expand to Various Industries, Driving Pervasive

Computing
Past Professional devices are
required for computing. Now Intelligent devices are ubiquitous.
Heterogeneous computing is rising.

Wearables Smartphones HUAWEI Vision

20 MegaOPS(MOPS)1–10 TeraOPS(TOPS)1–10 TeraOPS(TOPS)

Facilitating
lives

Cloud & Data center

Peng Cheng CloudBrain Phase II,
exascale (106 TFLOPS) AI computing
Vacuum tube Integrated circuit PCs
computers computers K 103
ENIAC (1946), Intel Pentium III (1999),
Enabling M 106
Cray-I (1975),
industries
5 kiloOPS(KOPS) ~160 MegaOPS(MOPS) ~1 GigaOPS(GOPS) G 109
T 1012
Industrial computers Smart cameras Smart vehicles P 1015
4–20 4–20 Tesla FSD (L2+),
E 1018
TeraOPS(TOPS) TeraOPS(TOPS) 72 TeraOPS(TOPS)
L4–L5: 100–1000+ TeraOPS(TOPS)
 Trends

Continuous Breakthroughs in AI Algorithms Unlock Boundless

Possibilities
In specific fields, AI is approaching or exceeding human capabilities.

ResNet model: top-5 error rate AlphaGo

3.57%, exceeding the human March 2016: Defeated Lee Sedol
capability (4%) May 2017: Beat Ke Jie

1 Image classification 3 Game decision-

making

2 Speech recognition 4 Reading

comprehension
DeepSpeech2 model: 95% BERT model: 87%
accuracy, approaching the accuracy, exceeding that
human capability of human (82%)
 Huawei Atlas AI Computing Solution
AI Unlocks Boundless Possibilities

5
An Open AI Computing Platform for Intelligent Transformation of
Industries
Intelligent edge solution

Atlas intelligent edge platform

Industry SDK/Container engine/Basic service repository

Framework MindSpore/TensorFlow/PyTorch/etc. Common components

AXE toolchain/Security subsystem/Unified O&M system
Chip enablement CANN

Device Edge Cloud

Atlas 500 Atlas 300 Atlas 800

Atlas 200 Model: 3000 Model:3000/3010

Da Vinci
Ascend 310 architecture

6 Huawei Confidential
Da Vinci Architecture, for Tensor Computing

3D Cube: Made for AI Matrix Operation

3D Cube:
16 x 16 x 16 3D Elastic Cube
• High computing power: 4096 FP16 MAC operations
completed within a clock cycle
• Efficiency: from IP modules of dozens of mW to chips of
hundreds of watts, adapting to the smoothly scalable
architecture of device-edge-cloud

7 Huawei Confidential
Atlas Accelerates AI Inference

Intelligent devices with Edge intelligence and Highest density, 64 video AI inference platform with Build an AI development
7x higher performance cloud-edge synergy inference channels ultimate computing power environment in 30 minutes

Atlas 200 Atlas 500 Atlas 300 Atlas 800 Atlas 200 DK
AI accelerator module AI edge station AI accelerator card AI server AI Developer Kit
Model 3000 Model 3000/3010
Device Edge Cloud Ecosystem

Ascend 310 16 TeraOPS INT8

AI Processor Max. power consumption: 8W

8 Huawei Confidential
Atlas 200: Smartening up Terminal Devices, with a 7x Performance Leap

Cameras Drones Robots 30  200

Number of faces in a
single frame

• 16 TOPS INT8, 9.5 W

• 16-channel HD video real-time
analytics, and JPEG decoding
• 4 GB/8 GB memory, PCIe 3.0 x4
interface
• Operating temperature: -25°C to +80°C
9
Huawei Confidential
AI camera
Run multiple algorithms
in parallel
Pixel-level image
segmentation
+ Facial recognition
+ Posture recognition
+ Vehicle recognition
Models in the demo are Huawei employees.
Atlas 300: Industry's Highest-Density AI Accelerator Card, Supporting
64-Channel Video Inference

 64 TOPS of INT8, 67 W
 32 GB memory
Huawei Atlas 800 AI inference server
 64-channel HD video real-time
analytics

Model: 3000

Number of video Resnet-50

decoding codes
Resnet-50 VGG-16Neural network
H.265network
Neural at 1080P performance
Neural network performance
performance 64 1x

0.69x
44
0.46x
16

AI acce. AI acce. Atlas AI acce. AI acce. Atlas Intelligent diagnosis system for COVID-19
card 1 card 2 300 card 1 card 2 300

Video Analytics | OCR | Speech Recognition |

Industry-leading performance Precision Marketing | Medical Image Analysis
10 Huawei Confidential
Atlas 500 AI Edge Station

Built for Harsh Edge Environments

 16 TOPS INT8
Extreme cold | Extreme hot | Heavy dust
Powerful  25–40 W
compute
 Wi-Fi & LTE
Easy Cloud
collaboration
 16-channel HD video
deployment
Edge
real-time analytics
Intelligence
 Fanless, stable at -40°C

Small Low to +70°C

footprint consumption

11 Huawei Confidential
Atlas 800 AI Server – 3000 Model: Efficient Inference Platform
Powered by Kunpeng
Powerful Real-Time Inference
• Supports 8 Atlas 300 AI accelerator cards, industry-
leading 64 TeraOPS per card; 512-channel real-time
HD video analytics per system
• Runs on 2 Kunpeng 920 processors, unlocking
supreme performance and compute power; leverages a
multi-core architecture for application acceleration
12 Huawei Confidential
 2 Kunpeng 920 processors in a 2U space
 8 PCIe slots, supporting up to 8 Atlas 300 AI accelerator cards
 Up to 512-channel real-time HD video analytics
 Air-cooled, stable in 5°C to 40°C environments
Efficient Computing
• Provides an AI computing platform with high efficiency, low
consumption for inference scenarios, fully leveraging the multi-
core and energy-efficient advantages of Kunpeng
• Atlas 300 runs at an ultra-low power of 67 W, fueling the AI
server with faster computing and higher performance per watt
Atlas 800 AI Server – 3010 Model: Flexible Inference Platform
Based on Intel Processors

 2 Intel® Xeon® SP Skylake or Cascade Lake processors in a 2U space

 8 PCIe slots, supporting up to 7 Atlas 300/NVIDIA T4 AI accelerator cards

 Up to 448-channel real-time HD video analytics

 Air-cooled, stable in 5°C to 35°C environments

Flexible Configuration, Workload-Adaptive Intelligent Video Analytics

• Supports flexible combinations of
SAS/SATA/NVMe/M.2 SSD hard drives
• Supports LAN on motherboard (LOM) and FlexIO
cards, providing rich network interface options
• Supports 7 AI accelerator cards, adapting to various
video and image analytics scenarios
• Uses the Atlas 300 dedicated decoding engine for
transcoding and inference of up to 448-channel HD video
streams

13 Huawei Confidential
Incubating Multi-Scenario AI Teaching Demos Based on Atlas
Developer Kit and Third-Party Teaching Tools

Atlas 200 DK:

Full-stack AI development

Developers
Set up a dev environment with 1 laptop
Ultra-low cost for local independent
environment, with multiple functions and
interfaces to meet basic requirements
Start-ups
Code-level demo
Developer community interaction;
seamless porting for commercial products

14 Huawei Confidential
 Ascend Community: Enablement, Resources, and Support for
Developers
Enablement
Resource Center Support Center
Center
• AI theory basics • Developer guides • Ascend Forum
Scan to join
• Hands-on courses • Development tools • FAQs
• Use case courses • Community projects • Remote support
• Expert lectures • Models • Experience sharing

https://www.huaweicloud.com/intl/en-
us/ascend/home.html

15 Huawei Confidential
 AI Enables Transformation with Edge Intelligence
Industries

16 Huawei Confidential
AI Will Reshape Industries

Transportation Electric Power

Finance Manufacturing
• Road-vehicle • Intelligent booster
Public Security • Smart branch • Intelligent quality Internet
cooperation station
• Financial OCR inspection • Personalized
• Facial recognition • Contactless • Unmanned patrol
• Industrial robots recommendation
• Vehicle recognition identification • Intelligent PV
• Content analysis
• Autonomous driving

AI readiness empowers industries

Speech recognition Machine vision Decision and inference Natural language processing

17 Huawei Confidential
Power Grid: Industry's First Intelligent Unattended
Inspection Solution, with 5x Efficiency
Intelligent analysis at the edge with
ultra-low consumption

Front-end analysis and return 15 W 16 TOPS

Power Computing
alarms
consumption power Power consumption
Intelligent camera Atlas 300/800 reduced by 80%
AI AI model training
Model optimization and 3W 2.x TOPS Meeting edge computing
remote upgrade Surveillance and
management platform requirements
Average system Real-time High computing
consumption analysis power

Atlas 200 1W Once per minute 16 TOPS

Manual AI
inspection inspection

Efficiency 5x+ up

System cost 30% down

18 Huawei Confidential
Manufacturing: AI Enables Intelligent Production Line with Machine
Vision
Cloud-edge collaboration enables intelligent
EL detection for PV modules

Return unidentified data

Video streams Model file

AI
Update algorithms and
deploy microservices Atlas 300/800
Atlas 500 AI Application FusionDirector
system training platform
edge station

Manual inspection Intelligent inspection

Unstable Low production Discontinuous High labor High production Cloud-edge Reduced labor
Zero omission
results efficiency process costs efficiency collaboration costs

2 Defective cells Defective cells 6

~5s Time taken Time taken 1.36s

33.33% Accuracy Accuracy 100%

19 Huawei Confidential
Thank you. 把数字世界带入每个人、每个家庭、
每个组织，构建万物互联的智能世界。
Bring digital to every person, home, and
organization for a fully connected,
intelligent world.

Copyright©2020 Huawei Technologies Co., Ltd.

All Rights Reserved.

The information in this document may contain predictive

statements including, without limitation, statements regarding
the future financial and operating results, future product
portfolio, new technology, etc. There are a number of factors that
could cause actual results and developments to differ materially
from those expressed or implied in the predictive statements.
Therefore, such information is provided for reference purpose
only and constitutes neither an offer nor an acceptance. Huawei
may change the information at any time without notice.