Professional Documents
Culture Documents
Storage Technology Trends
Storage Technology Trends
Foreword
2 Huawei Confidential
Objectives
3 Huawei Confidential
Contents
2. Data Storage
4 Huawei Confidential
What is Data
SNIA (Storage Networking Industry Association) defines data as the digital
representation of anything in any form.
Format in which data is stored
Email 0101001010100010000011
1100011100010001110001
1100000111101010100101
Digital music 0101001010100101001010
1001010101001010100010
1010010101001010101010
Digital video
0101010101010010100010
0101001010101010100101
Ebook
0101001010101010100101
0101010010100101001000
1010101001001010010010
5 Huawei Confidential
Data Types
Semi-
Structured structured Unstructured
data data data
6 Huawei Confidential
Data Processing Cycle
Data processing is the reorganization or reordering of data by humans or
machines to increase their specific value. A data processing cycle includes three
basic steps: input, processing, and output.
7 Huawei Confidential
What is Information
Information is processed, structured, or
rendered in a given context to make it
Processing Information
meaningful and useful.
Information is processed data, including
data with context, relevance, and
Data
purpose. It also involves the manipulation
of raw data.
Data
Redundancy
8 Huawei Confidential
Data vs. Information
After being processed, data can be converted into information.
In order to be stored and transmitted in IT systems, information need to be
processed as data.
9 Huawei Confidential
Information Lifecycle Management
Information lifecycle management (ILM) refers to a set of management
theories and methods from the stage in which the information is generated and
initially stored to the stage where the information is obsoletely deleted.
Data value
10 Huawei Confidential
Contents
2. Data Storage
11 Huawei Confidential
What is Data Storage
Storage in a narrow sense Storage in a broad sense
12 Huawei Confidential
Data Storage System
13 Huawei Confidential
Physical Structure of Storage
Hosts
Storage application
software
The front-end board of
controllers
Cache
Storage
System The back-end board of Storage management
controllers software
Connectors
Disks
14 Huawei Confidential
Data Storage Types
Internal DAS
Storage SAN
Storage FAS
External NAS
Storage
15 Huawei Confidential
Evolution of Data Management Technologies
Distributed
Dedicated storage device
storage device
Manual
management
16 Huawei Confidential
Data Storage Application
Database servers
Users
Application
servers
Email servers
Offline
storage
File servers Online storage Nearline storage
Employees
Classification based on data access frequencies
17 Huawei Confidential
Contents
2. Data Storage
▫ Storage Media
▫ Interface Protocols
18 Huawei Confidential
History of Storage Architecture Development
2000s
1990s • Distributed
• Storage storage
1980s network • Cloud storage
• External
storage
1950s
• Traditional
storage
19 Huawei Confidential
From Disks to Disk Arrays
JBOD
Controllers
20 Huawei Confidential
From Separation to Convergence
SAN LAN
File
NAS SAN
system
Storage Storage
File
system
Storage
21 Huawei Confidential
Distributed Storage
Physical resources are organized using
software to form a high-performance
Front-end
logical storage pool, ensuring reliability service
network Management
and providing multiple storage services. network
22 Huawei Confidential
Storage Virtualization
Storage virtualization consolidates the Clients or servers
23 Huawei Confidential
Cloud Storage
The cloud storage system combines multiple storage devices, applications, and services. It uses
highly virtualized multi-tenant infrastructure to provide scalable storage resources for enterprises.
Those storage resources can be dynamically configured based on organization requirements.
Legacy New
applications applications
Converged
Elastic Block storage service File storage service Object storage service
24 Huawei Confidential
Contents
2. Data Storage
▫ Interface Protocols
25 Huawei Confidential
History of HDDs
Larger capacity with the smaller size.
26 Huawei Confidential
History of SSDs
Solid-state drives (SSDs) were invented almost as early as HDDs, but were not
popular at that time due to high price and the rapid development of HDDs at
the end of the 20th century.
With the requirement for high access speed, SSDs are booming.
• Bell Labs
1976 • SanDisk
1999 • Samsung
2010…
• Floating gate • Dataram sold launched flash • BiTMICRO released laptops • Lower costs
transistor Bulk Core. SSDs. launched flash using SSDs.
• Greater capacity
• 2 MB capacity • 20 MB capacity SSDs. • 32 GB capacity
• 18 GB capacity
1967 1991 2006
27 Huawei Confidential
Development of Flash Memory
28 Huawei Confidential
Contents
2. Data Storage
▫ Storage Media
Interface Protocols
29 Huawei Confidential
Interface Protocols
Disk interfaces connect disks to hosts.
Interface protocols refer to the communication modes and requirements that
interfaces for exchanging information must comply with.
30 Huawei Confidential
History of Interface Protocols
The first-gen FC
protocol was 2004 2008 2012 2016 2017 2018 2020…
released in 1994.
SATA 1.0
Disk interface SATA 3.0
4G FC
SAS 1.0 SAS 2.0 SAS 3.0 SAS 4.0
SATA 2.0
31 Huawei Confidential
NVMe and NVMe-oF
NVMe, Non-Volatile Memory Express
Improve the performance CPU CPU
Reduce the latency PCIe PCIe
NVMe-oF, NVMe over Fabrics
SAS Controller
Potential: low latency and high
SAS Expander
bandwidth
Purpose: accelerate the data
transmission among the storage NVMe back-end SAS back-end
physical path physical path
network
32 Huawei Confidential
Contents
2. Data Storage
33 Huawei Confidential
History of Storage Products
Cloud
Media
HDD SSD
Architecture Trend
Centralized Distributed
All-flash Intelligence
Management
Manual O&M Intelligent O&M
34 Huawei Confidential
The Intelligence Era is Coming
35 Huawei Confidential
Challenges to Data Storage
24/7 µs-level
Time-consuming of Always-on Real-time, high-speed
RAID reconstruction services for all processing of production
Service things connected transactions in the 5G era
interruption due
to multiple points
of failure Finance High disk
failure rate Reliable Fast
36 Huawei Confidential
Characteristics of Storage in the Intelligence Era
Storage in the intelligence
era
Intelligent data lifecycle
management
Storage for AI AI in storage
Data convergence
Zero data migration Data collaboration
Convergence of Simplified protocol stack and data-
SAN and NAS storage convergence
Intelligent storage tiering of hot, Compute-storage collaboration, on-
warm, and cold data demand capacity expansion
Multi-service convergence Dedicated hardware and
(block, file, and object) distributed storage
Hardware + Algorithm + Architecture = Efficient storage
Robust reliability Large capacity High performance
Device-level of 99.99999% PB-level to EB-level ms-level to µs-level
System-level of 99.999% Efficient deduplication & Intelligent distributed cache
compression
Solution-level reliability + Cost-effective media, warm and High-speed protocols
Cloud-level DR cold data storage and algorithms
Minimum cost and maximum value for per-bit data
37 Huawei Confidential
Data Storage Trend
Distributed
storage
Database Cloud
applications Blockchain
computing Storage in AI
Mainframe the
system
Private software
Hyper- Big data intelligenc
Traditional
and hardware
external
converged e era
solutions with infrastructure 5G
fully coupled storage (HCI) General-
computing, purpose
Brain-like
storage, and computing DNA Graph
Tensor computin
network computing computing computing
VM Container g
resources, x86
applicable only to
CXL HCCS
large RoCE/NVMe
organizations
FC IP
SAS IB Quantum dot
PCM MRAM
HDD SSD
38 Huawei Confidential
Optical Storage Technology
Long service High 100 GB+ per Low power Long-term 10 TB per
life reliability disk consumption stable storage disk
39 Huawei Confidential
DNA Data Storage
A small number of synthetic DNA molecules can store a large amount of data,
and can freeze, dry, transport, and store data for thousands of years.
Advantages of using DNA as storage media:
Small size
High density
Strong stability
Bottlenecks and limitations:
High costs of DNA molecular synthesis
Slow data read and search
40 Huawei Confidential
Atomic Storage
In 1959, physicist Richard Feynman suggested that it was possible to use atoms to store
information if they could be arranged the way we wanted.
Because an atom is so small, the capacity of atomic storage will be much larger than that of the
existing storage medium in the same size.
With the development of science and technology, arranging the atoms the way we want has
become a reality.
Bottlenecks and limitations:
Strict requirements on the operating environment.
41 Huawei Confidential
Quantum Storage
Now, information in electronic devices is stored and moved through the flow of electrons.
If electrons are replaced by photons, the movement of information within the computer may
occur at the speed of light.
Although the storage efficiency and service life are improved, the quantum storage is still difficult
to be widely applied at present.
Quantum storage cannot meet the following requirements:
High storage efficiency
Low noise
Long service life
Operating at room temperature
42 Huawei Confidential
Storage Network Trend
AS-IS TO-BE
FC SAN and IP SAN Converged AI Fabric network
High network costs: The FC private network has low latency but high Reduced network costs: Open Ethernet carries high-performance, low-
costs. The IP SAN has low costs but high latency and poor performance. latency, and low-cost storage networks.
High O&M costs: IP SAN and FC SAN require dedicated O&M personnel Reduced O&M costs: No dedicated O&M skills are required, and unified
separately, and do not support cloud-and-network synergy network management is supported for data centers.
LAN Flexibility
Eth
Flexibility
No packet loss
NIC NIC
Low latency
FC SAN FC SAN
IP SAN IP SAN
10G Eth
IP FC
16G FC SAN iNIC iNIC
SAN SAN
10G IP SAN
Low cost Low latency
25/100G Eth
43 Huawei Confidential
History of Huawei Storage Products
2019
2017 First high-end
2015 Huawei OceanStor storage
2013 2nd-gen high- Dorado, fastest
2011 accelerated by AI
end storage all-flash storage
2008 1st-gen high- chips
2006 Launched self- end storage
2002 Launched 2 -nd
developed Interop Best
Released SmartMatrix
Dived into gen FC storage. HSSDs, pioneer architecture Best-in-class of of Show
self-
storage Founded in the all-flash the year Award
developed
technical IP SAN Huawei industry
research Symantec Co.,
Ltd.
Released self-
Launched developed Distributed Huawei
FC storage virtual storage clustered Launched T OceanStor V3
2003 NAS storage series
2007 unified storage First SAN&NAS Leader in Gartner Industry's first
2009 converged Magic Quadrant full-series Huawei
2012 storage for the first time
2014 NVMe all-flash OceanStor
2016 storage Pacific series
2018
2020
44 Huawei Confidential
Architecture of Huawei Intelligent Data Storage Products
Storage Database Big data Edge Intelligent data reduction
• AI-based prediction
Intelligent data reduction Intelligent data storage • Intelligent CPU and GPU reduction algorithms
• Deep • Intelligent • CPU/GPU • Intelligent • Intelligent • Intelligent
compression global acceleration tiering prefetch prediction Intelligent data storage
Intelligence prediction • Optimal media combination using technologies
Intelligent scheduling such as intelligent prefetch, data tiering, hotspot
• Container • Heterogeneous computing power • Near-data computing identification, and data caching
+ Intelligent scheduling
CPU
DRA NPU
SCM GPU
SSD • Dynamic management of heterogeneous
computing resources; near-data computing
Memory Fabric scheduling; quick start of containers
Hardware Network Network
chip chip
Memory Fabric: high-performance network centered
All IP on memory
• High-performance network with ns-level latency
Memory SSD
media
• Memory pooling and tiering
media
45 Huawei Confidential
Quiz
1. (Multiple-answer question) Which of the following are data types?
A. Structured data
B. Semi-structured data
C. Unstructured data
2. (Multiple-answer question) Which of the following statements about storage are correct?
A. Storage refers to disks.
C. Storage types include block storage, file storage, and object storage.
46 Huawei Confidential
Quiz
3. (Multiple-answer question) Which are characteristics of cloud storage?
A. Convergence
B. Open
C. Elasticity
D. Scale-up
4. (Multiple-answer question) Which of the following are the objectives of integrating AI into storage?
A. Simple
B. Efficient
D. Easy to use
47 Huawei Confidential
Summary
48 Huawei Confidential
More Information
Enterprise Huawei
Technical Enterprise
Support App Service App
49 Huawei Confidential
Recommendations
50 Huawei Confidential
Thank you. 把数字世界带入每个人、每个家庭、
每个组织,构建万物互联的智能世界。
Bring digital to every person, home, and
organization for a fully connected,
intelligent world.