Professional Documents
Culture Documents
1-1 Storage Technology Trends
1-1 Storage Technology Trends
5 Theory Course
Theory Course Overview
M1 Storage Technology Trends 1-1 Storage Technology Trends
1 Huawei Confidential
Storage Technology Trends
Foreword
1 Huawei Confidential
Objectives
2 Huawei Confidential
Contents
2. Data Storage
3 Huawei Confidential
What is Data
SNIA (Storage Networking Industry Association) defines data as the digital
representation of anything in any form.
Format in which data is stored
Email 0101001010100010000011
1100011100010001110001
1100000111101010100101
Digital music 0101001010100101001010
1001010101001010100010
1010010101001010101010
Digital video
0101010101010010100010
0101001010101010100101
Ebook 0101001010101010100101
0101010010100101001000
1010101001001010010010
4 Huawei Confidential
Data Types
Semi-
Structured structured Unstructured
data data data
5 Huawei Confidential
Data Processing Cycle
Data processing is the reorganization or reordering of data by humans or
machines to increase their specific value. A data processing cycle includes three
basic steps: input, processing, and output.
6 Huawei Confidential
What is Information
Information is processed, structured, or
rendered in a given context to make it
Processing Information
meaningful and useful.
7 Huawei Confidential
Data vs. Information
After being processed, data can be converted into information.
8 Huawei Confidential
Information Lifecycle Management
Information lifecycle management (ILM) refers to a set of management
theories and methods from the stage in which the information is generated and
initially stored to the stage where the information is obsoletely deleted.
Data value
9 Huawei Confidential
Contents
2. Data Storage
10 Huawei Confidential
What is Data Storage
Storage in a narrow sense Storage in a broad sense
11 Huawei Confidential
Data Storage System
12 Huawei Confidential
Physical Structure of Storage
Hosts
Storage application
software
The front-end board of
controllers
Cache
Storage
System The back-end board of Storage management
controllers software
Connectors
Disks
13 Huawei Confidential
Data Storage Types
Internal DAS
Storage SAN
Storage FAS
External NAS
Storage
14 Huawei Confidential
Evolution of Data Management Technologies
Distributed
Dedicated storage device
storage device
Manual
management
15 Huawei Confidential
Data Storage Application
Database servers
Users
Application
servers
Email servers
Offline
storage
File servers Online storage Nearline storage
Employees
Classification based on data access frequencies
16 Huawei Confidential
Contents
2. Data Storage
▫ Storage Media
▫ Interface Protocols
17 Huawei Confidential
History of Storage Architecture Development
2000s
1990s • Distributed
• Storage storage
1980s network • Cloud storage
• External
storage
1950s
• Traditional
storage
18 Huawei Confidential
From Disks to Disk Arrays
JBOD
Controllers
19 Huawei Confidential
From Separation to Convergence
File
Ethernet
system Server
SAN LAN
File
NAS SAN
system
Storage Storage
File
system
Storage
20 Huawei Confidential
Distributed Storage
Physical resources are organized using
software to form a high-performance
Front-end
logical storage pool, ensuring reliability service
network Management
and providing multiple storage services. network
21 Huawei Confidential
Storage Virtualization
Storage virtualization consolidates the Clients or servers
22 Huawei Confidential
Cloud Storage
The cloud storage system combines multiple storage devices, applications, and services. It uses
highly virtualized multi-tenant infrastructure to provide scalable storage resources for enterprises.
Those storage resources can be dynamically configured based on organization requirements.
Legacy New
applications applications
Converged
Elastic Block storage service File storage service Object storage service
23 Huawei Confidential
Contents
2. Data Storage
Storage Media
▫ Interface Protocols
24 Huawei Confidential
History of HDDs
Larger capacity with the smaller size.
25 Huawei Confidential
History of SSDs
Solid-state drives (SSDs) were invented almost as early as HDDs, but were not
popular at that time due to high price and the rapid development of HDDs at
the end of the 20th century.
With the requirement for high access speed, SSDs are booming.
• Bell Labs
1976 • SanDisk
1999 • Samsung
2010…
• Floating gate • Dataram sold launched flash • BiTMICRO released laptops • Lower costs
transistor Bulk Core. SSDs. launched flash using SSDs.
• Greater capacity
• 2 MB capacity • 20 MB capacity SSDs. • 32 GB capacity
• 18 GB capacity
1967 1991 2006
26 Huawei Confidential
Development of Flash Memory
27 Huawei Confidential
Contents
2. Data Storage
▫ Storage Media
Interface Protocols
28 Huawei Confidential
Interface Protocols
Disk interfaces connect disks to hosts.
29 Huawei Confidential
History of Interface Protocols
The first-gen FC
protocol was 2004 2008 2012 2016 2017 2018 2020…
released in 1994.
SATA 1.0
Disk interface SATA 3.0
4G FC
SAS 1.0 SAS 2.0 SAS 3.0 SAS 4.0
SATA 2.0
30 Huawei Confidential
NVMe and NVMe-oF
NVMe, Non-Volatile Memory Express
Improve the performance CPU CPU
31 Huawei Confidential
Contents
2. Data Storage
32 Huawei Confidential
History of Storage Products
Cloud
Media
HDD SSD
Architecture Trend
Centralized Distributed
All-flash Intelligence
Management
Manual O&M Intelligent O&M
33 Huawei Confidential
The Intelligence Era is Coming
34 Huawei Confidential
Challenges to Data Storage
24/7 µs-level
Time-consuming of Always-on Real-time, high-speed
RAID reconstruction services for all processing of production
Service things connected transactions in the 5G era
interruption due
to multiple points
of failure Finance High disk
Reliable Fast
failure rate
35 Huawei Confidential
Characteristics of Storage in the Intelligence Era
Storage in the intelligence
era
Intelligent data lifecycle
management
Storage for AI AI in storage
Data convergence
Zero data migration Data collaboration
Convergence of Simplified protocol stack and data-
SAN and NAS storage convergence
Intelligent storage tiering of hot, Compute-storage collaboration, on-
warm, and cold data demand capacity expansion
Multi-service convergence Dedicated hardware and
(block, file, and object) distributed storage
Hardware + Algorithm + Architecture = Efficient storage
Robust reliability Large capacity High performance
Device-level of 99.99999% PB-level to EB-level ms-level to µs-level
System-level of 99.999% Efficient deduplication & Intelligent distributed cache
compression
Solution-level reliability + Cost-effective media, warm and High-speed protocols
Cloud-level DR cold data storage and algorithms
Minimum cost and maximum value for per-bit data
36 Huawei Confidential
Data Storage Trend
Distributed
storage
Database Cloud
applications Blockchain
computing Storage in AI
Mainframe the
system
Private software
Hyper- Big data intelligenc
Traditional
and hardware
external
converged e era
solutions with infrastructure 5G
fully coupled storage (HCI) General-
computing, purpose
Brain-like
storage, and computing DNA Graph
Tensor computin
network computing computing computing
VM Container g
resources, x86
applicable only to
CXL HCCS
large RoCE/NVMe
organizations
FC IP
SAS IB Quantum dot
PCM MRAM
HDD SSD
37 Huawei Confidential
Optical Storage Technology
Long service High 100 GB+ per Low power Long-term 10 TB per
life reliability disk consumption stable storage disk
38 Huawei Confidential
DNA Data Storage
A small number of synthetic DNA molecules can store a large amount of data,
and can freeze, dry, transport, and store data for thousands of years.
High density
Strong stability
39 Huawei Confidential
Atomic Storage
In 1959, physicist Richard Feynman suggested that it was possible to use atoms to store
information if they could be arranged the way we wanted.
Because an atom is so small, the capacity of atomic storage will be much larger than that of the
existing storage medium in the same size.
With the development of science and technology, arranging the atoms the way we want has
become a reality.
40 Huawei Confidential
Quantum Storage
Now, information in electronic devices is stored and moved through the flow of electrons.
If electrons are replaced by photons, the movement of information within the computer may
occur at the speed of light.
Although the storage efficiency and service life are improved, the quantum storage is still difficult
to be widely applied at present.
Low noise
41 Huawei Confidential
Storage Network Trend
AS-IS TO-BE
FC SAN and IP SAN Converged AI Fabric network
High network costs: The FC private network has low latency but high Reduced network costs: Open Ethernet carries high-performance, low-
costs. The IP SAN has low costs but high latency and poor performance. latency, and low-cost storage networks.
High O&M costs: IP SAN and FC SAN require dedicated O&M personnel Reduced O&M costs: No dedicated O&M skills are required, and unified
separately, and do not support cloud-and-network synergy network management is supported for data centers.
LAN Flexibility
Eth
Flexibility
No packet loss
NIC NIC
Low latency
FC SAN FC SAN
IP SAN IP SAN
10G Eth
IP FC
16G FC SAN iNIC iNIC
SAN SAN
10G IP SAN
Low cost Low latency
25/100G Eth
42 Huawei Confidential
History of Huawei Storage Products
2019
2017 First high-end
2015 Huawei OceanStor storage
2013 2nd-gen high- Dorado, fastest
2011 accelerated by AI
end storage all-flash storage
2008 1st-gen high- chips
2006 Launched self- end storage
2002 Launched 2nd- developed Interop Best
Released SmartMatrix
Dived into gen FC storage. HSSDs, pioneer architecture Best-in-class of of Show
self-
storage Founded in the all-flash the year Award
developed
technical IP SAN Huawei industry
research Symantec Co.,
Ltd.
Released self-
Launched developed Distributed Huawei
FC storage virtual storage clustered Launched T OceanStor V3
2003 NAS storage series
2007 unified storage First SAN&NAS Leader in Gartner Industry's first
2009 converged Magic Quadrant full-series
2012 storage Huawei
for the first time NVMe all-flash
2014 OceanStor
2016 storage Pacific series
2018
2020
43 Huawei Confidential
Architecture of Huawei Intelligent Data Storage Products
Storage Database Big data Edge Intelligent data reduction
• AI-based prediction
Intelligent data reduction Intelligent data storage • Intelligent CPU and GPU reduction algorithms
• Deep • Intelligent • CPU/GPU • Intelligent • Intelligent • Intelligent
compression global acceleration tiering prefetch prediction Intelligent data storage
Intelligence prediction • Optimal media combination using technologies
Intelligent scheduling such as intelligent prefetch, data tiering, hotspot
• Container • Heterogeneous computing power • Near-data computing identification, and data caching
+
Intelligent scheduling
CPU
DRA NPU
SCM GPU
SSD • Dynamic management of heterogeneous
computing resources; near-data computing
Memory Fabric scheduling; quick start of containers
Hardware Network Network
chip chip
Memory Fabric: high-performance network centered
All IP on memory
• High-performance network with ns-level latency
Memory SSD
media
• Memory pooling and tiering
media
44 Huawei Confidential