Download as pdf or txt
Download as pdf or txt
You are on page 1of 51

Storage Technology Trends

Foreword

 Data carries information during the transmission on networks. What is the


relationship between information and data? What is the function of data
storage? This course describes the definition of information and data in the
computer field, their relationship, as well as the concept, development
history, and development trend of data storage.

2 Huawei Confidential
Objectives

On completion of this course, you will be able to understand:


 Definition of information and data
 Concept of data storage
 History of data storage
 Development trend of data storage products

3 Huawei Confidential
Contents

1. Data and Information

2. Data Storage

3. Development of Storage Technologies

4. Development Trend of Storage Products

4 Huawei Confidential
What is Data
 SNIA (Storage Networking Industry Association) defines data as the digital
representation of anything in any form.
Format in which data is stored
Email 0101001010100010000011
1100011100010001110001
1100000111101010100101
Digital music 0101001010100101001010
1001010101001010100010
1010010101001010101010
Digital video
0101010101010010100010
0101001010101010100101
Ebook
0101001010101010100101
0101010010100101001000
1010101001001010010010

5 Huawei Confidential
Data Types

Semi-
Structured structured Unstructured
data data data

6 Huawei Confidential
Data Processing Cycle
 Data processing is the reorganization or reordering of data by humans or
machines to increase their specific value. A data processing cycle includes three
basic steps: input, processing, and output.

Input Processing Output

7 Huawei Confidential
What is Information
 Information is processed, structured, or
rendered in a given context to make it
Processing Information
meaningful and useful.
 Information is processed data, including
data with context, relevance, and
Data
purpose. It also involves the manipulation
of raw data.
Data
Redundancy

8 Huawei Confidential
Data vs. Information
 After being processed, data can be converted into information.
 In order to be stored and transmitted in IT systems, information need to be
processed as data.

Item Data Information


Raw and meaningless, with no
Feature Valuable and logical
specific purpose
Essence Original materials Processed data
Dependence Data never depend on information Information depends on data
Meteorological data or satellite
Example Weather forecasts
image data

9 Huawei Confidential
Information Lifecycle Management
 Information lifecycle management (ILM) refers to a set of management
theories and methods from the stage in which the information is generated and
initially stored to the stage where the information is obsoletely deleted.

Data value

Data Data Data Data Data Data


creation protection access migration archiving destruction

10 Huawei Confidential
Contents

1. Data and Information

2. Data Storage

3. Development of Storage Technologies

4. Development Trend of Storage Products

11 Huawei Confidential
What is Data Storage
Storage in a narrow sense Storage in a broad sense

12 Huawei Confidential
Data Storage System

 Disaster recovery (DR) solutions


 Backup solutions

 Storage management software


Solutions
 Snapshot and mirroring software
 Backup software
 Multipathing software
Storage software
 Storage devices  Connection elements
 Disk array  HBA cards
 Tape library  Switches
Storage hardware  Virtual tape  Cables
library  ……
 ……

13 Huawei Confidential
Physical Structure of Storage
Hosts

Network switching devices NAS gateway

Storage application
software
The front-end board of
controllers

Cache
Storage
System The back-end board of Storage management
controllers software

Connectors

Disks

14 Huawei Confidential
Data Storage Types

Internal DAS
Storage SAN
Storage FAS
External NAS
Storage

15 Huawei Confidential
Evolution of Data Management Technologies
Distributed
Dedicated storage device
storage device

Tape and single


disk
Big data
management
Card and paper Traditional
tape database
File system system
management management

Manual
management

16 Huawei Confidential
Data Storage Application

Database servers
Users
Application
servers

Email servers

Offline
storage
File servers Online storage Nearline storage
Employees
Classification based on data access frequencies

Data Data Data


generation processing management

17 Huawei Confidential
Contents

1. Data and Information

2. Data Storage

3. Development of Storage Technologies


 Storage Architecture

▫ Storage Media

▫ Interface Protocols

4. Development Trend of Storage Products

18 Huawei Confidential
History of Storage Architecture Development

2000s
1990s • Distributed
• Storage storage
1980s network • Cloud storage
• External
storage
1950s
• Traditional
storage

19 Huawei Confidential
From Disks to Disk Arrays

Disks in a server Early external storage Storage arrays


Server Server Server

CPU CPU CPU

RAM RAM RAM

Disks Disks Disks

JBOD
Controllers

20 Huawei Confidential
From Separation to Convergence

SAN NAS Clients Unified


Storage
Server Server
Ethernet
File
system Server

SAN LAN

File
NAS SAN
system
Storage Storage
File
system
Storage

21 Huawei Confidential
Distributed Storage
 Physical resources are organized using
software to form a high-performance
Front-end
logical storage pool, ensuring reliability service
network Management
and providing multiple storage services. network

 Generally, distributed storage scatters


data to multiple independent storage
servers in a scalable system structure. It
uses those storage servers to share
...
storage loads and uses location servers
to locate storage information. Node Node Node Node

Back-end storage network

22 Huawei Confidential
Storage Virtualization
 Storage virtualization consolidates the Clients or servers

storage devices into logical resources,


thereby providing comprehensive and
unified storage services. Management
 Unified functions are provided Logical resources
regardless of different storage forms
and device types.
Virtualization
Physical resources

23 Huawei Confidential
Cloud Storage
 The cloud storage system combines multiple storage devices, applications, and services. It uses
highly virtualized multi-tenant infrastructure to provide scalable storage resources for enterprises.
Those storage resources can be dynamically configured based on organization requirements.

Legacy New
applications applications

Protocol and interface

Converged
Elastic Block storage service File storage service Object storage service

Open Storage device and storage node

Universal hardware platforms

24 Huawei Confidential
Contents

1. Data and Information

2. Data Storage

3. Development of Storage Technologies


▫ Storage Architecture
 Storage Media

▫ Interface Protocols

4. Development Trend of Storage Products

25 Huawei Confidential
History of HDDs
 Larger capacity with the smaller size.

1950s–1960s 1960s–1970s 1970s–1980s 1980s-1990s 1990s-


Giant disk 14-inch disk 8-inch disk Portable Microdrive
IBM 350 RAMAC IBM 3340 Disks started to 5.25-inch 1.8-inch
IBM 1301 enter the civil 3.5-inch Hitachi: 1-inch
market 2.5-inch Toshiba: 0.85-
inch
...

26 Huawei Confidential
History of SSDs
 Solid-state drives (SSDs) were invented almost as early as HDDs, but were not
popular at that time due to high price and the rapid development of HDDs at
the end of the 20th century.
 With the requirement for high access speed, SSDs are booming.

• Bell Labs
1976 • SanDisk
1999 • Samsung
2010…
• Floating gate • Dataram sold launched flash • BiTMICRO released laptops • Lower costs
transistor Bulk Core. SSDs. launched flash using SSDs.
• Greater capacity
• 2 MB capacity • 20 MB capacity SSDs. • 32 GB capacity
• 18 GB capacity
1967 1991 2006

27 Huawei Confidential
Development of Flash Memory

Single-level Quad-level cell


cell (SLC): fast Triple-level cell (QLC): larger
read/write and (TLC): mature and cheaper,
long service mainstream applicable to
life technology warm data

Multi-level cell 3D TLC:


(MLC): improve the
moderate storage density
read/write through multi-
speed and layer
service life overlaying

28 Huawei Confidential
Contents

1. Data and Information

2. Data Storage

3. Development of Storage Technologies


▫ Storage Architecture

▫ Storage Media
 Interface Protocols

4. Development Trend of Storage Products

29 Huawei Confidential
Interface Protocols
 Disk interfaces connect disks to hosts.
 Interface protocols refer to the communication modes and requirements that
interfaces for exchanging information must comply with.

Parallel interface Serial interface

30 Huawei Confidential
History of Interface Protocols

100G NVMe-oF 400G


Ethernet NVMe-oF 1.0 (FC-NVMe) Ethernet
Host interface (RDMA) NVMe-oF 1.1
(TCP) 64G FC
2G FC iSCSI 4G FC 8G FC 16G FC 32G FC

The first-gen FC
protocol was 2004 2008 2012 2016 2017 2018 2020…
released in 1994.

SATA 1.0
Disk interface SATA 3.0
4G FC
SAS 1.0 SAS 2.0 SAS 3.0 SAS 4.0
SATA 2.0

NVMe 1.0 NVMe 1.2 NVMe 1.3 NVMe 1.4

31 Huawei Confidential
NVMe and NVMe-oF
 NVMe, Non-Volatile Memory Express
 Improve the performance CPU CPU
 Reduce the latency PCIe PCIe
 NVMe-oF, NVMe over Fabrics
SAS Controller
 Potential: low latency and high
SAS Expander
bandwidth
 Purpose: accelerate the data
transmission among the storage NVMe back-end SAS back-end
physical path physical path
network

32 Huawei Confidential
Contents

1. Data and Information

2. Data Storage

3. Development of Storage Technologies

4. Development Trend of Storage Products

33 Huawei Confidential
History of Storage Products

Cloud
Media
HDD SSD

Architecture Trend
Centralized Distributed

All-flash Intelligence
Management
Manual O&M Intelligent O&M

34 Huawei Confidential
The Intelligence Era is Coming

Steam Age Electricity Age Information Age Intelligence Age

Industry Cloud Service extension


computing AI
Network coordination
Agriculture
+ Data + Intelligence
Internet
IoT
Intelligent production

Service Big data Customization

35 Huawei Confidential
Challenges to Data Storage
24/7 µs-level
Time-consuming of Always-on Real-time, high-speed
RAID reconstruction services for all processing of production
Service things connected transactions in the 5G era
interruption due
to multiple points
of failure Finance High disk
failure rate Reliable Fast

Gov & Public Large


enterprise
Low data
deduplication and
compression ratio Large Efficient
Carrier Transportation

EB-level TCO reduction


Energy & Electricity Unstable latency
Data monetized as Edge-center-cloud
under high assets and intelligent synergy, minimizing
Inefficient convergence of concurrency storage tiering, the per-bit data cost
block, file, and object turning cold data to and maximizing the
services warm data to mine value
data value

36 Huawei Confidential
Characteristics of Storage in the Intelligence Era
Storage in the intelligence
era
Intelligent data lifecycle
management
Storage for AI AI in storage

Data convergence
Zero data migration Data collaboration
Convergence of Simplified protocol stack and data-
SAN and NAS storage convergence
Intelligent storage tiering of hot, Compute-storage collaboration, on-
warm, and cold data demand capacity expansion
Multi-service convergence Dedicated hardware and
(block, file, and object) distributed storage
Hardware + Algorithm + Architecture = Efficient storage
Robust reliability Large capacity High performance
Device-level of 99.99999% PB-level to EB-level ms-level to µs-level
System-level of 99.999% Efficient deduplication & Intelligent distributed cache
compression
Solution-level reliability + Cost-effective media, warm and High-speed protocols
Cloud-level DR cold data storage and algorithms
Minimum cost and maximum value for per-bit data

37 Huawei Confidential
Data Storage Trend
Distributed
storage

Database Cloud
applications Blockchain
computing Storage in AI
Mainframe the
system
Private software
Hyper- Big data intelligenc
Traditional
and hardware
external
converged e era
solutions with infrastructure 5G
fully coupled storage (HCI) General-
computing, purpose
Brain-like
storage, and computing DNA Graph
Tensor computin
network computing computing computing
VM Container g
resources, x86
applicable only to
CXL HCCS
large RoCE/NVMe
organizations
FC IP
SAS IB Quantum dot
PCM MRAM
HDD SSD

Biomolecule Optical storage

38 Huawei Confidential
Optical Storage Technology

Blu-ray storage Gold nanostructured glass

Long service High 100 GB+ per Low power Long-term 10 TB per
life reliability disk consumption stable storage disk

50 years >>> 600 years

39 Huawei Confidential
DNA Data Storage
 A small number of synthetic DNA molecules can store a large amount of data,
and can freeze, dry, transport, and store data for thousands of years.
 Advantages of using DNA as storage media:
 Small size
 High density
 Strong stability
 Bottlenecks and limitations:
 High costs of DNA molecular synthesis
 Slow data read and search

40 Huawei Confidential
Atomic Storage
 In 1959, physicist Richard Feynman suggested that it was possible to use atoms to store
information if they could be arranged the way we wanted.
 Because an atom is so small, the capacity of atomic storage will be much larger than that of the
existing storage medium in the same size.
 With the development of science and technology, arranging the atoms the way we want has
become a reality.
 Bottlenecks and limitations:
 Strict requirements on the operating environment.

41 Huawei Confidential
Quantum Storage
 Now, information in electronic devices is stored and moved through the flow of electrons.
 If electrons are replaced by photons, the movement of information within the computer may
occur at the speed of light.
 Although the storage efficiency and service life are improved, the quantum storage is still difficult
to be widely applied at present.
 Quantum storage cannot meet the following requirements:
 High storage efficiency
 Low noise
 Long service life
 Operating at room temperature

42 Huawei Confidential
Storage Network Trend
AS-IS TO-BE
FC SAN and IP SAN Converged AI Fabric network
High network costs: The FC private network has low latency but high Reduced network costs: Open Ethernet carries high-performance, low-
costs. The IP SAN has low costs but high latency and poor performance. latency, and low-cost storage networks.
High O&M costs: IP SAN and FC SAN require dedicated O&M personnel Reduced O&M costs: No dedicated O&M skills are required, and unified
separately, and do not support cloud-and-network synergy network management is supported for data centers.

LAN Flexibility
Eth
Flexibility
No packet loss
NIC NIC
Low latency
FC SAN FC SAN
IP SAN IP SAN
10G Eth
IP FC
16G FC SAN iNIC iNIC
SAN SAN
10G IP SAN
Low cost Low latency
25/100G Eth

43 Huawei Confidential
History of Huawei Storage Products
2019
2017 First high-end
2015 Huawei OceanStor storage
2013 2nd-gen high- Dorado, fastest
2011 accelerated by AI
end storage all-flash storage
2008 1st-gen high- chips
2006 Launched self- end storage
2002 Launched 2 -nd
developed Interop Best
Released SmartMatrix
Dived into gen FC storage. HSSDs, pioneer architecture Best-in-class of of Show
self-
storage Founded in the all-flash the year Award
developed
technical IP SAN Huawei industry
research Symantec Co.,
Ltd.

Start out Grow Lead

Released self-
Launched developed Distributed Huawei
FC storage virtual storage clustered Launched T OceanStor V3
2003 NAS storage series
2007 unified storage First SAN&NAS Leader in Gartner Industry's first
2009 converged Magic Quadrant full-series Huawei
2012 storage for the first time
2014 NVMe all-flash OceanStor
2016 storage Pacific series
2018
2020

44 Huawei Confidential
Architecture of Huawei Intelligent Data Storage Products
Storage Database Big data Edge Intelligent data reduction
• AI-based prediction
Intelligent data reduction Intelligent data storage • Intelligent CPU and GPU reduction algorithms
• Deep • Intelligent • CPU/GPU • Intelligent • Intelligent • Intelligent
compression global acceleration tiering prefetch prediction Intelligent data storage
Intelligence prediction • Optimal media combination using technologies
Intelligent scheduling such as intelligent prefetch, data tiering, hotspot
• Container • Heterogeneous computing power • Near-data computing identification, and data caching
+ Intelligent scheduling
CPU
DRA NPU
SCM GPU
SSD • Dynamic management of heterogeneous
computing resources; near-data computing
Memory Fabric scheduling; quick start of containers
Hardware Network Network
chip chip
Memory Fabric: high-performance network centered
All IP on memory
• High-performance network with ns-level latency
Memory SSD
media
• Memory pooling and tiering
media

All IP: extremely low cost of SSD media


• In-depth disk-controller collaboration,
DRAM SCM SLC/QLC QLC/OLC SLC/QLC/OLC evolution
ns µs 50 µs 200 µs • All IP to build an ultra-simplified network

Edge Production Analysis Backup Archive

45 Huawei Confidential
Quiz
1. (Multiple-answer question) Which of the following are data types?
A. Structured data

B. Semi-structured data

C. Unstructured data

D. Massive amounts of data

2. (Multiple-answer question) Which of the following statements about storage are correct?
A. Storage refers to disks.

B. A storage system consists of storage hardware, software, and solutions.

C. Storage types include block storage, file storage, and object storage.

D. File storage is used to store data of data applications.

46 Huawei Confidential
Quiz
3. (Multiple-answer question) Which are characteristics of cloud storage?
A. Convergence

B. Open

C. Elasticity

D. Scale-up

4. (Multiple-answer question) Which of the following are the objectives of integrating AI into storage?
A. Simple

B. Efficient

C. High power consumption

D. Easy to use

47 Huawei Confidential
Summary

Data and Information

Data Storage Storage Architecture


Trend of Storage
Technologies
Storage Technologies Storage Media

Storage Products Interface Protocols

48 Huawei Confidential
More Information

Enterprise Huawei
Technical Enterprise
Support App Service App

49 Huawei Confidential
Recommendations

 Huawei official websites


 Enterprise business: https://e.huawei.com/en/
 Technical support: https://support.huawei.com/enterprise/en/index.html
 Online learning: https://www.huawei.com/en/learning
 Popular tools
 HedEx Lite
 Network Document Tool Center
 Information Query Assistant

50 Huawei Confidential
Thank you. 把数字世界带入每个人、每个家庭、
每个组织,构建万物互联的智能世界。
Bring digital to every person, home, and
organization for a fully connected,
intelligent world.

Copyright©2020 Huawei Technologies Co., Ltd.


All Rights Reserved.

The information in this document may contain predictive


statements including, without limitation, statements regarding
the future financial and operating results, future product
portfolio, new technology, etc. There are a number of factors that
could cause actual results and developments to differ materially
from those expressed or implied in the predictive statements.
Therefore, such information is provided for reference purpose
only and constitutes neither an offer nor an acceptance. Huawei
may change the information at any time without notice.

You might also like