Server Masters: Workload profiles

Technical Sales
1 hour
 Learning objectives

This module has been designed to help you:

– Discuss workload requirements and data growth with customers
– Identify typical hardware characteristics to run specific workloads

2 © Copyright 2018 Dell Inc

 Discussion

Why should you be discussing workloads with your customers?

3 © Copyright 2018 Dell Inc

 Tr a d i t i o n a l Cloud-native
applications applications
IT Investments $

IT transformation Digital transformation

Optimize IT for the business IT is the business

2000 2015 2030

4 4© Copyright 2018 Dell Inc

Server: Primary source of competitive advantage
Flexible
Flexible cost
cost structure
structure

Traditional
Traditional Comprehensive
Comprehensive
and
and emerging
emerging and
and enduring
enduring
workloads
workloads Modern IT infrastructure security
security

Server
Server
5 5© Copyright 2018 Dell Inc
How to build a
modern IT
infrastructure
1 ADAPT AND SCALE
to dynamic business needs

2 AUTOMATE
to sustain and grow

3 PROTECT your customers

and your business

6 6 © Copyright 2018 Dell Inc

 Workload characteristics

7 © Copyright 2018 Dell Inc

Workloads introduction

Most common workloads Hardware requirements

Server Business processing and Memory

virtualization OLTP
CPU
Virtual desktop High performance
Storage
infrastructure computing
Network
Unified communications Big data and
and collaboration analytics Rack density

Dell EMC Blueprint solutions on SalesEdge or Partner Central

8 © Copyright 2018 Dell Inc
 Server virtualization workloads

Hardware requirements

Memory
Workload characteristics
• Consolidation of workloads onto fewer physical machines
CPU
• High availability and recovery
• Improved CPU utilization
Storage
• Resource sharing
Network

Rack density

9 © Copyright 2018 Dell Inc

 Unified Communications and Collaboration workloads

Hardware requirements

Memory
Workload characteristics
• Backbone of communications infrastructure
CPU
• VOIP, presence, email, and file collaboration
• Peaks at login and lunch
Storage
• Random activity spikes
Network

Rack density

10 © Copyright 2018 Dell Inc

 Big data and analytics workloads

Hardware requirements

Memory
Workload characteristics CPU
• The four Vs: Volume, variety, velocity, veracity
• Resource ratio important Storage
• Requires fine tuning and customization for environment

Network

Rack density

11 © Copyright 2018 Dell Inc

 Business processing workloads
OLTP requirements
Memory
CPU

Workload characteristics Storage

Network
• SQL and Oracle database
Rack density
• ERP and CRM data
• Structured data Data warehousing requirements
• Online Transaction Processing Memory
• Data warehousing CPU
Storage
Network
Rack density

12 © Copyright 2018 Dell Inc

 VDI workloads

Hardware requirements

Memory
Workload characteristics
•
CPU (with GPU)
Consolidate and centralize client virtualization
• Sized for task workers, knowledge workers and power
users Storage
• Bootstorms
Network

Rack density

13 © Copyright 2018 Dell Inc

 HPC workloads

Hardware requirements

Memory
Workload characteristics
• Intensive calculations CPU
• Genomic sequencing, oil and gas, modeling, high
frequency trading
Storage
• Processing spread across multiple nodes
• GPU computational acceleration.
Network

Rack density

14 © Copyright 2018 Dell Inc

Hardware requirement comparison
Memory CPU Storage
Business processing (BPI) HPC Business processing
VDI VDI UC&C
Virtualization OLTP VDI
Big data Virtualization Big data
OLTP Business processing OLTP
HPC Big data Virtualization
UC&C UC&C HPC

Network Rack density

VDI Virtualization
HPC HPC
OLTP Big data
Big data VDI
UC&C UC&C
Business processing BPI
Virtualization OLTP
15 15 © Copyright 2018 Dell Inc
 Live Optics

Virtual Desktops and Apps are Expensive to

Design and Deliver

IT is cumbersome to setup and scale out

Secure and consistent experience across endpoints

is difficult to guarantee

16 © Copyright 2018 Dell Inc Live Optics login: https://app.liveoptics.com/

 #
1
Industry's #1
Server portfolio
PowerEdge

OpenManage – Intelligent automation systems management

Extreme scale
Towers Racks Modular
infrastructure
*Based on units sold (tie). IDC Worldwide Quarterly Server Tracker, Q1-Q3, 2016.

17 17 © Copyright 2018 Dell Inc The bedrock of the modern data center
Server solutions for every workload

Cloud providers, HCI

R640
PowerEdge

SQL, deep storage

R740 – 740XD
SAP HANA, genomics
R940
Virtualization, OLTP
M640 – FC640
Database, BI analytics, SDS
C6420
HPC, web tech, SDS

18 18 © Copyright 2018 Dell Inc IT transformation Digital transformation

 Summary

• In this module, we covered how to:

– Discuss workload requirements and data growth with customers
– Identify typical hardware characteristics to run specific workloads
• What questions do you have?

19 © Copyright 2018 Dell Inc

Support materials
 14G key technologies trend
12G 13G 14G
• > DDR4
• DDR3 • DDR4 • Persistent memory
Memory • NVDIMM-N
• 12Gb/s SAS
• More density
• Variety of chassis options • 6Gb/s SATA
• Storage tiering options
• Internal Dual SD Module • Options for more storage
• NMVe PCIe SSDs mainstream
• PCIe SSDs devices
• Intel 3D XPoint NVMe
Storage • NVMe PCIe SSDs
• PCIe Gen 3
• FPGA & GPU
• 4 x 10GE NDC
• New Options for vendor & • More low latency options
• Better troubleshooting
technology flexibility • RDMA, 25GE mainstream
• 100GE, FC32
• enable new FPGA, GPUs
I/O • 25GE NDC
• iDRAC Direct dedicated Micro-B
• iDRAC Direct USB port USB port
• LCD • Quick Sync mobile • Quick Sync 2 (BLE/WiFi)
management (NFC)
• Optional LCD, bezel-based
Management

21 © Copyright 2018 Dell Inc

PowerEdge R940
Today Next generation Differentiation Dell-EMC PowerEdge Best for

Ultra Performance
In memory DB

4 x PROCs, 6TB memory

4 x PROCs, 6TB memory,
NVDIMM persistent memory
SAP Hana

IO optimized

4 x PROCs, 24 x 2.5” Genomics

4 x PROCs, 4 x NVME, 10 x slots NVMe SSDs, 13 x16 IO slots

Super 2S,
compute optimized

N.A Virtualization
Dell EMC Unique: 2 x PROCs,
3TB of memory, 24 x 2.5”, NVMe SSDs

22 © Copyright 2018 Dell Inc

PowerEdge R740-R740xd
Today Next generation Differentiation Dell-EMC PowerEdge Best for

VDI
2 x DW GPUs – 16 x SSDs Ultra performance in memory DB
DW GPUs – 24 x SSDs

SQL
Compute & fast SSDs Ultra performance in memory DB
NVDIMM-N persistent memory

vSAN
Scale out storage tiering 1.8” Tiering NVDIMM-N persistent 25GbE Scale IO
to 3.5” memory, all flash NVME

Deep storage

Maximize cost effective

MSFT
Maximize cost effective
storage: 16 x 3.5” HDs storage: 18 x 3.5” HDs Exchange

23 © Copyright 2018 Dell Inc

PowerEdge R640
Today Next generation Differentiation Dell-EMC PowerEdge Best for

Cloud
N.A Chipset

Providers
SATA
Capacity optimized 4 x 3.5”

HCI
24 x 1.8” SATA SSDs for (10 + 2) x 2.5” cost effective
cost effective performance SSDs with up to 8 x NVMe SSDs 25GbE Scale IO

HFT, HPC,
4 x NVMe, 165W Processors Performance optimized,
CPU direct 8 x NVMe, 205W processors DB

24 © Copyright 2018 Dell Inc

 PowerEdge R540 Workloads
Today Next generation Differentiation Dell-EMC PowerEdge Best for

WebTech
Compute & fast SSDs Ultra performance, 14 x HDDs

Data
Scale out storage tiering 1.8” 16 x DIMMs, 14 x HDDs 25GbE Analytics
to 3.5”

MSFT
Maximize cost effective Maximize csot effective Exchange
storage: 16 x 3.5” HDs storage: 14 x 3.5” HDs

25 © Copyright 2018 Dell Inc

 PowerEdge R440 Workloads
Today Next generation Differentiation Dell-EMC PowerEdge Best for

Cloud
N.A Chipset

Providers
SATA
Capacity optimized 4 x 3.5”

HCI
1.8” SATA SSDs for cost 10 x 2.5” cost effective SSDs with
effective performance up to 4 x NVMe SSDs 25GbE Scale IO

HFT, HPC,
125W Processors Performance optimized,
CPU direct 4 x NVMe, 135W processors DB

26 © Copyright 2018 Dell Inc

 PowerEdge T640
Today Next generation Differentiation Dell EMC PowerEdge Best for

2 x Intel Broadwell, 4 active DW

VDI
Ultra performance with 27% more processing cores,
GPUs, 2400MT/s 2667MT/s passive 4 DW GPUs, 32 x SSDs

Performance optimized with 8 x NVMe and

Databases
4x NVMe, 4 x PCIe slots built-in room for growth with 8x PCIe slots

2x M.2 for Boot, 8 NVME drives and 16 SSDs,

SDS
Compute & fast SSDs,1GbE increased speed with 10GbE

Deep storage

27 © Copyright 2018 Dell Inc

 PowerEdge T440
Today Next generation Differentiation Dell EMC PowerEdge Best for

Web serving
Ultra performance with 2x Intel Scalable
2x Intel Broadwell Processors, 16 SSDs, 1 GPU

Print
Up to 512 GB memory with 16 DIMM slots
384GB memory, 12 DIMM slots and 4/8/16 HDDs/SSDs

Deep storage

MSFT
2x M.2 for Boot and 8 x 3.5” HDDs/SSDs
Maximize cost effective storage or 16 x 2.5” HDDs/SSDs Exchange

28 © Copyright 2018 Dell Inc

PowerEdge M640-FC640
Today Next Generation Differentiation Dell-EMC PowerEdge Best For
3.2TB SSD
2 x Intel Broadwell MS Exchange
M630p / VRTX Over 2k users
Email resiliency
900GB Sled Storage M640p 2xM.2 for Boot

3.2TB SSD
2 x Intel Broadwell SQL server
M630 / M1000e Databases and BI
Universal BP/ *Intel Apache pass Analytics
900GB Sled Storage M640

2 x Intel Broadwell 2TB Memory

Virtual SAN
*Intel Apache Pass: Up To 4 Virtualization
1.5TB Memory
2xM.2 for Boot/HW RAID 1 In-Memory OLTP
FC640
*Post RTS

29 © Copyright 2018 Dell Inc

 FX2 provides unparalleled workload flexibility
Traditional Hosting / HPC SDDC

Performance Virtualization Dense Webservers

FC630 FC630 FM120 FM120 FC630 FC630
FM120 FM120 FD332 FD332
FC630 FC630
FM120x4 (4X 4X1S) FC630 (2 x 2S) + FD332 (2X)
FC630 (4X 2S )
(1S Micro-servers/16 in 2U)
Dense Performance Computing Virtual SAN, Small Hadoop Cluster
Dense HPC/HTC
FC830 FC430 FC430 FC430 FC430 FC430 FC430 FC430 FC430

FC830 FC430 FC430 FC430 FC430 FD332 FD332

FC830 (2 x 4S) FC430 (8x 2S w/IB) FC430 (4 x 2S) + Storage

Performance Database Dense Virtualization Dense Direct Attached Storage

FC830 FC430 FC430 FC430 FC430 FC630 FD332
FC630 FC630 FC430 FC430 FC430 FC430 FD332 FD332

FC830 (1 x 4S) + 2x FC630 FC430 (8 x 2S) FC630 (1 X 2S ) + Storage

30 © Copyright 2018 Dell Inc

PowerEdge C6420
Today Next generation Differentiation Dell-EMC PowerEdge Best for

High
Performance
No HDs with backplane EDR, Omni-path, 10/25/40 GbE
HPC cost optimized, M.2 boot, no backplane Direct Liquid Cooling
Computing

Web Tech &

Big Data
24 x 2.5” 2 x NMVe per sled for cache performance
All flash storage + PERC portfolio, M.2 boot 10/25/40 GbE
Analytics

Private
12 x 3.5” 2 x NMVe per sled (in 2.5” chassis only) for cache performance
Cloud/HCI/
All flash storage + PERC portfolio, M.2 boot 10/25/40 GbE
SDS

31 © Copyright 2018 Dell Inc

PowerEdge C4140
Workload & Configurations
 Oil & Gas (typical C4140 - B configuration)
Example application – Reverse Time Migration (RTM)
Characteristics
This customer is typically interested in performance above all
Optimum for this customer would be Configuration B – it delivers high performance
Long accelerator jobs & Low CPU I/O needs
If I/O throughput is a concern, the customer
can use NVMe on a card in one of the
available rear slots.

Typical Configuration:
CPU: 2 x 6130 CPU (16 core) Configuration B
Memory: 192 GB min (or more*)
GPU: 4 4 GPU, Switch, Dual CPU
IO: InfiniBand, Omnipath, or Ethernet
PCI topology: 4-x16 to GPUs
2-x16 to rear I/O

*Total system memory should be greater than the capacity of the (typically) 4 GPUs
33 © Copyright 2018 Dell Inc
 Molecular Dynamics (typical C4140 - K configuration)
Example application – HOOMD-Blue
Characteristics
This customer is typically interested in peer to peer GPU-GPU performance
Optimum for this customer would be Configuration K – it delivers high performance
NVLinkTM is a proprietary solution by NVIDIA that allows for direct GPU to GPU communication
NVLinkTM is 25Gbps versus PCIe at 8Gbps

NVLinkTM
Typical Configuration:
Topology Configuration K
CPU: 2 x 6130 CPU (16 core)
Memory: 192 GB min (or more) NVLinkTM
GPU: 4
IO: InfiniBand, Omnipath, or Ethernet
PCI topology: 4-x16 to GPUs
2-x16 to rear I/O

34 © Copyright 2018 Dell Inc

 Financial Services (typical C4140 - C configuration)
Example applications - Monte Carlo, Risk Modeling (but not High Frequency Trading)
Characteristics:
This customer is not interested in using the PCI switch configuration – there is no GPU interaction in these environments.
Optimum for this customer would be Configuration C – that balances GPU, Memory, and IO
Total system memory should be greater than the capacity of the (typically) 4 GPUs

Typical Configuration:
CPU: 2 x 6130 CPU
Memory: 192 GB min
Configuration C
GPU: 4
IO: Ethernet, InfiniBand or Omnipath
PCI topology: 4X-x16 to GPUs (Post RTS)
2X-x16 to rear I/O

35 © Copyright 2018 Dell Inc

 Higher Education (University) / Research
Example application – Multiple, different projects, applications, departments, “HPC for everyone”
Characteristics
This customer needs to satisfy a wide variety of “customers”. Needs performance plus flexibility.
Optimum for this customer would be configuration G– with the PCI switch for fast GPU to GPU communication.
The 1 CPU configuration C is an lower cost-to-performance option (switch).
If I/O throughput is a concern, the customer
can use NVMe on a card in one of the
available rear slots.

Typical Configuration
CPU: 2 x 6130 CPU (16 core) Configuration G
Memory: 192 GB min
GPU: 4 (Post RTS)
IO: Omnipath. InfiniBand or Ethernet
PCI topology: 4-x16 to GPUs 4 GPU, 2 Virtual switches, Dual CPU
2-x16 to rear I/O

36 © Copyright 2018 Dell Inc

 Deep Learning Training
Example application – Caffe, TensorFlow, CNTK
Characteristics
This customer is typically interested in peer to peer GPU-GPU performance
In addition, balanced IO between CPU/GPU
Optimum for this customer would be Configuration L – it delivers high performance
NVLinkTM is a proprietary solution by NVIDIA that allows for direct GPU to GPU communication
NVLinkTM is 25Gbps versus PCIe at 8Gbps

Typical Configuration NVLinkTM

CPU: 2 x 6130 CPU (16 core) Topology Configuration L
Memory: 192 GB min
GPU: 4 (Post RTS)
IO: Omnipath. Ethernet, Infiniband
PCI topology: 4-x16 to GPUs NVLinkTM
2-x16 to rear I/O

37 © Copyright 2018 Dell Inc