Professional Documents
Culture Documents
16G Intel PowerEdge R660 and R760 Features Participant Guide PDF
16G Intel PowerEdge R660 and R760 Features Participant Guide PDF
16G Intel PowerEdge R660 and R760 Features Participant Guide PDF
PARTICIPANT GUIDE
PARTICIPANT GUIDE
16G Intel PowerEdge R660 and R760 Features - PG
Platform Overview 6
Platform Overview 7
Platform Introduction 7
Internal Component 11
Platform Restrictions 17
Scavenger Hunt Activity 18
Enhanced Features 20
Configuration Options 35
Storage Configuration 36
BOSS-N1 and E3.S Storage 39
Expansion Card Risers Slots 42
R760 Riser Configurations 43
R660 Riser Configurations 46
PCIe Slot Considerations 47
Scavenger Hunt Activity 49
Heat Sink Assembly Design 51
Liquid Cooling Module 52
Air Shroud Support 56
Fans 58
Appendix 61
Platform Overview
Platform Introduction
Benefits of R760
Benefits of R660
Internal Component
The graphics show the internal components of each system along with a
table that adds a brief description. The course covers many of the
components in detail. Each graphic shows only one configuration option.
See the FSM for more options.
R760
The table lists the components inside the PowerEdge R760 chassis.
R660
The table lists the components inside the PowerEdge R660 chassis.
The graphic shows an R660 with a single CPU and without riser 2.
Tip: Graphics are excerpts from the FSM. See the FSM
attached in the Resources tab for additional system views
such as shrouds and extended risers.
Platform Restrictions
Components Description
Instructions
Activity
Question
What front bay storage options are available for PowerEdge R760?
Question
What rear bay storage options are available for PowerEdge R760?
1:
2:
3:
4:
• PERC H965i adapter and front PERC H965i supports PCIe Gen 4 with
X16 lanes.
• PERC 12 does not support Gen 5.
• Supports 8 GB DDR4 with 3200 MT/s cache.
• SAS/SATA supports maximum drive along with 16 drives per controller
but without SAS expander.
• NVMe supports maximum of 8 drives per controller.
• Supports SAS 4 with speeds of 22.5 Gbps, 12 Gbps SAS, and 6 Gbps
SATA/SAS.
• NVMe drives are supported at PCIe Gen 4 speeds.
5:
• E3.S form factor supports PCIe Gen5 NVMe drives, which double the
bandwidth over Gen 4 NVMe.
6:
7:
8:
CPU attributes:
• Clock Speed (GHz) is the processor speed, which is calculated by the
number of clock cycles that are managed per second.
• Core count is the number of compute cores available on a CPU,
determining the compute capability of a CPU.
• Thermal Design Power (TDP) is the power target of the CPU or
wattage that the CPU runs.
DDR5
The image illustrates the high-level DDR5 implementation plan for the 2-
socket platform with two slots per channel. The convention is to have
DIMM slot 0 further away from the CPU than slot 1 within the same
channel. Use the optimized population order:
DDR5 implementation plan for the 2-socket platform with two slots per channel.
The latest PCIe Gen5 enabled Nvidia GPU1s, and NVMe drives offer
highest throughput on largest datasets. GPU density maximizes
performance for accelerated environments. GPU use cases include:
1GPU blank is required for empty slots or non-GPU cards or half length
(HL) A2 GPU.
Network Cards
The system allows a customizable port choice for the OCP cards as well
as up to two embedded 1Gbe Network Interface Controller (NIC) ports on
the LAN on Motherboard (LOM) card. Network cards are supported based
on the system configuration. On the 16G platforms, the LOM and OCP
cards are both optional, but a system will ship with either a LOM or OCP
card in the system.
Feature Specifications
LOM card 1 GB x 2
DPU Architecture.
The OCP NIC card supports OCP 3.0. The NIC ports are integrated on the
OCP card which connects to the system board.
Feature Support
Maximum of Ports 4
Storage Configuration
R760
R660
Backplane
The PowerEdge R760 supports hard drives options with 2.5 inch (x 8)
SAS or SATA backplane. The drives plug into the front of the backplane
and a lever secures the drive in place.
8 x 2.5 inch drive backplane showing the data side of the backplane.
BOSS-N1
Dell Boot Optimized Storage Solution (BOSS) is the RAID controller card
that offers expandable storage capacity to improve the performance of the
server systems. BOSS-N1 is the latest version of BOSS. The double
module channel provides high-speed connectivity for one or two NVMe
M.2 drive modules.
BOSS-N1.
E3.S Drives
E3.S drives.
E3.S drives or the Enterprise and Data Center Small Form Factor
(EDSFF) is an SSD design for NAND and Storage Class Memory (SCM).
E3.S drives optimize storage in enterprise, private, and public data
centers.
Benefits of E3 drives:
• Density and improved packaging in space constrained servers.
• Double the performance over NVMe Gen4.
• Optimized for high-speed signal and more lanes.
Slots noted with orange are assigned to CPU1. Slots noted with blue are
assigned to CPU 2.
Configuration 1
6 x8 FH and 2 x16 LP
Configuration 9
3 x8 FH (Gen5) + 1 x16 LP
Configuration 10
Configuration 11
2 x16 LP + 2 x8 FH
Configuration 12
2 x16 LP + 4 x8 FH (Gen5)
FH - full height
HH - half height
LP - low profile
HL - half length
FL - full length
Slots noted with orange are assigned to CPU1. Slots noted with blue are
assigned to CPU 2. Slots noted with a red dot indicate Gen 5.
Configuration 7
Riser configuration R3P: Slot 3: HL, low profile, CPU2 - PCIe Gen5 x16
Configuration 8
Riser configuration R2A: Slot 1: HL, low profile, CPU1 - PCIe Gen3/Gen4
x16 (x16 connector)
Riser R2A.
Configuration 9
• Slot 1: HL, low profile, CPU1 - PCIe Gen5 x16 (x16 connector)
• Slot 3: HL, low profile, CPU2 - PCIe Gen5 x16 (x16 connector)
Configuration 10
The expansion cards with the highest priority should be installed first using
the slot priority. All the other expansion cards should be installed in the
card priority and slot priority order. The table provides guidelines for
installing expansion cards to ensure proper cooling and mechanical fit.
The table lists the card type, slot priority, and maximum card supported.
(Mellanox) NIC:100Gb 5, 7, 1, 2 1
(Intel) NIC:100Gb 6, 3 2
Table 1: Configuration: R1R + R2A + R3A + R4P
Instructions
Activity
Question
Can both a LOM card and OCP card be installed on the same PowerEdge
R760?
Answer: Yes. The system allows either LOM card or an OCP card or both
to be installed in the system. See the note in the NIC port specifications.
Question
Processor Heatsink Module (PHM) combines the processor and heat sink
into a single unit prior to installation. The torsion wires on the bolster plate
secures the connection. Benefits include reduced socket contact damage,
and minimal board keep - out space.
Graphic showing the heat sink assembly components using a 2U high performance heat
sink.
• PHM
• Bolster plate assembly
• Back plate assembly
Photograph of heatsinks.
R760 and R660 includes the latest Direct Liquid Cooling (DLC). The
optional DLC solution absorbs the generated heat using a coolant that
assembly.
• Two liquid leak sensor (LLS) boards, one for each CPU with tubes
connecting to the external liquid cooling system
• An alert cable or detection cable
The Liquid Cooling Rear I/O (LC RIO) board is unique to liquid-cooled
PowerEdge servers that follow the monolithic architecture.
LC RIO attributes:
• The LC RIO board is smaller than the standard rear I/O board.
• The VGA port cable is a default optional kit with the LC RIO board.
The air shroud directs the airflow across the entire system, prevents the
system from overheating, maintains uniform airflow inside the system.
• Regular Shroud — Standard Air Shroud for Non-GPU and for Liquid
cooling
• Regular Shroud Rear Drive Shroud — Used on air cooling system
with 2x 2.5" rear drive configuration
• General-Purpose Graphics Processing Unit (GPGPU) Shroud —
For GPU configurations
Fans
The image illustrates the fans supported on the R760 and R660.
HPR and VHP fans provide a higher air flow rate through the system. For
certain single CPU configurations only three fan modules are required and
in such configurations a fan blank is required to block fan bay 1. System
should have the correct fan type. Any standard fan can upsell to high
performance fan.
1. You need to replace the heat sink on a PowerEdge R760. The system
has a GPU configuration. What type of heat sink must be ordered as a
replacement? Use the activity FSM to help answer the question.
a. 1U L-type HPR HSK
b. 2U HPR HSK
c. 1U STD HSK
d. 2U L-type HPR HSK
Answer: The 1U L-type HPR HSK heat sink. The 1U and 2U heat sinks
are for non-GPU configurations. See the Processor and heat sink matrix.
PCIe slots Max 5: Gen4 PCIe slots Max 3: Gen4 PCIe slots
(3) ; Gen5 PCIe slots (3)
(2)
provides 12V to the end devices such as GPUs. The PUCK requires two
connected power cables to prevents an over current condition when only
one cable is connected.
OCP cable.
Supported Heatsinks
Heatsinks.
15G
Generation 15 modifier to distinguish different features available for
generation 15 servers.
2S
Two socket form factor. Used to identify the family of servers. PowerEdge
servers can have 1S, 2S, or 4S. See the PowerEdge rack server portfolio
page for details.
AI
Artificial Intelligence (AI) is the designing and building of intelligent agents
that receive precepts from the environment and act to affect that
environment.
AI Inferencing
Machine learning inferencing is the ability of a system to make predictions
from novel data. ML Inferencing teaches an AI to sort different fruits by
color. The user shows the AI a tomato, apple, and cherry to learn the fruits
are red. Later, when showing the AI a strawberry, it can infer the
strawberry is also red.
CPLD
DDR5
PowerEdge 16G introduces DDR5 memory. DDR5 reduces latency and
optimizes workloads that are memory, capacity, and cost constrained.
DDR5 offers up to 1.5X bandwidth improvement over DDR4. DDR5
scaling enables performance, capacity, power, and cost advantages not
available to DDR4. DDR5 provides a power-efficient design and improved
reliability features.
DIMM
Direct Access Inline Memory Module. DIMMs are available in varying
capacities. All DIMMs in a cache must have the same capacity
DL
Deep Learning (DL) is a form of Machine Learning which uses Artificial
Neural Networks.
DRAM
E3 Drives
The Enterprise and Data Center Small Form Factor (EDSFF) is an SSD
design for NAND and Storage Class Memory (SCM). EDSFF optimizes
storage in enterprise, private, and public data centers.
E3 Drives
The Enterprise and Data Center Small Form Factor (EDSFF) is an SSD
design for NAND and Storage Class Memory (SCM). EDSFF optimizes
storage in enterprise, private, and public data centers.
EE
Enhanced Edge (EE) Intel CPU's are used to acceleration network traffic
in Edge deployments. Edge computing is a distributed information
technology (IT) architecture in which client data is processed at the
periphery of the network, as close to the originating source as possible.
HCI
Hyper Converged infrastructure (HCI) combines compute, virtualization,
storage, and networking in a single cluster.
HII
The Human Interface Infrastructure (HII) configuration utility is a storage
management application integrated into the System BIOS <F2> It is used
to configure and manage RAID disk groups, virtual disks, and physical
disks. This utility is independent of the operating system.
HPC
High performance computing (HPC) is the ability to process data and
perform complex calculations at high speeds.
HPC
HW RAID
Form of RAID. The motherboard or a separate RAID card handles the
processing.
iDRAC
The Integrated Dell Remote Access Controller (iDRAC) is designed for
secure local and remote server management and helps IT administrators
deploy, update, and monitor PowerEdge servers.
IDSDM
Redundant SD-card module for embedded hypervisors. PowerEdge
servers can boot to the hypervisor out-of-the-box. The embedded
hypervisor is mirrored across dual SD cards using an integrated hardware
controller.
IEEE 802.3
The Electrical and Electronics Engineers (IEEE) 802.3 is a collection of
IEEE standards. The working group defining the physical layer and Media
Access Control (MAC) of Data Link Layer in the Ethernet set the
standards.
IoT
Latency
Latency is the response time or the period of time that a component waits
for an answer from another component. Latency is the time it takes for the
storage to respond to a request.
LRDIMM
Load-Reduced DIMM. Has higher densities than RDIMMs. Uses a
memory buffer chip to reduce the load on the server memory bus.
ML
Machine Learning (ML) is an application of AI where systems use data to
learn how to respond, rather than being explicitly programmed.
MT/s
Mega-Transfers per Second (MT/s). Measurement of bus and channel
speed in millions of cycles per second.
Multicasting
Multicasting involves sending the same message to many endpoints such
as in a video conferencing facility.
NVDIMM
Non-Volatile DIMM
NVMe
Non-Volatile Memory Express (NVMe). Communications interface for
PCIe-based SSDs. Used to increase efficiency and performance.
NVMe
Non-Volatile Memory Express (NVMe). Communications interface for
PCIe-based SSDs. Used to increase efficiency and performance.
OCP
Open Compute Project (OCP) is an organization that shares designs of
data center products and best practices among companies. OCP designs
and projects include server designs, data storage, rack designs, and open
networking switches. Read more information about the organization by
going to www.opencompute.org.
OCP
OMSA
OpenManage Server Administrator (OMSA) is a software agent that
provides a comprehensive, one-to-one systems management solution in
integrated web browser-based graphical user interface (GUI) or command
line interface(CLI) throught the operating system.
PCH
Platform controller hub (PCH) controls certain data paths and support
functions used in conjunction with Intel CPUs.
PCIe
Peripheral component interconnect express (PCIe) is an interface
standard for connecting high-speed components.
PCIe
Peripheral component interconnect express (PCIe) is an interface
standard for connecting high-speed components.
PERC
PowerEdge RAID Controller (PERC). Family of controllers that enhance
performance, increase reliability, add fault tolerance, and simplifies
management.
RAID
Redundant Arrays of Independent Disks (RAID). RAID controllers combine
multiple server physical hard drives together into a virtual drive or multiple
drives to improve data efficiency and protection.
RDIMM
RSA SecurID
RSA SecurID is multi-factor authentication (MFA) technology used to
protect network resources, such as applications and websites. MFA
mitigates risk and maintains compliance without disrupting employee
productivity. MFA can confirm user identities to ensure they are only
granted access to the resources they need to do their jobs. RSA SecurID
can quickly and securely provide appropriate access to resources both on-
premises and in the cloud.
SAS
SAS (serial-attached SCSI) is a type of SCSI that uses serial signals to
transfer data, instructions, and information. SAS drives are dual ported.
SATA
SATA (Serial Advanced Technology Attachment) uses serial signals to
transfer data, instructions, and information. SATA drives have only a
single port.
SCSI
A set of standards for physically connecting and transferring data between
computers and peripheral devices. The SCSI standards define
commands, protocols, electrical, optical and logical interfaces.
SDS
Storage data services such as APEX Data Storage Services. APEX is an
as-a-Service portfolio of scalable and elastic storage resources. The
storage as-a-Service model simplifies the storage process.
SMART
Self-Monitoring, Analysis and Reporting Technology (SMART) is a
monitoring system included in hard disk drives (HDDs) and solid state
drives (SSDs). Its primary function is to detect and report various
indicators of drive reliability with the intent of anticipating imminent
hardware failures.
SNAP I/O
Balances I/O performance. CPUs share one adapter, which prevents data
from traversing the inter-processor link when accessing remote memory.
SP
A service provider (SP) is a company that provides its subscribers access
to the internet.
STP cable
Shielded Twisted Pair (STP) Ethernet cable that is commonly used for
high-speed networks. A metallic substance shields STP. An additional
metal foil wraps each set of twisted wire pairs together.
UEFI boot
Unified Extensible Firmware Interface (UEFI). UEFI secure boot prevents
systems from booting from unsigned or unauthorized preboot device
firmware, applications, and operating system boot loaders. Without secure
boot enabled, systems are vulnerable to malware corrupting the startup
process. UEFI is a firmware interface that connects the firmware to the
operating system. UEFI initializes the hardware components and starts the
operating system.
UTP cable
Unshielded Twisted Pair (UTP) Ethernet cable that is commonly used
between a system and wall. It is also used for desktop communication
applications.
vRAN
Virtualized radio access networks (vRANs) are a way for
telecommunications operators to run their baseband functions as
software. One of the primary benefits of virtualizing radio access networks
(RANs) is that RAN functions no longer require special proprietary
hardware to run, and can instead be run on standard servers. This is
achieved by applying the principles of virtualization to RAN, and is usually
one part of a larger network function virtualization (NFV) effort.