Scribd Logo
Upload

Welcome to Scribd!

  • 212 views

    Intel Hotchips 2021 - MT Evans R2a

    Uploaded by

    ddscribe
    The document summarizes Intel's Hyperscale-Ready Infrastructure Processing Unit (IPU) called "Mount Evans". It has 3 key points: 1) Mount Evans is a 200G IPU co-designed with a top cloud provider to provide security, performance, and flexibility for hyperscale data centers. 2) It features a programmable packet processing engine, ARM cores for infrastructure apps, and acceleration engines to offload tasks from CPUs. 3) Mount Evans supports use cases like IaaS/PaaS offloading, inline acceleration, and provides a scale out storage architecture.

    Copyright:

    © All Rights Reserved
    Download as PDF, TXT or read online from Scribd
    Flag for inappropriate content

    You might also like

    Intel Hotchips 2021 - MT Evans R2a

    Uploaded by

    ddscribe
    212 views18 pages
    The document summarizes Intel's Hyperscale-Ready Infrastructure Processing Unit (IPU) called "Mount Evans". It has 3 key points: 1) Mount Evans is a 200G IPU co-designed with a top cloud provider to provide security, performance, and flexibility for hyperscale data centers. 2) It features a programmable packet processing engine, ARM cores for infrastructure apps, and acceleration engines to offload tasks from CPUs. 3) Mount Evans supports use cases like IaaS/PaaS offloading, inline acceleration, and provides a scale out storage architecture.

    Original Description:

    Hot Chips 33 presentation

    Original Title

    Intel Hotchips 2021 - Mt Evans R2a

    Copyright

    © © All Rights Reserved

    Available Formats

    PDF, TXT or read online from Scribd

    Did you find this document useful?

    Is this content inappropriate?

    Report this Document
    The document summarizes Intel's Hyperscale-Ready Infrastructure Processing Unit (IPU) called "Mount Evans". It has 3 key points: 1) Mount Evans is a 200G IPU co-designed with a top cloud provider to provide security, performance, and flexibility for hyperscale data centers. 2) It features a programmable packet processing engine, ARM cores for infrastructure apps, and acceleration engines to offload tasks from CPUs. 3) Mount Evans supports use cases like IaaS/PaaS offloading, inline acceleration, and provides a scale out storage architecture.

    Copyright:

    © All Rights Reserved
    Download as PDF, TXT or read online from Scribd
    Flag for inappropriate content
    Download as pdf or txt
    212 views18 pages

    Intel Hotchips 2021 - MT Evans R2a

    Uploaded by

    ddscribe
    The document summarizes Intel's Hyperscale-Ready Infrastructure Processing Unit (IPU) called "Mount Evans". It has 3 key points: 1) Mount Evans is a 200G IPU co-designed with a top cloud provider to provide security, performance, and flexibility for hyperscale data centers. 2) It features a programmable packet processing engine, ARM cores for infrastructure apps, and acceleration engines to offload tasks from CPUs. 3) Mount Evans supports use cases like IaaS/PaaS offloading, inline acceleration, and provides a scale out storage architecture.

    Copyright:

    © All Rights Reserved
    Download as PDF, TXT or read online from Scribd
    Flag for inappropriate content
    Download as pdf or txt
    of 18

    Intel’s Hyperscale-Ready Infrastructure

    Processing Unit (IPU)


    Brad Burres, Intel Fellow
    Co-Authors: Dan Daly, Mark Debbage, Eliel Louzoun, Christine Severns-Williams, Naru Sundar,
    Nadav Turbovich, Barry Wolford, Yadong Li

    Hot Chips 2021


    Major Advantages of IPUs

    CPU
    CPU IPU
    IPU

    Separation of
    Infrastructure Infrastructure Diskless Server
    & Tenant Offload Architecture
    Guest can fully control the CPU Accelerators help process Simplifies data center
    with their SW, while CSP these task efficiently. Minimize architecture while adding
    maintains control of the latency and jitter and maximize flexibility for the CSP
    infrastructure and Root of Trust revenue from CPU

    Hot Chips 2021


    Infrastructure Workloads Migrating to IPU
    Hypervisor responsible for all Infrastructure tasks move to Free up cycles for more
    infrastructure services IPU or into the network VMs or applications

    VM VM VM VM VM VM VM VM VM VM VM VM VM VM VM

    Hypervisor Hypervisor
    Host

    Mgmt. Mgmt. VM VM VM VM VM
    Network Storage Security Storage Security
    Monitor Monitor Hypervisor

    Mgmt.
    Network Storage Network Storage Security
    Monitor

    Foundational NIC IPU IPU

    Hot Chips 2021


    Mount Evans
    Intel’s 200G IPU Co-designed with a top cloud provider
    Hyperscale Integrated learnings from multiple gen. of FPGA sNIC/IPU​
    Ready High performance under real world load
    Security and isolation from the ground up

    Best-in-Class Programmable Packet Processing Engine


    Technology NVMe storage interface scaled up from Intel Optane Tech
    Innovation Next Generation Reliable Transport
    Advanced crypto and compression accel.

    SW/HW/Accel co-design
    P4 Studio based on Barefoot
    Software
    Leverage and extend DPDK and SPDK
    Enable broad adoption of IPUs​

    Hot Chips 2021


    Mount Evans
    Architectural Breakdown

    Network Compute
    Subsystem Complex

    Hot Chips 2021


    Mount Evans
    Network subsystem

    Support for up to 4 host Xeons with


    200Gb/s full duplex

    High-performance ROCEv2 & Reliable


    Transport Protocol

    NVMe device interface with inline


    AES-XTS and VM QoS for efficient
    software backend
    Programmable packet pipeline with QoS
    and telemetry capabilities supporting
    200Mpps

    Advanced transmit scheduling


    capabilities

    Inline IPSec for high scale connection at


    wire speed

    Hot Chips 2021


    Mount Evans
    Compute Complex

    16 ARM Neoverse N1 Cores @ ~3GHz for


    infrastructure apps such as the Storage
    initiator backend, TLS proxy, vSwitch and
    other applications.

    Large System Level Cache backed by


    three channels of LP/DDR4

    Lookaside Crypto and Compression


    Engine for Host or Compute Complex use

    Dedicated management processor


    providing secure boot, life cycle
    management and overall manageability

    Hot Chips 2021


    Mt. Evan’s Key Use Cases
    IaaS Offload PaaS Offload Inline Accel.
    Customer Applications Customer Applications
    Customer Inline Function
    Container Service Provider Platform
    Customer
    CustomerInline
    InlineFunction
    Function
    VM Container Bare Metal
    Infrastructure Infrastructure

    Service Provider IPU Applications

    Intel IPU Applications

    IPU Abstractions

    Middleware & Drivers

    Hot Chips 2021


    Mt. Evans - Packet Processing
    Device and
    Network
    Management Service Interfaces Leadership P4 programmable pipeline
    • Support complete vSwitch + beyond fully in hardware
    • Virtual Network • Telemetry & INT
    IaaS & PaaS • pipeline composition via recirculation and chained
    Management • ACLs
    Hosting operations without sacrificing performance
    • Virtual Firewall

    • Programmable Parser, Exact Match, Wildcard Match, Range


    Match, LPM, Meters, Statistics, Modifier
    P4 • Compilation • Tuning • Mapping
    toolchain
    Packet Processing at scale
    • @scale classification for > 10M entries backed by DDR
    Packet
    Processing • Support pipeline driven operations like flow auto-add and
    Engine aging

    Tightly coupled with the Compute Complex


    • Large L1 caches, optionally backed in compute cache,
    designed to meet hyperscale performance challenges
    • multi-TB cross-sectional BW between NSS and CC

    IPU • Broad metadata capabilities, including handoff to Compute


    software

    Hot Chips 2021


    Scale out Storage Architecture
    Control Pane
    Create
    New Virtual SSD
    Storage Service
    Software

    Customer’s Flexible Storage

    Storage
    Software • NVMeoTCP
    Create
    • NVMeoRDMA
    • Ceph New Virtual
    • BYOS Volume - SSD1
    Standard OS

    NVMe – SSD1 Create


    Virtual NVMe Device SSD1 –
    Hardware

    Virt + NVMe 250GB


    protocol layer
    QoS/
    Virtualized
    CPU
    CPU LoadIPU
    IPU
    balance Network
    HW crypto,
    PCIe compress, CRC

    Shared Storage

    Hot Chips 2021


    Mt. Evans – in Depth Security Strategy

    11
    Hot Chips 2021
    Mt. Evans – in Depth Security Strategy
    System Security

    12
    Hot Chips 2021
    Mt. Evans – in Depth Security Strategy
    System Security

    Isolation and Recovery

    13
    Hot Chips 2021
    Mt. Evans – in Depth Security Strategy
    System Security

    Isolation and Recovery

    Performance

    Flexibility

    14
    Hot Chips 2021
    Mt. Evans – in Depth Security Strategy
    System Security

    Isolation and Recovery

    Performance

    Flexibility

    Survivability & Uptime

    15
    Hot Chips 2021
    Mt. Evans – in Depth Security Strategy
    System Security

    Isolation and Recovery

    Performance

    Flexibility

    Survivability & Uptime

    Future proof

    Security Compliance

    16
    Hot Chips 2021
    Thank you!

    Hot Chips 2021


    Mt. Evans - Packet Processing
    Network Device and
    Management Service Interfaces Mt. Evans supports a rich packet processing
    programming model
    • Virtual Network • Telemetry & INT • P4 based toolchain
    IaaS & PaaS Management • ACLs
    Hosting • Virtual Firewall • Logical pipeline composition through recirculation and
    chained operations without sacrificing performance

    Mt. Evans supports packet processing at scale


    P4 • Compilation • Tuning • Mapping
    toolchain
    • Classification functions designed for scale
    • > 10M entries backed by DDR
    Packet • Large L1 caches, with optional SLC in compute cache
    Processing
    Engine
    Mt. Evans supports flexible, protocol agnostic
    packet processing
    • Multiple lookups per pass, with multiple classification
    types (exact-match, wildcard, range)
    • Generic editor capable of arbitrary header manipulation
    IPU
    utilizing packet and metadata fields with constant
    performance regardless of packet transformation

    Hot Chips 2021

    You might also like