Professional Documents
Culture Documents
Running VMware Vsphere On HPE Superdome Flex Family of Servers
Running VMware Vsphere On HPE Superdome Flex Family of Servers
Running VMware Vsphere On HPE Superdome Flex Family of Servers
Contents
Introduction ................................................................................................................................................................................................................................................................................................................................. 3
Hardware overview of HPE Superdome Flex family of servers ................................................................................................................................................................................................... 3
VMware vSphere overview............................................................................................................................................................................................................................................................................................ 3
VMware vSphere limitations on HPE Superdome Flex family of servers ........................................................................................................................................................................... 4
HPE Persistent Memory on HPE Superdome Flex server ......................................................................................................................................................................................................... 4
VMware vSphere configuration maximums ............................................................................................................................................................................................................................................ 5
HPE Superdome Flex family of servers firmware bundle ........................................................................................................................................................................................................... 5
HPE Superdome Flex I/O Service Pack ....................................................................................................................................................................................................................................................... 5
VMware vSphere ISO image options ............................................................................................................................................................................................................................................................. 5
Build own VMware vSphere custom images for HPE Superdome Flex servers..................................................................................................................................................... 6
Download VMware vSphere Hypervisor (ESXi) Offline Bundles from VMware site .......................................................................................................................................... 6
Download VMware vSphere Hypervisor (ESXi) Custom ISO Images from VMware site ............................................................................................................................... 6
HPE Online VIBs software depot for HPE Superdome Flex servers ................................................................................................................................................................................ 7
Steps to build own VMware vSphere custom image ...................................................................................................................................................................................................................... 7
HPE Data Collection Daemon .............................................................................................................................................................................................................................................................................. 8
VMware ESXi logs ................................................................................................................................................................................................................................................................................................................. 9
Preparing to install VMware vSphere on HPE Superdome Flex family of servers ..................................................................................................................................................... 9
Known issues in VMware 6.5 U1\U2\U3, 6.7 U1\U2\U3, 7.0 U1\U2\U3 and 8.0 ................................................................................................................................................13
Summary .....................................................................................................................................................................................................................................................................................................................................14
Resources ...................................................................................................................................................................................................................................................................................................................................15
Technical white paper Page 3
Introduction
VMware vSphere® is a virtualization platform for building cloud infrastructures using existing IT assets and resources. It is easy to deploy
VMware vSphere on HPE Superdome Flex family of servers.
This paper provides instructions to deploy and update VMware vSphere on HPE Superdome Flex. You can also build your own VMware
vSphere custom image. This white paper facilitates successful deployment and configuration of the VMware vSphere virtualization platform
on HPE Superdome Flex servers and HPE Superdome Flex 280 servers, referred as HPE Superdome Flex family of servers. It includes a
description of recommended HPE hardware and software components for HPE Superdome Flex family of servers and the best practices you
may use when deploying VMware vSphere.
VMware vSphere releases HPE Superdome Flex HPE Superdome Flex HPE Superdome Flex 280
(first-generation Intel Xeon (second-generation Intel Xeon (third-generation Intel Xeon
Scalable processors) Supported Scalable processors) Supported Scalable processors) Supported
Socket Configuration Socket Configuration Socket Configuration
Table 3. The memory limits supported by VMware vSphere on HPE Superdome Flex family of servers based on Intel Xeon Scalable processor types
VMware vSphere Memory size Memory size Memory size
HPE Superdome Flex HPE Superdome Flex HPE Superdome Flex 280
(first-generation Intel Xeon (second-generation Intel Xeon (third-generation Intel Xeon
Scalable processors) Scalable processors) Scalable processors)
Table 4. The HPE Persistent Memory limits supported by VMware vSphere on HPE Superdome Flex servers based on second-generation Intel Xeon Scalable processors
VMware vSphere HPE Persistent Memory size Non-persistent memory size
Note
VMware vSphere PowerCLI can be downloaded from VMware site by providing appropriate credentials.
Technical white paper Page 6
Build own VMware vSphere custom images for HPE Superdome Flex servers
This section is applicable to HPE Superdome Flex family of servers based on first-generation and second-generation Intel Xeon Scalable
processors. You can build a VMware vSphere custom image ISO using the VMware vSphere Hypervisor (ESXi) Offline Bundle which is in
the .ZIP format and specific HPE online VIBs software depot for HPE Superdome Flex server.
Download VMware vSphere Hypervisor (ESXi) Offline Bundles from VMware site
HPE will not support the HPE Superdome Flex family of servers with the HPE ProLiant VMware custom images. You need to build your own
VMware vSphere custom image ISO using the VMware vSphere Hypervisor (ESXi) Offline Bundle and specific available drivers (includes the
third-party driver’s bundle) to HPE Superdome Flex family of servers based on first-generation and second-generation Intel Xeon Scalable
processors from vibsdepot (also known as HPE Online Depot).
VMware vSphere Hypervisor (ESXi) 6.5 U1 Offline Bundle
• The VMware 6.5 U1 Offline Bundle is available for download at VMware site
VMware vSphere Hypervisor (ESXi) 6.5 U2 Offline Bundle
• The VMware 6.5 U2 Offline Bundle is available for download at VMware site
VMware vSphere Hypervisor (ESXi) 6.5 U3 Offline Bundle
• The VMware 6.5 U3 Offline Bundle is available for download at VMware site
VMware vSphere Hypervisor (ESXi) 6.7 Offline Bundle
• The VMware 6.7 Offline Bundle is available for download at VMware site
VMware vSphere Hypervisor (ESXi) 6.7 U1 Offline Bundle
• The VMware 6.7 U1 Offline Bundle is available for download at VMware site
VMware vSphere Hypervisor (ESXi) 6.7 U2 Offline Bundle
• The VMware 6.7 U2 Offline Bundle is available for download at VMware site
VMware vSphere Hypervisor (ESXi) 6.7 U3 Offline Bundle
• The VMware 6.7 U3 Offline Bundle is available for download at VMware site
Download VMware vSphere Hypervisor (ESXi) Custom ISO Images from VMware site
• Starting with VMware vSphere 7.0 onwards, HPE publishes a tested custom ISO image containing updated drivers (includes the
third-party driver’s bundle), on the below mentioned VMware site and can be downloaded directly from following URLs:
Note
HPE has removed all ESXi 7.0 U3 content from vibsdepot in alignment with the VMware announcement that ESXi 7.0 Update 3, ESXi 7.0
Update 3a, and ESXi 7.0 Update 3b were removed from all online and offline download portals on November 18, 2021. Check KB 86398
for further details. HPE has published new ESXi 7.0 U3 images based upon the VMware announcement of a new ESXi 7.0 U3. See the links
below to download the same.
Table 5. VMware vSphere Hypervisor (ESXi) Custom ISO images for HPE Superdome Flex 280 servers
Table 6. VMware vSphere Hypervisor (ESXi) Custom ISO images for HPE Superdome Flex servers (first and second-generation Intel Xeon Scalable processors)
HPE Online VIBs software depot for HPE Superdome Flex servers
For HPE Superdome Flex family of servers based on Intel Xeon scalable 61xx or 81xx series processors (first-generation Intel Xeon Scalable
processors) or Intel Xeon scalable 62xx or 82xx series processors (second-generation Intel Xeon Scalable processors) customer need to
include/update appropriate async drivers, which are available from vibsdepot and build their custom VMware vSphere distributions. A customer
can obtain the appropriate updated drivers from the link mentioned in Table 7 and 7A.
Table 7. To create a supported HPE Custom build for VMware vSphere versions of ESXi 6.5 U1/U2/U3 and 6.7 U1/U2/U3 (First generation)
Supported servers Vibsdepot link
Table 7A. To create a supported HPE Custom build for VMware vSphere versions of ESXi 6.7 U3 onwards (Second generation)
Supported servers Vibsdepot link
Note
As steps mentioned below involve usage of a script which downloads HPE online VIBs software depot from vibsdepot link, hence the server
on which these steps performed need to be connected to the internet.
To build own VMware vSphere custom image for Apr 2022, follow these steps:
1. Download the HPE Image Builder script (“.ps1” file) from the vibsdepot release path of the desired HPE drivers and save it as .ps1 file.
For 6.5 U1/U2/U3: vibsdepot.hpe.com/superdome/sdflex/downloads/Apr2022/SDflex/hpe650/build-hpe650-img-Apr2022-SDflex.ps1
For 6.7\6.7 U1/U2/U3: vibsdepot.hpe.com/superdome/sdflex/downloads/Apr2022/SDflex/hpe670/build-hpe670-img-Apr2022-SDflex.ps1
2. Download the corresponding VMware vSphere Hypervisor (ESXi) Offline Bundles by referring the section “Download VMware vSphere
Hypervisor (ESXi) Offline Bundles” from VMware site and place it on the folder where .ps1 file is kept.
Technical white paper Page 8
3. Identify the VMware image profile to use from VMware vSphere Hypervisor (ESXi) Offline Bundle by viewing the contents of the “profiles”
directory in the metadata file inside the zip file (always use the image profile with xxxxxxxx-standard embedded in the name with NO “s”
before “-standard”)
a. Example output: ESXi-6.5.0-20170702001-standard
b. Example output: ESXi-6.7.0-20180804001-standard
4. Start PowerCLI Image Builder session
Note
As the above-mentioned PowerShell scripts published are unsigned, run “Set-ExecutionPolicy cmdlet” in PowerCLI to run unsigned
scripts.
5. Run the Image Builder script and supply the input parameters to build a custom image. Customer can choose from one of the following
two options to create the image:
a. Option a: Run the .ps1 file and supply all the parameters in the same command line:
<.\ps1 file> -VMwareDepot <VMware vSphere Hypervisor (ESXi) Offline Bundles> -VMwareIP <name
of the Image Profile> -CustomIP “<Your choice of New ISO image to be created>” -CustomVendor
“<Your Company Name>”
b. Option b: Run the script with no parameters from the command line and supply parameters one by one as prompted:
I. PowerCLI C:\vmware> .\ps1 file
II. VMwareDepot: VMware vSphere Hypervisor (ESXi) Offline Bundle
III. VMwareIP: Name of the Image Profile
IV. CustomIP: Your choice of New ISO image be created
V. CustomVendor: Your Company Name
6. The custom image will be generated in the current working directory
2. Check the LUN device name by listing the contents (for example, >dir fs0:\EFI\BOOT\BOOTx64.efi)
3. Exit the EFI shell by entering the exit command; enter the System Utilities and navigate to Boot Maintenance Manager ->
Boot Options Menu; select Add Boot Option.
Technical white paper Page 11
4. Select the boot entry for VMware vSphere that matches the entry noted in steps 1 and 2, and then press Enter.
Note
In the next step, use the BOOT directory, not the VMware directory.
Technical white paper Page 12
Technical white paper Page 13
5. Go to Change Boot Order under Boot Options Menu. Set the boot order so VMware ESXi (VMware vSphere) is the first option or as the
next option after the HPE iLO virtual DVD. Commit the changes.
6. Once VMware vSphere is successfully booted, configure the management network, for example, IP address and such, to enable SSH
through direct console user interface (DCUI).
Note
The above steps are applicable only for ESXi 6.x versions. For ESXi 7.x and above, boot entry is automatically created.
Known issues in VMware 6.5 U1\U2\U3, 6.7 U1\U2\U3, 7.0 U1\U2\U3, and 8.0
• VMware ESXi doesn’t display some of the I/O adapters this could include FC HBA adapter or NIC adapter.
– Workaround 1: The default “maxIntrCookies” needs to be increased its value from current 1024 to max 4096. Please use the below
esxcli command to do the same.
# esxcli system settings kernel set -s maxIntrCookies -v 4096
#reboot (The system needs to be rebooted for the changes to be effective)
– Workaround 1(a): Even after increasing the value of maxIntrCookies to 4096 and if still VMware ESXi doesn’t display your required
I/O adapter, then deconfigure one or more unused I/O adapters using the below RMC command.
# deconfig physloc=xxxx (physical address of unused I/O adapters)
• In case upgrading from 7.0 U2 fails:
– Workaround: Remove “hpe-upgrade” drivers from 7.0 U2 before upgrading to higher versions using the esxcli command.
– syntax/command: esxcli software vib remove --vibname=hpe-upgrade
#reboot (The system needs to be rebooted for the changes to be effective)
Once system boots up the upgrade to higher version should work.
• VMware ESXi displays less memory than is available on the host
The DCUI expresses available host memory as a rounded number of terabytes. In some cases, the rounding operation results in the
DCUI stating the available memory as less than the amount of memory actually in use. For example, the DCUI might display the
available memory as 1.4 TB instead of the 1.5 TB that the ESXi host is utilizing. Refer the KB site: kb.vmware.com/s/article/2144056.
• MegaRAID 9361-4i SAS card (HPE 9361-4i RAID Controller) information not displayed on the VMware ESXi
The SAS card information (Model Description, Hardware Version, and OptionROM Version) is not getting displayed on the OS level.
Following is one of the examples for reference:
# esxcli storage san sas list
Device Name: vmhba2
SAS Address: 60:f5:75:42:75:71:40:72
Physical ID: 0
Minimum Link Rate: 0 Mbps
Maximum Link Rate: 0 Mbps
Technical white paper Page 14
• Incorrect information displayed against the Physical Slot of all PCI hardware
When details of a PCI hardware are displayed, the information displayed against the Physical Slot is incorrect. Following is one of the
examples for reference:
# esxcli hardware pci list
Physical Slot: 4294967295
• Access USB Device from virtual machine (VM) failed in VMware ESXi
Unable to access a bootable USB drive on to the guest VMs, which are mounted on to the host. Guest VM is unable to mount a bootable
OS image.
• Failure messages in syslog
The following failure is seen on the /var/log/syslog file:
“Failed to open dcb ioctl interface”
This failure message is harmless and can be safely ignored.
• RAID mode of Intel® Corporation Lewisburg SATA AHCI Controller is not supported in ESXi
VMware does not support the RAID mode of Intel Corporation Lewisburg SATA AHCI Controller in VMware ESXi. Refer KB site:
kb.vmware.com/s/article/52047
Summary
Hewlett Packard Enterprise is committed to providing a long road map of solutions for virtualized mission-critical computing.
These solutions are grounded on solid HPE hardware platforms, augmented by VMware vSphere virtualization. We are working
with the VMware community to make continuous improvements to these mission-critical virtualization solutions.
Further innovations will be released to the market on a regular basis. This white paper will be updated as further enhancements
are announced.
Technical white paper Page 15
Resources
• HPE Superdome Flex family of servers (first-generation and second-generation Intel Xeon Scalable processors) QuickSpecs
• HPE Superdome Flex 280 servers (third-generation Intel Xeon Scalable processors) QuickSpecs
• HPE Superdome Flex servers based on Intel Xeon scalable 61xx or 81xx series processors (first-generation Intel Xeon Scalable
processors) server-specific third-party drivers (OEM drivers) for appropriate VMware vSphere versions can be directly downloaded using
the following URLs:
Table 8. To create a supported HPE Custom build for VMware vSphere versions of ESXi 6.5 U1/U2/U3 and 6.7 U1/U2/U3 (First generation)
Mar 2018 HPE Superdome Flex servers Initial I/O drivers vibsdepot.hpe.com/superdome/sdflex/downloads/Mar2018/SDflex/
Sep 2018 HPE Superdome Flex servers Initial I/O drivers vibsdepot.hpe.com/superdome/sdflex/downloads/Sep2018/SDflex/
Aug 2019 HPE Superdome Flex servers Initial I/O drivers vibsdepot.hpe.com/superdome/sdflex/downloads/Aug2019/SDflex/
Mar 2020 HPE Superdome Flex servers Initial I/O drivers vibsdepot.hpe.com/superdome/sdflex/downloads/March2020/SDflex/
Jan 2021 HPE Superdome Flex servers Initial I/O drivers vibsdepot.hpe.com/superdome/sdflex/downloads/Jan2021/SDflex/
Oct 2021 HPE Superdome Flex servers Initial I/O drivers vibsdepot.hpe.com/superdome/sdflex/downloads/Oct2021/SDflex/
Apr 2022 HPE Superdome Flex servers Initial I/O drivers vibsdepot.hpe.com/superdome/sdflex/downloads/Apr2022/SDflex/
• HPE Superdome Flex family of servers based on Intel Xeon scalable 62xx or 82xx series processors (second-generation Intel Xeon
Scalable processors) server-specific third-party drivers (OEM drivers) for VMware vSphere 6.7 U3 onwards can be directly downloaded
using the following URLs:
Table 9. To create a supported HPE Custom build for VMware vSphere versions of ESXi 6.7 U3 onwards (Second generation)
Aug 2019 HPE Superdome Flex servers Initial I/O drivers vibsdepot.hpe.com/superdome/sdflex/downloads/Aug2019/SDflex/
Mar 2020 HPE Superdome Flex servers Initial I/O drivers vibsdepot.hpe.com/superdome/sdflex/downloads/March2020/SDflex/
Jan 2021 HPE Superdome Flex servers Initial I/O drivers vibsdepot.hpe.com/superdome/sdflex/downloads/Jan2021/SDflex/
Oct 2021 HPE Superdome Flex servers Initial I/O drivers vibsdepot.hpe.com/superdome/sdflex/downloads/Oct2021/SDflex/
Apr 2022 HPE Superdome Flex servers Initial I/O drivers vibsdepot.hpe.com/superdome/sdflex/downloads/Apr2022/SDflex/
Technical white paper
• HPE Superdome Flex 280 servers (third-generation Intel Xeon Scalable processors) and HPE Superdome Flex family of servers
(first-generation and second-generation Intel Xeon Scalable processors) server-specific custom ISO containing third-party drivers
(OEM drivers) for VMware vSphere 7.0 based distributions can be downloaded using following URLs:
Table 10. VMware vSphere Hypervisor (ESXi) Custom ISO images for HPE Superdome Flex family of servers
Additional resources
• HPE and VMware
• HPE Superdome Flex Server User Guide
© Copyright 2022 Hewlett Packard Enterprise Development LP. The information contained herein is subject to change without
notice. The only warranties for Hewlett Packard Enterprise products and services are set forth in the express warranty statements
accompanying such products and services. Nothing herein should be construed as constituting an additional warranty.
Hewlett Packard Enterprise shall not be liable for technical or editorial errors or omissions contained herein.
Intel and Intel Xeon are trademarks of Intel Corporation or its subsidiaries in the U.S. and/or other countries. PowerShell is
either a registered trademark or trademark of Microsoft Corporation in the United States and/or other countries. VMware vSphere,
VMware vSphere Hypervisor, VMware vSphere PowerCLI, VMware, and VMware ESXi are registered trademarks or trademarks
of VMware, Inc. and its subsidiaries in the United States and other jurisdictions. All third-party marks are property of their
respective owners.
a00043141ENW, Rev. 18