Mellanox MLNX-OS Release Notes

Software Ver. 3.9.09xx

www.mellanox.com Mellanox Technologies Confidential

 NOTE:
THIS HARDWARE, SOFTWARE OR TEST SUITE PRODUCT (“PRODUCT(S)”) AND ITS RELATED
DOCUMENTATION ARE PROVIDED BY MELLANOX TECHNOLOGIES “AS-IS” WITH ALL FAULTS OF ANY
KIND AND SOLELY FOR THE PURPOSE OF AIDING THE CUSTOMER IN TESTING APPLICATIONS THAT
USE THE PRODUCTS IN DESIGNATED SOLUTIONS. THE CUSTOMER'S MANUFACTURING TEST
ENVIRONMENT HAS NOT MET THE STANDARDS SET BY MELLANOX TECHNOLOGIES TO FULLY
QUALIFY THE PRODUCT(S) AND/OR THE SYSTEM USING IT. THEREFORE, MELLANOX TECHNOLOGIES
CANNOT AND DOES NOT GUARANTEE OR WARRANT THAT THE PRODUCTS WILL OPERATE WITH THE
HIGHEST QUALITY. ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE
IMPLIED WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND
NONINFRINGEMENT ARE DISCLAIMED. IN NO EVENT SHALL MELLANOX BE LIABLE TO CUSTOMER OR
ANY THIRD PARTIES FOR ANY DIRECT, INDIRECT, SPECIAL, EXEMPLARY, OR CONSEQUENTIAL
DAMAGES OF ANY KIND (INCLUDING, BUT NOT LIMITED TO, PAYMENT FOR PROCUREMENT OF
SUBSTITUTE GOODS OR SERVICES; LOSS OF USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION)
HOWEVER CAUSED AND ON ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY,
OR TORT (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY FROM THE USE OF THE
PRODUCT(S) AND RELATED DOCUMENTATION EVEN IF ADVISED OF THE POSSIBILITY OF SUCH
DAMAGE.

Mellanox Technologies
350 Oakmead Parkway Suite 100
Sunnyvale, CA 94085
U.S.A.
www.mellanox.com
Tel: (408) 970-3400
Fax: (408) 970-3403

© Copyright 2020. Mellanox Technologies Ltd. All Rights Reserved.

Mellanox®, Mellanox logo, 25 Is The New 10®, CoolBox®, InfiniScale®, LinkX®, Mellanox Care®, Mellanox CloudX®, Mellanox
NEO®, Mellanox NVMEDirect®, Mellanox OpenCloud®, Mellanox Open Ethernet®, Mellanox Spectrum®, Mellanox TuneX®,
Mellanox Virtual Modular Switch®, MetroDX®, MetroX®, MLNX-OS®, ONE SWITCH. A WORLD OF OPTIONS®, Open Ethernet
logo, Spectrum logo®, StoreX®, Switch-IB®, SwitchX®, TestX®, TuneX®, UFM®, Unbreakable-Link®, Virtual Protocol
Interconnect®, Voltaire®, and Voltaire logo are registered trademarks of Mellanox Technologies, Ltd.

For the complete and most updated list of Mellanox trademarks, visit http://www.mellanox.com/page/trademarks.

All other trademarks are property of their respective owners.

Mellanox Technologies Confidential 2

Table of Contents
Table of Contents . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1
Document Update History . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2
Chapter 1 Introduction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3
Chapter 2 Supported Switch Systems, Firmware, Cables and Licenses. . . . . . 3
2.1 Supported Switch Systems. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3
2.2 Tested and Supported Firmware Versions . . . . . . . . . . . . . . . . . . . . . . . . . . 3
2.3 Software/Firmware Interoperability. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3
2.4 Supported BIOS Version. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4
2.5 Supported Software Licenses . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4
2.6 Upgrade from Previous Releases . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4
2.7 Supported Cables . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5
2.7.1 Switch and HCAs InfiniBand Cable Connectivity Matrix. . . . . . . . . . . . . . . . 5
2.7.2 Mellanox Quantum™ Supported Link Speed . . . . . . . . . . . . . . . . . . . . . . . . 6
Chapter 3 Changes and New Features . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7
3.1 New Features . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7
3.2 Customer Affecting Changes . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 12
Chapter 4 Known Issues . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 13
4.1 General Known Issues . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 13
4.2 InfiniBand Known Issues . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 15
4.3 IB Router Known Issues . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 17
Chapter 5 Bug Fixes. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 19
Chapter 6 Submitting a Service Request . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 23

Mellanox Technologies Confidential 1

 Document Update History
Table 1. Release Update History

Date Description
June 4, 2020 First release of this software version.

Mellanox Technologies Confidential 2

 Introduction

1 Introduction
This document is the Mellanox MLNX-OS® Release Notes for InfiniBand.
MLNX-OS is a comprehensive management software solution that provides optimal perfor-
mance for cluster computing, enterprise data centers, and cloud computing over Mellanox
Switch-IB®, and Spectrum® IC families. The fabric management capabilities ensure the highest
fabric performance while the chassis management ensures the longest switch up time.
The MLNX-OS documentation package includes the following documents:
• User Manual provides general information about the scope, organization, and command
line interface of MLNX-OS as well as basic configuration examples.
• Release Notes provide information about the supported platforms, changes and new
features, and reports on software known issues as well as bug fixes.
The Mellanox Community also offers useful end-to-end and special How To guides at:
http://community.mellanox.com/community/solutions.

2 Supported Switch Systems, Firmware, Cables and Licenses

2.1 Supported Switch Systems
Table 2. Supported Switch Systems
Model Number Description CPU

QM8700 Mellanox Quantum 40-port QSFP56 HDR (200Gb/s) InfiniBand smart switch x86
TQ8200 Quantum MetroX®-2 40km long haul 100Gb/s, 2 long haul QSFP28 ports, 8 standard x86
HDR ports
TQ8100 Quantum MetroX®-2 10km long haul 100Gb/s, 2 long haul QSFP28 ports, 8 standard x86
HDR ports
SB7800 Switch-IB® 2 36-port EDR (100Gb/s) 1U InfiniBand dual core switch x86
SB7700 Switch-IB 36-port EDR (100Gb/s) 1U InfiniBand dual core switch x86
SB7780 Switch-IB 36-port EDR (100Gb/s) 1U InfiniBand dual core IB router x86
CS7500 Switch-IB Family 648-port EDR (100Gb/s) InfiniBand switch x86
CS7510 Switch-IB Family 324-port EDR (100Gb/s) InfiniBand switch chassis x86
CS7520 Switch-IB Family 216-port EDR (100Gb/s) InfiniBand switch chassis x86

2.2 Tested and Supported Firmware Versions

• Mellanox Quantum™ firmware version 27.2008.12xx
• Switch-IB®-2 firmware version 15.2007.09xx
• Switch-IB® firmware version 11.2007.09xx

2.3 Software/Firmware Interoperability

• ConnectX®-3 firmware version 2.42.5000

Mellanox Technologies Confidential 3

 Supported Switch Systems, Firmware, Cables and Licenses

• ConnectX®-4 firmware version 12.27.2008

• ConnectX®-5 firmware 16.27.2008
• ConnectX®-6 firmware 20.27.2008
• Connect-IB® firmware version 10.16.1200
• Mellanox OpenFabrics Enterprise Distribution (OFED) version 5.0-1.0.0.0
• ONIE version 5.2.0020
• Unified Fabric Manager® software version 6.2.0.5

The minimum required firmware versions for ConnectX-6 and Mellanox Quantum are
20.25.1532 and 27.2000.1260 respectively.

2.4 Supported BIOS Version

• x86 Celeron 4.6.5—0ABZS017_02.02.x04
• x86 ATOM 5.6.5—0ACIF007_02.02.x02
• x86 Broadwell 5.6.5—0ACLH004_02.02.x07

2.5 Supported Software Licenses

For the software licenses supported with MLNX-OS software please refer to the “Licenses” sec-
tion of the “Getting Started” chapter of the Mellanox MLNX-OS User Manual.

2.6 Upgrade from Previous Releases

Older versions of Mellanox MLNX-OS may require upgrading to one or more intermediate ver-
sions prior to upgrading to the latest. Missing an intermediate step may lead to errors. Please
refer to Table 3 to identify the correct upgrade order.
Table 3. Supported Software Upgrades
Target Version Verified Versions From Which to Upgrade

3.9.0xxx 3.8.2xxx, 3.8.1xxx

3.8.2xxx 3.8.1xxx, 3.7.1xxx
3.8.1xxx 3.8.1xxx, 3.7.1xxx
3.7.1xxx 3.7.0xxx, 3.6.8xxx, 3.6.6xxx
3.6.8xxx 3.6.6xxx, 3.6.5xxx
3.6.6xxx 3.6.5xxx, 3.6.4xxx
3.6.5xxx 3.6.4xxx, 3.6.3xxx
3.6.4xxx 3.6.3xxx, 3.6.2xxx
3.6.3xxx 3.6.2xxx, 3.6.1xxx
3.6.2xxx 3.6.1xxx, 3.5.1xxx

Mellanox Technologies Confidential 4

 Supported Switch Systems, Firmware, Cables and Licenses

Table 3. Supported Software Upgrades

Target Version Verified Versions From Which to Upgrade

3.6.1xxx 3.5.1xxx, 3.5.0xxx, 3.4.3xxx

3.5.1xxx 3.5.0xxx, 3.4.3xxx
3.5.0xxx 3.4.3xxx, 3.4.2xxx
3.4.3xxx 3.4.2xxx, 3.4.1xxx
3.4.2xxx 3.4.1xxx,3.4.0xxx
3.4.1xxx 3.4.0xxx, 3.3.5006
3.4.0xxx 3.3.5006
For upgrade instructions refer to the section “Upgrading Mellanox MLNX-OS Software” in Mel-
lanox MLNX-OS User Manual.

2.7 Supported Cables

For a list of the Mellanox-supported cables, please visit the LinkX® Cables and Transceivers
page of the Mellanox website:
http://www.mellanox.com/products/interconnect/cables-configurator.php

When using Mellanox AOC cables that are longer than 50m, one VL must be used to
achieve full wire speed.

2.7.1 Switch and HCAs InfiniBand Cable Connectivity Matrix

Mellanox Quantum™ based switches and ConnectX®-6 HCAs support HDR (PAM4, 50Gb/s
per lane) and EDR (NRZ, 25Gb/s per lane) technologies.
As the ConnectX adapter cards are identified by their maximum supported throughput (e.g.
ConnectX-6 VPI 100Gb/s card can support either 2-lanes of 50Gb/s or 4-lanes of 25Gb/s), the
exact connectivity will be determined by the cable that is being used.
As a reference:
Speed Mode Speed Supported Number of Lanes Used

HDR 200Gb/s InfiniBand 4 lanes of 50Gb/s

HDR100 100Gb/s InfiniBand 2 lanes of 50Gb/s
EDR 100Gb/s InfiniBand 4 lanes of 25Gb/s

Mellanox Technologies Confidential 5

 Supported Switch Systems, Firmware, Cables and Licenses

The following table presents the connectivity matrix, between Mellanox Quantum based
switches, ConnectX-6 HCA, and the cables.
Table 4 - Switch to Switch Connectivity
Switch Switch Cable

H cable DAC H cable AOC HDR DAC HDR AOC EDR DAC EDR AOC

Mellanox Mellanox No such cable HDR100 HDR HDR EDR EDR

Quantum Quantum
Switch-IB 2 Mellanox Not Supported Not Supported EDR Not supported EDR EDR
Quantum

Table 5 - Adapter to Switch Connectivity

Adapter Switch Cable

Y cable DAC Y cable AOC HDR DAC HDR AOC EDR DAC EDR AOC

ConnectX-6 Mellanox HDR100 HDR100 HDR HDR EDR EDR

200Gb/s Quantum
ConnectX-6 Mellanox HDR100 HDR100 EDR EDR1 EDR EDR
100Gb/s Quantum

1. This is currently not supported. For further information see the HDR limitation in table Table 6, “Mellanox Quan-
tum Supported Link Speed”.

2.7.2 Mellanox Quantum™ Supported Link Speed

The table below lists the current supported link speed in Mellanox Quantum-based switch sys-
tems.

Table 6. Mellanox Quantum Supported Link Speed

Cable Length
Speed Cable Limitations
[meters]

SDR Optical Up to 100 N/A

Copper Up to 2
QDR Optical 3/10/15/100 QDR speed is only supported when
Copper Up to 3 using the MC220731V-xxx FDR
cables.
FDR Optical 3/10/15/100 When using MC2207310-0xx optical
cables, FDR speed is supported only
Copper Up to 3
with 10m/15m/30m and only on ports
#7 and #9–#30.
EDR Optical Up to 100 N/A
Copper Up to 3
HDR Optical Up to 100 Note: HDR optical cables support
only HDR speed.
Copper Up to 2
Thus, when mask is configured to
HDR, the link is not raised when
connecting to EDR devices.

Mellanox Technologies Confidential 6

 Changes and New Features

3 Changes and New Features

This chapter contains the following sections:
• “New Features” on page 7.
• “Customer Affecting Changes” on page 12.

3.1 New Features

Table 7. New Features
Category Description

Release 3.9.09xx
MAC Added support for MAC masking in log messages.For more information, see "Logging"
section in the user manual.
UFM Added support for IPv6 in UFM Agent.
General Bug fixes (see Section 5, “Bug Fixes,” on page 19).
Release 3.9.0606
TQ8100 Added ES-level support for TQ8100 system.
TQ8200 Added ES-level support for TQ8200 system.
General Bug fixes (see Section 5, “Bug Fixes,” on page 19)
Release 3.9.0450
Configuration Added support for automated configuration file backup.
Management
Release 3.9.0300
Cables Added support for the following OPNs:
• MMA1L30-CM MMA1T00-HS MCA1J00-H003E/4E MCA7J50-H00XX
DCQCN Added support for DCQCN Congestion Control.
Link Added support for link-negotiated credit size.
Mellanox Scalable SHARP (SAT) is at GA level.
Hierarchical
Aggregation and *SAT: Streaming Aggregation Tree
Reduction Protocol
(SHARP)™
Security SSH Login Notification now displays the following information after authentication:
• Last successful and unsuccessful login date/time
• Number of unsuccessful logins since last successful login
• Changes to user's account since last login (password, capability)
• Location of last successful and unsuccessful login (terminal or IP)
• Number of total successful logins since last X days
Security Upgraded OpenSSH version to 8.0p1.
Split Added ability to MCS8500 systems to configure split-ready profile and split ports using
CLI.
General Bug fixes (see Section 5, “Bug Fixes,” on page 19)

Mellanox Technologies Confidential 7

 Changes and New Features

Table 7. New Features

Category Description

Release 3.8.2204
Link Speed Added QDR/FDR support in Mellanox Quantum switch systems when using optical
cables of up to 30m.
Note: QDR speed is only supported when using FDR cables. For a list of supported
cables, see “InfiniBand Known Issues” on page 15.
Cables HDR Active Copper Cables are now supported between two switches.
General Bug fixes (see Section 5, “Bug Fixes,” on page 19)
Release 3.8.2102
NTP Server Added new CLI commands that allow the user the block the switch's ability to function
as an NTP server. For more information, see NTP commands in "NTP and Clock"
section in the user manual.
Syslog UDP/TCP The"crypto certificate system-self-signed regenerate" command was added with the
option to specify the certificate CA basic constraints flag. For more information see "
Cryptographic (X.509, IPSec) and Encryption" section in the user manual.
Subnet Manager Added additional options for IB partition's member configuration (all-cas, all-routers,
all-switches, all-vcas) to better align with keywords that are supported by opensm when
configuring IB partitions. For more information see "SM Commands" section in the
user manual.
SHARP Added GA-level support for Mellanox Scalable Hierarchical Aggregation and
Reduction Protocol (SHARP)™ v1 technology.
SHARP Added Beta-level support for Mellanox Scalable Hierarchical Aggregation and
Reduction Protocol (SHARP)™ v2 technology.
Release 3.8.2004
BER Added port Bit Error Rate (BER) monitoring for Mellanox Quantum-based switch
systems.
Cables Removed PLR from active cables longer than 30m.
CS8500 Added thermal algorithm support to CS8500.
InfiniBand Interfaces Added FDR support in Mellanox Quantum switch systems when using optical cables of
up to 30m.
Link Down Added support for Link Down Reasoning.
Reasoning
Logging Added support to send syslog messages based only on a given regex.
For more information, see “Logging Commands” section in the user manual.
Mellanox Scalable [Beta-level] Mellanox Scalable Hierarchical Aggregation and Reduction Protocol
Hierarchical (SHARP)™ technology improves the performance of MPI operations by offloading
Aggregation and collective operations from the CPU to the switch network, and by eliminating the need
Reduction Protocol to send data multiple times between endpoints.
(SHARP)™
Running-config Added version information to the show running-config.
Subnet Manager Added support to enable calculation of missing routes. See “ib sm calculate-missing-
routes” command in the MLNX-OS User Manual.

Mellanox Technologies Confidential 8

 Changes and New Features

Table 7. New Features

Category Description

General Added support to prevent disk from running out of space due to sysdump files.

PLR Added support to the Physical Layer Retransmission (PLR) functionality for HDR
speed.
Link Up Speed Link up time improvements. The link up time is up to 60 seconds.
General Bug fixes (see Section 5, “Bug Fixes,” on page 19)
Release 3.8.1206
Switch Systems Added GA level support for HDR (200Gb/s) capable 800-port InfiniBand switch
system (CS8500).
Chassis HA Added IPv6 support for Chassis HA. For further information, see the “chassis ha bipv6”
and “show chassis ha” commands in the user manual.
Release 3.8.1102
Switch Systems Added beta-level support for HDR (200Gb/s) capable 800-port InfiniBand switch
system (CS8500).
Switch Systems Added GA-level support for QM8700 switch system.
InfiniBand Interfaces Added GA level support for HDR rate speed for Mellanox Quantum-based switch
systems.
Release 3.8.1000
JSON Added support for running a single HTTP request for both authentication and JSON
request.
IPv6 Added IPv6 support for RADIUS and Syslog.
WebUI Removed a few insecure parameters of the HTTP header.
Cables Added support for HDR AOC H-cables MFS1S90-H0xxE
Cables Added support for HDR copper cables MCP1650-H00xxxx
Cables Added support for HDR Y splitter copper cable MCP7H50-H001R30.
Docker Added the option to mount USB to a docker container.
Docker Enhanced dockers performance with Overlay2 driver.
Telemetry Added support for deleting telemetry statistics files.
CLI Added Ctrl-w key shortcut support to the CLI.
See section “CLI Shortcuts” in the User Manual.
Breakout Cables Added ability for QTM8700 system to configure split-ready mode and break-out cable
configuration using MADs.
Breakout Cables Confirmation for split-port has changed to an all-caps “YES”.
Release 3.8.0994
System Management Added alpha level support for HDR rate speed on both internal and external links.
Release 3.7.1134
General Bug Fixes
General Bug Fixes

Mellanox Technologies Confidential 9

 Changes and New Features

Table 7. New Features

Category Description

Release 3.7.1086
System Management Added alpha level support for 40-Port HDR / 80-Port HDR100 managed Switch
System (MCS8500). This release provides the following functionalities:
• Two management slave/master modules
• Boot over Out-of-Band (OOB) ports
• EDR rate speed on both internal and external links
• The management chassis includes leaf and spine hot swapping
Release 3.7.1060
Link speed Added alpha-level support for HDR speed when using optical cables only.
Release 3.7.1000
General Upgraded to Linux kernel 4.15/6.
JSON Added JSON API support for all legacy commands.
Security Added support for remote server only in Authentication, Authorization and Accounting
(AAA) fallback.
See section “Authentication, Authorization and Accounting” in the user manual.
Security Added support for CSR certificate.
Security Added support for additional SNMP encryption cipher.
See section “SNMP” in the User Manual.
System Profile Added ability for QTM8700 Mellanox Quantum-based systems to reboot in a split-
ready mode optimized to configure twice the number of ports exposed to IB utilities.
See the parameter “split-ready” in the command “system profile”.
System Profile Added ability to set number of adaptive routing groups in system profile.
See “system profile” command in user manual.
SM Added support for OpenSM 5.2.0 which provides HDR support.
Telemetry Added support for Top Talker.
See section “Telemetry” in the User Manual.
Systems Added EDR-speed GA-level support for the QM8700 switch system.
Release 3.6.8008
JSON Added support for additional JSON commands.
See Appendix “Show Commands Not Supported by JSON.”
Linux Dockers Added ability to start a container immediately as well as after system initialization with
one CLI command.
See parameters “now-and-init” and “now-and-data-path-ready” in the command “start”
under the “Linux Docker” section in the User Manual.
Linux Dockers Added option to limit docker containers CPU and memory usage.
See command “start” in the User Manual.
Linux Dockers Added ability to monitor container statistics.
See command “show docker stats” in the User Manual.
Linux Dockers Added support for sending an SNMP health trap upon container failure.

Mellanox Technologies Confidential 10

 Changes and New Features

Table 7. New Features

Category Description

Security Enhanced default configuration for switches to be more secure so that, by default,
HTTP is disabled, HTTPS is enabled, the lowest SSH version allowed is 2, and SSH
security strict mode is enabled.
SNMP Added a new SNMP notification to the MELLANOX-POWER-CYCLE MIB called
mellanoxPowerCyclePlannedReload (OID 1.3.6.1.4.1.33049.10.1.1.3.1) to support
planned reload.
Subnet Manager Added support for scatter port.
See section “Scatter Ports” in the User Manual.
Subnet Manager Added support for setting GUID order in routing table.
See section “GUID Routing Order” in the User Manual.
Subnet Manager Added support for bulk application of SM configurations.
See section “Bulk Update Mode” in the User Manual.
WebUI Added GA level support for Linux Dockers.
See Setup > Docker in the WebUI.

Mellanox Technologies Confidential 11

 Changes and New Features

3.2 Customer Affecting Changes

Category Description

Release 3.9.09xx
MAC From this release on, the first two bytes of the MAC address in the log will be marked
with asterisks for security purposes. This may be disabled using the no form of the
“logging mac masking” command. See “Logging” section in the user manual for more
information.
Release 3.8.2004
Security Admin and Monitor passwords must be typed upon initial configuration. Default
Enhancements passwords will no longer be created automatically.
As of the September release of version 3.8.2000, California law SB-327 will be
enforced. The new law creates some limitations with respect to the use of the default
password.

Currently, the user is not required to set the default user and password for “Admin” and
“Monitor.” The user can skip the credentials wizard when setting up a new switch and
have the following default User and Password:
Admin: User & Password = admin
Monitor: User & Password = monitor
To comply with the California law SB-327 regulations, the user will now have to enter
the password manually, as part of the initial wizard and will not be allowed to skip this
step. Nevertheless, the user will be allowed to manually write in the default user name
and password (admin/admin or monitor/monitor)

The changes are implemented in a manner that minimizes the impact on the automation
processes so that Zero Touch Provisioning (ZTP) will continue to work as usual and will
not be affected by the new regulation.
XPL API As of the September release of software version 3.8.2000, the XML user accounts will no
Deprecation longer be supported and the XML gateway will be closed. Access through XML will no
longer be available.
Interfaces will only be available through SNMP and JSON.
Backward When performing downgrade or role-back from version 3.8.2000 to an older version, the
Compatibility MGMT slave will require additional reboot to complete initialization.
Web UI Re-designed interface to enhance user experience.

Mellanox Technologies Confidential 12

 Known Issues

4 Known Issues
The following sections describe Mellanox MLNX-OS® known issues in this software release
and possible workarounds.

For hardware issues, please refer to the switch support product page.

4.1 General Known Issues

Table 8. General Known Issues (Sheet 1 of 2)
Index Category Description Workaround

1. Cables, System If a faulty cable is used, rise time of other N/A

Management interfaces in the system may be delayed.
2. Chassis Management Duplicate notification is sent upon high N/A
temperature alerts, both specific module alerts
and general “too high” alerts.
3. CLI Command output filtering does not support the N/A
following commands:
• show log
• show puppet-agent log
• show ib sm log
• show configuration text files <file>
4. Configuration Applying a configuration file of one system N/A
Management profile to another is not supported from one
system type to another.
5. Configuration The system needs to be rebooted after running N/A
Management the command “configuration revert factory
keep-basic keep-connect”.
6. Configuration Binary configuration files saved from releases Save your configurations
Management older than 3.6.1002 cannot be fetched to the as text files before
switch and fail with a decryption error. It is upgrading to this version.
recommended to create a new copy of the bin
configuration file after upgrade in case
configuration backup is needed.
7. Configuration Merging two binary configuration files using Use “configuration text
Management the command “configuration merge” is not file apply” instead.
supported.
8. JSON The command "show whoami" is not supported Run the command through
through JSON HTTP request. the CLI.

9. Linux Dockers When running “configuration text apply” (with Run the init configuration
“docker no shutdown”), a container that is from the CLI session.
configured as init, may run immediately
(instead of waiting for next boot).

Mellanox Technologies Confidential 13

 Known Issues

Table 8. General Known Issues (Sheet 2 of 2)

Index Category Description Workaround

10. Linux Dockers If two docker images are installed, both from Delete older latest image
same distribution and both chosen as “latest”, or download while
the command “show docker images” may specifying a version.
display image name and image version as
“none”.
11. Logging The warning “[pm.WARNING]: snapshots and N/A
sysdumps are on separate partitions; space
constraints not thoroughly enforced on
sysdumps” may appear if operating with an
encrypted file system. This warning may be
safely ignored.
12. Logging When switch clock has an earlier time N/A
configured from the certificate creation, the
following error may appear in the log and can
be safely ignored: “[mgmtd.ERR]:
md_cert_validate_new_cert_value(),
md_cert.c:3388, build 1: Return status 512
from openssl verify!”
13. Management Switch systems may have an expired HTTPS Generate a new certificate
Interfaces certification. by changing the hostname.
14. Management Consecutive hostname modification is not Wait 25 seconds before
Interfaces supported. reattempting to modify the
hostname.
15. Management Speed of mgmt0 interface is shown as N/A
Interfaces “UNKNOWN” when working with VM.
16. SNMP Request timeout should be set to at least 20 N/A
seconds since initial table calculation requires
time.
17. Virtual Machine Virtualization connection might fail when Connect through text.
trying to connect through graphics.
18. Virtual Machine For volume fetch, using a USB drive formatted Use EXT3 USB format.
with VFAT causes errors in the log and may
require additional reboot for the USB to be
registered for virtual machine volume usage.
19. WebUI Interactive CLI commands cannot be executed N/A
via WebUI.
20. WebUI Importing a configuration text file with Import the configuration
commands that only get enabled after running text file through the CLI.
other commands is not possible through the
WebUI.
21. WebUI Reversing the time clock can result in WebUI Clear the graphs data after
graphs’ corrupted data. setting the clock.
22. WebUI Enabling/disabling HTTPS while connected Refresh the page or
via HTTP to the WebUI may result in navigate back using the
temporary loss of connection to the webpage. browser’s back button.

Mellanox Technologies Confidential 14

 Known Issues

4.2 InfiniBand Known Issues

Table 9. InfiniBand Known Issues (Sheet 1 of 3)
Index Category Description Possible Workaround

1. FDR, Cables FDR link is unstable when using an FDR N/A

cable in ports: #27-#34.
2. HDR, Cables Occasionally, when using Active Fiber N/A
Splitter cables (OPNs: MFS1S90-Hxxx),
unclean RAW BER (10e-6) might be seen.
3. CS8500 SM key is not supported for MCS8500 N/A
systems.
4. TQ8200 In TQ8200 system, 40km cable is not yet N/A
supported.
5. Cables, Split Breakout cables are not supported in N/A
CS8500 switch systems.
6. Chassis HA A management module that has been reset 5 To resolve the issue,
times by the other management module on a perform the following:
director switch is treated as malfunctioning • Remove the powered
and gets disabled even after plugging out off management mod-
and plugging in the module. ule.
• Run “chassis ha power
enable other”.
• Remove the powered
off management local
spine and wait 1 min-
ute
• Plug in the removed
spine (this step will
raise the spines inter-
nal links).
• Plug in the removed/
new management
(spine’s link will fall
and raise again once it
is done).
7. Chassis HA On director switch systems, only one N/A
existing SNMP user is supported with
chassis HA.
8. Chassis Management On CS7520 switch systems, the spine health N/A
LED lights amber even when one of the
spine fans is missing.
9. Chassis Management On CS75x0 switch systems, duplicate N/A
notifications are sent for a leaf in fatal state.

10. Chassis Management Retrieving chassis information (such as N/A

temperature, power etc.) by running show
commands can only be performed from
chassis master.

Mellanox Technologies Confidential 15

 Known Issues

Table 9. InfiniBand Known Issues (Sheet 2 of 3)

Index Category Description Possible Workaround

11. CS8500 System SNMP requests for "entPhysicalTable" in N/A

ENTITY-MIB may return false values for
some of the ports.
12. InfiniBand (CS7500) When performing downgrade or role-back Reload the switch.
Switch Systems from version 3.8.2000 to an older version,
the management slave may not boot
properly.
13. InfiniBand Director When performing upgrade on a director N/A
Switch Systems switch system, the following error might
appear and cab be safely ignored:
"[hwd.ERR]:
hwd_stm_handle_incoming_event()
..."
14. InfiniBand Interfaces Running DHCP over IB0 interface may not N/A
complete.
15. InfiniBand Interfaces Setting the port width to 1x in the WebUI N/A
and/or CLI is currently not supported.
16. InfiniBand Interfaces When using MC2207310-0xx optical N/A
cables, FDR speed is supported only with
10m/15m/30m and only on ports #7 and #9–
#30.

17. Mellanox Quantum Running mstdump on Mellanox Quantum Reload the switch.
ASIC from a host (on MFT versions 4.12.0-
15 or older) followed by split-port
operations, may cause the ASIC to not
operate properly.
18. Mellanox Quantum The following features are not currently N/A
supported on Mellanox Quantum-based
systems:
• Congestion Control
• IB Router
• Signal Degradation Monitoring
• Telemetry Protocol
19. SHARP On rare occasions and under high SHARP Disable trimming in
load, switch SHARP operation might get Aggregation Manager
stuck. settings.
20. SHARP (SAT) Data VLs buffer may be lack of credits due Use SHARP (SAT)
to an overload of small size SHARP (SAT) message size of at least
messages (<32KB). 32KB.

Mellanox Technologies Confidential 16

 Known Issues

Table 9. InfiniBand Known Issues (Sheet 3 of 3)

Index Category Description Possible Workaround

21. SM Chassis HA takeover might terminate open Run open SM manually

SM on new master. after takeover.
22. SM DOR and LASH OpenSM routing N/A
algorithms can be configured only via the
CLI.
23. SM It is not allowed to configure an smnode N/A
with “*” character (e.g. “ib smnode *”).
24. SM The “Subnet Manager started” email may N/A
not be sent on system initialization.
25. SM The SM must be disabled prior to and N/A
during the software upgrade.
26. SM Two notifications are sent via SNMP trap or N/A
email when the SM is disabled.
27. SM When changing the parameter N/A
allow_both_pkeys and partition settings,
OpenSM must be restarted in the default
partition for the change to take effect.
28. SM HA After upgrading a director switch system Reboot the SM HA slave.
with both management modules part of an
SM HA cluster, the SM HA slave may see
the SM HA master as offline.
29. SM HA Change hostname to members of SM HA Configure hostname to a
network my result in these member to be member prior adding it to
appear as offline. the cluster.
30. SM HA If an SM HA node fails, the VIP might not Reconnect through the
be reachable, but functionality is not VIP.
affected.
31. SM HA The SM HA works only over mgmt0. N/A

32. WebUI WebUI does not support arbitrary setting of N/A

all SM routing engines. If the CLI does not
support the configuration, the routing
engines option is disabled in the WebUI.

4.3 IB Router Known Issues

Table 10. IB Router Known Issues (Sheet 1 of 2)
Index Category Description Possible Workaround

1. Adaptive Routing Adaptive routing cannot run when IB router is N/A

enabled.
2. Embedded SM Embedded SM cannot run on multi-SWID Run SM using OpenSM.
profile.

Mellanox Technologies Confidential 17

 Known Issues

Table 10. IB Router Known Issues (Sheet 2 of 2)

Index Category Description Possible Workaround

3. FDB Capabilities Switch-IB switch systems may provide 4 N/A

SWID up to 48k, or 6 SWIDs up to 24K.
4. IB Router IP validation errors are counted on the L2 N/A
interface.

5. IB Router IB router packets arrive with wrong VL when Use either SL2VL or
crossing VL2VL and SL2VL. VL2VL.

6. Interfaces Configuring IB router prior to mapping an Reconfigure IB router by

interface to an IB router subnet may cause the running “ib router 
interface not to link up. shutdown” then “no ib
router shutdown”.
7. Interoperability IB router is only supported on fat-tree N/A
topologies.
8. Multicast IB router does not support multicast traffic. N/A

Mellanox Technologies Confidential 18

 Bug Fixes

5 Bug Fixes
The following table lists the latest Mellanox MLNX-OS® bug fixes.

Table 11. Bug Fixes

Index Category Description

Revision 3.9.09xx
1. Logging Default configuration of log rotation criteria "size" appears in "show running-
config".
2. Switch Management In version 3.9.06xx, when more than 1000 DNS resolutions occur via DHCP,
the switch may get stuck.
3. TQ8xxx Systems, TQ8100 and TQ8200 systems show a second management interface. This
Management second interface can be ignored.
Interfaces
Revision 3.9.0606
4. General Management When "SSH server login record-period" is set to 30 days and the successful
login count is higher than 20K, a delay may be experienced in initializing
SSH, the console, or web sessions.
5. Link On rare occasion when link is flapping or toggle by the user, the switch may
hang.
6. Logging Logging to remote host in WELF format is not working.

7. SHARP (SAT) Traffic loss may be experienced during a spine failover, when two SHARP
(SAT) flows are enabled.
8. SNMP In case of power supply cable removal, the power supply is still accessible to
SNMP requests.
9. SNMP, MIB On systems with fixed PSUs (where PSUs cannot be removed), when one PSU
is down, SNMP OID 1.3.6.1.2.1.99 fails.
Revision 3.9.0450
1. Link EDR link does not come up when using MMA1L30-CM modules with
SB7800 switches.
2. Management Inter- The IPv6 address of management interfaces disappears when link flips, if it is
faces, IPv6 a static IP.
3. SHARP (SAT), 2 Running 2 flows in parallel is currently not functional in SHARP (SAT).
Flows
4. SM HA Some online nodes are mistaken by the SM HA as being offline, when the
hostnames are only differentiated by a '.' instead a '-'.
Revision 3.9.0300
5. Auto-negotiation, As the switch does not send auto-negotiation indication, after resetting/power
HCA cycling a ConnectX-6 HCA, some HCAs get stuck in "polling" state.
6. Link Up The switch gets stuck while conducting force link up with too many PLR
retries.

Mellanox Technologies Confidential 19

 Bug Fixes

Table 11. Bug Fixes

Index Category Description
7. Logging; rsyslog When rsyslog is flooded with log requests, restarting the rsyslog during the
deinitialization flow will result in a crash.
8. Security Missing LDAP group support.
9. WSMD In very rare cases, heavy web loads caused WSMD to crash.
Revision 3.8.2204
10. CLI The CLI allowed for configuration of an invalid IP and netmask, such as
0.0.0.0/0, on the management interfaces.
11. Debug Dump On CS8500 switch systems, when running the command "debug generate
dump" few error in the following format may appear in the log : “[sdkd.ERR]:
SDK LOG MESSAGE:....”
12. Docker Docker daemon failed to start.
13. InfiniBand Interfaces Running DHCP over IB0 interface may fail.
14. Management Inter- The CLI command “ip default-gateway <inter-face>” sets the gateway address
faces to 0.0.0.0 and prevents the user from adding other gateways and the command
cannot be removed.
15. QM8700 System Error flow for 1U management.
16. SM HA When a network is restored after a node in an IB HA cluster loses network
connectivity, some of the other cluster nodes may appear as offline to the node.
17. Wizard On manufactured systems, closing the terminal suddenly during the wizard
process will cause the wizard to consume 100% of the CPU.
Revision 3.8.2102
18. Cables CWDM4 AOM cable is currently not supported on Quantum switch systems.
19. Cables When using splitter HDR optical cables, toggling the upper port causes the
lower port to be toggled as well.
20. Chassis Management Immediately after initialization the thermal ambient may not decrease fan
speed properly.
21. CLI The following error message appears after exiting CLI:
clish_output_logout_message(), clish_event.c:334, build 1: Error code 25
returned.
clish_initiate_exit(), clish_event.c:386, build 1: Error code 25 returned
This error can safely be ignored.
22. CS8500 On CS8500, Spine Module failed to power on.

23. CS8500 LCD Fixed display bug on the LCD homepage.

24. Logging In case multiple identical log messages are sent in a short period of time, the
aggregation may not work properly.
25. Logging Upon system deinitialization, the following error may appear in log:
"[unk.ERR]: unk: SDK LOG MESSAGE: [FDB_FLOOD_DB"
This error can be safely ignored.

Mellanox Technologies Confidential 20

 Bug Fixes

Table 11. Bug Fixes

Index Category Description

Revision 3.8.2032
1. Adaptive Routing Packets transmitted to the wrong output port due to misconfiguration of the
packet classification decision in the switch forwarding database cache key that
caused both AR eligible packets and AR ineligible packets to hit the same
cache entry.
2. Cables High BER when using optical module with module firmware older than
37.50.316.
Revision 3.8.2004
3. Cables The bandwidth on MFS1S00-H050E cables is 99Gb/s and on MFS1S00-
H100E cables is 67Gb/s when connecting at HDR speed to a HDR switch.
4. Chassis Management Fan speed changes too often on the system.
5. Copper Cables Link issues might occur if 1.5m copper cables and longer are not connected to
the middle ports of the Mellanox Quantum switch.
6. CLI The CLI command "show interfaces ethernet [<inf>] transceiver brief" can fail
to execute if a cable has the "#" character in its cable information data.
7. CS8500 On CS8500 switch systems, when entering (or powering on) a second manage-
ment module to a director system, a few errors may appear in the log for sev-
eral seconds. These errors can safely be ignored.
8. Error Flow On CS7500 switch systems, after takeover, spine1 may remain in "power on"
state instead of being in "ready" state.
9. JSON When JSON API was overloaded with requests, the request queue would
sometimes get to its maximum capacity.
10. SNMP SNMP through inband stops responding when the management interface is
down.
11. Software Manage- Switch may self-reboot 49 days after upgrading to version 3.8.1206 or higher.
ment
12. Web UI Switch administrator can pull files through the web UI with admin privileges.
13. Configuration Man- Prior to license deletion make sure to be in an allowed profile. Failing to do so
agement may result in errors.
14. HDR, Optical Cables, HDR link up time when using optical cables may take 6 minutes or more (up to 20 min-
Link Up Times utes)
15. JSON When JSON API is overloaded with multiple requests, the request queue can
sometimes get to its maximum capacity.
16. Link-Maintenance A port may hang while Link-Maintenance runs on it and the second port’s link
is toggled.
17. Software Manage- Upgrading to 3.6.80xx fails when the command “web http redirect” is enabled.
ment
18. User Accounts If AAA authorization order policy is configured to remote-only, then when
upgrading to 3.4.3002 or later from an older version, this policy is changed to
remote-first.

Mellanox Technologies Confidential 21

 Bug Fixes

Table 11. Bug Fixes

Index Category Description

Revision 3.8.1206
19. IB Director Systems On director systems with a single mgmt, when S01 (or S02) are being plugged
in to the chassis the modules inserted may remain in “powered-on” state and
not complete their configuration.
20. iblink When running iblinkinfo on QM8700 system, there was an error message in
the output. Updated libraries used by fabric inspector and other link libraries to
support HDR.
21. Network Typology When running ibnetdiscover on QM8700 system, the output was unclear.
Updated libraries used by fabric inspector and other link libraries to support
HDR.
Revision 3.8.1174
22. Chassis HA On CS8500 switch system, the switch may perform an unwanted takeover
during system initialization.
23. InfiniBand Switching CLI hangs when running “show fabric sm” repeatedly.
Revision 3.8.1054
1. Chassis Management On director switch systems, the color of the rear fans’ status LED does not
change after removing spine fans.
Revision 3.8.1000
2. Chassis Management False alert of “Insufficient number of working fans in the system”.
3. Chassis Management Minimal fan speed configuration changes periodically.
4. Hostname Sometimes, the DNS server is unavailable when syslog is configured via host-
name. A process might not respond while trying to print.
5. JSON When sending a JSON request that results in a very large output that takes up
all the disk space assigned for the JSON API (10 MB), new JSON requests are
dropped for 1 minute.
6. JSON When sending JSON GET requests with a payload, it may result in the request
being ignored.
7. Linux Dockers When running “configuration text apply” (with “docker no shutdown”), a con-
tainer that is configured as init, may run immediately (instead of waiting for
next boot).
8. PTP PTP announces an interval which is not present for reloading.
9. SNMP In InfiniBand, snmpwalk packets are discarded due to low CPU rate limiters.
10. SNMP On director switch systems, only 1 existing SNMP user is supported with
chassis HA.
11. SNMP SNMP entPhysicalTable and entPhySensorTable are missing DDMI transceiv-
ers power sensors information.
12. What Just Happened WJH engine hangs during parsing of IPv6 packets with a fragment header and
an additional extension header.

Mellanox Technologies Confidential 22

 Submitting a Service Request

6 Submitting a Service Request

The Mellanox® Support Center is at your service for any issues. You may access the Warranty
Service through the Web Request Form by using the following link:
https://mymellanox.force.com/mellanoxsupport/s/new-case-form.

Mellanox Technologies Confidential 23