Mellanox OFED for Linux Release Notes

1 Mellanox ofed for Linux Release Notes Rev Rev NOTE: THIS HARDWARE, SOFTWARE OR TEST SUITE PRODUCT ( PRODUCT (S) ) AND ITS RELATED. DOCUMENTATION ARE PROVIDED BY Mellanox TECHNOLOGIES AS-IS WITH ALL FAULTS OF ANY. KIND AND SOLELY FOR THE PURPOSE OF AIDING THE CUSTOMER IN TESTING APPLICATIONS THAT. USE THE PRODUCTS IN DESIGNATED SOLUTIONS. THE CUSTOMER'S MANUFACTURING TEST. ENVIRONMENT HAS NOT MET THE STANDARDS SET BY Mellanox TECHNOLOGIES TO FULLY. QUALIFY THE PRODUCT(S) AND/OR THE SYSTEM USING IT. THEREFORE, Mellanox TECHNOLOGIES. CANNOT AND DOES NOT GUARANTEE OR WARRANT THAT THE PRODUCTS WILL OPERATE WITH THE. HIGHEST QUALITY. ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING , BUT NOT LIMITED TO, THE.

2 IMPLIED WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND. NONINFRINGEMENT ARE DISCLAIMED. IN NO EVENT SHALL Mellanox BE LIABLE TO CUSTOMER OR. ANY THIRD PARTIES FOR ANY DIRECT, INDIRECT, SPECIAL, EXEMPLARY, OR CONSEQUENTIAL. DAMAGES OF ANY KIND (INCLUDING , BUT NOT LIMITED TO, PAYMENT FOR PROCUREMENT OF. SUBSTITUTE GOODS OR SERVICES; LOSS OF USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION). HOWEVER CAUSED AND ON ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY FROM THE USE OF THE. PRODUCT (S) AND RELATED DOCUMENTATION EVEN IF ADVISED OF THE POSSIBILITY OF SUCH. DAMAGE. Mellanox Technologies 350 Oakmead Parkway Suite 100.

3 Sunnyvale , CA 94085. Tel: (408) 970-3400. Fax: (408) 970-3403. Copyright 2016. Mellanox Technologies Ltd . All Rights Reserved . Mellanox , Mellanox logo, Accelio , BridgeX , CloudX logo, CompustorX , Connect -IB , ConnectX , CoolBox , CORE-Direct , EZchip , EZchip logo, EZappliance , EZdesign , EZdriver , EZsystem , GPUD irect , InfiniHost , InfiniBridge , InfiniScale , Kotura , Kotura logo, Mellanox CloudRack , Mellanox CloudXMellanox , Mellanox Federal Systems , Mellanox HostDirect , Mellanox Multi-Host , Mellanox Open Ethernet , Mellanox OpenCloud , Mellanox OpenCloud Logo , Mellanox PeerDirect , Mellanox ScalableHPC , Mellanox StorageX , Mellanox TuneX , Mellanox Connect Accelerate Outperform logo , Mellanox Virtual Modular Switch , MetroDX , MetroX , MLNX-OS , NP-1c , NP-2 , NP-3.

4 Open Ethernet logo, PhyX , PlatformX , PSIPHY , SiPhy , StoreX , SwitchX , Tilera , Tilera logo, TestX , TuneX , The Generation of Open Ethernet logo , UFM , Unbreakable Link , Virtual Protocol Interconnect , Voltaire and Voltaire logo are registered trademarks of Mellanox Technologies , Ltd. All other trademarks are property of their respective owners . For the most updated list of Mellanox trademarks, visit /page/trademarks 2 Mellanox Technologies Rev Table of Contents Table of Contents .. 1. Release Update History .. 3. Chapter 1 Overview .. 4. Content of Mellanox ofed for Linux .. 4. Supported Platforms and Operating Systems .. 5. Supported Hypervisors .. 6. Supported Non- Linux Virtual Machines.

5 7. Tested Hypervisors in Paravirtualized and SR-IOV Environments .. 7. Hardware and Software Requirements .. 9. Supported HCAs Firmware Versions .. 9. Compatibility Matrix .. 10. RoCE Modes Matrix .. 10. Chapter 2 Changes and New Features in Rev .. 11. Future API Changes in MLNX_OFED .. 12. Chapter 3 Known Issues .. 13. Driver Installation/Loading/Unloading/Start Known Issues .. 13. Installation Known Issues .. 13. Driver Unload Known Issues .. 14. Driver Start Known Issues .. 14. System Time Known Issues .. 16. UEFI Secure Boot Known Issues .. 16. Performance Known Issues .. 16. HCAs Known Issues .. 18. mlx5 Driver Known Issues .. 18. Ethernet Network.. 19. Ethernet Known Issues.

6 19. Port Type Management Known Issues .. 21. Flow Steering Known Issues.. 22. Quality of Service Known Issues .. 22. Ethernet Performance Counters Known Issues.. 22. InfiniBand Network .. 23. IPoIB Known Issues .. 23. eIPoIB Known Issues .. 26. XRC Known Issues .. 26. Verbs Known Issues .. 27. RoCE Known Issues .. 27. iSCSI over IPoIB Known Issues .. 29. SDP Known Issues .. 30. Storage Protocols Known Issues .. 30. Storage Known Issues .. 30. SRP Known Issues .. 30. Mellanox Technologies 1. Rev SRP Interop Known Issues .. 30. DDN Storage Fusion 10000 Target Known Issues .. 30. Oracle Sun ZFS Storage 7420 Known Issues .. 30. iSER Initiator Known Issues.. 31. iSER Target Known Issues.

7 31. ZFS Appliance Known Issues .. 32. Erasure Coding Verbs Known Issues .. 32. Virtualization .. 32. SR-IOV Known Issues .. 32. Resiliency .. 36. Reset Flow Known Issues .. 36. Miscellaneous Known Issues.. 37. General Known Issues.. 37. ABI Compatibility Known Issues .. 38. Connection Manager (CM) Known Issues .. 38. Fork Support Known Issues .. 38. Uplinks Known Issues.. 38. Resources Limitation Known Issues.. 38. Accelerated Verbs Known Issues .. 39. InfiniBand Fabric Utilities Known Issues .. 40. Performance Tools Known Issues.. 40. Diagnostic Utilities Known Issues .. 40. Tools Known Issues .. 40. Chapter 4 Bug Fixes History.. 41. Chapter 5 Change Log History.. 49.

8 2 Mellanox Technologies Rev Release Update History Release Date Description Rev April 10, 2017 Added XenServer as a supported OS to Table , Supported Platforms and Operating Systems, on page 5. December 19, 2016 Fixed Connect-IB recommended and additional firmware versions in Section , Supported HCAs Firmware Versions , on page 9. October 20, 2016 Updated the workaround of issue #783496. September 29, 2016 Initial Release of this version. Mellanox Technologies 3. Rev Overview 1 Overview These are the Release Notes of Mellanox ofed for Linux Driver, Rev which operates across all Mellanox network adapter solutions supporting the following uplinks to servers: Uplink/HCAs Uplink Speed ConnectX -4 InfiniBand: SDR, QDR, FDR, FDR10, EDR.

9 Ethernet: 1 GigE, 10 GigE, 25 GigE, 40 GigE, 50 GigE, 56 GigEa, and 100 GigE. ConnectX -4 Lx Ethernet: 1 GigE, 10 GigE, 25 GigE, 40 GigE, and 50 GigE. Connect-IB InfiniBand: SDR, QDR, FDR10, FDR. ConnectX -3/ConnectX -3 Pro InfiniBand: SDR, QDR, FDR10, FDR. Ethernet: 10 GigE, 40 GigE and 56 GigEa ConnectX -2 InfiniBand: SDR, DDR. Ethernet: 10 GigE, 20 GigE. PCI Express or GT/s PCI Express 8 GT/s a. 56 GbE is a Mellanox propriety link speed and can be achieved while connecting a Mellanox adapter cards to Mellanox SX10XX switch series or connecting a Mellanox adapter card to another Mellanox adapter card. Content of Mellanox ofed for Linux Mellanox ofed for Linux software contains the following components: Components Description OpenFabrics core and ULPs InfiniBand and Ethernet HCA drivers (mlx4, mlx5).

10 Core Upper Layer Protocols: IPoIB, SRP, iSER and iSER Initiator and Target OpenFabrics utilities OpenSM: IB Subnet Manager with Mellanox proprietary Adaptive Routing Diagnostic tools Performance tests SSA (SLES12): libopensmssa plugin for OpenSM, ibssa, ibacm MPI Open MPI stack and later supporting the InfiniBand interface MPI benchmark tests (OSU benchmarks, Intel MPI benchmarks, Presta). PGAS HPC-X OpenSHMEM supporting InfiniBand, MXM and FCA. HPC-X UPC supporting InfiniBand, MXM and FCA. HPC Acceleration packages Mellanox MXM (p2p transport library acceleration over Infini- band). Mellanox FCA (MPI/PGAS collective operations acceleration library over InfiniBand). KNEM, Linux kernel module enabling high-performance intra-node MPI/PGAS communication for large messages Extra packages ibutils2.