                       ============================
                        R E L E A S E    N O T E S
                       ============================

                 Broadcom NetXtreme-C/E BCM5734x Network Controller
                  VMKAPI Ethernet ROCE Driver For VMware vSphere 2016

                   Copyright (c) 2016-2017 Broadcom Limited
                              All rights reserved.

Version 212.0.114.0 (May 8, 2018)
====================================
Fixes:

	-JIRA 29139  Fix for PSOD when destroy CQ command fails or timesout.
	-JIRA 29239  Disabled ECN by default
	-JIRA 29138  Fixed Memory Leak in bnxtroce due to which unload failed

Version 212.0.107.0 (April 19, 2018)
=======================================
Fixes:

	-JIRA 29044  Reset missedEvents when there are no missedEvents to be polled.
	-JIRA 29185  Generate Error Completion even if completion is requested for signalled WQEs only.

Version 212.0.93.0 (March 26, 2018)
======================================
Fixes:

	-JIRA 28867	Fixed PSOD due to incompatibility between bnxtnet and bnxtroce driver

Enhancements:

	-JIRA 28351 	Implement Support for printing CNP statistics.
	-JIRA 28741	Added support to print bono trace from driver.

Version 212.0.88.0 (March 16, 2018)
======================================
Updating component version.

Version 212.0.85.0 (March 13, 2018)
======================================
Updating component version.

Version 212.0.81.0 (March 8, 2018)
=====================================
Updating component version.

Version 212.0.70.0 (February 22, 2018)
=========================================
Updating component version.

Version 212.0.69.0 (February 21, 2018)
=========================================
Enhancements:

	-JIRA 28272 Implemented Error Statistics in ESX RoCE Driver

Version 212.0.64.0 (February 16, 2018)
=========================================
Fixes:

	JIRA 28386 Added bnxtroce driver support for ESX 6.7

Version 212.0.62.0 (February 14, 2018)
=========================================
Enhancements:

	-JIRA 28097 Added Support for CNP configuration and Display.

Version 212.0.47.0 (January 29, 2018)
========================================
Fixes:

	- JIRA 28070 Fix for RX packet counters incrementing on Port 0 when traffic is on Port 1.
	- JIRA 26540 Enforced atomicity and memory barrier for device status checks

Version 212.0.46.0 (January 25, 2018)
========================================
Fixes:

	JIRA-27942  Fixed UD Traffic failure due to incorrect network header type

Version 212.0.33.0 (January 12, 2018)
========================================
Updating component version.

Version 212.0.32.0 (January 11, 2018)
========================================
Enhancements:

    -JIRA 27422: Added Shared Receive Queue (SRQ) support to bnxtroce(Esxi 6.7 and above).

Version 212.0.26.0 (January 5, 2018)
=======================================
Fixes:

    -JIRA 27685   bnxtroce: Fixed speed for 100G in device display.

Version 212.0.21.0 (December 28, 2017)
=========================================
Updating component version.

Version 212.0.19.0 (December 22, 2017)
=========================================
Updating component version.

Version 212.0.18.0 (December 21, 2017)
=========================================
Updating component version.

Version 212.0.12.0 (December 14, 2017)
=========================================
Updating component version.

Version 210.0.36.0 (November 16, 2017)
=========================================
Updating component version.

Version 210.0.27.0 (November 7, 2017)
========================================
Updating component version.

Version 210.0.20.0 (October 31, 2017)
========================================
Updating component version.

Version 20.8.1.0 (ESXi 6.5 and ESXi 6.6) Sep 13, 2017
=====================================================
        Supports HWRM version 1.7.7.3, Chimp FW Version 20.8.12 or higher and BONO Version 20.8.10.0 or higher
        and minimum L2 driver 20.8.1.0

                20.8.1.0 Fixes
                ---------------
		CTRL-26534 -  Fixed errors reported by  DVV static analysis (VMWare)
		CTRL-26093 -  Added support for MISSED Events in CQ_NOTIFY
		CTRL-23500 -  Corrected Speed reported to Stack in case of 50 Gbps Port.
		CTRL-25429 -  Fixed PSOD seen due to accessing CQ after it is deleted(while NQE processing)
		CTRL-22015 -  (i).  Fixed memory leak issue in roce_dev_add seen during forced pci scan
	                      (ii). Added Support for ESXi 6.6.3



Version 20.8.0.0 (ESXi 6.5) Aug 3rd, 2017
=========================================
        Supports HWRM version 1.7.7.3, Chimp FW Version 20.8.12 or higher and BONO Version 20.8.13.0 or higher
        and minimum L2 driver 20.8.1.0

                20.8.0.0 Fixes
                ----------------
		CTRL-25154 - Advertise Support for Atomic operations only when host supports.
		CTRL-25311 - Fix for ib_send_lat when run in event mode (Delayed Arming).
		CTRL-25351 - Fix for PSN related issues when QP is re-used.
		CTRL-25560 - Specify RDMA when allocating context for RoCE stats.
		CTRL-25003 - fix for rstream traffic not receiving tx completions.
		CTRL-25154 - Added support for atomic operations
		CTRL-25091 - Fixed possible interop issue with maxRdAtomic mismatch with peer.
		CTRL-25047 - Fixed - Populate nodeGuid in device query.
		CTRL-25018 - Increase Max MR and MAX GID values per VF.
		CTRL-25003 - Ensure minimum wqe size when application does not provide any sges
		CTRL-22015 - Fixed - Correted the firmware version reported to stack in device query.


Version 20.6.16.0 (ESXi 6.5) Mar 3, 2017
=========================================
        Supports HWRM version 1.7.3, Chimp FW Version 20.6.70 or higher and BONO Version 20.6.41.0 or higher
        and minimum L2 driver 20.6.31.0

                20.6.16.0 Fixes
                ----------------
		2. CTRL-24971 -  Fix for UD Lockup issue

Version 20.6.15.0 (ESXi 6.5) Mar 1, 2017
=========================================
        Supports HWRM version 1.7.3, Chimp FW Version 20.6.70 or higher and BONO Version 20.6.41.0 or higher
        and minimum L2 driver 20.6.31.0

                20.6.15.0 Fixes
                ----------------
		1. CTRL-24735 - HWRM command timeouts are seen when scacling above 4000 QPs.
		2. CTRL-24861 - Fix for the synchronisation for Tx path retransmission.

Version 20.6.14.0 (ESXi 6.5) Feb 27, 2017
=========================================
        Supports HWRM version 1.7.3, Chimp FW Version 20.6.70 or higher and BONO Version 20.6.39.0 or higher
        and minimum L2 driver 20.6.31.0

		20.6.14.0 New Features:
                -----------------------
		1. CTRL-24869: Module parameter to enable/disable ECN, configure DSCP

                20.6.14.0 Fixes
                ----------------
                CTRL-24857: Fix possible corruption in slow path resp critical section.
		CTRL-24849: Add vlan tag for RoCE traffic if vlan id is 0 and non-zero priority.
		CTRL-24855: Fix for SQ Depth issue.

Version 20.6.13.0 (ESXi 6.5) Feb 17, 2017
=========================================
        Supports HWRM version 1.7.0, Chimp FW Version 20.6.66 or higher and BONO Version 20.6.38.0 or higher
        and minimum L2 driver 20.6.31.0

		20.6.13.0 New Features:
                -----------------------
		bnxtroce cli plugin to print driver info

                20.6.13.0 Fixes
                -----------------------
                CTRL-24735: Fix for ib traffic halt when running ib traffic with firmwares > 20.6.61.0

Version 20.6.12.0 (ESXi 6.5) Feb 06, 2017
=========================================
        Supports HWRM version 1.7.0, Chimp FW Version 20.6.60 or higher and BONO Version 20.6.36.0 or higher
        and minimum L2 driver 20.6.30.0

		20.6.12.0 New Features:
                -----------------------
		Upgrade to the HWRM versin 1.7.0

                20.6.12.0 Fixes
                -----------------------
                CTRL-24326: Fix for PSOD in QP async event handling.

Version 20.6.11.0 (ESXi 6.5) Dec 30, 2016
=========================================
        Supports HWRM version 1.6.1, Chimp FW Version 20.6.52.0 or higher and BONO Version 20.6.37.0 or higher
        and minimum L2 driver 20.6.23.0

                20.6.11.0 New Features:
		-----------------------
		CTRL-23840: Support for QP1 over VF

		20.6.11.0 Fixes
                -----------------------
                CTRL-24307: Updated the CMDQ offset.
                CTRL-23838: Corrected the irrd and orrd values in modify qp to avoid IRRQ overflow seen during iser testing.

Version 20.6.10.0 (ESXi 6.5) Dec 15, 2016
=========================================
        Supports HWRM version 1.5.4, Chimp FW Version 20.6.45.0 or higher and BONO Version 20.6.26.0 or higher
	and minimum L2 driver 20.6.21.0

		20.6.10.0 New Features
		-----------------------
		CTRL-23836: Support for SRIOV VF Passthrough to the VM added.
			    256 QPs can be created per VF.
		CTRL-23838: Added support for iSER (with Mellanox iSER target).

Version 20.6.9.0 (ESXi 6.5) Dec 02, 2016
=========================================
        Supports HWRM version 1.5.4, Chimp FW Version 20.6.45.0 or higher and BONO Version 20.6.26.0 or higher
	and minimum L2 driver 20.6.21.0

		20.6.9.0 Fixes
		--------------
		CTRL-24050:  PSOD in hwq_alloc() during boot time. reverted the cmdq prod index
			     offset change as BONO does not have it yet.

Version 20.6.8.0 (ESXi 6.5) Nov 30, 2016
=========================================
        Supports HWRM version 1.5.4, Chimp FW Version 20.6.45.0 or higher and BONO Version 20.6.26.0 or higher
	and minimum L2 driver 20.6.21.0

		20.6.8.0 Fixes
		--------------
		1. Support for the latest ESX 6.5 GA DDK - 4598673
		2. Added QP HW error async event handling.
		3. Updated cmdq prod offset in pcie BAR (Needs atleast BONO: 20.6.26.0. Not backward compatible).

Version 20.6.7.0 (ESXi 6.5) Nov 15, 2016
=========================================
        Supports HWRM version 1.5.3, Chimp FW Version 20.6.42.0 or higher and BONO Version 20.6.25.0 or higher
	and minimum L2 driver 20.6.18.0

		20.6.7.0 Fixes
		--------------
		CTRL-23614 : Fixed PSOD when RoCE + L2 traffic is run with Qos.

Version 20.6.6.0 (ESXi 6.5) Nov 3, 2016
=========================================
        Supports HWRM version 1.5.2, Chimp FW Version 20.6.40 or higher and BONO Version 20.6.18 or higher
	and minimum L2 driver 20.6.16.0

		20.6.6.0 Fixes
		--------------
		Fixed POLL to consider signal bit during reporting of work completion
		CTRL-23557: Fixed driver to ignore QP MODIFY if qpAttrMask is 0.
		Flush CQEs during QP DESTROY to avoid possible PSOD.


Version 20.6.5.0 (ESXi 6.5) Oct 26, 2016
=========================================
        Supports HWRM version 1.5.2, Chimp FW Version 20.6.36 or higher and BONO Version 20.6.16 or higher
	and minimum L2 driver 20.6.15.0

		20.6.5.0 Fixes
		--------------
		CTRL-23283:  Fixed failure to create Multiple queue pairs with defualt tx of 128 fails.
		CTRL-22015:  Fixed DELETE_GID was failing during driver unload.
		CTRL-23468:  Fixed failure to create more than 256 QPs.  Corrected heap size calculation.
		CTRL-23025:  Fixed psod due to out of range tx-depth configuration

Version 20.6.4.0 (ESXi 6.5) Oct 17, 2016
=========================================
        Supports HWRM version 1.5.2, Chimp FW Version 20.6.36 or higher and BONO Version 20.6.16 or higher
	and minimum L2 driver 20.6.14.0

		20.6.4.0 Fixes
		--------------
		CTRL-23350 - Fixed the speed advertised to vmkernel in case of 25 Gbps.
		CTRL-23387 -  i). Added disable_rocev2 module parameter to disable support for rocev2.
			     ii). In Create Bind, if the binding already exists, avoid printing error message and return VMK_EXISTS.
			    iii). Set the hoplimit to 1, instead of 64 when stack does not provide during QP MODIFY and AH CREATE
		CTRL-23381 - Fixed GSI QP (QP_MODIFY) failure and PSOD on port 1 due to invalid sgid Index filled in QP_MODIFY

Version 20.6.3.0 (ESXi 6.5) Sep 28, 2016
=========================================
        Supports HWRM version 1.5.1, Chimp FW Version 20.6.30 or higher and BONO Version 20.6.15 or higher

		New Features Tested
		-------------------
		Basic NPAR and vRDMA support is working.
		Needs more testing.

		20.6.3.0 Fixes
		--------------
		CTRL-23211 - Updated the DDK to latest RC DDK-4240417.
		CTRL-23239 - ISSUE : Applications in the VM cannot establish connection with RDMA CM (-R option)
		             CAUSE : vRDMA uses UD Queue pair instead of GSI Queue pair for connection establishment.
					         When creating address handle for the UD Queue pair, Stack does not set the hop
							 limit. So the outgoing packet with TTL=0 is dropped. Hence connection cannot be
							 established
					 Fix   : If the stack does not set the Hop limit during AH create, Driver will set TTL to 64.

		CTRL-23210 - ISSUE : RoCE traffic Fails with rx depth set to any value less than 16
					 CAUSE:  The HW Queue depth is rounded up to the page boundry. So it can be
					         different from the value reported to the upper layers.
						     During Poll, comparing the actual depth with reported depth will fail for depths
						     less than 16.
					 Fix :   Always use only actual rounded up depth for all purposes.

		CTRL-23060, 23075
					ISSUE :  PSOD seen when running RDMA traffic with FastReg Memory Registration.
					CAUSE :  Memory corruption occured while building the FastReg WQE.
					Fix   :  Fixed the memory corruption.

		CTRL-22015 Change : Change to adopt to the new TQM ctx memory allocation procedure.

Version 20.6.2.0 (ESXi 6.5) Sep 16, 2016
=========================================
        Supports HWRM version 1.5.1, Chimp FW Version 20.6.25 and BONO Version 20.6.13

	Features Supported:
	-----------------

		The following features are supported in this release

		1. RoCE v1 and RoCE v2 are supported.
		2. Features Supported -
			i). QP Types   - RC, UD, GSI
			ii). MR Types   - DMA MR, Phys MR, Fast Reg MR.
			iii). Operations - SEND, READ, WRITE.

		3. ROCEv1 and ROCEv2 over NPAR functions is supported.

		4. Both MAC Based and IP based GIDs are supprted.

		5. RDMA Connection Manager (GSI/QP1) is supported for both ROCEv1 and ROCEv2.

		6. For ROCEv2 - IPv4 and IPv6 addressing schemes are supported.

		7. Applications used to Verify Functionality - KRDMA, VMKAPI

		8. KRDMA Testing
		      i).  All RDMA Operations (SEND/READ/WRITE) over RC Queue pair are tested with KRDMA.
			       and VMKAPI applications on both ROCEv1 and ROCEv2.
		      ii). UD Queue pairs are verified with SEND Latency/bandwidth operations.
		     iii). All packet sizes from 1-4096 are tested and also with "-a" command line argument to test RC/UD queue pair
			       with all packet sizes (1-4096).
			  iv). ROCEv2 is verified with IPv4 and IPv6 addressing schemes.
			   v). ROCEv1/ROCEv2 over NPAR functions are tested with RC and UD Queue pairs.
			  vi). RoCE functionality with and without VLAN configuration is tested over RC queue Pairs.

		9). VMKAPI Test suite
				i). Connection Management over ROCEv1 and ROCEv2.
			   ii). RC Stress Tests, Mutliple Connections establishment (accept and reject), CM Negative tests
			  iii). Physical Memory Registration and Fast Registration Memory Registration over RC Queue Pairs.
			   iv). ROCEv2 : Only  IPv4 addressing scheme can only be tested with VMKAPI Tests.

		20.6.2.0 Fixes
		---------------
		CTRL-22015
			Fixed the send buffer length to accomodate VLAN header in outgoing packets on GSI QP.
			Fixed a potential issue related to pbl table in phys Mr registration.

Version 20.6.1.0 (ESXi 6.5) Aug 25, 2016
=========================================
        Supports HWRM version 1.4.0, Chimp FW Version 20.6.20 and BONO Version 20.6.0

        Initial release:
        ---------------

                The following features are supported in this release

                1. RoCE v1 and RoCE v2 are supported.
                2. RC, UD and QP1 connection types are supported.
                4. DMA MR, Fast Register MR and Phys MR are supported.

