aboutsummaryrefslogtreecommitdiffstats
diff options
context:
space:
mode:
authorMaciek Konstantynowicz <mkonstan@cisco.com>2017-04-27 10:03:31 +0100
committerMaciek Konstantynowicz <mkonstan@cisco.com>2017-04-27 10:03:31 +0100
commit38850b1710c99c2d981cd9ccd6a474c0a017b91f (patch)
tree3087d5d76a156c35d791b1041350852564c41a54
parent43c34a7ba751495f2bc5f9d6eb9740dedd689f2b (diff)
csit rls1704 report: updates to csit_release_notes.rst files.
Change-Id: I672beb5e710bcec7aba738efe75e508e9394fafe Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
Diffstat
-rw-r--r--docs/report/vpp_functional_tests/csit_release_notes.rst20
-rw-r--r--docs/report/vpp_performance_tests/csit_release_notes.rst150
2 files changed, 86 insertions, 84 deletions
diff --git a/docs/report/vpp_functional_tests/csit_release_notes.rst b/docs/report/vpp_functional_tests/csit_release_notes.rst
index 25ca27c03f..4b682209d6 100644
--- a/docs/report/vpp_functional_tests/csit_release_notes.rst
+++ b/docs/report/vpp_functional_tests/csit_release_notes.rst
@@ -29,38 +29,38 @@ Here is the list of known issues in CSIT |release| for VPP functional tests in V
| # | Issue | Jira ID | Description |
+---+-------------------------------------------------+----------+------------------------------------------------------+
| 1 | DHCPv4 client: Client responses to DHCPv4 OFFER | CSIT-129 | Client replies with DHCPv4 REQUEST message when |
-| | sent with different XID | | received DHCPv4 OFFER message with different (wrong) |
+| | sent with different XID. | | received DHCPv4 OFFER message with different (wrong) |
| | | | XID. |
+---+-------------------------------------------------+----------+------------------------------------------------------+
| 2 | Softwire - MAP-E: Incorrect calculation of IPv6 | CSIT-398 | IPv6 destination address is wrongly calculated in |
-| | destination address when IPv4 prefix is 0 | | case that IPv4 prefix is equal to 0 and IPv6 prefix |
+| | destination address when IPv4 prefix is 0. | | case that IPv4 prefix is equal to 0 and IPv6 prefix |
| | | | is less than 40. |
+---+-------------------------------------------------+----------+------------------------------------------------------+
| 3 | Softwire - MAP-E: Map domain is created when | CSIT-399 | Map domain is created in case that the sum of suffix |
-| | incorrect parameters provided | | length of IPv4 prefix and PSID length is greater |
+| | incorrect parameters provided. | | length of IPv4 prefix and PSID length is greater |
| | | | than EA bits length. IPv6 destination address |
| | | | contains bits writen with PSID over the EA-bit |
| | | | length when IPv4 packet is sent. |
+---+-------------------------------------------------+----------+------------------------------------------------------+
| 4 | IPv6 RA: Incorrect IPv6 destination address in | CSIT-409 | Wrong IPv6 destination address (ff02::1) is used in |
-| | response to ICMPv6 Router Solicitation | | ICMPv6 Router Advertisement packet sent as a |
+| | response to ICMPv6 Router Solicitation. | | ICMPv6 Router Advertisement packet sent as a |
| | | | response to received ICMPv6 Router Solicitation |
| | | | packet. |
+---+-------------------------------------------------+----------+------------------------------------------------------+
| 5 | IPFIX: IPv6_src key name reported instead of | CSIT-402 | The report contains IPv6_src key name instead of |
-| | IPv6_dst | | IPv6_dst when classify session is configured with |
+| | IPv6_dst. | | IPv6_dst when classify session is configured with |
| | | | IPv6 destination address. Anyhow the correct IPv6 |
| | | | destination address is reported. |
+---+-------------------------------------------------+----------+------------------------------------------------------+
-| 6 | IPv4 + VLAN: Processing of tagged frame doesn't | CSIT-564 | Dot1q tagged packets are thrown away in case of IPv4 |
-| | work with virtio driver | | routing on interface binded to virtio driver. Issue |
-| | | | with VIRL test simulation environment |
+| 6 | IPv4 + VLAN: Processing of tagged frame does | CSIT-564 | Dot1q tagged packets are thrown away in case of IPv4 |
+| | not work with virtio driver. | | routing on interface binded to virtio driver. Issue |
+| | | | with VIRL test simulation environment. |
+---+-------------------------------------------------+----------+------------------------------------------------------+
-| 7 | Vhost-user: QEMU reconnect doesn't work | CSIT-565 | Using QEMU 2.5.0 that does not support vhost-user |
+| 7 | Vhost-user: QEMU reconnect does not work. | CSIT-565 | Using QEMU 2.5.0 that does not support vhost-user |
| | | | reconnect. It requires moving CSIT VIRL environment |
| | | | to QEMU 2.7.0. |
+---+-------------------------------------------------+----------+------------------------------------------------------+
-| 8 | Centos7: LISP and VXLAN sporadic test failures | CSIT-566 | Observing sporadic crashes of DUT1 VM during LISP |
+| 8 | Centos7: LISP and VXLAN sporadic test failures. | CSIT-566 | Observing sporadic crashes of DUT1 VM during LISP |
| | | | and VXLAN test executions, what leads to failure of |
| | | | all other tests in the suite. NOTE: After upgrading |
| | | | one of the VIRL servers host from Ubuntu14.04 to |
diff --git a/docs/report/vpp_performance_tests/csit_release_notes.rst b/docs/report/vpp_performance_tests/csit_release_notes.rst
index b4fc9de3c9..8aa4533972 100644
--- a/docs/report/vpp_performance_tests/csit_release_notes.rst
+++ b/docs/report/vpp_performance_tests/csit_release_notes.rst
@@ -45,10 +45,11 @@ Changes in CSIT |release|
Performance Improvements
------------------------
-Some performance improvements in measured packet throughput have been observed
-in a number of CSIT |release| tests listed below. Relative improvements are
-calculated against the test results in CSIT rls1701 report. VPP-16.09 and
-VPP-17.01 numbers are provided for reference.
+Substantial improvements in measured packet throughput have been
+observed in a number of CSIT |release| tests listed below, with relative
+increase of double-digit percentage points. Relative improvements are
+calculated against the test results listed in CSIT rls1701 report.
+VPP-16.09 numbers are provided for reference.
NDR Throughput
~~~~~~~~~~~~~~
@@ -59,31 +60,19 @@ Non-Drop Rate Throughput discovery tests:
| VPP Functionality | Test Name | VPP-16.09 | VPP-17.01 | VPP-17.04 | 17.01 to 17.04 |
| | | [Mpps] | [Mpps] | [Mpps] | Relative Change |
+===================+=================================================================+============+===========+===========+=================+
-| L2XC | 10ge2p1x520: 64B-1t1c-eth-l2xcbase-ndrdisc | 9.4 | 12.7 | 13.4 | 6% |
-+-------------------+-----------------------------------------------------------------+------------+-----------+-----------+-----------------+
-| L2XC | 10ge2p1xl710: 64B-1t1c-eth-l2xcbase-ndrdisc | 9.5 | 12.2 | 12.4 | 2% |
-+-------------------+-----------------------------------------------------------------+------------+-----------+-----------+-----------------+
-| L2XC dot1ad | 10ge2p1x520: 64B-1t1c-dot1ad-l2xcbase-ndrdisc | 7.4 | 8.8 | 9.3 | 6% |
-+-------------------+-----------------------------------------------------------------+------------+-----------+-----------+-----------------+
-| L2XC dot1q | 10ge2p1x520: 64B-1t1c-dot1q-l2xcbase-ndrdisc | 7.5 | 8.8 | 9.2 | 5% |
-+-------------------+-----------------------------------------------------------------+------------+-----------+-----------+-----------------+
-| L2XC VxLAN | 10ge2p1x520: 64B-1t1c-ethip4vxlan-l2xcbase-ndrdisc | 5.4 | 6.5 | 6.8 | 5% |
-+-------------------+-----------------------------------------------------------------+------------+-----------+-----------+-----------------+
| L2XC-vhost-VM | 10ge2p1x520: 64B-1t1c-eth-l2xcbase-eth-2vhost-1vm-ndrdisc | 0.5 | 2.8 | 3.2 | 14% |
+-------------------+-----------------------------------------------------------------+------------+-----------+-----------+-----------------+
-| L2BD | 10ge2p1x520: 64B-1t1c-eth-l2bdbasemaclrn-ndrdisc | 7.8 | 10.4 | 10.8 | 4% |
+| L2BD-vhost-VM | 10ge2p1x520: 64B-1t1c-eth-l2bdbasemaclrn-eth-2vhost-1vm-ndrdisc | 0.4 | 2.7 | 3.1 | 15% |
+-------------------+-----------------------------------------------------------------+------------+-----------+-----------+-----------------+
-| L2BD-vhost-VM | 10ge2p1x520: 64B-1t1c-eth-l2bdbasemaclrn-eth-2vhost-1vm-ndrdisc | 0.4 | 2.7 | 3.4 | 26% |
-+-------------------+-----------------------------------------------------------------+------------+-----------+-----------+-----------------+
-| IPv4 | 10ge2p1x520: 64B-1t1c-ethip4-ip4base-ndrdisc | 8.7 | 9.7 | 10.6 | 9% |
+| IPv4 vhost | 10ge2p1x520: 64B-1t1c-ethip4-ip4base-eth-2vhost-1vm-ndrdisc | 0.3 | 2.6 | 3.1 | 19% |
+-------------------+-----------------------------------------------------------------+------------+-----------+-----------+-----------------+
-| IPv4 COP | 10ge2p1x520: 64B-1t1c-ethip4-ip4base-copwhtlistbase-ndrdisc | 7.1 | 8.3 | 9.0 | 8% |
+| IPv4 LISP | 10ge2p1x520: 64B-1t1c-ethip4lispip4-ip4base-ndrdisc | 4.4 | 4.8 | 5.5 | 15% |
+-------------------+-----------------------------------------------------------------+------------+-----------+-----------+-----------------+
-| IPv4 iAcl | 10ge2p1x520: 64B-1t1c-ethip4-ip4base-iacldstbase-ndrdisc | 6.9 | 7.6 | 8.3 | 9% |
+| IPv6 | 10ge2p1x520: 78B-1t1c-ethip6-ip6base-ndrdisc | 3.0 | 7.3 | 8.1 | 11% |
+-------------------+-----------------------------------------------------------------+------------+-----------+-----------+-----------------+
-| IPv4 vhost | 10ge2p1x520: 64B-1t1c-ethip4-ip4base-eth-2vhost-1vm-ndrdisc | 0.3 | 2.6 | 3.1 | 19% |
+| IPv6 COP | 10ge2p1x520: 78B-1t1c-ethip6-ip6base-copwhtlistbase-ndrdisc | 6.1 | 6.1 | 6.9 | 13% |
+-------------------+-----------------------------------------------------------------+------------+-----------+-----------+-----------------+
-| IPv6 | 10ge2p1x520: 78B-1t1c-ethip6-ip6base-ndrdisc | 3.0 | 7.3 | 8.1 | 11% |
+| IPv6 iAcl | 10ge2p1x520: 78B-1t1c-ethip6-ip6base-iacldstbase-ndrdisc | 6.5 | 6.1 | 6.9 | 13% |
+-------------------+-----------------------------------------------------------------+------------+-----------+-----------+-----------------+
PDR Throughput
@@ -95,29 +84,19 @@ Partial Drop Rate thoughput discovery tests with packet Loss Tolerance of 0.5%:
| VPP Functionality | Test Name | VPP-16.09 | VPP-17.01 | VPP-17.04 | 17.01 to 17.04 |
| | | [Mpps] | [Mpps] | [Mpps] | Relative Change |
+===================+=================================================================+===========+===========+===========+=================+
-| L2XC | 10ge2p1x520: 64B-1t1c-eth-l2xcbase-pdrdisc | 9.4 | 12.7 | 13.4 | 6% |
-+-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-----------------+
-| L2XC dot1ad | 10ge2p1x520: 64B-1t1c-dot1ad-l2xcbase-pdrdisc | 7.4 | 8.8 | 9.3 | 6% |
-+-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-----------------+
-| L2XC dot1q | 10ge2p1x520: 64B-1t1c-dot1q-l2xcbase-pdrdisc | 7.5 | 8.8 | 9.5 | 8% |
-+-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-----------------+
-| L2XC VxLAN | 10ge2p1x520: 64B-1t1c-ethip4vxlan-l2xcbase-pdrdisc | 5.4 | 6.5 | 6.8 | 5% |
-+-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-----------------+
| L2XC-vhost-VM | 10ge2p1x520: 64B-1t1c-eth-l2xcbase-eth-2vhost-1vm-pdrdisc | 2.6 | 3.2 | 3.2 | 0% |
+-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-----------------+
-| L2BD | 10ge2p1x520: 64B-1t1c-eth-l2bdbasemaclrn-pdrdisc | 7.8 | 10.6 | 11.1 | 5% |
-+-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-----------------+
| L2BD-vhost-VM | 10ge2p1x520: 64B-1t1c-eth-l2bdbasemaclrn-eth-2vhost-1vm-pdrdisc | 2.1 | 2.9 | 3.2 | 10% |
+-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-----------------+
-| IPv4 | 10ge2p1x520: 64B-1t1c-ethip4-ip4base-pdrdisc | 8.7 | 9.7 | 10.6 | 9% |
+| IPv4 vhost | 10ge2p1x520: 64B-1t1c-ethip4-ip4base-eth-2vhost-1vm-pdrdisc | 2.0 | 2.7 | 3.1 | 15% |
+-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-----------------+
-| IPv4 COP | 10ge2p1x520: 64B-1t1c-ethip4-ip4base-copwhtlistbase-pdrdisc | 7.1 | 8.3 | 9.2 | 11% |
+| IPv4 LISP | 10ge2p1x520: 64B-1t1c-ethip4lispip4-ip4base-pdrdisc | 4.6 | 4.8 | 5.5 | 15% |
+-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-----------------+
-| IPv4 iAcl | 10ge2p1x520: 64B-1t1c-ethip4-ip4base-iacldstbase-pdrdisc | 7.1 | 7.6 | 8.3 | 9% |
+| IPv6 | 10ge2p1x520: 78B-1t1c-ethip6-ip6base-pdrdisc | 7.7 | 7.3 | 8.1 | 11% |
+-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-----------------+
-| IPv4 vhost | 10ge2p1x520: 64B-1t1c-ethip4-ip4base-eth-2vhost-1vm-pdrdisc | 2.0 | 2.7 | 3.2 | 19% |
+| IPv6 COP | 10ge2p1x520: 78B-1t1c-ethip6-ip6base-copwhtlistbase-pdrdisc | 6.1 | 6.1 | 6.9 | 13% |
+-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-----------------+
-| IPv6 | 10ge2p1x520: 78B-1t1c-ethip6-ip6base-pdrdisc | 7.7 | 7.3 | 8.1 | 11% |
+| IPv6 iAcl | 10ge2p1x520: 78B-1t1c-ethip6-ip6base-iacldstbase-pdrdisc | 6.5 | 6.1 | 6.9 | 13% |
+-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-----------------+
Measured improvements are in line with VPP code optimizations listed in
@@ -134,69 +113,91 @@ Other Performance Changes
-------------------------
Other changes in measured packet throughput, with either minor relative
-increase or decrease, have been observed in a number of CSIT |release| tests
-listed below. Relative changes are calculated against the test results in CSIT
-rls1701 report.
+increase or decrease, have been observed in a number of CSIT |release|
+tests listed below. Relative changes are calculated against the test
+results listed in CSIT rls1701 report.
NDR Throughput
~~~~~~~~~~~~~~
Non-Drop Rate Throughput discovery tests:
++-------------------+-----------------------------------------------------------------+------------+-----------+-----------+-----------------+
+| VPP Functionality | Test Name | VPP-16.09 | VPP-17.01 | VPP-17.04 | 17.01 to 17.04 |
+| | | [Mpps] | [Mpps] | [Mpps] | Relative Change |
++===================+=================================================================+============+===========+===========+=================+
+| L2XC | 10ge2p1x520: 64B-1t1c-eth-l2xcbase-ndrdisc | 9.4 | 12.7 | 13.1 | 3% |
++-------------------+-----------------------------------------------------------------+------------+-----------+-----------+-----------------+
+| L2XC | 10ge2p1xl710: 64B-1t1c-eth-l2xcbase-ndrdisc | 9.5 | 12.2 | 12.4 | 2% |
++-------------------+-----------------------------------------------------------------+------------+-----------+-----------+-----------------+
+| L2XC dot1ad | 10ge2p1x520: 64B-1t1c-dot1ad-l2xcbase-ndrdisc | 7.4 | 8.8 | 9.1 | 3% |
++-------------------+-----------------------------------------------------------------+------------+-----------+-----------+-----------------+
+| L2XC dot1q | 10ge2p1x520: 64B-1t1c-dot1q-l2xcbase-ndrdisc | 7.5 | 8.8 | 9.2 | 5% |
++-------------------+-----------------------------------------------------------------+------------+-----------+-----------+-----------------+
+| L2XC VxLAN | 10ge2p1x520: 64B-1t1c-ethip4vxlan-l2xcbase-ndrdisc | 5.4 | 6.5 | 6.8 | 5% |
++-------------------+-----------------------------------------------------------------+------------+-----------+-----------+-----------------+
+| L2BD | 10ge2p1x520: 64B-1t1c-eth-l2bdbasemaclrn-ndrdisc | 7.8 | 10.4 | 10.8 | 4% |
++-------------------+-----------------------------------------------------------------+------------+-----------+-----------+-----------------+
+| IPv4 | 10ge2p1x520: 64B-1t1c-ethip4-ip4base-ndrdisc | 8.7 | 9.7 | 10.6 | 9% |
++-------------------+-----------------------------------------------------------------+------------+-----------+-----------+-----------------+
+| IPv4 COP | 10ge2p1x520: 64B-1t1c-ethip4-ip4base-copwhtlistbase-ndrdisc | 7.1 | 8.3 | 9.0 | 8% |
++-------------------+-----------------------------------------------------------------+------------+-----------+-----------+-----------------+
+| IPv4 iAcl | 10ge2p1x520: 64B-1t1c-ethip4-ip4base-iacldstbase-ndrdisc | 6.9 | 7.6 | 8.3 | 9% |
++-------------------+-----------------------------------------------------------------+------------+-----------+-----------+-----------------+
+| IPv4 FIB 200k | 10ge2p1x520: 64B-1t1c-ethip4-ip4scale200k-ndrdisc | 8.5 | 9.0 | 9.7 | 8% |
++-------------------+-----------------------------------------------------------------+------------+-----------+-----------+-----------------+
+| IPv4 FIB 20k | 10ge2p1x520: 64B-1t1c-ethip4-ip4scale20k-ndrdisc | 8.5 | 9.0 | 9.4 | 4% |
++-------------------+-----------------------------------------------------------------+------------+-----------+-----------+-----------------+
+| IPv4 FIB 2M | 10ge2p1x520: 64B-1t1c-ethip4-ip4scale2m-ndrdisc | 8.5 | 7.8 | 8.1 | 4% |
++-------------------+-----------------------------------------------------------------+------------+-----------+-----------+-----------------+
+| IPv4 Policer | 10ge2p1x520: 64B-1t1c-ethip4-ip4base-ipolicemarkbase-ndrdisc | 6.9 | 7.4 | 8.1 | 9% |
++-------------------+-----------------------------------------------------------------+------------+-----------+-----------+-----------------+
+| IPv6 FIB 200k | 10ge2p1x520: 78B-1t1c-ethip6-ip6scale200k-ndrdisc | 6.5 | 5.3 | 5.3 | 0% |
++-------------------+-----------------------------------------------------------------+------------+-----------+-----------+-----------------+
+| IPv6 FIB 20k | 10ge2p1x520: 78B-1t1c-ethip6-ip6scale20k-ndrdisc | 6.9 | 6.5 | 6.9 | 6% |
++-------------------+-----------------------------------------------------------------+------------+-----------+-----------+-----------------+
+| IPv6 FIB 2M | 10ge2p1x520: 78B-1t1c-ethip6-ip6scale2m-ndrdisc | 5.3 | 4.2 | 4.6 | 10% |
++-------------------+-----------------------------------------------------------------+------------+-----------+-----------+-----------------+
+
+PDR Throughput
+~~~~~~~~~~~~~~
+
+Partial Drop Rate thoughput discovery tests with packet Loss Tolerance of 0.5%:
+
+-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-----------------+
| VPP Functionality | Test Name | VPP-16.09 | VPP-17.01 | VPP-17.04 | 17.01 to 17.04 |
| | | [Mpps] | [Mpps] | [Mpps] | Relative Change |
+===================+=================================================================+===========+===========+===========+=================+
-| IPv4 FIB 200k | 10ge2p1x520: 64B-1t1c-ethip4-ip4scale200k-ndrdisc | 8.5 | 9.0 | 9.7 | 8% |
-+-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-----------------+
-| IPv4 FIB 20k | 10ge2p1x520: 64B-1t1c-ethip4-ip4scale20k-ndrdisc | 8.5 | 9.0 | 9.4 | 4% |
-+-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-----------------+
-| IPv4 FIB 2M | 10ge2p1x520: 64B-1t1c-ethip4-ip4scale2m-ndrdisc | 8.5 | 7.8 | 8.1 | 4% |
-+-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-----------------+
-| IPv4 Policer | 10ge2p1x520: 64B-1t1c-ethip4-ip4base-ipolicemarkbase-ndrdisc | 6.9 | 7.4 | 8.1 | 9% |
+| L2XC | 10ge2p1x520: 64B-1t1c-eth-l2xcbase-pdrdisc | 9.4 | 12.7 | 13.4 | 6% |
+-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-----------------+
-| IPv4 LISP | 10ge2p1x520: 64B-1t1c-ethip4lispip4-ip4base-ndrdisc | 4.4 | 4.8 | 5.5 | 15% |
+| L2XC dot1ad | 10ge2p1x520: 64B-1t1c-dot1ad-l2xcbase-pdrdisc | 7.4 | 8.8 | 9.3 | 6% |
+-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-----------------+
-| IPv6 COP | 10ge2p1x520: 78B-1t1c-ethip6-ip6base-copwhtlistbase-ndrdisc | 6.1 | 6.1 | 6.9 | 13% |
+| L2XC dot1q | 10ge2p1x520: 64B-1t1c-dot1q-l2xcbase-pdrdisc | 7.5 | 8.8 | 9.2 | 5% |
+-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-----------------+
-| IPv6 FIB 200k | 10ge2p1x520: 78B-1t1c-ethip6-ip6scale200k-ndrdisc | 6.5 | 5.3 | 5.3 | 0% |
+| L2XC VxLAN | 10ge2p1x520: 64B-1t1c-ethip4vxlan-l2xcbase-pdrdisc | 5.4 | 6.5 | 6.8 | 5% |
+-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-----------------+
-| IPv6 FIB 20k | 10ge2p1x520: 78B-1t1c-ethip6-ip6scale20k-ndrdisc | 6.9 | 6.5 | 6.9 | 6% |
+| L2BD | 10ge2p1x520: 64B-1t1c-eth-l2bdbasemaclrn-pdrdisc | 7.8 | 10.6 | 10.8 | 2% |
+-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-----------------+
-| IPv6 FIB 2M | 10ge2p1x520: 78B-1t1c-ethip6-ip6scale2m-ndrdisc | 5.3 | 4.2 | 4.6 | 10% |
+| IPv4 | 10ge2p1x520: 64B-1t1c-ethip4-ip4base-pdrdisc | 8.7 | 9.7 | 10.4 | 7% |
+-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-----------------+
-| IPv6 iAcl | 10ge2p1x520: 78B-1t1c-ethip6-ip6base-iacldstbase-ndrdisc | 6.5 | 6.1 | 6.9 | 13% |
+| IPv4 COP | 10ge2p1x520: 64B-1t1c-ethip4-ip4base-copwhtlistbase-pdrdisc | 7.1 | 8.3 | 9.2 | 11% |
+-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-----------------+
-
-PDR Throughput
-~~~~~~~~~~~~~~
-
-Partial Drop Rate thoughput discovery tests with packet Loss Tolerance of 0.5%:
-
+| IPv4 iAcl | 10ge2p1x520: 64B-1t1c-ethip4-ip4base-iacldstbase-pdrdisc | 7.1 | 7.6 | 8.3 | 9% |
+-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-----------------+
-| VPP Functionality | Test Name | VPP-16.09 | VPP-17.01 | VPP-17.04 | 17.01 to 17.04 |
-| | | [Mpps] | [Mpps] | [Mpps] | Relative Change |
-+===================+=================================================================+===========+===========+===========+=================+
| IPv4 FIB 200k | 10ge2p1x520: 64B-1t1c-ethip4-ip4scale200k-pdrdisc | 8.5 | 9.0 | 9.7 | 8% |
+-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-----------------+
| IPv4 FIB 20k | 10ge2p1x520: 64B-1t1c-ethip4-ip4scale20k-pdrdisc | 8.5 | 9.0 | 9.7 | 8% |
+-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-----------------+
-| IPv4 FIB 2M | 10ge2p1x520: 64B-1t1c-ethip4-ip4scale2m-pdrdisc | 8.3 | 8.1 | 8.3 | 2% |
+| IPv4 FIB 2M | 10ge2p1x520: 64B-1t1c-ethip4-ip4scale2m-pdrdisc | 8.3 | 8.1 | 8.1 | 0% |
+-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-----------------+
| IPv4 Policer | 10ge2p1x520: 64B-1t1c-ethip4-ip4base-ipolicemarkbase-pdrdisc | 7.1 | 7.4 | 8.1 | 9% |
+-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-----------------+
-| IPv4 LISP | 10ge2p1x520: 64B-1t1c-ethip4lispip4-ip4base-pdrdisc | 4.6 | 4.8 | 5.5 | 15% |
-+-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-----------------+
-| IPv6 COP | 10ge2p1x520: 78B-1t1c-ethip6-ip6base-copwhtlistbase-pdrdisc | 6.1 | 6.1 | 6.9 | 13% |
-+-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-----------------+
| IPv6 FIB 200k | 10ge2p1x520: 78B-1t1c-ethip6-ip6scale200k-pdrdisc | 6.9 | 5.3 | 5.3 | 0% |
+-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-----------------+
| IPv6 FIB 20k | 10ge2p1x520: 78B-1t1c-ethip6-ip6scale20k-pdrdisc | 6.9 | 6.5 | 6.9 | 6% |
+-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-----------------+
| IPv6 FIB 2M | 10ge2p1x520: 78B-1t1c-ethip6-ip6scale2m-pdrdisc | 5.3 | 4.2 | 4.6 | 10% |
+-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-----------------+
-| IPv6 iAcl | 10ge2p1x520: 78B-1t1c-ethip6-ip6base-iacldstbase-pdrdisc | 6.5 | 6.1 | 6.9 | 13% |
-+-------------------+-----------------------------------------------------------------+-----------+-----------+-----------+-----------------+
Known Issues
------------
@@ -210,14 +211,15 @@ Here is the list of known issues in CSIT |release| for VPP performance tests:
| | for ip4scale200k, ip4scale2m scale IPv4 routed- | | Observed frequency: all test runs. |
| | forwarding tests. ip4scale20k tests are fine. | | |
+---+-------------------------------------------------+------------+-----------------------------------------------------------------+
-| 2 | VAT API timeouts during ip6scale2m scale IPv6 | VPP-712 | Needs fixing VPP VAT API timeouts for large volume of IPv6 |
-| | routed-forwarding tests when volume adding IPv6 | | routes. |
-| | routes - 2M in this case. ip6scale2kk works. | | |
+| 2 | Sporadic VAT API timeouts during ip6scale2m | VPP-712 | Needs fixing VPP VAT API timeouts for large volume of IPv6 |
+| | scale IPv6 routed-forwarding tests when volume | | routes. |
+| | adding IPv6 routes - 2M in this case. | | |
+| | ip6scale200k works. | | |
+---+-------------------------------------------------+------------+-----------------------------------------------------------------+
-| 3 | Vic1385 and Vic1227 low performance | VPP-664 | Low NDR performance. |
+| 3 | Vic1385 and Vic1227 low performance. | VPP-664 | Low NDR performance. |
| | | | |
+---+-------------------------------------------------+------------+-----------------------------------------------------------------+
-| 4 | Sporadic NDR discovery test failures on x520 | CSIT-750 | Suspected issue with HW settings (BIOS, FW) in LF |
+| 4 | Sporadic NDR discovery test failures on x520. | CSIT-750 | Suspected issue with HW settings (BIOS, FW) in LF |
| | | | infrastructure. Issue can't be replicated outside LF. |
+---+-------------------------------------------------+------------+-----------------------------------------------------------------+
| 5 | VPP in 2t2c setups - large variation | CSIT-568 | Suspected NIC firmware or DPDK driver issue affecting NDR |