From b7886126c92c7e67fde7ded741c23adcbc850179 Mon Sep 17 00:00:00 2001 From: Maciek Konstantynowicz Date: Thu, 16 Aug 2018 20:31:53 +0100 Subject: report 1807: updated known issues in vpp perf rls notes. Change-Id: I340548173018d234f699b1125c886fcd9ae75347 Signed-off-by: Maciek Konstantynowicz (cherry picked from commit c9011da954e3af3550191610784b358f9ba6a9bf) --- .../vpp_performance_tests/csit_release_notes.rst | 42 ++++++++++++---------- 1 file changed, 24 insertions(+), 18 deletions(-) diff --git a/docs/report/vpp_performance_tests/csit_release_notes.rst b/docs/report/vpp_performance_tests/csit_release_notes.rst index 9c65143266..2c5b40bd42 100644 --- a/docs/report/vpp_performance_tests/csit_release_notes.rst +++ b/docs/report/vpp_performance_tests/csit_release_notes.rst @@ -216,21 +216,27 @@ Known Issues List of known issues in |csit-release| for VPP performance tests: -+---+-------------------------------------------------+------------+-----------------------------------------------------------------+ -| # | Issue | Jira ID | Description | -+===+=================================================+============+=================================================================+ -| 1 | Sporadic (1 in 200) NDR discovery test failures | CSIT-570 | DPDK reporting rx-errors, indicating L1 issue. Suspected issue | -| | on x520. | | with HW combination of X710-X520 in LF testbeds. Not observed | -| | | | outside of LF testbeds. | -+---+-------------------------------------------------+------------+-----------------------------------------------------------------+ -| 2 | High failure rate of api call | VPP-1361 | Failure rate: 30-40% of tests failing due to interfaces not | -| | sw_interface_set_flags [admin-up|link-up] | | in link-up state after API call sw_interface_set_flags. | -+---+-------------------------------------------------+------------+-----------------------------------------------------------------+ -| 3 | Scale IPSecHW Interface mode throughput | CSIT-1234 | IPSec throughput regression - 1core deltas: NDR -32%, PDR -33%, | -| | regression. | | MRR -38%. Affects IPSec HW Scale 1000tnl tests with Int mode. | -+---+-------------------------------------------------+------------+-----------------------------------------------------------------+ -| 4 | Lower than expected 64B NDR and PDR | CSIT-1242 | NDR and PDR regressions: ip4base -29%. | -| | throughput in VPP ip4base tests | | | -| | with xl710 NIC in 3n-hsw testbeds. | | | -+---+-------------------------------------------------+------------+-----------------------------------------------------------------+ - ++---+-----------------------------------------+---------------------------------------------------------------------------------------------------------------------------------+ +| # | JiraID | Description | ++===+=========================================+=================================================================================================================================+ +| 1 | `CSIT-570 | Sporadic (1 in 200) NDR discovery test failures on x520. DPDK reporting rx-errors, indicating L1 issue. | +| | `_ | Suspected issue with HW combination of X710-X520 in LF testbeds. Not observed outside of LF testbeds. | ++---+-----------------------------------------+---------------------------------------------------------------------------------------------------------------------------------+ +| 2 | `VPP-1361 | High failure rate of api call sw_interface_set_flags [admin-up|link-up]. | +| | `_ | Failure rate: 30-40% of tests failing due to interfaces not in link-up state after API call sw_interface_set_flags. | ++---+-----------------------------------------+---------------------------------------------------------------------------------------------------------------------------------+ +| 3 | `CSIT-1234 | VPP IPSecHW scale interface mode 1core, low NDR and PDR 64B throughput in 3n-hsw testbeds, in CSIT-18.07 vs. CSIT-18.04. | +| | `_ | ip4ipsecscale1000tnl-ip4base-int 1core CSIT-18.07/18.04 relative change: NDR -32%, PDR -33%, MRR -38%. | ++---+-----------------------------------------+---------------------------------------------------------------------------------------------------------------------------------+ +| 4 | `CSIT-1242 | VPP xl710 ip4base test 1core, low NDR and PDR 64B throughput in 3n-hsw testbeds, in CSIT-18.07 vs. CSIT-18.04. | +| | `_ | xl710 ip4base 1core CSIT-18.07/18.04 relative change: NDR -19%, high stdev. | ++---+-----------------------------------------+---------------------------------------------------------------------------------------------------------------------------------+ +| 5 | `CSIT-1243 | VPP nat44 base test 2core, low NDR and PDR 64B throughput in 3n-skx testbeds, compared to 3n-hsw testbeds. | +| | `_ | ip4base-nat44 2core 3n-skx/3n-hsw relative change: NDR -19%, PDR -22%. | ++---+-----------------------------------------+---------------------------------------------------------------------------------------------------------------------------------+ +| 6 | `CSIT-1244 | VPP lispip4 base test 2core, low NDR and PDR 64B throughput in 3n-skx testbeds, compared to 3n-hsw testbeds. | +| | `_ | ip4lispip4-ip4base 2core 3n-skx/3n-hsw relative change: NDR -11%, PDR -18%. | ++---+-----------------------------------------+---------------------------------------------------------------------------------------------------------------------------------+ +| 7 | `CSIT-1245 | VPP srv6proxy-stat and srv6proxy-masq, much higher NDR and PDR 78B throughput in 3n-hsw testbeds, in CSIT-18.07 vs. CSIT-18.04. | +| | `_ | Due to wrong test suite configuration in dynamic-proxy mode. Artefact of suite code refactoring. | ++---+-----------------------------------------+---------------------------------------------------------------------------------------------------------------------------------+ -- cgit 1.2.3-korg