From 737fbd3341638e90478979779b5ee6c0b0bf5c39 Mon Sep 17 00:00:00 2001 From: Maciek Konstantynowicz Date: Mon, 30 Oct 2017 21:28:43 +0000 Subject: csit report static content updates for rls1710. Change-Id: I6744f1c206410564114ce7b9d06f840432f97ed2 Signed-off-by: Maciek Konstantynowicz --- .../vpp_performance_tests/csit_release_notes.rst | 63 ++++++---------------- 1 file changed, 17 insertions(+), 46 deletions(-) (limited to 'docs/report/vpp_performance_tests/csit_release_notes.rst') diff --git a/docs/report/vpp_performance_tests/csit_release_notes.rst b/docs/report/vpp_performance_tests/csit_release_notes.rst index 1c1bce17b3..69444d2a3a 100644 --- a/docs/report/vpp_performance_tests/csit_release_notes.rst +++ b/docs/report/vpp_performance_tests/csit_release_notes.rst @@ -4,61 +4,32 @@ CSIT Release Notes Changes in CSIT |release| ------------------------- -#. Test environment changes in VPP data plane performance tests: - - - Further characterization and optimizations of VPP vhost-user and VM test - methodology and test environment; - - - Tests with varying Qemu virtio queue (a.k.a. vring) sizes: - [vr256] default 256 descriptors, [vr1024] 1024 descriptors to - optimize for packet throughput; - - - Tests with varying Linux :abbr:`CFS (Completely Fair Scheduler)` - settings: [cfs] default settings, [cfsrr1] :abbr:`CFS (Completely Fair - Scheduler)` RoundRobin(1) policy applied to all data plane threads - handling test packet path including all VPP worker threads and all Qemu - testpmd poll-mode threads; - - - Resulting test cases are all combinations with [vr256,vr1024] and - [cfs,cfsrr1] settings; - - - For more detail see performance results observations section in - this report; - -#. Code updates and optimizations in CSIT performance framework: - - - Complete CSIT framework code revision and optimizations as descried - on CSIT wiki page `Design_Optimizations - `_. - - - For more detail see the :ref:`CSIT Framework Design ` section - in this report; - -#. Changes to CSIT driver for TRex Traffic Generator: +#. Added VPP performance tests - - Complete refactor of TRex CSIT driver; + - **Linux Container VPP memif tests** - - Introduction of packet traffic profiles to improve usability and - manageability of traffic profiles for a growing number of test - scenarios. + - Tests with VPP in L2 Bridge-Domain configuration connecting over + memif virtual interfaces to VPPs running in LXCs; - - Support for packet traffic profiles to test IPv4/IPv6 stateful and - stateless DUT data plane features; + - **Docker Container VPP memif tests** -#. Added VPP performance tests + - Tests with VPP in L2 Cross-Connect configuration connecting over + memif virtual interfaces VPPs running in Docker containers; - - **Linux Container VPP memif virtual interface tests** + - **Container Topologies Orchestrated by K8s with VPP memif tests** - - New VPP Memif virtual interface (shared memory interface) tests - with L2 Bridge-Domain switched-forwarding; + - Tests with VPP in L2 Cross-Connect and Bridge-Domain configurations + connecting over memif virtual interfaces VPPs running in Docker + containers, with service chain topologies orchestrated by Kubernetes; - **Stateful Security Groups** - - New m-thread m-core VPP stateful security-groups tests; + - m-thread m-core VPP stateful and stateless security-groups tests; - **MAC-IP binding** - - New MACIP iACL single-thread single-core and m-thread m-core tests; + - MACIP input access-lists, single-thread single-core and m-thread + m-core tests; - Statistical analysis of repeatibility of results; @@ -71,8 +42,8 @@ double-digit percentage points. Relative improvements for this release are calculated against the test results listed in CSIT |release-1| report. The comparison is calculated between the mean values based on collected and archived test results' samples for involved VPP releases. Standard deviation -has been also listed for CSIT |release|. VPP-16.09 and VPP-17.01 numbers are -provided for reference. +has been also listed for CSIT |release|. Performance numbers since release +VPP-16.09 are provided for reference. NDR Throughput ~~~~~~~~~~~~~~ @@ -232,7 +203,7 @@ Here is the list of known issues in CSIT |release| for VPP performance tests: | | of discovered NDR throughput values across | | throughput. Applies to XL710 and X710 NICs, x520 NICs are fine. | | | multiple test runs with xl710 and x710 NICs. | | | +---+-------------------------------------------------+------------+-----------------------------------------------------------------+ -| 4 | Lower than expected NDR and PDR throughput with | CSIT-569 | Suspected NIC firmware or DPDK driver issue affecting NDR and | +| 4 | Lower than expected NDR throughput with | CSIT-569 | Suspected NIC firmware or DPDK driver issue affecting NDR and | | | xl710 and x710 NICs, compared to x520 NICs. | | PDR throughput. Applies to XL710 and X710 NICs. | +---+-------------------------------------------------+------------+-----------------------------------------------------------------+ -- cgit 1.2.3-korg