aboutsummaryrefslogtreecommitdiffstats
path: root/docs/report/vpp_performance_tests/csit_release_notes.rst
diff options
context:
space:
mode:
authorMaciek Konstantynowicz <mkonstan@cisco.com>2017-10-30 21:28:43 +0000
committerTibor Frank <tifrank@cisco.com>2017-10-31 11:53:21 +0000
commit737fbd3341638e90478979779b5ee6c0b0bf5c39 (patch)
tree44b891d199bf7d99c6921de037461697fce2429d /docs/report/vpp_performance_tests/csit_release_notes.rst
parent5beb7d3d04a876ee37c7b9cf64b3e02366086968 (diff)
csit report static content updates for rls1710.
Change-Id: I6744f1c206410564114ce7b9d06f840432f97ed2 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
Diffstat (limited to 'docs/report/vpp_performance_tests/csit_release_notes.rst')
-rw-r--r--docs/report/vpp_performance_tests/csit_release_notes.rst63
1 files changed, 17 insertions, 46 deletions
diff --git a/docs/report/vpp_performance_tests/csit_release_notes.rst b/docs/report/vpp_performance_tests/csit_release_notes.rst
index 1c1bce17b3..69444d2a3a 100644
--- a/docs/report/vpp_performance_tests/csit_release_notes.rst
+++ b/docs/report/vpp_performance_tests/csit_release_notes.rst
@@ -4,61 +4,32 @@ CSIT Release Notes
Changes in CSIT |release|
-------------------------
-#. Test environment changes in VPP data plane performance tests:
-
- - Further characterization and optimizations of VPP vhost-user and VM test
- methodology and test environment;
-
- - Tests with varying Qemu virtio queue (a.k.a. vring) sizes:
- [vr256] default 256 descriptors, [vr1024] 1024 descriptors to
- optimize for packet throughput;
-
- - Tests with varying Linux :abbr:`CFS (Completely Fair Scheduler)`
- settings: [cfs] default settings, [cfsrr1] :abbr:`CFS (Completely Fair
- Scheduler)` RoundRobin(1) policy applied to all data plane threads
- handling test packet path including all VPP worker threads and all Qemu
- testpmd poll-mode threads;
-
- - Resulting test cases are all combinations with [vr256,vr1024] and
- [cfs,cfsrr1] settings;
-
- - For more detail see performance results observations section in
- this report;
-
-#. Code updates and optimizations in CSIT performance framework:
-
- - Complete CSIT framework code revision and optimizations as descried
- on CSIT wiki page `Design_Optimizations
- <https://wiki.fd.io/view/CSIT/Design_Optimizations>`_.
-
- - For more detail see the :ref:`CSIT Framework Design <csit-design>` section
- in this report;
-
-#. Changes to CSIT driver for TRex Traffic Generator:
+#. Added VPP performance tests
- - Complete refactor of TRex CSIT driver;
+ - **Linux Container VPP memif tests**
- - Introduction of packet traffic profiles to improve usability and
- manageability of traffic profiles for a growing number of test
- scenarios.
+ - Tests with VPP in L2 Bridge-Domain configuration connecting over
+ memif virtual interfaces to VPPs running in LXCs;
- - Support for packet traffic profiles to test IPv4/IPv6 stateful and
- stateless DUT data plane features;
+ - **Docker Container VPP memif tests**
-#. Added VPP performance tests
+ - Tests with VPP in L2 Cross-Connect configuration connecting over
+ memif virtual interfaces VPPs running in Docker containers;
- - **Linux Container VPP memif virtual interface tests**
+ - **Container Topologies Orchestrated by K8s with VPP memif tests**
- - New VPP Memif virtual interface (shared memory interface) tests
- with L2 Bridge-Domain switched-forwarding;
+ - Tests with VPP in L2 Cross-Connect and Bridge-Domain configurations
+ connecting over memif virtual interfaces VPPs running in Docker
+ containers, with service chain topologies orchestrated by Kubernetes;
- **Stateful Security Groups**
- - New m-thread m-core VPP stateful security-groups tests;
+ - m-thread m-core VPP stateful and stateless security-groups tests;
- **MAC-IP binding**
- - New MACIP iACL single-thread single-core and m-thread m-core tests;
+ - MACIP input access-lists, single-thread single-core and m-thread
+ m-core tests;
- Statistical analysis of repeatibility of results;
@@ -71,8 +42,8 @@ double-digit percentage points. Relative improvements for this release are
calculated against the test results listed in CSIT |release-1| report. The
comparison is calculated between the mean values based on collected and
archived test results' samples for involved VPP releases. Standard deviation
-has been also listed for CSIT |release|. VPP-16.09 and VPP-17.01 numbers are
-provided for reference.
+has been also listed for CSIT |release|. Performance numbers since release
+VPP-16.09 are provided for reference.
NDR Throughput
~~~~~~~~~~~~~~
@@ -232,7 +203,7 @@ Here is the list of known issues in CSIT |release| for VPP performance tests:
| | of discovered NDR throughput values across | | throughput. Applies to XL710 and X710 NICs, x520 NICs are fine. |
| | multiple test runs with xl710 and x710 NICs. | | |
+---+-------------------------------------------------+------------+-----------------------------------------------------------------+
-| 4 | Lower than expected NDR and PDR throughput with | CSIT-569 | Suspected NIC firmware or DPDK driver issue affecting NDR and |
+| 4 | Lower than expected NDR throughput with | CSIT-569 | Suspected NIC firmware or DPDK driver issue affecting NDR and |
| | xl710 and x710 NICs, compared to x520 NICs. | | PDR throughput. Applies to XL710 and X710 NICs. |
+---+-------------------------------------------------+------------+-----------------------------------------------------------------+