aboutsummaryrefslogtreecommitdiffstats
diff options
context:
space:
mode:
authorMaciek Konstantynowicz <mkonstan@cisco.com>2021-07-14 11:35:35 +0100
committerTibor Frank <tifrank@cisco.com>2021-07-14 11:31:08 +0000
commitd9bb63c2d9f126800f69bd53fca5d42fd2beb739 (patch)
treef9001583404e906178b34d1d21f4e041bda5caff
parentda7ec9bf7aff31d18325043891aa19cda2b063ec (diff)
report: update to rls notes and add methodology sections TODO placeholders
- Update VPP and DPDK rls notes. - Added methodology sections TODO placeholders - IPsec with Async Crypto Feature Workers - IPsec Uni-Directional Tests - IPsec Deep SPD Policy Tests - GTPU Tunnels Change-Id: Ibfb937f193cce3a6576ac64cf00ad2e1b4bc3868 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
-rw-r--r--docs/report/dpdk_performance_tests/csit_release_notes.rst11
-rw-r--r--docs/report/introduction/methodology_ipsec.rst15
-rw-r--r--docs/report/introduction/methodology_tunnel_encapsulations.rst5
-rw-r--r--docs/report/vpp_performance_tests/csit_release_notes.rst80
4 files changed, 86 insertions, 25 deletions
diff --git a/docs/report/dpdk_performance_tests/csit_release_notes.rst b/docs/report/dpdk_performance_tests/csit_release_notes.rst
index 6810d35f54..2f88519361 100644
--- a/docs/report/dpdk_performance_tests/csit_release_notes.rst
+++ b/docs/report/dpdk_performance_tests/csit_release_notes.rst
@@ -4,16 +4,15 @@ Release Notes
Changes in |csit-release|
-------------------------
+#. TEST FRAMEWORK
-#. DPDK PERFORMANCE TESTS
+ - **Upgrade to Ubuntu 20.04 LTS**: Re-installed base operating system
+ to Ubuntu 20.04.2 LTS. Upgrade included also baseline Docker
+ containers used for spawning topology.
- - CSIT test environment is versioned, see
+ - **CSIT test environment** version has been updated to ver. 7, see
:ref:`test_environment_versioning`.
- - **Upgrade to Ubuntu 20.04 LTS**: Reinstall base operating system to Ubuntu
- 20.04.2 LTS. Upgrade includes also baseline Docker containers used for
- spawning topology.
-
#. DPDK RELEASE VERSION CHANGE
- |csit-release| tested |dpdk-release|, as used by |vpp-release|.
diff --git a/docs/report/introduction/methodology_ipsec.rst b/docs/report/introduction/methodology_ipsec.rst
index 6cfa69cd88..2e6a324c3f 100644
--- a/docs/report/introduction/methodology_ipsec.rst
+++ b/docs/report/introduction/methodology_ipsec.rst
@@ -47,3 +47,18 @@ dpdk_cryptodev
| crypto_ipsecmb | async/crypto worker | AES[128]-CBC | SHA[256|512] | 1, 4, 1k tunnels |
+-------------------+---------------------+------------------+----------------+------------------+
+IPsec with Async Crypto Feature Workers
+^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
+
+*TODO Description to be added*
+
+IPsec Uni-Directional Tests
+^^^^^^^^^^^^^^^^^^^^^^^^^^^
+
+*TODO Description to be added*
+
+
+IPsec Deep SPD Policy Tests
+^^^^^^^^^^^^^^^^^^^^^^^^^^^
+
+*TODO Description to be added*
diff --git a/docs/report/introduction/methodology_tunnel_encapsulations.rst b/docs/report/introduction/methodology_tunnel_encapsulations.rst
index c61df171ac..64c6f1f82d 100644
--- a/docs/report/introduction/methodology_tunnel_encapsulations.rst
+++ b/docs/report/introduction/methodology_tunnel_encapsulations.rst
@@ -36,3 +36,8 @@ VPP is tested in the following IPv6 tunnel baseline configurations:
In all cases listed above low number of IPv4, IPv6 flows (253 or 254 per
direction) is routed by VPP.
+
+GTPU Tunnels
+~~~~~~~~~~~~
+
+*TODO Description to be added*
diff --git a/docs/report/vpp_performance_tests/csit_release_notes.rst b/docs/report/vpp_performance_tests/csit_release_notes.rst
index a0777918da..4f448c2c89 100644
--- a/docs/report/vpp_performance_tests/csit_release_notes.rst
+++ b/docs/report/vpp_performance_tests/csit_release_notes.rst
@@ -8,34 +8,76 @@ Changes in |csit-release|
#. VPP PERFORMANCE TESTS
- - CSIT test environment is versioned, see
- :ref:`test_environment_versioning`.
+ - **AF_XDP**: Added af_xdp driver support for all test cases. Test
+ results will be added in sub-sequent CSIT-2106 report.
- - **Upgrade to Ubuntu 20.04 LTS**: Reinstall base operating system to
- Ubuntu 20.04.2 LTS. Upgrade includes also baseline Docker
- containers used for spawning topology.
+ - **GTPU tunnel**: Added GTPU HW Offload IPv4 routing tests.
- - Initial test data for Intel Xeon Ice Lake platforms. Current
- CSIT-2106 report data for Intel Xeon Ice Lake comes from an
- external source (Intel labs running CSIT code on 8360Y D Stepping
- and 6338N processors). For detail about the physical setup
- see :ref:`tested_physical_topologies`. Tested VPP and CSIT
- versions are pre-release, VPP 21.06-rc0~779-gd640ae52f.
+ - **Intel Xeon Ice Lake**: Added initial test data for these
+ platforms. Current CSIT-2106 report data for Intel Xeon Ice Lake
+ comes from an external source (Intel labs running CSIT code on
+ "8360Y D Stepping" and "6338N" processors). For details about the
+ physical setup see :ref:`tested_physical_topologies`. Tested
+ VPP and CSIT versions are pre-release, VPP
+ 21.06-rc0~779-gd640ae52f.
+
+ - **MLRsearch improvements**: Added support for multiple packet
+ throughput rates in a single search, each rate is associated
+ with a distinct Packet Loss Ratio (PLR) criterion. Previously
+ only Non Drop Rate (NDR) (PLR=0) and single Partial Drop Rate
+ (PDR) (PLR<0.5%) were supported. Implemented number of
+ optimizations improving rate discovery efficiency.
+
+ - **Reduction of tests**: Removed obsolete VPP use cases and
+ superfluous test combinations from continuous and report test
+ executions, including:
+
+ - All vts tests, obsolete use cases.
+ - dot1q tests apart from dot1q-l2bd, superfluous combinations.
+ - -100flows, -100kflows in all acl tests.
+ - nat44 tests
+
+ - -pps tests, replaced by -tput tests.
+ - h1-p1-s1 single session tests, unessential combination.
+ - h4096-p63-s258048 tests, unessential scale combination.
+
+ - ipsec tests
+
+ - ethip4ipsectptlispgpe.
+ - policy-aes128gcm.
+ - policy-aes128cbc-hmac256sha.
+ - policy-aes128cbc-hmac512sha.
+ - int-aes128cbc-hmac256sha.
+ - scale of
+
+ - 400tnlsw.
+ - 5000tnlsw.
+ - 20000tnlsw.
+ - 60000tnlsw.
- - **AF_XDP**: Added af_xdp driver testing for all testcases.
+#. TEST FRAMEWORK
- - **GTPU tunnel**: Added GTPU HW Offload IPv4 routing tests.
+ - **Telemetry retouch**: Refactored telemetry retrieval from DUTs and
+ SUTs. Included VPP perfmon plugin telemetry with all perfmon
+ bundles available in VPP release.
- - **Telemetry retouch**: Redesign telemetry retrieval from DUT.
- Include VPP perfmon plugin telemetry.
+ - **Upgrade to Ubuntu 20.04 LTS**: Re-installed base operating system
+ to Ubuntu 20.04.2 LTS. Upgrade included also baseline Docker
+ containers used for spawning topology.
-#. TEST FRAMEWORK
+ - **CSIT test environment** version has been updated to ver. 7, see
+ :ref:`test_environment_versioning`.
+
+ - **CSIT in AWS environment**: Added CSIT support for AWS c5n
+ instances environment. Test results will be added in sub-sequent
+ CSIT-2106 report.
- **CSIT PAPI support**: Due to issues with PAPI performance, VAT is
- still used in CSIT for all VPP scale tests. See known issues below.
+ still used in CSIT for all VPP scale tests. See known issues
+ below.
- - **General Code Housekeeping**: Ongoing code optimizations,
- speed ups and bug fixes.
+ - **General Code Housekeeping**: Ongoing code optimizations and bug
+ fixes.
#. PRESENTATION AND ANALYTICS LAYER