aboutsummaryrefslogtreecommitdiffstats
path: root/docs/report/vpp_performance_tests/csit_release_notes.rst
diff options
context:
space:
mode:
authorPeter Mikus <pmikus@cisco.com>2018-04-24 13:36:20 +0200
committerPeter Mikus <pmikus@cisco.com>2018-04-26 04:42:05 +0000
commit1261ada9edd22c784a7763d861c5acf87ccd1ae1 (patch)
treefcc489ab2d802c970b5abc404fd14809480dcfec /docs/report/vpp_performance_tests/csit_release_notes.rst
parenta1728c4f56cc44b9acb45614c20fc0a546ee3161 (diff)
Update report content
- Update report content to match with rls1804 and master Change-Id: Ib50df2482635f07c94ba92f0ed766bd95bc8e52c Signed-off-by: Peter Mikus <pmikus@cisco.com>
Diffstat (limited to 'docs/report/vpp_performance_tests/csit_release_notes.rst')
-rw-r--r--docs/report/vpp_performance_tests/csit_release_notes.rst39
1 files changed, 6 insertions, 33 deletions
diff --git a/docs/report/vpp_performance_tests/csit_release_notes.rst b/docs/report/vpp_performance_tests/csit_release_notes.rst
index e7c61e665c..8fd8a3b634 100644
--- a/docs/report/vpp_performance_tests/csit_release_notes.rst
+++ b/docs/report/vpp_performance_tests/csit_release_notes.rst
@@ -19,10 +19,9 @@ Changes in CSIT |release|
to container, then via "horizontal" memif to next container, and so on
until the last container, then back to VPP and NIC;
- - **VPP TCP/IP stack**
+ - **MRR tests**
- - Added tests for VPP TCP/IP stack using VPP built-in HTTP server.
- WRK traffic generator is used as a client-side;
+ - <placeholder>;
- **SRv6**
@@ -31,11 +30,6 @@ Changes in CSIT |release|
lookups and rewrites based on configured End and End.DX6 SRv6 egress
functions;
- - **IPSecSW**
-
- - SW computed IPSec encryption with AES-GCM, CBC-SHA1 ciphers, in
- combination with IPv4 routed-forwarding;
-
#. Presentation and Analytics Layer
- Added throughput speedup analysis for multi-core and multi-thread
@@ -46,20 +40,7 @@ Changes in CSIT |release|
- **Framework optimizations**
- - Ability to run CSIT framework on ARM architecture;
-
- - Overall stability improvements;
-
- - **NDR and PDR throughput binary search change**
-
- - Increased binary search resolution by reducing final step from
- 100kpps to 50kpps;
-
- - **VPP plugin loaded as needed by tests**
-
- - From this release only plugins required by tests are loaded at
- VPP initialization time. Previously all plugins were loaded for
- all tests;
+ - Performance test duration improvements and stability;
Performance Changes
-------------------
@@ -132,23 +113,15 @@ Here is the list of known issues in CSIT |release| for VPP performance tests:
| 3 | Lower than expected NDR throughput with | CSIT-571 | Suspected NIC firmware or DPDK driver issue affecting NDR and |
| | xl710 and x710 NICs, compared to x520 NICs. | | PDR throughput. Applies to XL710 and X710 NICs. |
+---+-------------------------------------------------+------------+-----------------------------------------------------------------+
-| 4 | QAT IPSec scale with 1000 tunnels (interfaces) | VPP-1121 | VPP crashes during configuration of 1000 IPsec tunnels. |
-| | in 2t2c config, all tests are failing. | | 1t1c tests are not affected |
-+---+-------------------------------------------------+------------+-----------------------------------------------------------------+
-| 5 | rls1801 plugin related performance regression | CSIT-925 | With all plugins loaded NDR, PDR and MaxRates vary |
+| 4 | rls1801 plugin related performance regression | CSIT-925 | With all plugins loaded NDR, PDR and MaxRates vary |
| | | | intermittently from 3% to 5% across multiple test executions. |
| | | | Requires plugin code bisecting. |
+---+-------------------------------------------------+------------+-----------------------------------------------------------------+
-| 6 | rls1801 generic small performance regression | CSIT-926 | Generic performance regression of discovered NDR, PDR and |
+| 5 | rls1801 generic small performance regression | CSIT-926 | Generic performance regression of discovered NDR, PDR and |
| | ip4base, l2xcbase, l2bdbase | | MaxRates of -3%..-1% vs. rls1710, affects ip4base, l2xcbase, |
| | | | l2bdbase test suites. Not detected by CSIT performance trending |
| | | | scheme as it was masked out by another issue CSIT-925. |
+---+-------------------------------------------------+------------+-----------------------------------------------------------------+
-| 7 | rls1801 substantial NDR performance regression | CSIT-927 | Much lower NDR for vhostvr1024 tests, with mean values |
-| | for vhost-user vring size of 1024 | | regression of -17%..-42% vs. rls1710, but also very high |
-| | | | standard deviation of up to 1.46 Mpps => poor repeatibility. |
-| | | | Making mean values not fully representative. |
-+---+-------------------------------------------------+------------+-----------------------------------------------------------------+
-| 8 | rls1801 substantial NDR/PDR regression for | CSIT-928 | NDR regression of -7%..-15%, PDR regression of -3%..-15% |
+| 6 | rls1801 substantial NDR/PDR regression for | CSIT-928 | NDR regression of -7%..-15%, PDR regression of -3%..-15% |
| | IPSec tunnel scale with HW QAT crypto-dev | | compared to rls1710. |
+---+-------------------------------------------------+------------+-----------------------------------------------------------------+