diff options
Diffstat (limited to 'docs/report')
34 files changed, 276 insertions, 349 deletions
diff --git a/docs/report/detailed_test_results/vpp_performance_results/index.rst b/docs/report/detailed_test_results/vpp_performance_results/index.rst index 07650249f3..bf89346894 100644 --- a/docs/report/detailed_test_results/vpp_performance_results/index.rst +++ b/docs/report/detailed_test_results/vpp_performance_results/index.rst @@ -5,7 +5,7 @@ VPP Throughput ../vpp_performance_results_3n_hsw/index ../vpp_performance_results_3n_skx/index - ../vpp_performance_results_2n_skx/index .. + ../vpp_performance_results_2n_skx/index ../vpp_performance_results_2n_dnv/index diff --git a/docs/report/index.html.template b/docs/report/index.html.template index 2663b492d2..cc757c671c 100644 --- a/docs/report/index.html.template +++ b/docs/report/index.html.template @@ -1,5 +1,5 @@ -CSIT-1904 -========= +CSIT-1901.2 +=========== .. toctree:: :maxdepth: 2 @@ -20,13 +20,13 @@ CSIT-1904 vpp_performance_tests/packet_throughput_graphs/index vpp_performance_tests/throughput_speedup_multi_core/index vpp_performance_tests/packet_latency_graphs/index - vpp_performance_tests/soak_tests/index - vpp_performance_tests/nf_service_density/index vpp_performance_tests/comparisons/index vpp_performance_tests/throughput_trending vpp_performance_tests/test_environment vpp_performance_tests/documentation/index .. + vpp_performance_tests/soak_tests/index + vpp_performance_tests/nf_service_density/index vpp_performance_tests/http_server_performance/index .. toctree:: @@ -60,16 +60,16 @@ CSIT-1904 vpp_functional_tests/test_environment vpp_functional_tests/documentation -.. toctree:: - :maxdepth: 2 - :caption: HoneyComb Functional +.. + .. toctree:: + :maxdepth: 2 + :caption: HoneyComb Functional - honeycomb_functional_tests/overview - honeycomb_functional_tests/csit_release_notes - honeycomb_functional_tests/test_environment - honeycomb_functional_tests/documentation + honeycomb_functional_tests/overview + honeycomb_functional_tests/csit_release_notes + honeycomb_functional_tests/test_environment + honeycomb_functional_tests/documentation -.. .. toctree:: :maxdepth: 2 :caption: NSH_SFC Functional @@ -79,7 +79,6 @@ CSIT-1904 nsh_sfc_functional_tests/test_environment nsh_sfc_functional_tests/documentation -.. .. toctree:: :maxdepth: 2 :caption: DMM Functional @@ -94,14 +93,14 @@ CSIT-1904 :caption: Detailed Results detailed_test_results/vpp_performance_results/index - detailed_test_results/vpp_mrr_results/index detailed_test_results/dpdk_performance_results/index detailed_test_results/vpp_functional_results/index detailed_test_results/vpp_device_results_ubuntu/index - detailed_test_results/honeycomb_functional_results/index .. + detailed_test_results/honeycomb_functional_results/index detailed_test_results/dmm_functional_results/index + detailed_test_results/vpp_mrr_results/index detailed_test_results/cot_performance_results/index detailed_test_results/nshsfc_functional_results/index @@ -110,10 +109,11 @@ CSIT-1904 :caption: Test Configuration test_configuration/vpp_performance_configuration/index - test_configuration/vpp_mrr_configuration/index test_configuration/vpp_functional_configuration/index test_configuration/vpp_device_configuration_ubuntu/index + .. + test_configuration/vpp_mrr_configuration/index test_configuration/cot_performance_configuration/index .. toctree:: diff --git a/docs/report/index.pdf.template b/docs/report/index.pdf.template index 29faad5fef..9302af808c 100644 --- a/docs/report/index.pdf.template +++ b/docs/report/index.pdf.template @@ -1,5 +1,5 @@ -CSIT-1904 -========= +CSIT-1901.2 +=========== .. toctree:: :numbered: @@ -9,9 +9,9 @@ CSIT-1904 dpdk_performance_tests/index vpp_device_tests/index vpp_functional_tests/index - honeycomb_functional_tests/index csit_framework_documentation/index .. + honeycomb_functional_tests/index dmm_functional_tests/index nsh_sfc_functional_tests/index diff --git a/docs/report/introduction/report_history.rst b/docs/report/introduction/report_history.rst index ba7cc25295..65c54351bc 100644 --- a/docs/report/introduction/report_history.rst +++ b/docs/report/introduction/report_history.rst @@ -1,42 +1,12 @@ Report History ============== -FD.io CSIT-1904 Report history and per .[ww] revision changes are listed below. +FD.io CSIT-1904.1 Report history and per .[ww] revision changes are listed below. +----------------+------------------------------------------------------------+ | .[ww] Revision | Changes | +================+============================================================+ -| .23 | 1. Added new data | -| | | -| | - VPP 3n-hsw NDRPDR full | -| | | -+----------------+------------------------------------------------------------+ -| .22 | 1. Added new data | -| | | -| | - VPP 3n-hsw NDRPDR full | -| | | -+----------------+------------------------------------------------------------+ -| .21 | 1. Added new data | -| | | -| | - VPP 3n-hsw NDRPDR full | -| | - VPP 2n-skx NFV NDRPDR 64b and IMIX | -| | | -| | 2. Added missing results | -| | | -| | - VPP functional tests Ubuntu | -| | - VPP device tests | -| | | -+----------------+------------------------------------------------------------+ -| .20 | 1. Added new data | -| | | -| | - VPP 3n-hsw NDRPDR selected | -| | - VPP 3n-skx NDRPDR full | -| | - VPP 2n-skx NFV NDRPDR 64b and IMIX | -| | | -| | 2. Added Soak tests | -| | | -+----------------+------------------------------------------------------------+ -| .19 | Initial version | +| .24 | Initial version | | | | +----------------+------------------------------------------------------------+ diff --git a/docs/report/test_configuration/vpp_performance_configuration/index.rst b/docs/report/test_configuration/vpp_performance_configuration/index.rst index 8039fb4c92..4584a15588 100644 --- a/docs/report/test_configuration/vpp_performance_configuration/index.rst +++ b/docs/report/test_configuration/vpp_performance_configuration/index.rst @@ -5,7 +5,7 @@ VPP Throughput ../vpp_performance_configuration_3n_hsw/index ../vpp_performance_configuration_3n_skx/index - ../vpp_performance_configuration_2n_skx/index .. ../vpp_performance_configuration_2n_dnv/index + ../vpp_performance_configuration_2n_skx/index diff --git a/docs/report/test_operational_data/vpp_performance_operational_data/index.rst b/docs/report/test_operational_data/vpp_performance_operational_data/index.rst index e34d08feeb..ff8009dd4d 100644 --- a/docs/report/test_operational_data/vpp_performance_operational_data/index.rst +++ b/docs/report/test_operational_data/vpp_performance_operational_data/index.rst @@ -5,7 +5,7 @@ VPP Throughput ../vpp_performance_operational_data_3n_hsw/index ../vpp_performance_operational_data_3n_skx/index - ../vpp_performance_operational_data_2n_skx/index .. ../vpp_performance_operational_data_2n_dnv/index + ../vpp_performance_operational_data_2n_skx/index diff --git a/docs/report/vpp_functional_tests/csit_release_notes.rst b/docs/report/vpp_functional_tests/csit_release_notes.rst index 57114cc858..c861a9a6cb 100644 --- a/docs/report/vpp_functional_tests/csit_release_notes.rst +++ b/docs/report/vpp_functional_tests/csit_release_notes.rst @@ -8,14 +8,6 @@ Changes in |csit-release| - **Bug fixes**. -#. CSIT TEST MIMGRATION - - - **VPP_Path**: Continuing migration of the original FD.io CSIT VIRL - tests to VPP-make_test VPP integration tests for functional - acceptance of VPP feature path(s) driven by use case(s). See P1 - and P2 markup in `CSIT_VIRL migration progress - <https://docs.google.com/spreadsheets/d/1PciV8XN9v1qHbIRUpFJoqyES29_vik7lcFDl73G1usc/edit?usp=sharing>`_ - Known Issues ------------ diff --git a/docs/report/vpp_functional_tests/test_environment.rst b/docs/report/vpp_functional_tests/test_environment.rst index d8f2abff55..b3b857a4c2 100644 --- a/docs/report/vpp_functional_tests/test_environment.rst +++ b/docs/report/vpp_functional_tests/test_environment.rst @@ -247,15 +247,15 @@ VPP Installed Packages - Ubuntu :: $ dpkg -l | grep vpp - ii libvppinfra 19.04-release amd64 Vector Packet Processing--runtime libraries - ii libvppinfra-dev 19.04-release amd64 Vector Packet Processing--runtime libraries - ii python3-vpp-api 19.04-release amd64 VPP Python3 API bindings - ii vpp 19.04-release amd64 Vector Packet Processing--executables - ii vpp-api-python 19.04-release amd64 VPP Python API bindings - ii vpp-dbg 19.04-release amd64 Vector Packet Processing--debug symbols - ii vpp-dev 19.04-release amd64 Vector Packet Processing--development support - ii vpp-plugin-core 19.04-release amd64 Vector Packet Processing--runtime core plugins - ii vpp-plugin-dpdk 19.04-release amd64 Vector Packet Processing--runtime dpdk plugin + ii libvppinfra 19.04.1-release amd64 Vector Packet Processing--runtime libraries + ii libvppinfra-dev 19.04.1-release amd64 Vector Packet Processing--runtime libraries + ii python3-vpp-api 19.04.1-release amd64 VPP Python3 API bindings + ii vpp 19.04.1-release amd64 Vector Packet Processing--executables + ii vpp-api-python 19.04.1-release amd64 VPP Python API bindings + ii vpp-dbg 19.04.1-release amd64 Vector Packet Processing--debug symbols + ii vpp-dev 19.04.1-release amd64 Vector Packet Processing--development support + ii vpp-plugin-core 19.04.1-release amd64 Vector Packet Processing--runtime core plugins + ii vpp-plugin-dpdk 19.04.1-release amd64 Vector Packet Processing--runtime dpdk plugin VPP Installed Packages - Centos ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ @@ -264,17 +264,17 @@ VPP Installed Packages - Centos $ rpm -qai *vpp* Name : vpp-lib - Version : 19.04 + Version : 19.04.1 Release : release Architecture: x86_64 - Install Date: Thu 25 Apr 2019 04:14:51 AM EDT + Install Date: Fri 07 Jun 2019 04:19:08 AM EDT Group : System Environment/Libraries - Size : 39543181 + Size : 39668077 License : ASL 2.0 Signature : (none) - Source RPM : vpp-19.04-release.src.rpm - Build Date : Tue 23 Apr 2019 08:46:26 PM EDT - Build Host : 940fc1a9327e + Source RPM : vpp-19.04.1-release.src.rpm + Build Date : Fri 31 May 2019 12:46:18 PM EDT + Build Host : 8e0d50f37e2b Relocations : (not relocatable) Summary : VPP libraries Description : @@ -285,17 +285,17 @@ VPP Installed Packages - Centos vlib-api - binary API library vnet - network stack library Name : vpp-devel - Version : 19.04 + Version : 19.04.1 Release : release Architecture: x86_64 - Install Date: Thu 25 Apr 2019 04:14:52 AM EDT + Install Date: Fri 07 Jun 2019 04:19:10 AM EDT Group : Development/Libraries - Size : 12701413 + Size : 12702385 License : ASL 2.0 Signature : (none) - Source RPM : vpp-19.04-release.src.rpm - Build Date : Tue 23 Apr 2019 08:46:26 PM EDT - Build Host : 940fc1a9327e + Source RPM : vpp-19.04.1-release.src.rpm + Build Date : Fri 31 May 2019 12:46:18 PM EDT + Build Host : 8e0d50f37e2b Relocations : (not relocatable) Summary : VPP header files, static libraries Description : @@ -308,65 +308,65 @@ VPP Installed Packages - Centos vpp-api vppinfra Name : vpp-selinux-policy - Version : 19.04 + Version : 19.04.1 Release : release Architecture: x86_64 - Install Date: Thu 25 Apr 2019 04:14:49 AM EDT + Install Date: Fri 07 Jun 2019 04:19:07 AM EDT Group : System Environment/Base Size : 102155 License : ASL 2.0 Signature : (none) - Source RPM : vpp-19.04-release.src.rpm - Build Date : Tue 23 Apr 2019 08:46:26 PM EDT - Build Host : 940fc1a9327e + Source RPM : vpp-19.04.1-release.src.rpm + Build Date : Fri 31 May 2019 12:46:18 PM EDT + Build Host : 8e0d50f37e2b Relocations : (not relocatable) Summary : VPP Security-Enhanced Linux (SELinux) policy Description : This package contains a tailored VPP SELinux policy Name : vpp-plugins - Version : 19.04 + Version : 19.04.1 Release : release Architecture: x86_64 - Install Date: Thu 25 Apr 2019 04:14:51 AM EDT + Install Date: Fri 07 Jun 2019 04:19:10 AM EDT Group : System Environment/Libraries - Size : 22696981 + Size : 22767029 License : ASL 2.0 Signature : (none) - Source RPM : vpp-19.04-release.src.rpm - Build Date : Tue 23 Apr 2019 08:46:26 PM EDT - Build Host : 940fc1a9327e + Source RPM : vpp-19.04.1-release.src.rpm + Build Date : Fri 31 May 2019 12:46:18 PM EDT + Build Host : 8e0d50f37e2b Relocations : (not relocatable) Summary : Vector Packet Processing--runtime plugins Description : This package contains VPP plugins Name : vpp-api-python - Version : 19.04 + Version : 19.04.1 Release : release Architecture: x86_64 - Install Date: Thu 25 Apr 2019 04:14:51 AM EDT + Install Date: Fri 07 Jun 2019 04:19:09 AM EDT Group : Development/Libraries Size : 164979 License : ASL 2.0 Signature : (none) - Source RPM : vpp-19.04-release.src.rpm - Build Date : Tue 23 Apr 2019 08:46:26 PM EDT - Build Host : 940fc1a9327e + Source RPM : vpp-19.04.1-release.src.rpm + Build Date : Fri 31 May 2019 12:46:18 PM EDT + Build Host : 8e0d50f37e2b Relocations : (not relocatable) Summary : VPP api python bindings Description : This package contains the python bindings for the vpp api Name : vpp - Version : 19.04 + Version : 19.04.1 Release : release Architecture: x86_64 - Install Date: Thu 25 Apr 2019 04:14:51 AM EDT + Install Date: Fri 07 Jun 2019 04:19:08 AM EDT Group : Unspecified - Size : 2496078 + Size : 2496102 License : ASL 2.0 Signature : (none) - Source RPM : vpp-19.04-release.src.rpm - Build Date : Tue 23 Apr 2019 08:46:26 PM EDT - Build Host : 940fc1a9327e + Source RPM : vpp-19.04.1-release.src.rpm + Build Date : Fri 31 May 2019 12:46:18 PM EDT + Build Host : 8e0d50f37e2b Relocations : (not relocatable) Summary : Vector Packet Processing Description : diff --git a/docs/report/vpp_performance_tests/comparisons/current_vs_previous_release.rst b/docs/report/vpp_performance_tests/comparisons/current_vs_previous_release.rst index ecc2c98dd1..e13cac308e 100644 --- a/docs/report/vpp_performance_tests/comparisons/current_vs_previous_release.rst +++ b/docs/report/vpp_performance_tests/comparisons/current_vs_previous_release.rst @@ -53,17 +53,18 @@ Comparison tables in ASCII and CSV formats: - `CSV 1t1c PDR comparison <../../_static/vpp/performance-changes-3n-hsw-1t1c-pdr.csv>`_ - `CSV 2t2c PDR comparison <../../_static/vpp/performance-changes-3n-hsw-2t2c-pdr.csv>`_ -MRR Comparison -`````````````` +.. + MRR Comparison + `````````````` -Comparison tables in ASCII and CSV formats: + Comparison tables in ASCII and CSV formats: - - `ASCII 1t1c MRR comparison <../../_static/vpp/performance-changes-3n-hsw-1t1c-mrr.txt>`_ - - `ASCII 2t2c MRR comparison <../../_static/vpp/performance-changes-3n-hsw-2t2c-mrr.txt>`_ - - `ASCII 4t4c MRR comparison <../../_static/vpp/performance-changes-3n-hsw-4t4c-mrr.txt>`_ - - `CSV 1t1c MRR comparison <../../_static/vpp/performance-changes-3n-hsw-1t1c-mrr.csv>`_ - - `CSV 2t2c MRR comparison <../../_static/vpp/performance-changes-3n-hsw-2t2c-mrr.csv>`_ - - `CSV 4t4c MRR comparison <../../_static/vpp/performance-changes-3n-hsw-4t4c-mrr.csv>`_ + - `ASCII 1t1c MRR comparison <../../_static/vpp/performance-changes-3n-hsw-1t1c-mrr.txt>`_ + - `ASCII 2t2c MRR comparison <../../_static/vpp/performance-changes-3n-hsw-2t2c-mrr.txt>`_ + - `ASCII 4t4c MRR comparison <../../_static/vpp/performance-changes-3n-hsw-4t4c-mrr.txt>`_ + - `CSV 1t1c MRR comparison <../../_static/vpp/performance-changes-3n-hsw-1t1c-mrr.csv>`_ + - `CSV 2t2c MRR comparison <../../_static/vpp/performance-changes-3n-hsw-2t2c-mrr.csv>`_ + - `CSV 4t4c MRR comparison <../../_static/vpp/performance-changes-3n-hsw-4t4c-mrr.csv>`_ 3n-skx ~~~~~~ @@ -88,55 +89,21 @@ Comparison tables in ASCII and CSV formats: - `CSV 2t1c PDR comparison <../../_static/vpp/performance-changes-3n-skx-2t1c-pdr.csv>`_ - `CSV 4t2c PDR comparison <../../_static/vpp/performance-changes-3n-skx-4t2c-pdr.csv>`_ -MRR Comparison -`````````````` - -Comparison tables in ASCII and CSV formats: - - - `ASCII 2t1c MRR comparison <../../_static/vpp/performance-changes-3n-skx-2t1c-mrr.txt>`_ - - `ASCII 4t2c MRR comparison <../../_static/vpp/performance-changes-3n-skx-4t2c-mrr.txt>`_ - - `ASCII 8t4c MRR comparison <../../_static/vpp/performance-changes-3n-skx-8t4c-mrr.txt>`_ - - `CSV 2t1c MRR comparison <../../_static/vpp/performance-changes-3n-skx-2t1c-mrr.csv>`_ - - `CSV 4t2c MRR comparison <../../_static/vpp/performance-changes-3n-skx-4t2c-mrr.csv>`_ - - `CSV 8t4c MRR comparison <../../_static/vpp/performance-changes-3n-skx-8t4c-mrr.csv>`_ - -2n-skx -~~~~~~ - -NDR Comparison -`````````````` - -Comparison tables in ASCII and CSV formats: - - - `ASCII 2t1c NDR comparison <../../_static/vpp/performance-changes-2n-skx-2t1c-ndr.txt>`_ - - `ASCII 4t2c NDR comparison <../../_static/vpp/performance-changes-2n-skx-4t2c-ndr.txt>`_ - - `CSV 2t1c NDR comparison <../../_static/vpp/performance-changes-2n-skx-2t1c-ndr.csv>`_ - - `CSV 4t2c NDR comparison <../../_static/vpp/performance-changes-2n-skx-4t2c-ndr.csv>`_ - -PDR Comparison -`````````````` - -Comparison tables in ASCII and CSV formats: - - - `ASCII 2t1c PDR comparison <../../_static/vpp/performance-changes-2n-skx-2t1c-pdr.txt>`_ - - `ASCII 4t2c PDR comparison <../../_static/vpp/performance-changes-2n-skx-4t2c-pdr.txt>`_ - - `CSV 2t1c PDR comparison <../../_static/vpp/performance-changes-2n-skx-2t1c-pdr.csv>`_ - - `CSV 4t2c PDR comparison <../../_static/vpp/performance-changes-2n-skx-4t2c-pdr.csv>`_ - -MRR Comparison -`````````````` +.. + MRR Comparison + `````````````` -Comparison tables in ASCII and CSV formats: + Comparison tables in ASCII and CSV formats: - - `ASCII 2t1c MRR comparison <../../_static/vpp/performance-changes-2n-skx-2t1c-mrr.txt>`_ - - `ASCII 4t2c MRR comparison <../../_static/vpp/performance-changes-2n-skx-4t2c-mrr.txt>`_ - - `ASCII 8t4c MRR comparison <../../_static/vpp/performance-changes-2n-skx-8t4c-mrr.txt>`_ - - `CSV 2t1c MRR comparison <../../_static/vpp/performance-changes-2n-skx-2t1c-mrr.csv>`_ - - `CSV 4t2c MRR comparison <../../_static/vpp/performance-changes-2n-skx-4t2c-mrr.csv>`_ - - `CSV 8t4c MRR comparison <../../_static/vpp/performance-changes-2n-skx-8t4c-mrr.csv>`_ + - `ASCII 2t1c MRR comparison <../../_static/vpp/performance-changes-3n-skx-2t1c-mrr.txt>`_ + - `ASCII 4t2c MRR comparison <../../_static/vpp/performance-changes-3n-skx-4t2c-mrr.txt>`_ + - `ASCII 8t4c MRR comparison <../../_static/vpp/performance-changes-3n-skx-8t4c-mrr.txt>`_ + - `CSV 2t1c MRR comparison <../../_static/vpp/performance-changes-3n-skx-2t1c-mrr.csv>`_ + - `CSV 4t2c MRR comparison <../../_static/vpp/performance-changes-3n-skx-4t2c-mrr.csv>`_ + - `CSV 8t4c MRR comparison <../../_static/vpp/performance-changes-3n-skx-8t4c-mrr.csv>`_ .. - 2n-dnv + 2n-skx ~~~~~~ NDR Comparison @@ -144,29 +111,29 @@ Comparison tables in ASCII and CSV formats: Comparison tables in ASCII and CSV formats: - - `ASCII 1t1c NDR comparison <../../_static/vpp/performance-changes-2n-dnv-1t1c-ndr.txt>`_ - - `ASCII 2t2c NDR comparison <../../_static/vpp/performance-changes-2n-dnv-2t2c-ndr.txt>`_ - - `CSV 1t1c NDR comparison <../../_static/vpp/performance-changes-2n-dnv-1t1c-ndr.csv>`_ - - `CSV 2t2c NDR comparison <../../_static/vpp/performance-changes-2n-dnv-2t2c-ndr.csv>`_ + - `ASCII 2t1c NDR comparison <../../_static/vpp/performance-changes-2n-skx-2t1c-ndr.txt>`_ + - `ASCII 4t2c NDR comparison <../../_static/vpp/performance-changes-2n-skx-4t2c-ndr.txt>`_ + - `CSV 2t1c NDR comparison <../../_static/vpp/performance-changes-2n-skx-2t1c-ndr.csv>`_ + - `CSV 4t2c NDR comparison <../../_static/vpp/performance-changes-2n-skx-4t2c-ndr.csv>`_ PDR Comparison `````````````` Comparison tables in ASCII and CSV formats: - - `ASCII 1t1c PDR comparison <../../_static/vpp/performance-changes-2n-dnv-1t1c-pdr.txt>`_ - - `ASCII 2t2c PDR comparison <../../_static/vpp/performance-changes-2n-dnv-2t2c-pdr.txt>`_ - - `CSV 1t1c PDR comparison <../../_static/vpp/performance-changes-2n-dnv-1t1c-pdr.csv>`_ - - `CSV 2t2c PDR comparison <../../_static/vpp/performance-changes-2n-dnv-2t2c-pdr.csv>`_ + - `ASCII 2t1c PDR comparison <../../_static/vpp/performance-changes-2n-skx-2t1c-pdr.txt>`_ + - `ASCII 4t2c PDR comparison <../../_static/vpp/performance-changes-2n-skx-4t2c-pdr.txt>`_ + - `CSV 2t1c PDR comparison <../../_static/vpp/performance-changes-2n-skx-2t1c-pdr.csv>`_ + - `CSV 4t2c PDR comparison <../../_static/vpp/performance-changes-2n-skx-4t2c-pdr.csv>`_ MRR Comparison `````````````` Comparison tables in ASCII and CSV formats: - - `ASCII 1t1c MRR comparison <../../_static/vpp/performance-changes-2n-dnv-1t1c-mrr.txt>`_ - - `ASCII 2t2c MRR comparison <../../_static/vpp/performance-changes-2n-dnv-2t2c-mrr.txt>`_ - - `ASCII 4t4c MRR comparison <../../_static/vpp/performance-changes-2n-dnv-4t4c-mrr.txt>`_ - - `CSV 1t1c MRR comparison <../../_static/vpp/performance-changes-2n-dnv-1t1c-mrr.csv>`_ - - `CSV 2t2c MRR comparison <../../_static/vpp/performance-changes-2n-dnv-2t2c-mrr.csv>`_ - - `CSV 4t4c MRR comparison <../../_static/vpp/performance-changes-2n-dnv-4t4c-mrr.csv>`_ + - `ASCII 2t1c MRR comparison <../../_static/vpp/performance-changes-2n-skx-2t1c-mrr.txt>`_ + - `ASCII 4t2c MRR comparison <../../_static/vpp/performance-changes-2n-skx-4t2c-mrr.txt>`_ + - `ASCII 8t4c MRR comparison <../../_static/vpp/performance-changes-2n-skx-8t4c-mrr.txt>`_ + - `CSV 2t1c MRR comparison <../../_static/vpp/performance-changes-2n-skx-2t1c-mrr.csv>`_ + - `CSV 4t2c MRR comparison <../../_static/vpp/performance-changes-2n-skx-4t2c-mrr.csv>`_ + - `CSV 8t4c MRR comparison <../../_static/vpp/performance-changes-2n-skx-8t4c-mrr.csv>`_ diff --git a/docs/report/vpp_performance_tests/comparisons/index.rst b/docs/report/vpp_performance_tests/comparisons/index.rst index 1ce9427d99..2664bb9bc9 100644 --- a/docs/report/vpp_performance_tests/comparisons/index.rst +++ b/docs/report/vpp_performance_tests/comparisons/index.rst @@ -11,7 +11,9 @@ Comparisons .. toctree:: current_vs_previous_release + +.. 3n-skx_vs_3n-hsw_testbeds 3n-skx_vs_2n-skx_testbeds nic_comparison - soak_vs_ndr + diff --git a/docs/report/vpp_performance_tests/comparisons/nic_comparison.rst b/docs/report/vpp_performance_tests/comparisons/nic_comparison.rst index 6db2756c38..4b288da24c 100644 --- a/docs/report/vpp_performance_tests/comparisons/nic_comparison.rst +++ b/docs/report/vpp_performance_tests/comparisons/nic_comparison.rst @@ -29,40 +29,41 @@ results repeatability vary between the test cases. with RF result files csit-vpp-perf-|srelease|-\*.zip `archived here <../../_static/archive/>`_. -3n-hsw -~~~~~~ +.. + 3n-hsw + ~~~~~~ -NDR Comparison -`````````````` + NDR Comparison + `````````````` -Comparison tables in ASCII and CSV formats: + Comparison tables in ASCII and CSV formats: - - `ASCII 1t1c NDR Intel-x520 and Intel-x710 comparison <../../_static/vpp/performance-changes-3n-hsw-1t1c-nics-ndr.txt>`_ - - `ASCII 2t2c NDR Intel-x520 and Intel-x710 comparison <../../_static/vpp/performance-changes-3n-hsw-2t2c-nics-ndr.txt>`_ - - `CSV 1t1c NDR Intel-x520 and Intel-x710 comparison <../../_static/vpp/performance-changes-3n-hsw-1t1c-nics-ndr.csv>`_ - - `CSV 2t2c NDR Intel-x520 and Intel-x710 comparison <../../_static/vpp/performance-changes-3n-hsw-2t2c-nics-ndr.csv>`_ + - `ASCII 1t1c NDR Intel-x520 and Intel-x710 comparison <../../_static/vpp/performance-changes-3n-hsw-1t1c-nics-ndr.txt>`_ + - `ASCII 2t2c NDR Intel-x520 and Intel-x710 comparison <../../_static/vpp/performance-changes-3n-hsw-2t2c-nics-ndr.txt>`_ + - `CSV 1t1c NDR Intel-x520 and Intel-x710 comparison <../../_static/vpp/performance-changes-3n-hsw-1t1c-nics-ndr.csv>`_ + - `CSV 2t2c NDR Intel-x520 and Intel-x710 comparison <../../_static/vpp/performance-changes-3n-hsw-2t2c-nics-ndr.csv>`_ -PDR Comparison -`````````````` + PDR Comparison + `````````````` -Comparison tables in ASCII and CSV formats: + Comparison tables in ASCII and CSV formats: - - `ASCII 1t1c PDR Intel-x520 and Intel-x710 comparison <../../_static/vpp/performance-changes-3n-hsw-1t1c-nics-pdr.txt>`_ - - `ASCII 2t2c PDR Intel-x520 and Intel-x710 comparison <../../_static/vpp/performance-changes-3n-hsw-2t2c-nics-pdr.txt>`_ - - `CSV 1t1c PDR Intel-x520 and Intel-x710 comparison <../../_static/vpp/performance-changes-3n-hsw-1t1c-nics-pdr.csv>`_ - - `CSV 2t2c PDR Intel-x520 and Intel-x710 comparison <../../_static/vpp/performance-changes-3n-hsw-2t2c-nics-pdr.csv>`_ + - `ASCII 1t1c PDR Intel-x520 and Intel-x710 comparison <../../_static/vpp/performance-changes-3n-hsw-1t1c-nics-pdr.txt>`_ + - `ASCII 2t2c PDR Intel-x520 and Intel-x710 comparison <../../_static/vpp/performance-changes-3n-hsw-2t2c-nics-pdr.txt>`_ + - `CSV 1t1c PDR Intel-x520 and Intel-x710 comparison <../../_static/vpp/performance-changes-3n-hsw-1t1c-nics-pdr.csv>`_ + - `CSV 2t2c PDR Intel-x520 and Intel-x710 comparison <../../_static/vpp/performance-changes-3n-hsw-2t2c-nics-pdr.csv>`_ -MRR Comparison -`````````````` + MRR Comparison + `````````````` -Comparison tables in ASCII and CSV formats: + Comparison tables in ASCII and CSV formats: - - `ASCII 1t1c MRR Intel-x520 and Intel-x710 comparison <../../_static/vpp/performance-changes-3n-hsw-1t1c-nics-mrr.txt>`_ - - `ASCII 2t2c MRR Intel-x520 and Intel-x710 comparison <../../_static/vpp/performance-changes-3n-hsw-2t2c-nics-mrr.txt>`_ - - `ASCII 4t4c MRR Intel-x520 and Intel-x710 comparison <../../_static/vpp/performance-changes-3n-hsw-4t4c-nics-mrr.txt>`_ - - `CSV 1t1c MRR Intel-x520 and Intel-x710 comparison <../../_static/vpp/performance-changes-3n-hsw-1t1c-nics-mrr.csv>`_ - - `CSV 2t2c MRR Intel-x520 and Intel-x710 comparison <../../_static/vpp/performance-changes-3n-hsw-2t2c-nics-mrr.csv>`_ - - `CSV 4t4c MRR Intel-x520 and Intel-x710 comparison <../../_static/vpp/performance-changes-3n-hsw-4t4c-nics-mrr.csv>`_ + - `ASCII 1t1c MRR Intel-x520 and Intel-x710 comparison <../../_static/vpp/performance-changes-3n-hsw-1t1c-nics-mrr.txt>`_ + - `ASCII 2t2c MRR Intel-x520 and Intel-x710 comparison <../../_static/vpp/performance-changes-3n-hsw-2t2c-nics-mrr.txt>`_ + - `ASCII 4t4c MRR Intel-x520 and Intel-x710 comparison <../../_static/vpp/performance-changes-3n-hsw-4t4c-nics-mrr.txt>`_ + - `CSV 1t1c MRR Intel-x520 and Intel-x710 comparison <../../_static/vpp/performance-changes-3n-hsw-1t1c-nics-mrr.csv>`_ + - `CSV 2t2c MRR Intel-x520 and Intel-x710 comparison <../../_static/vpp/performance-changes-3n-hsw-2t2c-nics-mrr.csv>`_ + - `CSV 4t4c MRR Intel-x520 and Intel-x710 comparison <../../_static/vpp/performance-changes-3n-hsw-4t4c-nics-mrr.csv>`_ 3n-skx ~~~~~~ @@ -87,49 +88,51 @@ Comparison tables in ASCII and CSV formats: - `CSV 2t1c PDR Intel-x710 and Intel-xxv710 comparison <../../_static/vpp/performance-changes-3n-skx-2t1c-nics-pdr.csv>`_ - `CSV 4t2c PDR Intel-x710 and Intel-xxv710 comparison <../../_static/vpp/performance-changes-3n-skx-4t2c-nics-pdr.csv>`_ -MRR Comparison -`````````````` +.. + MRR Comparison + `````````````` -Comparison tables in ASCII and CSV formats: + Comparison tables in ASCII and CSV formats: - - `ASCII 2t1c MRR Intel-x710 and Intel-xxv710 comparison <../../_static/vpp/performance-changes-3n-skx-2t1c-nics-mrr.txt>`_ - - `ASCII 4t2c MRR Intel-x710 and Intel-xxv710 comparison <../../_static/vpp/performance-changes-3n-skx-4t2c-nics-mrr.txt>`_ - - `ASCII 8t4c MRR Intel-x710 and Intel-xxv710 comparison <../../_static/vpp/performance-changes-3n-skx-8t4c-nics-mrr.txt>`_ - - `CSV 2t1c MRR Intel-x710 and Intel-xxv710 comparison <../../_static/vpp/performance-changes-3n-skx-2t1c-nics-mrr.csv>`_ - - `CSV 4t2c MRR Intel-x710 and Intel-xxv710 comparison <../../_static/vpp/performance-changes-3n-skx-4t2c-nics-mrr.csv>`_ - - `CSV 8t4c MRR Intel-x710 and Intel-xxv710 comparison <../../_static/vpp/performance-changes-3n-skx-8t4c-nics-mrr.csv>`_ + - `ASCII 2t1c MRR Intel-x710 and Intel-xxv710 comparison <../../_static/vpp/performance-changes-3n-skx-2t1c-nics-mrr.txt>`_ + - `ASCII 4t2c MRR Intel-x710 and Intel-xxv710 comparison <../../_static/vpp/performance-changes-3n-skx-4t2c-nics-mrr.txt>`_ + - `ASCII 8t4c MRR Intel-x710 and Intel-xxv710 comparison <../../_static/vpp/performance-changes-3n-skx-8t4c-nics-mrr.txt>`_ + - `CSV 2t1c MRR Intel-x710 and Intel-xxv710 comparison <../../_static/vpp/performance-changes-3n-skx-2t1c-nics-mrr.csv>`_ + - `CSV 4t2c MRR Intel-x710 and Intel-xxv710 comparison <../../_static/vpp/performance-changes-3n-skx-4t2c-nics-mrr.csv>`_ + - `CSV 8t4c MRR Intel-x710 and Intel-xxv710 comparison <../../_static/vpp/performance-changes-3n-skx-8t4c-nics-mrr.csv>`_ -2n-skx -~~~~~~ +.. + 2n-skx + ~~~~~~ -NDR Comparison -`````````````` + NDR Comparison + `````````````` -Comparison tables in ASCII and CSV formats: + Comparison tables in ASCII and CSV formats: - - `ASCII 2t1c NDR Intel-x710 and Intel-xxv710 comparison <../../_static/vpp/performance-changes-2n-skx-2t1c-nics-ndr.txt>`_ - - `ASCII 4t2c NDR Intel-x710 and Intel-xxv710 comparison <../../_static/vpp/performance-changes-2n-skx-4t2c-nics-ndr.txt>`_ - - `CSV 2t1c NDR Intel-x710 and Intel-xxv710 comparison <../../_static/vpp/performance-changes-2n-skx-2t1c-nics-ndr.csv>`_ - - `CSV 4t2c NDR Intel-x710 and Intel-xxv710 comparison <../../_static/vpp/performance-changes-2n-skx-4t2c-nics-ndr.csv>`_ + - `ASCII 2t1c NDR Intel-x710 and Intel-xxv710 comparison <../../_static/vpp/performance-changes-2n-skx-2t1c-nics-ndr.txt>`_ + - `ASCII 4t2c NDR Intel-x710 and Intel-xxv710 comparison <../../_static/vpp/performance-changes-2n-skx-4t2c-nics-ndr.txt>`_ + - `CSV 2t1c NDR Intel-x710 and Intel-xxv710 comparison <../../_static/vpp/performance-changes-2n-skx-2t1c-nics-ndr.csv>`_ + - `CSV 4t2c NDR Intel-x710 and Intel-xxv710 comparison <../../_static/vpp/performance-changes-2n-skx-4t2c-nics-ndr.csv>`_ -PDR Comparison -`````````````` + PDR Comparison + `````````````` -Comparison tables in ASCII and CSV formats: + Comparison tables in ASCII and CSV formats: - - `ASCII 2t1c PDR Intel-x710 and Intel-xxv710 comparison <../../_static/vpp/performance-changes-2n-skx-2t1c-nics-pdr.txt>`_ - - `ASCII 4t2c PDR Intel-x710 and Intel-xxv710 comparison <../../_static/vpp/performance-changes-2n-skx-4t2c-nics-pdr.txt>`_ - - `CSV 2t1c PDR Intel-x710 and Intel-xxv710 comparison <../../_static/vpp/performance-changes-2n-skx-2t1c-nics-pdr.csv>`_ - - `CSV 4t2c PDR Intel-x710 and Intel-xxv710 comparison <../../_static/vpp/performance-changes-2n-skx-4t2c-nics-pdr.csv>`_ + - `ASCII 2t1c PDR Intel-x710 and Intel-xxv710 comparison <../../_static/vpp/performance-changes-2n-skx-2t1c-nics-pdr.txt>`_ + - `ASCII 4t2c PDR Intel-x710 and Intel-xxv710 comparison <../../_static/vpp/performance-changes-2n-skx-4t2c-nics-pdr.txt>`_ + - `CSV 2t1c PDR Intel-x710 and Intel-xxv710 comparison <../../_static/vpp/performance-changes-2n-skx-2t1c-nics-pdr.csv>`_ + - `CSV 4t2c PDR Intel-x710 and Intel-xxv710 comparison <../../_static/vpp/performance-changes-2n-skx-4t2c-nics-pdr.csv>`_ -MRR Comparison -`````````````` + MRR Comparison + `````````````` -Comparison tables in ASCII and CSV formats: + Comparison tables in ASCII and CSV formats: - - `ASCII 2t1c MRR Intel-x710 and Intel-xxv710 comparison <../../_static/vpp/performance-changes-2n-skx-2t1c-nics-mrr.txt>`_ - - `ASCII 4t2c MRR Intel-x710 and Intel-xxv710 comparison <../../_static/vpp/performance-changes-2n-skx-4t2c-nics-mrr.txt>`_ - - `ASCII 8t4c MRR Intel-x710 and Intel-xxv710 comparison <../../_static/vpp/performance-changes-2n-skx-8t4c-nics-mrr.txt>`_ - - `CSV 2t1c MRR Intel-x710 and Intel-xxv710 comparison <../../_static/vpp/performance-changes-2n-skx-2t1c-nics-mrr.csv>`_ - - `CSV 4t2c MRR Intel-x710 and Intel-xxv710 comparison <../../_static/vpp/performance-changes-2n-skx-4t2c-nics-mrr.csv>`_ - - `CSV 8t4c MRR Intel-x710 and Intel-xxv710 comparison <../../_static/vpp/performance-changes-2n-skx-8t4c-nics-mrr.csv>`_ + - `ASCII 2t1c MRR Intel-x710 and Intel-xxv710 comparison <../../_static/vpp/performance-changes-2n-skx-2t1c-nics-mrr.txt>`_ + - `ASCII 4t2c MRR Intel-x710 and Intel-xxv710 comparison <../../_static/vpp/performance-changes-2n-skx-4t2c-nics-mrr.txt>`_ + - `ASCII 8t4c MRR Intel-x710 and Intel-xxv710 comparison <../../_static/vpp/performance-changes-2n-skx-8t4c-nics-mrr.txt>`_ + - `CSV 2t1c MRR Intel-x710 and Intel-xxv710 comparison <../../_static/vpp/performance-changes-2n-skx-2t1c-nics-mrr.csv>`_ + - `CSV 4t2c MRR Intel-x710 and Intel-xxv710 comparison <../../_static/vpp/performance-changes-2n-skx-4t2c-nics-mrr.csv>`_ + - `CSV 8t4c MRR Intel-x710 and Intel-xxv710 comparison <../../_static/vpp/performance-changes-2n-skx-8t4c-nics-mrr.csv>`_ diff --git a/docs/report/vpp_performance_tests/csit_release_notes.rst b/docs/report/vpp_performance_tests/csit_release_notes.rst index 74ab68062b..6cf529e786 100644 --- a/docs/report/vpp_performance_tests/csit_release_notes.rst +++ b/docs/report/vpp_performance_tests/csit_release_notes.rst @@ -1,60 +1,60 @@ Release Notes ============= -Changes in |csit-release| -------------------------- - -#. VPP PERFORMANCE TESTS - - - **Service density 2n-skx tests**: Added higher NF density tests with two - NFs' data-plane threads sharing a physical core. VPP IPv4 routing is now - used as a VNF payload similar to CNF tests. +.. + Changes in |csit-release| + ------------------------- - - **Soak Tests**: Optimized performamce soak tests framework - code for extended time duration tests and throughput discovery - at given PLR and at give total test time e.g. minutes, hours, - days, weeks. See updated - :ref:`test_methodology` section for more details. + #. VPP PERFORMANCE TESTS -#. TEST FRAMEWORK + - **Service density 2n-skx tests**: Network Function Virtualization (NFV) + service density tests focus on measuring total per server throughput at + varied NFV service *packing* densities with vswitch providing host + dataplane. The goal is to compare and contrast performance of a shared + vswitch for different network topologies and virtualization technologies, + and their impact on vswitch performance and efficiency in a range of NFV + service configurations. - - **Qemu code refactor**: Complete code refactor of the key components of - QemuUtil.py and QemuManager.py (L1 and L2 KW counterparts). Added - implementation of kernel-image-kvm based VM replacing the previously used - NestedVM images. Added ability to run VPP as a payload in VNF. + - **Experimental Soak Tests**: Added performamce soak tests framework + code for extended time duration tests and throughput discovery + at given PLR and at give total test time e.g. minutes, hours, + days, weeks, months, years. See updated + :ref:`test_methodology` section for more details. - - **CSIT PAPI Support**: Continued conversion of CSIT VAT L1 keywords to - PAPI L1 KWs in CSIT using VPP Python bindings. Redesign of key components - of PAPI Executor and PAPI history. + #. TEST FRAMEWORK - - **General Code Housekeeping**: Ongoing RF keywords optimizations, - removal of redundant RF keywords. + - **Container code optimizations**: Optimized container library allows to + run containre_memif tests faster. - - **Test suite generator**: Added capability to generate suites for - different NIC models as well as throughput search algorithm types. Uses - base tests suites as source. + - **CSIT PAPI Support**: Continue converting existing VAT L1 keywords to + PAPI L1 KWs in CSIT using VPP Python bindings. Required for migrating away + from VAT. - - **TOX verification**: Added verifications for test suite generator. + - **General Code Housekeeping**: Ongoing RF keywords optimizations, + removal of redundant RF keywords. -#. PRESENTATION AND ANALYTICS LAYER + #. PRESENTATION AND ANALYTICS LAYER - - **Graphs Layout Improvements**: Improved performance graphs layout - for better readibility and maintenance: test grouping, axis - labels, descriptions, other informative decoration. + - **Graphs Layout Improvements**: Improved performance graphs layout + for better readibility and maintenance: test grouping, axis + labels, descriptions, other informative decoration. -.. #. MISCELLANEOUS - - **2n-dnv Tests (3rd Party)**: Published performance tests for 2n- - dnv (2-Node Atom Denverton) from 3rd party testbeds running FD.io + - **3n-dnv Tests (3rd Party)**: Published performance tests for 3n- + dnv (3-Node Atom Denverton) from 3rd party testbeds running FD.io |csit-release| automated testing code. Only graphs for Packet Throughput and Speedup Multi-core and not for Packet Latency were published as there are no results for Packet Latency available. -.. raw:: latex +.. note:: - \clearpage + |csit-release| report was generated with a single run of selected + 64B frame performance tests on 3n-hsw and 3n-skx test beds + in order to spot-check the main data plane paths. + NFV service density and soak tests were not run and do not feature in + this report. .. _vpp_known_issues: @@ -63,30 +63,15 @@ Known Issues List of known issues in |csit-release| for VPP performance tests: -+----+-----------------------------------------+----------------------------------------------------------------------------------------------------------+ -| # | JiraID | Issue Description | -+====+=========================================+==========================================================================================================+ -| 1 | `CSIT-570 | Sporadic (1 in 200) NDR discovery test failures on x520. DPDK reporting rx-errors, indicating L1 issue. | -| | <https://jira.fd.io/browse/CSIT-570>`_ | Suspected issue with HW combination of X710-X520 in LF testbeds. Not observed outside of LF testbeds. | -+----+-----------------------------------------+----------------------------------------------------------------------------------------------------------+ -| 2 | `CSIT-1503 | [`TRex-519 <https://trex-tgn.cisco.com/youtrack/issue/trex-519>`_] XL710/XXV710 with FW 6.0.1 will have | -| | <https://jira.fd.io/browse/CSIT-1503>`_ | Rx drop rate of 27MPPS. | -+----+-----------------------------------------+----------------------------------------------------------------------------------------------------------+ -| 3 | `CSIT-1501 | Sporadic crypto backend fails loading `VPP-1670 <https://jira.fd.io/browse/VPP-1670>`_ | -| | <https://jira.fd.io/browse/CSIT-1501>`_ | | -+----+-----------------------------------------+----------------------------------------------------------------------------------------------------------+ -| 4 | `CSIT-1427 | Sporadic HW aes-128-cbc-sha1 tunnel-interface tests are failing. | -| | <https://jira.fd.io/browse/CSIT-1427>`_ | `VPP-1671 <https://jira.fd.io/browse/VPP-1671>`_ | -+----+-----------------------------------------+----------------------------------------------------------------------------------------------------------+ -| 5 | `CSIT-1498 | Memif tests are sporadically failing on initialization of memif connection. | -| | <https://jira.fd.io/browse/CSIT-1498>`_ | | -+----+-----------------------------------------+----------------------------------------------------------------------------------------------------------+ -| 6 | `CSIT-1499 | AVF tests are sporadically failing on initialization of AVF interface. | -| | <https://jira.fd.io/browse/CSIT-1499>`_ | | -+----+-----------------------------------------+----------------------------------------------------------------------------------------------------------+ -| 7 | `VPP-1676 | 9000B ip4 memif errors - ip4-input: ip4 length > l2 length. | -| | <https://jira.fd.io/browse/VPP-1676>`_ | IP4 jumbo frames (9000B) are dropped in case of tests with memif. | -+----+-----------------------------------------+----------------------------------------------------------------------------------------------------------+ -| 8 | `VPP-1677 | 9000B ip4 nat44: VPP crash + coredump. | -| | <https://jira.fd.io/browse/VPP-1677>`_ | VPP crashes very often in case that NAT44 is configured and it has to process IP4 jumbo frames (9000B). | -+----+-----------------------------------------+----------------------------------------------------------------------------------------------------------+ ++----+-----------------------------------------+---------------------------------------------------------------------------------------------------------------------------------+ +| # | JiraID | Issue Description | ++====+=========================================+=================================================================================================================================+ +| 1 | `CSIT-570 | Sporadic (1 in 200) NDR discovery test failures on x520. DPDK reporting rx-errors, indicating L1 issue. | +| | <https://jira.fd.io/browse/CSIT-570>`_ | Suspected issue with HW combination of X710-X520 in LF testbeds. Not observed outside of LF testbeds. | ++----+-----------------------------------------+---------------------------------------------------------------------------------------------------------------------------------+ +| 2 | `VPP-1563 | AVF L2patch tests are failing for all packet size and core combination. Reason: null-node blackholed packets in show error. | +| | <https://jira.fd.io/browse/VPP-1563>`_ | | ++----+-----------------------------------------+---------------------------------------------------------------------------------------------------------------------------------+ +| 3 | `CSIT-1465 | 4c VPP VM vhost tests failiing on 3n-skx | +| | <https://jira.fd.io/browse/CSIT-1465>`_ | | ++----+-----------------------------------------+---------------------------------------------------------------------------------------------------------------------------------+ diff --git a/docs/report/vpp_performance_tests/index.rst b/docs/report/vpp_performance_tests/index.rst index e33c37d31c..c681364216 100644 --- a/docs/report/vpp_performance_tests/index.rst +++ b/docs/report/vpp_performance_tests/index.rst @@ -8,8 +8,6 @@ VPP Performance packet_throughput_graphs/index throughput_speedup_multi_core/index packet_latency_graphs/index - soak_tests/index - nf_service_density/index comparisons/index throughput_trending test_environment @@ -17,3 +15,5 @@ VPP Performance .. http_server_performance/index + soak_tests/index + nf_service_density/index diff --git a/docs/report/vpp_performance_tests/packet_latency_graphs/container_memif.rst b/docs/report/vpp_performance_tests/packet_latency_graphs/container_memif.rst index 0ffeef5546..98872f36f3 100644 --- a/docs/report/vpp_performance_tests/packet_latency_graphs/container_memif.rst +++ b/docs/report/vpp_performance_tests/packet_latency_graphs/container_memif.rst @@ -17,11 +17,10 @@ CSIT source code for the test cases used for plots can be found in .. toctree:: + container_memif-3n-skx-x710 +.. container_memif-3n-hsw-x520 container_memif-3n-hsw-x710 container_memif-3n-hsw-xl710 - container_memif-3n-skx-x710 container_memif-2n-skx-x710 - -.. container_memif-2n-skx-xxv710 diff --git a/docs/report/vpp_performance_tests/packet_latency_graphs/index.rst b/docs/report/vpp_performance_tests/packet_latency_graphs/index.rst index 73798a5f1f..46cac66468 100644 --- a/docs/report/vpp_performance_tests/packet_latency_graphs/index.rst +++ b/docs/report/vpp_performance_tests/packet_latency_graphs/index.rst @@ -50,13 +50,13 @@ Additional information about graph data: l2 ip4 ip6 - srv6 ip4_tunnels - ip6_tunnels vm_vhost container_memif ipsec + srv6 .. + ip6_tunnels container_orchestrated vts diff --git a/docs/report/vpp_performance_tests/packet_latency_graphs/ip4.rst b/docs/report/vpp_performance_tests/packet_latency_graphs/ip4.rst index b523cfde75..1c71d9949a 100644 --- a/docs/report/vpp_performance_tests/packet_latency_graphs/ip4.rst +++ b/docs/report/vpp_performance_tests/packet_latency_graphs/ip4.rst @@ -18,8 +18,9 @@ CSIT source code for the test cases used for plots can be found in .. toctree:: ip4-3n-hsw-x520 + ip4-3n-skx-x710 +.. ip4-3n-hsw-x710 ip4-3n-hsw-xl710 - ip4-3n-skx-x710 ip4-2n-skx-x710 ip4-2n-skx-xxv710 diff --git a/docs/report/vpp_performance_tests/packet_latency_graphs/ip4_tunnels.rst b/docs/report/vpp_performance_tests/packet_latency_graphs/ip4_tunnels.rst index 924bf3eb2f..fffea0f589 100644 --- a/docs/report/vpp_performance_tests/packet_latency_graphs/ip4_tunnels.rst +++ b/docs/report/vpp_performance_tests/packet_latency_graphs/ip4_tunnels.rst @@ -17,6 +17,8 @@ CSIT source code for the test cases used for plots can be found in .. toctree:: + ip4_tunnels-3n-skx-x710 + +.. ip4_tunnels-3n-hsw-x520 ip4_tunnels-3n-hsw-x710 - ip4_tunnels-3n-skx-x710 diff --git a/docs/report/vpp_performance_tests/packet_latency_graphs/ip6.rst b/docs/report/vpp_performance_tests/packet_latency_graphs/ip6.rst index c0de92f969..f08bf9e5ae 100644 --- a/docs/report/vpp_performance_tests/packet_latency_graphs/ip6.rst +++ b/docs/report/vpp_performance_tests/packet_latency_graphs/ip6.rst @@ -17,10 +17,11 @@ CSIT source code for the test cases used for plots can be found in .. toctree:: + ip6-3n-skx-x710 + +.. ip6-3n-hsw-x520 ip6-3n-hsw-x710 ip6-3n-hsw-xl710 - ip6-3n-skx-x710 - ip6-3n-skx-xxv710 ip6-2n-skx-x710 ip6-2n-skx-xxv710 diff --git a/docs/report/vpp_performance_tests/packet_latency_graphs/l2.rst b/docs/report/vpp_performance_tests/packet_latency_graphs/l2.rst index 642f995ccb..ac907407be 100644 --- a/docs/report/vpp_performance_tests/packet_latency_graphs/l2.rst +++ b/docs/report/vpp_performance_tests/packet_latency_graphs/l2.rst @@ -44,9 +44,11 @@ CSIT source code for the test cases used for plots can be found in .. toctree:: l2-3n-hsw-x520 + l2-3n-skx-x710 + +.. l2-3n-hsw-x710 l2-3n-hsw-xl710 - l2-3n-skx-x710 l2-3n-skx-xxv710 l2-2n-skx-x710 l2-2n-skx-xxv710 diff --git a/docs/report/vpp_performance_tests/packet_latency_graphs/vm_vhost.rst b/docs/report/vpp_performance_tests/packet_latency_graphs/vm_vhost.rst index eff64690c0..36c46b8599 100644 --- a/docs/report/vpp_performance_tests/packet_latency_graphs/vm_vhost.rst +++ b/docs/report/vpp_performance_tests/packet_latency_graphs/vm_vhost.rst @@ -18,10 +18,10 @@ CSIT source code for the test cases used for plots can be found in .. toctree:: - vm_vhost-3n-hsw-x520 - vm_vhost-3n-hsw-x710 vm_vhost-3n-skx-x710 - vm_vhost-2n-skx-x710 .. + vm_vhost-3n-hsw-x520 + vm_vhost-3n-hsw-x710 + vm_vhost-2n-skx-x710 vm_vhost-2n-skx-xxv710 diff --git a/docs/report/vpp_performance_tests/packet_throughput_graphs/container_memif.rst b/docs/report/vpp_performance_tests/packet_throughput_graphs/container_memif.rst index a7acf3f4ab..b8b4ea5e51 100644 --- a/docs/report/vpp_performance_tests/packet_throughput_graphs/container_memif.rst +++ b/docs/report/vpp_performance_tests/packet_throughput_graphs/container_memif.rst @@ -17,11 +17,11 @@ CSIT source code for the test cases used for plots can be found in .. toctree:: + container_memif-3n-skx-x710 + +.. container_memif-3n-hsw-x520 container_memif-3n-hsw-x710 container_memif-3n-hsw-xl710 - container_memif-3n-skx-x710 container_memif-2n-skx-x710 - -.. container_memif-2n-skx-xxv710 diff --git a/docs/report/vpp_performance_tests/packet_throughput_graphs/index.rst b/docs/report/vpp_performance_tests/packet_throughput_graphs/index.rst index 48f66d1b78..252f67043e 100644 --- a/docs/report/vpp_performance_tests/packet_throughput_graphs/index.rst +++ b/docs/report/vpp_performance_tests/packet_throughput_graphs/index.rst @@ -60,13 +60,13 @@ Additional information about graph data: l2 ip4 ip6 - srv6 ip4_tunnels - ip6_tunnels vm_vhost container_memif ipsec + srv6 vts .. + ip6_tunnels container_orchestrated diff --git a/docs/report/vpp_performance_tests/packet_throughput_graphs/ip4.rst b/docs/report/vpp_performance_tests/packet_throughput_graphs/ip4.rst index 205d2a696f..32592d41a5 100644 --- a/docs/report/vpp_performance_tests/packet_throughput_graphs/ip4.rst +++ b/docs/report/vpp_performance_tests/packet_throughput_graphs/ip4.rst @@ -18,11 +18,11 @@ CSIT source code for the test cases used for plots can be found in .. toctree:: ip4-3n-hsw-x520 + ip4-3n-skx-x710 + +.. ip4-3n-hsw-x710 ip4-3n-hsw-xl710 - ip4-3n-skx-x710 ip4-2n-skx-x710 ip4-2n-skx-xxv710 - -.. ip4-2n-dnv-x553 diff --git a/docs/report/vpp_performance_tests/packet_throughput_graphs/ip4_tunnels.rst b/docs/report/vpp_performance_tests/packet_throughput_graphs/ip4_tunnels.rst index 670d580fa0..e441484394 100644 --- a/docs/report/vpp_performance_tests/packet_throughput_graphs/ip4_tunnels.rst +++ b/docs/report/vpp_performance_tests/packet_throughput_graphs/ip4_tunnels.rst @@ -17,6 +17,8 @@ CSIT source code for the test cases used for plots can be found in .. toctree:: + ip4_tunnels-3n-skx-x710 + +.. ip4_tunnels-3n-hsw-x520 ip4_tunnels-3n-hsw-x710 - ip4_tunnels-3n-skx-x710 diff --git a/docs/report/vpp_performance_tests/packet_throughput_graphs/ip6.rst b/docs/report/vpp_performance_tests/packet_throughput_graphs/ip6.rst index 50e9cdcddd..86320a8419 100644 --- a/docs/report/vpp_performance_tests/packet_throughput_graphs/ip6.rst +++ b/docs/report/vpp_performance_tests/packet_throughput_graphs/ip6.rst @@ -17,13 +17,12 @@ CSIT source code for the test cases used for plots can be found in .. toctree:: + ip6-3n-skx-x710 + +.. ip6-3n-hsw-x520 ip6-3n-hsw-x710 ip6-3n-hsw-xl710 - ip6-3n-skx-x710 - ip6-3n-skx-xxv710 ip6-2n-skx-x710 ip6-2n-skx-xxv710 - -.. ip6-2n-dnv-x553 diff --git a/docs/report/vpp_performance_tests/packet_throughput_graphs/l2.rst b/docs/report/vpp_performance_tests/packet_throughput_graphs/l2.rst index fe09661811..2695ffe9da 100644 --- a/docs/report/vpp_performance_tests/packet_throughput_graphs/l2.rst +++ b/docs/report/vpp_performance_tests/packet_throughput_graphs/l2.rst @@ -43,12 +43,12 @@ CSIT source code for the test cases used for plots can be found in .. toctree:: l2-3n-hsw-x520 + l2-3n-skx-x710 + +.. l2-3n-hsw-x710 l2-3n-hsw-xl710 - l2-3n-skx-x710 l2-3n-skx-xxv710 l2-2n-skx-x710 l2-2n-skx-xxv710 - -.. l2-2n-dnv-x553 diff --git a/docs/report/vpp_performance_tests/packet_throughput_graphs/vm_vhost.rst b/docs/report/vpp_performance_tests/packet_throughput_graphs/vm_vhost.rst index 6cae714171..ec356fcd80 100644 --- a/docs/report/vpp_performance_tests/packet_throughput_graphs/vm_vhost.rst +++ b/docs/report/vpp_performance_tests/packet_throughput_graphs/vm_vhost.rst @@ -20,10 +20,10 @@ CSIT source code for the test cases used for plots can be found in .. toctree:: - vm_vhost-3n-hsw-x520 - vm_vhost-3n-hsw-x710 vm_vhost-3n-skx-x710 - vm_vhost-2n-skx-x710 .. + vm_vhost-3n-hsw-x520 + vm_vhost-3n-hsw-x710 + vm_vhost-2n-skx-x710 vm_vhost-2n-skx-xxv710 diff --git a/docs/report/vpp_performance_tests/throughput_speedup_multi_core/container_memif.rst b/docs/report/vpp_performance_tests/throughput_speedup_multi_core/container_memif.rst index 2713cc65d3..c9d3eb5f09 100644 --- a/docs/report/vpp_performance_tests/throughput_speedup_multi_core/container_memif.rst +++ b/docs/report/vpp_performance_tests/throughput_speedup_multi_core/container_memif.rst @@ -19,11 +19,11 @@ CSIT source code for the test cases used for plots can be found in .. toctree:: + container_memif-3n-skx-x710 + +.. container_memif-3n-hsw-x520 container_memif-3n-hsw-x710 container_memif-3n-hsw-xl710 - container_memif-3n-skx-x710 container_memif-2n-skx-x710 - -.. container_memif-2n-skx-xxv710 diff --git a/docs/report/vpp_performance_tests/throughput_speedup_multi_core/index.rst b/docs/report/vpp_performance_tests/throughput_speedup_multi_core/index.rst index f31bfe6012..b1b1ebc416 100644 --- a/docs/report/vpp_performance_tests/throughput_speedup_multi_core/index.rst +++ b/docs/report/vpp_performance_tests/throughput_speedup_multi_core/index.rst @@ -50,13 +50,13 @@ Additional information about graph data: l2 ip4 ip6 - srv6 ip4_tunnels - ip6_tunnels - vm_vhost container_memif ipsec + srv6 vts .. + vm_vhost + ip6_tunnels container_orchestrated diff --git a/docs/report/vpp_performance_tests/throughput_speedup_multi_core/ip4.rst b/docs/report/vpp_performance_tests/throughput_speedup_multi_core/ip4.rst index 439ed71295..1a5d32813c 100644 --- a/docs/report/vpp_performance_tests/throughput_speedup_multi_core/ip4.rst +++ b/docs/report/vpp_performance_tests/throughput_speedup_multi_core/ip4.rst @@ -20,11 +20,12 @@ CSIT source code for the test cases used for plots can be found in .. toctree:: ip4-3n-hsw-x520 + ip4-3n-skx-x710 + +.. ip4-3n-hsw-x710 ip4-3n-hsw-xl710 ip4-3n-skx-x710 ip4-2n-skx-x710 ip4-2n-skx-xxv710 - -.. ip4-2n-dnv-x553 diff --git a/docs/report/vpp_performance_tests/throughput_speedup_multi_core/ip4_tunnels.rst b/docs/report/vpp_performance_tests/throughput_speedup_multi_core/ip4_tunnels.rst index 574112c7ac..0957953241 100644 --- a/docs/report/vpp_performance_tests/throughput_speedup_multi_core/ip4_tunnels.rst +++ b/docs/report/vpp_performance_tests/throughput_speedup_multi_core/ip4_tunnels.rst @@ -19,6 +19,8 @@ CSIT source code for the test cases used for plots can be found in .. toctree:: + ip4_tunnels-3n-skx-x710 + +.. ip4_tunnels-3n-hsw-x520 ip4_tunnels-3n-hsw-x710 - ip4_tunnels-3n-skx-x710 diff --git a/docs/report/vpp_performance_tests/throughput_speedup_multi_core/ip6.rst b/docs/report/vpp_performance_tests/throughput_speedup_multi_core/ip6.rst index 23889ed2be..f5c1efd595 100644 --- a/docs/report/vpp_performance_tests/throughput_speedup_multi_core/ip6.rst +++ b/docs/report/vpp_performance_tests/throughput_speedup_multi_core/ip6.rst @@ -19,13 +19,12 @@ CSIT source code for the test cases used for plots can be found in .. toctree:: + ip6-3n-skx-x710 + +.. ip6-3n-hsw-x520 ip6-3n-hsw-x710 ip6-3n-hsw-xl710 - ip6-3n-skx-x710 - ip6-3n-skx-xxv710 ip6-2n-skx-x710 ip6-2n-skx-xxv710 - -.. ip6-2n-dnv-x553 diff --git a/docs/report/vpp_performance_tests/throughput_speedup_multi_core/l2.rst b/docs/report/vpp_performance_tests/throughput_speedup_multi_core/l2.rst index da7cbc21f6..cd78d5addd 100644 --- a/docs/report/vpp_performance_tests/throughput_speedup_multi_core/l2.rst +++ b/docs/report/vpp_performance_tests/throughput_speedup_multi_core/l2.rst @@ -20,12 +20,12 @@ CSIT source code for the test cases used for above plots can be found in .. toctree:: l2-3n-hsw-x520 + l2-3n-skx-x710 + +.. l2-3n-hsw-x710 l2-3n-hsw-xl710 - l2-3n-skx-x710 l2-3n-skx-xxv710 l2-2n-skx-x710 l2-2n-skx-xxv710 - -.. l2-2n-dnv-x553 diff --git a/docs/report/vpp_performance_tests/throughput_speedup_multi_core/vm_vhost.rst b/docs/report/vpp_performance_tests/throughput_speedup_multi_core/vm_vhost.rst index ad4e81037c..2e9b208545 100644 --- a/docs/report/vpp_performance_tests/throughput_speedup_multi_core/vm_vhost.rst +++ b/docs/report/vpp_performance_tests/throughput_speedup_multi_core/vm_vhost.rst @@ -19,10 +19,10 @@ CSIT source code for the test cases used for plots can be found in .. toctree:: + vm_vhost-3n-skx-x710 + +.. vm_vhost-3n-hsw-x520 vm_vhost-3n-hsw-x710 vm_vhost-2n-skx-x710 - -.. vm_vhost-2n-skx-xxv710 - vm_vhost-3n-skx-x710 |