aboutsummaryrefslogtreecommitdiffstats
path: root/docs/report/dpdk_performance_tests/comparisons
diff options
context:
space:
mode:
Diffstat (limited to 'docs/report/dpdk_performance_tests/comparisons')
-rw-r--r--docs/report/dpdk_performance_tests/comparisons/2n-skx_vs_2n-clx_testbeds.rst40
-rw-r--r--docs/report/dpdk_performance_tests/comparisons/3n-skx_vs_2n-skx_testbeds.rst44
-rw-r--r--docs/report/dpdk_performance_tests/comparisons/3n-skx_vs_3n-hsw_testbeds.rst41
-rw-r--r--docs/report/dpdk_performance_tests/comparisons/current_vs_previous_release.rst215
-rw-r--r--docs/report/dpdk_performance_tests/comparisons/index.rst27
5 files changed, 0 insertions, 367 deletions
diff --git a/docs/report/dpdk_performance_tests/comparisons/2n-skx_vs_2n-clx_testbeds.rst b/docs/report/dpdk_performance_tests/comparisons/2n-skx_vs_2n-clx_testbeds.rst
deleted file mode 100644
index ec7a9f3609..0000000000
--- a/docs/report/dpdk_performance_tests/comparisons/2n-skx_vs_2n-clx_testbeds.rst
+++ /dev/null
@@ -1,40 +0,0 @@
-2n-Skx vs 2n-Clx Testbeds
--------------------------
-
-Relative comparison of |dpdk-release| Testpmd and L3fwd packet
-throughput (NDR, PDR and MRR) is calculated for the same tests executed
-on 2-Node Skylake (2n-skx) and 2-Node Cascade Lake (2n-clx) physical testbed
-types, in 1-core, 2-core and 4-core configurations.
-
-.. note::
-
- Test results have been generated by
- `FD.io test executor dpdk performance job 2n-skx`_ and
- `FD.io test executor dpdk performance job 2n-clx`_
- with RF result files csit-dpdk-perf-|srelease|-\*.zip
- `archived here <../../_static/archive/>`_.
-
-NDR Comparison
-~~~~~~~~~~~~~~
-
-Comparison tables in ASCII and CSV formats:
-
- - `ASCII NDR comparison <../../_static/dpdk/performance-compare-testbeds-2n-skx-2n-clx-ndr.txt>`_
- - `CSV NDR comparison <../../_static/dpdk/performance-compare-testbeds-2n-skx-2n-clx-ndr.csv>`_
-
-PDR Comparison
-~~~~~~~~~~~~~~
-
-Comparison tables in ASCII and CSV formats:
-
- - `ASCII PDR comparison <../../_static/dpdk/performance-compare-testbeds-2n-skx-2n-clx-pdr.txt>`_
- - `CSV PDR comparison <../../_static/dpdk/performance-compare-testbeds-2n-skx-2n-clx-pdr.csv>`_
-
-..
- MRR Comparison
- ~~~~~~~~~~~~~~
-
- Comparison tables in ASCII and CSV formats:
-
- - `ASCII MRR comparison <../../_static/dpdk/performance-compare-testbeds-2n-skx-2n-clx-mrr.txt>`_
- - `CSV MRR comparison <../../_static/dpdk/performance-compare-testbeds-2n-skx-2n-clx-mrr.csv>`_
diff --git a/docs/report/dpdk_performance_tests/comparisons/3n-skx_vs_2n-skx_testbeds.rst b/docs/report/dpdk_performance_tests/comparisons/3n-skx_vs_2n-skx_testbeds.rst
deleted file mode 100644
index 2eb1e7b961..0000000000
--- a/docs/report/dpdk_performance_tests/comparisons/3n-skx_vs_2n-skx_testbeds.rst
+++ /dev/null
@@ -1,44 +0,0 @@
-
-.. _dpdk_compare_topologies_3n-Skx_vs_2n-Skx:
-
-3n-Skx vs 2n-Skx Testbeds
--------------------------
-
-Relative comparison of |dpdk-release| Testpmd and L3fwd packet
-throughput (NDR, PDR and MRR) is calculated for the same tests executed
-on 3-Node Skylake (3n-skx) and 2-Node Skylake (2n-skx) physical testbed
-types, in 1-core, 2-core and 4-core configurations.
-
-.. note::
-
- Test results have been generated by
- `FD.io test executor dpdk performance job 3n-skx`_ and
- `FD.io test executor dpdk performance job 2n-skx`_
- with RF result
- files csit-dpdk-perf-|srelease|-\*.zip
- `archived here <../../_static/archive/>`_.
-
-NDR Comparison
-~~~~~~~~~~~~~~
-
-Comparison tables in ASCII and CSV formats:
-
- - `ASCII NDR comparison <../../_static/dpdk/performance-compare-topologies-3n-skx-2n-skx-ndr.txt>`_
- - `CSV NDR comparison <../../_static/dpdk/performance-compare-topologies-3n-skx-2n-skx-ndr.csv>`_
-
-PDR Comparison
-~~~~~~~~~~~~~~
-
-Comparison tables in ASCII and CSV formats:
-
- - `ASCII PDR comparison <../../_static/dpdk/performance-compare-topologies-3n-skx-2n-skx-pdr.txt>`_
- - `CSV PDR comparison <../../_static/dpdk/performance-compare-topologies-3n-skx-2n-skx-pdr.csv>`_
-
-..
- MRR Comparison
- ~~~~~~~~~~~~~~
-
- Comparison tables in ASCII and CSV formats:
-
- - `ASCII MRR comparison <../../_static/dpdk/performance-compare-testbeds-3n-hsw-3n-skx-mrr.txt>`_
- - `CSV MRR comparison <../../_static/dpdk/performance-compare-testbeds-3n-hsw-3n-skx-mrr.csv>`_
diff --git a/docs/report/dpdk_performance_tests/comparisons/3n-skx_vs_3n-hsw_testbeds.rst b/docs/report/dpdk_performance_tests/comparisons/3n-skx_vs_3n-hsw_testbeds.rst
deleted file mode 100644
index 8b581f91d2..0000000000
--- a/docs/report/dpdk_performance_tests/comparisons/3n-skx_vs_3n-hsw_testbeds.rst
+++ /dev/null
@@ -1,41 +0,0 @@
-3n-Skx vs 3n-Hsw Testbeds
--------------------------
-
-Relative comparison of |dpdk-release| Testpmd and L3fwd packet
-throughput (NDR, PDR and MRR) is calculated for the same tests executed
-on 3-Node Skylake (3n-skx) and 3-Node Haswell (3n-hsw) physical testbed
-types, in 1-core, 2-core and 4-core configurations.
-
-.. note::
-
- Test results have been generated by
- `FD.io test executor dpdk performance job 3n-hsw`_ and
- `FD.io test executor dpdk performance job 3n-skx`_
- with RF result
- files csit-dpdk-perf-|srelease|-\*.zip
- `archived here <../../_static/archive/>`_.
-
-NDR Comparison
-~~~~~~~~~~~~~~
-
-Comparison tables in ASCII and CSV formats:
-
- - `ASCII NDR comparison <../../_static/dpdk/performance-compare-testbeds-3n-hsw-3n-skx-ndr.txt>`_
- - `CSV NDR comparison <../../_static/dpdk/performance-compare-testbeds-3n-hsw-3n-skx-ndr.csv>`_
-
-PDR Comparison
-~~~~~~~~~~~~~~
-
-Comparison tables in ASCII and CSV formats:
-
- - `ASCII PDR comparison <../../_static/dpdk/performance-compare-testbeds-3n-hsw-3n-skx-pdr.txt>`_
- - `CSV PDR comparison <../../_static/dpdk/performance-compare-testbeds-3n-hsw-3n-skx-pdr.csv>`_
-
-..
- MRR Comparison
- ~~~~~~~~~~~~~~
-
- Comparison tables in ASCII and CSV formats:
-
- - `ASCII MRR comparison <../../_static/dpdk/performance-compare-testbeds-3n-hsw-3n-skx-mrr.txt>`_
- - `CSV MRR comparison <../../_static/dpdk/performance-compare-testbeds-3n-hsw-3n-skx-mrr.csv>`_
diff --git a/docs/report/dpdk_performance_tests/comparisons/current_vs_previous_release.rst b/docs/report/dpdk_performance_tests/comparisons/current_vs_previous_release.rst
deleted file mode 100644
index bf59bb2bea..0000000000
--- a/docs/report/dpdk_performance_tests/comparisons/current_vs_previous_release.rst
+++ /dev/null
@@ -1,215 +0,0 @@
-
-.. _dpdk_compare_current_vs_previous_release:
-
-Current vs Previous Release
----------------------------
-
-Relative comparison of DPDK Testpmd and L3fwd packet throughput (NDR,
-PDR and MRR) between |dpdk-release| and |dpdk-release-1| (measured for
-|csit-release| and |csit-release-1| respectively) is calculated from
-results of tests running on 3-Node Intel Xeon Haswell testbeds (3n-hsw)
-in 1-core and 2-core configurations.
-
-Listed mean and standard deviation values are computed based on a series
-of the same tests executed against respective DPDK releases to verify
-test results repeatability, with percentage change calculated for mean
-values.
-
-.. note::
-
- Test results have been generated by
- `FD.io test executor dpdk performance job 3n-hsw`_,
- `FD.io test executor dpdk performance job 3n-skx`_,
- `FD.io test executor dpdk performance job 2n-skx`_,
- `FD.io test executor dpdk performance job 2n-clx`_,
- `FD.io test executor dpdk performance job 2n-zn2`_,
- `FD.io test executor dpdk performance job 3n-tsh`_,
- with RF result
- files csit-dpdk-perf-|srelease|-\*.zip
- `archived here <../../_static/archive/>`_.
-
-3n-hsw
-~~~~~~
-
-NDR Comparison
-``````````````
-
-Comparison tables in ASCII and CSV formats:
-
- - `ASCII 1t1c NDR comparison <../../_static/dpdk/performance-changes-3n-hsw-1t1c-ndr.txt>`_
- - `ASCII 2t2c NDR comparison <../../_static/dpdk/performance-changes-3n-hsw-2t2c-ndr.txt>`_
- - `CSV 1t1c NDR comparison <../../_static/dpdk/performance-changes-3n-hsw-1t1c-ndr.csv>`_
- - `CSV 2t2c NDR comparison <../../_static/dpdk/performance-changes-3n-hsw-2t2c-ndr.csv>`_
-
-PDR Comparison
-``````````````
-
-Comparison tables in ASCII and CSV formats:
-
- - `ASCII 1t1c PDR comparison <../../_static/dpdk/performance-changes-3n-hsw-1t1c-pdr.txt>`_
- - `ASCII 2t2c PDR comparison <../../_static/dpdk/performance-changes-3n-hsw-2t2c-pdr.txt>`_
- - `CSV 1t1c PDR comparison <../../_static/dpdk/performance-changes-3n-hsw-1t1c-pdr.csv>`_
- - `CSV 2t2c PDR comparison <../../_static/dpdk/performance-changes-3n-hsw-2t2c-pdr.csv>`_
-
-3n-skx
-~~~~~~
-
-NDR Comparison
-``````````````
-
-Comparison tables in ASCII and CSV formats:
-
- - `ASCII 2t1c NDR comparison <../../_static/dpdk/performance-changes-3n-skx-2t1c-ndr.txt>`_
- - `ASCII 4t1c NDR comparison <../../_static/dpdk/performance-changes-3n-skx-4t2c-ndr.txt>`_
- - `CSV 2t1c NDR comparison <../../_static/dpdk/performance-changes-3n-skx-2t1c-ndr.csv>`_
- - `CSV 4t1c NDR comparison <../../_static/dpdk/performance-changes-3n-skx-4t2c-ndr.csv>`_
-
-PDR Comparison
-``````````````
-
-Comparison tables in ASCII and CSV formats:
-
- - `ASCII 2t1c PDR comparison <../../_static/dpdk/performance-changes-3n-skx-2t1c-pdr.txt>`_
- - `ASCII 4t1c PDR comparison <../../_static/dpdk/performance-changes-3n-skx-4t2c-pdr.txt>`_
- - `CSV 2t1c PDR comparison <../../_static/dpdk/performance-changes-3n-skx-2t1c-pdr.csv>`_
- - `CSV 4t1c PDR comparison <../../_static/dpdk/performance-changes-3n-skx-4t2c-pdr.csv>`_
-
-2n-skx
-~~~~~~
-
-NDR Comparison
-``````````````
-
-Comparison tables in ASCII and CSV formats:
-
- - `ASCII 2t1c NDR comparison <../../_static/dpdk/performance-changes-2n-skx-2t1c-ndr.txt>`_
- - `ASCII 4t1c NDR comparison <../../_static/dpdk/performance-changes-2n-skx-4t2c-ndr.txt>`_
- - `CSV 2t1c NDR comparison <../../_static/dpdk/performance-changes-2n-skx-2t1c-ndr.csv>`_
- - `CSV 4t1c NDR comparison <../../_static/dpdk/performance-changes-2n-skx-4t2c-ndr.csv>`_
-
-PDR Comparison
-``````````````
-
-Comparison tables in ASCII and CSV formats:
-
- - `ASCII 2t1c PDR comparison <../../_static/dpdk/performance-changes-2n-skx-2t1c-pdr.txt>`_
- - `ASCII 4t1c PDR comparison <../../_static/dpdk/performance-changes-2n-skx-4t2c-pdr.txt>`_
- - `CSV 2t1c PDR comparison <../../_static/dpdk/performance-changes-2n-skx-2t1c-pdr.csv>`_
- - `CSV 4t1c PDR comparison <../../_static/dpdk/performance-changes-2n-skx-4t2c-pdr.csv>`_
-
-2n-clx
-~~~~~~
-
-NDR Comparison
-``````````````
-
-Comparison tables in ASCII and CSV formats:
-
- - `ASCII 2t1c NDR comparison <../../_static/dpdk/performance-changes-2n-clx-2t1c-ndr.txt>`_
- - `ASCII 4t1c NDR comparison <../../_static/dpdk/performance-changes-2n-clx-4t2c-ndr.txt>`_
- - `CSV 2t1c NDR comparison <../../_static/dpdk/performance-changes-2n-clx-2t1c-ndr.csv>`_
- - `CSV 4t1c NDR comparison <../../_static/dpdk/performance-changes-2n-clx-4t2c-ndr.csv>`_
-
-PDR Comparison
-``````````````
-
-Comparison tables in ASCII and CSV formats:
-
- - `ASCII 2t1c PDR comparison <../../_static/dpdk/performance-changes-2n-clx-2t1c-pdr.txt>`_
- - `ASCII 4t1c PDR comparison <../../_static/dpdk/performance-changes-2n-clx-4t2c-pdr.txt>`_
- - `CSV 2t1c PDR comparison <../../_static/dpdk/performance-changes-2n-clx-2t1c-pdr.csv>`_
- - `CSV 4t1c PDR comparison <../../_static/dpdk/performance-changes-2n-clx-4t2c-pdr.csv>`_
-
-2n-zn2
-~~~~~~
-
-NDR Comparison
-``````````````
-
-Comparison tables in ASCII and CSV formats:
-
- - `ASCII 2t1c NDR comparison <../../_static/dpdk/performance-changes-2n-zn2-2t1c-ndr.txt>`_
- - `ASCII 4t1c NDR comparison <../../_static/dpdk/performance-changes-2n-zn2-4t2c-ndr.txt>`_
- - `CSV 2t1c NDR comparison <../../_static/dpdk/performance-changes-2n-zn2-2t1c-ndr.csv>`_
- - `CSV 4t1c NDR comparison <../../_static/dpdk/performance-changes-2n-zn2-4t2c-ndr.csv>`_
-
-PDR Comparison
-``````````````
-
-Comparison tables in ASCII and CSV formats:
-
- - `ASCII 2t1c PDR comparison <../../_static/dpdk/performance-changes-2n-zn2-2t1c-pdr.txt>`_
- - `ASCII 4t1c PDR comparison <../../_static/dpdk/performance-changes-2n-zn2-4t2c-pdr.txt>`_
- - `CSV 2t1c PDR comparison <../../_static/dpdk/performance-changes-2n-zn2-2t1c-pdr.csv>`_
- - `CSV 4t1c PDR comparison <../../_static/dpdk/performance-changes-2n-zn2-4t2c-pdr.csv>`_
-
-..
- 2n-dnv
- ~~~~~~
-
- NDR Comparison
- ``````````````
-
- Comparison tables in ASCII and CSV formats:
-
- - `ASCII 1t1c NDR comparison <../../_static/dpdk/performance-changes-2n-dnv-1t1c-ndr.txt>`_
- - `ASCII 4t1c NDR comparison <../../_static/dpdk/performance-changes-2n-dnv-2t2c-ndr.txt>`_
- - `CSV 1t1c NDR comparison <../../_static/dpdk/performance-changes-2n-dnv-1t1c-ndr.csv>`_
- - `CSV 4t1c NDR comparison <../../_static/dpdk/performance-changes-2n-dnv-2t2c-ndr.csv>`_
-
- PDR Comparison
- ``````````````
-
- Comparison tables in ASCII and CSV formats:
-
- - `ASCII 1t1c PDR comparison <../../_static/dpdk/performance-changes-2n-dnv-1t1c-pdr.txt>`_
- - `ASCII 4t1c PDR comparison <../../_static/dpdk/performance-changes-2n-dnv-2t2c-pdr.txt>`_
- - `CSV 1t1c PDR comparison <../../_static/dpdk/performance-changes-2n-dnv-1t1c-pdr.csv>`_
- - `CSV 4t1c PDR comparison <../../_static/dpdk/performance-changes-2n-dnv-2t2c-pdr.csv>`_
-
- 3n-dnv
- ~~~~~~
-
- NDR Comparison
- ``````````````
-
- Comparison tables in ASCII and CSV formats:
-
- - `ASCII 1t1c NDR comparison <../../_static/dpdk/performance-changes-3n-dnv-1t1c-ndr.txt>`_
- - `ASCII 4t1c NDR comparison <../../_static/dpdk/performance-changes-3n-dnv-2t2c-ndr.txt>`_
- - `CSV 1t1c NDR comparison <../../_static/dpdk/performance-changes-3n-dnv-1t1c-ndr.csv>`_
- - `CSV 4t1c NDR comparison <../../_static/dpdk/performance-changes-3n-dnv-2t2c-ndr.csv>`_
-
- PDR Comparison
- ``````````````
-
- Comparison tables in ASCII and CSV formats:
-
- - `ASCII 1t1c PDR comparison <../../_static/dpdk/performance-changes-3n-dnv-1t1c-pdr.txt>`_
- - `ASCII 4t1c PDR comparison <../../_static/dpdk/performance-changes-3n-dnv-2t2c-pdr.txt>`_
- - `CSV 1t1c PDR comparison <../../_static/dpdk/performance-changes-3n-dnv-1t1c-pdr.csv>`_
- - `CSV 4t1c PDR comparison <../../_static/dpdk/performance-changes-3n-dnv-2t2c-pdr.csv>`_
-
-..
- 3n-tsh
- ~~~~~~
-
- NDR Comparison
- ``````````````
-
- Comparison tables in ASCII and CSV formats:
-
- - `ASCII 1t1c NDR comparison <../../_static/dpdk/performance-changes-3n-tsh-1t1c-ndr.txt>`_
- - `ASCII 4t1c NDR comparison <../../_static/dpdk/performance-changes-3n-tsh-2t2c-ndr.txt>`_
- - `CSV 1t1c NDR comparison <../../_static/dpdk/performance-changes-3n-tsh-1t1c-ndr.csv>`_
- - `CSV 4t1c NDR comparison <../../_static/dpdk/performance-changes-3n-tsh-2t2c-ndr.csv>`_
-
- PDR Comparison
- ``````````````
-
- Comparison tables in ASCII and CSV formats:
-
- - `ASCII 1t1c PDR comparison <../../_static/dpdk/performance-changes-3n-tsh-1t1c-pdr.txt>`_
- - `ASCII 4t1c PDR comparison <../../_static/dpdk/performance-changes-3n-tsh-2t2c-pdr.txt>`_
- - `CSV 1t1c PDR comparison <../../_static/dpdk/performance-changes-3n-tsh-1t1c-pdr.csv>`_
- - `CSV 4t1c PDR comparison <../../_static/dpdk/performance-changes-3n-tsh-2t2c-pdr.csv>`_
diff --git a/docs/report/dpdk_performance_tests/comparisons/index.rst b/docs/report/dpdk_performance_tests/comparisons/index.rst
deleted file mode 100644
index 3e0d3f932b..0000000000
--- a/docs/report/dpdk_performance_tests/comparisons/index.rst
+++ /dev/null
@@ -1,27 +0,0 @@
-
-.. raw:: latex
-
- \clearpage
-
-Comparisons
-===========
-
-..
- // Alternative Note for 1st Bullet when bad microcode Skx, Clx results are published
- note::
- L3fwd throughput drop in the current release in comparison to previous
- releases **on Intel Xeon 2n-skx, 3n-skx and 2n-clx testbeds**: L3fwd
- performance test data shows lower performance and behaviour
- inconsistency of these systems following the recent upgrade of
- processor microcode packages (skx ucode 0x2000064, clx ucode
- 0x500002c) as part of updating Ubuntu 18.04 LTS kernel version.
- Tested VPP and DPDK applications (L3fwd) are affected. Skx and Clx
- test data will be corrected in subsequent maintenance report
- version(s) once the issue is resolved. See :ref:`vpp_known_issues`.
-
-.. toctree::
-
- current_vs_previous_release
- 2n-skx_vs_2n-clx_testbeds
- 3n-skx_vs_3n-hsw_testbeds
- 3n-skx_vs_2n-skx_testbeds