diff options
| author |   Tibor Frank <tifrank@cisco.com> | 2022-06-29 16:38:49 +0200 |
|---|---|---|
| committer | Tibor Frank <tifrank@cisco.com> | 2022-07-01 12:17:15 +0000 |
| commit | c16c43b84b00ac6698b7f3214910d4c11d77befb (patch) | |
| tree | 488ef2d0fae95718f7fbb804f2f2acfcdaf24815 | |
| parent | 4a46873243d619cc2987ec5a5f07669b6afb8dab (diff) | |
Report: Comparison tables
- normalization
- table headers
- legend
Change-Id: Ie095a84b7a62481d01fa5ece7c9da7f320d6d5c9
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 55cad0badce981ec3f0b544e687d898eba689368)
17 files changed, 1211 insertions, 2168 deletions
diff --git a/docs/report/dpdk_performance_tests/comparisons_norm/2n-clx_vs_2n-icx_testbeds.rst b/docs/report/dpdk_performance_tests/comparisons_norm/2n-clx_vs_2n-icx_testbeds.rst deleted file mode 100644 index 21e0a3b69f..0000000000 --- a/docs/report/dpdk_performance_tests/comparisons_norm/2n-clx_vs_2n-icx_testbeds.rst +++ /dev/null @@ -1,31 +0,0 @@ -2n-Icx vs 2n-Clx Testbeds -------------------------- - -Relative normalized comparison of |dpdk-release| Testpmd and L3fwd packet -throughput (NDR, PDR) is calculated for the same tests executed -on 2-Node Cascadelake (2n-clx) and 2-Node Ice Lake (2n-icx) physical testbed -types, in 1-core, 2-core and 4-core configurations. - -.. note:: - - Test results are stored in - `build logs from FD.io dpdk performance job 2n-clx`_ and - `build logs from FD.io dpdk performance job 2n-icx`_ - with RF result files csit-dpdk-perf-|srelease|-\*.zip - `archived here <../../_static/archive/>`_. - -NDR Comparison -~~~~~~~~~~~~~~ - -Comparison tables in ASCII and CSV formats: - - - `ASCII NDR comparison <../../_static/dpdk/norm-compare-testbeds-2n-clx-2n-icx-ndr.txt>`_ - - `CSV NDR comparison <../../_static/dpdk/norm-compare-testbeds-2n-clx-2n-icx-ndr.csv>`_ - -PDR Comparison -~~~~~~~~~~~~~~ - -Comparison tables in ASCII and CSV formats: - - - `ASCII PDR comparison <../../_static/dpdk/norm-compare-testbeds-2n-clx-2n-icx-pdr.txt>`_ - - `CSV PDR comparison <../../_static/dpdk/norm-compare-testbeds-2n-clx-2n-icx-pdr.csv>`_ diff --git a/docs/report/dpdk_performance_tests/comparisons_norm/2n-icx_vs_2n-skx_testbeds.rst b/docs/report/dpdk_performance_tests/comparisons_norm/2n-icx_vs_2n-skx_testbeds.rst deleted file mode 100644 index 7eb0da55fc..0000000000 --- a/docs/report/dpdk_performance_tests/comparisons_norm/2n-icx_vs_2n-skx_testbeds.rst +++ /dev/null @@ -1,31 +0,0 @@ -2n-Icx vs 2n-Skx Testbeds -------------------------- - -Relative normalized comparison of |dpdk-release| Testpmd and L3fwd packet -throughput (NDR, PDR) is calculated for the same tests executed -on 2-Node Cascadelake (2n-skx) and 2-Node Ice Lake (2n-icx) physical testbed -types, in 1-core, 2-core and 4-core configurations. - -.. note:: - - Test results are stored in - `build logs from FD.io dpdk performance job 2n-skx`_ and - `build logs from FD.io dpdk performance job 2n-icx`_ - with RF result files csit-dpdk-perf-|srelease|-\*.zip - `archived here <../../_static/archive/>`_. - -NDR Comparison -~~~~~~~~~~~~~~ - -Comparison tables in ASCII and CSV formats: - - - `ASCII NDR comparison <../../_static/dpdk/norm-compare-testbeds-2n-skx-2n-icx-ndr.txt>`_ - - `CSV NDR comparison <../../_static/dpdk/norm-compare-testbeds-2n-skx-2n-icx-ndr.csv>`_ - -PDR Comparison -~~~~~~~~~~~~~~ - -Comparison tables in ASCII and CSV formats: - - - `ASCII PDR comparison <../../_static/dpdk/norm-compare-testbeds-2n-skx-2n-icx-pdr.txt>`_ - - `CSV PDR comparison <../../_static/dpdk/norm-compare-testbeds-2n-skx-2n-icx-pdr.csv>`_ diff --git a/docs/report/dpdk_performance_tests/comparisons_norm/2n-skx_vs_2n-clx_testbeds.rst b/docs/report/dpdk_performance_tests/comparisons_norm/2n-skx_vs_2n-clx_testbeds.rst deleted file mode 100644 index 247287852d..0000000000 --- a/docs/report/dpdk_performance_tests/comparisons_norm/2n-skx_vs_2n-clx_testbeds.rst +++ /dev/null @@ -1,31 +0,0 @@ -2n-Clx vs 2n-Skx Testbeds -------------------------- - -Relative normalized comparison of |dpdk-release| Testpmd and L3fwd packet -throughput (NDR, PDR) is calculated for the same tests executed -on 2-Node Skylake (2n-skx) and 2-Node Cascade Lake (2n-clx) physical testbed -types, in 1-core, 2-core and 4-core configurations. - -.. note:: - - Test results are stored in - `build logs from FD.io dpdk performance job 2n-skx`_ and - `build logs from FD.io dpdk performance job 2n-clx`_ - with RF result files csit-dpdk-perf-|srelease|-\*.zip - `archived here <../../_static/archive/>`_. - -NDR Comparison -~~~~~~~~~~~~~~ - -Comparison tables in ASCII and CSV formats: - - - `ASCII NDR comparison <../../_static/dpdk/norm-compare-testbeds-2n-skx-2n-clx-ndr.txt>`_ - - `CSV NDR comparison <../../_static/dpdk/norm-compare-testbeds-2n-skx-2n-clx-ndr.csv>`_ - -PDR Comparison -~~~~~~~~~~~~~~ - -Comparison tables in ASCII and CSV formats: - - - `ASCII PDR comparison <../../_static/dpdk/norm-compare-testbeds-2n-skx-2n-clx-pdr.txt>`_ - - `CSV PDR comparison <../../_static/dpdk/norm-compare-testbeds-2n-skx-2n-clx-pdr.csv>`_ diff --git a/docs/report/dpdk_performance_tests/comparisons_norm/3n-skx_vs_2n-skx_testbeds.rst b/docs/report/dpdk_performance_tests/comparisons_norm/3n-skx_vs_2n-skx_testbeds.rst deleted file mode 100644 index 1f82825a28..0000000000 --- a/docs/report/dpdk_performance_tests/comparisons_norm/3n-skx_vs_2n-skx_testbeds.rst +++ /dev/null @@ -1,32 +0,0 @@ -3n-Skx vs 2n-Skx Testbeds -------------------------- - -Relative normalized comparison of |dpdk-release| Testpmd and L3fwd packet -throughput (NDR, PDR) is calculated for the same tests executed -on 3-Node Skylake (3n-skx) and 2-Node Skylake (2n-skx) physical testbed -types, in 1-core, 2-core and 4-core configurations. - -.. note:: - - Test results are stored in - `build logs from FD.io dpdk performance job 3n-skx`_ and - `build logs from FD.io dpdk performance job 2n-skx`_ - with RF result - files csit-dpdk-perf-|srelease|-\*.zip - `archived here <../../_static/archive/>`_. - -NDR Comparison -~~~~~~~~~~~~~~ - -Comparison tables in ASCII and CSV formats: - - - `ASCII NDR comparison <../../_static/dpdk/norm-compare-topologies-3n-skx-2n-skx-ndr.txt>`_ - - `CSV NDR comparison <../../_static/dpdk/norm-compare-topologies-3n-skx-2n-skx-ndr.csv>`_ - -PDR Comparison -~~~~~~~~~~~~~~ - -Comparison tables in ASCII and CSV formats: - - - `ASCII PDR comparison <../../_static/dpdk/norm-compare-topologies-3n-skx-2n-skx-pdr.txt>`_ - - `CSV PDR comparison <../../_static/dpdk/norm-compare-topologies-3n-skx-2n-skx-pdr.csv>`_ diff --git a/docs/report/dpdk_performance_tests/comparisons_norm/3n-skx_vs_3n-icx_testbeds.rst b/docs/report/dpdk_performance_tests/comparisons_norm/3n-skx_vs_3n-icx_testbeds.rst deleted file mode 100644 index 87884e2cdf..0000000000 --- a/docs/report/dpdk_performance_tests/comparisons_norm/3n-skx_vs_3n-icx_testbeds.rst +++ /dev/null @@ -1,31 +0,0 @@ -3n-Icx vs 3n-Skx Testbeds -------------------------- - -Relative normalized comparison of |dpdk-release| Testpmd and L3fwd packet -throughput (NDR, PDR) is calculated for the same tests executed -on 3-Node Skylake (3n-skx) and 3-Node Ice Lake (3n-icx) physical testbed -types, in 1-core, 2-core and 4-core configurations. - -.. note:: - - Test results are stored in - `build logs from FD.io dpdk performance job 3n-skx`_ and - `build logs from FD.io dpdk performance job 3n-icx`_ - with RF result files csit-dpdk-perf-|srelease|-\*.zip - `archived here <../../_static/archive/>`_. - -NDR Comparison -~~~~~~~~~~~~~~ - -Comparison tables in ASCII and CSV formats: - - - `ASCII NDR comparison <../../_static/dpdk/norm-compare-testbeds-3n-skx-3n-icx-ndr.txt>`_ - - `CSV NDR comparison <../../_static/dpdk/norm-compare-testbeds-3n-skx-3n-icx-ndr.csv>`_ - -PDR Comparison -~~~~~~~~~~~~~~ - -Comparison tables in ASCII and CSV formats: - - - `ASCII PDR comparison <../../_static/dpdk/norm-compare-testbeds-3n-skx-3n-icx-pdr.txt>`_ - - `CSV PDR comparison <../../_static/dpdk/norm-compare-testbeds-3n-skx-3n-icx-pdr.csv>`_ diff --git a/docs/report/dpdk_performance_tests/comparisons_norm/index.rst b/docs/report/dpdk_performance_tests/comparisons_norm/index.rst deleted file mode 100644 index 3a814240fa..0000000000 --- a/docs/report/dpdk_performance_tests/comparisons_norm/index.rst +++ /dev/null @@ -1,17 +0,0 @@ - -.. raw:: latex - - \clearpage - -Normalized Comparisons -====================== - -All values in this section are normalized to CPU frequency 2GHz. - -.. toctree:: - - 2n-clx_vs_2n-icx_testbeds - 2n-icx_vs_2n-skx_testbeds - 3n-skx_vs_3n-icx_testbeds - 2n-skx_vs_2n-clx_testbeds - 3n-skx_vs_2n-skx_testbeds diff --git a/docs/report/dpdk_performance_tests/index.rst b/docs/report/dpdk_performance_tests/index.rst index d0bb18d0b4..01b27235be 100644 --- a/docs/report/dpdk_performance_tests/index.rst +++ b/docs/report/dpdk_performance_tests/index.rst @@ -9,6 +9,5 @@ DPDK Performance throughput_speedup_multi_core/index packet_latency/index comparisons/index - comparisons_norm/index throughput_trending test_environment diff --git a/docs/report/index.html.template b/docs/report/index.html.template index 88945a646a..8091ab7dcc 100644 --- a/docs/report/index.html.template +++ b/docs/report/index.html.template @@ -27,7 +27,6 @@ CSIT-2206 vpp_performance_tests/hoststack_testing/index vpp_performance_tests/gso_testing/index vpp_performance_tests/comparisons/index - vpp_performance_tests/comparisons_norm/index vpp_performance_tests/throughput_trending vpp_performance_tests/test_environment @@ -41,7 +40,6 @@ CSIT-2206 dpdk_performance_tests/throughput_speedup_multi_core/index dpdk_performance_tests/packet_latency/index dpdk_performance_tests/comparisons/index - dpdk_performance_tests/comparisons_norm/index dpdk_performance_tests/throughput_trending dpdk_performance_tests/test_environment diff --git a/docs/report/vpp_performance_tests/comparisons_norm/2n-clx_vs_2n-icx_testbeds.rst b/docs/report/vpp_performance_tests/comparisons_norm/2n-clx_vs_2n-icx_testbeds.rst deleted file mode 100644 index 8db3d6632f..0000000000 --- a/docs/report/vpp_performance_tests/comparisons_norm/2n-clx_vs_2n-icx_testbeds.rst +++ /dev/null @@ -1,55 +0,0 @@ -2n-Icx vs 2n-Clx Testbeds -------------------------- - -Relative normalized comparison of |vpp-release| packet throughput (NDR, PDR and -MRR) is calculated for the same tests executed on 2-Node Cascadelake (2n- -clx) and 2-Node Icelake (2n-icx) physical testbed types, in 1-core, -2-core and 4-core configurations. - -.. note:: - - Test results are stored in - `build logs from FD.io vpp performance job 2n-icx`_ and - `build logs from FD.io vpp performance job 2n-clx`_ - with RF result - files csit-vpp-perf-|srelease|-\*.zip - `archived here <../../_static/archive/>`_. - -NDR Comparison -~~~~~~~~~~~~~~ - -Comparison tables in HTML, ASCII and CSV formats: - - - `HTML 1c NDR comparison <norm-compare-testbeds-2n-clx-2n-icx-1c-ndr.html>`_ - - `HTML 2c NDR comparison <norm-compare-testbeds-2n-clx-2n-icx-2c-ndr.html>`_ - - `ASCII 1c NDR comparison <../../_static/vpp/norm-compare-testbeds-2n-clx-2n-icx-1c-ndr.txt>`_ - - `ASCII 2c NDR comparison <../../_static/vpp/norm-compare-testbeds-2n-clx-2n-icx-2c-ndr.txt>`_ - - `CSV 1c NDR comparison <../../_static/vpp/norm-compare-testbeds-2n-clx-2n-icx-1c-ndr-csv.csv>`_ - - `CSV 2c NDR comparison <../../_static/vpp/norm-compare-testbeds-2n-clx-2n-icx-2c-ndr-csv.csv>`_ - -PDR Comparison -~~~~~~~~~~~~~~ - -Comparison tables in HTML, ASCII and CSV formats: - - - `HTML 1c PDR comparison <norm-compare-testbeds-2n-clx-2n-icx-1c-pdr.html>`_ - - `HTML 2c PDR comparison <norm-compare-testbeds-2n-clx-2n-icx-2c-pdr.html>`_ - - `ASCII 1c PDR comparison <../../_static/vpp/norm-compare-testbeds-2n-clx-2n-icx-1c-pdr.txt>`_ - - `ASCII 2c PDR comparison <../../_static/vpp/norm-compare-testbeds-2n-clx-2n-icx-2c-pdr.txt>`_ - - `CSV 1c PDR comparison <../../_static/vpp/norm-compare-testbeds-2n-clx-2n-icx-1c-pdr-csv.csv>`_ - - `CSV 2c PDR comparison <../../_static/vpp/norm-compare-testbeds-2n-clx-2n-icx-2c-pdr-csv.csv>`_ - -MRR Comparison -~~~~~~~~~~~~~~ - -Comparison tables in HTML, ASCII and CSV formats: - - - `HTML 1c MRR comparison <norm-compare-testbeds-2n-clx-2n-icx-1c-mrr.html>`_ - - `HTML 2c MRR comparison <norm-compare-testbeds-2n-clx-2n-icx-2c-mrr.html>`_ - - `HTML 4c MRR comparison <norm-compare-testbeds-2n-clx-2n-icx-4c-mrr.html>`_ - - `ASCII 1c MRR comparison <../../_static/vpp/norm-compare-testbeds-2n-clx-2n-icx-1c-mrr.txt>`_ - - `ASCII 2c MRR comparison <../../_static/vpp/norm-compare-testbeds-2n-clx-2n-icx-2c-mrr.txt>`_ - - `ASCII 4c MRR comparison <../../_static/vpp/norm-compare-testbeds-2n-clx-2n-icx-4c-mrr.txt>`_ - - `CSV 1c MRR comparison <../../_static/vpp/norm-compare-testbeds-2n-clx-2n-icx-1c-mrr-csv.csv>`_ - - `CSV 2c MRR comparison <../../_static/vpp/norm-compare-testbeds-2n-clx-2n-icx-2c-mrr-csv.csv>`_ - - `CSV 4c MRR comparison <../../_static/vpp/norm-compare-testbeds-2n-clx-2n-icx-4c-mrr-csv.csv>`_ diff --git a/docs/report/vpp_performance_tests/comparisons_norm/2n-icx_vs_2n-skx_testbeds.rst b/docs/report/vpp_performance_tests/comparisons_norm/2n-icx_vs_2n-skx_testbeds.rst deleted file mode 100644 index 8e69eddeac..0000000000 --- a/docs/report/vpp_performance_tests/comparisons_norm/2n-icx_vs_2n-skx_testbeds.rst +++ /dev/null @@ -1,54 +0,0 @@ -2n-Icx vs 2n-Skx Testbeds -------------------------- - -Relative normalized comparison of |vpp-release| packet throughput (NDR, PDR and -MRR) is calculated for the same tests executed on 2-Node Cascadelake (2n- -skx) and 2-Node Icelake (2n-icx) physical testbed types, in 1-core, -2-core and 4-core configurations. - -.. note:: - - Test results are stored in - `build logs from FD.io vpp performance job 2n-icx`_ and - `build logs from FD.io vpp performance job 2n-skx`_ - with RF result files csit-vpp-perf-|srelease|-\*.zip - `archived here <../../_static/archive/>`_. - -NDR Comparison -~~~~~~~~~~~~~~ - -Comparison tables in HTML, ASCII and CSV formats: - - - `HTML 1c NDR comparison <norm-compare-testbeds-2n-skx-2n-icx-1c-ndr.html>`_ - - `HTML 2c NDR comparison <norm-compare-testbeds-2n-skx-2n-icx-2c-ndr.html>`_ - - `ASCII 1c NDR comparison <../../_static/vpp/norm-compare-testbeds-2n-skx-2n-icx-1c-ndr.txt>`_ - - `ASCII 2c NDR comparison <../../_static/vpp/norm-compare-testbeds-2n-skx-2n-icx-2c-ndr.txt>`_ - - `CSV 1c NDR comparison <../../_static/vpp/norm-compare-testbeds-2n-skx-2n-icx-1c-ndr-csv.csv>`_ - - `CSV 2c NDR comparison <../../_static/vpp/norm-compare-testbeds-2n-skx-2n-icx-2c-ndr-csv.csv>`_ - -PDR Comparison -~~~~~~~~~~~~~~ - -Comparison tables in HTML, ASCII and CSV formats: - - - `HTML 1c PDR comparison <norm-compare-testbeds-2n-skx-2n-icx-1c-pdr.html>`_ - - `HTML 2c PDR comparison <norm-compare-testbeds-2n-skx-2n-icx-2c-pdr.html>`_ - - `ASCII 1c PDR comparison <../../_static/vpp/norm-compare-testbeds-2n-skx-2n-icx-1c-pdr.txt>`_ - - `ASCII 2c PDR comparison <../../_static/vpp/norm-compare-testbeds-2n-skx-2n-icx-2c-pdr.txt>`_ - - `CSV 1c PDR comparison <../../_static/vpp/norm-compare-testbeds-2n-skx-2n-icx-1c-pdr-csv.csv>`_ - - `CSV 2c PDR comparison <../../_static/vpp/norm-compare-testbeds-2n-skx-2n-icx-2c-pdr-csv.csv>`_ - -MRR Comparison -~~~~~~~~~~~~~~ - -Comparison tables in HTML, ASCII and CSV formats: - - - `HTML 1c MRR comparison <norm-compare-testbeds-2n-skx-2n-icx-1c-mrr.html>`_ - - `HTML 2c MRR comparison <norm-compare-testbeds-2n-skx-2n-icx-2c-mrr.html>`_ - - `HTML 4c MRR comparison <norm-compare-testbeds-2n-skx-2n-icx-4c-mrr.html>`_ - - `ASCII 1c MRR comparison <../../_static/vpp/norm-compare-testbeds-2n-skx-2n-icx-1c-mrr.txt>`_ - - `ASCII 2c MRR comparison <../../_static/vpp/norm-compare-testbeds-2n-skx-2n-icx-2c-mrr.txt>`_ - - `ASCII 4c MRR comparison <../../_static/vpp/norm-compare-testbeds-2n-skx-2n-icx-4c-mrr.txt>`_ - - `CSV 1c MRR comparison <../../_static/vpp/norm-compare-testbeds-2n-skx-2n-icx-1c-mrr-csv.csv>`_ - - `CSV 2c MRR comparison <../../_static/vpp/norm-compare-testbeds-2n-skx-2n-icx-2c-mrr-csv.csv>`_ - - `CSV 4c MRR comparison <../../_static/vpp/norm-compare-testbeds-2n-skx-2n-icx-4c-mrr-csv.csv>`_ diff --git a/docs/report/vpp_performance_tests/comparisons_norm/2n-skx_vs_2n-clx_testbeds.rst b/docs/report/vpp_performance_tests/comparisons_norm/2n-skx_vs_2n-clx_testbeds.rst deleted file mode 100644 index 5791c79803..0000000000 --- a/docs/report/vpp_performance_tests/comparisons_norm/2n-skx_vs_2n-clx_testbeds.rst +++ /dev/null @@ -1,54 +0,0 @@ -2n-Clx vs 2n-Skx Testbeds -------------------------- - -Relative normalized comparison of |vpp-release| packet throughput (NDR, PDR and -MRR) is calculated for the same tests executed on 2-Node Skylake (2n- -skx) and 2-Node Cascade Lake (2n-clx) physical testbed types, in 1-core, -2-core and 4-core configurations. - -.. note:: - - Test results are stored in - `build logs from FD.io vpp performance job 2n-skx`_ and - `build logs from FD.io vpp performance job 2n-clx`_ - with RF result files csit-vpp-perf-|srelease|-\*.zip - `archived here <../../_static/archive/>`_. - -NDR Comparison -~~~~~~~~~~~~~~ - -Comparison tables in HTML, ASCII and CSV formats: - - - `HTML 1c NDR comparison <norm-compare-testbeds-2n-skx-2n-clx-2t1c-ndr.html>`_ - - `HTML 2c NDR comparison <norm-compare-testbeds-2n-skx-2n-clx-4t2c-ndr.html>`_ - - `ASCII 1c NDR comparison <../../_static/vpp/norm-compare-testbeds-2n-skx-2n-clx-2t1c-ndr.txt>`_ - - `ASCII 2c NDR comparison <../../_static/vpp/norm-compare-testbeds-2n-skx-2n-clx-4t2c-ndr.txt>`_ - - `CSV 1c NDR comparison <../../_static/vpp/norm-compare-testbeds-2n-skx-2n-clx-2t1c-ndr-csv.csv>`_ - - `CSV 2c NDR comparison <../../_static/vpp/norm-compare-testbeds-2n-skx-2n-clx-4t2c-ndr-csv.csv>`_ - -PDR Comparison -~~~~~~~~~~~~~~ - -Comparison tables in HTML, ASCII and CSV formats: - - - `HTML 1c PDR comparison <norm-compare-testbeds-2n-skx-2n-clx-2t1c-pdr.html>`_ - - `HTML 2c PDR comparison <norm-compare-testbeds-2n-skx-2n-clx-4t2c-pdr.html>`_ - - `ASCII 1c PDR comparison <../../_static/vpp/norm-compare-testbeds-2n-skx-2n-clx-2t1c-pdr.txt>`_ - - `ASCII 2c PDR comparison <../../_static/vpp/norm-compare-testbeds-2n-skx-2n-clx-4t2c-pdr.txt>`_ - - `CSV 1c PDR comparison <../../_static/vpp/norm-compare-testbeds-2n-skx-2n-clx-2t1c-pdr-csv.csv>`_ - - `CSV 2c PDR comparison <../../_static/vpp/norm-compare-testbeds-2n-skx-2n-clx-4t2c-pdr-csv.csv>`_ - -MRR Comparison -~~~~~~~~~~~~~~ - -Comparison tables in HTML, ASCII and CSV formats: - - - `HTML 1c MRR comparison <norm-compare-testbeds-2n-skx-2n-clx-2t1c-mrr.html>`_ - - `HTML 2c MRR comparison <norm-compare-testbeds-2n-skx-2n-clx-4t2c-mrr.html>`_ - - `HTML 4c MRR comparison <norm-compare-testbeds-2n-skx-2n-clx-8t4c-mrr.html>`_ - - `ASCII 1c MRR comparison <../../_static/vpp/norm-compare-testbeds-2n-skx-2n-clx-2t1c-mrr.txt>`_ - - `ASCII 2c MRR comparison <../../_static/vpp/norm-compare-testbeds-2n-skx-2n-clx-4t2c-mrr.txt>`_ - - `ASCII 4c MRR comparison <../../_static/vpp/norm-compare-testbeds-2n-skx-2n-clx-8t4c-mrr.txt>`_ - - `CSV 1c MRR comparison <../../_static/vpp/norm-compare-testbeds-2n-skx-2n-clx-2t1c-mrr-csv.csv>`_ - - `CSV 2c MRR comparison <../../_static/vpp/norm-compare-testbeds-2n-skx-2n-clx-4t2c-mrr-csv.csv>`_ - - `CSV 4c MRR comparison <../../_static/vpp/norm-compare-testbeds-2n-skx-2n-clx-8t4c-mrr-csv.csv>`_ diff --git a/docs/report/vpp_performance_tests/comparisons_norm/3n-skx_vs_2n-skx_testbeds.rst b/docs/report/vpp_performance_tests/comparisons_norm/3n-skx_vs_2n-skx_testbeds.rst deleted file mode 100644 index 2b309f75d5..0000000000 --- a/docs/report/vpp_performance_tests/comparisons_norm/3n-skx_vs_2n-skx_testbeds.rst +++ /dev/null @@ -1,55 +0,0 @@ -3n-Skx vs 2n-Skx Testbeds -------------------------- - -Relative normalized comparison of |vpp-release| packet throughput (NDR, PDR and -MRR) is calculated for the same tests executed on 3-Node Skylake (3n- -skx) and 2-Node Skylake (2n-skx) physical testbed types, in 1-core, -2-core and 4-core configurations. - -.. note:: - - Test results are stored in - `build logs from FD.io vpp performance job 3n-skx`_ and - `build logs from FD.io vpp performance job 2n-skx`_ - with RF result - files csit-vpp-perf-|srelease|-\*.zip - `archived here <../../_static/archive/>`_. - -NDR Comparison -~~~~~~~~~~~~~~ - -Comparison tables in HTML, ASCII and CSV formats: - - - `HTML 1c NDR comparison <norm-compare-topologies-3n-skx-2n-skx-1c-ndr.html>`_ - - `HTML 2c NDR comparison <norm-compare-topologies-3n-skx-2n-skx-2c-ndr.html>`_ - - `ASCII 1c NDR comparison <../../_static/vpp/norm-compare-topologies-3n-skx-2n-skx-1c-ndr.txt>`_ - - `ASCII 2c NDR comparison <../../_static/vpp/norm-compare-topologies-3n-skx-2n-skx-2c-ndr.txt>`_ - - `CSV 1c NDR comparison <../../_static/vpp/norm-compare-topologies-3n-skx-2n-skx-1c-ndr-csv.csv>`_ - - `CSV 2c NDR comparison <../../_static/vpp/norm-compare-topologies-3n-skx-2n-skx-2c-ndr-csv.csv>`_ - -PDR Comparison -~~~~~~~~~~~~~~ - -Comparison tables in HTML, ASCII and CSV formats: - - - `HTML 1c PDR comparison <norm-compare-topologies-3n-skx-2n-skx-1c-pdr.html>`_ - - `HTML 2c PDR comparison <norm-compare-topologies-3n-skx-2n-skx-2c-pdr.html>`_ - - `ASCII 1c PDR comparison <../../_static/vpp/norm-compare-topologies-3n-skx-2n-skx-1c-pdr.txt>`_ - - `ASCII 2c PDR comparison <../../_static/vpp/norm-compare-topologies-3n-skx-2n-skx-2c-pdr.txt>`_ - - `CSV 1c PDR comparison <../../_static/vpp/norm-compare-topologies-3n-skx-2n-skx-1c-pdr-csv.csv>`_ - - `CSV 2c PDR comparison <../../_static/vpp/norm-compare-topologies-3n-skx-2n-skx-2c-pdr-csv.csv>`_ - -MRR Comparison -~~~~~~~~~~~~~~ - -Comparison tables in HTML, ASCII and CSV formats: - - - `HTML 1c MRR comparison <norm-compare-topologies-3n-skx-2n-skx-1c-mrr.html>`_ - - `HTML 2c MRR comparison <norm-compare-topologies-3n-skx-2n-skx-2c-mrr.html>`_ - - `HTML 4c MRR comparison <norm-compare-topologies-3n-skx-2n-skx-4c-mrr.html>`_ - - `ASCII 1c MRR comparison <../../_static/vpp/norm-compare-topologies-3n-skx-2n-skx-1c-mrr.txt>`_ - - `ASCII 2c MRR comparison <../../_static/vpp/norm-compare-topologies-3n-skx-2n-skx-2c-mrr.txt>`_ - - `ASCII 4c MRR comparison <../../_static/vpp/norm-compare-topologies-3n-skx-2n-skx-4c-mrr.txt>`_ - - `CSV 1c MRR comparison <../../_static/vpp/norm-compare-topologies-3n-skx-2n-skx-1c-mrr-csv.csv>`_ - - `CSV 2c MRR comparison <../../_static/vpp/norm-compare-topologies-3n-skx-2n-skx-2c-mrr-csv.csv>`_ - - `CSV 4c MRR comparison <../../_static/vpp/norm-compare-topologies-3n-skx-2n-skx-4c-mrr-csv.csv>`_ diff --git a/docs/report/vpp_performance_tests/comparisons_norm/3n-skx_vs_3n-icx_testbeds.rst b/docs/report/vpp_performance_tests/comparisons_norm/3n-skx_vs_3n-icx_testbeds.rst deleted file mode 100644 index 8e2fb103cd..0000000000 --- a/docs/report/vpp_performance_tests/comparisons_norm/3n-skx_vs_3n-icx_testbeds.rst +++ /dev/null @@ -1,55 +0,0 @@ -3n-Icx vs 3n-Skx Testbeds -------------------------- - -Relative normalized comparison of |vpp-release| packet throughput (NDR, PDR and -MRR) is calculated for the same tests executed on 3-Node Skylake (3n- -skx) and 3-Node Icelake (3n-icx) physical testbed types, in 1-core, -2-core and 4-core configurations. - -.. note:: - - Test results are stored in - `build logs from FD.io vpp performance job 3n-skx`_ and - `build logs from FD.io vpp performance job 3n-icx`_ - with RF result - files csit-vpp-perf-|srelease|-\*.zip - `archived here <../../_static/archive/>`_. - -NDR Comparison -~~~~~~~~~~~~~~ - -Comparison tables in HTML, ASCII and CSV formats: - - - `HTML 1c NDR comparison <norm-compare-testbeds-3n-skx-3n-icx-1c-ndr.html>`_ - - `HTML 2c NDR comparison <norm-compare-testbeds-3n-skx-3n-icx-2c-ndr.html>`_ - - `ASCII 1c NDR comparison <../../_static/vpp/norm-compare-testbeds-3n-skx-3n-icx-1c-ndr.txt>`_ - - `ASCII 2c NDR comparison <../../_static/vpp/norm-compare-testbeds-3n-skx-3n-icx-2c-ndr.txt>`_ - - `CSV 1c NDR comparison <../../_static/vpp/norm-compare-testbeds-3n-skx-3n-icx-1c-ndr-csv.csv>`_ - - `CSV 2c NDR comparison <../../_static/vpp/norm-compare-testbeds-3n-skx-3n-icx-2c-ndr-csv.csv>`_ - -PDR Comparison -~~~~~~~~~~~~~~ - -Comparison tables in HTML, ASCII and CSV formats: - - - `HTML 1c PDR comparison <norm-compare-testbeds-3n-skx-3n-icx-1c-pdr.html>`_ - - `HTML 2c PDR comparison <norm-compare-testbeds-3n-skx-3n-icx-2c-pdr.html>`_ - - `ASCII 1c PDR comparison <../../_static/vpp/norm-compare-testbeds-3n-skx-3n-icx-1c-pdr.txt>`_ - - `ASCII 2c PDR comparison <../../_static/vpp/norm-compare-testbeds-3n-skx-3n-icx-2c-pdr.txt>`_ - - `CSV 1c PDR comparison <../../_static/vpp/norm-compare-testbeds-3n-skx-3n-icx-1c-pdr-csv.csv>`_ - - `CSV 2c PDR comparison <../../_static/vpp/norm-compare-testbeds-3n-skx-3n-icx-2c-pdr-csv.csv>`_ - -MRR Comparison -~~~~~~~~~~~~~~ - -Comparison tables in HTML, ASCII and CSV formats: - - - `HTML 1c MRR comparison <norm-compare-testbeds-3n-skx-3n-icx-1c-mrr.html>`_ - - `HTML 2c MRR comparison <norm-compare-testbeds-3n-skx-3n-icx-2c-mrr.html>`_ - - `HTML 4c MRR comparison <norm-compare-testbeds-3n-skx-3n-icx-4c-mrr.html>`_ - - `ASCII 1c MRR comparison <../../_static/vpp/norm-compare-testbeds-3n-skx-3n-icx-1c-mrr.txt>`_ - - `ASCII 2c MRR comparison <../../_static/vpp/norm-compare-testbeds-3n-skx-3n-icx-2c-mrr.txt>`_ - - `ASCII 4c MRR comparison <../../_static/vpp/norm-compare-testbeds-3n-skx-3n-icx-4c-mrr.txt>`_ - - `CSV 1c MRR comparison <../../_static/vpp/norm-compare-testbeds-3n-skx-3n-icx-1c-mrr-csv.csv>`_ - - `CSV 2c MRR comparison <../../_static/vpp/norm-compare-testbeds-3n-skx-3n-icx-2c-mrr-csv.csv>`_ - - `CSV 4c MRR comparison <../../_static/vpp/norm-compare-testbeds-3n-skx-3n-icx-4c-mrr-csv.csv>`_ diff --git a/docs/report/vpp_performance_tests/comparisons_norm/index.rst b/docs/report/vpp_performance_tests/comparisons_norm/index.rst deleted file mode 100644 index 7a0bdb0712..0000000000 --- a/docs/report/vpp_performance_tests/comparisons_norm/index.rst +++ /dev/null @@ -1,17 +0,0 @@ - -.. raw:: latex - - \clearpage - -Normalized Comparisons -====================== - -All values in this section are normalized to CPU frequency 2GHz. - -.. toctree:: - - 2n-clx_vs_2n-icx_testbeds - 2n-icx_vs_2n-skx_testbeds - 2n-skx_vs_2n-clx_testbeds - 3n-skx_vs_3n-icx_testbeds - 3n-skx_vs_2n-skx_testbeds diff --git a/docs/report/vpp_performance_tests/index.rst b/docs/report/vpp_performance_tests/index.rst index 42cec49604..e54549ed32 100644 --- a/docs/report/vpp_performance_tests/index.rst +++ b/docs/report/vpp_performance_tests/index.rst @@ -14,6 +14,5 @@ VPP Performance hoststack_testing/index gso_testing/index comparisons/index - comparisons_norm/index throughput_trending test_environment diff --git a/resources/tools/presentation/generator_tables.py b/resources/tools/presentation/generator_tables.py index d28ff9ac87..273288c1aa 100644 --- a/resources/tools/presentation/generator_tables.py +++ b/resources/tools/presentation/generator_tables.py @@ -39,7 +39,6 @@ from pal_utils import mean, stdev, classify_anomalies, \ REGEX_NIC = re.compile(r'(\d*ge\dp\d\D*\d*[a-z]*)') -REGEX_TOPO_ARCH = re.compile(r'^(\dn-.{3})') NORM_FREQ = 2.0 # [GHz] @@ -1740,8 +1739,6 @@ def table_comparison(table, input_data): f"{table.get('title', '')}." ) - normalize = table.get('normalize', False) - columns = table.get("columns", None) if not columns: logging.error( @@ -1872,19 +1869,7 @@ def table_comparison(table, input_data): for tst_data in tbl_dict.values(): row = [tst_data[u"name"], ] for col in cols: - row_data = tst_data.get(col["title"], None) - if normalize and row_data and row_data.get("mean", None) and \ - row_data.get("stdev", None): - groups = re.search(REGEX_TOPO_ARCH, col["title"]) - topo_arch = groups.group(0) if groups else "" - norm_factor = table["norm_factor"].get(topo_arch, 1.0) - row_data_norm = { - "mean": row_data["mean"] * norm_factor, - "stdev": row_data["stdev"] * norm_factor - } - else: - row_data_norm = row_data - row.append(row_data_norm) + row.append(tst_data.get(col[u"title"], None)) tbl_lst.append(row) comparisons = table.get("comparisons", None) @@ -1941,10 +1926,20 @@ def table_comparison(table, input_data): cmp_itm["mean"] is not None and \ ref_itm["stdev"] is not None and \ cmp_itm["stdev"] is not None: + norm_factor_ref = table["norm_factor"].get( + comp.get("norm-ref", ""), + 1.0 + ) + norm_factor_cmp = table["norm_factor"].get( + comp.get("norm-cmp", ""), + 1.0 + ) try: delta, d_stdev = relative_change_stdev( - ref_itm["mean"], cmp_itm["mean"], - ref_itm["stdev"], cmp_itm["stdev"] + ref_itm["mean"] * norm_factor_ref, + cmp_itm["mean"] * norm_factor_cmp, + ref_itm["stdev"] * norm_factor_ref, + cmp_itm["stdev"] * norm_factor_cmp ) except ZeroDivisionError: break diff --git a/resources/tools/presentation/specifications/report/elements.yaml b/resources/tools/presentation/specifications/report/elements.yaml index ca882d675c..21f6b7166f 100644 --- a/resources/tools/presentation/specifications/report/elements.yaml +++ b/resources/tools/presentation/specifications/report/elements.yaml @@ -709,793 +709,1009 @@ - type: "table" title: "VPP Normalized Comparison Across Testbeds 2n-skx to 2n-clx 2t1c ndr" algorithm: "table_comparison" - output-file: "{DIR[STATIC,VPP]}/norm-compare-testbeds-2n-skx-2n-clx-2t1c-ndr" + output-file: "{DIR[STATIC,VPP]}/performance-compare-testbeds-2n-skx-2n-clx-2t1c-ndr" include-tests: "NDR" # "PDR" | "NDR" | "MRR" filter: "'2T1C' and 'NIC_Intel-XXV710'" - normalize: True columns: - - title: "2n-skx" + - title: "2n-skx xxv710" data-set: "vpp-2n-skx-curr-iter" - - title: "2n-clx" + - title: "2n-clx xxv710" data-set: "vpp-2n-clx-curr-iter" comparisons: - - title: "Diff" + - title: "2n-clx vs 2n-skx" reference: 1 compare: 2 + - title: "Normalized 2n-clx vs 2n-skx" + reference: 1 + compare: 2 + norm-ref: "2n-skx" + norm-cmp: "2n-clx" legend: - - "" - - "2n-skx, 2n-clx - testbeds and NICs tested." - - "Diff - difference between 2n-skx and 2n-clx testbeds." + - '' + - 'Test Case: Test cases executed for: NDR throughput on 2n-skx and 2n-clx with xxv710.' + - '2n-skx, 2n-clx: [Mpps +- StDev] results for VPP tested in CSIT' + - '2n-clx vs 2n-skx: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' + - 'Normalized 2n-clx vs 2n-skx: [% +- StDev] Normalized relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' # VPP Normalized Comparison Across Testbeds 2n-skx to 2n-clx 4t2c ndr - type: "table" title: "VPP Normalized Comparison Across Testbeds 2n-skx to 2n-clx 4t2c ndr" algorithm: "table_comparison" - output-file: "{DIR[STATIC,VPP]}/norm-compare-testbeds-2n-skx-2n-clx-4t2c-ndr" + output-file: "{DIR[STATIC,VPP]}/performance-compare-testbeds-2n-skx-2n-clx-4t2c-ndr" include-tests: "NDR" # "PDR" | "NDR" | "MRR" filter: "'4T2C' and 'NIC_Intel-XXV710'" - normalize: True columns: - - title: "2n-skx" + - title: "2n-skx xxv710" data-set: "vpp-2n-skx-curr-iter" - - title: "2n-clx" + - title: "2n-clx xxv710" data-set: "vpp-2n-clx-curr-iter" comparisons: - - title: "Diff" + - title: "2n-clx vs 2n-skx" reference: 1 compare: 2 + - title: "Normalized 2n-clx vs 2n-skx" + reference: 1 + compare: 2 + norm-ref: "2n-skx" + norm-cmp: "2n-clx" legend: - - "" - - "2n-skx, 2n-clx - testbeds and NICs tested." - - "Diff - difference between 2n-skx and 2n-clx testbeds." + - '' + - 'Test Case: Test cases executed for: NDR throughput on 2n-skx and 2n-clx with xxv710.' + - '2n-skx, 2n-clx: [Mpps +- StDev] results for VPP tested in CSIT' + - '2n-clx vs 2n-skx: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' + - 'Normalized 2n-clx vs 2n-skx: [% +- StDev] Normalized relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' # VPP Normalized Comparison Across Testbeds 2n-skx to 2n-clx 2t1c pdr - type: "table" title: "VPP Normalized Comparison Across Testbeds 2n-skx to 2n-clx 2t1c pdr" algorithm: "table_comparison" - output-file: "{DIR[STATIC,VPP]}/norm-compare-testbeds-2n-skx-2n-clx-2t1c-pdr" + output-file: "{DIR[STATIC,VPP]}/performance-compare-testbeds-2n-skx-2n-clx-2t1c-pdr" include-tests: "PDR" # "PDR" | "NDR" | "MRR" filter: "'2T1C' and 'NIC_Intel-XXV710'" - normalize: True columns: - - title: "2n-skx" + - title: "2n-skx xxv710" data-set: "vpp-2n-skx-curr-iter" - - title: "2n-clx" + - title: "2n-clx xxv710" data-set: "vpp-2n-clx-curr-iter" comparisons: - - title: "Diff" + - title: "2n-clx vs 2n-skx" reference: 1 compare: 2 + - title: "Normalized 2n-clx vs 2n-skx" + reference: 1 + compare: 2 + norm-ref: "2n-skx" + norm-cmp: "2n-clx" legend: - - "" - - "2n-skx, 2n-clx - testbeds and NICs tested." - - "Diff - difference between 2n-skx and 2n-clx testbeds." + - '' + - 'Test Case: Test cases executed for: PDR throughput on 2n-skx and 2n-clx with xxv710.' + - '2n-skx, 2n-clx: [Mpps +- StDev] results for VPP tested in CSIT' + - '2n-clx vs 2n-skx: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' + - 'Normalized 2n-clx vs 2n-skx: [% +- StDev] Normalized relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' # VPP Normalized Comparison Across Testbeds 2n-skx to 2n-clx 4t2c pdr - type: "table" title: "VPP Normalized Comparison Across Testbeds 2n-skx to 2n-clx 4t2c pdr" algorithm: "table_comparison" - output-file: "{DIR[STATIC,VPP]}/norm-compare-testbeds-2n-skx-2n-clx-4t2c-pdr" + output-file: "{DIR[STATIC,VPP]}/performance-compare-testbeds-2n-skx-2n-clx-4t2c-pdr" include-tests: "PDR" # "PDR" | "NDR" | "MRR" filter: "'4T2C' and 'NIC_Intel-XXV710'" - normalize: True columns: - - title: "2n-skx" + - title: "2n-skx xxv710" data-set: "vpp-2n-skx-curr-iter" - - title: "2n-clx" + - title: "2n-clx xxv710" data-set: "vpp-2n-clx-curr-iter" comparisons: - - title: "Diff" + - title: "2n-clx vs 2n-skx" + reference: 1 + compare: 2 + - title: "Normalized 2n-clx vs 2n-skx" reference: 1 compare: 2 + norm-ref: "2n-skx" + norm-cmp: "2n-clx" legend: - - "" - - "2n-skx, 2n-clx - testbeds and NICs tested." - - "Diff - difference between 2n-skx and 2n-clx testbeds." + - '' + - 'Test Case: Test cases executed for: PDR throughput on 2n-skx and 2n-clx with xxv710.' + - '2n-skx, 2n-clx: [Mpps +- StDev] results for VPP tested in CSIT' + - '2n-clx vs 2n-skx: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' + - 'Normalized 2n-clx vs 2n-skx: [% +- StDev] Normalized relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' # VPP Normalized Comparison Across Testbeds 2n-clx to 2n-icx 1c ndr - type: "table" title: "VPP Normalized Comparison Across Testbeds 2n-clx to 2n-icx 1c ndr" algorithm: "table_comparison" - output-file: "{DIR[STATIC,VPP]}/norm-compare-testbeds-2n-clx-2n-icx-1c-ndr" + output-file: "{DIR[STATIC,VPP]}/performance-compare-testbeds-2n-clx-2n-icx-1c-ndr" include-tests: "NDR" # "PDR" | "NDR" | "MRR" filter: "'NIC_Intel-XXV710' and 'NDRPDR' and '1C'" - normalize: True columns: - title: "2n-clx xxv710" data-set: "vpp-2n-clx-curr-iter" - title: "2n-icx xxv710" data-set: "vpp-2n-icx-curr-iter" comparisons: - - title: "Diff" + - title: "2n-icx vs 2n-clx" + reference: 1 + compare: 2 + - title: "Normalized 2n-icx vs 2n-clx" reference: 1 compare: 2 + norm-ref: "2n-clx" + norm-cmp: "2n-icx" legend: - - "" - - "2n-clx xxv710, 2n-icx xxv710 - testbeds and NICs tested." - - "Diff - difference between 2n-clx xxv710 and 2n-icx xxv710 testbeds." + - '' + - 'Test Case: Test cases executed for: NDR throughput on 2n-clx and 2n-icx with xxv710.' + - '2n-clx, 2n-icx: [Mpps +- StDev] results for VPP tested in CSIT' + - '2n-icx vs 2n-clx: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' + - 'Normalized 2n-icx vs 2n-clx: [% +- StDev] Normalized relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' # VPP Normalized Comparison Across Testbeds 2n-clx to 2n-icx 2c ndr - type: "table" title: "VPP Normalized Comparison Across Testbeds 2n-clx to 2n-icx 2c ndr" algorithm: "table_comparison" - output-file: "{DIR[STATIC,VPP]}/norm-compare-testbeds-2n-clx-2n-icx-2c-ndr" + output-file: "{DIR[STATIC,VPP]}/performance-compare-testbeds-2n-clx-2n-icx-2c-ndr" include-tests: "NDR" # "PDR" | "NDR" | "MRR" filter: "'NIC_Intel-XXV710' and 'NDRPDR' and '2C'" - normalize: True columns: - title: "2n-clx xxv710" data-set: "vpp-2n-clx-curr-iter" - title: "2n-icx xxv710" data-set: "vpp-2n-icx-curr-iter" comparisons: - - title: "Diff" + - title: "2n-icx vs 2n-clx" reference: 1 compare: 2 + - title: "Normalized 2n-icx vs 2n-clx" + reference: 1 + compare: 2 + norm-ref: "2n-clx" + norm-cmp: "2n-icx" legend: - - "" - - "2n-clx xxv710, 2n-icx xxv710 - testbeds and NICs tested." - - "Diff - difference between 2n-clx xxv710 and 2n-icx xxv710 testbeds." + - '' + - 'Test Case: Test cases executed for: NDR throughput on 2n-clx and 2n-icx with xxv710.' + - '2n-clx, 2n-icx: [Mpps +- StDev] results for VPP tested in CSIT' + - '2n-icx vs 2n-clx: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' + - 'Normalized 2n-icx vs 2n-clx: [% +- StDev] Normalized relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' # VPP Normalized Comparison Across Testbeds 2n-clx to 2n-icx 1c pdr - type: "table" title: "VPP Normalized Comparison Across Testbeds 2n-clx to 2n-icx 1c pdr" algorithm: "table_comparison" - output-file: "{DIR[STATIC,VPP]}/norm-compare-testbeds-2n-clx-2n-icx-1c-pdr" + output-file: "{DIR[STATIC,VPP]}/performance-compare-testbeds-2n-clx-2n-icx-1c-pdr" include-tests: "PDR" # "PDR" | "NDR" | "MRR" filter: "'NIC_Intel-XXV710' and 'NDRPDR' and '1C'" - normalize: True columns: - title: "2n-clx xxv710" data-set: "vpp-2n-clx-curr-iter" - title: "2n-icx xxv710" data-set: "vpp-2n-icx-curr-iter" comparisons: - - title: "Diff" + - title: "2n-icx vs 2n-clx" reference: 1 compare: 2 + - title: "Normalized 2n-icx vs 2n-clx" + reference: 1 + compare: 2 + norm-ref: "2n-clx" + norm-cmp: "2n-icx" legend: - - "" - - "2n-clx xxv710, 2n-icx xxv710 - testbeds and NICs tested." - - "Diff - difference between 2n-clx xxv710 and 2n-icx xxv710 testbeds." + - '' + - 'Test Case: Test cases executed for: PDR throughput on 2n-clx and 2n-icx with xxv710.' + - '2n-clx, 2n-icx: [Mpps +- StDev] results for VPP tested in CSIT' + - '2n-icx vs 2n-clx: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' + - 'Normalized 2n-icx vs 2n-clx: [% +- StDev] Normalized relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' # VPP Normalized Comparison Across Testbeds 2n-clx to 2n-icx 2c pdr - type: "table" title: "VPP Normalized Comparison Across Testbeds 2n-clx to 2n-icx 2c pdr" algorithm: "table_comparison" - output-file: "{DIR[STATIC,VPP]}/norm-compare-testbeds-2n-clx-2n-icx-2c-pdr" + output-file: "{DIR[STATIC,VPP]}/performance-compare-testbeds-2n-clx-2n-icx-2c-pdr" include-tests: "PDR" # "PDR" | "NDR" | "MRR" filter: "'NIC_Intel-XXV710' and 'NDRPDR' and '2C'" - normalize: True columns: - title: "2n-clx xxv710" data-set: "vpp-2n-clx-curr-iter" - title: "2n-icx xxv710" data-set: "vpp-2n-icx-curr-iter" comparisons: - - title: "Diff" + - title: "2n-icx vs 2n-clx" + reference: 1 + compare: 2 + - title: "Normalized 2n-icx vs 2n-clx" reference: 1 compare: 2 + norm-ref: "2n-clx" + norm-cmp: "2n-icx" legend: - - "" - - "2n-clx xxv710, 2n-icx xxv710 - testbeds and NICs tested." - - "Diff - difference between 2n-clx xxv710 and 2n-icx xxv710 testbeds." + - '' + - 'Test Case: Test cases executed for: PDR throughput on 2n-clx and 2n-icx with xxv710.' + - '2n-clx, 2n-icx: [Mpps +- StDev] results for VPP tested in CSIT' + - '2n-icx vs 2n-clx: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' + - 'Normalized 2n-icx vs 2n-clx: [% +- StDev] Normalized relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' # VPP Normalized Comparison Across Testbeds 2n-skx to 2n-icx 1c ndr - type: "table" title: "VPP Normalized Comparison Across Testbeds 2n-skx to 2n-icx 1c ndr" algorithm: "table_comparison" - output-file: "{DIR[STATIC,VPP]}/norm-compare-testbeds-2n-skx-2n-icx-1c-ndr" + output-file: "{DIR[STATIC,VPP]}/performance-compare-testbeds-2n-skx-2n-icx-1c-ndr" include-tests: "NDR" # "PDR" | "NDR" | "MRR" filter: "'NIC_Intel-XXV710' and 'NDRPDR' and '1C'" - normalize: True columns: - title: "2n-skx xxv710" data-set: "vpp-2n-skx-curr-iter" - title: "2n-icx xxv710" data-set: "vpp-2n-icx-curr-iter" comparisons: - - title: "Diff" + - title: "2n-icx vs 2n-skx" + reference: 1 + compare: 2 + - title: "Normalized 2n-icx vs 2n-skx" reference: 1 compare: 2 + norm-ref: "2n-skx" + norm-cmp: "2n-icx" legend: - - "" - - "2n-skx xxv710, 2n-icx xxv710 - testbeds and NICs tested." - - "Diff - difference between 2n-skx xxv710 and 2n-icx xxv710 testbeds." + - '' + - 'Test Case: Test cases executed for: NDR throughput on 2n-skx and 2n-icx with xxv710.' + - '2n-skx, 2n-icx: [Mpps +- StDev] results for VPP tested in CSIT' + - '2n-icx vs 2n-skx: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' + - 'Normalized 2n-icx vs 2n-skx: [% +- StDev] Normalized relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' # VPP Normalized Comparison Across Testbeds 2n-skx to 2n-icx 2c ndr - type: "table" title: "VPP Normalized Comparison Across Testbeds 2n-skx to 2n-icx 2c ndr" algorithm: "table_comparison" - output-file: "{DIR[STATIC,VPP]}/norm-compare-testbeds-2n-skx-2n-icx-2c-ndr" + output-file: "{DIR[STATIC,VPP]}/performance-compare-testbeds-2n-skx-2n-icx-2c-ndr" include-tests: "NDR" # "PDR" | "NDR" | "MRR" filter: "'NIC_Intel-XXV710' and 'NDRPDR' and '2C'" - normalize: True columns: - title: "2n-skx xxv710" data-set: "vpp-2n-skx-curr-iter" - title: "2n-icx xxv710" data-set: "vpp-2n-icx-curr-iter" comparisons: - - title: "Diff" + - title: "2n-icx vs 2n-skx" + reference: 1 + compare: 2 + - title: "Normalized 2n-icx vs 2n-skx" reference: 1 compare: 2 + norm-ref: "2n-skx" + norm-cmp: "2n-icx" legend: - - "" - - "2n-skx xxv710, 2n-icx xxv710 - testbeds and NICs tested." - - "Diff - difference between 2n-skx xxv710 and 2n-icx xxv710 testbeds." + - '' + - 'Test Case: Test cases executed for: NDR throughput on 2n-skx and 2n-icx with xxv710.' + - '2n-skx, 2n-icx: [Mpps +- StDev] results for VPP tested in CSIT' + - '2n-icx vs 2n-skx: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' + - 'Normalized 2n-icx vs 2n-skx: [% +- StDev] Normalized relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' # VPP Normalized Comparison Across Testbeds 2n-skx to 2n-icx 1c pdr - type: "table" title: "VPP Normalized Comparison Across Testbeds 2n-skx to 2n-icx 1c pdr" algorithm: "table_comparison" - output-file: "{DIR[STATIC,VPP]}/norm-compare-testbeds-2n-skx-2n-icx-1c-pdr" + output-file: "{DIR[STATIC,VPP]}/performance-compare-testbeds-2n-skx-2n-icx-1c-pdr" include-tests: "PDR" # "PDR" | "NDR" | "MRR" filter: "'NIC_Intel-XXV710' and 'NDRPDR' and '1C'" - normalize: True columns: - title: "2n-skx xxv710" data-set: "vpp-2n-skx-curr-iter" - title: "2n-icx xxv710" data-set: "vpp-2n-icx-curr-iter" comparisons: - - title: "Diff" + - title: "2n-icx vs 2n-skx" reference: 1 compare: 2 + - title: "Normalized 2n-icx vs 2n-skx" + reference: 1 + compare: 2 + norm-ref: "2n-skx" + norm-cmp: "2n-icx" legend: - - "" - - "2n-skx xxv710, 2n-icx xxv710 - testbeds and NICs tested." - - "Diff - difference between 2n-skx xxv710 and 2n-icx xxv710 testbeds." + - '' + - 'Test Case: Test cases executed for: PDR throughput on 2n-skx and 2n-icx with xxv710.' + - '2n-skx, 2n-icx: [Mpps +- StDev] results for VPP tested in CSIT' + - '2n-icx vs 2n-skx: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' + - 'Normalized 2n-icx vs 2n-skx: [% +- StDev] Normalized relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' # VPP Normalized Comparison Across Testbeds 2n-skx to 2n-icx 2c pdr - type: "table" title: "VPP Normalized Comparison Across Testbeds 2n-skx to 2n-icx 2c pdr" algorithm: "table_comparison" - output-file: "{DIR[STATIC,VPP]}/norm-compare-testbeds-2n-skx-2n-icx-2c-pdr" + output-file: "{DIR[STATIC,VPP]}/performance-compare-testbeds-2n-skx-2n-icx-2c-pdr" include-tests: "PDR" # "PDR" | "NDR" | "MRR" filter: "'NIC_Intel-XXV710' and 'NDRPDR' and '2C'" - normalize: True columns: - title: "2n-skx xxv710" data-set: "vpp-2n-skx-curr-iter" - title: "2n-icx xxv710" data-set: "vpp-2n-icx-curr-iter" comparisons: - - title: "Diff" + - title: "2n-icx vs 2n-skx" reference: 1 compare: 2 + - title: "Normalized 2n-icx vs 2n-skx" + reference: 1 + compare: 2 + norm-ref: "2n-skx" + norm-cmp: "2n-icx" legend: - - "" - - "2n-skx xxv710, 2n-icx xxv710 - testbeds and NICs tested." - - "Diff - difference between 2n-skx xxv710 and 2n-icx xxv710 testbeds." + - '' + - 'Test Case: Test cases executed for: PDR throughput on 2n-skx and 2n-icx with xxv710.' + - '2n-skx, 2n-icx: [Mpps +- StDev] results for VPP tested in CSIT' + - '2n-icx vs 2n-skx: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' + - 'Normalized 2n-icx vs 2n-skx: [% +- StDev] Normalized relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' # VPP Normalized Comparison Across Testbeds 3n-skx to 3n-icx 1c ndr - type: "table" title: "VPP Normalized Comparison Across Testbeds 3n-skx to 3n-icx 1c ndr" algorithm: "table_comparison" - output-file: "{DIR[STATIC,VPP]}/norm-compare-testbeds-3n-skx-3n-icx-1c-ndr" + output-file: "{DIR[STATIC,VPP]}/performance-compare-testbeds-3n-skx-3n-icx-1c-ndr" include-tests: "NDR" # "PDR" | "NDR" | "MRR" filter: "'NIC_Intel-XXV710' and 'NDRPDR' and '1C'" - normalize: True columns: - title: "3n-skx xxv710" data-set: "vpp-3n-skx-curr-iter" - title: "3n-icx xxv710" data-set: "vpp-3n-icx-curr-iter" comparisons: - - title: "Diff" + - title: "3n-icx vs 3n-skx" + reference: 1 + compare: 2 + - title: "Normalized 3n-icx vs 3n-skx" reference: 1 compare: 2 + norm-ref: "3n-skx" + norm-cmp: "3n-icx" legend: - - "" - - "3n-skx xxv710, 3n-icx xxv710 - testbeds and NICs tested." - - "Diff - difference between 3n-skx xxv710 and 3n-icx xxv710 testbeds." + - '' + - 'Test Case: Test cases executed for: NDR throughput on 3n-skx and 3n-icx with xxv710.' + - '3n-skx, 3n-icx: [Mpps +- StDev] results for VPP tested in CSIT' + - '3n-icx vs 3n-skx: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' + - 'Normalized 3n-icx vs 3n-skx: [% +- StDev] Normalized relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' # VPP Normalized Comparison Across Testbeds 3n-skx to 3n-icx 2c ndr - type: "table" title: "VPP Normalized Comparison Across Testbeds 3n-skx to 3n-icx ndr" algorithm: "table_comparison" - output-file: "{DIR[STATIC,VPP]}/norm-compare-testbeds-3n-skx-3n-icx-2c-ndr" + output-file: "{DIR[STATIC,VPP]}/performance-compare-testbeds-3n-skx-3n-icx-2c-ndr" include-tests: "NDR" # "PDR" | "NDR" | "MRR" filter: "'NIC_Intel-XXV710' and 'NDRPDR' and '2C'" - normalize: True columns: - title: "3n-skx xxv710" data-set: "vpp-3n-skx-curr-iter" - title: "3n-icx xxv710" data-set: "vpp-3n-icx-curr-iter" comparisons: - - title: "Diff" + - title: "3n-icx vs 3n-skx" + reference: 1 + compare: 2 + - title: "Normalized 3n-icx vs 3n-skx" reference: 1 compare: 2 + norm-ref: "3n-skx" + norm-cmp: "3n-icx" legend: - - "" - - "3n-skx xxv710, 3n-icx xxv710 - testbeds and NICs tested." - - "Diff - difference between 3n-skx xxv710 and 3n-icx xxv710 testbeds." + - '' + - 'Test Case: Test cases executed for: NDR throughput on 3n-skx and 3n-icx with xxv710.' + - '3n-skx, 3n-icx: [Mpps +- StDev] results for VPP tested in CSIT' + - '3n-icx vs 3n-skx: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' + - 'Normalized 3n-icx vs 3n-skx: [% +- StDev] Normalized relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' # VPP Normalized Comparison Across Testbeds 3n-skx to 3n-icx 1c pdr - type: "table" title: "VPP Normalized Comparison Across Testbeds 3n-skx to 3n-icx 1c pdr" algorithm: "table_comparison" - output-file: "{DIR[STATIC,VPP]}/norm-compare-testbeds-3n-skx-3n-icx-1c-pdr" + output-file: "{DIR[STATIC,VPP]}/performance-compare-testbeds-3n-skx-3n-icx-1c-pdr" include-tests: "PDR" # "PDR" | "NDR" | "MRR" filter: "'NIC_Intel-XXV710' and 'NDRPDR' and '1C'" - normalize: True columns: - title: "3n-skx xxv710" data-set: "vpp-3n-skx-curr-iter" - title: "3n-icx xxv710" data-set: "vpp-3n-icx-curr-iter" comparisons: - - title: "Diff" + - title: "3n-icx vs 3n-skx" reference: 1 compare: 2 + - title: "Normalized 3n-icx vs 3n-skx" + reference: 1 + compare: 2 + norm-ref: "3n-skx" + norm-cmp: "3n-icx" legend: - - "" - - "3n-skx xxv710, 3n-icx xxv710 - testbeds and NICs tested." - - "Diff - difference between 3n-skx xxv710 and 3n-icx xxv710 testbeds." + - '' + - 'Test Case: Test cases executed for: PDR throughput on 3n-skx and 3n-icx with xxv710.' + - '3n-skx, 3n-icx: [Mpps +- StDev] results for VPP tested in CSIT' + - '3n-icx vs 3n-skx: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' + - 'Normalized 3n-icx vs 3n-skx: [% +- StDev] Normalized relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' # VPP Normalized Comparison Across Testbeds 3n-skx to 3n-icx 2c pdr - type: "table" title: "VPP Normalized Comparison Across Testbeds 3n-skx to 3n-icx 2c pdr" algorithm: "table_comparison" - output-file: "{DIR[STATIC,VPP]}/norm-compare-testbeds-3n-skx-3n-icx-2c-pdr" + output-file: "{DIR[STATIC,VPP]}/performance-compare-testbeds-3n-skx-3n-icx-2c-pdr" include-tests: "PDR" # "PDR" | "NDR" | "MRR" filter: "'NIC_Intel-XXV710' and 'NDRPDR' and '2C'" - normalize: True columns: - title: "3n-skx xxv710" data-set: "vpp-3n-skx-curr-iter" - title: "3n-icx xxv710" data-set: "vpp-3n-icx-curr-iter" comparisons: - - title: "Diff" + - title: "3n-icx vs 3n-skx" + reference: 1 + compare: 2 + - title: "Normalized 3n-icx vs 3n-skx" reference: 1 compare: 2 + norm-ref: "3n-skx" + norm-cmp: "3n-icx" legend: - - "" - - "3n-skx xxv710, 3n-icx xxv710 - testbeds and NICs tested." - - "Diff - difference between 3n-skx xxv710 and 3n-icx xxv710 testbeds." + - '' + - 'Test Case: Test cases executed for: PDR throughput on 3n-skx and 3n-icx with xxv710.' + - '3n-skx, 3n-icx: [Mpps +- StDev] results for VPP tested in CSIT' + - '3n-icx vs 3n-skx: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' + - 'Normalized 3n-icx vs 3n-skx: [% +- StDev] Normalized relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' # VPP Normalized Comparison Across Testbeds 2n-skx to 2n-clx 2t1c mrr - type: "table" title: "VPP Normalized Comparison Across Testbeds 2n-skx to 2n-clx 2t1c mrr" algorithm: "table_comparison" - output-file: "{DIR[STATIC,VPP]}/norm-compare-testbeds-2n-skx-2n-clx-2t1c-mrr" + output-file: "{DIR[STATIC,VPP]}/performance-compare-testbeds-2n-skx-2n-clx-2t1c-mrr" include-tests: "MRR" # "PDR" | "NDR" | "MRR" filter: "'2T1C' and 'NIC_Intel-XXV710'" - normalize: True columns: - - title: "2n-skx" + - title: "2n-skx xxv710" data-set: "vpp-2n-skx-curr-iter-mrr" - - title: "2n-clx" + - title: "2n-clx xxv710" data-set: "vpp-2n-clx-curr-iter-mrr" comparisons: - - title: "Diff" + - title: "2n-clx vs 2n-skx" reference: 1 compare: 2 + - title: "Normalized 2n-clx vs 2n-skx" + reference: 1 + compare: 2 + norm-ref: "2n-skx" + norm-cmp: "2n-clx" legend: - - "" - - "2n-skx, 2n-clx - testbeds and NICs tested." - - "Diff - difference between 2n-skx and 2n-clx testbeds." + - '' + - 'Test Case: Test cases executed for: MRR throughput on 2n-skx and 2n-clx with xxv710.' + - '2n-skx, 2n-clx: [Mpps +- StDev] results for VPP tested in CSIT' + - '2n-clx vs 2n-skx: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' + - 'Normalized 2n-clx vs 2n-skx: [% +- StDev] Normalized relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' # VPP Normalized Comparison Across Testbeds 2n-skx to 2n-clx 4t2c mrr - type: "table" title: "VPP Normalized Comparison Across Testbeds 2n-skx to 2n-clx 4t2c mrr" algorithm: "table_comparison" - output-file: "{DIR[STATIC,VPP]}/norm-compare-testbeds-2n-skx-2n-clx-4t2c-mrr" + output-file: "{DIR[STATIC,VPP]}/performance-compare-testbeds-2n-skx-2n-clx-4t2c-mrr" include-tests: "MRR" # "PDR" | "NDR" | "MRR" filter: "'4T2C' and 'NIC_Intel-XXV710'" - normalize: True columns: - - title: "2n-skx" + - title: "2n-skx xxv710" data-set: "vpp-2n-skx-curr-iter-mrr" - - title: "2n-clx" + - title: "2n-clx xxv710" data-set: "vpp-2n-clx-curr-iter-mrr" comparisons: - - title: "Diff" + - title: "2n-clx vs 2n-skx" + reference: 1 + compare: 2 + - title: "Normalized 2n-clx vs 2n-skx" reference: 1 compare: 2 + norm-ref: "2n-skx" + norm-cmp: "2n-clx" legend: - - "" - - "2n-skx, 2n-clx - testbeds and NICs tested." - - "Diff - difference between 2n-skx and 2n-clx testbeds." + - '' + - 'Test Case: Test cases executed for: MRR throughput on 2n-skx and 2n-clx with xxv710.' + - '2n-skx, 2n-clx: [Mpps +- StDev] results for VPP tested in CSIT' + - '2n-clx vs 2n-skx: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' + - 'Normalized 2n-clx vs 2n-skx: [% +- StDev] Normalized relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' # VPP Normalized Comparison Across Testbeds 2n-skx to 2n-clx 8t4c mrr - type: "table" title: "VPP Normalized Comparison Across Testbeds 2n-skx to 2n-clx 8t4c mrr" algorithm: "table_comparison" - output-file: "{DIR[STATIC,VPP]}/norm-compare-testbeds-2n-skx-2n-clx-8t4c-mrr" + output-file: "{DIR[STATIC,VPP]}/performance-compare-testbeds-2n-skx-2n-clx-8t4c-mrr" include-tests: "MRR" # "PDR" | "NDR" | "MRR" filter: "'8T4C' and 'NIC_Intel-XXV710'" - normalize: True columns: - - title: "2n-skx" + - title: "2n-skx xxv710" data-set: "vpp-2n-skx-curr-iter-mrr" - - title: "2n-clx" + - title: "2n-clx xxv710" data-set: "vpp-2n-clx-curr-iter-mrr" comparisons: - - title: "Diff" + - title: "2n-clx vs 2n-skx" reference: 1 compare: 2 + - title: "Normalized 2n-clx vs 2n-skx" + reference: 1 + compare: 2 + norm-ref: "2n-skx" + norm-cmp: "2n-clx" legend: - - "" - - "2n-skx, 2n-clx - testbeds and NICs tested." - - "Diff - difference between 2n-skx and 2n-clx testbeds." + - '' + - 'Test Case: Test cases executed for: MRR throughput on 2n-skx and 2n-clx with xxv710.' + - '2n-skx, 2n-clx: [Mpps +- StDev] results for VPP tested in CSIT' + - '2n-clx vs 2n-skx: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' + - 'Normalized 2n-clx vs 2n-skx: [% +- StDev] Normalized relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' # VPP Normalized Comparison Across Testbeds 2n-clx to 2n-icx 1c mrr - type: "table" title: "VPP Normalized Comparison Across Testbeds 2n-clx to 2n-icx 1c mrr" algorithm: "table_comparison" - output-file: "{DIR[STATIC,VPP]}/norm-compare-testbeds-2n-clx-2n-icx-1c-mrr" + output-file: "{DIR[STATIC,VPP]}/performance-compare-testbeds-2n-clx-2n-icx-1c-mrr" include-tests: "MRR" # "PDR" | "NDR" | "MRR" filter: "'NIC_Intel-XXV710' and 'MRR' and '1C'" - normalize: True columns: - title: "2n-clx xxv710" data-set: "vpp-2n-clx-curr-iter-mrr" - title: "2n-icx xxv710" data-set: "vpp-2n-icx-curr-iter-mrr" comparisons: - - title: "Diff" + - title: "2n-icx vs 2n-clx" + reference: 1 + compare: 2 + - title: "Normalized 2n-icx vs 2n-clx" reference: 1 compare: 2 + norm-ref: "2n-clx" + norm-cmp: "2n-icx" legend: - - "" - - "2n-clx xxv710, 2n-icx xxv710 - testbeds and NICs tested." - - "Diff - difference between 2n-clx xxv710 and 2n-icx xxv710 testbeds." + - '' + - 'Test Case: Test cases executed for: MRR throughput on 2n-clx and 2n-icx with xxv710.' + - '2n-clx, 2n-icx: [Mpps +- StDev] results for VPP tested in CSIT' + - '2n-icx vs 2n-clx: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' + - 'Normalized 2n-icx vs 2n-clx: [% +- StDev] Normalized relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' # VPP Normalized Comparison Across Testbeds 2n-clx to 2n-icx 2c mrr - type: "table" title: "VPP Normalized Comparison Across Testbeds 2n-clx to 2n-icx 2c mrr" algorithm: "table_comparison" - output-file: "{DIR[STATIC,VPP]}/norm-compare-testbeds-2n-clx-2n-icx-2c-mrr" + output-file: "{DIR[STATIC,VPP]}/performance-compare-testbeds-2n-clx-2n-icx-2c-mrr" include-tests: "MRR" # "PDR" | "NDR" | "MRR" filter: "'NIC_Intel-XXV710' and 'MRR' and '2C'" - normalize: True columns: - title: "2n-clx xxv710" data-set: "vpp-2n-clx-curr-iter-mrr" - title: "2n-icx xxv710" data-set: "vpp-2n-icx-curr-iter-mrr" comparisons: - - title: "Diff" + - title: "2n-icx vs 2n-clx" + reference: 1 + compare: 2 + - title: "Normalized 2n-icx vs 2n-clx" reference: 1 compare: 2 + norm-ref: "2n-clx" + norm-cmp: "2n-icx" legend: - - "" - - "2n-clx xxv710, 2n-icx xxv710 - testbeds and NICs tested." - - "Diff - difference between 2n-clx xxv710 and 2n-icx xxv710 testbeds." + - '' + - 'Test Case: Test cases executed for: MRR throughput on 2n-clx and 2n-icx with xxv710.' + - '2n-clx, 2n-icx: [Mpps +- StDev] results for VPP tested in CSIT' + - '2n-icx vs 2n-clx: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' + - 'Normalized 2n-icx vs 2n-clx: [% +- StDev] Normalized relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' # VPP Normalized Comparison Across Testbeds 2n-clx to 2n-icx 4c mrr - type: "table" title: "VPP Normalized Comparison Across Testbeds 2n-clx to 2n-icx 4c mrr" algorithm: "table_comparison" - output-file: "{DIR[STATIC,VPP]}/norm-compare-testbeds-2n-clx-2n-icx-4c-mrr" + output-file: "{DIR[STATIC,VPP]}/performance-compare-testbeds-2n-clx-2n-icx-4c-mrr" include-tests: "MRR" # "PDR" | "NDR" | "MRR" filter: "'NIC_Intel-XXV710' and 'MRR' and '4C'" - normalize: True columns: - title: "2n-clx xxv710" data-set: "vpp-2n-clx-curr-iter-mrr" - title: "2n-icx xxv710" data-set: "vpp-2n-icx-curr-iter-mrr" comparisons: - - title: "Diff" + - title: "2n-icx vs 2n-clx" reference: 1 compare: 2 + - title: "Normalized 2n-icx vs 2n-clx" + reference: 1 + compare: 2 + norm-ref: "2n-clx" + norm-cmp: "2n-icx" legend: - - "" - - "2n-clx xxv710, 2n-icx xxv710 - testbeds and NICs tested." - - "Diff - difference between 2n-clx xxv710 and 2n-icx xxv710 testbeds." + - '' + - 'Test Case: Test cases executed for: MRR throughput on 2n-clx and 2n-icx with xxv710.' + - '2n-clx, 2n-icx: [Mpps +- StDev] results for VPP tested in CSIT' + - '2n-icx vs 2n-clx: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' + - 'Normalized 2n-icx vs 2n-clx: [% +- StDev] Normalized relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' # VPP Normalized Comparison Across Testbeds 2n-skx to 2n-icx 1c mrr - type: "table" title: "VPP Normalized Comparison Across Testbeds 2n-skx to 2n-icx 1c mrr" algorithm: "table_comparison" - output-file: "{DIR[STATIC,VPP]}/norm-compare-testbeds-2n-skx-2n-icx-1c-mrr" + output-file: "{DIR[STATIC,VPP]}/performance-compare-testbeds-2n-skx-2n-icx-1c-mrr" include-tests: "MRR" # "PDR" | "NDR" | "MRR" filter: "'NIC_Intel-XXV710' and 'MRR' and '1C'" - normalize: True columns: - title: "2n-skx xxv710" data-set: "vpp-2n-skx-curr-iter-mrr" - title: "2n-icx xxv710" data-set: "vpp-2n-icx-curr-iter-mrr" comparisons: - - title: "Diff" + - title: "2n-icx vs 2n-clx" reference: 1 compare: 2 + - title: "Normalized 2n-icx vs 2n-skx" + reference: 1 + compare: 2 + norm-ref: "2n-skx" + norm-cmp: "2n-icx" legend: - - "" - - "2n-skx xxv710, 2n-icx xxv710 - testbeds and NICs tested." - - "Diff - difference between 2n-skx xxv710 and 2n-icx xxv710 testbeds." + - '' + - 'Test Case: Test cases executed for: MRR throughput on 2n-skx and 2n-icx with xxv710.' + - '2n-skx, 2n-icx: [Mpps +- StDev] results for VPP tested in CSIT' + - '2n-icx vs 2n-skx: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' + - 'Normalized 2n-icx vs 2n-skx: [% +- StDev] Normalized relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' # VPP Normalized Comparison Across Testbeds 2n-skx to 2n-icx 2c mrr - type: "table" title: "VPP Normalized Comparison Across Testbeds 2n-skx to 2n-icx 2c mrr" algorithm: "table_comparison" - output-file: "{DIR[STATIC,VPP]}/norm-compare-testbeds-2n-skx-2n-icx-2c-mrr" + output-file: "{DIR[STATIC,VPP]}/performance-compare-testbeds-2n-skx-2n-icx-2c-mrr" include-tests: "MRR" # "PDR" | "NDR" | "MRR" filter: "'NIC_Intel-XXV710' and 'MRR' and '2C'" - normalize: True columns: - title: "2n-skx xxv710" data-set: "vpp-2n-skx-curr-iter-mrr" - title: "2n-icx xxv710" data-set: "vpp-2n-icx-curr-iter-mrr" comparisons: - - title: "Diff" + - title: "2n-icx vs 2n-skx" + reference: 1 + compare: 2 + - title: "Normalized 2n-icx vs 2n-skx" reference: 1 compare: 2 + norm-ref: "2n-skx" + norm-cmp: "2n-icx" legend: - - "" - - "2n-skx xxv710, 2n-icx xxv710 - testbeds and NICs tested." - - "Diff - difference between 2n-skx xxv710 and 2n-icx xxv710 testbeds." + - '' + - 'Test Case: Test cases executed for: MRR throughput on 2n-skx and 2n-icx with xxv710.' + - '2n-skx, 2n-icx: [Mpps +- StDev] results for VPP tested in CSIT' + - '2n-icx vs 2n-skx: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' + - 'Normalized 2n-icx vs 2n-skx: [% +- StDev] Normalized relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' # VPP Normalized Comparison Across Testbeds 2n-skx to 2n-icx 4c mrr - type: "table" title: "VPP Normalized Comparison Across Testbeds 2n-skx to 2n-icx 4c mrr" algorithm: "table_comparison" - output-file: "{DIR[STATIC,VPP]}/norm-compare-testbeds-2n-skx-2n-icx-4c-mrr" + output-file: "{DIR[STATIC,VPP]}/performance-compare-testbeds-2n-skx-2n-icx-4c-mrr" include-tests: "MRR" # "PDR" | "NDR" | "MRR" filter: "'NIC_Intel-XXV710' and 'MRR' and '4C'" - normalize: True columns: - title: "2n-skx xxv710" data-set: "vpp-2n-skx-curr-iter-mrr" - title: "2n-icx xxv710" data-set: "vpp-2n-icx-curr-iter-mrr" comparisons: - - title: "Diff" + - title: "2n-icx vs 2n-skx" + reference: 1 + compare: 2 + - title: "Normalized 2n-icx vs 2n-skx" reference: 1 compare: 2 + norm-ref: "2n-skx" + norm-cmp: "2n-icx" legend: - - "" - - "2n-skx xxv710, 2n-icx xxv710 - testbeds and NICs tested." - - "Diff - difference between 2n-skx xxv710 and 2n-icx xxv710 testbeds." + - '' + - 'Test Case: Test cases executed for: MRR throughput on 2n-skx and 2n-icx with xxv710.' + - '2n-skx, 2n-icx: [Mpps +- StDev] results for VPP tested in CSIT' + - '2n-icx vs 2n-skx: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' + - 'Normalized 2n-icx vs 2n-skx: [% +- StDev] Normalized relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' # VPP Normalized Comparison Across Testbeds 3n-skx to 3n-icx 1c mrr - type: "table" title: "VPP Normalized Comparison Across Testbeds 3n-skx to 3n-icx 1c mrr" algorithm: "table_comparison" - output-file: "{DIR[STATIC,VPP]}/norm-compare-testbeds-3n-skx-3n-icx-1c-mrr" + output-file: "{DIR[STATIC,VPP]}/performance-compare-testbeds-3n-skx-3n-icx-1c-mrr" include-tests: "MRR" # "PDR" | "NDR" | "MRR" filter: "'NIC_Intel-XXV710' and 'MRR' and '1C'" - normalize: True columns: - title: "3n-skx xxv710" data-set: "vpp-3n-skx-curr-iter-mrr" - title: "3n-icx xxv710" data-set: "vpp-3n-icx-curr-iter-mrr" comparisons: - - title: "Diff" + - title: "3n-icx vs 3n-skx" + reference: 1 + compare: 2 + - title: "Normalized 3n-icx vs 3n-skx" reference: 1 compare: 2 + norm-ref: "3n-skx" + norm-cmp: "3n-icx" legend: - - "" - - "3n-skx xxv710, 3n-icx xxv710 - testbeds and NICs tested." - - "Diff - difference between 3n-skx xxv710 and 3n-icx xxv710 testbeds." + - '' + - 'Test Case: Test cases executed for: MRR throughput on 3n-skx and 3n-icx with xxv710.' + - '3n-skx, 3n-icx: [Mpps +- StDev] results for VPP tested in CSIT' + - '3n-icx vs 3n-skx: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' + - 'Normalized 3n-icx vs 3n-skx: [% +- StDev] Normalized relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' # VPP Normalized Comparison Across Testbeds 3n-skx to 3n-icx 2c mrr - type: "table" title: "VPP Normalized Comparison Across Testbeds 3n-skx to 3n-icx 2c mrr" algorithm: "table_comparison" - output-file: "{DIR[STATIC,VPP]}/norm-compare-testbeds-3n-skx-3n-icx-2c-mrr" + output-file: "{DIR[STATIC,VPP]}/performance-compare-testbeds-3n-skx-3n-icx-2c-mrr" include-tests: "MRR" # "PDR" | "NDR" | "MRR" filter: "'NIC_Intel-XXV710' and 'MRR' and '2C'" - normalize: True columns: - title: "3n-skx xxv710" data-set: "vpp-3n-skx-curr-iter-mrr" - title: "3n-icx xxv710" data-set: "vpp-3n-icx-curr-iter-mrr" comparisons: - - title: "Diff" + - title: "3n-icx vs 3n-skx" + reference: 1 + compare: 2 + - title: "Normalized 3n-icx vs 3n-skx" reference: 1 compare: 2 + norm-ref: "3n-skx" + norm-cmp: "3n-icx" legend: - - "" - - "3n-skx xxv710, 3n-icx xxv710 - testbeds and NICs tested." - - "Diff - difference between 3n-skx xxv710 and 3n-icx xxv710 testbeds." + - '' + - 'Test Case: Test cases executed for: MRR throughput on 3n-skx and 3n-icx with xxv710.' + - '3n-skx, 3n-icx: [Mpps +- StDev] results for VPP tested in CSIT' + - '3n-icx vs 3n-skx: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' + - 'Normalized 3n-icx vs TB3n-skxR: [% +- StDev] Normalized relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' # VPP Normalized Comparison Across Testbeds 3n-skx to 3n-icx 4c mrr - type: "table" title: "VPP Normalized Comparison Across Testbeds 3n-skx to 3n-icx 4c mrr" algorithm: "table_comparison" - output-file: "{DIR[STATIC,VPP]}/norm-compare-testbeds-3n-skx-3n-icx-4c-mrr" + output-file: "{DIR[STATIC,VPP]}/performance-compare-testbeds-3n-skx-3n-icx-4c-mrr" include-tests: "MRR" # "PDR" | "NDR" | "MRR" filter: "'NIC_Intel-XXV710' and 'MRR' and '4C'" - normalize: True columns: - title: "3n-skx xxv710" data-set: "vpp-3n-skx-curr-iter-mrr" - title: "3n-icx xxv710" data-set: "vpp-3n-icx-curr-iter-mrr" comparisons: - - title: "Diff" + - title: "3n-icx vs 3n-skx" reference: 1 compare: 2 + - title: "Normalized 3n-icx vs 3n-skx" + reference: 1 + compare: 2 + norm-ref: "3n-skx" + norm-cmp: "3n-icx" legend: - - "" - - "3n-skx xxv710, 3n-icx xxv710 - testbeds and NICs tested." - - "Diff - difference between 3n-skx xxv710 and 3n-icx xxv710 testbeds." + - '' + - 'Test Case: Test cases executed for: MRR throughput on 3n-skx and 3n-icx with xxv710.' + - '3n-skx, 3n-icx: [Mpps +- StDev] results for VPP tested in CSIT' + - '3n-icx vs 3n-skx: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' + - 'Normalized 3n-icx vs 3n-skx: [% +- StDev] Normalized relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' # DPDK Normalized Comparison Across Testbeds 2n-skx to 2n-clx ndr - type: "table" title: "DPDK Normalized Comparison Across Testbeds 2n-skx to 2n-clx ndr" algorithm: "table_comparison" - output-file: "{DIR[STATIC,DPDK]}/norm-compare-testbeds-2n-skx-2n-clx-ndr" + output-file: "{DIR[STATIC,DPDK]}/performance-compare-testbeds-2n-skx-2n-clx-ndr" include-tests: "NDR" # "PDR" | "NDR" | "MRR" filter: "'NIC_Intel-XXV710'" - normalize: True columns: - - title: "2n-skx" + - title: "2n-skx xxv710" data-set: "dpdk-2n-skx-curr-iter" - - title: "2n-clx" + - title: "2n-clx xxv710" data-set: "dpdk-2n-clx-curr-iter" comparisons: - - title: "Diff" + - title: "2n-clx vs 2n-skx" reference: 1 compare: 2 + - title: "Normalized 2n-clx vs 2n-skx" + reference: 1 + compare: 2 + norm-ref: "2n-skx" + norm-cmp: "2n-clx" legend: - - "" - - "2n-skx, 2n-clx - testbeds and NICs tested." - - "Diff - difference between 2n-skx and 2n-clx testbeds." + - '' + - 'Test Case: Test cases executed for: NDR throughput on 2n-skx and 2n-clx with xxv710.' + - '2n-skx, 2n-clx: [Mpps +- StDev] results for DPDK tested in CSIT' + - '2n-clx vs 2n-skx: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' + - 'Normalized 2n-clx vs 2n-skx: [% +- StDev] Normalized relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' # DPDK Normalized Comparison Across Testbeds 2n-skx to 2n-clx pdr - type: "table" title: "DPDK Normalized Comparison Across Testbeds 2n-skx to 2n-clx pdr" algorithm: "table_comparison" - output-file: "{DIR[STATIC,DPDK]}/norm-compare-testbeds-2n-skx-2n-clx-pdr" + output-file: "{DIR[STATIC,DPDK]}/performance-compare-testbeds-2n-skx-2n-clx-pdr" include-tests: "PDR" # "PDR" | "NDR" | "MRR" filter: "'NIC_Intel-XXV710'" - normalize: True columns: - - title: "2n-skx" + - title: "2n-skx xxv710" data-set: "dpdk-2n-skx-curr-iter" - - title: "2n-clx" + - title: "2n-clx xxv710" data-set: "dpdk-2n-clx-curr-iter" comparisons: - - title: "Diff" + - title: "2n-clx vs 2n-skx" reference: 1 compare: 2 + - title: "Normalized 2n-clx vs 2n-skx" + reference: 1 + compare: 2 + norm-ref: "2n-skx" + norm-cmp: "2n-clx" legend: - - "" - - "2n-skx, 2n-clx - testbeds and NICs tested." - - "Diff - difference between 2n-skx and 2n-clx testbeds." + - '' + - 'Test Case: Test cases executed for: PDR throughput on 2n-skx and 2n-clx with xxv710.' + - '2n-skx, 2n-clx: [Mpps +- StDev] results for DPDK tested in CSIT' + - '2n-clx vs 2n-skx: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' + - 'Normalized 2n-clx vs 2n-skx: [% +- StDev] Normalized relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' # DPDK Normalized Comparison Across Testbeds 2n-clx to 2n-icx ndr - type: "table" title: "DPDK Normalized Comparison Across Testbeds 2n-clx to 2n-icx ndr" algorithm: "table_comparison" - output-file: "{DIR[STATIC,DPDK]}/norm-compare-testbeds-2n-clx-2n-icx-ndr" + output-file: "{DIR[STATIC,DPDK]}/performance-compare-testbeds-2n-clx-2n-icx-ndr" include-tests: "NDR" # "PDR" | "NDR" | "MRR" filter: "'NIC_Intel-XXV710'" - normalize: True columns: - title: "2n-clx xxv710" data-set: "dpdk-2n-clx-curr-iter" - title: "2n-icx xxv710" data-set: "dpdk-2n-icx-curr-iter" comparisons: - - title: "Diff" + - title: "2n-icx vs 2n-clx" + reference: 1 + compare: 2 + - title: "Normalized 2n-icx vs 2n-clx" reference: 1 compare: 2 + norm-ref: "2n-clx" + norm-cmp: "2n-icx" legend: - - "" - - "2n-clx xxv710, 2n-icx xxv710 - testbeds and NICs tested." - - "Diff - difference between 2n-clx xxv710 and 2n-icx xxv710 testbeds." + - '' + - 'Test Case: Test cases executed for: NDR throughput on 2n-clx and 2n-icx with xxv710.' + - '2n-clx, 2n-icx: [Mpps +- StDev] results for DPDK tested in CSIT' + - '2n-icx vs 2n-clx: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' + - 'Normalized 2n-icx vs 2n-clx: [% +- StDev] Normalized relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' # DPDK Normalized Comparison Across Testbeds 2n-clx to 2n-icx pdr - type: "table" title: "DPDK Normalized Comparison Across Testbeds 2n-clx to 2n-icx pdr" algorithm: "table_comparison" - output-file: "{DIR[STATIC,DPDK]}/norm-compare-testbeds-2n-clx-2n-icx-pdr" + output-file: "{DIR[STATIC,DPDK]}/performance-compare-testbeds-2n-clx-2n-icx-pdr" include-tests: "PDR" # "PDR" | "NDR" | "MRR" filter: "'NIC_Intel-XXV710'" - normalize: True columns: - title: "2n-clx xxv710" data-set: "dpdk-2n-clx-curr-iter" - title: "2n-icx xxv710" data-set: "dpdk-2n-icx-curr-iter" comparisons: - - title: "Diff" + - title: "2n-icx vs 2n-clx" reference: 1 compare: 2 + - title: "Normalized 2n-icx vs 2n-clx" + reference: 1 + compare: 2 + norm-ref: "2n-clx" + norm-cmp: "2n-icx" legend: - - "" - - "2n-clx xxv710, 2n-icx xxv710 - testbeds and NICs tested." - - "Diff - difference between 2n-clx xxv710 and 2n-icx xxv710 testbeds." + - '' + - 'Test Case: Test cases executed for: PDR throughput on 2n-clx and 2n-icx with xxv710.' + - '2n-clx, 2n-icx: [Mpps +- StDev] results for DPDK tested in CSIT' + - '2n-icx vs 2n-clx: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' + - 'Normalized 2n-icx vs 2n-clx: [% +- StDev] Normalized relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' # DPDK Normalized Comparison Across Testbeds 2n-skx to 2n-icx ndr - type: "table" title: "DPDK Normalized Comparison Across Testbeds 2n-skx to 2n-icx ndr" algorithm: "table_comparison" - output-file: "{DIR[STATIC,DPDK]}/norm-compare-testbeds-2n-skx-2n-icx-ndr" + output-file: "{DIR[STATIC,DPDK]}/performance-compare-testbeds-2n-skx-2n-icx-ndr" include-tests: "NDR" # "PDR" | "NDR" | "MRR" filter: "'NIC_Intel-XXV710'" - normalize: True columns: - title: "2n-skx xxv710" data-set: "dpdk-2n-skx-curr-iter" - title: "2n-icx xxv710" data-set: "dpdk-2n-icx-curr-iter" comparisons: - - title: "Diff" + - title: "2n-icx vs 2n-skx" + reference: 1 + compare: 2 + - title: "Normalized 2n-icx vs 2n-clx" reference: 1 compare: 2 + norm-ref: "2n-skx" + norm-cmp: "2n-icx" legend: - - "" - - "2n-skx xxv710, 2n-icx xxv710 - testbeds and NICs tested." - - "Diff - difference between 2n-skx xxv710 and 2n-icx xxv710 testbeds." + - '' + - 'Test Case: Test cases executed for: NDR throughput on 2n-icx and 2n-icx with xxv710.' + - '2n-icx, 2n-icx: [Mpps +- StDev] results for DPDK tested in CSIT' + - '2n-icx vs 2n-icx: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' + - 'Normalized 2n-icx vs 2n-icx: [% +- StDev] Normalized relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' # DPDK Normalized Comparison Across Testbeds 2n-skx to 2n-icx pdr - type: "table" title: "DPDK Normalized Comparison Across Testbeds 2n-skx to 2n-icx pdr" algorithm: "table_comparison" - output-file: "{DIR[STATIC,DPDK]}/norm-compare-testbeds-2n-skx-2n-icx-pdr" + output-file: "{DIR[STATIC,DPDK]}/performance-compare-testbeds-2n-skx-2n-icx-pdr" include-tests: "PDR" # "PDR" | "NDR" | "MRR" filter: "'NIC_Intel-XXV710'" - normalize: True columns: - title: "2n-skx xxv710" data-set: "dpdk-2n-skx-curr-iter" - title: "2n-icx xxv710" data-set: "dpdk-2n-icx-curr-iter" comparisons: - - title: "Diff" + - title: "2n-icx vs 2n-skx" + reference: 1 + compare: 2 + - title: "Normalized 2n-icx vs 2n-clx" reference: 1 compare: 2 + norm-ref: "2n-skx" + norm-cmp: "2n-icx" legend: - - "" - - "2n-skx xxv710, 2n-icx xxv710 - testbeds and NICs tested." - - "Diff - difference between 2n-skx xxv710 and 2n-icx xxv710 testbeds." + - '' + - 'Test Case: Test cases executed for: PDR throughput on 2n-icx and T2n-icxBC with xxv710.' + - '2n-icx, 2n-icx: [Mpps +- StDev] results for DPDK tested in CSIT' + - '2n-icx vs 2n-icx: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' + - 'Normalized 2n-icx vs 2n-icx: [% +- StDev] Normalized relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' # DPDK Normalized Comparison Across Testbeds 3n-skx to 3n-icx ndr - type: "table" title: "DPDK Normalized Comparison Across Testbeds 3n-skx to 3n-icx ndr" algorithm: "table_comparison" - output-file: "{DIR[STATIC,DPDK]}/norm-compare-testbeds-3n-skx-3n-icx-ndr" + output-file: "{DIR[STATIC,DPDK]}/performance-compare-testbeds-3n-skx-3n-icx-ndr" include-tests: "NDR" # "PDR" | "NDR" | "MRR" filter: "'NIC_Intel-XXV710'" - normalize: True columns: - title: "3n-skx xxv710" data-set: "dpdk-3n-skx-curr-iter" - title: "3n-icx xxv710" data-set: "dpdk-3n-icx-curr-iter" comparisons: - - title: "Diff" + - title: "3n-icx vs 3n-skx" reference: 1 compare: 2 + - title: "Normalized 3n-icx vs 3n-clx" + reference: 1 + compare: 2 + norm-ref: "3n-skx" + norm-cmp: "3n-icx" legend: - - "" - - "3n-skx xxv710, 3n-icx xxv710 - testbeds and NICs tested." - - "Diff - difference between 3n-skx xxv710 and 3n-icx xxv710 testbeds." + - '' + - 'Test Case: Test cases executed for: NDR throughput on 3n-skx and 3n-icx with xxv710.' + - '3n-skx, 3n-icx: [Mpps +- StDev] results for DPDK tested in CSIT' + - '3n-icx vs 3n-skx: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' + - 'Normalized 3n-icx vs 3n-skx: [% +- StDev] Normalized relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' # DPDK Normalized Comparison Across Testbeds 3n-skx to 3n-icx pdr - type: "table" title: "DPDK Normalized Comparison Across Testbeds 3n-skx to 3n-icx pdr" algorithm: "table_comparison" - output-file: "{DIR[STATIC,DPDK]}/norm-compare-testbeds-3n-skx-3n-icx-pdr" + output-file: "{DIR[STATIC,DPDK]}/performance-compare-testbeds-3n-skx-3n-icx-pdr" include-tests: "PDR" # "PDR" | "NDR" | "MRR" filter: "'NIC_Intel-XXV710'" - normalize: True columns: - title: "3n-skx xxv710" data-set: "dpdk-3n-skx-curr-iter" - title: "3n-icx xxv710" data-set: "dpdk-3n-icx-curr-iter" comparisons: - - title: "Diff" + - title: "3n-icx vs 3n-skx" reference: 1 compare: 2 + - title: "Normalized 3n-icx vs 3n-clx" + reference: 1 + compare: 2 + norm-ref: "3n-skx" + norm-cmp: "3n-icx" legend: - - "" - - "3n-skx xxv710, 3n-icx xxv710 - testbeds and NICs tested." - - "Diff - difference between 3n-skx xxv710 and 3n-icx xxv710 testbeds." + - '' + - 'Test Case: Test cases executed for: PDR throughput on 3n-skx and 3n-icx with xxv710.' + - '3n-skx, 3n-icx: [Mpps +- StDev] results for DPDK tested in CSIT' + - '3n-icx vs 3n-skx: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' + - 'Normalized 3n-icx vs 3n-skx: [% +- StDev] Normalized relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' # VPP Latency Changes 3n-skx 2t1c - type: "table" @@ -1522,10 +1738,10 @@ compare: 4 legend: - '' - - 'Test Case: Test cases executed for: PDR throughput on 3n-skx with xxv710.' - - 'YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' - - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' - - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' + - 'Test Case: Test cases executed for: PDR throughput on 3n-skx with xxv710.' + - 'YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' + - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' + - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' - '2206.0-10 vs 2202.0-10: Compares VPP code current vs previous in the current CSIT environment.' # VPP Latency Changes 3n-skx 2t1c @@ -1553,10 +1769,10 @@ compare: 4 legend: - '' - - 'Test Case: Test cases executed for: PDR throughput on 3n-skx with xxv710.' - - 'YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' - - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' - - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' + - 'Test Case: Test cases executed for: PDR throughput on 3n-skx with xxv710.' + - 'YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' + - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' + - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' - '2206.0-10 vs 2202.0-10: Compares VPP code current vs previous in the current CSIT environment.' # VPP Latency Changes 3n-skx 2t1c @@ -1584,10 +1800,10 @@ compare: 4 legend: - '' - - 'Test Case: Test cases executed for: PDR throughput on 3n-skx with xxv710.' - - 'YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' - - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' - - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' + - 'Test Case: Test cases executed for: PDR throughput on 3n-skx with xxv710.' + - 'YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' + - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' + - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' - '2206.0-10 vs 2202.0-10: Compares VPP code current vs previous in the current CSIT environment.' # VPP Latency Changes 2n-skx 2t1c @@ -1615,10 +1831,10 @@ compare: 4 legend: - '' - - 'Test Case: Test cases executed for: PDR throughput on 2n-skx with xxv710.' - - 'YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' - - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' - - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' + - 'Test Case: Test cases executed for: PDR throughput on 2n-skx with xxv710.' + - 'YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' + - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' + - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' - '2206.0-10 vs 2202.0-10: Compares VPP code current vs previous in the current CSIT environment.' # VPP Latency Changes 2n-skx 2t1c @@ -1646,10 +1862,10 @@ compare: 4 legend: - '' - - 'Test Case: Test cases executed for: PDR throughput on 2n-skx with xxv710.' - - 'YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' - - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' - - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' + - 'Test Case: Test cases executed for: PDR throughput on 2n-skx with xxv710.' + - 'YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' + - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' + - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' - '2206.0-10 vs 2202.0-10: Compares VPP code current vs previous in the current CSIT environment.' # VPP Latency Changes 2n-skx 2t1c @@ -1677,10 +1893,10 @@ compare: 4 legend: - '' - - 'Test Case: Test cases executed for: PDR throughput on 2n-skx with xxv710.' - - 'YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' - - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' - - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' + - 'Test Case: Test cases executed for: PDR throughput on 2n-skx with xxv710.' + - 'YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' + - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' + - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' - '2206.0-10 vs 2202.0-10: Compares VPP code current vs previous in the current CSIT environment.' # VPP Latency Changes 2n-clx 2t1c @@ -1708,10 +1924,10 @@ compare: 4 legend: - '' - - 'Test Case: Test cases executed for: PDR throughput on 2n-clx with xxv710.' - - 'YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' - - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' - - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' + - 'Test Case: Test cases executed for: PDR throughput on 2n-clx with xxv710.' + - 'YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' + - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' + - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' - '2206.0-10 vs 2202.0-10: Compares VPP code current vs previous in the current CSIT environment.' # VPP Latency Changes 2n-clx 2t1c @@ -1739,10 +1955,10 @@ compare: 4 legend: - '' - - 'Test Case: Test cases executed for: PDR throughput on 2n-clx with xxv710.' - - 'YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' - - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' - - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' + - 'Test Case: Test cases executed for: PDR throughput on 2n-clx with xxv710.' + - 'YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' + - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' + - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' - '2206.0-10 vs 2202.0-10: Compares VPP code current vs previous in the current CSIT environment.' # VPP Latency Changes 2n-clx 2t1c @@ -1770,10 +1986,10 @@ compare: 4 legend: - '' - - 'Test Case: Test cases executed for: PDR throughput on 2n-clx with xxv710.' - - 'YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' - - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' - - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' + - 'Test Case: Test cases executed for: PDR throughput on 2n-clx with xxv710.' + - 'YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' + - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' + - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' - '2206.0-10 vs 2202.0-10: Compares VPP code current vs previous in the current CSIT environment.' # VPP Latency Changes 2n-clx 2t1c @@ -1801,10 +2017,10 @@ compare: 4 legend: - '' - - 'Test Case: Test cases executed for: PDR throughput on 2n-clx with cx556a.' - - 'YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' - - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' - - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' + - 'Test Case: Test cases executed for: PDR throughput on 2n-clx with cx556a.' + - 'YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' + - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' + - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' - '2206.0-10 vs 2202.0-10: Compares VPP code current vs previous in the current CSIT environment.' # VPP Latency Changes 2n-clx 2t1c @@ -1832,10 +2048,10 @@ compare: 4 legend: - '' - - 'Test Case: Test cases executed for: PDR throughput on 2n-clx with cx556a.' - - 'YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' - - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' - - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' + - 'Test Case: Test cases executed for: PDR throughput on 2n-clx with cx556a.' + - 'YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' + - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' + - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' - '2206.0-10 vs 2202.0-10: Compares VPP code current vs previous in the current CSIT environment.' # VPP Latency Changes 2n-clx 2t1c @@ -1863,10 +2079,10 @@ compare: 4 legend: - '' - - 'Test Case: Test cases executed for: PDR throughput on 2n-clx with cx556a.' - - 'YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' - - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' - - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' + - 'Test Case: Test cases executed for: PDR throughput on 2n-clx with cx556a.' + - 'YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' + - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' + - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' - '2206.0-10 vs 2202.0-10: Compares VPP code current vs previous in the current CSIT environment.' # VPP Latency Changes 2n-zn2 2t1c @@ -1894,10 +2110,10 @@ compare: 4 legend: - '' - - 'Test Case: Test cases executed for: PDR throughput on 2n-zn2 with xxv710.' - - 'YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' - - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' - - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' + - 'Test Case: Test cases executed for: PDR throughput on 2n-zn2 with xxv710.' + - 'YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' + - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' + - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' - '2206.0-10 vs 2202.0-10: Compares VPP code current vs previous in the current CSIT environment.' # VPP Latency Changes 2n-zn2 2t1c @@ -1925,10 +2141,10 @@ compare: 4 legend: - '' - - 'Test Case: Test cases executed for: PDR throughput on 2n-zn2 with xxv710.' - - 'YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' - - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' - - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' + - 'Test Case: Test cases executed for: PDR throughput on 2n-zn2 with xxv710.' + - 'YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' + - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' + - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' - '2206.0-10 vs 2202.0-10: Compares VPP code current vs previous in the current CSIT environment.' # VPP Latency Changes 2n-zn2 2t1c @@ -1956,10 +2172,10 @@ compare: 4 legend: - '' - - 'Test Case: Test cases executed for: PDR throughput on 2n-zn2 with xxv710.' - - 'YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' - - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' - - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' + - 'Test Case: Test cases executed for: PDR throughput on 2n-zn2 with xxv710.' + - 'YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' + - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' + - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' - '2206.0-10 vs 2202.0-10: Compares VPP code current vs previous in the current CSIT environment.' # VPP Latency Changes 2n-tx2 1t1c @@ -1987,10 +2203,10 @@ compare: 4 legend: - '' - - 'Test Case: Test cases executed for: PDR throughput on 2n-tx2 with xl710.' - - 'YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' - - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' - - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' + - 'Test Case: Test cases executed for: PDR throughput on 2n-tx2 with xl710.' + - 'YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' + - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' + - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' - '2206.0-10 vs 2202.0-10: Compares VPP code current vs previous in the current CSIT environment.' # VPP Latency Changes 2n-tx2 1t1c @@ -2018,10 +2234,10 @@ compare: 4 legend: - '' - - 'Test Case: Test cases executed for: PDR throughput on 2n-tx2 with xl710.' - - 'YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' - - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' - - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' + - 'Test Case: Test cases executed for: PDR throughput on 2n-tx2 with xl710.' + - 'YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' + - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' + - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' - '2206.0-10 vs 2202.0-10: Compares VPP code current vs previous in the current CSIT environment.' # VPP Latency Changes 2n-tx2 1t1c @@ -2049,10 +2265,10 @@ compare: 4 legend: - '' - - 'Test Case: Test cases executed for: PDR throughput on 2n-tx2 with xl710.' - - 'YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' - - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' - - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' + - 'Test Case: Test cases executed for: PDR throughput on 2n-tx2 with xl710.' + - 'YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' + - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' + - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' - '2206.0-10 vs 2202.0-10: Compares VPP code current vs previous in the current CSIT environment.' # VPP Latency Changes 3n-tsh 1t1c @@ -2080,10 +2296,10 @@ compare: 4 legend: - '' - - 'Test Case: Test cases executed for: PDR throughput on 3n-tsh with x520.' - - 'YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' - - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' - - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' + - 'Test Case: Test cases executed for: PDR throughput on 3n-tsh with x520.' + - 'YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' + - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' + - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' - '2206.0-10 vs 2202.0-10: Compares VPP code current vs previous in the current CSIT environment.' # VPP Latency Changes 3n-tsh 1t1c @@ -2111,10 +2327,10 @@ compare: 4 legend: - '' - - 'Test Case: Test cases executed for: PDR throughput on 3n-tsh with x520.' - - 'YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' - - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' - - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' + - 'Test Case: Test cases executed for: PDR throughput on 3n-tsh with x520.' + - 'YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' + - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' + - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' - '2206.0-10 vs 2202.0-10: Compares VPP code current vs previous in the current CSIT environment.' # VPP Latency Changes 3n-tsh 1t1c @@ -2142,10 +2358,10 @@ compare: 4 legend: - '' - - 'Test Case: Test cases executed for: PDR throughput on 3n-tsh with x520.' - - 'YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' - - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' - - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' + - 'Test Case: Test cases executed for: PDR throughput on 3n-tsh with x520.' + - 'YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' + - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' + - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' - '2206.0-10 vs 2202.0-10: Compares VPP code current vs previous in the current CSIT environment.' # VPP Latency Changes 3n-icx 2t1c @@ -2173,10 +2389,10 @@ compare: 3 legend: - '' - - 'Test Case: Test cases executed for: PDR throughput on 3n-icx with xxv710.' - - 'YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' - - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' - - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' + - 'Test Case: Test cases executed for: PDR throughput on 3n-icx with xxv710.' + - 'YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' + - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' + - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' - '2206.0-10 vs 2202.0-10: Compares VPP code current vs previous in the current CSIT environment.' # VPP Latency Changes 3n-icx 2t1c @@ -2204,10 +2420,10 @@ compare: 3 legend: - '' - - 'Test Case: Test cases executed for: PDR throughput on 3n-icx with xxv710.' - - 'YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' - - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' - - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' + - 'Test Case: Test cases executed for: PDR throughput on 3n-icx with xxv710.' + - 'YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' + - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' + - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' - '2206.0-10 vs 2202.0-10: Compares VPP code current vs previous in the current CSIT environment.' # VPP Latency Changes 3n-icx 2t1c @@ -2235,10 +2451,10 @@ compare: 3 legend: - '' - - 'Test Case: Test cases executed for: PDR throughput on 3n-icx with xxv710.' - - 'YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' - - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' - - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' + - 'Test Case: Test cases executed for: PDR throughput on 3n-icx with xxv710.' + - 'YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' + - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' + - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' - '2206.0-10 vs 2202.0-10: Compares VPP code current vs previous in the current CSIT environment.' # VPP Latency Changes 2n-icx 2t1c @@ -2266,10 +2482,10 @@ compare: 3 legend: - '' - - 'Test Case: Test cases executed for: PDR throughput on 2n-icx with xxv710.' - - 'YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' - - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' - - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' + - 'Test Case: Test cases executed for: PDR throughput on 2n-icx with xxv710.' + - 'YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' + - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' + - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' - '2206.0-10 vs 2202.0-10: Compares VPP code current vs previous in the current CSIT environment.' # VPP Latency Changes 2n-icx 2t1c @@ -2297,10 +2513,10 @@ compare: 3 legend: - '' - - 'Test Case: Test cases executed for: PDR throughput on 2n-icx with xxv710.' - - 'YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' - - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' - - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' + - 'Test Case: Test cases executed for: PDR throughput on 2n-icx with xxv710.' + - 'YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' + - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' + - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' - '2206.0-10 vs 2202.0-10: Compares VPP code current vs previous in the current CSIT environment.' # VPP Latency Changes 2n-icx 2t1c @@ -2328,10 +2544,10 @@ compare: 3 legend: - '' - - 'Test Case: Test cases executed for: PDR throughput on 2n-icx with xxv710.' - - 'YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' - - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' - - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' + - 'Test Case: Test cases executed for: PDR throughput on 2n-icx with xxv710.' + - 'YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' + - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' + - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' - '2206.0-10 vs 2202.0-10: Compares VPP code current vs previous in the current CSIT environment.' # VPP Soak vs NDR - 2n-icx @@ -2408,13 +2624,14 @@ data-set: "vpp-3n-skx-curr-iter" tag: "NIC_Intel-XXV710" comparisons: - - title: "Diff" + - title: "xxv710 vs x710" reference: 1 compare: 2 legend: - - "" - - "x710, xxv710 - NICs tested." - - "Diff - difference between x710 and xxv710 NIC." + - '' + - 'Test Case: Test cases executed for: NDR throughput on 3n-skx with x710 and xxv710.' + - 'x710, xxv710: [Mpps +- StDev] results for VPP tested in CSIT' + - 'xxv710 vs x710: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' # VPP Compare NICs 3n-skx 4t2c ndr - type: "table" @@ -2431,13 +2648,14 @@ data-set: "vpp-3n-skx-curr-iter" tag: "NIC_Intel-XXV710" comparisons: - - title: "Diff" + - title: "xxv710 vs x710" reference: 1 compare: 2 legend: - - "" - - "x710, xxv710 - NICs tested." - - "Diff - difference between x710 and xxv710 NIC." + - '' + - 'Test Case: Test cases executed for: NDR throughput on 3n-skx with x710 and xxv710.' + - 'x710, xxv710: [Mpps +- StDev] results for VPP tested in CSIT' + - 'xxv710 vs x710: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' # VPP Compare NICs 3n-skx 2t1c pdr - type: "table" @@ -2454,13 +2672,14 @@ data-set: "vpp-3n-skx-curr-iter" tag: "NIC_Intel-XXV710" comparisons: - - title: "Diff" + - title: "xxv710 vs x710" reference: 1 compare: 2 legend: - - "" - - "x710, xxv710 - NICs tested." - - "Diff - difference between x710 and xxv710 NIC." + - '' + - 'Test Case: Test cases executed for: PDR throughput on 3n-skx with x710 and xxv710.' + - 'x710, xxv710: [Mpps +- StDev] results for VPP tested in CSIT' + - 'xxv710 vs x710: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' # VPP Compare NICs 3n-skx 4t2c pdr - type: "table" @@ -2477,13 +2696,14 @@ data-set: "vpp-3n-skx-curr-iter" tag: "NIC_Intel-XXV710" comparisons: - - title: "Diff" + - title: "xxv710 vs x710" reference: 1 compare: 2 legend: - - "" - - "x710, xxv710 - NICs tested." - - "Diff - difference between x710 and xxv710 NIC." + - '' + - 'Test Case: Test cases executed for: PDR throughput on 3n-skx with x710 and xxv710.' + - 'x710, xxv710: [Mpps +- StDev] results for VPP tested in CSIT' + - 'xxv710 vs x710: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' # VPP Compare NICs 3n-skx 2t1c mrr - type: "table" @@ -2500,13 +2720,14 @@ data-set: "vpp-3n-skx-curr-iter-mrr" tag: "NIC_Intel-XXV710" comparisons: - - title: "Diff" + - title: "xxv710 vs x710" reference: 1 compare: 2 legend: - - "" - - "x710, xxv710 - NICs tested." - - "Diff - difference between x710 and xxv710 NIC." + - '' + - 'Test Case: Test cases executed for: MRR throughput on 3n-skx with x710 and xxv710.' + - 'x710, xxv710: [Mpps +- StDev] results for VPP tested in CSIT' + - 'xxv710 vs x710: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' # VPP Compare NICs 3n-skx 4t2c mrr - type: "table" @@ -2523,13 +2744,14 @@ data-set: "vpp-3n-skx-curr-iter-mrr" tag: "NIC_Intel-XXV710" comparisons: - - title: "Diff" + - title: "xxv710 vs x710" reference: 1 compare: 2 legend: - - "" - - "x710, xxv710 - NICs tested." - - "Diff - difference between x710 and xxv710 NIC." + - '' + - 'Test Case: Test cases executed for: MRR throughput on 3n-skx with x710 and xxv710.' + - 'x710, xxv710: [Mpps +- StDev] results for VPP tested in CSIT' + - 'xxv710 vs x710: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' # VPP Compare NICs 3n-skx 8t4c mrr - type: "table" @@ -2546,13 +2768,14 @@ data-set: "vpp-3n-skx-curr-iter-mrr" tag: "NIC_Intel-XXV710" comparisons: - - title: "Diff" + - title: "xxv710 vs x710" reference: 1 compare: 2 legend: - - "" - - "x710, xxv710 - NICs tested." - - "Diff - difference between x710 and xxv710 NIC." + - '' + - 'Test Case: Test cases executed for: MRR throughput on 3n-skx with x710 and xxv710.' + - 'x710, xxv710: [Mpps +- StDev] results for VPP tested in CSIT' + - 'xxv710 vs x710: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' # VPP Compare NICs 2n-skx 2t1c ndr - type: "table" @@ -2569,13 +2792,14 @@ data-set: "vpp-2n-skx-curr-iter" tag: "NIC_Intel-XXV710" comparisons: - - title: "Diff" + - title: "xxv710 vs x710" reference: 1 compare: 2 legend: - - "" - - "x710, xxv710 - NICs tested." - - "Diff - difference between x710 and xxv710 NIC." + - '' + - 'Test Case: Test cases executed for: NDR throughput on 2n-skx with x710 and xxv710.' + - 'x710, xxv710: [Mpps +- StDev] results for VPP tested in CSIT' + - 'xxv710 vs x710: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' # VPP Compare NICs 2n-skx 4t2c ndr - type: "table" @@ -2592,13 +2816,14 @@ data-set: "vpp-2n-skx-curr-iter" tag: "NIC_Intel-XXV710" comparisons: - - title: "Diff" + - title: "xxv710 vs x710" reference: 1 compare: 2 legend: - - "" - - "x710, xxv710 - NICs tested." - - "Diff - difference between x710 and xxv710 NIC." + - '' + - 'Test Case: Test cases executed for: NDR throughput on 2n-skx with x710 and xxv710.' + - 'x710, xxv710: [Mpps +- StDev] results for VPP tested in CSIT' + - 'xxv710 vs x710: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' # VPP Compare NICs 2n-skx 2t1c pdr - type: "table" @@ -2615,13 +2840,14 @@ data-set: "vpp-2n-skx-curr-iter" tag: "NIC_Intel-XXV710" comparisons: - - title: "Diff" + - title: "xxv710 vs x710" reference: 1 compare: 2 legend: - - "" - - "x710, xxv710 - NICs tested." - - "Diff - difference between x710 and xxv710 NIC." + - '' + - 'Test Case: Test cases executed for: PDR throughput on 2n-skx with x710 and xxv710.' + - 'x710, xxv710: [Mpps +- StDev] results for VPP tested in CSIT' + - 'xxv710 vs x710: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' # VPP Compare NICs 2n-skx 4t2c pdr - type: "table" @@ -2638,13 +2864,14 @@ data-set: "vpp-2n-skx-curr-iter" tag: "NIC_Intel-XXV710" comparisons: - - title: "Diff" + - title: "xxv710 vs x710" reference: 1 compare: 2 legend: - - "" - - "x710, xxv710 - NICs tested." - - "Diff - difference between x710 and xxv710 NIC." + - '' + - 'Test Case: Test cases executed for: PDR throughput on 2n-skx with x710 and xxv710.' + - 'x710, xxv710: [Mpps +- StDev] results for VPP tested in CSIT' + - 'xxv710 vs x710: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' # VPP Compare NICs 2n-skx 2t1c mrr - type: "table" @@ -2661,13 +2888,14 @@ data-set: "vpp-2n-skx-curr-iter-mrr" tag: "NIC_Intel-XXV710" comparisons: - - title: "Diff" + - title: "xxv710 vs x710" reference: 1 compare: 2 legend: - - "" - - "x710, xxv710 - NICs tested." - - "Diff - difference between x710 and xxv710 NIC." + - '' + - 'Test Case: Test cases executed for: MRR throughput on 2n-skx with x710 and xxv710.' + - 'x710, xxv710: [Mpps +- StDev] results for VPP tested in CSIT' + - 'xxv710 vs x710: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' # VPP Compare NICs 2n-skx 4t2c mrr - type: "table" @@ -2684,13 +2912,14 @@ data-set: "vpp-2n-skx-curr-iter-mrr" tag: "NIC_Intel-XXV710" comparisons: - - title: "Diff" + - title: "xxv710 vs x710" reference: 1 compare: 2 legend: - - "" - - "x710, xxv710 - NICs tested." - - "Diff - difference between x710 and xxv710 NIC." + - '' + - 'Test Case: Test cases executed for: MRR throughput on 2n-skx with x710 and xxv710.' + - 'x710, xxv710: [Mpps +- StDev] results for VPP tested in CSIT' + - 'xxv710 vs x710: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' # VPP Compare NICs 2n-skx 8t4c mrr - type: "table" @@ -2707,13 +2936,14 @@ data-set: "vpp-2n-skx-curr-iter-mrr" tag: "NIC_Intel-XXV710" comparisons: - - title: "Diff" + - title: "xxv710 vs x710" reference: 1 compare: 2 legend: - - "" - - "x710, xxv710 - NICs tested." - - "Diff - difference between x710 and xxv710 NIC." + - '' + - 'Test Case: Test cases executed for: MRR throughput on 2n-skx with x710 and xxv710.' + - 'x710, xxv710: [Mpps +- StDev] results for VPP tested in CSIT' + - 'xxv710 vs x710: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' ################################################################################ # VPP @@ -2738,9 +2968,9 @@ compare: 3 legend: - '' - - 'Test Case: Test cases executed for: Hoststack on 3n-skx with xxv710.' - - 'YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' - - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' + - 'Test Case: Test cases executed for: Hoststack on 3n-skx with xxv710.' + - 'YYMM.V-E: [Mbps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' + - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' - '2206.0-10 vs 2202.0-9: Compares VPP code current vs previous.' # VPP Performance Changes 2n-clx VSAP @@ -2763,9 +2993,9 @@ compare: 3 legend: - '' - - 'Test Case: Test cases executed for: VSAP on 2n-clx with cx556a.' - - 'YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' - - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' + - 'Test Case: Test cases executed for: VSAP on 2n-clx with cx556a.' + - 'YYMM.V-E: [cps/rps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' + - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' - '2206.0-10 vs 2202.0-9: Compares VPP code current vs previous.' # VPP Performance Changes 3n-icx 2t1c pdr @@ -2793,10 +3023,10 @@ compare: 3 legend: - '' - - 'Test Case: Test cases executed for: PDR throughput on 3n-icx with xxv710.' - - 'YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' - - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' - - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' + - 'Test Case: Test cases executed for: PDR throughput on 3n-icx with xxv710.' + - 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' + - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' + - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' - '2206.0-10 vs 2202.0-10: Compares VPP code current vs previous in the current CSIT environment.' # VPP Performance Changes 3n-icx 4t2c pdr @@ -2824,10 +3054,10 @@ compare: 3 legend: - '' - - 'Test Case: Test cases executed for: PDR throughput on 3n-icx with xxv710.' - - 'YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' - - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' - - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' + - 'Test Case: Test cases executed for: PDR throughput on 3n-icx with xxv710.' + - 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' + - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' + - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' - '2206.0-10 vs 2202.0-10: Compares VPP code current vs previous in the current CSIT environment.' # VPP Performance Changes 3n-icx 2t1c ndr @@ -2855,10 +3085,10 @@ compare: 3 legend: - '' - - 'Test Case: Test cases executed for: PDR throughput on 3n-icx with xxv710.' - - 'YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' - - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' - - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' + - 'Test Case: Test cases executed for: NDR throughput on 3n-icx with xxv710.' + - 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' + - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' + - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' - '2206.0-10 vs 2202.0-10: Compares VPP code current vs previous in the current CSIT environment.' # VPP Performance Changes 3n-icx 4t2c ndr @@ -2886,10 +3116,10 @@ compare: 3 legend: - '' - - 'Test Case: Test cases executed for: PDR throughput on 3n-icx with xxv710.' - - 'YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' - - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' - - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' + - 'Test Case: Test cases executed for: NDR throughput on 3n-icx with xxv710.' + - 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' + - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' + - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' - '2206.0-10 vs 2202.0-10: Compares VPP code current vs previous in the current CSIT environment.' # VPP Performance Changes 2n-icx 2t1c pdr @@ -2917,10 +3147,10 @@ compare: 3 legend: - '' - - 'Test Case: Test cases executed for: PDR throughput on 2n-icx with xxv710.' - - 'YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' - - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' - - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' + - 'Test Case: Test cases executed for: PDR throughput on 2n-icx with xxv710.' + - 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' + - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' + - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' - '2206.0-10 vs 2202.0-10: Compares VPP code current vs previous in the current CSIT environment.' # VPP Performance Changes 2n-icx 4t2c pdr @@ -2948,10 +3178,10 @@ compare: 3 legend: - '' - - 'Test Case: Test cases executed for: PDR throughput on 2n-icx with xxv710.' - - 'YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' - - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' - - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' + - 'Test Case: Test cases executed for: PDR throughput on 2n-icx with xxv710.' + - 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' + - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' + - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' - '2206.0-10 vs 2202.0-10: Compares VPP code current vs previous in the current CSIT environment.' # VPP Performance Changes 2n-icx 2t1c ndr @@ -2979,10 +3209,10 @@ compare: 3 legend: - '' - - 'Test Case: Test cases executed for: PDR throughput on 2n-icx with xxv710.' - - 'YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' - - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' - - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' + - 'Test Case: Test cases executed for: NDR throughput on 2n-icx with xxv710.' + - 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' + - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' + - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' - '2206.0-10 vs 2202.0-10: Compares VPP code current vs previous in the current CSIT environment.' # VPP Performance Changes 2n-icx 4t2c ndr @@ -3010,10 +3240,10 @@ compare: 3 legend: - '' - - 'Test Case: Test cases executed for: PDR throughput on 2n-icx with xxv710.' - - 'YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' - - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' - - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' + - 'Test Case: Test cases executed for: NDR throughput on 2n-icx with xxv710.' + - 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' + - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' + - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' - '2206.0-10 vs 2202.0-10: Compares VPP code current vs previous in the current CSIT environment.' # VPP Performance Changes 3n-skx 2t1c pdr @@ -3041,10 +3271,10 @@ compare: 4 legend: - '' - - 'Test Case: Test cases executed for: PDR throughput on 3n-skx with xxv710.' - - 'YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' - - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' - - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' + - 'Test Case: Test cases executed for: PDR throughput on 3n-skx with xxv710.' + - 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' + - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' + - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' - '2206.0-10 vs 2202.0-10: Compares VPP code current vs previous in the current CSIT environment.' # VPP Performance Changes 3n-skx 4t2c pdr @@ -3072,10 +3302,10 @@ compare: 4 legend: - '' - - 'Test Case: Test cases executed for: PDR throughput on 3n-skx with xxv710.' - - 'YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' - - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' - - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' + - 'Test Case: Test cases executed for: PDR throughput on 3n-skx with xxv710.' + - 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' + - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' + - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' - '2206.0-10 vs 2202.0-10: Compares VPP code current vs previous in the current CSIT environment.' # VPP Performance Changes 3n-skx 2t1c ndr @@ -3103,8 +3333,8 @@ compare: 4 legend: - '' - - 'Test Case: Test cases executed for: PDR throughput on 3n-skx with xxv710.' - - 'YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' + - 'Test Case: Test cases executed for: NDR throughput on 3n-skx with xxv710.' + - 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' - '2206.0-10 vs 2202.0-10: Compares VPP code current vs previous in the current CSIT environment.' @@ -3134,10 +3364,10 @@ compare: 4 legend: - '' - - 'Test Case: Test cases executed for: PDR throughput on 3n-skx with xxv710.' - - 'YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' - - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' - - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' + - 'Test Case: Test cases executed for: NDR throughput on 3n-skx with xxv710.' + - 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' + - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' + - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' - '2206.0-10 vs 2202.0-10: Compares VPP code current vs previous in the current CSIT environment.' # VPP Performance Changes 2n-skx 2t1c pdr @@ -3165,10 +3395,10 @@ compare: 4 legend: - '' - - 'Test Case: Test cases executed for: PDR throughput on 2n-skx with xxv710.' - - 'YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' - - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' - - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' + - 'Test Case: Test cases executed for: PDR throughput on 2n-skx with xxv710.' + - 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' + - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' + - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' - '2206.0-10 vs 2202.0-10: Compares VPP code current vs previous in the current CSIT environment.' # VPP Performance Changes 2n-skx 4t2c pdr @@ -3196,10 +3426,10 @@ compare: 4 legend: - '' - - 'Test Case: Test cases executed for: PDR throughput on 2n-skx with xxv710.' - - 'YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' - - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' - - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' + - 'Test Case: Test cases executed for: PDR throughput on 2n-skx with xxv710.' + - 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' + - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' + - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' - '2206.0-10 vs 2202.0-10: Compares VPP code current vs previous in the current CSIT environment.' # VPP Performance Changes 2n-skx 2t1c ndr @@ -3227,10 +3457,10 @@ compare: 4 legend: - '' - - 'Test Case: Test cases executed for: PDR throughput on 2n-skx with xxv710.' - - 'YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' - - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' - - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' + - 'Test Case: Test cases executed for: NDR throughput on 2n-skx with xxv710.' + - 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' + - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' + - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' - '2206.0-10 vs 2202.0-10: Compares VPP code current vs previous in the current CSIT environment.' # VPP Performance Changes 2n-skx 4t2c ndr @@ -3258,10 +3488,10 @@ compare: 4 legend: - '' - - 'Test Case: Test cases executed for: PDR throughput on 2n-skx with xxv710.' - - 'YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' - - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' - - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' + - 'Test Case: Test cases executed for: NDR throughput on 2n-skx with xxv710.' + - 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' + - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' + - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' - '2206.0-10 vs 2202.0-10: Compares VPP code current vs previous in the current CSIT environment.' # VPP Performance Changes 2n-clx-xxv710 2t1c pdr @@ -3289,10 +3519,10 @@ compare: 4 legend: - '' - - 'Test Case: Test cases executed for: PDR throughput on 2n-clx with xxv710.' - - 'YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' - - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' - - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' + - 'Test Case: Test cases executed for: PDR throughput on 2n-clx with xxv710.' + - 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' + - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' + - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' - '2206.0-10 vs 2202.0-10: Compares VPP code current vs previous in the current CSIT environment.' # VPP Performance Changes 2n-clx-xxv710 4t2c pdr @@ -3320,10 +3550,10 @@ compare: 4 legend: - '' - - 'Test Case: Test cases executed for: PDR throughput on 2n-clx with xxv710.' - - 'YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' - - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' - - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' + - 'Test Case: Test cases executed for: PDR throughput on 2n-clx with xxv710.' + - 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' + - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' + - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' - '2206.0-10 vs 2202.0-10: Compares VPP code current vs previous in the current CSIT environment.' # VPP Performance Changes 2n-clx-xxv710 2t1c ndr @@ -3351,10 +3581,10 @@ compare: 4 legend: - '' - - 'Test Case: Test cases executed for: PDR throughput on 2n-clx with xxv710.' - - 'YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' - - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' - - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' + - 'Test Case: Test cases executed for: NDR throughput on 2n-clx with xxv710.' + - 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' + - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' + - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' - '2206.0-10 vs 2202.0-10: Compares VPP code current vs previous in the current CSIT environment.' # VPP Performance Changes 2n-clx-xxv710 4t2c ndr @@ -3382,10 +3612,10 @@ compare: 4 legend: - '' - - 'Test Case: Test cases executed for: PDR throughput on 2n-clx with xxv710.' - - 'YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' - - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' - - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' + - 'Test Case: Test cases executed for: NDR throughput on 2n-clx with xxv710.' + - 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' + - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' + - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' - '2206.0-10 vs 2202.0-10: Compares VPP code current vs previous in the current CSIT environment.' # VPP Performance Changes 2n-clx-cx556a 2t1c pdr @@ -3413,10 +3643,10 @@ compare: 4 legend: - '' - - 'Test Case: Test cases executed for: PDR throughput on 2n-clx with cx556a.' - - 'YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' - - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' - - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' + - 'Test Case: Test cases executed for: PDR throughput on 2n-clx with cx556a.' + - 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' + - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' + - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' - '2206.0-10 vs 2202.0-10: Compares VPP code current vs previous in the current CSIT environment.' # VPP Performance Changes 2n-clx-cx556a 4t2c pdr @@ -3444,10 +3674,10 @@ compare: 4 legend: - '' - - 'Test Case: Test cases executed for: PDR throughput on 2n-clx with cx556a.' - - 'YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' - - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' - - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' + - 'Test Case: Test cases executed for: PDR throughput on 2n-clx with cx556a.' + - 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' + - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' + - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' - '2206.0-10 vs 2202.0-10: Compares VPP code current vs previous in the current CSIT environment.' # VPP Performance Changes 2n-clx-cx556a 2t1c ndr @@ -3475,10 +3705,10 @@ compare: 4 legend: - '' - - 'Test Case: Test cases executed for: PDR throughput on 2n-clx with cx556a.' - - 'YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' - - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' - - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' + - 'Test Case: Test cases executed for: NDR throughput on 2n-clx with cx556a.' + - 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' + - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' + - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' - '2206.0-10 vs 2202.0-10: Compares VPP code current vs previous in the current CSIT environment.' # VPP Performance Changes 2n-clx-cx556a 4t2c ndr @@ -3506,10 +3736,10 @@ compare: 4 legend: - '' - - 'Test Case: Test cases executed for: PDR throughput on 2n-clx with cx556a.' - - 'YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' - - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' - - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' + - 'Test Case: Test cases executed for: NDR throughput on 2n-clx with cx556a.' + - 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' + - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' + - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' - '2206.0-10 vs 2202.0-10: Compares VPP code current vs previous in the current CSIT environment.' # VPP Performance Changes 2n-zn2-xxv710 2t1c pdr @@ -3537,10 +3767,10 @@ compare: 4 legend: - '' - - 'Test Case: Test cases executed for: PDR throughput on 2n-zn2 with xxv710.' - - 'YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' - - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' - - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' + - 'Test Case: Test cases executed for: PDR throughput on 2n-zn2 with xxv710.' + - 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' + - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' + - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' - '2206.0-10 vs 2202.0-10: Compares VPP code current vs previous in the current CSIT environment.' # VPP Performance Changes 2n-zn2-xxv710 4t2c pdr @@ -3568,10 +3798,10 @@ compare: 4 legend: - '' - - 'Test Case: Test cases executed for: PDR throughput on 2n-zn2 with xxv710.' - - 'YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' - - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' - - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' + - 'Test Case: Test cases executed for: PDR throughput on 2n-zn2 with xxv710.' + - 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' + - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' + - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' - '2206.0-10 vs 2202.0-10: Compares VPP code current vs previous in the current CSIT environment.' # VPP Performance Changes 2n-zn2-xxv710 2t1c ndr @@ -3599,10 +3829,10 @@ compare: 4 legend: - '' - - 'Test Case: Test cases executed for: PDR throughput on 2n-zn2 with xxv710.' - - 'YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' - - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' - - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' + - 'Test Case: Test cases executed for: NDR throughput on 2n-zn2 with xxv710.' + - 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' + - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' + - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' - '2206.0-10 vs 2202.0-10: Compares VPP code current vs previous in the current CSIT environment.' # VPP Performance Changes 2n-zn2-xxv710 4t2c ndr @@ -3630,10 +3860,10 @@ compare: 4 legend: - '' - - 'Test Case: Test cases executed for: PDR throughput on 2n-zn2 with xxv710.' - - 'YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' - - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' - - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' + - 'Test Case: Test cases executed for: NDR throughput on 2n-zn2 with xxv710.' + - 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' + - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' + - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' - '2206.0-10 vs 2202.0-10: Compares VPP code current vs previous in the current CSIT environment.' # VPP Performance Changes 2n-dnv 1t1c pdr @@ -3661,10 +3891,10 @@ compare: 4 legend: - '' - - 'Test Case: Test cases executed for: PDR throughput on 2n-dnv with x553.' - - 'YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' - - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' - - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' + - 'Test Case: Test cases executed for: PDR throughput on 2n-dnv with x553.' + - 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' + - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' + - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' - '2206.0-10 vs 2202.0-10: Compares VPP code current vs previous in the current CSIT environment.' # VPP Performance Changes 2n-dnv 2t2c pdr @@ -3692,10 +3922,10 @@ compare: 4 legend: - '' - - 'Test Case: Test cases executed for: PDR throughput on 2n-dnv with x553.' - - 'YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' - - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' - - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' + - 'Test Case: Test cases executed for: PDR throughput on 2n-dnv with x553.' + - 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' + - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' + - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' - '2206.0-10 vs 2202.0-10: Compares VPP code current vs previous in the current CSIT environment.' # VPP Performance Changes 2n-dnv 1t1c ndr @@ -3723,10 +3953,10 @@ compare: 4 legend: - '' - - 'Test Case: Test cases executed for: PDR throughput on 2n-dnv with x553.' - - 'YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' - - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' - - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' + - 'Test Case: Test cases executed for: NDR throughput on 2n-dnv with x553.' + - 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' + - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' + - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' - '2206.0-10 vs 2202.0-10: Compares VPP code current vs previous in the current CSIT environment.' # VPP Performance Changes 2n-dnv 2t2c ndr @@ -3754,10 +3984,10 @@ compare: 4 legend: - '' - - 'Test Case: Test cases executed for: PDR throughput on 2n-dnv with x553.' - - 'YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' - - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' - - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' + - 'Test Case: Test cases executed for: NDR throughput on 2n-dnv with x553.' + - 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' + - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' + - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' - '2206.0-10 vs 2202.0-10: Compares VPP code current vs previous in the current CSIT environment.' # VPP Performance Changes 3n-dnv 1t1c pdr @@ -3785,10 +4015,10 @@ compare: 4 legend: - '' - - 'Test Case: Test cases executed for: PDR throughput on 3n-dnv with x553.' - - 'YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' - - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' - - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' + - 'Test Case: Test cases executed for: PDR throughput on 3n-dnv with x553.' + - 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' + - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' + - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' - '2206.0-10 vs 2202.0-10: Compares VPP code current vs previous in the current CSIT environment.' # VPP Performance Changes 3n-dnv 2t2c pdr @@ -3816,10 +4046,10 @@ compare: 4 legend: - '' - - 'Test Case: Test cases executed for: PDR throughput on 3n-dnv with x553.' - - 'YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' - - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' - - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' + - 'Test Case: Test cases executed for: PDR throughput on 3n-dnv with x553.' + - 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' + - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' + - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' - '2206.0-10 vs 2202.0-10: Compares VPP code current vs previous in the current CSIT environment.' # VPP Performance Changes 3n-dnv 1t1c ndr @@ -3847,10 +4077,10 @@ compare: 4 legend: - '' - - 'Test Case: Test cases executed for: PDR throughput on 3n-dnv with x553.' - - 'YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' - - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' - - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' + - 'Test Case: Test cases executed for: NDR throughput on 3n-dnv with x553.' + - 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' + - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' + - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' - '2206.0-10 vs 2202.0-10: Compares VPP code current vs previous in the current CSIT environment.' # VPP Performance Changes 3n-dnv 2t2c ndr @@ -3878,10 +4108,10 @@ compare: 4 legend: - '' - - 'Test Case: Test cases executed for: PDR throughput on 3n-dnv with x553.' - - 'YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' - - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' - - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' + - 'Test Case: Test cases executed for: NDR throughput on 3n-dnv with x553.' + - 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' + - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' + - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' - '2206.0-10 vs 2202.0-10: Compares VPP code current vs previous in the current CSIT environment.' # VPP Performance Changes 3n-tsh 1t1c pdr @@ -3909,10 +4139,10 @@ compare: 4 legend: - '' - - 'Test Case: Test cases executed for: PDR throughput on 3n-tsh with x520.' - - 'YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' - - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' - - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' + - 'Test Case: Test cases executed for: PDR throughput on 3n-tsh with x520.' + - 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' + - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' + - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' - '2206.0-10 vs 2202.0-10: Compares VPP code current vs previous in the current CSIT environment.' # VPP Performance Changes 3n-tsh 2t2c pdr @@ -3940,10 +4170,10 @@ compare: 4 legend: - '' - - 'Test Case: Test cases executed for: PDR throughput on 3n-tsh with x520.' - - 'YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' - - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' - - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' + - 'Test Case: Test cases executed for: PDR throughput on 3n-tsh with x520.' + - 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' + - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' + - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' - '2206.0-10 vs 2202.0-10: Compares VPP code current vs previous in the current CSIT environment.' # VPP Performance Changes 3n-tsh 1t1c ndr @@ -3971,10 +4201,10 @@ compare: 4 legend: - '' - - 'Test Case: Test cases executed for: PDR throughput on 3n-tsh with x520.' - - 'YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' - - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' - - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' + - 'Test Case: Test cases executed for: NDR throughput on 3n-tsh with x520.' + - 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' + - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' + - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' - '2206.0-10 vs 2202.0-10: Compares VPP code current vs previous in the current CSIT environment.' # VPP Performance Changes 3n-tsh 2t2c ndr @@ -4002,10 +4232,10 @@ compare: 4 legend: - '' - - 'Test Case: Test cases executed for: PDR throughput on 3n-tsh with x520.' - - 'YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' - - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' - - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' + - 'Test Case: Test cases executed for: NDR throughput on 3n-tsh with x520.' + - 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' + - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' + - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' - '2206.0-10 vs 2202.0-10: Compares VPP code current vs previous in the current CSIT environment.' # VPP Performance Changes 2n-tx2 1t1c pdr @@ -4033,10 +4263,10 @@ compare: 4 legend: - '' - - 'Test Case: Test cases executed for: PDR throughput on 2n-tx2 with xl710.' - - 'YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' - - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' - - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' + - 'Test Case: Test cases executed for: PDR throughput on 2n-tx2 with xl710.' + - 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' + - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' + - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' - '2206.0-10 vs 2202.0-10: Compares VPP code current vs previous in the current CSIT environment.' # VPP Performance Changes 2n-tx2 2t2c pdr @@ -4064,10 +4294,10 @@ compare: 4 legend: - '' - - 'Test Case: Test cases executed for: PDR throughput on 2n-tx2 with xl710.' - - 'YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' - - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' - - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' + - 'Test Case: Test cases executed for: PDR throughput on 2n-tx2 with xl710.' + - 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' + - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' + - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' - '2206.0-10 vs 2202.0-10: Compares VPP code current vs previous in the current CSIT environment.' # VPP Performance Changes 2n-tx2 1t1c ndr @@ -4095,10 +4325,10 @@ compare: 4 legend: - '' - - 'Test Case: Test cases executed for: PDR throughput on 2n-tx2 with xl710.' - - 'YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' - - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' - - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' + - 'Test Case: Test cases executed for: NDR throughput on 2n-tx2 with xl710.' + - 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' + - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' + - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' - '2206.0-10 vs 2202.0-10: Compares VPP code current vs previous in the current CSIT environment.' # VPP Performance Changes 2n-tx2 2t2c ndr @@ -4126,10 +4356,10 @@ compare: 4 legend: - '' - - 'Test Case: Test cases executed for: PDR throughput on 2n-tx2 with xl710.' - - 'YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' - - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' - - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' + - 'Test Case: Test cases executed for: NDR throughput on 2n-tx2 with xl710.' + - 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' + - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' + - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' - '2206.0-10 vs 2202.0-10: Compares VPP code current vs previous in the current CSIT environment.' # VPP Performance Changes 2n-aws 2t1c pdr @@ -4152,9 +4382,9 @@ compare: 3 legend: - '' - - 'Test Case: Test cases executed for: PDR throughput on 2n-aws with nitro50g.' - - 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' - - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' + - 'Test Case: Test cases executed for: PDR throughput on 2n-aws with nitro50g.' + - 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' + - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' - '2206.0-10 vs 2202.0-9: Compares VPP code current vs previous.' # VPP Performance Changes 2n-aws 4t2c pdr @@ -4177,9 +4407,9 @@ compare: 3 legend: - '' - - 'Test Case: Test cases executed for: PDR throughput on 2n-aws with nitro50g.' - - 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' - - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' + - 'Test Case: Test cases executed for: PDR throughput on 2n-aws with nitro50g.' + - 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' + - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' - '2206.0-10 vs 2202.0-9: Compares VPP code current vs previous.' # VPP Performance Changes 2n-aws 2t1c ndr @@ -4202,9 +4432,9 @@ compare: 3 legend: - '' - - 'Test Case: Test cases executed for: PDR throughput on 2n-aws with nitro50g.' - - 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' - - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' + - 'Test Case: Test cases executed for: NDR throughput on 2n-aws with nitro50g.' + - 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' + - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' - '2206.0-10 vs 2202.0-9: Compares VPP code current vs previous.' # VPP Performance Changes 2n-aws 4t2c ndr @@ -4227,9 +4457,9 @@ compare: 3 legend: - '' - - 'Test Case: Test cases executed for: PDR throughput on 2n-aws with nitro50g.' - - 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' - - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' + - 'Test Case: Test cases executed for: NDR throughput on 2n-aws with nitro50g.' + - 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' + - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' - '2206.0-10 vs 2202.0-9: Compares VPP code current vs previous.' # # VPP Performance Changes 3n-aws 2t1c pdr @@ -4252,9 +4482,9 @@ # compare: 3 # legend: # - '' -# - 'Test Case: Test cases executed for: PDR throughput on 3n-aws with nitro50g.' -# - 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' -# - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' +# - 'Test Case: Test cases executed for: PDR throughput on 3n-aws with nitro50g.' +# - 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' +# - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' # - '2206.0-10 vs 2202.0-9: Compares VPP code current vs previous.' # # VPP Performance Changes 3n-aws 4t2c pdr @@ -4277,9 +4507,9 @@ # compare: 3 # legend: # - '' -# - 'Test Case: Test cases executed for: PDR throughput on 3n-aws with nitro50g.' -# - 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' -# - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' +# - 'Test Case: Test cases executed for: PDR throughput on 3n-aws with nitro50g.' +# - 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' +# - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' # - '2206.0-10 vs 2202.0-9: Compares VPP code current vs previous.' # # VPP Performance Changes 3n-aws 2t1c ndr @@ -4302,9 +4532,9 @@ # compare: 3 # legend: # - '' -# - 'Test Case: Test cases executed for: PDR throughput on 3n-aws with nitro50g.' -# - 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' -# - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' +# - 'Test Case: Test cases executed for: NDR throughput on 3n-aws with nitro50g.' +# - 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' +# - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' # - '2206.0-10 vs 2202.0-9: Compares VPP code current vs previous.' # # VPP Performance Changes 3n-aws 4t2c ndr @@ -4327,347 +4557,11 @@ # compare: 3 # legend: # - '' -# - 'Test Case: Test cases executed for: PDR throughput on 3n-aws with nitro50g.' -# - 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' -# - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' +# - 'Test Case: Test cases executed for: NDR throughput on 3n-aws with nitro50g.' +# - 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' +# - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' # - '2206.0-10 vs 2202.0-9: Compares VPP code current vs previous.' -# VPP Comparison Across Testbeds 2n-skx to 2n-clx 2t1c ndr -- type: "table" - title: "VPP Comparison Across Testbeds 2n-skx to 2n-clx 2t1c ndr" - algorithm: "table_comparison" - output-file: "{DIR[STATIC,VPP]}/performance-compare-testbeds-2n-skx-2n-clx-2t1c-ndr" - include-tests: "NDR" # "PDR" | "NDR" | "MRR" - filter: "'2T1C' and 'NIC_Intel-XXV710'" - columns: - - title: "2n-skx" - data-set: "vpp-2n-skx-curr-iter" - - title: "2n-clx" - data-set: "vpp-2n-clx-curr-iter" - comparisons: - - title: "Diff" - reference: 1 - compare: 2 - legend: - - "" - - "2n-skx, 2n-clx - testbeds and NICs tested." - - "Diff - difference between 2n-skx and 2n-clx testbeds." - -# VPP Comparison Across Testbeds 2n-skx to 2n-clx 4t2c ndr -- type: "table" - title: "VPP Comparison Across Testbeds 2n-skx to 2n-clx 4t2c ndr" - algorithm: "table_comparison" - output-file: "{DIR[STATIC,VPP]}/performance-compare-testbeds-2n-skx-2n-clx-4t2c-ndr" - include-tests: "NDR" # "PDR" | "NDR" | "MRR" - filter: "'4T2C' and 'NIC_Intel-XXV710'" - columns: - - title: "2n-skx" - data-set: "vpp-2n-skx-curr-iter" - - title: "2n-clx" - data-set: "vpp-2n-clx-curr-iter" - comparisons: - - title: "Diff" - reference: 1 - compare: 2 - legend: - - "" - - "2n-skx, 2n-clx - testbeds and NICs tested." - - "Diff - difference between 2n-skx and 2n-clx testbeds." - -# VPP Comparison Across Testbeds 2n-skx to 2n-clx 2t1c pdr -- type: "table" - title: "VPP Comparison Across Testbeds 2n-skx to 2n-clx 2t1c pdr" - algorithm: "table_comparison" - output-file: "{DIR[STATIC,VPP]}/performance-compare-testbeds-2n-skx-2n-clx-2t1c-pdr" - include-tests: "PDR" # "PDR" | "NDR" | "MRR" - filter: "'2T1C' and 'NIC_Intel-XXV710'" - columns: - - title: "2n-skx" - data-set: "vpp-2n-skx-curr-iter" - - title: "2n-clx" - data-set: "vpp-2n-clx-curr-iter" - comparisons: - - title: "Diff" - reference: 1 - compare: 2 - legend: - - "" - - "2n-skx, 2n-clx - testbeds and NICs tested." - - "Diff - difference between 2n-skx and 2n-clx testbeds." - -# VPP Comparison Across Testbeds 2n-skx to 2n-clx 4t2c pdr -- type: "table" - title: "VPP Comparison Across Testbeds 2n-skx to 2n-clx 4t2c pdr" - algorithm: "table_comparison" - output-file: "{DIR[STATIC,VPP]}/performance-compare-testbeds-2n-skx-2n-clx-4t2c-pdr" - include-tests: "PDR" # "PDR" | "NDR" | "MRR" - filter: "'4T2C' and 'NIC_Intel-XXV710'" - columns: - - title: "2n-skx" - data-set: "vpp-2n-skx-curr-iter" - - title: "2n-clx" - data-set: "vpp-2n-clx-curr-iter" - comparisons: - - title: "Diff" - reference: 1 - compare: 2 - legend: - - "" - - "2n-skx, 2n-clx - testbeds and NICs tested." - - "Diff - difference between 2n-skx and 2n-clx testbeds." - -# VPP Comparison Across Testbeds 2n-clx to 2n-icx 1c ndr -- type: "table" - title: "VPP Comparison Across Testbeds 2n-clx to 2n-icx 1c ndr" - algorithm: "table_comparison" - output-file: "{DIR[STATIC,VPP]}/performance-compare-testbeds-2n-clx-2n-icx-1c-ndr" - include-tests: "NDR" # "PDR" | "NDR" | "MRR" - filter: "'NIC_Intel-XXV710' and 'NDRPDR' and '1C'" - columns: - - title: "2n-clx xxv710" - data-set: "vpp-2n-clx-curr-iter" - - title: "2n-icx xxv710" - data-set: "vpp-2n-icx-curr-iter" - comparisons: - - title: "Diff" - reference: 1 - compare: 2 - legend: - - "" - - "2n-clx xxv710, 2n-icx xxv710 - testbeds and NICs tested." - - "Diff - difference between 2n-clx xxv710 and 2n-icx xxv710 testbeds." - -# VPP Comparison Across Testbeds 2n-clx to 2n-icx 2c ndr -- type: "table" - title: "VPP Comparison Across Testbeds 2n-clx to 2n-icx 2c ndr" - algorithm: "table_comparison" - output-file: "{DIR[STATIC,VPP]}/performance-compare-testbeds-2n-clx-2n-icx-2c-ndr" - include-tests: "NDR" # "PDR" | "NDR" | "MRR" - filter: "'NIC_Intel-XXV710' and 'NDRPDR' and '2C'" - columns: - - title: "2n-clx xxv710" - data-set: "vpp-2n-clx-curr-iter" - - title: "2n-icx xxv710" - data-set: "vpp-2n-icx-curr-iter" - comparisons: - - title: "Diff" - reference: 1 - compare: 2 - legend: - - "" - - "2n-clx xxv710, 2n-icx xxv710 - testbeds and NICs tested." - - "Diff - difference between 2n-clx xxv710 and 2n-icx xxv710 testbeds." - -# VPP Comparison Across Testbeds 2n-clx to 2n-icx 1c pdr -- type: "table" - title: "VPP Comparison Across Testbeds 2n-clx to 2n-icx 1c pdr" - algorithm: "table_comparison" - output-file: "{DIR[STATIC,VPP]}/performance-compare-testbeds-2n-clx-2n-icx-1c-pdr" - include-tests: "PDR" # "PDR" | "NDR" | "MRR" - filter: "'NIC_Intel-XXV710' and 'NDRPDR' and '1C'" - columns: - - title: "2n-clx xxv710" - data-set: "vpp-2n-clx-curr-iter" - - title: "2n-icx xxv710" - data-set: "vpp-2n-icx-curr-iter" - comparisons: - - title: "Diff" - reference: 1 - compare: 2 - legend: - - "" - - "2n-clx xxv710, 2n-icx xxv710 - testbeds and NICs tested." - - "Diff - difference between 2n-clx xxv710 and 2n-icx xxv710 testbeds." - -# VPP Comparison Across Testbeds 2n-clx to 2n-icx 2c pdr -- type: "table" - title: "VPP Comparison Across Testbeds 2n-clx to 2n-icx 2c pdr" - algorithm: "table_comparison" - output-file: "{DIR[STATIC,VPP]}/performance-compare-testbeds-2n-clx-2n-icx-2c-pdr" - include-tests: "PDR" # "PDR" | "NDR" | "MRR" - filter: "'NIC_Intel-XXV710' and 'NDRPDR' and '2C'" - columns: - - title: "2n-clx xxv710" - data-set: "vpp-2n-clx-curr-iter" - - title: "2n-icx xxv710" - data-set: "vpp-2n-icx-curr-iter" - comparisons: - - title: "Diff" - reference: 1 - compare: 2 - legend: - - "" - - "2n-clx xxv710, 2n-icx xxv710 - testbeds and NICs tested." - - "Diff - difference between 2n-clx xxv710 and 2n-icx xxv710 testbeds." - -# VPP Comparison Across Testbeds 2n-skx to 2n-icx 1c ndr -- type: "table" - title: "VPP Comparison Across Testbeds 2n-skx to 2n-icx 1c ndr" - algorithm: "table_comparison" - output-file: "{DIR[STATIC,VPP]}/performance-compare-testbeds-2n-skx-2n-icx-1c-ndr" - include-tests: "NDR" # "PDR" | "NDR" | "MRR" - filter: "'NIC_Intel-XXV710' and 'NDRPDR' and '1C'" - columns: - - title: "2n-skx xxv710" - data-set: "vpp-2n-skx-curr-iter" - - title: "2n-icx xxv710" - data-set: "vpp-2n-icx-curr-iter" - comparisons: - - title: "Diff" - reference: 1 - compare: 2 - legend: - - "" - - "2n-skx xxv710, 2n-icx xxv710 - testbeds and NICs tested." - - "Diff - difference between 2n-skx xxv710 and 2n-icx xxv710 testbeds." - -# VPP Comparison Across Testbeds 2n-skx to 2n-icx 2c ndr -- type: "table" - title: "VPP Comparison Across Testbeds 2n-skx to 2n-icx 2c ndr" - algorithm: "table_comparison" - output-file: "{DIR[STATIC,VPP]}/performance-compare-testbeds-2n-skx-2n-icx-2c-ndr" - include-tests: "NDR" # "PDR" | "NDR" | "MRR" - filter: "'NIC_Intel-XXV710' and 'NDRPDR' and '2C'" - columns: - - title: "2n-skx xxv710" - data-set: "vpp-2n-skx-curr-iter" - - title: "2n-icx xxv710" - data-set: "vpp-2n-icx-curr-iter" - comparisons: - - title: "Diff" - reference: 1 - compare: 2 - legend: - - "" - - "2n-skx xxv710, 2n-icx xxv710 - testbeds and NICs tested." - - "Diff - difference between 2n-skx xxv710 and 2n-icx xxv710 testbeds." - -# VPP Comparison Across Testbeds 2n-skx to 2n-icx 1c pdr -- type: "table" - title: "VPP Comparison Across Testbeds 2n-skx to 2n-icx 1c pdr" - algorithm: "table_comparison" - output-file: "{DIR[STATIC,VPP]}/performance-compare-testbeds-2n-skx-2n-icx-1c-pdr" - include-tests: "PDR" # "PDR" | "NDR" | "MRR" - filter: "'NIC_Intel-XXV710' and 'NDRPDR' and '1C'" - columns: - - title: "2n-skx xxv710" - data-set: "vpp-2n-skx-curr-iter" - - title: "2n-icx xxv710" - data-set: "vpp-2n-icx-curr-iter" - comparisons: - - title: "Diff" - reference: 1 - compare: 2 - legend: - - "" - - "2n-skx xxv710, 2n-icx xxv710 - testbeds and NICs tested." - - "Diff - difference between 2n-skx xxv710 and 2n-icx xxv710 testbeds." - -# VPP Comparison Across Testbeds 2n-skx to 2n-icx 2c pdr -- type: "table" - title: "VPP Comparison Across Testbeds 2n-skx to 2n-icx 2c pdr" - algorithm: "table_comparison" - output-file: "{DIR[STATIC,VPP]}/performance-compare-testbeds-2n-skx-2n-icx-2c-pdr" - include-tests: "PDR" # "PDR" | "NDR" | "MRR" - filter: "'NIC_Intel-XXV710' and 'NDRPDR' and '2C'" - columns: - - title: "2n-skx xxv710" - data-set: "vpp-2n-skx-curr-iter" - - title: "2n-icx xxv710" - data-set: "vpp-2n-icx-curr-iter" - comparisons: - - title: "Diff" - reference: 1 - compare: 2 - legend: - - "" - - "2n-skx xxv710, 2n-icx xxv710 - testbeds and NICs tested." - - "Diff - difference between 2n-skx xxv710 and 2n-icx xxv710 testbeds." - -# VPP Comparison Across Testbeds 3n-skx to 3n-icx 1c ndr -- type: "table" - title: "VPP Comparison Across Testbeds 3n-skx to 3n-icx 1c ndr" - algorithm: "table_comparison" - output-file: "{DIR[STATIC,VPP]}/performance-compare-testbeds-3n-skx-3n-icx-1c-ndr" - include-tests: "NDR" # "PDR" | "NDR" | "MRR" - filter: "'NIC_Intel-XXV710' and 'NDRPDR' and '1C'" - columns: - - title: "3n-skx xxv710" - data-set: "vpp-3n-skx-curr-iter" - - title: "3n-icx xxv710" - data-set: "vpp-3n-icx-curr-iter" - comparisons: - - title: "Diff" - reference: 1 - compare: 2 - legend: - - "" - - "3n-skx xxv710, 3n-icx xxv710 - testbeds and NICs tested." - - "Diff - difference between 3n-skx xxv710 and 3n-icx xxv710 testbeds." - -# VPP Comparison Across Testbeds 3n-skx to 3n-icx 2c ndr -- type: "table" - title: "VPP Comparison Across Testbeds 3n-skx to 3n-icx ndr" - algorithm: "table_comparison" - output-file: "{DIR[STATIC,VPP]}/performance-compare-testbeds-3n-skx-3n-icx-2c-ndr" - include-tests: "NDR" # "PDR" | "NDR" | "MRR" - filter: "'NIC_Intel-XXV710' and 'NDRPDR' and '2C'" - columns: - - title: "3n-skx xxv710" - data-set: "vpp-3n-skx-curr-iter" - - title: "3n-icx xxv710" - data-set: "vpp-3n-icx-curr-iter" - comparisons: - - title: "Diff" - reference: 1 - compare: 2 - legend: - - "" - - "3n-skx xxv710, 3n-icx xxv710 - testbeds and NICs tested." - - "Diff - difference between 3n-skx xxv710 and 3n-icx xxv710 testbeds." - -# VPP Comparison Across Testbeds 3n-skx to 3n-icx 1c pdr -- type: "table" - title: "VPP Comparison Across Testbeds 3n-skx to 3n-icx 1c pdr" - algorithm: "table_comparison" - output-file: "{DIR[STATIC,VPP]}/performance-compare-testbeds-3n-skx-3n-icx-1c-pdr" - include-tests: "PDR" # "PDR" | "NDR" | "MRR" - filter: "'NIC_Intel-XXV710' and 'NDRPDR' and '1C'" - columns: - - title: "3n-skx xxv710" - data-set: "vpp-3n-skx-curr-iter" - - title: "3n-icx xxv710" - data-set: "vpp-3n-icx-curr-iter" - comparisons: - - title: "Diff" - reference: 1 - compare: 2 - legend: - - "" - - "3n-skx xxv710, 3n-icx xxv710 - testbeds and NICs tested." - - "Diff - difference between 3n-skx xxv710 and 3n-icx xxv710 testbeds." - -# VPP Comparison Across Testbeds 3n-skx to 3n-icx 2c pdr -- type: "table" - title: "VPP Comparison Across Testbeds 3n-skx to 3n-icx 2c pdr" - algorithm: "table_comparison" - output-file: "{DIR[STATIC,VPP]}/performance-compare-testbeds-3n-skx-3n-icx-2c-pdr" - include-tests: "PDR" # "PDR" | "NDR" | "MRR" - filter: "'NIC_Intel-XXV710' and 'NDRPDR' and '2C'" - columns: - - title: "3n-skx xxv710" - data-set: "vpp-3n-skx-curr-iter" - - title: "3n-icx xxv710" - data-set: "vpp-3n-icx-curr-iter" - comparisons: - - title: "Diff" - reference: 1 - compare: 2 - legend: - - "" - - "3n-skx xxv710, 3n-icx xxv710 - testbeds and NICs tested." - - "Diff - difference between 3n-skx xxv710 and 3n-icx xxv710 testbeds." - # VPP Comparison Across Topologies 3n-skx to 2n-skx 1c ndr - type: "table" title: "VPP Comparison Across Topologies 3n-skx to 2n-skx 1c ndr" @@ -4676,18 +4570,19 @@ include-tests: "NDR" # "PDR" | "NDR" | "MRR" filter: "'NDRPDR' and '1C' and 'NIC_Intel-XXV710'" columns: - - title: "3n-skx" + - title: "3n-skx xxv710" data-set: "vpp-3n-skx-curr-iter" - - title: "2n-skx" + - title: "2n-skx xxv710" data-set: "vpp-2n-skx-curr-iter" comparisons: - - title: "Diff" + - title: "2n-skx vs 3n-skx" reference: 1 compare: 2 legend: - - "" - - "3n-skx, 2n-skx - topologies tested." - - "Diff - difference between 3n-skx and 2n-skx topologies." + - '' + - 'Test Case: Test cases executed for: NDR throughput on 3n-skx xxv710 and 2n-skx xxv710.' + - '3n-skx xxv710, 2n-skx xxv710: [Mpps +- StDev] results for VPP tested in CSIT' + - '2n-skx vs 3n-skx: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' # VPP Comparison Across Topologies 3n-skx to 2n-skx 2c ndr - type: "table" @@ -4697,18 +4592,19 @@ include-tests: "NDR" # "PDR" | "NDR" | "MRR" filter: "'NDRPDR' and '2C' and 'NIC_Intel-XXV710'" columns: - - title: "3n-skx" + - title: "3n-skx xxv710" data-set: "vpp-3n-skx-curr-iter" - - title: "2n-skx" + - title: "2n-skx xxv710" data-set: "vpp-2n-skx-curr-iter" comparisons: - - title: "Diff" + - title: "2n-skx vs 3n-skx" reference: 1 compare: 2 legend: - - "" - - "3n-skx, 2n-skx - topologies tested." - - "Diff - difference between 3n-skx and 2n-skx topologies." + - '' + - 'Test Case: Test cases executed for: NDR throughput on 3n-skx xxv710 and 2n-skx xxv710.' + - '3n-skx xxv710, 2n-skx xxv710: [Mpps +- StDev] results for VPP tested in CSIT' + - '2n-skx vs 3n-skx: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' # VPP Comparison Across Topologies 3n-skx to 2n-skx 1c pdr - type: "table" @@ -4718,18 +4614,19 @@ include-tests: "PDR" # "PDR" | "NDR" | "MRR" filter: "'NDRPDR' and '1C' and 'NIC_Intel-XXV710'" columns: - - title: "3n-skx" + - title: "3n-skx xxv710" data-set: "vpp-3n-skx-curr-iter" - - title: "2n-skx" + - title: "2n-skx xxv710" data-set: "vpp-2n-skx-curr-iter" comparisons: - - title: "Diff" + - title: "2n-skx vs 3n-skx" reference: 1 compare: 2 legend: - - "" - - "3n-skx, 2n-skx - topologies tested." - - "Diff - difference between 3n-skx and 2n-skx topologies." + - '' + - 'Test Case: Test cases executed for: PDR throughput on 3n-skx xxv710 and 2n-skx xxv710.' + - '3n-skx xxv710, 2n-skx xxv710: [Mpps +- StDev] results for VPP tested in CSIT' + - '2n-skx vs 3n-skx: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' # VPP Comparison Across Topologies 3n-skx to 2n-skx 2c pdr - type: "table" @@ -4739,18 +4636,19 @@ include-tests: "PDR" # "PDR" | "NDR" | "MRR" filter: "'NDRPDR' and '2C' and 'NIC_Intel-XXV710'" columns: - - title: "3n-skx" + - title: "3n-skx xxv710" data-set: "vpp-3n-skx-curr-iter" - - title: "2n-skx" + - title: "2n-skx xxv710" data-set: "vpp-2n-skx-curr-iter" comparisons: - - title: "Diff" + - title: "2n-skx vs 3n-skx" reference: 1 compare: 2 legend: - - "" - - "3n-skx, 2n-skx - topologies tested." - - "Diff - difference between 3n-skx and 2n-skx topologies." + - '' + - 'Test Case: Test cases executed for: PDR throughput on 3n-skx xxv710 and 2n-skx xxv710.' + - '3n-skx xxv710, 2n-skx xxv710: [Mpps +- StDev] results for VPP tested in CSIT' + - '2n-skx vs 3n-skx: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' # VPP Performance Changes 3n-icx 2t1c mrr - type: "table" @@ -4777,10 +4675,10 @@ compare: 3 legend: - '' - - 'Test Case: Test cases executed for: PDR throughput on 3n-icx with xxv710.' - - 'YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' - - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' - - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' + - 'Test Case: Test cases executed for: MRR throughput on 3n-icx with xxv710.' + - 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' + - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' + - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' - '2206.0-10 vs 2202.0-10: Compares VPP code current vs previous in the current CSIT environment.' # VPP Performance Changes 3n-icx 4t2c mrr @@ -4808,10 +4706,10 @@ compare: 3 legend: - '' - - 'Test Case: Test cases executed for: PDR throughput on 3n-icx with xxv710.' - - 'YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' - - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' - - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' + - 'Test Case: Test cases executed for: MRR throughput on 3n-icx with xxv710.' + - 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' + - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' + - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' - '2206.0-10 vs 2202.0-10: Compares VPP code current vs previous in the current CSIT environment.' # VPP Performance Changes 3n-icx 8t4c mrr @@ -4839,10 +4737,10 @@ compare: 3 legend: - '' - - 'Test Case: Test cases executed for: PDR throughput on 3n-icx with xxv710.' - - 'YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' - - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' - - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' + - 'Test Case: Test cases executed for: MRR throughput on 3n-icx with xxv710.' + - 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' + - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' + - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' - '2206.0-10 vs 2202.0-10: Compares VPP code current vs previous in the current CSIT environment.' # VPP Performance Changes 2n-icx 2t1c mrr @@ -4870,10 +4768,10 @@ compare: 3 legend: - '' - - 'Test Case: Test cases executed for: PDR throughput on 2n-icx with xxv710.' - - 'YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' - - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' - - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' + - 'Test Case: Test cases executed for: MRR throughput on 2n-icx with xxv710.' + - 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' + - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' + - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' - '2206.0-10 vs 2202.0-10: Compares VPP code current vs previous in the current CSIT environment.' # VPP Performance Changes 2n-icx 4t2c mrr @@ -4901,10 +4799,10 @@ compare: 3 legend: - '' - - 'Test Case: Test cases executed for: PDR throughput on 2n-icx with xxv710.' - - 'YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' - - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' - - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' + - 'Test Case: Test cases executed for: MRR throughput on 2n-icx with xxv710.' + - 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' + - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' + - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' - '2206.0-10 vs 2202.0-10: Compares VPP code current vs previous in the current CSIT environment.' # VPP Performance Changes 2n-icx 8t4c mrr @@ -4932,10 +4830,10 @@ compare: 3 legend: - '' - - 'Test Case: Test cases executed for: PDR throughput on 2n-icx with xxv710.' - - 'YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' - - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' - - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' + - 'Test Case: Test cases executed for: MRR throughput on 2n-icx with xxv710.' + - 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' + - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' + - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' - '2206.0-10 vs 2202.0-10: Compares VPP code current vs previous in the current CSIT environment.' # VPP Performance Changes 3n-skx 2t1c mrr @@ -4963,10 +4861,10 @@ compare: 4 legend: - '' - - 'Test Case: Test cases executed for: PDR throughput on 3n-skx with xxv710.' - - 'YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' - - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' - - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' + - 'Test Case: Test cases executed for: MRR throughput on 3n-skx with xxv710.' + - 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' + - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' + - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' - '2206.0-10 vs 2202.0-10: Compares VPP code current vs previous in the current CSIT environment.' # VPP Performance Changes 3n-skx 4t2c mrr @@ -4994,10 +4892,10 @@ compare: 4 legend: - '' - - 'Test Case: Test cases executed for: PDR throughput on 3n-skx with xxv710.' - - 'YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' - - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' - - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' + - 'Test Case: Test cases executed for: MRR throughput on 3n-skx with xxv710.' + - 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' + - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' + - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' - '2206.0-10 vs 2202.0-10: Compares VPP code current vs previous in the current CSIT environment.' # VPP Performance Changes 3n-skx 8t4c mrr @@ -5025,10 +4923,10 @@ compare: 4 legend: - '' - - 'Test Case: Test cases executed for: PDR throughput on 3n-skx with xxv710.' - - 'YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' - - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' - - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' + - 'Test Case: Test cases executed for: MRR throughput on 3n-skx with xxv710.' + - 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' + - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' + - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' - '2206.0-10 vs 2202.0-10: Compares VPP code current vs previous in the current CSIT environment.' # VPP Performance Changes 2n-skx 2t1c mrr @@ -5056,10 +4954,10 @@ compare: 4 legend: - '' - - 'Test Case: Test cases executed for: PDR throughput on 2n-skx with xxv710.' - - 'YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' - - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' - - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' + - 'Test Case: Test cases executed for: MRR throughput on 2n-skx with xxv710.' + - 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' + - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' + - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' - '2206.0-10 vs 2202.0-10: Compares VPP code current vs previous in the current CSIT environment.' # VPP Performance Changes 2n-skx 4t2c mrr @@ -5087,10 +4985,10 @@ compare: 4 legend: - '' - - 'Test Case: Test cases executed for: PDR throughput on 2n-skx with xxv710.' - - 'YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' - - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' - - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' + - 'Test Case: Test cases executed for: MRR throughput on 2n-skx with xxv710.' + - 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' + - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' + - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' - '2206.0-10 vs 2202.0-10: Compares VPP code current vs previous in the current CSIT environment.' # VPP Performance Changes 2n-skx 8t4c mrr @@ -5118,10 +5016,10 @@ compare: 4 legend: - '' - - 'Test Case: Test cases executed for: PDR throughput on 2n-skx with xxv710.' - - 'YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' - - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' - - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' + - 'Test Case: Test cases executed for: MRR throughput on 2n-skx with xxv710.' + - 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' + - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' + - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' - '2206.0-10 vs 2202.0-10: Compares VPP code current vs previous in the current CSIT environment.' # VPP Performance Changes 2n-clx-xxv710 2t1c mrr @@ -5149,10 +5047,10 @@ compare: 4 legend: - '' - - 'Test Case: Test cases executed for: PDR throughput on 2n-clx with xxv710.' - - 'YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' - - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' - - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' + - 'Test Case: Test cases executed for: MRR throughput on 2n-clx with xxv710.' + - 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' + - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' + - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' - '2206.0-10 vs 2202.0-10: Compares VPP code current vs previous in the current CSIT environment.' # VPP Performance Changes 2n-clx-xxv710 4t2c mrr @@ -5180,10 +5078,10 @@ compare: 4 legend: - '' - - 'Test Case: Test cases executed for: PDR throughput on 2n-clx with xxv710.' - - 'YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' - - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' - - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' + - 'Test Case: Test cases executed for: MRR throughput on 2n-clx with xxv710.' + - 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' + - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' + - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' - '2206.0-10 vs 2202.0-10: Compares VPP code current vs previous in the current CSIT environment.' # VPP Performance Changes 2n-clx-xxv710 8t4c mrr @@ -5211,10 +5109,10 @@ compare: 4 legend: - '' - - 'Test Case: Test cases executed for: PDR throughput on 2n-clx with xxv710.' - - 'YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' - - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' - - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' + - 'Test Case: Test cases executed for: MRR throughput on 2n-clx with xxv710.' + - 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' + - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' + - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' - '2206.0-10 vs 2202.0-10: Compares VPP code current vs previous in the current CSIT environment.' # VPP Performance Changes 2n-clx-cx556a 2t1c mrr @@ -5242,10 +5140,10 @@ compare: 4 legend: - '' - - 'Test Case: Test cases executed for: PDR throughput on 2n-clx with cx556a.' - - 'YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' - - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' - - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' + - 'Test Case: Test cases executed for: MRR throughput on 2n-clx with cx556a.' + - 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' + - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' + - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' - '2206.0-10 vs 2202.0-10: Compares VPP code current vs previous in the current CSIT environment.' # VPP Performance Changes 2n-clx-cx556a 4t2c mrr @@ -5273,10 +5171,10 @@ compare: 4 legend: - '' - - 'Test Case: Test cases executed for: PDR throughput on 2n-clx with cx556a.' - - 'YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' - - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' - - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' + - 'Test Case: Test cases executed for: MRR throughput on 2n-clx with cx556a.' + - 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' + - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' + - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' - '2206.0-10 vs 2202.0-10: Compares VPP code current vs previous in the current CSIT environment.' # VPP Performance Changes 2n-clx-cx556a 8t4c mrr @@ -5304,10 +5202,10 @@ compare: 4 legend: - '' - - 'Test Case: Test cases executed for: PDR throughput on 2n-clx with cx556a.' - - 'YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' - - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' - - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' + - 'Test Case: Test cases executed for: MRR throughput on 2n-clx with cx556a.' + - 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' + - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' + - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' - '2206.0-10 vs 2202.0-10: Compares VPP code current vs previous in the current CSIT environment.' # VPP Performance Changes 2n-zn2-xxv710 2t1c mrr @@ -5335,10 +5233,10 @@ compare: 4 legend: - '' - - 'Test Case: Test cases executed for: PDR throughput on 2n-zn2 with xxv710.' - - 'YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' - - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' - - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' + - 'Test Case: Test cases executed for: MRR throughput on 2n-zn2 with xxv710.' + - 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' + - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' + - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' - '2206.0-10 vs 2202.0-10: Compares VPP code current vs previous in the current CSIT environment.' # VPP Performance Changes 2n-zn2-xxv710 4t2c mrr @@ -5366,10 +5264,10 @@ compare: 4 legend: - '' - - 'Test Case: Test cases executed for: PDR throughput on 2n-zn2 with xxv710.' - - 'YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' - - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' - - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' + - 'Test Case: Test cases executed for: MRR throughput on 2n-zn2 with xxv710.' + - 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' + - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' + - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' - '2206.0-10 vs 2202.0-10: Compares VPP code current vs previous in the current CSIT environment.' # VPP Performance Changes 2n-zn2-xxv710 8t4c mrr @@ -5397,10 +5295,10 @@ compare: 4 legend: - '' - - 'Test Case: Test cases executed for: PDR throughput on 2n-zn2 with xxv710.' - - 'YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' - - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' - - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' + - 'Test Case: Test cases executed for: MRR throughput on 2n-zn2 with xxv710.' + - 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' + - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' + - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' - '2206.0-10 vs 2202.0-10: Compares VPP code current vs previous in the current CSIT environment.' # VPP Performance Changes 2n-dnv 1t1c mrr @@ -5428,10 +5326,10 @@ compare: 4 legend: - '' - - 'Test Case: Test cases executed for: PDR throughput on 2n-dnv with x553.' - - 'YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' - - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' - - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' + - 'Test Case: Test cases executed for: MRR throughput on 2n-dnv with x553.' + - 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' + - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' + - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' - '2206.0-10 vs 2202.0-10: Compares VPP code current vs previous in the current CSIT environment.' # VPP Performance Changes 2n-dnv 2t2c mrr @@ -5459,10 +5357,10 @@ compare: 4 legend: - '' - - 'Test Case: Test cases executed for: PDR throughput on 2n-dnv with x553.' - - 'YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' - - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' - - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' + - 'Test Case: Test cases executed for: MRR throughput on 2n-dnv with x553.' + - 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' + - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' + - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' - '2206.0-10 vs 2202.0-10: Compares VPP code current vs previous in the current CSIT environment.' # VPP Performance Changes 2n-dnv 4t4c mrr @@ -5490,10 +5388,10 @@ compare: 4 legend: - '' - - 'Test Case: Test cases executed for: PDR throughput on 2n-dnv with x553.' - - 'YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' - - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' - - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' + - 'Test Case: Test cases executed for: MRR throughput on 2n-dnv with x553.' + - 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' + - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' + - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' - '2206.0-10 vs 2202.0-10: Compares VPP code current vs previous in the current CSIT environment.' # VPP Performance Changes 3n-dnv 1t1c mrr @@ -5521,10 +5419,10 @@ compare: 4 legend: - '' - - 'Test Case: Test cases executed for: PDR throughput on 3n-dnv with x553.' - - 'YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' - - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' - - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' + - 'Test Case: Test cases executed for: MRR throughput on 3n-dnv with x553.' + - 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' + - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' + - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' - '2206.0-10 vs 2202.0-10: Compares VPP code current vs previous in the current CSIT environment.' # VPP Performance Changes 3n-dnv 2t2c mrr @@ -5552,10 +5450,10 @@ compare: 4 legend: - '' - - 'Test Case: Test cases executed for: PDR throughput on 3n-dnv with x553.' - - 'YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' - - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' - - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' + - 'Test Case: Test cases executed for: MRR throughput on 3n-dnv with x553.' + - 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' + - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' + - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' - '2206.0-10 vs 2202.0-10: Compares VPP code current vs previous in the current CSIT environment.' # VPP Performance Changes 3n-dnv 4t4c mrr @@ -5583,10 +5481,10 @@ compare: 4 legend: - '' - - 'Test Case: Test cases executed for: PDR throughput on 3n-dnv with x553.' - - 'YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' - - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' - - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' + - 'Test Case: Test cases executed for: MRR throughput on 3n-dnv with x553.' + - 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' + - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' + - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' - '2206.0-10 vs 2202.0-10: Compares VPP code current vs previous in the current CSIT environment.' # VPP Performance Changes 3n-tsh 1t1c mrr @@ -5614,10 +5512,10 @@ compare: 4 legend: - '' - - 'Test Case: Test cases executed for: PDR throughput on 3n-tsh with x520.' - - 'YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' - - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' - - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' + - 'Test Case: Test cases executed for: MRR throughput on 3n-tsh with x520.' + - 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' + - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' + - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' - '2206.0-10 vs 2202.0-10: Compares VPP code current vs previous in the current CSIT environment.' # VPP Performance Changes 3n-tsh 2t2c mrr @@ -5645,10 +5543,10 @@ compare: 4 legend: - '' - - 'Test Case: Test cases executed for: PDR throughput on 3n-tsh with x520.' - - 'YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' - - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' - - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' + - 'Test Case: Test cases executed for: MRR throughput on 3n-tsh with x520.' + - 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' + - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' + - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' - '2206.0-10 vs 2202.0-10: Compares VPP code current vs previous in the current CSIT environment.' # VPP Performance Changes 3n-tsh 4t4c mrr @@ -5676,10 +5574,10 @@ compare: 4 legend: - '' - - 'Test Case: Test cases executed for: PDR throughput on 3n-tsh with x520.' - - 'YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' - - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' - - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' + - 'Test Case: Test cases executed for: MRR throughput on 3n-tsh with x520.' + - 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' + - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' + - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' - '2206.0-10 vs 2202.0-10: Compares VPP code current vs previous in the current CSIT environment.' # VPP Performance Changes 2n-tx2 1t1c mrr @@ -5707,10 +5605,10 @@ compare: 4 legend: - '' - - 'Test Case: Test cases executed for: PDR throughput on 2n-tx2 with xl710.' - - 'YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' - - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' - - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' + - 'Test Case: Test cases executed for: MRR throughput on 2n-tx2 with xl710.' + - 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' + - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' + - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' - '2206.0-10 vs 2202.0-10: Compares VPP code current vs previous in the current CSIT environment.' # VPP Performance Changes 2n-tx2 2t2c mrr @@ -5738,10 +5636,10 @@ compare: 4 legend: - '' - - 'Test Case: Test cases executed for: PDR throughput on 2n-tx2 with xl710.' - - 'YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' - - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' - - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' + - 'Test Case: Test cases executed for: MRR throughput on 2n-tx2 with xl710.' + - 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' + - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' + - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' - '2206.0-10 vs 2202.0-10: Compares VPP code current vs previous in the current CSIT environment.' # VPP Performance Changes 2n-tx2 4t4c mrr @@ -5769,10 +5667,10 @@ compare: 4 legend: - '' - - 'Test Case: Test cases executed for: PDR throughput on 2n-tx2 with xl710.' - - 'YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' - - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' - - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' + - 'Test Case: Test cases executed for: MRR throughput on 2n-tx2 with xl710.' + - 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' + - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' + - '2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code.' - '2206.0-10 vs 2202.0-10: Compares VPP code current vs previous in the current CSIT environment.' # VPP Performance Changes 2n-aws 2t1c mrr @@ -5795,10 +5693,10 @@ compare: 3 legend: - '' - - 'Test Case: Test cases executed for: PDR throughput on 2n-aws with nitro50g.' - - 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' - - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' - - '2206.0-10 vs 2202.0-9: Compares VPP code current vs previous.' + - 'Test Case: Test cases executed for: MRR throughput on 2n-aws with nitro50g.' + - 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' + - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' + - '2206.0-10 vs 2202.0-9: Compares VPP code current vs previous.' # VPP Performance Changes 2n-aws 4t2c mrr - type: "table" @@ -5820,9 +5718,9 @@ compare: 3 legend: - '' - - 'Test Case: Test cases executed for: PDR throughput on 2n-aws with nitro50g.' - - 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' - - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' + - 'Test Case: Test cases executed for: MRR throughput on 2n-aws with nitro50g.' + - 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' + - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' - '2206.0-10 vs 2202.0-9: Compares VPP code current vs previous.' # # VPP Performance Changes 3n-aws 2t1c mrr @@ -5845,9 +5743,9 @@ # compare: 3 # legend: # - '' -# - 'Test Case: Test cases executed for: PDR throughput on 3n-aws with nitro50g.' -# - 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' -# - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' +# - 'Test Case: Test cases executed for: MRR throughput on 3n-aws with nitro50g.' +# - 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' +# - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' # - '2206.0-10 vs 2202.0-9: Compares VPP code current vs previous.' # # VPP Performance Changes 3n-aws 4t2c mrr @@ -5870,74 +5768,11 @@ # compare: 3 # legend: # - '' -# - 'Test Case: Test cases executed for: PDR throughput on 3n-aws with nitro50g.' -# - 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' -# - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' +# - 'Test Case: Test cases executed for: MRR throughput on 3n-aws with nitro50g.' +# - 'YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206).' +# - 'YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' # - '2206.0-10 vs 2202.0-9: Compares VPP code current vs previous.' -# VPP Comparison Across Testbeds 2n-skx to 2n-clx 2t1c mrr -- type: "table" - title: "VPP Comparison Across Testbeds 2n-skx to 2n-clx 2t1c mrr" - algorithm: "table_comparison" - output-file: "{DIR[STATIC,VPP]}/performance-compare-testbeds-2n-skx-2n-clx-2t1c-mrr" - include-tests: "MRR" # "PDR" | "NDR" | "MRR" - filter: "'2T1C' and 'NIC_Intel-XXV710'" - columns: - - title: "2n-skx" - data-set: "vpp-2n-skx-curr-iter-mrr" - - title: "2n-clx" - data-set: "vpp-2n-clx-curr-iter-mrr" - comparisons: - - title: "Diff" - reference: 1 - compare: 2 - legend: - - "" - - "2n-skx, 2n-clx - testbeds and NICs tested." - - "Diff - difference between 2n-skx and 2n-clx testbeds." - -# VPP Comparison Across Testbeds 2n-skx to 2n-clx 4t2c mrr -- type: "table" - title: "VPP Comparison Across Testbeds 2n-skx to 2n-clx 4t2c mrr" - algorithm: "table_comparison" - output-file: "{DIR[STATIC,VPP]}/performance-compare-testbeds-2n-skx-2n-clx-4t2c-mrr" - include-tests: "MRR" # "PDR" | "NDR" | "MRR" - filter: "'4T2C' and 'NIC_Intel-XXV710'" - columns: - - title: "2n-skx" - data-set: "vpp-2n-skx-curr-iter-mrr" - - title: "2n-clx" - data-set: "vpp-2n-clx-curr-iter-mrr" - comparisons: - - title: "Diff" - reference: 1 - compare: 2 - legend: - - "" - - "2n-skx, 2n-clx - testbeds and NICs tested." - - "Diff - difference between 2n-skx and 2n-clx testbeds." - -# VPP Comparison Across Testbeds 2n-skx to 2n-clx 8t4c mrr -- type: "table" - title: "VPP Comparison Across Testbeds 2n-skx to 2n-clx 8t4c mrr" - algorithm: "table_comparison" - output-file: "{DIR[STATIC,VPP]}/performance-compare-testbeds-2n-skx-2n-clx-8t4c-mrr" - include-tests: "MRR" # "PDR" | "NDR" | "MRR" - filter: "'8T4C' and 'NIC_Intel-XXV710'" - columns: - - title: "2n-skx" - data-set: "vpp-2n-skx-curr-iter-mrr" - - title: "2n-clx" - data-set: "vpp-2n-clx-curr-iter-mrr" - comparisons: - - title: "Diff" - reference: 1 - compare: 2 - legend: - - "" - - "2n-skx, 2n-clx - testbeds and NICs tested." - - "Diff - difference between 2n-skx and 2n-clx testbeds." - # VPP Comparison Across Topologies 3n-skx to 2n-skx 1c mrr - type: "table" title: "VPP Comparison Across Topologies 3n-skx to 2n-skx 1c mrr" @@ -5946,18 +5781,19 @@ include-tests: "MRR" # "PDR" | "NDR" | "MRR" filter: "'MRR' and '1C' and 'NIC_Intel-XXV710'" columns: - - title: "3n-skx" + - title: "3n-skx xxv710" data-set: "vpp-3n-skx-curr-iter-mrr" - - title: "2n-skx" + - title: "2n-skx xxv710" data-set: "vpp-2n-skx-curr-iter-mrr" comparisons: - - title: "Diff" + - title: "2n-skx vs 3n-skx" reference: 1 compare: 2 legend: - - "" - - "3n-skx, 2n-skx - topologies tested." - - "Diff - difference between 3n-skx and 2n-skx topologies." + - '' + - 'Test Case: Test cases executed for: MRR throughput on 3n-skx xxv710 and 2n-skx xxv710.' + - '3n-skx xxv710, 2n-skx xxv710: [Mpps +- StDev] results for VPP tested in CSIT' + - '2n-skx vs 3n-skx: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' # VPP Comparison Across Topologies 3n-skx to 2n-skx 2c mrr - type: "table" @@ -5967,18 +5803,19 @@ include-tests: "MRR" # "PDR" | "NDR" | "MRR" filter: "'MRR' and '2C' and 'NIC_Intel-XXV710'" columns: - - title: "3n-skx" + - title: "3n-skx xxv710" data-set: "vpp-3n-skx-curr-iter-mrr" - - title: "2n-skx" + - title: "2n-skx xxv710" data-set: "vpp-2n-skx-curr-iter-mrr" comparisons: - - title: "Diff" + - title: "2n-skx vs 3n-skx" reference: 1 compare: 2 legend: - - "" - - "3n-skx, 2n-skx - topologies tested." - - "Diff - difference between 3n-skx and 2n-skx topologies." + - '' + - 'Test Case: Test cases executed for: MRR throughput on 3n-skx xxv710 and 2n-skx xxv710.' + - '3n-skx xxv710, 2n-skx xxv710: [Mpps +- StDev] results for VPP tested in CSIT' + - '2n-skx vs 3n-skx: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' # VPP Comparison Across Topologies 3n-skx to 2n-skx 4c mrr - type: "table" @@ -5988,207 +5825,19 @@ include-tests: "MRR" # "PDR" | "NDR" | "MRR" filter: "'MRR' and '4C' and 'NIC_Intel-XXV710'" columns: - - title: "3n-skx" + - title: "3n-skx xxv710" data-set: "vpp-3n-skx-curr-iter-mrr" - - title: "2n-skx" - data-set: "vpp-2n-skx-curr-iter-mrr" - comparisons: - - title: "Diff" - reference: 1 - compare: 2 - legend: - - "" - - "3n-skx, 2n-skx - topologies tested." - - "Diff - difference between 3n-skx and 2n-skx topologies." - -# VPP Comparison Across Testbeds 2n-clx to 2n-icx 1c mrr -- type: "table" - title: "VPP Comparison Across Testbeds 2n-clx to 2n-icx 1c mrr" - algorithm: "table_comparison" - output-file: "{DIR[STATIC,VPP]}/performance-compare-testbeds-2n-clx-2n-icx-1c-mrr" - include-tests: "MRR" # "PDR" | "NDR" | "MRR" - filter: "'NIC_Intel-XXV710' and 'MRR' and '1C'" - columns: - - title: "2n-clx xxv710" - data-set: "vpp-2n-clx-curr-iter-mrr" - - title: "2n-icx xxv710" - data-set: "vpp-2n-icx-curr-iter-mrr" - comparisons: - - title: "Diff" - reference: 1 - compare: 2 - legend: - - "" - - "2n-clx xxv710, 2n-icx xxv710 - testbeds and NICs tested." - - "Diff - difference between 2n-clx xxv710 and 2n-icx xxv710 testbeds." - -# VPP Comparison Across Testbeds 2n-clx to 2n-icx 2c mrr -- type: "table" - title: "VPP Comparison Across Testbeds 2n-clx to 2n-icx 2c mrr" - algorithm: "table_comparison" - output-file: "{DIR[STATIC,VPP]}/performance-compare-testbeds-2n-clx-2n-icx-2c-mrr" - include-tests: "MRR" # "PDR" | "NDR" | "MRR" - filter: "'NIC_Intel-XXV710' and 'MRR' and '2C'" - columns: - - title: "2n-clx xxv710" - data-set: "vpp-2n-clx-curr-iter-mrr" - - title: "2n-icx xxv710" - data-set: "vpp-2n-icx-curr-iter-mrr" - comparisons: - - title: "Diff" - reference: 1 - compare: 2 - legend: - - "" - - "2n-clx xxv710, 2n-icx xxv710 - testbeds and NICs tested." - - "Diff - difference between 2n-clx xxv710 and 2n-icx xxv710 testbeds." - -# VPP Comparison Across Testbeds 2n-clx to 2n-icx 4c mrr -- type: "table" - title: "VPP Comparison Across Testbeds 2n-clx to 2n-icx 4c mrr" - algorithm: "table_comparison" - output-file: "{DIR[STATIC,VPP]}/performance-compare-testbeds-2n-clx-2n-icx-4c-mrr" - include-tests: "MRR" # "PDR" | "NDR" | "MRR" - filter: "'NIC_Intel-XXV710' and 'MRR' and '4C'" - columns: - - title: "2n-clx xxv710" - data-set: "vpp-2n-clx-curr-iter-mrr" - - title: "2n-icx xxv710" - data-set: "vpp-2n-icx-curr-iter-mrr" - comparisons: - - title: "Diff" - reference: 1 - compare: 2 - legend: - - "" - - "2n-clx xxv710, 2n-icx xxv710 - testbeds and NICs tested." - - "Diff - difference between 2n-clx xxv710 and 2n-icx xxv710 testbeds." - -# VPP Comparison Across Testbeds 2n-skx to 2n-icx 1c mrr -- type: "table" - title: "VPP Comparison Across Testbeds 2n-skx to 2n-icx 1c mrr" - algorithm: "table_comparison" - output-file: "{DIR[STATIC,VPP]}/performance-compare-testbeds-2n-skx-2n-icx-1c-mrr" - include-tests: "MRR" # "PDR" | "NDR" | "MRR" - filter: "'NIC_Intel-XXV710' and 'MRR' and '1C'" - columns: - title: "2n-skx xxv710" data-set: "vpp-2n-skx-curr-iter-mrr" - - title: "2n-icx xxv710" - data-set: "vpp-2n-icx-curr-iter-mrr" comparisons: - - title: "Diff" + - title: "2n-skx vs 3n-skx" reference: 1 compare: 2 legend: - - "" - - "2n-skx xxv710, 2n-icx xxv710 - testbeds and NICs tested." - - "Diff - difference between 2n-skx xxv710 and 2n-icx xxv710 testbeds." - -# VPP Comparison Across Testbeds 2n-skx to 2n-icx 2c mrr -- type: "table" - title: "VPP Comparison Across Testbeds 2n-skx to 2n-icx 2c mrr" - algorithm: "table_comparison" - output-file: "{DIR[STATIC,VPP]}/performance-compare-testbeds-2n-skx-2n-icx-2c-mrr" - include-tests: "MRR" # "PDR" | "NDR" | "MRR" - filter: "'NIC_Intel-XXV710' and 'MRR' and '2C'" - columns: - - title: "2n-skx xxv710" - data-set: "vpp-2n-skx-curr-iter-mrr" - - title: "2n-icx xxv710" - data-set: "vpp-2n-icx-curr-iter-mrr" - comparisons: - - title: "Diff" - reference: 1 - compare: 2 - legend: - - "" - - "2n-skx xxv710, 2n-icx xxv710 - testbeds and NICs tested." - - "Diff - difference between 2n-skx xxv710 and 2n-icx xxv710 testbeds." - -# VPP Comparison Across Testbeds 2n-skx to 2n-icx 4c mrr -- type: "table" - title: "VPP Comparison Across Testbeds 2n-skx to 2n-icx 4c mrr" - algorithm: "table_comparison" - output-file: "{DIR[STATIC,VPP]}/performance-compare-testbeds-2n-skx-2n-icx-4c-mrr" - include-tests: "MRR" # "PDR" | "NDR" | "MRR" - filter: "'NIC_Intel-XXV710' and 'MRR' and '4C'" - columns: - - title: "2n-skx xxv710" - data-set: "vpp-2n-skx-curr-iter-mrr" - - title: "2n-icx xxv710" - data-set: "vpp-2n-icx-curr-iter-mrr" - comparisons: - - title: "Diff" - reference: 1 - compare: 2 - legend: - - "" - - "2n-skx xxv710, 2n-icx xxv710 - testbeds and NICs tested." - - "Diff - difference between 2n-skx xxv710 and 2n-icx xxv710 testbeds." - -# VPP Comparison Across Testbeds 3n-skx to 3n-icx 1c mrr -- type: "table" - title: "VPP Comparison Across Testbeds 3n-skx to 3n-icx 1c mrr" - algorithm: "table_comparison" - output-file: "{DIR[STATIC,VPP]}/performance-compare-testbeds-3n-skx-3n-icx-1c-mrr" - include-tests: "MRR" # "PDR" | "NDR" | "MRR" - filter: "'NIC_Intel-XXV710' and 'MRR' and '1C'" - columns: - - title: "3n-skx xxv710" - data-set: "vpp-3n-skx-curr-iter-mrr" - - title: "3n-icx xxv710" - data-set: "vpp-3n-icx-curr-iter-mrr" - comparisons: - - title: "Diff" - reference: 1 - compare: 2 - legend: - - "" - - "3n-skx xxv710, 3n-icx xxv710 - testbeds and NICs tested." - - "Diff - difference between 3n-skx xxv710 and 3n-icx xxv710 testbeds." - -# VPP Comparison Across Testbeds 3n-skx to 3n-icx 2c mrr -- type: "table" - title: "VPP Comparison Across Testbeds 3n-skx to 3n-icx 2c mrr" - algorithm: "table_comparison" - output-file: "{DIR[STATIC,VPP]}/performance-compare-testbeds-3n-skx-3n-icx-2c-mrr" - include-tests: "MRR" # "PDR" | "NDR" | "MRR" - filter: "'NIC_Intel-XXV710' and 'MRR' and '2C'" - columns: - - title: "3n-skx xxv710" - data-set: "vpp-3n-skx-curr-iter-mrr" - - title: "3n-icx xxv710" - data-set: "vpp-3n-icx-curr-iter-mrr" - comparisons: - - title: "Diff" - reference: 1 - compare: 2 - legend: - - "" - - "3n-skx xxv710, 3n-icx xxv710 - testbeds and NICs tested." - - "Diff - difference between 3n-skx xxv710 and 3n-icx xxv710 testbeds." - -# VPP Comparison Across Testbeds 3n-skx to 3n-icx 4c mrr -- type: "table" - title: "VPP Comparison Across Testbeds 3n-skx to 3n-icx 4c mrr" - algorithm: "table_comparison" - output-file: "{DIR[STATIC,VPP]}/performance-compare-testbeds-3n-skx-3n-icx-4c-mrr" - include-tests: "MRR" # "PDR" | "NDR" | "MRR" - filter: "'NIC_Intel-XXV710' and 'MRR' and '4C'" - columns: - - title: "3n-skx xxv710" - data-set: "vpp-3n-skx-curr-iter-mrr" - - title: "3n-icx xxv710" - data-set: "vpp-3n-icx-curr-iter-mrr" - comparisons: - - title: "Diff" - reference: 1 - compare: 2 - legend: - - "" - - "3n-skx xxv710, 3n-icx xxv710 - testbeds and NICs tested." - - "Diff - difference between 3n-skx xxv710 and 3n-icx xxv710 testbeds." + - '' + - 'Test Case: Test cases executed for: MRR throughput on 3n-skx xxv710 and 2n-skx xxv710.' + - '3n-skx xxv710, 2n-skx xxv710: [Mpps +- StDev] results for VPP tested in CSIT' + - '2n-skx vs 3n-skx: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' # Detailed Test Results - VPP Performance Results 3n-skx - type: "table" @@ -7237,13 +6886,14 @@ - title: "22.03" data-set: "dpdk-3n-icx-curr-iter" comparisons: - - title: "Diff" + - title: "22.03 vs 21.11" reference: 1 compare: 2 legend: - - "" - - "21.11, 22.03 - DPDK versions tested." - - "Diff - difference between 21.11 and 22.03 DPDK version." + - '' + - 'Test Case: Test cases executed for: PDR throughput on 3n-icx with xxv710.' + - '21.11, 22.03: [Mpps +- StDev] results for DPDK tested in CSIT.' + - '22.03 vs 21.11: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' # DPDK Performance Changes 3n-icx 4t2c pdr - type: "table" @@ -7260,13 +6910,14 @@ - title: "22.03" data-set: "dpdk-3n-icx-curr-iter" comparisons: - - title: "Diff" + - title: "22.03 vs 21.11" reference: 1 compare: 2 legend: - - "" - - "21.11, 22.03 - DPDK versions tested." - - "Diff - difference between 21.11 and 22.03 DPDK version." + - '' + - 'Test Case: Test cases executed for: PDR throughput on 3n-icx with xxv710.' + - '21.11, 22.03: [Mpps +- StDev] results for DPDK tested in CSIT.' + - '22.03 vs 21.11: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' # DPDK Performance Changes 3n-icx 2t1c ndr - type: "table" @@ -7283,13 +6934,14 @@ - title: "22.03" data-set: "dpdk-3n-icx-curr-iter" comparisons: - - title: "Diff" + - title: "22.03 vs 21.11" reference: 1 compare: 2 legend: - - "" - - "21.11, 22.03 - DPDK versions tested." - - "Diff - difference between 21.11 and 22.03 DPDK version." + - '' + - 'Test Case: Test cases executed for: NDR throughput on 3n-icx with xxv710.' + - '21.11, 22.03: [Mpps +- StDev] results for DPDK tested in CSIT.' + - '22.03 vs 21.11: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' # DPDK Performance Changes 3n-icx 4t2c ndr - type: "table" @@ -7306,13 +6958,14 @@ - title: "22.03" data-set: "dpdk-3n-icx-curr-iter" comparisons: - - title: "Diff" + - title: "22.03 vs 21.11" reference: 1 compare: 2 legend: - - "" - - "21.11, 22.03 - DPDK versions tested." - - "Diff - difference between 21.11 and 22.03 DPDK version." + - '' + - 'Test Case: Test cases executed for: NDR throughput on 3n-icx with xxv710.' + - '21.11, 22.03: [Mpps +- StDev] results for DPDK tested in CSIT.' + - '22.03 vs 21.11: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' # DPDK Performance Changes 2n-icx 2t1c pdr - type: "table" @@ -7329,13 +6982,14 @@ - title: "22.03" data-set: "dpdk-2n-icx-curr-iter" comparisons: - - title: "Diff" + - title: "22.03 vs 21.11" reference: 1 compare: 2 legend: - - "" - - "21.11, 22.03 - DPDK versions tested." - - "Diff - difference between 21.11 and 22.03 DPDK version." + - '' + - 'Test Case: Test cases executed for: PDR throughput on 2n-icx with xxv710.' + - '21.11, 22.03: [Mpps +- StDev] results for DPDK tested in CSIT.' + - '22.03 vs 21.11: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' # DPDK Performance Changes 2n-icx 4t2c pdr - type: "table" @@ -7352,13 +7006,14 @@ - title: "22.03" data-set: "dpdk-2n-icx-curr-iter" comparisons: - - title: "Diff" + - title: "22.03 vs 21.11" reference: 1 compare: 2 legend: - - "" - - "21.11, 22.03 - DPDK versions tested." - - "Diff - difference between 21.11 and 22.03 DPDK version." + - '' + - 'Test Case: Test cases executed for: PDR throughput on 2n-icx with xxv710.' + - '21.11, 22.03: [Mpps +- StDev] results for DPDK tested in CSIT.' + - '22.03 vs 21.11: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' # DPDK Performance Changes 2n-icx 2t1c ndr - type: "table" @@ -7375,13 +7030,14 @@ - title: "22.03" data-set: "dpdk-2n-icx-curr-iter" comparisons: - - title: "Diff" + - title: "22.03 vs 21.11" reference: 1 compare: 2 legend: - - "" - - "21.11, 22.03 - DPDK versions tested." - - "Diff - difference between 21.11 and 22.03 DPDK version." + - '' + - 'Test Case: Test cases executed for: NDR throughput on 2n-icx with xxv710.' + - '21.11, 22.03: [Mpps +- StDev] results for DPDK tested in CSIT.' + - '22.03 vs 21.11: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' # DPDK Performance Changes 2n-icx 4t2c ndr - type: "table" @@ -7398,13 +7054,14 @@ - title: "22.03" data-set: "dpdk-2n-icx-curr-iter" comparisons: - - title: "Diff" + - title: "22.03 vs 21.11" reference: 1 compare: 2 legend: - - "" - - "21.11, 22.03 - DPDK versions tested." - - "Diff - difference between 21.11 and 22.03 DPDK version." + - '' + - 'Test Case: Test cases executed for: NDR throughput on 2n-icx with xxv710.' + - '21.11, 22.03: [Mpps +- StDev] results for DPDK tested in CSIT.' + - '22.03 vs 21.11: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' # DPDK Performance Changes 3n-skx 2t1c pdr - type: "table" @@ -7421,13 +7078,14 @@ - title: "22.03" data-set: "dpdk-3n-skx-curr-iter" comparisons: - - title: "Diff" + - title: "22.03 vs 21.11" reference: 2 compare: 3 legend: - - "" - - "21.08, 21.11, 22.03 - DPDK versions tested." - - "Diff - difference between 21.11 and 22.03 DPDK version." + - '' + - 'Test Case: Test cases executed for: PDR throughput on 3n-skx with xxv710.' + - '21.08, 21.11, 22.03: [Mpps +- StDev] results for DPDK tested in CSIT.' + - '22.03 vs 21.11: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' # DPDK Performance Changes 3n-skx 4t2c pdr - type: "table" @@ -7444,13 +7102,14 @@ - title: "22.03" data-set: "dpdk-3n-skx-curr-iter" comparisons: - - title: "Diff" + - title: "22.03 vs 21.11" reference: 2 compare: 3 legend: - - "" - - "21.08, 21.11, 22.03 - DPDK versions tested." - - "Diff - difference between 21.11 and 22.03 DPDK version." + - '' + - 'Test Case: Test cases executed for: PDR throughput on 3n-skx with xxv710.' + - '21.08, 21.11, 22.03: [Mpps +- StDev] results for DPDK tested in CSIT.' + - '22.03 vs 21.11: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' # DPDK Performance Changes 3n-skx 2t1c ndr - type: "table" @@ -7467,13 +7126,14 @@ - title: "22.03" data-set: "dpdk-3n-skx-curr-iter" comparisons: - - title: "Diff" + - title: "22.03 vs 21.11" reference: 2 compare: 3 legend: - - "" - - "21.08, 21.11, 22.03 - DPDK versions tested." - - "Diff - difference between 21.11 and 22.03 DPDK version." + - '' + - 'Test Case: Test cases executed for: NDR throughput on 3n-skx with xxv710.' + - '21.08, 21.11, 22.03: [Mpps +- StDev] results for DPDK tested in CSIT.' + - '22.03 vs 21.11: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' # DPDK Performance Changes 3n-skx 4t2c ndr - type: "table" @@ -7490,13 +7150,14 @@ - title: "22.03" data-set: "dpdk-3n-skx-curr-iter" comparisons: - - title: "Diff" + - title: "22.03 vs 21.11" reference: 2 compare: 3 legend: - - "" - - "21.08, 21.11, 22.03 - DPDK versions tested." - - "Diff - difference between 21.11 and 22.03 DPDK version." + - '' + - 'Test Case: Test cases executed for: NDR throughput on 3n-skx with xxv710.' + - '21.08, 21.11, 22.03: [Mpps +- StDev] results for DPDK tested in CSIT.' + - '22.03 vs 21.11: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' # DPDK Performance Changes 2n-skx 2t1c pdr - type: "table" @@ -7513,13 +7174,14 @@ - title: "22.03" data-set: "dpdk-2n-skx-curr-iter" comparisons: - - title: "Diff" + - title: "22.03 vs 21.11" reference: 2 compare: 3 legend: - - "" - - "21.08, 21.11, 22.03 - DPDK versions tested." - - "Diff - difference between 21.11 and 22.03 DPDK version." + - '' + - 'Test Case: Test cases executed for: PDR throughput on 2n-skx with xxv710.' + - '21.08, 21.11, 22.03: [Mpps +- StDev] results for DPDK tested in CSIT.' + - '22.03 vs 21.11: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' # DPDK Performance Changes 2n-skx 4t2c pdr - type: "table" @@ -7536,13 +7198,14 @@ - title: "22.03" data-set: "dpdk-2n-skx-curr-iter" comparisons: - - title: "Diff" + - title: "22.03 vs 21.11" reference: 2 compare: 3 legend: - - "" - - "21.08, 21.11, 22.03 - DPDK versions tested." - - "Diff - difference between 21.11 and 22.03 DPDK version." + - '' + - 'Test Case: Test cases executed for: PDR throughput on 2n-skx with xxv710.' + - '21.08, 21.11, 22.03: [Mpps +- StDev] results for DPDK tested in CSIT.' + - '22.03 vs 21.11: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' # DPDK Performance Changes 2n-skx 2t1c ndr - type: "table" @@ -7559,13 +7222,14 @@ - title: "22.03" data-set: "dpdk-2n-skx-curr-iter" comparisons: - - title: "Diff" + - title: "22.03 vs 21.11" reference: 2 compare: 3 legend: - - "" - - "21.08, 21.11, 22.03 - DPDK versions tested." - - "Diff - difference between 21.11 and 22.03 DPDK version." + - '' + - 'Test Case: Test cases executed for: NDR throughput on 2n-skx with xxv710.' + - '21.08, 21.11, 22.03: [Mpps +- StDev] results for DPDK tested in CSIT.' + - '22.03 vs 21.11: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' # DPDK Performance Changes 2n-skx 4t2c ndr - type: "table" @@ -7582,13 +7246,14 @@ - title: "22.03" data-set: "dpdk-2n-skx-curr-iter" comparisons: - - title: "Diff" + - title: "22.03 vs 21.11" reference: 2 compare: 3 legend: - - "" - - "21.08, 21.11, 22.03 - DPDK versions tested." - - "Diff - difference between 21.11 and 22.03 DPDK version." + - '' + - 'Test Case: Test cases executed for: NDR throughput on 2n-skx with xxv710.' + - '21.08, 21.11, 22.03: [Mpps +- StDev] results for DPDK tested in CSIT.' + - '22.03 vs 21.11: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' # DPDK Performance Changes 2n-clx 2t1c pdr - type: "table" @@ -7605,13 +7270,14 @@ - title: "22.03" data-set: "dpdk-2n-clx-curr-iter" comparisons: - - title: "Diff" + - title: "22.03 vs 21.11" reference: 2 compare: 3 legend: - - "" - - "21.08, 21.11, 22.03 - DPDK versions tested." - - "Diff - difference between 21.11 and 22.03 DPDK version." + - '' + - 'Test Case: Test cases executed for: PDR throughput on 2n-clx with xxv710.' + - '21.08, 21.11, 22.03: [Mpps +- StDev] results for DPDK tested in CSIT.' + - '22.03 vs 21.11: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' # DPDK Performance Changes 2n-clx 4t2c pdr - type: "table" @@ -7628,13 +7294,14 @@ - title: "22.03" data-set: "dpdk-2n-clx-curr-iter" comparisons: - - title: "Diff" + - title: "22.03 vs 21.11" reference: 2 compare: 3 legend: - - "" - - "21.08, 21.11, 22.03 - DPDK versions tested." - - "Diff - difference between 21.11 and 22.03 DPDK version." + - '' + - 'Test Case: Test cases executed for: PDR throughput on 2n-clx with xxv710.' + - '21.08, 21.11, 22.03: [Mpps +- StDev] results for DPDK tested in CSIT.' + - '22.03 vs 21.11: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' # DPDK Performance Changes 2n-clx 2t1c ndr - type: "table" @@ -7651,13 +7318,14 @@ - title: "22.03" data-set: "dpdk-2n-clx-curr-iter" comparisons: - - title: "Diff" + - title: "22.03 vs 21.11" reference: 2 compare: 3 legend: - - "" - - "21.08, 21.11, 22.03 - DPDK versions tested." - - "Diff - difference between 21.11 and 22.03 DPDK version." + - '' + - 'Test Case: Test cases executed for: NDR throughput on 2n-clx with xxv710.' + - '21.08, 21.11, 22.03: [Mpps +- StDev] results for DPDK tested in CSIT.' + - '22.03 vs 21.11: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' # DPDK Performance Changes 2n-clx 4t2c ndr - type: "table" @@ -7674,13 +7342,14 @@ - title: "22.03" data-set: "dpdk-2n-clx-curr-iter" comparisons: - - title: "Diff" + - title: "22.03 vs 21.11" reference: 2 compare: 3 legend: - - "" - - "21.08, 21.11, 22.03 - DPDK versions tested." - - "Diff - difference between 21.11 and 22.03 DPDK version." + - '' + - 'Test Case: Test cases executed for: NDR throughput on 2n-clx with xxv710.' + - '21.08, 21.11, 22.03: [Mpps +- StDev] results for DPDK tested in CSIT.' + - '22.03 vs 21.11: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' # DPDK Performance Changes 2n-zn2 2t1c pdr - type: "table" @@ -7697,13 +7366,14 @@ - title: "22.03" data-set: "dpdk-2n-zn2-curr-iter" comparisons: - - title: "Diff" + - title: "22.03 vs 21.11" reference: 2 compare: 3 legend: - - "" - - "21.08, 21.11, 22.03 - DPDK versions tested." - - "Diff - difference between 21.11 and 22.03 DPDK version." + - '' + - 'Test Case: Test cases executed for: PDR throughput on 2n-zn2 with xxv710.' + - '21.08, 21.11, 22.03: [Mpps +- StDev] results for DPDK tested in CSIT.' + - '22.03 vs 21.11: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' # DPDK Performance Changes 2n-zn2 4t2c pdr - type: "table" @@ -7720,13 +7390,14 @@ - title: "22.03" data-set: "dpdk-2n-zn2-curr-iter" comparisons: - - title: "Diff" + - title: "22.03 vs 21.11" reference: 2 compare: 3 legend: - - "" - - "21.08, 21.11, 22.03 - DPDK versions tested." - - "Diff - difference between 21.11 and 22.03 DPDK version." + - '' + - 'Test Case: Test cases executed for: PDR throughput on 2n-zn2 with xxv710.' + - '21.08, 21.11, 22.03: [Mpps +- StDev] results for DPDK tested in CSIT.' + - '22.03 vs 21.11: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' # DPDK Performance Changes 2n-zn2 2t1c ndr - type: "table" @@ -7743,13 +7414,14 @@ - title: "22.03" data-set: "dpdk-2n-zn2-curr-iter" comparisons: - - title: "Diff" + - title: "22.03 vs 21.11" reference: 2 compare: 3 legend: - - "" - - "21.08, 21.11, 22.03 - DPDK versions tested." - - "Diff - difference between 21.11 and 22.03 DPDK version." + - '' + - 'Test Case: Test cases executed for: NDR throughput on 2n-zn2 with xxv710.' + - '21.08, 21.11, 22.03: [Mpps +- StDev] results for DPDK tested in CSIT.' + - '22.03 vs 21.11: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' # DPDK Performance Changes 2n-zn2 4t2c ndr - type: "table" @@ -7766,13 +7438,14 @@ - title: "22.03" data-set: "dpdk-2n-zn2-curr-iter" comparisons: - - title: "Diff" + - title: "22.03 vs 21.11" reference: 2 compare: 3 legend: - - "" - - "21.08, 21.11, 22.03 - DPDK versions tested." - - "Diff - difference between 21.11 and 22.03 DPDK version." + - '' + - 'Test Case: Test cases executed for: NDR throughput on 2n-zn2 with xxv710.' + - '21.08, 21.11, 22.03: [Mpps +- StDev] results for DPDK tested in CSIT.' + - '22.03 vs 21.11: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' # DPDK Performance Changes 3n-tsh 1t1c pdr - type: "table" @@ -7789,13 +7462,14 @@ - title: "22.03" data-set: "dpdk-3n-tsh-curr-iter" comparisons: - - title: "Diff" + - title: "22.03 vs 21.11" reference: 2 compare: 3 legend: - - "" - - "21.08, 21.11, 22.03 - DPDK versions tested." - - "Diff - difference between 21.11 and 22.03 DPDK version." + - '' + - 'Test Case: Test cases executed for: PDR throughput on 3n-tsh with x520.' + - '21.08, 21.11, 22.03: [Mpps +- StDev] results for DPDK tested in CSIT.' + - '22.03 vs 21.11: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' # DPDK Performance Changes 3n-tsh 2t2c pdr - type: "table" @@ -7812,13 +7486,14 @@ - title: "22.03" data-set: "dpdk-3n-tsh-curr-iter" comparisons: - - title: "Diff" + - title: "22.03 vs 21.11" reference: 2 compare: 3 legend: - - "" - - "21.08, 21.11, 22.03 - DPDK versions tested." - - "Diff - difference between 21.11 and 22.03 DPDK version." + - '' + - 'Test Case: Test cases executed for: PDR throughput on 3n-tsh with x520.' + - '21.08, 21.11, 22.03: [Mpps +- StDev] results for DPDK tested in CSIT.' + - '22.03 vs 21.11: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' # DPDK Performance Changes 3n-tsh 1t1c ndr - type: "table" @@ -7835,13 +7510,14 @@ - title: "22.03" data-set: "dpdk-3n-tsh-curr-iter" comparisons: - - title: "Diff" + - title: "22.03 vs 21.11" reference: 2 compare: 3 legend: - - "" - - "21.08, 21.11, 22.03 - DPDK versions tested." - - "Diff - difference between 21.11 and 22.03 DPDK version." + - '' + - 'Test Case: Test cases executed for: NDR throughput on 3n-tsh with x520.' + - '21.08, 21.11, 22.03: [Mpps +- StDev] results for DPDK tested in CSIT.' + - '22.03 vs 21.11: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' # DPDK Performance Changes 3n-tsh 2t2c ndr - type: "table" @@ -7858,13 +7534,14 @@ - title: "22.03" data-set: "dpdk-3n-tsh-curr-iter" comparisons: - - title: "Diff" + - title: "22.03 vs 21.11" reference: 2 compare: 3 legend: - - "" - - "21.08, 21.11, 22.03 - DPDK versions tested." - - "Diff - difference between 21.11 and 22.03 DPDK version." + - '' + - 'Test Case: Test cases executed for: NDR throughput on 3n-tsh with x520.' + - '21.08, 21.11, 22.03: [Mpps +- StDev] results for DPDK tested in CSIT.' + - '22.03 vs 21.11: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' # DPDK Performance Changes 2n-tx2 1t1c pdr - type: "table" @@ -7881,13 +7558,14 @@ - title: "22.03" data-set: "dpdk-2n-tx2-curr-iter" comparisons: - - title: "Diff" + - title: "22.03 vs 21.11" reference: 2 compare: 3 legend: - - "" - - "21.08, 21.11, 22.03 - DPDK versions tested." - - "Diff - difference between 21.11 and 22.03 DPDK version." + - '' + - 'Test Case: Test cases executed for: PDR throughput on 2n-tx2.' + - '21.08, 21.11, 22.03: [Mpps +- StDev] results for DPDK tested in CSIT.' + - '22.03 vs 21.11: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' # DPDK Performance Changes 2n-tx2 2t2c pdr - type: "table" @@ -7904,13 +7582,14 @@ - title: "22.03" data-set: "dpdk-2n-tx2-curr-iter" comparisons: - - title: "Diff" + - title: "22.03 vs 21.11" reference: 2 compare: 3 legend: - - "" - - "21.08, 21.11, 22.03 - DPDK versions tested." - - "Diff - difference between 21.11 and 22.03 DPDK version." + - '' + - 'Test Case: Test cases executed for: PDR throughput on 2n-tx2.' + - '21.08, 21.11, 22.03: [Mpps +- StDev] results for DPDK tested in CSIT.' + - '22.03 vs 21.11: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' # DPDK Performance Changes 2n-tx2 1t1c ndr - type: "table" @@ -7927,13 +7606,14 @@ - title: "22.03" data-set: "dpdk-2n-tx2-curr-iter" comparisons: - - title: "Diff" + - title: "22.03 vs 21.11" reference: 2 compare: 3 legend: - - "" - - "21.08, 21.11, 22.03 - DPDK versions tested." - - "Diff - difference between 21.11 and 22.03 DPDK version." + - '' + - 'Test Case: Test cases executed for: NDR throughput on 2n-tx2.' + - '21.08, 21.11, 22.03: [Mpps +- StDev] results for DPDK tested in CSIT.' + - '22.03 vs 21.11: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' # DPDK Performance Changes 2n-tx2 2t2c ndr - type: "table" @@ -7954,177 +7634,10 @@ reference: 2 compare: 3 legend: - - "" - - "21.08, 21.11, 22.03 - DPDK versions tested." - - "Diff - difference between 21.11 and 22.03 DPDK version." - -# DPDK Comparison Across Testbeds 2n-skx to 2n-clx ndr -- type: "table" - title: "DPDK Comparison Across Testbeds 2n-skx to 2n-clx ndr" - algorithm: "table_comparison" - output-file: "{DIR[STATIC,DPDK]}/performance-compare-testbeds-2n-skx-2n-clx-ndr" - include-tests: "NDR" # "PDR" | "NDR" | "MRR" - filter: "'NIC_Intel-XXV710'" - columns: - - title: "2n-skx" - data-set: "dpdk-2n-skx-curr-iter" - - title: "2n-clx" - data-set: "dpdk-2n-clx-curr-iter" - comparisons: - - title: "Diff" - reference: 1 - compare: 2 - legend: - - "" - - "2n-skx, 2n-clx - testbeds and NICs tested." - - "Diff - difference between 2n-skx and 2n-clx testbeds." - -# DPDK Comparison Across Testbeds 2n-skx to 2n-clx pdr -- type: "table" - title: "DPDK Comparison Across Testbeds 2n-skx to 2n-clx pdr" - algorithm: "table_comparison" - output-file: "{DIR[STATIC,DPDK]}/performance-compare-testbeds-2n-skx-2n-clx-pdr" - include-tests: "PDR" # "PDR" | "NDR" | "MRR" - filter: "'NIC_Intel-XXV710'" - columns: - - title: "2n-skx" - data-set: "dpdk-2n-skx-curr-iter" - - title: "2n-clx" - data-set: "dpdk-2n-clx-curr-iter" - comparisons: - - title: "Diff" - reference: 1 - compare: 2 - legend: - - "" - - "2n-skx, 2n-clx - testbeds and NICs tested." - - "Diff - difference between 2n-skx and 2n-clx testbeds." - -# DPDK Comparison Across Testbeds 2n-clx to 2n-icx ndr -- type: "table" - title: "DPDK Comparison Across Testbeds 2n-clx to 2n-icx ndr" - algorithm: "table_comparison" - output-file: "{DIR[STATIC,DPDK]}/performance-compare-testbeds-2n-clx-2n-icx-ndr" - include-tests: "NDR" # "PDR" | "NDR" | "MRR" - filter: "'NIC_Intel-XXV710'" - columns: - - title: "2n-clx xxv710" - data-set: "dpdk-2n-clx-curr-iter" - - title: "2n-icx xxv710" - data-set: "dpdk-2n-icx-curr-iter" - comparisons: - - title: "Diff" - reference: 1 - compare: 2 - legend: - - "" - - "2n-clx xxv710, 2n-icx xxv710 - testbeds and NICs tested." - - "Diff - difference between 2n-clx xxv710 and 2n-icx xxv710 testbeds." - -# DPDK Comparison Across Testbeds 2n-clx to 2n-icx pdr -- type: "table" - title: "DPDK Comparison Across Testbeds 2n-clx to 2n-icx pdr" - algorithm: "table_comparison" - output-file: "{DIR[STATIC,DPDK]}/performance-compare-testbeds-2n-clx-2n-icx-pdr" - include-tests: "PDR" # "PDR" | "NDR" | "MRR" - filter: "'NIC_Intel-XXV710'" - columns: - - title: "2n-clx xxv710" - data-set: "dpdk-2n-clx-curr-iter" - - title: "2n-icx xxv710" - data-set: "dpdk-2n-icx-curr-iter" - comparisons: - - title: "Diff" - reference: 1 - compare: 2 - legend: - - "" - - "2n-clx xxv710, 2n-icx xxv710 - testbeds and NICs tested." - - "Diff - difference between 2n-clx xxv710 and 2n-icx xxv710 testbeds." - -# DPDK Comparison Across Testbeds 2n-skx to 2n-icx ndr -- type: "table" - title: "DPDK Comparison Across Testbeds 2n-skx to 2n-icx ndr" - algorithm: "table_comparison" - output-file: "{DIR[STATIC,DPDK]}/performance-compare-testbeds-2n-skx-2n-icx-ndr" - include-tests: "NDR" # "PDR" | "NDR" | "MRR" - filter: "'NIC_Intel-XXV710'" - columns: - - title: "2n-skx xxv710" - data-set: "dpdk-2n-skx-curr-iter" - - title: "2n-icx xxv710" - data-set: "dpdk-2n-icx-curr-iter" - comparisons: - - title: "Diff" - reference: 1 - compare: 2 - legend: - - "" - - "2n-skx xxv710, 2n-icx xxv710 - testbeds and NICs tested." - - "Diff - difference between 2n-skx xxv710 and 2n-icx xxv710 testbeds." - -# DPDK Comparison Across Testbeds 2n-skx to 2n-icx pdr -- type: "table" - title: "DPDK Comparison Across Testbeds 2n-skx to 2n-icx pdr" - algorithm: "table_comparison" - output-file: "{DIR[STATIC,DPDK]}/performance-compare-testbeds-2n-skx-2n-icx-pdr" - include-tests: "PDR" # "PDR" | "NDR" | "MRR" - filter: "'NIC_Intel-XXV710'" - columns: - - title: "2n-skx xxv710" - data-set: "dpdk-2n-skx-curr-iter" - - title: "2n-icx xxv710" - data-set: "dpdk-2n-icx-curr-iter" - comparisons: - - title: "Diff" - reference: 1 - compare: 2 - legend: - - "" - - "2n-skx xxv710, 2n-icx xxv710 - testbeds and NICs tested." - - "Diff - difference between 2n-skx xxv710 and 2n-icx xxv710 testbeds." - -# DPDK Comparison Across Testbeds 3n-skx to 3n-icx ndr -- type: "table" - title: "DPDK Comparison Across Testbeds 3n-skx to 3n-icx ndr" - algorithm: "table_comparison" - output-file: "{DIR[STATIC,DPDK]}/performance-compare-testbeds-3n-skx-3n-icx-ndr" - include-tests: "NDR" # "PDR" | "NDR" | "MRR" - filter: "'NIC_Intel-XXV710'" - columns: - - title: "3n-skx xxv710" - data-set: "dpdk-3n-skx-curr-iter" - - title: "3n-icx xxv710" - data-set: "dpdk-3n-icx-curr-iter" - comparisons: - - title: "Diff" - reference: 1 - compare: 2 - legend: - - "" - - "3n-skx xxv710, 3n-icx xxv710 - testbeds and NICs tested." - - "Diff - difference between 3n-skx xxv710 and 3n-icx xxv710 testbeds." - -# DPDK Comparison Across Testbeds 3n-skx to 3n-icx pdr -- type: "table" - title: "DPDK Comparison Across Testbeds 3n-skx to 3n-icx pdr" - algorithm: "table_comparison" - output-file: "{DIR[STATIC,DPDK]}/performance-compare-testbeds-3n-skx-3n-icx-pdr" - include-tests: "PDR" # "PDR" | "NDR" | "MRR" - filter: "'NIC_Intel-XXV710'" - columns: - - title: "3n-skx xxv710" - data-set: "dpdk-3n-skx-curr-iter" - - title: "3n-icx xxv710" - data-set: "dpdk-3n-icx-curr-iter" - comparisons: - - title: "Diff" - reference: 1 - compare: 2 - legend: - - "" - - "3n-skx xxv710, 3n-icx xxv710 - testbeds and NICs tested." - - "Diff - difference between 3n-skx xxv710 and 3n-icx xxv710 testbeds." + - '' + - 'Test Case: Test cases executed for: NDR throughput on 2n-tx2.' + - '21.08, 21.11, 22.03: [Mpps +- StDev] results for DPDK tested in CSIT.' + - '22.03 vs 21.11: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' # DPDK Comparison Across Topologies 3n-skx to 2n-skx ndr - type: "table" @@ -8134,18 +7647,19 @@ include-tests: "NDR" # "PDR" | "NDR" | "MRR" filter: "'NIC_Intel-XXV710'" columns: - - title: "3n-skx" + - title: "3n-skx xxv710" data-set: "dpdk-3n-skx-curr-iter" - - title: "2n-skx" + - title: "2n-skx xxv710" data-set: "dpdk-2n-skx-curr-iter" comparisons: - - title: "Diff" + - title: "2n-skx vs 3n-skx" reference: 1 compare: 2 legend: - - "" - - "3n-skx, 2n-skx - topologies tested." - - "Diff - difference between 3n-skx and 2n-skx topologies." + - '' + - 'Test Case: Test cases executed for: NDR throughput on 3n-skx xxv710 and 2n-skx xxv710.' + - '3n-skx xxv710, 2n-skx xxv710: [Mpps +- StDev] results for DPDK tested in CSIT' + - '2n-skx vs 3n-skx: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' # DPDK Comparison Across Topologies 3n-skx to 2n-skx pdr - type: "table" @@ -8155,18 +7669,19 @@ include-tests: "PDR" # "PDR" | "NDR" | "MRR" filter: "'NIC_Intel-XXV710'" columns: - - title: "3n-skx" + - title: "3n-skx xxv710" data-set: "dpdk-3n-skx-curr-iter" - - title: "2n-skx" + - title: "2n-skx xxv710" data-set: "dpdk-2n-skx-curr-iter" comparisons: - - title: "Diff" + - title: "2n-skx vs 3n-skx" reference: 1 compare: 2 legend: - - "" - - "3n-skx, 2n-skx - topologies tested." - - "Diff - difference between 3n-skx and 2n-skx topologies." + - '' + - 'Test Case: Test cases executed for: PDR throughput on 3n-skx xxv710 and 2n-skx xxv710.' + - '3n-skx xxv710, 2n-skx xxv710: [Mpps +- StDev] results for DPDK tested in CSIT' + - '2n-skx vs 3n-skx: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.' # Detailed Test Results - DPDK Performance Results 3n-skx - type: "table" |