From c2d12bb8aefc1b5dc856d2278d7ea81321f74c8f Mon Sep 17 00:00:00 2001 From: Tibor Frank Date: Fri, 9 Sep 2022 13:01:50 +0200 Subject: Report: Remove skx testbeds Change-Id: I638b899ad3a227c7702f6d8229c49ca0835da66b Signed-off-by: Tibor Frank --- .../comparisons/2n-icx_vs_2n-skx_testbeds.rst | 55 ------- .../comparisons/2n-skx_vs_2n-clx_testbeds.rst | 54 ------- .../comparisons/3n-skx_vs_2n-skx_testbeds.rst | 58 ------- .../comparisons/3n-skx_vs_3n-icx_testbeds.rst | 58 ------- .../comparisons/current_vs_previous_release.rst | 119 +-------------- .../vpp_performance_tests/comparisons/index.rst | 4 - .../comparisons/nic_comparison.rst | 170 ++++++++++----------- .../comparisons/soak_vs_ndr.rst | 7 - 8 files changed, 86 insertions(+), 439 deletions(-) delete mode 100644 docs/report/vpp_performance_tests/comparisons/2n-icx_vs_2n-skx_testbeds.rst delete mode 100644 docs/report/vpp_performance_tests/comparisons/2n-skx_vs_2n-clx_testbeds.rst delete mode 100644 docs/report/vpp_performance_tests/comparisons/3n-skx_vs_2n-skx_testbeds.rst delete mode 100644 docs/report/vpp_performance_tests/comparisons/3n-skx_vs_3n-icx_testbeds.rst (limited to 'docs/report/vpp_performance_tests/comparisons') diff --git a/docs/report/vpp_performance_tests/comparisons/2n-icx_vs_2n-skx_testbeds.rst b/docs/report/vpp_performance_tests/comparisons/2n-icx_vs_2n-skx_testbeds.rst deleted file mode 100644 index d1cc872954..0000000000 --- a/docs/report/vpp_performance_tests/comparisons/2n-icx_vs_2n-skx_testbeds.rst +++ /dev/null @@ -1,55 +0,0 @@ -2n-Icx vs 2n-Skx Testbeds -------------------------- - -Relative comparison of |vpp-release| packet throughput (NDR, PDR and -MRR) is calculated for the same tests executed on 2-Node Cascadelake (2n- -skx) and 2-Node Icelake (2n-icx) physical testbed types, in 1-core, -2-core and 4-core configurations. - -.. note:: - - Test results are stored in - `build logs from FD.io vpp performance job 2n-icx`_ and - `build logs from FD.io vpp performance job 2n-skx`_ - with RF result - files csit-vpp-perf-|srelease|-\*.zip - `archived here <../../_static/archive/>`_. - -NDR Comparison -~~~~~~~~~~~~~~ - -Comparison tables in HTML, ASCII and CSV formats: - - - `HTML 1c NDR comparison `_ - - `HTML 2c NDR comparison `_ - - `ASCII 1c NDR comparison <../../_static/vpp/performance-compare-testbeds-2n-skx-2n-icx-1c-ndr.txt>`_ - - `ASCII 2c NDR comparison <../../_static/vpp/performance-compare-testbeds-2n-skx-2n-icx-2c-ndr.txt>`_ - - `CSV 1c NDR comparison <../../_static/vpp/performance-compare-testbeds-2n-skx-2n-icx-1c-ndr-csv.csv>`_ - - `CSV 2c NDR comparison <../../_static/vpp/performance-compare-testbeds-2n-skx-2n-icx-2c-ndr-csv.csv>`_ - -PDR Comparison -~~~~~~~~~~~~~~ - -Comparison tables in HTML, ASCII and CSV formats: - - - `HTML 1c PDR comparison `_ - - `HTML 2c PDR comparison `_ - - `ASCII 1c PDR comparison <../../_static/vpp/performance-compare-testbeds-2n-skx-2n-icx-1c-pdr.txt>`_ - - `ASCII 2c PDR comparison <../../_static/vpp/performance-compare-testbeds-2n-skx-2n-icx-2c-pdr.txt>`_ - - `CSV 1c PDR comparison <../../_static/vpp/performance-compare-testbeds-2n-skx-2n-icx-1c-pdr-csv.csv>`_ - - `CSV 2c PDR comparison <../../_static/vpp/performance-compare-testbeds-2n-skx-2n-icx-2c-pdr-csv.csv>`_ - -MRR Comparison -~~~~~~~~~~~~~~ - -Comparison tables in HTML, ASCII and CSV formats: - - - `HTML 1c MRR comparison `_ - - `HTML 2c MRR comparison `_ - - `HTML 4c MRR comparison `_ - - `ASCII 1c MRR comparison <../../_static/vpp/performance-compare-testbeds-2n-skx-2n-icx-1c-mrr.txt>`_ - - `ASCII 2c MRR comparison <../../_static/vpp/performance-compare-testbeds-2n-skx-2n-icx-2c-mrr.txt>`_ - - `ASCII 4c MRR comparison <../../_static/vpp/performance-compare-testbeds-2n-skx-2n-icx-4c-mrr.txt>`_ - - `CSV 1c MRR comparison <../../_static/vpp/performance-compare-testbeds-2n-skx-2n-icx-1c-mrr-csv.csv>`_ - - `CSV 2c MRR comparison <../../_static/vpp/performance-compare-testbeds-2n-skx-2n-icx-2c-mrr-csv.csv>`_ - - `CSV 4c MRR comparison <../../_static/vpp/performance-compare-testbeds-2n-skx-2n-icx-4c-mrr-csv.csv>`_ diff --git a/docs/report/vpp_performance_tests/comparisons/2n-skx_vs_2n-clx_testbeds.rst b/docs/report/vpp_performance_tests/comparisons/2n-skx_vs_2n-clx_testbeds.rst deleted file mode 100644 index 89145ff823..0000000000 --- a/docs/report/vpp_performance_tests/comparisons/2n-skx_vs_2n-clx_testbeds.rst +++ /dev/null @@ -1,54 +0,0 @@ -2n-Clx vs 2n-Skx Testbeds -------------------------- - -Relative comparison of |vpp-release| packet throughput (NDR, PDR and -MRR) is calculated for the same tests executed on 2-Node Skylake (2n- -skx) and 2-Node Cascade Lake (2n-clx) physical testbed types, in 1-core, -2-core and 4-core configurations. - -.. note:: - - Test results are stored in - `build logs from FD.io vpp performance job 2n-skx`_ and - `build logs from FD.io vpp performance job 2n-clx`_ - with RF result files csit-vpp-perf-|srelease|-\*.zip - `archived here <../../_static/archive/>`_. - -NDR Comparison -~~~~~~~~~~~~~~ - -Comparison tables in HTML, ASCII and CSV formats: - - - `HTML 1c NDR comparison `_ - - `HTML 2c NDR comparison `_ - - `ASCII 1c NDR comparison <../../_static/vpp/performance-compare-testbeds-2n-skx-2n-clx-2t1c-ndr.txt>`_ - - `ASCII 2c NDR comparison <../../_static/vpp/performance-compare-testbeds-2n-skx-2n-clx-4t2c-ndr.txt>`_ - - `CSV 1c NDR comparison <../../_static/vpp/performance-compare-testbeds-2n-skx-2n-clx-2t1c-ndr-csv.csv>`_ - - `CSV 2c NDR comparison <../../_static/vpp/performance-compare-testbeds-2n-skx-2n-clx-4t2c-ndr-csv.csv>`_ - -PDR Comparison -~~~~~~~~~~~~~~ - -Comparison tables in HTML, ASCII and CSV formats: - - - `HTML 1c PDR comparison `_ - - `HTML 2c PDR comparison `_ - - `ASCII 1c PDR comparison <../../_static/vpp/performance-compare-testbeds-2n-skx-2n-clx-2t1c-pdr.txt>`_ - - `ASCII 2c PDR comparison <../../_static/vpp/performance-compare-testbeds-2n-skx-2n-clx-4t2c-pdr.txt>`_ - - `CSV 1c PDR comparison <../../_static/vpp/performance-compare-testbeds-2n-skx-2n-clx-2t1c-pdr-csv.csv>`_ - - `CSV 2c PDR comparison <../../_static/vpp/performance-compare-testbeds-2n-skx-2n-clx-4t2c-pdr-csv.csv>`_ - -MRR Comparison -~~~~~~~~~~~~~~ - -Comparison tables in HTML, ASCII and CSV formats: - - - `HTML 1c MRR comparison `_ - - `HTML 2c MRR comparison `_ - - `HTML 4c MRR comparison `_ - - `ASCII 1c MRR comparison <../../_static/vpp/performance-compare-testbeds-2n-skx-2n-clx-2t1c-mrr.txt>`_ - - `ASCII 2c MRR comparison <../../_static/vpp/performance-compare-testbeds-2n-skx-2n-clx-4t2c-mrr.txt>`_ - - `ASCII 4c MRR comparison <../../_static/vpp/performance-compare-testbeds-2n-skx-2n-clx-8t4c-mrr.txt>`_ - - `CSV 1c MRR comparison <../../_static/vpp/performance-compare-testbeds-2n-skx-2n-clx-2t1c-mrr-csv.csv>`_ - - `CSV 2c MRR comparison <../../_static/vpp/performance-compare-testbeds-2n-skx-2n-clx-4t2c-mrr-csv.csv>`_ - - `CSV 4c MRR comparison <../../_static/vpp/performance-compare-testbeds-2n-skx-2n-clx-8t4c-mrr-csv.csv>`_ diff --git a/docs/report/vpp_performance_tests/comparisons/3n-skx_vs_2n-skx_testbeds.rst b/docs/report/vpp_performance_tests/comparisons/3n-skx_vs_2n-skx_testbeds.rst deleted file mode 100644 index f929d1bfaf..0000000000 --- a/docs/report/vpp_performance_tests/comparisons/3n-skx_vs_2n-skx_testbeds.rst +++ /dev/null @@ -1,58 +0,0 @@ - -.. _vpp_compare_topologies_3n-Skx_vs_2n-Skx: - -3n-Skx vs 2n-Skx Testbeds -------------------------- - -Relative comparison of |vpp-release| packet throughput (NDR, PDR and -MRR) is calculated for the same tests executed on 3-Node Skylake (3n- -skx) and 2-Node Skylake (2n-skx) physical testbed types, in 1-core, -2-core and 4-core configurations. - -.. note:: - - Test results are stored in - `build logs from FD.io vpp performance job 3n-skx`_ and - `build logs from FD.io vpp performance job 2n-skx`_ - with RF result - files csit-vpp-perf-|srelease|-\*.zip - `archived here <../../_static/archive/>`_. - -NDR Comparison -~~~~~~~~~~~~~~ - -Comparison tables in HTML, ASCII and CSV formats: - - - `HTML 1c NDR comparison `_ - - `HTML 2c NDR comparison `_ - - `ASCII 1c NDR comparison <../../_static/vpp/performance-compare-topologies-3n-skx-2n-skx-1c-ndr.txt>`_ - - `ASCII 2c NDR comparison <../../_static/vpp/performance-compare-topologies-3n-skx-2n-skx-2c-ndr.txt>`_ - - `CSV 1c NDR comparison <../../_static/vpp/performance-compare-topologies-3n-skx-2n-skx-1c-ndr-csv.csv>`_ - - `CSV 2c NDR comparison <../../_static/vpp/performance-compare-topologies-3n-skx-2n-skx-2c-ndr-csv.csv>`_ - -PDR Comparison -~~~~~~~~~~~~~~ - -Comparison tables in HTML, ASCII and CSV formats: - - - `HTML 1c PDR comparison `_ - - `HTML 2c PDR comparison `_ - - `ASCII 1c PDR comparison <../../_static/vpp/performance-compare-topologies-3n-skx-2n-skx-1c-pdr.txt>`_ - - `ASCII 2c PDR comparison <../../_static/vpp/performance-compare-topologies-3n-skx-2n-skx-2c-pdr.txt>`_ - - `CSV 1c PDR comparison <../../_static/vpp/performance-compare-topologies-3n-skx-2n-skx-1c-pdr-csv.csv>`_ - - `CSV 2c PDR comparison <../../_static/vpp/performance-compare-topologies-3n-skx-2n-skx-2c-pdr-csv.csv>`_ - -MRR Comparison -~~~~~~~~~~~~~~ - -Comparison tables in HTML, ASCII and CSV formats: - - - `HTML 1c MRR comparison `_ - - `HTML 2c MRR comparison `_ - - `HTML 4c MRR comparison `_ - - `ASCII 1c MRR comparison <../../_static/vpp/performance-compare-topologies-3n-skx-2n-skx-1c-mrr.txt>`_ - - `ASCII 2c MRR comparison <../../_static/vpp/performance-compare-topologies-3n-skx-2n-skx-2c-mrr.txt>`_ - - `ASCII 4c MRR comparison <../../_static/vpp/performance-compare-topologies-3n-skx-2n-skx-4c-mrr.txt>`_ - - `CSV 1c MRR comparison <../../_static/vpp/performance-compare-topologies-3n-skx-2n-skx-1c-mrr-csv.csv>`_ - - `CSV 2c MRR comparison <../../_static/vpp/performance-compare-topologies-3n-skx-2n-skx-2c-mrr-csv.csv>`_ - - `CSV 4c MRR comparison <../../_static/vpp/performance-compare-topologies-3n-skx-2n-skx-4c-mrr-csv.csv>`_ diff --git a/docs/report/vpp_performance_tests/comparisons/3n-skx_vs_3n-icx_testbeds.rst b/docs/report/vpp_performance_tests/comparisons/3n-skx_vs_3n-icx_testbeds.rst deleted file mode 100644 index 593924ea19..0000000000 --- a/docs/report/vpp_performance_tests/comparisons/3n-skx_vs_3n-icx_testbeds.rst +++ /dev/null @@ -1,58 +0,0 @@ - -.. _vpp_compare_topologies_3n-skx_vs_3n-icx: - -3n-Icx vs 3n-Skx Testbeds -------------------------- - -Relative comparison of |vpp-release| packet throughput (NDR, PDR and -MRR) is calculated for the same tests executed on 3-Node Skylake (3n- -skx) and 3-Node Icelake (3n-icx) physical testbed types, in 1-core, -2-core and 4-core configurations. - -.. note:: - - Test results are stored in - `build logs from FD.io vpp performance job 3n-skx`_ and - `build logs from FD.io vpp performance job 3n-icx`_ - with RF result - files csit-vpp-perf-|srelease|-\*.zip - `archived here <../../_static/archive/>`_. - -NDR Comparison -~~~~~~~~~~~~~~ - -Comparison tables in HTML, ASCII and CSV formats: - - - `HTML 1c NDR comparison `_ - - `HTML 2c NDR comparison `_ - - `ASCII 1c NDR comparison <../../_static/vpp/performance-compare-testbeds-3n-skx-3n-icx-1c-ndr.txt>`_ - - `ASCII 2c NDR comparison <../../_static/vpp/performance-compare-testbeds-3n-skx-3n-icx-2c-ndr.txt>`_ - - `CSV 1c NDR comparison <../../_static/vpp/performance-compare-testbeds-3n-skx-3n-icx-1c-ndr-csv.csv>`_ - - `CSV 2c NDR comparison <../../_static/vpp/performance-compare-testbeds-3n-skx-3n-icx-2c-ndr-csv.csv>`_ - -PDR Comparison -~~~~~~~~~~~~~~ - -Comparison tables in HTML, ASCII and CSV formats: - - - `HTML 1c PDR comparison `_ - - `HTML 2c PDR comparison `_ - - `ASCII 1c PDR comparison <../../_static/vpp/performance-compare-testbeds-3n-skx-3n-icx-1c-pdr.txt>`_ - - `ASCII 2c PDR comparison <../../_static/vpp/performance-compare-testbeds-3n-skx-3n-icx-2c-pdr.txt>`_ - - `CSV 1c PDR comparison <../../_static/vpp/performance-compare-testbeds-3n-skx-3n-icx-1c-pdr-csv.csv>`_ - - `CSV 2c PDR comparison <../../_static/vpp/performance-compare-testbeds-3n-skx-3n-icx-2c-pdr-csv.csv>`_ - -MRR Comparison -~~~~~~~~~~~~~~ - -Comparison tables in HTML, ASCII and CSV formats: - - - `HTML 1c MRR comparison `_ - - `HTML 2c MRR comparison `_ - - `HTML 4c MRR comparison `_ - - `ASCII 1c MRR comparison <../../_static/vpp/performance-compare-testbeds-3n-skx-3n-icx-1c-mrr.txt>`_ - - `ASCII 2c MRR comparison <../../_static/vpp/performance-compare-testbeds-3n-skx-3n-icx-2c-mrr.txt>`_ - - `ASCII 4c MRR comparison <../../_static/vpp/performance-compare-testbeds-3n-skx-3n-icx-4c-mrr.txt>`_ - - `CSV 1c MRR comparison <../../_static/vpp/performance-compare-testbeds-3n-skx-3n-icx-1c-mrr-csv.csv>`_ - - `CSV 2c MRR comparison <../../_static/vpp/performance-compare-testbeds-3n-skx-3n-icx-2c-mrr-csv.csv>`_ - - `CSV 4c MRR comparison <../../_static/vpp/performance-compare-testbeds-3n-skx-3n-icx-4c-mrr-csv.csv>`_ diff --git a/docs/report/vpp_performance_tests/comparisons/current_vs_previous_release.rst b/docs/report/vpp_performance_tests/comparisons/current_vs_previous_release.rst index 9418bd1988..e73d2b050e 100644 --- a/docs/report/vpp_performance_tests/comparisons/current_vs_previous_release.rst +++ b/docs/report/vpp_performance_tests/comparisons/current_vs_previous_release.rst @@ -7,8 +7,7 @@ Current vs Previous Release Relative comparison of VPP packet throughput (NDR, PDR and MRR) between |vpp-release| and |vpp-release-1| (measured for |csit-release| and |csit-release-1| respectively) is calculated from results of tests -running on 2-node Intel Xeon Skylake (2n-skx), 3-node Intel Xeon Skylake -(3n-skx), 2-node Intel Atom Denverton +running on 2-node Intel Atom Denverton (2n-dnv), 3-node Intel Atom Denverton (3n-dnv), 3-node Arm TaiShan (3n-tsh) testbeds, in 1-core, 2-core and 4-core (MRR only) configurations. @@ -27,8 +26,6 @@ results repeatability vary between the test cases. - `build logs from FD.io vpp performance job 2n-icx`_, - `build logs from FD.io vpp performance job 3n-icx`_, - - `build logs from FD.io vpp performance job 2n-skx`_, - - `build logs from FD.io vpp performance job 3n-skx`_, - `build logs from FD.io vpp performance job 2n-clx`_, - `build logs from FD.io vpp performance job 2n-zn2`_, - `build logs from FD.io vpp performance job 2n-dnv`_, @@ -154,120 +151,6 @@ Comparison tables in HTML, ASCII and CSV formats: - `CSV 2t1c PDR90, direction1, average value comparison <../../_static/vpp/latency-changes-3n-icx-xxv710-2t1c-pdr90-d1-avg-csv.csv>`_ - `CSV 2t1c PDR90, direction1, max value comparison <../../_static/vpp/latency-changes-3n-icx-xxv710-2t1c-pdr90-d1-max-csv.csv>`_ -2n-skx-xxv710 -~~~~~~~~~~~~~ - -NDR Comparison -`````````````` - -Comparison tables in HTML, ASCII and CSV formats: - - - `HTML 2t1c NDR comparison `_ - - `HTML 4t2c NDR comparison `_ - - `ASCII 2t1c NDR comparison <../../_static/vpp/performance-changes-2n-skx-2t1c-ndr.txt>`_ - - `ASCII 4t2c NDR comparison <../../_static/vpp/performance-changes-2n-skx-4t2c-ndr.txt>`_ - - `CSV 2t1c NDR comparison <../../_static/vpp/performance-changes-2n-skx-2t1c-ndr-csv.csv>`_ - - `CSV 4t2c NDR comparison <../../_static/vpp/performance-changes-2n-skx-4t2c-ndr-csv.csv>`_ - -PDR Comparison -`````````````` - -Comparison tables in HTML, ASCII and CSV formats: - - - `HTML 2t1c PDR comparison `_ - - `HTML 4t2c PDR comparison `_ - - `ASCII 2t1c PDR comparison <../../_static/vpp/performance-changes-2n-skx-2t1c-pdr.txt>`_ - - `ASCII 4t2c PDR comparison <../../_static/vpp/performance-changes-2n-skx-4t2c-pdr.txt>`_ - - `CSV 2t1c PDR comparison <../../_static/vpp/performance-changes-2n-skx-2t1c-pdr-csv.csv>`_ - - `CSV 4t2c PDR comparison <../../_static/vpp/performance-changes-2n-skx-4t2c-pdr-csv.csv>`_ - -MRR Comparison -`````````````` - -Comparison tables in HTML, ASCII and CSV formats: - - - `HTML 2t1c MRR comparison `_ - - `HTML 4t2c MRR comparison `_ - - `HTML 8t4c MRR comparison `_ - - `ASCII 2t1c MRR comparison <../../_static/vpp/performance-changes-2n-skx-2t1c-mrr.txt>`_ - - `ASCII 4t2c MRR comparison <../../_static/vpp/performance-changes-2n-skx-4t2c-mrr.txt>`_ - - `ASCII 8t4c MRR comparison <../../_static/vpp/performance-changes-2n-skx-8t4c-mrr.txt>`_ - - `CSV 2t1c MRR comparison <../../_static/vpp/performance-changes-2n-skx-2t1c-mrr-csv.csv>`_ - - `CSV 4t2c MRR comparison <../../_static/vpp/performance-changes-2n-skx-4t2c-mrr-csv.csv>`_ - - `CSV 8t4c MRR comparison <../../_static/vpp/performance-changes-2n-skx-8t4c-mrr-csv.csv>`_ - -Latency Comparison -`````````````````` - -Comparison tables in HTML, ASCII and CSV formats: - - - `HTML 2t1c PDR50, direction1, average value comparison `_ - - `HTML 2t1c PDR90, direction1, average value comparison `_ - - `HTML 2t1c PDR90, direction1, max value comparison `_ - - `ASCII 2t1c PDR50, direction1, average value comparison <../../_static/vpp/latency-changes-2n-skx-xxv710-2t1c-pdr50-d1-avg.txt>`_ - - `ASCII 2t1c PDR90, direction1, average value comparison <../../_static/vpp/latency-changes-2n-skx-xxv710-2t1c-pdr90-d1-avg.txt>`_ - - `ASCII 2t1c PDR90, direction1, max value comparison <../../_static/vpp/latency-changes-2n-skx-xxv710-2t1c-pdr90-d1-max.txt>`_ - - `CSV 2t1c PDR50, direction1, average value comparison <../../_static/vpp/latency-changes-2n-skx-xxv710-2t1c-pdr50-d1-avg-csv.csv>`_ - - `CSV 2t1c PDR90, direction1, average value comparison <../../_static/vpp/latency-changes-2n-skx-xxv710-2t1c-pdr90-d1-avg-csv.csv>`_ - - `CSV 2t1c PDR90, direction1, max value comparison <../../_static/vpp/latency-changes-2n-skx-xxv710-2t1c-pdr90-d1-max-csv.csv>`_ - -3n-skx-xxv710 -~~~~~~~~~~~~~ - -NDR Comparison -`````````````` - -Comparison tables in HTML, ASCII and CSV formats: - - - `HTML 2t1c NDR comparison `_ - - `HTML 4t2c NDR comparison `_ - - `ASCII 2t1c NDR comparison <../../_static/vpp/performance-changes-3n-skx-2t1c-ndr.txt>`_ - - `ASCII 4t2c NDR comparison <../../_static/vpp/performance-changes-3n-skx-4t2c-ndr.txt>`_ - - `CSV 2t1c NDR comparison <../../_static/vpp/performance-changes-3n-skx-2t1c-ndr-csv.csv>`_ - - `CSV 4t2c NDR comparison <../../_static/vpp/performance-changes-3n-skx-4t2c-ndr-csv.csv>`_ - -PDR Comparison -`````````````` - -Comparison tables in HTML, ASCII and CSV formats: - - - `HTML 2t1c PDR comparison `_ - - `HTML 4t2c PDR comparison `_ - - `ASCII 2t1c PDR comparison <../../_static/vpp/performance-changes-3n-skx-2t1c-pdr.txt>`_ - - `ASCII 4t2c PDR comparison <../../_static/vpp/performance-changes-3n-skx-4t2c-pdr.txt>`_ - - `CSV 2t1c PDR comparison <../../_static/vpp/performance-changes-3n-skx-2t1c-pdr-csv.csv>`_ - - `CSV 4t2c PDR comparison <../../_static/vpp/performance-changes-3n-skx-4t2c-pdr-csv.csv>`_ - -MRR Comparison -`````````````` - -Comparison tables in HTML, ASCII and CSV formats: - - - `HTML 2t1c MRR comparison `_ - - `HTML 4t2c MRR comparison `_ - - `HTML 8t4c MRR comparison `_ - - `ASCII 2t1c MRR comparison <../../_static/vpp/performance-changes-3n-skx-2t1c-mrr.txt>`_ - - `ASCII 4t2c MRR comparison <../../_static/vpp/performance-changes-3n-skx-4t2c-mrr.txt>`_ - - `ASCII 8t4c MRR comparison <../../_static/vpp/performance-changes-3n-skx-8t4c-mrr.txt>`_ - - `CSV 2t1c MRR comparison <../../_static/vpp/performance-changes-3n-skx-2t1c-mrr-csv.csv>`_ - - `CSV 4t2c MRR comparison <../../_static/vpp/performance-changes-3n-skx-4t2c-mrr-csv.csv>`_ - - `CSV 8t4c MRR comparison <../../_static/vpp/performance-changes-3n-skx-8t4c-mrr-csv.csv>`_ - -Latency Comparison -`````````````````` - -Comparison tables in HTML, ASCII and CSV formats: - - - `HTML 2t1c PDR50, direction1, average value comparison `_ - - `HTML 2t1c PDR90, direction1, average value comparison `_ - - `HTML 2t1c PDR90, direction1, max value comparison `_ - - `ASCII 2t1c PDR50, direction1, average value comparison <../../_static/vpp/latency-changes-3n-skx-xxv710-2t1c-pdr50-d1-avg.txt>`_ - - `ASCII 2t1c PDR90, direction1, average value comparison <../../_static/vpp/latency-changes-3n-skx-xxv710-2t1c-pdr90-d1-avg.txt>`_ - - `ASCII 2t1c PDR90, direction1, max value comparison <../../_static/vpp/latency-changes-3n-skx-xxv710-2t1c-pdr90-d1-max.txt>`_ - - `CSV 2t1c PDR50, direction1, average value comparison <../../_static/vpp/latency-changes-3n-skx-xxv710-2t1c-pdr50-d1-avg-csv.csv>`_ - - `CSV 2t1c PDR90, direction1, average value comparison <../../_static/vpp/latency-changes-3n-skx-xxv710-2t1c-pdr90-d1-avg-csv.csv>`_ - - `CSV 2t1c PDR90, direction1, max value comparison <../../_static/vpp/latency-changes-3n-skx-xxv710-2t1c-pdr90-d1-max-csv.csv>`_ - Hoststack ````````` diff --git a/docs/report/vpp_performance_tests/comparisons/index.rst b/docs/report/vpp_performance_tests/comparisons/index.rst index 3b84884e40..9569e27ed1 100644 --- a/docs/report/vpp_performance_tests/comparisons/index.rst +++ b/docs/report/vpp_performance_tests/comparisons/index.rst @@ -12,9 +12,5 @@ Comparisons current_vs_previous_release 2n-clx_vs_2n-icx_testbeds - 2n-icx_vs_2n-skx_testbeds - 2n-skx_vs_2n-clx_testbeds - 3n-skx_vs_3n-icx_testbeds - 3n-skx_vs_2n-skx_testbeds nic_comparison soak_vs_ndr diff --git a/docs/report/vpp_performance_tests/comparisons/nic_comparison.rst b/docs/report/vpp_performance_tests/comparisons/nic_comparison.rst index 5334753b97..9186ec556a 100644 --- a/docs/report/vpp_performance_tests/comparisons/nic_comparison.rst +++ b/docs/report/vpp_performance_tests/comparisons/nic_comparison.rst @@ -21,92 +21,92 @@ results repeatability vary between the test cases. Test results are stored in - - `build logs from FD.io vpp performance job 3n-skx`_, - - `build logs from FD.io vpp performance job 2n-skx`_ + - with RF result files csit-vpp-perf-|srelease|-\*.zip `archived here <../../_static/archive/>`_. -3n-skx -~~~~~~ - -NDR Comparison -`````````````` - -Comparison tables in HTML, ASCII and CSV formats: - - - `HTML 2t1c NDR Intel-x710 and Intel-xxv710 comparison `_ - - `HTML 4t2c NDR Intel-x710 and Intel-xxv710 comparison `_ - - `ASCII 2t1c NDR Intel-x710 and Intel-xxv710 comparison <../../_static/vpp/performance-changes-3n-skx-2t1c-nics-ndr.txt>`_ - - `ASCII 4t2c NDR Intel-x710 and Intel-xxv710 comparison <../../_static/vpp/performance-changes-3n-skx-4t2c-nics-ndr.txt>`_ - - `CSV 2t1c NDR Intel-x710 and Intel-xxv710 comparison <../../_static/vpp/performance-changes-3n-skx-2t1c-nics-ndr-csv.csv>`_ - - `CSV 4t2c NDR Intel-x710 and Intel-xxv710 comparison <../../_static/vpp/performance-changes-3n-skx-4t2c-nics-ndr-csv.csv>`_ - -PDR Comparison -`````````````` - -Comparison tables in HTML, ASCII and CSV formats: - - - `HTML 2t1c PDR Intel-x710 and Intel-xxv710 comparison `_ - - `HTML 4t2c PDR Intel-x710 and Intel-xxv710 comparison `_ - - `ASCII 2t1c PDR Intel-x710 and Intel-xxv710 comparison <../../_static/vpp/performance-changes-3n-skx-2t1c-nics-pdr.txt>`_ - - `ASCII 4t2c PDR Intel-x710 and Intel-xxv710 comparison <../../_static/vpp/performance-changes-3n-skx-4t2c-nics-pdr.txt>`_ - - `CSV 2t1c PDR Intel-x710 and Intel-xxv710 comparison <../../_static/vpp/performance-changes-3n-skx-2t1c-nics-pdr-csv.csv>`_ - - `CSV 4t2c PDR Intel-x710 and Intel-xxv710 comparison <../../_static/vpp/performance-changes-3n-skx-4t2c-nics-pdr-csv.csv>`_ - -MRR Comparison -`````````````` - -Comparison tables in HTML, ASCII and CSV formats: - - - `HTML 2t1c MRR Intel-x710 and Intel-xxv710 comparison `_ - - `HTML 4t2c MRR Intel-x710 and Intel-xxv710 comparison `_ - - `HTML 8t4c MRR Intel-x710 and Intel-xxv710 comparison `_ - - `ASCII 2t1c MRR Intel-x710 and Intel-xxv710 comparison <../../_static/vpp/performance-changes-3n-skx-2t1c-nics-mrr.txt>`_ - - `ASCII 4t2c MRR Intel-x710 and Intel-xxv710 comparison <../../_static/vpp/performance-changes-3n-skx-4t2c-nics-mrr.txt>`_ - - `ASCII 8t4c MRR Intel-x710 and Intel-xxv710 comparison <../../_static/vpp/performance-changes-3n-skx-8t4c-nics-mrr.txt>`_ - - `CSV 2t1c MRR Intel-x710 and Intel-xxv710 comparison <../../_static/vpp/performance-changes-3n-skx-2t1c-nics-mrr-csv.csv>`_ - - `CSV 4t2c MRR Intel-x710 and Intel-xxv710 comparison <../../_static/vpp/performance-changes-3n-skx-4t2c-nics-mrr-csv.csv>`_ - - `CSV 8t4c MRR Intel-x710 and Intel-xxv710 comparison <../../_static/vpp/performance-changes-3n-skx-8t4c-nics-mrr-csv.csv>`_ - -2n-skx -~~~~~~ - -NDR Comparison -`````````````` - -Comparison tables in HTML, ASCII and CSV formats: - - - `HTML 2t1c NDR Intel-x710 and Intel-xxv710 comparison `_ - - `HTML 4t2c NDR Intel-x710 and Intel-xxv710 comparison `_ - - `ASCII 2t1c NDR Intel-x710 and Intel-xxv710 comparison <../../_static/vpp/performance-changes-2n-skx-2t1c-nics-ndr.txt>`_ - - `ASCII 4t2c NDR Intel-x710 and Intel-xxv710 comparison <../../_static/vpp/performance-changes-2n-skx-4t2c-nics-ndr.txt>`_ - - `CSV 2t1c NDR Intel-x710 and Intel-xxv710 comparison <../../_static/vpp/performance-changes-2n-skx-2t1c-nics-ndr-csv.csv>`_ - - `CSV 4t2c NDR Intel-x710 and Intel-xxv710 comparison <../../_static/vpp/performance-changes-2n-skx-4t2c-nics-ndr-csv.csv>`_ - -PDR Comparison -`````````````` - -Comparison tables in HTML, ASCII and CSV formats: - - - `HTML 2t1c PDR Intel-x710 and Intel-xxv710 comparison `_ - - `HTML 4t2c PDR Intel-x710 and Intel-xxv710 comparison `_ - - `ASCII 2t1c PDR Intel-x710 and Intel-xxv710 comparison <../../_static/vpp/performance-changes-2n-skx-2t1c-nics-pdr.txt>`_ - - `ASCII 4t2c PDR Intel-x710 and Intel-xxv710 comparison <../../_static/vpp/performance-changes-2n-skx-4t2c-nics-pdr.txt>`_ - - `CSV 2t1c PDR Intel-x710 and Intel-xxv710 comparison <../../_static/vpp/performance-changes-2n-skx-2t1c-nics-pdr-csv.csv>`_ - - `CSV 4t2c PDR Intel-x710 and Intel-xxv710 comparison <../../_static/vpp/performance-changes-2n-skx-4t2c-nics-pdr-csv.csv>`_ - -MRR Comparison -`````````````` - -Comparison tables in HTML, ASCII and CSV formats: - - - `HTML 2t1c MRR Intel-x710 and Intel-xxv710 comparison `_ - - `HTML 4t2c MRR Intel-x710 and Intel-xxv710 comparison `_ - - `HTML 8t4c MRR Intel-x710 and Intel-xxv710 comparison `_ - - `ASCII 2t1c MRR Intel-x710 and Intel-xxv710 comparison <../../_static/vpp/performance-changes-2n-skx-2t1c-nics-mrr.txt>`_ - - `ASCII 4t2c MRR Intel-x710 and Intel-xxv710 comparison <../../_static/vpp/performance-changes-2n-skx-4t2c-nics-mrr.txt>`_ - - `ASCII 8t4c MRR Intel-x710 and Intel-xxv710 comparison <../../_static/vpp/performance-changes-2n-skx-8t4c-nics-mrr.txt>`_ - - `CSV 2t1c MRR Intel-x710 and Intel-xxv710 comparison <../../_static/vpp/performance-changes-2n-skx-2t1c-nics-mrr-csv.csv>`_ - - `CSV 4t2c MRR Intel-x710 and Intel-xxv710 comparison <../../_static/vpp/performance-changes-2n-skx-4t2c-nics-mrr-csv.csv>`_ - - `CSV 8t4c MRR Intel-x710 and Intel-xxv710 comparison <../../_static/vpp/performance-changes-2n-skx-8t4c-nics-mrr-csv.csv>`_ +.. + 3n-skx + ~~~~~~ + + NDR Comparison + `````````````` + + Comparison tables in HTML, ASCII and CSV formats: + + - `HTML 2t1c NDR Intel-x710 and Intel-xxv710 comparison `_ + - `HTML 4t2c NDR Intel-x710 and Intel-xxv710 comparison `_ + - `ASCII 2t1c NDR Intel-x710 and Intel-xxv710 comparison <../../_static/vpp/performance-changes-3n-skx-2t1c-nics-ndr.txt>`_ + - `ASCII 4t2c NDR Intel-x710 and Intel-xxv710 comparison <../../_static/vpp/performance-changes-3n-skx-4t2c-nics-ndr.txt>`_ + - `CSV 2t1c NDR Intel-x710 and Intel-xxv710 comparison <../../_static/vpp/performance-changes-3n-skx-2t1c-nics-ndr-csv.csv>`_ + - `CSV 4t2c NDR Intel-x710 and Intel-xxv710 comparison <../../_static/vpp/performance-changes-3n-skx-4t2c-nics-ndr-csv.csv>`_ + + PDR Comparison + `````````````` + + Comparison tables in HTML, ASCII and CSV formats: + + - `HTML 2t1c PDR Intel-x710 and Intel-xxv710 comparison `_ + - `HTML 4t2c PDR Intel-x710 and Intel-xxv710 comparison `_ + - `ASCII 2t1c PDR Intel-x710 and Intel-xxv710 comparison <../../_static/vpp/performance-changes-3n-skx-2t1c-nics-pdr.txt>`_ + - `ASCII 4t2c PDR Intel-x710 and Intel-xxv710 comparison <../../_static/vpp/performance-changes-3n-skx-4t2c-nics-pdr.txt>`_ + - `CSV 2t1c PDR Intel-x710 and Intel-xxv710 comparison <../../_static/vpp/performance-changes-3n-skx-2t1c-nics-pdr-csv.csv>`_ + - `CSV 4t2c PDR Intel-x710 and Intel-xxv710 comparison <../../_static/vpp/performance-changes-3n-skx-4t2c-nics-pdr-csv.csv>`_ + + MRR Comparison + `````````````` + + Comparison tables in HTML, ASCII and CSV formats: + + - `HTML 2t1c MRR Intel-x710 and Intel-xxv710 comparison `_ + - `HTML 4t2c MRR Intel-x710 and Intel-xxv710 comparison `_ + - `HTML 8t4c MRR Intel-x710 and Intel-xxv710 comparison `_ + - `ASCII 2t1c MRR Intel-x710 and Intel-xxv710 comparison <../../_static/vpp/performance-changes-3n-skx-2t1c-nics-mrr.txt>`_ + - `ASCII 4t2c MRR Intel-x710 and Intel-xxv710 comparison <../../_static/vpp/performance-changes-3n-skx-4t2c-nics-mrr.txt>`_ + - `ASCII 8t4c MRR Intel-x710 and Intel-xxv710 comparison <../../_static/vpp/performance-changes-3n-skx-8t4c-nics-mrr.txt>`_ + - `CSV 2t1c MRR Intel-x710 and Intel-xxv710 comparison <../../_static/vpp/performance-changes-3n-skx-2t1c-nics-mrr-csv.csv>`_ + - `CSV 4t2c MRR Intel-x710 and Intel-xxv710 comparison <../../_static/vpp/performance-changes-3n-skx-4t2c-nics-mrr-csv.csv>`_ + - `CSV 8t4c MRR Intel-x710 and Intel-xxv710 comparison <../../_static/vpp/performance-changes-3n-skx-8t4c-nics-mrr-csv.csv>`_ + + 2n-skx + ~~~~~~ + + NDR Comparison + `````````````` + + Comparison tables in HTML, ASCII and CSV formats: + + - `HTML 2t1c NDR Intel-x710 and Intel-xxv710 comparison `_ + - `HTML 4t2c NDR Intel-x710 and Intel-xxv710 comparison `_ + - `ASCII 2t1c NDR Intel-x710 and Intel-xxv710 comparison <../../_static/vpp/performance-changes-2n-skx-2t1c-nics-ndr.txt>`_ + - `ASCII 4t2c NDR Intel-x710 and Intel-xxv710 comparison <../../_static/vpp/performance-changes-2n-skx-4t2c-nics-ndr.txt>`_ + - `CSV 2t1c NDR Intel-x710 and Intel-xxv710 comparison <../../_static/vpp/performance-changes-2n-skx-2t1c-nics-ndr-csv.csv>`_ + - `CSV 4t2c NDR Intel-x710 and Intel-xxv710 comparison <../../_static/vpp/performance-changes-2n-skx-4t2c-nics-ndr-csv.csv>`_ + + PDR Comparison + `````````````` + + Comparison tables in HTML, ASCII and CSV formats: + + - `HTML 2t1c PDR Intel-x710 and Intel-xxv710 comparison `_ + - `HTML 4t2c PDR Intel-x710 and Intel-xxv710 comparison `_ + - `ASCII 2t1c PDR Intel-x710 and Intel-xxv710 comparison <../../_static/vpp/performance-changes-2n-skx-2t1c-nics-pdr.txt>`_ + - `ASCII 4t2c PDR Intel-x710 and Intel-xxv710 comparison <../../_static/vpp/performance-changes-2n-skx-4t2c-nics-pdr.txt>`_ + - `CSV 2t1c PDR Intel-x710 and Intel-xxv710 comparison <../../_static/vpp/performance-changes-2n-skx-2t1c-nics-pdr-csv.csv>`_ + - `CSV 4t2c PDR Intel-x710 and Intel-xxv710 comparison <../../_static/vpp/performance-changes-2n-skx-4t2c-nics-pdr-csv.csv>`_ + + MRR Comparison + `````````````` + + Comparison tables in HTML, ASCII and CSV formats: + + - `HTML 2t1c MRR Intel-x710 and Intel-xxv710 comparison `_ + - `HTML 4t2c MRR Intel-x710 and Intel-xxv710 comparison `_ + - `HTML 8t4c MRR Intel-x710 and Intel-xxv710 comparison `_ + - `ASCII 2t1c MRR Intel-x710 and Intel-xxv710 comparison <../../_static/vpp/performance-changes-2n-skx-2t1c-nics-mrr.txt>`_ + - `ASCII 4t2c MRR Intel-x710 and Intel-xxv710 comparison <../../_static/vpp/performance-changes-2n-skx-4t2c-nics-mrr.txt>`_ + - `ASCII 8t4c MRR Intel-x710 and Intel-xxv710 comparison <../../_static/vpp/performance-changes-2n-skx-8t4c-nics-mrr.txt>`_ + - `CSV 2t1c MRR Intel-x710 and Intel-xxv710 comparison <../../_static/vpp/performance-changes-2n-skx-2t1c-nics-mrr-csv.csv>`_ + - `CSV 4t2c MRR Intel-x710 and Intel-xxv710 comparison <../../_static/vpp/performance-changes-2n-skx-4t2c-nics-mrr-csv.csv>`_ + - `CSV 8t4c MRR Intel-x710 and Intel-xxv710 comparison <../../_static/vpp/performance-changes-2n-skx-8t4c-nics-mrr-csv.csv>`_ diff --git a/docs/report/vpp_performance_tests/comparisons/soak_vs_ndr.rst b/docs/report/vpp_performance_tests/comparisons/soak_vs_ndr.rst index 97639c9d0f..de904ffc91 100644 --- a/docs/report/vpp_performance_tests/comparisons/soak_vs_ndr.rst +++ b/docs/report/vpp_performance_tests/comparisons/soak_vs_ndr.rst @@ -11,7 +11,6 @@ in 1-core configurations. Test results are stored in `build logs from FD.io vpp performance job 2n-icx`_, - `build logs from FD.io vpp performance job 2n-skx`_, `build logs from FD.io vpp performance job 2n-clx`_ with RF result files csit-vpp-perf-|srelease|-\*.zip `archived here <../../_static/archive/>`_. @@ -24,12 +23,6 @@ Comparison tables in ASCII and CSV formats: - `ASCII Soak vs NDR comparison <../../_static/vpp/soak-vs-ndr-2n-icx.txt>`_ - `CSV Soak vs NDR comparison <../../_static/vpp/soak-vs-ndr-2n-icx.csv>`_ -2n-skx -~~~~~~ - - - `ASCII Soak vs NDR comparison <../../_static/vpp/soak-vs-ndr-2n-skx.txt>`_ - - `CSV Soak vs NDR comparison <../../_static/vpp/soak-vs-ndr-2n-skx.csv>`_ - 2n-clx ~~~~~~ -- cgit 1.2.3-korg