Report: Comparison tables

- normalization
- table headers
- legend

Change-Id: Ie095a84b7a62481d01fa5ece7c9da7f320d6d5c9
Signed-off-by: Tibor Frank <tifrank@cisco.com>

7 files changed, 0 insertions, 291 deletions

diff --git a/docs/report/vpp_performance_tests/comparisons_norm/2n-clx_vs_2n-icx_testbeds.rst b/docs/report/vpp_performance_tests/comparisons_norm/2n-clx_vs_2n-icx_testbeds.rst
deleted file mode 100644
index 8db3d6632f..0000000000
--- a/docs/report/vpp_performance_tests/comparisons_norm/2n-clx_vs_2n-icx_testbeds.rst
+++ /dev/null
@@ -1,55 +0,0 @@
-2n-Icx vs 2n-Clx Testbeds
--------------------------
-
-Relative normalized comparison of |vpp-release| packet throughput (NDR, PDR and
-MRR) is calculated for the same tests executed on 2-Node Cascadelake (2n-
-clx) and 2-Node Icelake (2n-icx) physical testbed types, in 1-core,
-2-core and 4-core configurations.
-
-.. note::
-
-    Test results are stored in
-    `build logs from FD.io vpp performance job 2n-icx`_ and
-    `build logs from FD.io vpp performance job 2n-clx`_
-    with RF result
-    files csit-vpp-perf-|srelease|-\*.zip
-    `archived here <../../_static/archive/>`_.
-
-NDR Comparison
-~~~~~~~~~~~~~~
-
-Comparison tables in HTML, ASCII and CSV formats:
-
-  - `HTML 1c NDR comparison <norm-compare-testbeds-2n-clx-2n-icx-1c-ndr.html>`_
-  - `HTML 2c NDR comparison <norm-compare-testbeds-2n-clx-2n-icx-2c-ndr.html>`_
-  - `ASCII 1c NDR comparison <../../_static/vpp/norm-compare-testbeds-2n-clx-2n-icx-1c-ndr.txt>`_
-  - `ASCII 2c NDR comparison <../../_static/vpp/norm-compare-testbeds-2n-clx-2n-icx-2c-ndr.txt>`_
-  - `CSV 1c NDR comparison <../../_static/vpp/norm-compare-testbeds-2n-clx-2n-icx-1c-ndr-csv.csv>`_
-  - `CSV 2c NDR comparison <../../_static/vpp/norm-compare-testbeds-2n-clx-2n-icx-2c-ndr-csv.csv>`_
-
-PDR Comparison
-~~~~~~~~~~~~~~
-
-Comparison tables in HTML, ASCII and CSV formats:
-
-  - `HTML 1c PDR comparison <norm-compare-testbeds-2n-clx-2n-icx-1c-pdr.html>`_
-  - `HTML 2c PDR comparison <norm-compare-testbeds-2n-clx-2n-icx-2c-pdr.html>`_
-  - `ASCII 1c PDR comparison <../../_static/vpp/norm-compare-testbeds-2n-clx-2n-icx-1c-pdr.txt>`_
-  - `ASCII 2c PDR comparison <../../_static/vpp/norm-compare-testbeds-2n-clx-2n-icx-2c-pdr.txt>`_
-  - `CSV 1c PDR comparison <../../_static/vpp/norm-compare-testbeds-2n-clx-2n-icx-1c-pdr-csv.csv>`_
-  - `CSV 2c PDR comparison <../../_static/vpp/norm-compare-testbeds-2n-clx-2n-icx-2c-pdr-csv.csv>`_
-
-MRR Comparison
-~~~~~~~~~~~~~~
-
-Comparison tables in HTML, ASCII and CSV formats:
-
-  - `HTML 1c MRR comparison <norm-compare-testbeds-2n-clx-2n-icx-1c-mrr.html>`_
-  - `HTML 2c MRR comparison <norm-compare-testbeds-2n-clx-2n-icx-2c-mrr.html>`_
-  - `HTML 4c MRR comparison <norm-compare-testbeds-2n-clx-2n-icx-4c-mrr.html>`_
-  - `ASCII 1c MRR comparison <../../_static/vpp/norm-compare-testbeds-2n-clx-2n-icx-1c-mrr.txt>`_
-  - `ASCII 2c MRR comparison <../../_static/vpp/norm-compare-testbeds-2n-clx-2n-icx-2c-mrr.txt>`_
-  - `ASCII 4c MRR comparison <../../_static/vpp/norm-compare-testbeds-2n-clx-2n-icx-4c-mrr.txt>`_
-  - `CSV 1c MRR comparison <../../_static/vpp/norm-compare-testbeds-2n-clx-2n-icx-1c-mrr-csv.csv>`_
-  - `CSV 2c MRR comparison <../../_static/vpp/norm-compare-testbeds-2n-clx-2n-icx-2c-mrr-csv.csv>`_
-  - `CSV 4c MRR comparison <../../_static/vpp/norm-compare-testbeds-2n-clx-2n-icx-4c-mrr-csv.csv>`_
diff --git a/docs/report/vpp_performance_tests/comparisons_norm/2n-icx_vs_2n-skx_testbeds.rst b/docs/report/vpp_performance_tests/comparisons_norm/2n-icx_vs_2n-skx_testbeds.rst
deleted file mode 100644
index 8e69eddeac..0000000000
--- a/docs/report/vpp_performance_tests/comparisons_norm/2n-icx_vs_2n-skx_testbeds.rst
+++ /dev/null
@@ -1,54 +0,0 @@
-2n-Icx vs 2n-Skx Testbeds
--------------------------
-
-Relative normalized comparison of |vpp-release| packet throughput (NDR, PDR and
-MRR) is calculated for the same tests executed on 2-Node Cascadelake (2n-
-skx) and 2-Node Icelake (2n-icx) physical testbed types, in 1-core,
-2-core and 4-core configurations.
-
-.. note::
-
-    Test results are stored in
-    `build logs from FD.io vpp performance job 2n-icx`_ and
-    `build logs from FD.io vpp performance job 2n-skx`_
-    with RF result files csit-vpp-perf-|srelease|-\*.zip
-    `archived here <../../_static/archive/>`_.
-
-NDR Comparison
-~~~~~~~~~~~~~~
-
-Comparison tables in HTML, ASCII and CSV formats:
-
-  - `HTML 1c NDR comparison <norm-compare-testbeds-2n-skx-2n-icx-1c-ndr.html>`_
-  - `HTML 2c NDR comparison <norm-compare-testbeds-2n-skx-2n-icx-2c-ndr.html>`_
-  - `ASCII 1c NDR comparison <../../_static/vpp/norm-compare-testbeds-2n-skx-2n-icx-1c-ndr.txt>`_
-  - `ASCII 2c NDR comparison <../../_static/vpp/norm-compare-testbeds-2n-skx-2n-icx-2c-ndr.txt>`_
-  - `CSV 1c NDR comparison <../../_static/vpp/norm-compare-testbeds-2n-skx-2n-icx-1c-ndr-csv.csv>`_
-  - `CSV 2c NDR comparison <../../_static/vpp/norm-compare-testbeds-2n-skx-2n-icx-2c-ndr-csv.csv>`_
-
-PDR Comparison
-~~~~~~~~~~~~~~
-
-Comparison tables in HTML, ASCII and CSV formats:
-
-  - `HTML 1c PDR comparison <norm-compare-testbeds-2n-skx-2n-icx-1c-pdr.html>`_
-  - `HTML 2c PDR comparison <norm-compare-testbeds-2n-skx-2n-icx-2c-pdr.html>`_
-  - `ASCII 1c PDR comparison <../../_static/vpp/norm-compare-testbeds-2n-skx-2n-icx-1c-pdr.txt>`_
-  - `ASCII 2c PDR comparison <../../_static/vpp/norm-compare-testbeds-2n-skx-2n-icx-2c-pdr.txt>`_
-  - `CSV 1c PDR comparison <../../_static/vpp/norm-compare-testbeds-2n-skx-2n-icx-1c-pdr-csv.csv>`_
-  - `CSV 2c PDR comparison <../../_static/vpp/norm-compare-testbeds-2n-skx-2n-icx-2c-pdr-csv.csv>`_
-
-MRR Comparison
-~~~~~~~~~~~~~~
-
-Comparison tables in HTML, ASCII and CSV formats:
-
-  - `HTML 1c MRR comparison <norm-compare-testbeds-2n-skx-2n-icx-1c-mrr.html>`_
-  - `HTML 2c MRR comparison <norm-compare-testbeds-2n-skx-2n-icx-2c-mrr.html>`_
-  - `HTML 4c MRR comparison <norm-compare-testbeds-2n-skx-2n-icx-4c-mrr.html>`_
-  - `ASCII 1c MRR comparison <../../_static/vpp/norm-compare-testbeds-2n-skx-2n-icx-1c-mrr.txt>`_
-  - `ASCII 2c MRR comparison <../../_static/vpp/norm-compare-testbeds-2n-skx-2n-icx-2c-mrr.txt>`_
-  - `ASCII 4c MRR comparison <../../_static/vpp/norm-compare-testbeds-2n-skx-2n-icx-4c-mrr.txt>`_
-  - `CSV 1c MRR comparison <../../_static/vpp/norm-compare-testbeds-2n-skx-2n-icx-1c-mrr-csv.csv>`_
-  - `CSV 2c MRR comparison <../../_static/vpp/norm-compare-testbeds-2n-skx-2n-icx-2c-mrr-csv.csv>`_
-  - `CSV 4c MRR comparison <../../_static/vpp/norm-compare-testbeds-2n-skx-2n-icx-4c-mrr-csv.csv>`_
diff --git a/docs/report/vpp_performance_tests/comparisons_norm/2n-skx_vs_2n-clx_testbeds.rst b/docs/report/vpp_performance_tests/comparisons_norm/2n-skx_vs_2n-clx_testbeds.rst
deleted file mode 100644
index 5791c79803..0000000000
--- a/docs/report/vpp_performance_tests/comparisons_norm/2n-skx_vs_2n-clx_testbeds.rst
+++ /dev/null
@@ -1,54 +0,0 @@
-2n-Clx vs 2n-Skx Testbeds
--------------------------
-
-Relative normalized comparison of |vpp-release| packet throughput (NDR, PDR and
-MRR) is calculated for the same tests executed on 2-Node Skylake (2n-
-skx) and 2-Node Cascade Lake (2n-clx) physical testbed types, in 1-core,
-2-core and 4-core configurations.
-
-.. note::
-
-    Test results are stored in
-    `build logs from FD.io vpp performance job 2n-skx`_ and
-    `build logs from FD.io vpp performance job 2n-clx`_
-    with RF result files csit-vpp-perf-|srelease|-\*.zip
-    `archived here <../../_static/archive/>`_.
-
-NDR Comparison
-~~~~~~~~~~~~~~
-
-Comparison tables in HTML, ASCII and CSV formats:
-
-  - `HTML 1c NDR comparison <norm-compare-testbeds-2n-skx-2n-clx-2t1c-ndr.html>`_
-  - `HTML 2c NDR comparison <norm-compare-testbeds-2n-skx-2n-clx-4t2c-ndr.html>`_
-  - `ASCII 1c NDR comparison <../../_static/vpp/norm-compare-testbeds-2n-skx-2n-clx-2t1c-ndr.txt>`_
-  - `ASCII 2c NDR comparison <../../_static/vpp/norm-compare-testbeds-2n-skx-2n-clx-4t2c-ndr.txt>`_
-  - `CSV 1c NDR comparison <../../_static/vpp/norm-compare-testbeds-2n-skx-2n-clx-2t1c-ndr-csv.csv>`_
-  - `CSV 2c NDR comparison <../../_static/vpp/norm-compare-testbeds-2n-skx-2n-clx-4t2c-ndr-csv.csv>`_
-
-PDR Comparison
-~~~~~~~~~~~~~~
-
-Comparison tables in HTML, ASCII and CSV formats:
-
-  - `HTML 1c PDR comparison <norm-compare-testbeds-2n-skx-2n-clx-2t1c-pdr.html>`_
-  - `HTML 2c PDR comparison <norm-compare-testbeds-2n-skx-2n-clx-4t2c-pdr.html>`_
-  - `ASCII 1c PDR comparison <../../_static/vpp/norm-compare-testbeds-2n-skx-2n-clx-2t1c-pdr.txt>`_
-  - `ASCII 2c PDR comparison <../../_static/vpp/norm-compare-testbeds-2n-skx-2n-clx-4t2c-pdr.txt>`_
-  - `CSV 1c PDR comparison <../../_static/vpp/norm-compare-testbeds-2n-skx-2n-clx-2t1c-pdr-csv.csv>`_
-  - `CSV 2c PDR comparison <../../_static/vpp/norm-compare-testbeds-2n-skx-2n-clx-4t2c-pdr-csv.csv>`_
-
-MRR Comparison
-~~~~~~~~~~~~~~
-
-Comparison tables in HTML, ASCII and CSV formats:
-
-  - `HTML 1c MRR comparison <norm-compare-testbeds-2n-skx-2n-clx-2t1c-mrr.html>`_
-  - `HTML 2c MRR comparison <norm-compare-testbeds-2n-skx-2n-clx-4t2c-mrr.html>`_
-  - `HTML 4c MRR comparison <norm-compare-testbeds-2n-skx-2n-clx-8t4c-mrr.html>`_
-  - `ASCII 1c MRR comparison <../../_static/vpp/norm-compare-testbeds-2n-skx-2n-clx-2t1c-mrr.txt>`_
-  - `ASCII 2c MRR comparison <../../_static/vpp/norm-compare-testbeds-2n-skx-2n-clx-4t2c-mrr.txt>`_
-  - `ASCII 4c MRR comparison <../../_static/vpp/norm-compare-testbeds-2n-skx-2n-clx-8t4c-mrr.txt>`_
-  - `CSV 1c MRR comparison <../../_static/vpp/norm-compare-testbeds-2n-skx-2n-clx-2t1c-mrr-csv.csv>`_
-  - `CSV 2c MRR comparison <../../_static/vpp/norm-compare-testbeds-2n-skx-2n-clx-4t2c-mrr-csv.csv>`_
-  - `CSV 4c MRR comparison <../../_static/vpp/norm-compare-testbeds-2n-skx-2n-clx-8t4c-mrr-csv.csv>`_
diff --git a/docs/report/vpp_performance_tests/comparisons_norm/3n-skx_vs_2n-skx_testbeds.rst b/docs/report/vpp_performance_tests/comparisons_norm/3n-skx_vs_2n-skx_testbeds.rst
deleted file mode 100644
index 2b309f75d5..0000000000
--- a/docs/report/vpp_performance_tests/comparisons_norm/3n-skx_vs_2n-skx_testbeds.rst
+++ /dev/null
@@ -1,55 +0,0 @@
-3n-Skx vs 2n-Skx Testbeds
--------------------------
-
-Relative normalized comparison of |vpp-release| packet throughput (NDR, PDR and
-MRR) is calculated for the same tests executed on 3-Node Skylake (3n-
-skx) and 2-Node Skylake (2n-skx) physical testbed types, in 1-core,
-2-core and 4-core configurations.
-
-.. note::
-
-    Test results are stored in
-    `build logs from FD.io vpp performance job 3n-skx`_ and
-    `build logs from FD.io vpp performance job 2n-skx`_
-    with RF result
-    files csit-vpp-perf-|srelease|-\*.zip
-    `archived here <../../_static/archive/>`_.
-
-NDR Comparison
-~~~~~~~~~~~~~~
-
-Comparison tables in HTML, ASCII and CSV formats:
-
-  - `HTML 1c NDR comparison <norm-compare-topologies-3n-skx-2n-skx-1c-ndr.html>`_
-  - `HTML 2c NDR comparison <norm-compare-topologies-3n-skx-2n-skx-2c-ndr.html>`_
-  - `ASCII 1c NDR comparison <../../_static/vpp/norm-compare-topologies-3n-skx-2n-skx-1c-ndr.txt>`_
-  - `ASCII 2c NDR comparison <../../_static/vpp/norm-compare-topologies-3n-skx-2n-skx-2c-ndr.txt>`_
-  - `CSV 1c NDR comparison <../../_static/vpp/norm-compare-topologies-3n-skx-2n-skx-1c-ndr-csv.csv>`_
-  - `CSV 2c NDR comparison <../../_static/vpp/norm-compare-topologies-3n-skx-2n-skx-2c-ndr-csv.csv>`_
-
-PDR Comparison
-~~~~~~~~~~~~~~
-
-Comparison tables in HTML, ASCII and CSV formats:
-
-  - `HTML 1c PDR comparison <norm-compare-topologies-3n-skx-2n-skx-1c-pdr.html>`_
-  - `HTML 2c PDR comparison <norm-compare-topologies-3n-skx-2n-skx-2c-pdr.html>`_
-  - `ASCII 1c PDR comparison <../../_static/vpp/norm-compare-topologies-3n-skx-2n-skx-1c-pdr.txt>`_
-  - `ASCII 2c PDR comparison <../../_static/vpp/norm-compare-topologies-3n-skx-2n-skx-2c-pdr.txt>`_
-  - `CSV 1c PDR comparison <../../_static/vpp/norm-compare-topologies-3n-skx-2n-skx-1c-pdr-csv.csv>`_
-  - `CSV 2c PDR comparison <../../_static/vpp/norm-compare-topologies-3n-skx-2n-skx-2c-pdr-csv.csv>`_
-
-MRR Comparison
-~~~~~~~~~~~~~~
-
-Comparison tables in HTML, ASCII and CSV formats:
-
-  - `HTML 1c MRR comparison <norm-compare-topologies-3n-skx-2n-skx-1c-mrr.html>`_
-  - `HTML 2c MRR comparison <norm-compare-topologies-3n-skx-2n-skx-2c-mrr.html>`_
-  - `HTML 4c MRR comparison <norm-compare-topologies-3n-skx-2n-skx-4c-mrr.html>`_
-  - `ASCII 1c MRR comparison <../../_static/vpp/norm-compare-topologies-3n-skx-2n-skx-1c-mrr.txt>`_
-  - `ASCII 2c MRR comparison <../../_static/vpp/norm-compare-topologies-3n-skx-2n-skx-2c-mrr.txt>`_
-  - `ASCII 4c MRR comparison <../../_static/vpp/norm-compare-topologies-3n-skx-2n-skx-4c-mrr.txt>`_
-  - `CSV 1c MRR comparison <../../_static/vpp/norm-compare-topologies-3n-skx-2n-skx-1c-mrr-csv.csv>`_
-  - `CSV 2c MRR comparison <../../_static/vpp/norm-compare-topologies-3n-skx-2n-skx-2c-mrr-csv.csv>`_
-  - `CSV 4c MRR comparison <../../_static/vpp/norm-compare-topologies-3n-skx-2n-skx-4c-mrr-csv.csv>`_
diff --git a/docs/report/vpp_performance_tests/comparisons_norm/3n-skx_vs_3n-icx_testbeds.rst b/docs/report/vpp_performance_tests/comparisons_norm/3n-skx_vs_3n-icx_testbeds.rst
deleted file mode 100644
index 8e2fb103cd..0000000000
--- a/docs/report/vpp_performance_tests/comparisons_norm/3n-skx_vs_3n-icx_testbeds.rst
+++ /dev/null
@@ -1,55 +0,0 @@
-3n-Icx vs 3n-Skx Testbeds
--------------------------
-
-Relative normalized comparison of |vpp-release| packet throughput (NDR, PDR and
-MRR) is calculated for the same tests executed on 3-Node Skylake (3n-
-skx) and 3-Node Icelake (3n-icx) physical testbed types, in 1-core,
-2-core and 4-core configurations.
-
-.. note::
-
-    Test results are stored in
-    `build logs from FD.io vpp performance job 3n-skx`_ and
-    `build logs from FD.io vpp performance job 3n-icx`_
-    with RF result
-    files csit-vpp-perf-|srelease|-\*.zip
-    `archived here <../../_static/archive/>`_.
-
-NDR Comparison
-~~~~~~~~~~~~~~
-
-Comparison tables in HTML, ASCII and CSV formats:
-
-  - `HTML 1c NDR comparison <norm-compare-testbeds-3n-skx-3n-icx-1c-ndr.html>`_
-  - `HTML 2c NDR comparison <norm-compare-testbeds-3n-skx-3n-icx-2c-ndr.html>`_
-  - `ASCII 1c NDR comparison <../../_static/vpp/norm-compare-testbeds-3n-skx-3n-icx-1c-ndr.txt>`_
-  - `ASCII 2c NDR comparison <../../_static/vpp/norm-compare-testbeds-3n-skx-3n-icx-2c-ndr.txt>`_
-  - `CSV 1c NDR comparison <../../_static/vpp/norm-compare-testbeds-3n-skx-3n-icx-1c-ndr-csv.csv>`_
-  - `CSV 2c NDR comparison <../../_static/vpp/norm-compare-testbeds-3n-skx-3n-icx-2c-ndr-csv.csv>`_
-
-PDR Comparison
-~~~~~~~~~~~~~~
-
-Comparison tables in HTML, ASCII and CSV formats:
-
-  - `HTML 1c PDR comparison <norm-compare-testbeds-3n-skx-3n-icx-1c-pdr.html>`_
-  - `HTML 2c PDR comparison <norm-compare-testbeds-3n-skx-3n-icx-2c-pdr.html>`_
-  - `ASCII 1c PDR comparison <../../_static/vpp/norm-compare-testbeds-3n-skx-3n-icx-1c-pdr.txt>`_
-  - `ASCII 2c PDR comparison <../../_static/vpp/norm-compare-testbeds-3n-skx-3n-icx-2c-pdr.txt>`_
-  - `CSV 1c PDR comparison <../../_static/vpp/norm-compare-testbeds-3n-skx-3n-icx-1c-pdr-csv.csv>`_
-  - `CSV 2c PDR comparison <../../_static/vpp/norm-compare-testbeds-3n-skx-3n-icx-2c-pdr-csv.csv>`_
-
-MRR Comparison
-~~~~~~~~~~~~~~
-
-Comparison tables in HTML, ASCII and CSV formats:
-
-  - `HTML 1c MRR comparison <norm-compare-testbeds-3n-skx-3n-icx-1c-mrr.html>`_
-  - `HTML 2c MRR comparison <norm-compare-testbeds-3n-skx-3n-icx-2c-mrr.html>`_
-  - `HTML 4c MRR comparison <norm-compare-testbeds-3n-skx-3n-icx-4c-mrr.html>`_
-  - `ASCII 1c MRR comparison <../../_static/vpp/norm-compare-testbeds-3n-skx-3n-icx-1c-mrr.txt>`_
-  - `ASCII 2c MRR comparison <../../_static/vpp/norm-compare-testbeds-3n-skx-3n-icx-2c-mrr.txt>`_
-  - `ASCII 4c MRR comparison <../../_static/vpp/norm-compare-testbeds-3n-skx-3n-icx-4c-mrr.txt>`_
-  - `CSV 1c MRR comparison <../../_static/vpp/norm-compare-testbeds-3n-skx-3n-icx-1c-mrr-csv.csv>`_
-  - `CSV 2c MRR comparison <../../_static/vpp/norm-compare-testbeds-3n-skx-3n-icx-2c-mrr-csv.csv>`_
-  - `CSV 4c MRR comparison <../../_static/vpp/norm-compare-testbeds-3n-skx-3n-icx-4c-mrr-csv.csv>`_
diff --git a/docs/report/vpp_performance_tests/comparisons_norm/index.rst b/docs/report/vpp_performance_tests/comparisons_norm/index.rst
deleted file mode 100644
index 7a0bdb0712..0000000000
--- a/docs/report/vpp_performance_tests/comparisons_norm/index.rst
+++ /dev/null
@@ -1,17 +0,0 @@
-
-.. raw:: latex
-
-    \clearpage
-
-Normalized Comparisons
-======================
-
-All values in this section are normalized to CPU frequency 2GHz.
-
-.. toctree::
-
-    2n-clx_vs_2n-icx_testbeds
-    2n-icx_vs_2n-skx_testbeds
-    2n-skx_vs_2n-clx_testbeds
-    3n-skx_vs_3n-icx_testbeds
-    3n-skx_vs_2n-skx_testbeds
diff --git a/docs/report/vpp_performance_tests/index.rst b/docs/report/vpp_performance_tests/index.rst
index 42cec49604..e54549ed32 100644
--- a/docs/report/vpp_performance_tests/index.rst
+++ b/docs/report/vpp_performance_tests/index.rst
@@ -14,6 +14,5 @@ VPP Performance
     hoststack_testing/index
     gso_testing/index
     comparisons/index
-    comparisons_norm/index
     throughput_trending
     test_environment