From b1af33fbcd345c9d4eca534072f6daf0c55c0305 Mon Sep 17 00:00:00 2001 From: Tibor Frank Date: Mon, 20 Apr 2020 12:20:38 +0200 Subject: Report: Add 2n-skx Soak and Reconf tests Change-Id: Ia1e658347051ea0476cbea76361783ab7f6d6d1d Signed-off-by: Tibor Frank --- docs/report/introduction/report_history.rst | 4 + .../comparisons/current_vs_previous_release.rst | 63 +++++++------- .../comparisons/soak_vs_ndr.rst | 9 +- .../reconf_tests/vnf_service_chains_reconf.rst | 95 +++++++++++----------- .../vpp_performance_tests/soak_tests/index.rst | 49 ++++++++++- 5 files changed, 135 insertions(+), 85 deletions(-) (limited to 'docs') diff --git a/docs/report/introduction/report_history.rst b/docs/report/introduction/report_history.rst index a7598e902e..380e3d36f5 100644 --- a/docs/report/introduction/report_history.rst +++ b/docs/report/introduction/report_history.rst @@ -20,6 +20,10 @@ FD.io CSIT-2001 Report history and per .[ww] revision changes are listed below. | | | | | - Hoststack 3n-hsw tests | | | | +| | - Reconfiguration Tests 2n-skx | +| | | +| | - Soak Tests 2n-skx | +| | | | | 2. Added Root Cause Analysis for VPP performance tests | | | 2n-skx and 3n-skx. | | | | diff --git a/docs/report/vpp_performance_tests/comparisons/current_vs_previous_release.rst b/docs/report/vpp_performance_tests/comparisons/current_vs_previous_release.rst index 30b428eb6f..2dcec8834d 100644 --- a/docs/report/vpp_performance_tests/comparisons/current_vs_previous_release.rst +++ b/docs/report/vpp_performance_tests/comparisons/current_vs_previous_release.rst @@ -57,7 +57,7 @@ Comparison tables in HTML, ASCII and CSV formats: - `CSV 2t1c PDR RCA <../../_static/vpp/performance-rca-2n-skx-2t1c-pdr-csv.csv>`_ .. - ``NDR Comparison + NDR Comparison `````````````` Comparison tables in HTML, ASCII and CSV formats: @@ -148,44 +148,45 @@ Comparison tables in HTML, ASCII and CSV formats: - `ASCII 2t1c PDR RCA <../../_static/vpp/performance-rca-3n-skx-2t1c-pdr.txt>`_ - `CSV 2t1c PDR RCA <../../_static/vpp/performance-rca-3n-skx-2t1c-pdr-csv.csv>`_ -NDR Comparison -`````````````` +.. + NDR Comparison + `````````````` -Comparison tables in HTML, ASCII and CSV formats: + Comparison tables in HTML, ASCII and CSV formats: - - `HTML 2t1c NDR comparison `_ - - `HTML 4t2c NDR comparison `_ - - `ASCII 2t1c NDR comparison <../../_static/vpp/performance-changes-3n-skx-2t1c-ndr.txt>`_ - - `ASCII 4t2c NDR comparison <../../_static/vpp/performance-changes-3n-skx-4t2c-ndr.txt>`_ - - `CSV 2t1c NDR comparison <../../_static/vpp/performance-changes-3n-skx-2t1c-ndr.csv>`_ - - `CSV 4t2c NDR comparison <../../_static/vpp/performance-changes-3n-skx-4t2c-ndr.csv>`_ + - `HTML 2t1c NDR comparison `_ + - `HTML 4t2c NDR comparison `_ + - `ASCII 2t1c NDR comparison <../../_static/vpp/performance-changes-3n-skx-2t1c-ndr.txt>`_ + - `ASCII 4t2c NDR comparison <../../_static/vpp/performance-changes-3n-skx-4t2c-ndr.txt>`_ + - `CSV 2t1c NDR comparison <../../_static/vpp/performance-changes-3n-skx-2t1c-ndr.csv>`_ + - `CSV 4t2c NDR comparison <../../_static/vpp/performance-changes-3n-skx-4t2c-ndr.csv>`_ -PDR Comparison -`````````````` + PDR Comparison + `````````````` -Comparison tables in HTML, ASCII and CSV formats: + Comparison tables in HTML, ASCII and CSV formats: - - `HTML 2t1c PDR comparison `_ - - `HTML 4t2c PDR comparison `_ - - `ASCII 2t1c PDR comparison <../../_static/vpp/performance-changes-3n-skx-2t1c-pdr.txt>`_ - - `ASCII 4t2c PDR comparison <../../_static/vpp/performance-changes-3n-skx-4t2c-pdr.txt>`_ - - `CSV 2t1c PDR comparison <../../_static/vpp/performance-changes-3n-skx-2t1c-pdr.csv>`_ - - `CSV 4t2c PDR comparison <../../_static/vpp/performance-changes-3n-skx-4t2c-pdr.csv>`_ + - `HTML 2t1c PDR comparison `_ + - `HTML 4t2c PDR comparison `_ + - `ASCII 2t1c PDR comparison <../../_static/vpp/performance-changes-3n-skx-2t1c-pdr.txt>`_ + - `ASCII 4t2c PDR comparison <../../_static/vpp/performance-changes-3n-skx-4t2c-pdr.txt>`_ + - `CSV 2t1c PDR comparison <../../_static/vpp/performance-changes-3n-skx-2t1c-pdr.csv>`_ + - `CSV 4t2c PDR comparison <../../_static/vpp/performance-changes-3n-skx-4t2c-pdr.csv>`_ -MRR Comparison -`````````````` + MRR Comparison + `````````````` -Comparison tables in HTML, ASCII and CSV formats: + Comparison tables in HTML, ASCII and CSV formats: - - `HTML 2t1c MRR comparison `_ - - `HTML 4t2c MRR comparison `_ - - `HTML 8t4c MRR comparison `_ - - `ASCII 2t1c MRR comparison <../../_static/vpp/performance-changes-3n-skx-2t1c-mrr.txt>`_ - - `ASCII 4t2c MRR comparison <../../_static/vpp/performance-changes-3n-skx-4t2c-mrr.txt>`_ - - `ASCII 8t4c MRR comparison <../../_static/vpp/performance-changes-3n-skx-8t4c-mrr.txt>`_ - - `CSV 2t1c MRR comparison <../../_static/vpp/performance-changes-3n-skx-2t1c-mrr.csv>`_ - - `CSV 4t2c MRR comparison <../../_static/vpp/performance-changes-3n-skx-4t2c-mrr.csv>`_ - - `CSV 8t4c MRR comparison <../../_static/vpp/performance-changes-3n-skx-8t4c-mrr.csv>`_ + - `HTML 2t1c MRR comparison `_ + - `HTML 4t2c MRR comparison `_ + - `HTML 8t4c MRR comparison `_ + - `ASCII 2t1c MRR comparison <../../_static/vpp/performance-changes-3n-skx-2t1c-mrr.txt>`_ + - `ASCII 4t2c MRR comparison <../../_static/vpp/performance-changes-3n-skx-4t2c-mrr.txt>`_ + - `ASCII 8t4c MRR comparison <../../_static/vpp/performance-changes-3n-skx-8t4c-mrr.txt>`_ + - `CSV 2t1c MRR comparison <../../_static/vpp/performance-changes-3n-skx-2t1c-mrr.csv>`_ + - `CSV 4t2c MRR comparison <../../_static/vpp/performance-changes-3n-skx-4t2c-mrr.csv>`_ + - `CSV 8t4c MRR comparison <../../_static/vpp/performance-changes-3n-skx-8t4c-mrr.csv>`_ 3n-hsw ~~~~~~ diff --git a/docs/report/vpp_performance_tests/comparisons/soak_vs_ndr.rst b/docs/report/vpp_performance_tests/comparisons/soak_vs_ndr.rst index daf62cc0b7..c219ffd5fe 100644 --- a/docs/report/vpp_performance_tests/comparisons/soak_vs_ndr.rst +++ b/docs/report/vpp_performance_tests/comparisons/soak_vs_ndr.rst @@ -17,12 +17,11 @@ in 1-core configurations. Comparison tables in ASCII and CSV formats: -.. - 2n-skx - ~~~~~~ +2n-skx +~~~~~~ - - `ASCII Soak vs. NDR comparison <../../_static/vpp/soak-vs-ndr-2n-skx.txt>`_ - - `CSV Soak vs. NDR comparison <../../_static/vpp/soak-vs-ndr-2n-skx.csv>`_ + - `ASCII Soak vs. NDR comparison <../../_static/vpp/soak-vs-ndr-2n-skx.txt>`_ + - `CSV Soak vs. NDR comparison <../../_static/vpp/soak-vs-ndr-2n-skx.csv>`_ 2n-clx ~~~~~~ diff --git a/docs/report/vpp_performance_tests/reconf_tests/vnf_service_chains_reconf.rst b/docs/report/vpp_performance_tests/reconf_tests/vnf_service_chains_reconf.rst index 3cdb5fd0cf..f63d12f01b 100644 --- a/docs/report/vpp_performance_tests/reconf_tests/vnf_service_chains_reconf.rst +++ b/docs/report/vpp_performance_tests/reconf_tests/vnf_service_chains_reconf.rst @@ -80,75 +80,74 @@ Additional information about graph data: \clearpage -.. - 2n-skx-xxv710 - ~~~~~~~~~~~~~ +2n-skx-xxv710 +~~~~~~~~~~~~~ - imix-2t1c-dot1qip4vxlan-l2bd - ---------------------------- +imix-2t1c-dot1qip4vxlan-l2bd +---------------------------- - .. raw:: html +.. raw:: html -
- -
+
+ +
- .. raw:: latex +.. raw:: latex - \begin{figure}[H] - \centering - \graphicspath{{../_build/_static/vpp/}} - \includegraphics[clip, trim=0cm 0cm 5cm 0cm, width=0.70\textwidth]{2n-skx-xxv710-imix-2t1c-dot1qip4vxlan-l2bd-reconf} - \label{fig:2n-skx-xxv710-imix-2t1c-dot1qip4vxlan-l2bd-reconf} - \end{figure} + \begin{figure}[H] + \centering + \graphicspath{{../_build/_static/vpp/}} + \includegraphics[clip, trim=0cm 0cm 5cm 0cm, width=0.70\textwidth]{2n-skx-xxv710-imix-2t1c-dot1qip4vxlan-l2bd-reconf} + \label{fig:2n-skx-xxv710-imix-2t1c-dot1qip4vxlan-l2bd-reconf} + \end{figure} - .. raw:: latex +.. raw:: latex - \clearpage + \clearpage - imix-4t2c-dot1qip4vxlan-l2bd - ---------------------------- +imix-4t2c-dot1qip4vxlan-l2bd +---------------------------- - .. raw:: html +.. raw:: html -
- -
+
+ +
- .. raw:: latex +.. raw:: latex - \begin{figure}[H] - \centering - \graphicspath{{../_build/_static/vpp/}} - \includegraphics[clip, trim=0cm 0cm 5cm 0cm, width=0.70\textwidth]{2n-skx-xxv710-imix-4t2c-dot1qip4vxlan-l2bd-reconf} - \label{fig:2n-skx-xxv710-imix-4t2c-dot1qip4vxlan-l2bd-reconf} - \end{figure} + \begin{figure}[H] + \centering + \graphicspath{{../_build/_static/vpp/}} + \includegraphics[clip, trim=0cm 0cm 5cm 0cm, width=0.70\textwidth]{2n-skx-xxv710-imix-4t2c-dot1qip4vxlan-l2bd-reconf} + \label{fig:2n-skx-xxv710-imix-4t2c-dot1qip4vxlan-l2bd-reconf} + \end{figure} - .. raw:: latex +.. raw:: latex - \clearpage + \clearpage - imix-8t4c-dot1qip4vxlan-l2bd - ---------------------------- +imix-8t4c-dot1qip4vxlan-l2bd +---------------------------- - .. raw:: html +.. raw:: html -
- -
+
+ +
- .. raw:: latex +.. raw:: latex - \begin{figure}[H] - \centering - \graphicspath{{../_build/_static/vpp/}} - \includegraphics[clip, trim=0cm 0cm 5cm 0cm, width=0.70\textwidth]{2n-skx-xxv710-imix-8t4c-dot1qip4vxlan-l2bd-reconf} - \label{fig:2n-skx-xxv710-imix-8t4c-dot1qip4vxlan-l2bd-reconf} - \end{figure} + \begin{figure}[H] + \centering + \graphicspath{{../_build/_static/vpp/}} + \includegraphics[clip, trim=0cm 0cm 5cm 0cm, width=0.70\textwidth]{2n-skx-xxv710-imix-8t4c-dot1qip4vxlan-l2bd-reconf} + \label{fig:2n-skx-xxv710-imix-8t4c-dot1qip4vxlan-l2bd-reconf} + \end{figure} - .. raw:: latex +.. raw:: latex - \clearpage + \clearpage 2n-clx-xxv710 ~~~~~~~~~~~~~ diff --git a/docs/report/vpp_performance_tests/soak_tests/index.rst b/docs/report/vpp_performance_tests/soak_tests/index.rst index 1ca041d59c..39e5ce152f 100644 --- a/docs/report/vpp_performance_tests/soak_tests/index.rst +++ b/docs/report/vpp_performance_tests/soak_tests/index.rst @@ -59,7 +59,8 @@ Additional information about graph data: .. note:: Test results have been generated by - `FD.io test executor vpp performance job 2n-skx`_ with RF + `FD.io test executor vpp performance job 2n-skx`_ and + `FD.io test executor vpp performance job 2n-clx`_ with RF result files csit-vpp-perf-|srelease|-\*.zip `archived here <../../_static/archive/>`_. @@ -67,6 +68,9 @@ Additional information about graph data: \clearpage +2n-clx +------ + .. raw:: html
@@ -102,3 +106,46 @@ Additional information about graph data: \includegraphics[clip, trim=0cm 0cm 5cm 0cm, width=0.70\textwidth]{soak-test-2} \label{fig:soak-test-2} \end{figure} + +.. raw:: latex + + \clearpage + +2n-skx +------ + +.. raw:: html + +
+ +


+
+ +.. raw:: latex + + \begin{figure}[H] + \centering + \graphicspath{{../_build/_static/vpp/}} + \includegraphics[clip, trim=0cm 0cm 5cm 0cm, width=0.70\textwidth]{soak-test-2n-skx-1} + \label{fig:soak-test-2n-skx-1} + \end{figure} + +.. raw:: latex + + \clearpage + +.. raw:: html + +
+ +


+
+ +.. raw:: latex + + \begin{figure}[H] + \centering + \graphicspath{{../_build/_static/vpp/}} + \includegraphics[clip, trim=0cm 0cm 5cm 0cm, width=0.70\textwidth]{soak-test-2n-skx-2} + \label{fig:soak-test-2n-skx-2} + \end{figure} -- cgit 1.2.3-korg