From b21dc3f42eb5cd77277ef44912cdb7c1f0acbff7 Mon Sep 17 00:00:00 2001 From: Tibor Frank Date: Tue, 12 Feb 2019 10:13:41 +0100 Subject: Report: Add hover info to graph's descriptions Change-Id: I39e6b18d73bbd35eda50cdb8191f7762bbe965e5 Signed-off-by: Tibor Frank --- .../packet_latency_graphs/index.rst | 4 + .../packet_latency_graphs/ip4.rst | 140 +++-------- .../packet_latency_graphs/l2.rst | 140 +++-------- .../packet_throughput_graphs/index.rst | 8 + .../packet_throughput_graphs/ip4.rst | 280 +++++---------------- .../packet_throughput_graphs/l2.rst | 280 +++++---------------- docs/report/index.html.template | 1 - .../http_server_performance/index.rst | 19 ++ .../nf_service_density/cnf_service_chains.rst | 4 +- .../nf_service_density/cnf_service_pipelines.rst | 4 +- .../nf_service_density/vnf_service_chains.rst | 4 +- .../packet_latency_graphs/index.rst | 4 + .../packet_throughput_graphs/index.rst | 7 + .../vpp_performance_tests/soak_tests/index.rst | 3 + .../throughput_speedup_multi_core/index.rst | 19 ++ 15 files changed, 238 insertions(+), 679 deletions(-) diff --git a/docs/report/dpdk_performance_tests/packet_latency_graphs/index.rst b/docs/report/dpdk_performance_tests/packet_latency_graphs/index.rst index 9805fa0dc4..51ad6ee004 100644 --- a/docs/report/dpdk_performance_tests/packet_latency_graphs/index.rst +++ b/docs/report/dpdk_performance_tests/packet_latency_graphs/index.rst @@ -29,6 +29,10 @@ Additional information about graph data: #. **Graph Legend**: lists X-axis indices with associated CSIT test suites executed to generate graphed test results. +#. **Hover Information**: lists number of runs executed, specific test + substring, packet flow direction, maximal, mean and minimal values of + measured latencies. + .. note:: Test results have been generated by diff --git a/docs/report/dpdk_performance_tests/packet_latency_graphs/ip4.rst b/docs/report/dpdk_performance_tests/packet_latency_graphs/ip4.rst index e89c43a345..1c512d09a2 100644 --- a/docs/report/dpdk_performance_tests/packet_latency_graphs/ip4.rst +++ b/docs/report/dpdk_performance_tests/packet_latency_graphs/ip4.rst @@ -51,15 +51,9 @@ CSIT source code for the test cases used for plots can be found in .. raw:: html -
- -:index:`Packet Latency: l3fwd-3n-hsw-x520-64b-1t1c-base-ndr` - -.. raw:: html - - +
-



+


.. raw:: latex @@ -80,15 +74,9 @@ CSIT source code for the test cases used for plots can be found in .. raw:: html -
- -:index:`Packet Latency: l3fwd-3n-hsw-x520-64b-2t2c-base-ndr` - -.. raw:: html - - +
-



+


.. raw:: latex @@ -112,15 +100,9 @@ CSIT source code for the test cases used for plots can be found in .. raw:: html -
- -:index:`Packet Latency: l3fwd-3n-hsw-x710-64b-1t1c-base-ndr` - -.. raw:: html - - +
-



+


.. raw:: latex @@ -141,15 +123,9 @@ CSIT source code for the test cases used for plots can be found in .. raw:: html -
- -:index:`Packet Latency: l3fwd-3n-hsw-x710-64b-2t2c-base-ndr` - -.. raw:: html - - +
-



+


.. raw:: latex @@ -173,15 +149,9 @@ CSIT source code for the test cases used for plots can be found in .. raw:: html -
- -:index:`Packet Latency: l3fwd-3n-hsw-xl710-64b-1t1c-base-ndr` - -.. raw:: html - - +
-



+


.. raw:: latex @@ -202,15 +172,9 @@ CSIT source code for the test cases used for plots can be found in .. raw:: html -
- -:index:`Packet Latency: l3fwd-3n-hsw-xl710-64b-2t2c-base-ndr` - -.. raw:: html - - +
-



+


.. raw:: latex @@ -235,15 +199,9 @@ CSIT source code for the test cases used for plots can be found in .. raw:: html -
- - :index:`Packet Latency: l3fwd-3n-skx-x710-64b-2t1c-base-ndr` - - .. raw:: html - - +
-



+


.. raw:: latex @@ -264,15 +222,9 @@ CSIT source code for the test cases used for plots can be found in .. raw:: html -
- - :index:`Packet Latency: l3fwd-3n-skx-x710-64b-4t2c-base-ndr` - - .. raw:: html - - +
-



+


.. raw:: latex @@ -296,15 +248,9 @@ CSIT source code for the test cases used for plots can be found in .. raw:: html -
- - :index:`Packet Latency: l3fwd-3n-skx-xxv710-64b-2t1c-base-ndr` - - .. raw:: html - - +
-



+


.. raw:: latex @@ -325,15 +271,9 @@ CSIT source code for the test cases used for plots can be found in .. raw:: html -
- - :index:`Packet Latency: l3fwd-3n-skx-xxv710-64b-4t2c-base-ndr` - - .. raw:: html - - +
-



+


.. raw:: latex @@ -357,15 +297,9 @@ CSIT source code for the test cases used for plots can be found in .. raw:: html -
- -:index:`Packet Latency: l3fwd-2n-skx-x710-64b-2t1c-base-ndr` - -.. raw:: html - - +
-



+


.. raw:: latex @@ -386,15 +320,9 @@ CSIT source code for the test cases used for plots can be found in .. raw:: html -
- -:index:`Packet Latency: l3fwd-2n-skx-x710-64b-4t2c-base-ndr` - -.. raw:: html - - +
-



+


.. raw:: latex @@ -418,15 +346,9 @@ CSIT source code for the test cases used for plots can be found in .. raw:: html -
- -:index:`Packet Latency: l3fwd-2n-skx-xxv710-64b-2t1c-base-ndr` - -.. raw:: html - - +
-



+


.. raw:: latex @@ -447,15 +369,9 @@ CSIT source code for the test cases used for plots can be found in .. raw:: html -
- -:index:`Packet Latency: l3fwd-2n-skx-xxv710-64b-4t2c-base-ndr` - -.. raw:: html - - +
-



+


.. raw:: latex diff --git a/docs/report/dpdk_performance_tests/packet_latency_graphs/l2.rst b/docs/report/dpdk_performance_tests/packet_latency_graphs/l2.rst index 4f6dd9e0de..efcea485a1 100644 --- a/docs/report/dpdk_performance_tests/packet_latency_graphs/l2.rst +++ b/docs/report/dpdk_performance_tests/packet_latency_graphs/l2.rst @@ -52,15 +52,9 @@ CSIT source code for the test cases used for plots can be found in .. raw:: html -
- -:index:`Packet Latency: testpmd-3n-hsw-x520-64b-1t1c-base-ndr` - -.. raw:: html - - +
-



+


.. raw:: latex @@ -81,15 +75,9 @@ CSIT source code for the test cases used for plots can be found in .. raw:: html -
- -:index:`Packet Latency: testpmd-3n-hsw-x520-64b-2t2c-base-ndr` - -.. raw:: html - - +
-



+


.. raw:: latex @@ -113,15 +101,9 @@ CSIT source code for the test cases used for plots can be found in .. raw:: html -
- -:index:`Packet Latency: testpmd-3n-hsw-x710-64b-1t1c-base-ndr` - -.. raw:: html - - +
-



+


.. raw:: latex @@ -142,15 +124,9 @@ CSIT source code for the test cases used for plots can be found in .. raw:: html -
- -:index:`Packet Latency: testpmd-3n-hsw-x710-64b-2t2c-base-ndr` - -.. raw:: html - - +
-



+


.. raw:: latex @@ -174,15 +150,9 @@ CSIT source code for the test cases used for plots can be found in .. raw:: html -
- -:index:`Packet Latency: testpmd-3n-hsw-xl710-64b-1t1c-base-ndr` - -.. raw:: html - - +
-



+


.. raw:: latex @@ -203,15 +173,9 @@ CSIT source code for the test cases used for plots can be found in .. raw:: html -
- -:index:`Packet Latency: testpmd-3n-hsw-xl710-64b-2t2c-base-ndr` - -.. raw:: html - - +
-



+


.. raw:: latex @@ -235,15 +199,9 @@ CSIT source code for the test cases used for plots can be found in .. raw:: html -
- -:index:`Packet Latency: testpmd-3n-skx-x710-64b-2t1c-base-ndr` - -.. raw:: html - - +
-



+


.. raw:: latex @@ -264,15 +222,9 @@ CSIT source code for the test cases used for plots can be found in .. raw:: html -
- -:index:`Packet Latency: testpmd-3n-skx-x710-64b-4t2c-base-ndr` - -.. raw:: html - - +
-



+


.. raw:: latex @@ -296,15 +248,9 @@ CSIT source code for the test cases used for plots can be found in .. raw:: html -
- -:index:`Packet Latency: testpmd-3n-skx-xxv710-64b-2t1c-base-ndr` - -.. raw:: html - - +
-



+


.. raw:: latex @@ -325,15 +271,9 @@ CSIT source code for the test cases used for plots can be found in .. raw:: html -
- -:index:`Packet Latency: testpmd-3n-skx-xxv710-64b-4t2c-base-ndr` - -.. raw:: html - - +
-



+


.. raw:: latex @@ -357,15 +297,9 @@ CSIT source code for the test cases used for plots can be found in .. raw:: html -
- -:index:`Packet Latency: testpmd-2n-skx-x710-64b-2t1c-base-ndr` - -.. raw:: html - - +
-



+


.. raw:: latex @@ -386,15 +320,9 @@ CSIT source code for the test cases used for plots can be found in .. raw:: html -
- -:index:`Packet Latency: testpmd-2n-skx-x710-64b-4t2c-base-ndr` - -.. raw:: html - - +
-



+


.. raw:: latex @@ -418,15 +346,9 @@ CSIT source code for the test cases used for plots can be found in .. raw:: html -
- -:index:`Packet Latency: testpmd-2n-skx-xxv710-64b-2t1c-base-ndr` - -.. raw:: html - - +
-



+


.. raw:: latex @@ -447,15 +369,9 @@ CSIT source code for the test cases used for plots can be found in .. raw:: html -
- -:index:`Packet Latency: testpmd-2n-skx-xxv710-64b-4t2c-base-ndr` - -.. raw:: html - - +
-



+


.. raw:: latex diff --git a/docs/report/dpdk_performance_tests/packet_throughput_graphs/index.rst b/docs/report/dpdk_performance_tests/packet_throughput_graphs/index.rst index 7a7e79adfc..f4de25c3ad 100644 --- a/docs/report/dpdk_performance_tests/packet_throughput_graphs/index.rst +++ b/docs/report/dpdk_performance_tests/packet_throughput_graphs/index.rst @@ -33,6 +33,14 @@ Additional information about graph data: #. **Graph Legend**: lists X-axis indices with associated CSIT test suites executed to generate graphed test results. +#. **Hover Information**: lists minimum, first quartile, median, + third quartile, and maximum. If either type of outlier is present the + whisker on the appropriate side is taken to 1.5×IQR from the quartile + (the "inner fence") rather than the max or min, and individual outlying + data points are displayed as unfilled circles (for suspected outliers) + or filled circles (for outliers). (The "outer fence" is 3×IQR from the + quartile.) + .. note:: Test results have been generated by diff --git a/docs/report/dpdk_performance_tests/packet_throughput_graphs/ip4.rst b/docs/report/dpdk_performance_tests/packet_throughput_graphs/ip4.rst index 37fcc3a447..4d54d49be5 100644 --- a/docs/report/dpdk_performance_tests/packet_throughput_graphs/ip4.rst +++ b/docs/report/dpdk_performance_tests/packet_throughput_graphs/ip4.rst @@ -52,15 +52,9 @@ CSIT source code for the test cases used for plots can be found in .. raw:: html -
- -:index:`Packet Throughput: l3fwd-3n-hsw-x520-64b-1t1c-base-ndr` - -.. raw:: html - - +
-



+


.. raw:: latex @@ -72,21 +66,15 @@ CSIT source code for the test cases used for plots can be found in \label{fig:l3fwd-3n-hsw-x520-64b-1t1c-base-ndr} \end{figure} -.. raw:: html - -
- .. raw:: latex \clearpage -:index:`Packet Throughput: l3fwd-3n-hsw-x520-64b-1t1c-base-pdr` - .. raw:: html - +
-



+


.. raw:: latex @@ -107,15 +95,9 @@ CSIT source code for the test cases used for plots can be found in .. raw:: html -
- -:index:`Packet Throughput: l3fwd-3n-hsw-x520-64b-2t2c-base-ndr` - -.. raw:: html - - +
-



+


.. raw:: latex @@ -127,21 +109,15 @@ CSIT source code for the test cases used for plots can be found in \label{fig:l3fwd-3n-hsw-x520-64b-2t2c-base-ndr} \end{figure} -.. raw:: html - -
- .. raw:: latex \clearpage -:index:`Packet Throughput: l3fwd-3n-hsw-x520-64b-2t2c-base-pdr` - .. raw:: html - +
-



+


.. raw:: latex @@ -165,15 +141,9 @@ CSIT source code for the test cases used for plots can be found in .. raw:: html -
- -:index:`Packet Throughput: l3fwd-3n-hsw-x710-64b-1t1c-base-ndr` - -.. raw:: html - - +
-



+


.. raw:: latex @@ -185,21 +155,15 @@ CSIT source code for the test cases used for plots can be found in \label{fig:l3fwd-3n-hsw-x710-64b-1t1c-base-ndr} \end{figure} -.. raw:: html - -
- .. raw:: latex \clearpage -:index:`Packet Throughput: l3fwd-3n-hsw-x710-64b-1t1c-base-pdr` - .. raw:: html - +
-



+


.. raw:: latex @@ -220,15 +184,9 @@ CSIT source code for the test cases used for plots can be found in .. raw:: html -
- -:index:`Packet Throughput: l3fwd-3n-hsw-x710-64b-2t2c-base-ndr` - -.. raw:: html - - +
-



+


.. raw:: latex @@ -240,21 +198,15 @@ CSIT source code for the test cases used for plots can be found in \label{fig:l3fwd-3n-hsw-x710-64b-2t2c-base-ndr} \end{figure} -.. raw:: html - -
- .. raw:: latex \clearpage -:index:`Packet Throughput: l3fwd-3n-hsw-x710-64b-2t2c-base-pdr` - .. raw:: html - +
-



+


.. raw:: latex @@ -278,15 +230,9 @@ CSIT source code for the test cases used for plots can be found in .. raw:: html -
- -:index:`Packet Throughput: l3fwd-3n-hsw-xl710-64b-1t1c-base-ndr` - -.. raw:: html - - +
-



+


.. raw:: latex @@ -298,21 +244,15 @@ CSIT source code for the test cases used for plots can be found in \label{fig:l3fwd-3n-hsw-xl710-64b-1t1c-base-ndr} \end{figure} -.. raw:: html - -
- .. raw:: latex \clearpage -:index:`Packet Throughput: l3fwd-3n-hsw-xl710-64b-1t1c-base-pdr` - .. raw:: html - +
-



+


.. raw:: latex @@ -333,15 +273,9 @@ CSIT source code for the test cases used for plots can be found in .. raw:: html -
- -:index:`Packet Throughput: l3fwd-3n-hsw-xl710-64b-2t2c-base-ndr` - -.. raw:: html - - +
-



+


.. raw:: latex @@ -353,21 +287,15 @@ CSIT source code for the test cases used for plots can be found in \label{fig:l3fwd-3n-hsw-xl710-64b-2t2c-base-ndr} \end{figure} -.. raw:: html - -
- .. raw:: latex \clearpage -:index:`Packet Throughput: l3fwd-3n-hsw-xl710-64b-2t2c-base-pdr` - .. raw:: html - +
-



+


.. raw:: latex @@ -392,15 +320,9 @@ CSIT source code for the test cases used for plots can be found in .. raw:: html -
- - :index:`Packet Throughput: l3fwd-3n-skx-x710-64b-2t1c-base-ndr` - - .. raw:: html - - +
-



+


.. raw:: latex @@ -412,21 +334,15 @@ CSIT source code for the test cases used for plots can be found in \label{fig:l3fwd-3n-skx-x710-64b-2t1c-base-ndr} \end{figure} - .. raw:: html - -
- .. raw:: latex \clearpage - :index:`Packet Throughput: l3fwd-3n-skx-x710-64b-2t1c-base-pdr` - .. raw:: html - +
-



+


.. raw:: latex @@ -447,15 +363,9 @@ CSIT source code for the test cases used for plots can be found in .. raw:: html -
- - :index:`Packet Throughput: l3fwd-3n-skx-x710-64b-4t2c-base-ndr` - - .. raw:: html - - +
-



+


.. raw:: latex @@ -467,21 +377,15 @@ CSIT source code for the test cases used for plots can be found in \label{fig:l3fwd-3n-skx-x710-64b-4t2c-base-ndr} \end{figure} - .. raw:: html - -
- .. raw:: latex \clearpage - :index:`Packet Throughput: l3fwd-3n-skx-x710-64b-4t2c-base-pdr` - .. raw:: html - +
-



+


.. raw:: latex @@ -505,15 +409,9 @@ CSIT source code for the test cases used for plots can be found in .. raw:: html -
- - :index:`Packet Throughput: l3fwd-3n-skx-xxv710-64b-2t1c-base-ndr` - - .. raw:: html - - +
-



+


.. raw:: latex @@ -525,21 +423,15 @@ CSIT source code for the test cases used for plots can be found in \label{fig:l3fwd-3n-skx-xxv710-64b-2t1c-base-ndr} \end{figure} - .. raw:: html - -
- .. raw:: latex \clearpage - :index:`Packet Throughput: l3fwd-3n-skx-xxv710-64b-2t1c-base-pdr` - .. raw:: html - +
-



+


.. raw:: latex @@ -560,15 +452,9 @@ CSIT source code for the test cases used for plots can be found in .. raw:: html -
- - :index:`Packet Throughput: l3fwd-3n-skx-xxv710-64b-4t2c-base-ndr` - - .. raw:: html - - +
-



+


.. raw:: latex @@ -580,21 +466,15 @@ CSIT source code for the test cases used for plots can be found in \label{fig:l3fwd-3n-skx-xxv710-64b-4t2c-base-ndr} \end{figure} - .. raw:: html - -
- .. raw:: latex \clearpage - :index:`Packet Throughput: l3fwd-3n-skx-xxv710-64b-4t2c-base-pdr` - .. raw:: html - +
-



+


.. raw:: latex @@ -618,15 +498,9 @@ CSIT source code for the test cases used for plots can be found in .. raw:: html -
- -:index:`Packet Throughput: l3fwd-2n-skx-x710-64b-2t1c-base-ndr` - -.. raw:: html - - +
-



+


.. raw:: latex @@ -638,21 +512,15 @@ CSIT source code for the test cases used for plots can be found in \label{fig:l3fwd-2n-skx-x710-64b-2t1c-base-ndr} \end{figure} -.. raw:: html - -
- .. raw:: latex \clearpage -:index:`Packet Throughput: l3fwd-2n-skx-x710-64b-2t1c-base-pdr` - .. raw:: html - +
-



+


.. raw:: latex @@ -673,15 +541,9 @@ CSIT source code for the test cases used for plots can be found in .. raw:: html -
- -:index:`Packet Throughput: l3fwd-2n-skx-x710-64b-4t2c-base-ndr` - -.. raw:: html - - +
-



+


.. raw:: latex @@ -693,21 +555,15 @@ CSIT source code for the test cases used for plots can be found in \label{fig:l3fwd-2n-skx-x710-64b-4t2c-base-ndr} \end{figure} -.. raw:: html - -
- .. raw:: latex \clearpage -:index:`Packet Throughput: l3fwd-2n-skx-x710-64b-4t2c-base-pdr` - .. raw:: html - +
-



+


.. raw:: latex @@ -731,15 +587,9 @@ CSIT source code for the test cases used for plots can be found in .. raw:: html -
- -:index:`Packet Throughput: l3fwd-2n-skx-xxv710-64b-2t1c-base-ndr` - -.. raw:: html - - +
-



+


.. raw:: latex @@ -751,21 +601,15 @@ CSIT source code for the test cases used for plots can be found in \label{fig:l3fwd-2n-skx-xxv710-64b-2t1c-base-ndr} \end{figure} -.. raw:: html - -
- .. raw:: latex \clearpage -:index:`Packet Throughput: l3fwd-2n-skx-xxv710-64b-2t1c-base-pdr` - .. raw:: html - +
-



+


.. raw:: latex @@ -786,15 +630,9 @@ CSIT source code for the test cases used for plots can be found in .. raw:: html -
- -:index:`Packet Throughput: l3fwd-2n-skx-xxv710-64b-4t2c-base-ndr` - -.. raw:: html - - +
-



+


.. raw:: latex @@ -806,21 +644,15 @@ CSIT source code for the test cases used for plots can be found in \label{fig:l3fwd-2n-skx-xxv710-64b-4t2c-base-ndr} \end{figure} -.. raw:: html - -
- .. raw:: latex \clearpage -:index:`Packet Throughput: l3fwd-2n-skx-xxv710-64b-4t2c-base-pdr` - .. raw:: html - +
-



+


.. raw:: latex diff --git a/docs/report/dpdk_performance_tests/packet_throughput_graphs/l2.rst b/docs/report/dpdk_performance_tests/packet_throughput_graphs/l2.rst index 6aefc362eb..8447b6a694 100644 --- a/docs/report/dpdk_performance_tests/packet_throughput_graphs/l2.rst +++ b/docs/report/dpdk_performance_tests/packet_throughput_graphs/l2.rst @@ -48,15 +48,9 @@ CSIT source code for the test cases used for plots can be found in .. raw:: html -
- -:index:`Packet Throughput: testpmd-3n-hsw-x520-64b-1t1c-base-ndr` - -.. raw:: html - - +
-



+


.. raw:: latex @@ -68,21 +62,15 @@ CSIT source code for the test cases used for plots can be found in \label{fig:testpmd-3n-hsw-x520-64b-1t1c-base-ndr} \end{figure} -.. raw:: html - -
- .. raw:: latex \clearpage -:index:`Packet Throughput: testpmd-3n-hsw-x520-64b-1t1c-base-pdr` - .. raw:: html - +
-



+


.. raw:: latex @@ -103,15 +91,9 @@ CSIT source code for the test cases used for plots can be found in .. raw:: html -
- -:index:`Packet Throughput: testpmd-3n-hsw-x520-64b-2t2c-base-ndr` - -.. raw:: html - - +
-



+


.. raw:: latex @@ -123,21 +105,15 @@ CSIT source code for the test cases used for plots can be found in \label{fig:testpmd-3n-hsw-x520-64b-2t2c-base-ndr} \end{figure} -.. raw:: html - -
- .. raw:: latex \clearpage -:index:`Packet Throughput: testpmd-3n-hsw-x520-64b-2t2c-base-pdr` - .. raw:: html - +
-



+


.. raw:: latex @@ -161,15 +137,9 @@ CSIT source code for the test cases used for plots can be found in .. raw:: html -
- -:index:`Packet Throughput: testpmd-3n-hsw-x710-64b-1t1c-base-ndr` - -.. raw:: html - - +
-



+


.. raw:: latex @@ -181,21 +151,15 @@ CSIT source code for the test cases used for plots can be found in \label{fig:testpmd-3n-hsw-x710-64b-1t1c-base-ndr} \end{figure} -.. raw:: html - -
- .. raw:: latex \clearpage -:index:`Packet Throughput: testpmd-3n-hsw-x710-64b-1t1c-base-pdr` - .. raw:: html - +
-



+


.. raw:: latex @@ -216,15 +180,9 @@ CSIT source code for the test cases used for plots can be found in .. raw:: html -
- -:index:`Packet Throughput: testpmd-3n-hsw-x710-64b-2t2c-base-ndr` - -.. raw:: html - - +
-



+


.. raw:: latex @@ -236,21 +194,15 @@ CSIT source code for the test cases used for plots can be found in \label{fig:testpmd-3n-hsw-x710-64b-2t2c-base-ndr} \end{figure} -.. raw:: html - -
- .. raw:: latex \clearpage -:index:`Packet Throughput: testpmd-3n-hsw-x710-64b-2t2c-base-pdr` - .. raw:: html - +
-



+


.. raw:: latex @@ -274,15 +226,9 @@ CSIT source code for the test cases used for plots can be found in .. raw:: html -
- -:index:`Packet Throughput: testpmd-3n-hsw-xl710-64b-1t1c-base-ndr` - -.. raw:: html - - +
-



+


.. raw:: latex @@ -294,21 +240,15 @@ CSIT source code for the test cases used for plots can be found in \label{fig:testpmd-3n-hsw-xl710-64b-1t1c-base-ndr} \end{figure} -.. raw:: html - -
- .. raw:: latex \clearpage -:index:`Packet Throughput: testpmd-3n-hsw-xl710-64b-1t1c-base-pdr` - .. raw:: html - +
-



+


.. raw:: latex @@ -329,15 +269,9 @@ CSIT source code for the test cases used for plots can be found in .. raw:: html -
- -:index:`Packet Throughput: testpmd-3n-hsw-xl710-64b-2t2c-base-ndr` - -.. raw:: html - - +
-



+


.. raw:: latex @@ -349,21 +283,15 @@ CSIT source code for the test cases used for plots can be found in \label{fig:testpmd-3n-hsw-xl710-64b-2t2c-base-ndr} \end{figure} -.. raw:: html - -
- .. raw:: latex \clearpage -:index:`Packet Throughput: testpmd-3n-hsw-xl710-64b-2t2c-base-pdr` - .. raw:: html - +
-



+


.. raw:: latex @@ -387,15 +315,9 @@ CSIT source code for the test cases used for plots can be found in .. raw:: html -
- -:index:`Packet Throughput: testpmd-3n-skx-x710-64b-2t1c-base-ndr` - -.. raw:: html - - +
-



+


.. raw:: latex @@ -407,21 +329,15 @@ CSIT source code for the test cases used for plots can be found in \label{fig:testpmd-3n-skx-x710-64b-2t1c-base-ndr} \end{figure} -.. raw:: html - -
- .. raw:: latex \clearpage -:index:`Packet Throughput: testpmd-3n-skx-x710-64b-2t1c-base-pdr` - .. raw:: html - +
-



+


.. raw:: latex @@ -442,15 +358,9 @@ CSIT source code for the test cases used for plots can be found in .. raw:: html -
- -:index:`Packet Throughput: testpmd-3n-skx-x710-64b-4t2c-base-ndr` - -.. raw:: html - - +
-



+


.. raw:: latex @@ -462,21 +372,15 @@ CSIT source code for the test cases used for plots can be found in \label{fig:testpmd-3n-skx-x710-64b-4t2c-base-ndr} \end{figure} -.. raw:: html - -
- .. raw:: latex \clearpage -:index:`Packet Throughput: testpmd-3n-skx-x710-64b-4t2c-base-pdr` - .. raw:: html - +
-



+


.. raw:: latex @@ -500,15 +404,9 @@ CSIT source code for the test cases used for plots can be found in .. raw:: html -
- -:index:`Packet Throughput: testpmd-3n-skx-xxv710-64b-2t1c-base-ndr` - -.. raw:: html - - +
-



+


.. raw:: latex @@ -520,21 +418,15 @@ CSIT source code for the test cases used for plots can be found in \label{fig:testpmd-3n-skx-xxv710-64b-2t1c-base-ndr} \end{figure} -.. raw:: html - -
- .. raw:: latex \clearpage -:index:`Packet Throughput: testpmd-3n-skx-xxv710-64b-2t1c-base-pdr` - .. raw:: html - +
-



+


.. raw:: latex @@ -555,15 +447,9 @@ CSIT source code for the test cases used for plots can be found in .. raw:: html -
- -:index:`Packet Throughput: testpmd-3n-skx-xxv710-64b-4t2c-base-ndr` - -.. raw:: html - - +
-



+


.. raw:: latex @@ -575,21 +461,15 @@ CSIT source code for the test cases used for plots can be found in \label{fig:testpmd-3n-skx-xxv710-64b-4t2c-base-ndr} \end{figure} -.. raw:: html - -
- .. raw:: latex \clearpage -:index:`Packet Throughput: testpmd-3n-skx-xxv710-64b-4t2c-base-pdr` - .. raw:: html - +
-



+


.. raw:: latex @@ -613,15 +493,9 @@ CSIT source code for the test cases used for plots can be found in .. raw:: html -
- -:index:`Packet Throughput: testpmd-2n-skx-x710-64b-2t1c-base-ndr` - -.. raw:: html - - +
-



+


.. raw:: latex @@ -633,21 +507,15 @@ CSIT source code for the test cases used for plots can be found in \label{fig:testpmd-2n-skx-x710-64b-2t1c-base-ndr} \end{figure} -.. raw:: html - -
- .. raw:: latex \clearpage -:index:`Packet Throughput: testpmd-2n-skx-x710-64b-2t1c-base-pdr` - .. raw:: html - +
-



+


.. raw:: latex @@ -668,15 +536,9 @@ CSIT source code for the test cases used for plots can be found in .. raw:: html -
- -:index:`Packet Throughput: testpmd-2n-skx-x710-64b-4t2c-base-ndr` - -.. raw:: html - - +
-



+


.. raw:: latex @@ -688,21 +550,15 @@ CSIT source code for the test cases used for plots can be found in \label{fig:testpmd-2n-skx-x710-64b-4t2c-base-ndr} \end{figure} -.. raw:: html - -
- .. raw:: latex \clearpage -:index:`Packet Throughput: testpmd-2n-skx-x710-64b-4t2c-base-pdr` - .. raw:: html - +
-



+


.. raw:: latex @@ -726,15 +582,9 @@ CSIT source code for the test cases used for plots can be found in .. raw:: html -
- -:index:`Packet Throughput: testpmd-2n-skx-xxv710-64b-2t1c-base-ndr` - -.. raw:: html - - +
-



+


.. raw:: latex @@ -746,21 +596,15 @@ CSIT source code for the test cases used for plots can be found in \label{fig:testpmd-2n-skx-xxv710-64b-2t1c-base-ndr} \end{figure} -.. raw:: html - -
- .. raw:: latex \clearpage -:index:`Packet Throughput: testpmd-2n-skx-xxv710-64b-2t1c-base-pdr` - .. raw:: html - +
-



+


.. raw:: latex @@ -781,15 +625,9 @@ CSIT source code for the test cases used for plots can be found in .. raw:: html -
- -:index:`Packet Throughput: testpmd-2n-skx-xxv710-64b-4t2c-base-ndr` - -.. raw:: html - - +
-



+


.. raw:: latex @@ -801,21 +639,15 @@ CSIT source code for the test cases used for plots can be found in \label{fig:testpmd-2n-skx-xxv710-64b-4t2c-base-ndr} \end{figure} -.. raw:: html - -
- .. raw:: latex \clearpage -:index:`Packet Throughput: testpmd-2n-skx-xxv710-64b-4t2c-base-pdr` - .. raw:: html - +
-



+


.. raw:: latex diff --git a/docs/report/index.html.template b/docs/report/index.html.template index 379e054593..d157b8c16e 100644 --- a/docs/report/index.html.template +++ b/docs/report/index.html.template @@ -20,7 +20,6 @@ CSIT-1901 vpp_performance_tests/packet_throughput_graphs/index vpp_performance_tests/throughput_speedup_multi_core/index vpp_performance_tests/packet_latency_graphs/index - vpp_performance_tests/soak_tests/index vpp_performance_tests/nf_service_density/index vpp_performance_tests/http_server_performance/index vpp_performance_tests/comparisons/index diff --git a/docs/report/vpp_performance_tests/http_server_performance/index.rst b/docs/report/vpp_performance_tests/http_server_performance/index.rst index e864931e2f..b067042f17 100644 --- a/docs/report/vpp_performance_tests/http_server_performance/index.rst +++ b/docs/report/vpp_performance_tests/http_server_performance/index.rst @@ -42,6 +42,25 @@ quartile / 25th percentile, 2nd quartile / 50th percentile / mean, 3rd quartile / 75th percentile, Max) across collected data set. Outliers are plotted as individual points. +Additional information about graph data: + +#. **X-axis Labels**: indices of individual test suites as listed in + Graph Legend. + +#. **Y-axis Labels**: measured Connections Per Second [cps] or Requests Per + Second [rps] throughput values. + +#. **Graph Legend**: lists X-axis indices with associated CSIT test + suites executed to generate graphed test results. + +#. **Hover Information**: lists minimum, first quartile, median, + third quartile, and maximum. If either type of outlier is present the + whisker on the appropriate side is taken to 1.5×IQR from the quartile + (the "inner fence") rather than the max or min, and individual outlying + data points are displayed as unfilled circles (for suspected outliers) + or filled circles (for outliers). (The "outer fence" is 3×IQR from the + quartile.) + .. note:: Data sources for reported test results: i) `FD.io test executor vpp diff --git a/docs/report/vpp_performance_tests/nf_service_density/cnf_service_chains.rst b/docs/report/vpp_performance_tests/nf_service_density/cnf_service_chains.rst index 56d1782692..32c46a080b 100644 --- a/docs/report/vpp_performance_tests/nf_service_density/cnf_service_chains.rst +++ b/docs/report/vpp_performance_tests/nf_service_density/cnf_service_chains.rst @@ -47,12 +47,12 @@ Additional information about graph data: #. **Y-axis Labels**: number of service chains. -#. **Z-axis Color Scale**: lists 64B Packet Throughput (mean MRR value) +#. **Z-axis Color Scale**: lists 64B Packet Throughput (mean MRR/NDR/PDR value) in Mpps. #. **Hover Information**: specific test substring listing memif-chain-docker_container combinations, number of runs executed, - mean MRR throughput in Mpps, standard deviation. + mean MRR/NDR/PDR throughput in Mpps, standard deviation. .. note:: diff --git a/docs/report/vpp_performance_tests/nf_service_density/cnf_service_pipelines.rst b/docs/report/vpp_performance_tests/nf_service_density/cnf_service_pipelines.rst index dac7ca8413..45d79f4536 100644 --- a/docs/report/vpp_performance_tests/nf_service_density/cnf_service_pipelines.rst +++ b/docs/report/vpp_performance_tests/nf_service_density/cnf_service_pipelines.rst @@ -47,12 +47,12 @@ Additional information about graph data: #. **Y-axis Labels**: number of service pipelines. -#. **Z-axis Color Scale**: lists 64B Packet Throughput (mean MRR value) +#. **Z-axis Color Scale**: lists 64B Packet Throughput (mean MRR/NDR/PDR value) in Mpps. #. **Hover Information**: specific test substring listing memif-pipeline-docker_container combinations, number of runs - executed, mean MRR throughput in Mpps, standard deviation. + executed, mean MRR/NDR/PDR throughput in Mpps, standard deviation. .. note:: diff --git a/docs/report/vpp_performance_tests/nf_service_density/vnf_service_chains.rst b/docs/report/vpp_performance_tests/nf_service_density/vnf_service_chains.rst index 12c9bd4afd..9dba258e86 100644 --- a/docs/report/vpp_performance_tests/nf_service_density/vnf_service_chains.rst +++ b/docs/report/vpp_performance_tests/nf_service_density/vnf_service_chains.rst @@ -47,11 +47,11 @@ Additional information about graph data: #. **Y-axis Labels**: number of service chains. -#. **Z-axis Color Scale**: lists 64B Packet Throughput (mean MRR value) +#. **Z-axis Color Scale**: lists 64B Packet Throughput (mean MRR/NDR/PDR value) in Mpps. #. **Hover Information**: specific test substring listing vhost-chain-vm - combinations, number of runs executed, mean MRR throughput in Mpps, + combinations, number of runs executed, mean MRR/NDR/PDR throughput in Mpps, standard deviation. .. note:: diff --git a/docs/report/vpp_performance_tests/packet_latency_graphs/index.rst b/docs/report/vpp_performance_tests/packet_latency_graphs/index.rst index c6c40d7a7d..912b499327 100644 --- a/docs/report/vpp_performance_tests/packet_latency_graphs/index.rst +++ b/docs/report/vpp_performance_tests/packet_latency_graphs/index.rst @@ -31,6 +31,10 @@ Additional information about graph data: #. **Graph Legend**: lists X-axis indices with associated CSIT test suites executed to generate graphed test results. +#. **Hover Information**: lists number of runs executed, specific test + substring, packet flow direction, maximal, mean and minimal values of + measured latencies. + .. note:: Test results have been generated by diff --git a/docs/report/vpp_performance_tests/packet_throughput_graphs/index.rst b/docs/report/vpp_performance_tests/packet_throughput_graphs/index.rst index 9bc7184ba8..4dea96f575 100644 --- a/docs/report/vpp_performance_tests/packet_throughput_graphs/index.rst +++ b/docs/report/vpp_performance_tests/packet_throughput_graphs/index.rst @@ -35,6 +35,13 @@ Additional information about graph data: #. **Graph Legend**: lists X-axis indices with associated CSIT test suites executed to generate graphed test results. +#. **Hover Information**: lists minimum, first quartile, median, + third quartile, and maximum. If either type of outlier is present the + whisker on the appropriate side is taken to 1.5×IQR from the quartile + (the "inner fence") rather than the max or min, and individual outlying + data points are displayed as unfilled circles (for suspected outliers) + or filled circles (for outliers). (The "outer fence" is 3×IQR from the + quartile.) .. note:: diff --git a/docs/report/vpp_performance_tests/soak_tests/index.rst b/docs/report/vpp_performance_tests/soak_tests/index.rst index 9cf502a62d..95ff414a62 100644 --- a/docs/report/vpp_performance_tests/soak_tests/index.rst +++ b/docs/report/vpp_performance_tests/soak_tests/index.rst @@ -46,6 +46,9 @@ Additional information about graph data: #. **Graph Legend**: list of X-axis indices with CSIT test suites. +#. **Hover Information**: lists the lower and upper bounds of measured + throughput. + .. note:: Test results have been generated by diff --git a/docs/report/vpp_performance_tests/throughput_speedup_multi_core/index.rst b/docs/report/vpp_performance_tests/throughput_speedup_multi_core/index.rst index b6feb2b8a6..b3504010f3 100644 --- a/docs/report/vpp_performance_tests/throughput_speedup_multi_core/index.rst +++ b/docs/report/vpp_performance_tests/throughput_speedup_multi_core/index.rst @@ -14,6 +14,25 @@ LF FD.io labs: 3n-hsw, 2n-skx, 2n-skx. Grouped bars illustrate the 64B/78B packet throughput speedup ratio for 2- and 4-core multi- threaded VPP configurations relative to 1-core configurations. +Additional information about graph data: + +#. **Graph Title**: describes tested packet path, testbed topology, + processor model, NIC model, packet size used by data plane workers and + indication of VPP DUT configuration. + +#. **X-axis Labels**: number of cores. + +#. **Y-axis Labels**: measured Packets Per Second [pps] throughput + values. + +#. **Graph Legend**: lists CSIT test suites executed to generate graphed test + results. + +#. **Hover Information**: lists number of runs executed, specific test + substring, mean value of the measured packet throughput, calculated perfect + throughput value, difference between measured and perfect values and + relative speedup value. + .. note:: Test results have been generated by -- cgit 1.2.3-korg