From a6644da0fb0bcd9513995c5d2aecdefb4bbdaf25 Mon Sep 17 00:00:00 2001 From: Maciek Konstantynowicz Date: Wed, 3 May 2017 13:17:42 +0100 Subject: Updates to csit rls1704 report related to increased number of test job executions. Change-Id: If16e312eeb377cabc96fe1a671d9bdfedf5e87b0 Signed-off-by: Maciek Konstantynowicz --- .../packet_throughput_graphs/index.rst | 33 ++++++++++++++++++++++ .../packet_throughput_graphs/l2.rst | 27 ------------------ 2 files changed, 33 insertions(+), 27 deletions(-) (limited to 'docs/report/testpmd_performance_tests/packet_throughput_graphs') diff --git a/docs/report/testpmd_performance_tests/packet_throughput_graphs/index.rst b/docs/report/testpmd_performance_tests/packet_throughput_graphs/index.rst index 4e4e87a1ea..d607b6ead6 100644 --- a/docs/report/testpmd_performance_tests/packet_throughput_graphs/index.rst +++ b/docs/report/testpmd_performance_tests/packet_throughput_graphs/index.rst @@ -1,6 +1,39 @@ Packet Throughput Graphs ======================== +Plotted results are generated by multiple executions of the same CSIT +performance tests across three physical testbeds within LF FD.io labs. +To provide a descriptive summary view, Box-and-Whisker plots are used to +display variation in measured throughput values, without making any +assumptions of the underlying statistical distribution. + +For each plotted test case, Box-and-Whisker plots show the quartiles +(Min, 1st quartile / 25th percentile, 2nd quartile / 50th percentile / +mean, 3rd quartile / 75th percentile, Max) across collected data set +(data set size stated in the note below). Outliers are plotted as +individual points. Min and max values are plotted as bottom and top +Whiskers respectively. 2nd and 3rd quartiles are plotted as bottom and +top edge of the box. If multiple samples match only two values, and all +samples fall between them, then no whiskers are plotted. If all samples +have the same value, only a horizontal line is plotted. + +*Title of each graph* is a regex (regular expression) matching all +throughput test cases plotted on this graph, *X-axis labels* are indices +of individual test suites executed by csit-dpdk-perf-1704-all jobs that +created result output files used as data sources for the graph, *Y-axis +labels* are measured Packets Per Second [pps] values, and the *Graph +legend* lists the plotted test suites and their indices. + +.. note:: + + Test results have been generated by FD.io test executor jobs + `csit-dpdk-perf-1704-all + `_, + with Robot Framework result files csit-dpdk-perf-1704-all-.zip + `archived here <../../_static/archive/>`_. Plotted data set size per + test case is equal to the number of job executions presented in this + report version: **10**. + .. toctree:: l2 diff --git a/docs/report/testpmd_performance_tests/packet_throughput_graphs/l2.rst b/docs/report/testpmd_performance_tests/packet_throughput_graphs/l2.rst index 8b13dc9e50..40f320ec04 100644 --- a/docs/report/testpmd_performance_tests/packet_throughput_graphs/l2.rst +++ b/docs/report/testpmd_performance_tests/packet_throughput_graphs/l2.rst @@ -7,33 +7,6 @@ and PDR throughput (<0.5% packet loss). Performance is reported for Testpmd running in multiple configurations of Testpmd pmd thread(s), a.k.a. Testpmd data plane thread(s), and their physical CPU core(s) placement. -Results are generated by multiple executions of the same CSIT -performance tests across three physical testbeds within LF FD.io labs. -To provide a descriptive summary view, Box-and-Whisker plots are used to -display variation in measured throughput values, without making any -assumptions of the underlying statistical distribution. For each plotted -test case, Box-and-Whisker plots show the quartiles (Min, 1st quartile -/ 25th percentile, 2nd quartile / 50th percentile / mean, 3rd quartile / -75th percentile, Max) across collected data set (data set size stated in -the note below). Outliers are plotted as individual points. - -*Title of each graph* is a regex (regular expression) matching all -throughput test cases plotted on this graph, *X-axis labels* are indices -of individual test suites executed by csit-dpdk-perf-1704-all jobs that -created result output files used as data sources for the graph, *Y-axis -labels* are measured Packets Per Second [pps] values, and the *Graph -legend* lists the plotted test suites and their indices. - -.. note:: - - Test results have been generated by FD.io test executor jobs - `csit-dpdk-perf-1704-all - `_, - with Robot Framework result files csit-dpdk-perf-1704-all-.zip - `archived here <../../_static/archive/>`_. Plotted data set size per - test case is equal to the number of job executions presented in this - report version: **4**. - NDR Throughput ~~~~~~~~~~~~~~ -- cgit 1.2.3-korg