From 77f5aa47751102cfa514c55690b5d58b782b0dcb Mon Sep 17 00:00:00 2001 From: Maciek Konstantynowicz Date: Thu, 27 Apr 2017 13:35:33 +0100 Subject: csit rls1704: updates to /testpmd_performance_tests/packet_*_graphs files. Change-Id: I7c9fefd93e768368ac1093ffd4589dcf63a6375c Signed-off-by: Maciek Konstantynowicz --- .../packet_latency_graphs/l2.rst | 2 +- .../packet_throughput_graphs/l2.rst | 18 ++++++++++++------ .../packet_throughput_graphs/l2.rst | 14 +++++++------- resources/tools/report_gen/run_report.sh | 2 +- 4 files changed, 21 insertions(+), 15 deletions(-) diff --git a/docs/report/testpmd_performance_tests/packet_latency_graphs/l2.rst b/docs/report/testpmd_performance_tests/packet_latency_graphs/l2.rst index ddb18f42d2..95b82d784d 100644 --- a/docs/report/testpmd_performance_tests/packet_latency_graphs/l2.rst +++ b/docs/report/testpmd_performance_tests/packet_latency_graphs/l2.rst @@ -27,7 +27,7 @@ ii) East-to-West: TGint2-to-SUT2-to-SUT1-to-TGint1. `csit-dpdk-perf-1704-all `_, with Robot Framework result files csit-dpdk-perf-1704-all-.zip - `archived here <../../_static/archive/>`_ + `archived here <../../_static/archive/>`_. Testpmd packet latency - running in configuration of **one worker thread (1t) on one physical core (1c)** - is presented in the figure below. diff --git a/docs/report/testpmd_performance_tests/packet_throughput_graphs/l2.rst b/docs/report/testpmd_performance_tests/packet_throughput_graphs/l2.rst index 3601384c99..8b13dc9e50 100644 --- a/docs/report/testpmd_performance_tests/packet_throughput_graphs/l2.rst +++ b/docs/report/testpmd_performance_tests/packet_throughput_graphs/l2.rst @@ -7,11 +7,15 @@ and PDR throughput (<0.5% packet loss). Performance is reported for Testpmd running in multiple configurations of Testpmd pmd thread(s), a.k.a. Testpmd data plane thread(s), and their physical CPU core(s) placement. -Results are generated by multiple executions of the same CSIT tests. -In order to display variation in measured throughput values, Box-and- -whisker plots are used to show their quartiles (Min, 1st quartile / 25th -percentile, 2nd quartile / 50th percentile / mean, 3rd quartile / 75th -percentile, Max). Outliers are plotted as individual points. +Results are generated by multiple executions of the same CSIT +performance tests across three physical testbeds within LF FD.io labs. +To provide a descriptive summary view, Box-and-Whisker plots are used to +display variation in measured throughput values, without making any +assumptions of the underlying statistical distribution. For each plotted +test case, Box-and-Whisker plots show the quartiles (Min, 1st quartile +/ 25th percentile, 2nd quartile / 50th percentile / mean, 3rd quartile / +75th percentile, Max) across collected data set (data set size stated in +the note below). Outliers are plotted as individual points. *Title of each graph* is a regex (regular expression) matching all throughput test cases plotted on this graph, *X-axis labels* are indices @@ -26,7 +30,9 @@ legend* lists the plotted test suites and their indices. `csit-dpdk-perf-1704-all `_, with Robot Framework result files csit-dpdk-perf-1704-all-.zip - `archived here <../../_static/archive/>`_ + `archived here <../../_static/archive/>`_. Plotted data set size per + test case is equal to the number of job executions presented in this + report version: **4**. NDR Throughput ~~~~~~~~~~~~~~ diff --git a/docs/report/vpp_performance_tests/packet_throughput_graphs/l2.rst b/docs/report/vpp_performance_tests/packet_throughput_graphs/l2.rst index 5344dd7d51..5e8822c4a5 100644 --- a/docs/report/vpp_performance_tests/packet_throughput_graphs/l2.rst +++ b/docs/report/vpp_performance_tests/packet_throughput_graphs/l2.rst @@ -140,11 +140,11 @@ git repository: $ cd $CSIT/tests/perf $ grep -E "64B-2t2c-(eth|dot1q|dot1ad)-(l2xcbase|l2bdbasemaclrn)-pdrdisc" * -10ge2p1vic1227-eth-l2bdbasemaclrn-ndrpdrdisc.robot:| tc08-64B-2t2c-eth-l2bdbasemaclrn-pdrdisc -10ge2p1x520-dot1ad-l2xcbase-ndrpdrdisc.robot:| tc08-64B-2t2c-dot1ad-l2xcbase-pdrdisc -10ge2p1x520-dot1q-l2xcbase-ndrpdrdisc.robot:| tc08-64B-2t2c-dot1q-l2xcbase-pdrdisc -10ge2p1x520-eth-l2bdbasemaclrn-ndrpdrdisc.robot:| tc08-64B-2t2c-eth-l2bdbasemaclrn-pdrdisc -10ge2p1x520-eth-l2xcbase-ndrpdrdisc.robot:| tc08-64B-2t2c-eth-l2xcbase-pdrdisc -10ge2p1x710-eth-l2bdbasemaclrn-ndrpdrdisc.robot:| tc08-64B-2t2c-eth-l2bdbasemaclrn-pdrdisc -40ge2p1vic1385-eth-l2bdbasemaclrn-ndrpdrdisc.robot:| tc08-64B-2t2c-eth-l2bdbasemaclrn-pdrdisc + 10ge2p1vic1227-eth-l2bdbasemaclrn-ndrpdrdisc.robot:| tc08-64B-2t2c-eth-l2bdbasemaclrn-pdrdisc + 10ge2p1x520-dot1ad-l2xcbase-ndrpdrdisc.robot:| tc08-64B-2t2c-dot1ad-l2xcbase-pdrdisc + 10ge2p1x520-dot1q-l2xcbase-ndrpdrdisc.robot:| tc08-64B-2t2c-dot1q-l2xcbase-pdrdisc + 10ge2p1x520-eth-l2bdbasemaclrn-ndrpdrdisc.robot:| tc08-64B-2t2c-eth-l2bdbasemaclrn-pdrdisc + 10ge2p1x520-eth-l2xcbase-ndrpdrdisc.robot:| tc08-64B-2t2c-eth-l2xcbase-pdrdisc + 10ge2p1x710-eth-l2bdbasemaclrn-ndrpdrdisc.robot:| tc08-64B-2t2c-eth-l2bdbasemaclrn-pdrdisc + 40ge2p1vic1385-eth-l2bdbasemaclrn-ndrpdrdisc.robot:| tc08-64B-2t2c-eth-l2bdbasemaclrn-pdrdisc diff --git a/resources/tools/report_gen/run_report.sh b/resources/tools/report_gen/run_report.sh index f4e4ee3d78..5c2c1ca1d7 100755 --- a/resources/tools/report_gen/run_report.sh +++ b/resources/tools/report_gen/run_report.sh @@ -238,7 +238,7 @@ sed -i -e "s@###LINK###@${JEN_URL}\/${JEN_JOB}\/${JEN_BUILD[-1]}@g" \ ### FUNCTIONAL SOURCE DATA JEN_JOB='csit-vpp-functional-1704-ubuntu1604-virl' -JEN_BUILD=63 +JEN_BUILD=71 if [[ ${DEBUG} -eq 1 ]] ; then -- cgit 1.2.3-korg