diff options
author | Peter Mikus <pmikus@cisco.com> | 2017-07-03 20:19:11 +0200 |
---|---|---|
committer | Peter Mikus <pmikus@cisco.com> | 2017-07-04 13:51:27 +0000 |
commit | 785519e26196b9e0a5016d0fc54ed099fd0a920f (patch) | |
tree | 1235a2c16c17f5534f3aa0d3574ca96a8a57f00b /docs/report/dpdk_performance_tests/packet_throughput_graphs | |
parent | d166ae0881c29dfd05ed61b9a12156f17981bb6d (diff) |
CSIT-702 Update static content after optimizations
Update the mechanics of script for generating report to reflect the latest changes. Update some static content.
Change-Id: If60f7b74245138cc3044a49c46ff06d5850732de
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Diffstat (limited to 'docs/report/dpdk_performance_tests/packet_throughput_graphs')
3 files changed, 237 insertions, 0 deletions
diff --git a/docs/report/dpdk_performance_tests/packet_throughput_graphs/index.rst b/docs/report/dpdk_performance_tests/packet_throughput_graphs/index.rst new file mode 100644 index 0000000000..140b51964c --- /dev/null +++ b/docs/report/dpdk_performance_tests/packet_throughput_graphs/index.rst @@ -0,0 +1,39 @@ +Packet Throughput Graphs +======================== + +Plotted results are generated by multiple executions of the same CSIT +performance tests across three physical testbeds within LF FD.io labs. +To provide a descriptive summary view, Box-and-Whisker plots are used to +display variation in measured throughput values, without making any +assumptions of the underlying statistical distribution. + +For each plotted test case, Box-and-Whisker plots show the quartiles +(Min, 1st quartile / 25th percentile, 2nd quartile / 50th percentile / +mean, 3rd quartile / 75th percentile, Max) across collected data set +(data set size stated in the note below). Outliers are plotted as +individual points. Min and max values are plotted as bottom and top +Whiskers respectively. 2nd and 3rd quartiles are plotted as bottom and +top edge of the box. If multiple samples match only two values, and all +samples fall between them, then no whiskers are plotted. If all samples +have the same value, only a horizontal line is plotted. + +*Title of each graph* is a regex (regular expression) matching all +throughput test cases plotted on this graph, *X-axis labels* are indices +of individual test suites executed by +`FD.io test executor dpdk performance jobs`_ jobs that created result output +files used as data sources for the graph, *Y-axis labels* are measured Packets +Per Second [pps] values, and the *Graph legend* lists the plotted test suites +and their indices. + +.. note:: + + Test results have been generated by + `FD.io test executor dpdk performance jobs`_ with Robot Framework result + files csit-dpdk-perf-\*.zip `archived here <../../_static/archive/>`_. + Plotted data set size per test case is equal to the number of job executions + presented in this report version: **10**. + +.. toctree:: + + l2 + ipv4 diff --git a/docs/report/dpdk_performance_tests/packet_throughput_graphs/ipv4.rst b/docs/report/dpdk_performance_tests/packet_throughput_graphs/ipv4.rst new file mode 100644 index 0000000000..108944537b --- /dev/null +++ b/docs/report/dpdk_performance_tests/packet_throughput_graphs/ipv4.rst @@ -0,0 +1,95 @@ +IPv4 Routed-Forwarding +====================== + +Following sections include summary graphs ofL3FWD Phy-to-Phy performance with +packet routed forwarding, including NDR throughput (zero packet loss) +and PDR throughput (<0.5% packet loss). Performance is reported for L3FWD +running in multiple configurations of L3FWD pmd thread(s), a.k.a. L3FWD +data plane thread(s), and their physical CPU core(s) placement. + +NDR Throughput +~~~~~~~~~~~~~~ + +Testpmd NDR 64B packet throughput in 1t1c setup (1thread, 1core) is presented +in the graph below. + +.. raw:: html + + <iframe width="700" height="1000" frameborder="0" scrolling="no" src="../../_static/dpdk/64B-1t1c-ipv4-ndrdisc.html"></iframe> + +*Figure 1. L3FWD 1thread 1core - NDR Throughput for Phy-to-Phy IPv4 Routed-Forwarding +Looping.* + +CSIT source code for the test cases used for above plots can be found in CSIT +git repository: + +.. code-block:: bash + + $ $CSIT/tests/dpdk/perf + $ grep -E "64B-1t1c-ethip4-ip4base-l3fwd-ndrdisc" * + + 10ge2p1x520-ethip4-ip4base-l3fwd-ndrpdrdisc.robot:| tc01-64B-1t1c-ethip4-ip4base-l3fwd-ndrdisc + +Testpmd NDR 64B packet throughput in 2t2c setup (2thread, 2core) is presented +in the graph below. + +.. raw:: html + + <iframe width="700" height="1000" frameborder="0" scrolling="no" src="../../_static/dpdk/64B-2t2c-ipv4-ndrdisc.html"></iframe> + +*Figure 2. L3FWD 2threads 2cores - NDR Throughput for Phy-to-Phy IPv4 Routed-Forwarding +Looping.* + +CSIT source code for the test cases used for above plots can be found in CSIT +git repository: + +.. code-block:: bash + + $ $CSIT/tests/dpdk/perf + $ grep -E "64B-2t2c-ethip4-ip4base-l3fwd-ndrdisc" * + + 10ge2p1x520-ethip4-ip4base-l3fwd-ndrpdrdisc.robot:| tc07-64B-2t2c-ethip4-ip4base-l3fwd-ndrdisc + +PDR Throughput +~~~~~~~~~~~~~~ + +L3FWD PDR 64B packet throughput in 1t1c setup (1thread, 1core) is presented +in the graph below. PDR measured for 0.5% packet loss ratio. + +.. raw:: html + + <iframe width="700" height="1000" frameborder="0" scrolling="no" src="../../_static/dpdk/64B-1t1c-ipv4-pdrdisc.html"></iframe> + +*Figure 3. L3FWD 1thread 1core - PDR Throughput for Phy-to-Phy IPv4 Routed-Forwarding +Looping.* + +CSIT source code for the test cases used for above plots can be found in CSIT +git repository: + +.. code-block:: bash + + $ $CSIT/tests/dpdk/perf + $ grep -E "64B-1t1c-ethip4-ip4base-l3fwd-pdrdisc" * + + 10ge2p1x520-ethip4-ip4base-l3fwd-ndrpdrdisc.robot:| tc02-64B-1t1c-ethip4-ip4base-l3fwd-pdrdisc + +L3FWD PDR 64B packet throughput in 2t2c setup (2thread, 2core) is presented +in the graph below. PDR measured for 0.5% packet loss ratio. + +.. raw:: html + + <iframe width="700" height="1000" frameborder="0" scrolling="no" src="../../_static/dpdk/64B-2t2c-ipv4-pdrdisc.html"></iframe> + +*Figure 4. L3FWD 2thread 2core - PDR Throughput for Phy-to-Phy IPv4 Routed-Forwarding +Looping.* + +CSIT source code for the test cases used for above plots can be found in CSIT +git repository: + +.. code-block:: bash + + $ $CSIT/tests/dpdk/perf + $ grep -E "64B-2t2c-ethip4-ip4base-l3fwd-pdrdisc" * + + 10ge2p1x520-ethip4-ip4base-l3fwd-ndrpdrdisc.robot:| tc08-64B-2t2c-ethip4-ip4base-l3fwd-pdrdisc + diff --git a/docs/report/dpdk_performance_tests/packet_throughput_graphs/l2.rst b/docs/report/dpdk_performance_tests/packet_throughput_graphs/l2.rst new file mode 100644 index 0000000000..9a2dc8ad85 --- /dev/null +++ b/docs/report/dpdk_performance_tests/packet_throughput_graphs/l2.rst @@ -0,0 +1,103 @@ +L2 Ethernet Interface Loop +========================== + +Following sections include summary graphs of DPDK Testpmd Phy-to-Phy performance +with L2 Ethernet Interface Loop, including NDR throughput (zero packet loss) +and PDR throughput (<0.5% packet loss). Performance is reported for Testpmd +running in multiple configurations of Testpmd pmd thread(s), a.k.a. Testpmd +data plane thread(s), and their physical CPU core(s) placement. + +NDR Throughput +~~~~~~~~~~~~~~ + +Testpmd NDR 64B packet throughput in 1t1c setup (1thread, 1core) is presented +in the graph below. + +.. raw:: html + + <iframe width="700" height="1000" frameborder="0" scrolling="no" src="../../_static/dpdk/64B-1t1c-l2-ndrdisc.html"></iframe> + +*Figure 1. Testpmd 1thread 1core - NDR Throughput for Phy-to-Phy L2 Ethernet +Looping.* + +CSIT source code for the test cases used for above plots can be found in CSIT +git repository: + +.. code-block:: bash + + $ $CSIT/tests/dpdk/perf + $ grep -E "64B-1t1c-eth-l2xcbase-testpmd-ndrdisc" * + + 10ge2p1x520-eth-l2xcbase-testpmd-ndrpdrdisc.robot:| tc01-64B-1t1c-eth-l2xcbase-testpmd-ndrdisc + 10ge2p1x710-eth-l2xcbase-testpmd-ndrpdrdisc.robot:| tc01-64B-1t1c-eth-l2xcbase-testpmd-ndrdisc + 40ge2p1xl710-eth-l2xcbase-testpmd-ndrpdrdisc.robot:| tc01-64B-1t1c-eth-l2xcbase-testpmd-ndrdisc + +Testpmd NDR 64B packet throughput in 2t2c setup (2thread, 2core) is presented +in the graph below. + +.. raw:: html + + <iframe width="700" height="1000" frameborder="0" scrolling="no" src="../../_static/dpdk/64B-2t2c-l2-ndrdisc.html"></iframe> + +*Figure 2. Testpmd 2threads 2cores - NDR Throughput for Phy-to-Phy L2 Ethernet +Looping.* + +CSIT source code for the test cases used for above plots can be found in CSIT +git repository: + +.. code-block:: bash + + $ $CSIT/tests/dpdk/perf + $ grep -E "64B-2t2c-eth-l2xcbase-testpmd-ndrdisc" * + + 10ge2p1x520-eth-l2xcbase-testpmd-ndrpdrdisc.robot:| tc07-64B-2t2c-eth-l2xcbase-testpmd-ndrdisc + 10ge2p1x710-eth-l2xcbase-testpmd-ndrpdrdisc.robot:| tc07-64B-2t2c-eth-l2xcbase-testpmd-ndrdisc + 40ge2p1xl710-eth-l2xcbase-testpmd-ndrpdrdisc.robot:| tc07-64B-2t2c-eth-l2xcbase-testpmd-ndrdisc + +PDR Throughput +~~~~~~~~~~~~~~ + +Testpmd PDR 64B packet throughput in 1t1c setup (1thread, 1core) is presented +in the graph below. PDR measured for 0.5% packet loss ratio. + +.. raw:: html + + <iframe width="700" height="1000" frameborder="0" scrolling="no" src="../../_static/dpdk/64B-1t1c-l2-pdrdisc.html"></iframe> + +*Figure 3. Testpmd 1thread 1core - PDR Throughput for Phy-to-Phy L2 Ethernet +Looping.* + +CSIT source code for the test cases used for above plots can be found in CSIT +git repository: + +.. code-block:: bash + + $ $CSIT/tests/dpdk/perf + $ grep -E "64B-1t1c-eth-l2xcbase-testpmd-pdrdisc" * + + 10ge2p1x520-eth-l2xcbase-testpmd-ndrpdrdisc.robot:| tc02-64B-1t1c-eth-l2xcbase-testpmd-pdrdisc + 10ge2p1x710-eth-l2xcbase-testpmd-ndrpdrdisc.robot:| tc02-64B-1t1c-eth-l2xcbase-testpmd-pdrdisc + 40ge2p1xl710-eth-l2xcbase-testpmd-ndrpdrdisc.robot:| tc02-64B-1t1c-eth-l2xcbase-testpmd-pdrdisc + +Testpmd PDR 64B packet throughput in 2t2c setup (2thread, 2core) is presented +in the graph below. PDR measured for 0.5% packet loss ratio. + +.. raw:: html + + <iframe width="700" height="1000" frameborder="0" scrolling="no" src="../../_static/dpdk/64B-2t2c-l2-pdrdisc.html"></iframe> + +*Figure 4. Testpmd 2thread 2core - PDR Throughput for Phy-to-Phy L2 Ethernet +Looping.* + +CSIT source code for the test cases used for above plots can be found in CSIT +git repository: + +.. code-block:: bash + + $ $CSIT/tests/dpdk/perf + $ grep -E "64B-2t2c-eth-l2xcbase-testpmd-pdrdisc" * + + 10ge2p1x520-eth-l2xcbase-testpmd-ndrpdrdisc.robot:| tc08-64B-2t2c-eth-l2xcbase-testpmd-pdrdisc + 10ge2p1x710-eth-l2xcbase-testpmd-ndrpdrdisc.robot:| tc08-64B-2t2c-eth-l2xcbase-testpmd-pdrdisc + 40ge2p1xl710-eth-l2xcbase-testpmd-ndrpdrdisc.robot:| tc08-64B-2t2c-eth-l2xcbase-testpmd-pdrdisc + |