From 107438e93a51eefc61dc171cfa9b959007ccc739 Mon Sep 17 00:00:00 2001 From: Tibor Frank Date: Thu, 30 Jan 2020 09:10:38 +0100 Subject: Report: Placeholder for LD preload tests - methodology - test results Change-Id: I0d102875045ab295d9b44fa7bc328f2a728803d7 Signed-off-by: Tibor Frank Signed-off-by: Dave Wallace --- .../http_server_performance/index.rst | 111 +++++++++++++++++++++ .../hoststack_testing/index.rst | 8 ++ .../hoststack_testing/iperf3/index.rst | 2 + .../hoststack_testing/quic/index.rst | 2 + .../http_server_performance/index.rst | 111 --------------------- docs/report/vpp_performance_tests/index.rst | 1 + 6 files changed, 124 insertions(+), 111 deletions(-) create mode 100644 docs/report/vpp_performance_tests/hoststack_testing/http_server_performance/index.rst create mode 100644 docs/report/vpp_performance_tests/hoststack_testing/index.rst create mode 100644 docs/report/vpp_performance_tests/hoststack_testing/iperf3/index.rst create mode 100644 docs/report/vpp_performance_tests/hoststack_testing/quic/index.rst delete mode 100644 docs/report/vpp_performance_tests/http_server_performance/index.rst (limited to 'docs/report/vpp_performance_tests') diff --git a/docs/report/vpp_performance_tests/hoststack_testing/http_server_performance/index.rst b/docs/report/vpp_performance_tests/hoststack_testing/http_server_performance/index.rst new file mode 100644 index 0000000000..412ff6af63 --- /dev/null +++ b/docs/report/vpp_performance_tests/hoststack_testing/http_server_performance/index.rst @@ -0,0 +1,111 @@ + +.. raw:: latex + + \clearpage + +.. raw:: html + + + +HTTP and TCP/IP +=============== + +Performance graphs are generated by multiple executions of the same +performance tests across physical testbeds hosted LF FD.io labs: 3n-hsw. +Box-and-Whisker plots are used to display variations in measured +throughput values, without making any assumptions of the underlying +statistical distribution. + +For each test case, Box-and-Whisker plots show the quartiles (Min, 1st +quartile / 25th percentile, 2nd quartile / 50th percentile / mean, 3rd +quartile / 75th percentile, Max) across collected data set. Outliers are +plotted as individual points. + +Additional information about graph data: + +#. **X-axis Labels**: indices of individual test suites as listed in + Graph Legend. + +#. **Y-axis Labels**: measured Connections Per Second [cps] or Requests Per + Second [rps] throughput values. + +#. **Graph Legend**: lists X-axis indices with associated CSIT test + suites executed to generate graphed test results. + +#. **Hover Information**: lists minimum, first quartile, median, + third quartile, and maximum. If either type of outlier is present the + whisker on the appropriate side is taken to 1.5×IQR from the quartile + (the "inner fence") rather than the max or min, and individual outlying + data points are displayed as unfilled circles (for suspected outliers) + or filled circles (for outliers). (The "outer fence" is 3×IQR from the + quartile.) + +.. note:: + + Data sources for reported test results: i) `FD.io test executor vpp + performance job 2n-skx`_, ii) archived FD.io jobs test result `output files + <../../_static/archive/>`_. + + CSIT source code for the test cases used for plots can be found in + `CSIT git repository `_. + +.. raw:: latex + + \clearpage + +Connections per second +---------------------- + +.. raw:: html + + + +.. raw:: latex + + \begin{figure}[H] + \centering + \graphicspath{{../_build/_static/vpp/}} + \includegraphics[clip, trim=0cm 0cm 5cm 0cm, width=0.70\textwidth]{http-server-performance-cps} + \label{fig:http-server-performance-cps} + \end{figure} + +.. raw:: latex + + \clearpage + +Requests per second +------------------- + +.. raw:: html + + + +.. raw:: latex + + \begin{figure}[H] + \centering + \graphicspath{{../_build/_static/vpp/}} + \includegraphics[clip, trim=0cm 0cm 5cm 0cm, width=0.70\textwidth]{http-server-performance-rps} + \label{fig:http-server-performance-rps} + \end{figure} diff --git a/docs/report/vpp_performance_tests/hoststack_testing/index.rst b/docs/report/vpp_performance_tests/hoststack_testing/index.rst new file mode 100644 index 0000000000..e6da504128 --- /dev/null +++ b/docs/report/vpp_performance_tests/hoststack_testing/index.rst @@ -0,0 +1,8 @@ +Hoststack Testing +================= + +.. toctree:: + + http_server_performance/index + iperf3/index + quic/index diff --git a/docs/report/vpp_performance_tests/hoststack_testing/iperf3/index.rst b/docs/report/vpp_performance_tests/hoststack_testing/iperf3/index.rst new file mode 100644 index 0000000000..85d120c31c --- /dev/null +++ b/docs/report/vpp_performance_tests/hoststack_testing/iperf3/index.rst @@ -0,0 +1,2 @@ +Hoststack Throughput Testing over TCP/IP with iperf3 +---------------------------------------------------- diff --git a/docs/report/vpp_performance_tests/hoststack_testing/quic/index.rst b/docs/report/vpp_performance_tests/hoststack_testing/quic/index.rst new file mode 100644 index 0000000000..c1ec15bd6f --- /dev/null +++ b/docs/report/vpp_performance_tests/hoststack_testing/quic/index.rst @@ -0,0 +1,2 @@ +Hoststack Throughput Testing over QUIC(picotls)/UDP/IP with vpp_echo +-------------------------------------------------------------------- diff --git a/docs/report/vpp_performance_tests/http_server_performance/index.rst b/docs/report/vpp_performance_tests/http_server_performance/index.rst deleted file mode 100644 index 412ff6af63..0000000000 --- a/docs/report/vpp_performance_tests/http_server_performance/index.rst +++ /dev/null @@ -1,111 +0,0 @@ - -.. raw:: latex - - \clearpage - -.. raw:: html - - - -HTTP and TCP/IP -=============== - -Performance graphs are generated by multiple executions of the same -performance tests across physical testbeds hosted LF FD.io labs: 3n-hsw. -Box-and-Whisker plots are used to display variations in measured -throughput values, without making any assumptions of the underlying -statistical distribution. - -For each test case, Box-and-Whisker plots show the quartiles (Min, 1st -quartile / 25th percentile, 2nd quartile / 50th percentile / mean, 3rd -quartile / 75th percentile, Max) across collected data set. Outliers are -plotted as individual points. - -Additional information about graph data: - -#. **X-axis Labels**: indices of individual test suites as listed in - Graph Legend. - -#. **Y-axis Labels**: measured Connections Per Second [cps] or Requests Per - Second [rps] throughput values. - -#. **Graph Legend**: lists X-axis indices with associated CSIT test - suites executed to generate graphed test results. - -#. **Hover Information**: lists minimum, first quartile, median, - third quartile, and maximum. If either type of outlier is present the - whisker on the appropriate side is taken to 1.5×IQR from the quartile - (the "inner fence") rather than the max or min, and individual outlying - data points are displayed as unfilled circles (for suspected outliers) - or filled circles (for outliers). (The "outer fence" is 3×IQR from the - quartile.) - -.. note:: - - Data sources for reported test results: i) `FD.io test executor vpp - performance job 2n-skx`_, ii) archived FD.io jobs test result `output files - <../../_static/archive/>`_. - - CSIT source code for the test cases used for plots can be found in - `CSIT git repository `_. - -.. raw:: latex - - \clearpage - -Connections per second ----------------------- - -.. raw:: html - - - -.. raw:: latex - - \begin{figure}[H] - \centering - \graphicspath{{../_build/_static/vpp/}} - \includegraphics[clip, trim=0cm 0cm 5cm 0cm, width=0.70\textwidth]{http-server-performance-cps} - \label{fig:http-server-performance-cps} - \end{figure} - -.. raw:: latex - - \clearpage - -Requests per second -------------------- - -.. raw:: html - - - -.. raw:: latex - - \begin{figure}[H] - \centering - \graphicspath{{../_build/_static/vpp/}} - \includegraphics[clip, trim=0cm 0cm 5cm 0cm, width=0.70\textwidth]{http-server-performance-rps} - \label{fig:http-server-performance-rps} - \end{figure} diff --git a/docs/report/vpp_performance_tests/index.rst b/docs/report/vpp_performance_tests/index.rst index beb4dce988..042ee4fc24 100644 --- a/docs/report/vpp_performance_tests/index.rst +++ b/docs/report/vpp_performance_tests/index.rst @@ -13,6 +13,7 @@ VPP Performance soak_tests/index reconf_tests/index nf_service_density/index + hoststack_testing/index http_server_performance/index comparisons/index throughput_trending -- cgit 1.2.3-korg