diff options
author | Tibor Frank <tifrank@cisco.com> | 2020-07-13 21:15:50 +0200 |
---|---|---|
committer | Tibor Frank <tifrank@cisco.com> | 2020-07-13 21:15:50 +0200 |
commit | faf579e9471ee8bd4e9c20beb40ed526d276b59c (patch) | |
tree | a72faeeed0febee9bcede9d80bcbf3cf9e8549d1 /docs/report | |
parent | ca585727f655942827ea4db1ae0318485655a109 (diff) |
Report: remove wrk tests
Change-Id: Ie3f6ad2e4b5542e915f310c7b9ebeddf88b6fd8a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Diffstat (limited to 'docs/report')
3 files changed, 0 insertions, 151 deletions
diff --git a/docs/report/introduction/methodology_hoststack_testing/index.rst b/docs/report/introduction/methodology_hoststack_testing/index.rst index e7b5b79610..5feb9cccd2 100644 --- a/docs/report/introduction/methodology_hoststack_testing/index.rst +++ b/docs/report/introduction/methodology_hoststack_testing/index.rst @@ -3,6 +3,5 @@ Hoststack Testing .. toctree:: - methodology_http_tcp_with_wrk methodology_tcp_with_iperf3 methodology_quic_with_vppecho diff --git a/docs/report/introduction/methodology_hoststack_testing/methodology_http_tcp_with_wrk.rst b/docs/report/introduction/methodology_hoststack_testing/methodology_http_tcp_with_wrk.rst deleted file mode 100644 index f5da5339a0..0000000000 --- a/docs/report/introduction/methodology_hoststack_testing/methodology_http_tcp_with_wrk.rst +++ /dev/null @@ -1,39 +0,0 @@ -HTTP/TCP with WRK -^^^^^^^^^^^^^^^^^ - -`WRK HTTP benchmarking tool <https://github.com/wg/wrk>`_ is used for -TCP/IP and HTTP tests of VPP Host Stack and built-in static HTTP server. -WRK has been chosen as it is capable of generating significant TCP/IP -and HTTP loads by scaling number of threads across multi-core processors. - -This in turn enables high scale benchmarking of the VPP Host Stack TCP/IP -and HTTP service including HTTP TCP/IP Connections-Per-Second (CPS) and -HTTP Requests-Per-Second. - -The initial tests are designed as follows: - -- HTTP and TCP/IP Connections-Per-Second (CPS) - - - WRK configured to use 8 threads across 8 cores, 1 thread per core. - - Maximum of 50 concurrent connections across all WRK threads. - - Timeout for server responses set to 5 seconds. - - Test duration is 30 seconds. - - Expected HTTP test sequence: - - - Single HTTP GET Request sent per open connection. - - Connection close after valid HTTP reply. - - Resulting flow sequence - 8 packets: >Syn, <Syn-Ack, >Ack, >Req, - <Rep, >Fin, <Fin, >Ack. - -- HTTP Requests-Per-Second - - - WRK configured to use 8 threads across 8 cores, 1 thread per core. - - Maximum of 50 concurrent connections across all WRK threads. - - Timeout for server responses set to 5 seconds. - - Test duration is 30 seconds. - - Expected HTTP test sequence: - - - Multiple HTTP GET Requests sent in sequence per open connection. - - Connection close after set test duration time. - - Resulting flow sequence: >Syn, <Syn-Ack, >Ack, >Req[1], <Rep[1], - .., >Req[n], <Rep[n], >Fin, <Fin, >Ack. diff --git a/docs/report/vpp_performance_tests/hoststack_testing/http_server_performance/index.rst b/docs/report/vpp_performance_tests/hoststack_testing/http_server_performance/index.rst deleted file mode 100644 index 52d87239d3..0000000000 --- a/docs/report/vpp_performance_tests/hoststack_testing/http_server_performance/index.rst +++ /dev/null @@ -1,111 +0,0 @@ - -.. raw:: latex - - \clearpage - -.. raw:: html - - <script type="text/javascript"> - - function getDocHeight(doc) { - doc = doc || document; - var body = doc.body, html = doc.documentElement; - var height = Math.max( body.scrollHeight, body.offsetHeight, - html.clientHeight, html.scrollHeight, html.offsetHeight ); - return height; - } - - function setIframeHeight(id) { - var ifrm = document.getElementById(id); - var doc = ifrm.contentDocument? ifrm.contentDocument: - ifrm.contentWindow.document; - ifrm.style.visibility = 'hidden'; - ifrm.style.height = "10px"; // reset to minimal height ... - // IE opt. for bing/msn needs a bit added or scrollbar appears - ifrm.style.height = getDocHeight( doc ) + 4 + "px"; - ifrm.style.visibility = 'visible'; - } - - </script> - -HTTP/TCP with WRK -~~~~~~~~~~~~~~~~~ - -Performance graphs are generated by multiple executions of the same -performance tests across physical testbeds hosted LF FD.io labs: 3n-hsw. -Box-and-Whisker plots are used to display variations in measured -throughput values, without making any assumptions of the underlying -statistical distribution. - -For each test case, Box-and-Whisker plots show the quartiles (Min, 1st -quartile / 25th percentile, 2nd quartile / 50th percentile / mean, 3rd -quartile / 75th percentile, Max) across collected data set. Outliers are -plotted as individual points. - -Additional information about graph data: - -#. **X-axis Labels**: indices of individual test suites as listed in - Graph Legend. - -#. **Y-axis Labels**: measured Connections Per Second [cps] or Requests Per - Second [rps] throughput values. - -#. **Graph Legend**: lists X-axis indices with associated CSIT test - suites executed to generate graphed test results. - -#. **Hover Information**: lists minimum, first quartile, median, - third quartile, and maximum. If either type of outlier is present the - whisker on the appropriate side is taken to 1.5×IQR from the quartile - (the "inner fence") rather than the max or min, and individual outlying - data points are displayed as unfilled circles (for suspected outliers) - or filled circles (for outliers). (The "outer fence" is 3×IQR from the - quartile.) - -.. note:: - - Data sources for reported test results: i) `FD.io test executor vpp - performance job 2n-clx`_, ii) archived FD.io jobs test result `output files - <../../_static/archive/>`_. - - CSIT source code for the test cases used for plots can be found in - `CSIT git repository <https://git.fd.io/csit/tree/tests/vpp/perf/tcp?h=rls2001>`_. - -.. raw:: latex - - \clearpage - -Connections per second ----------------------- - -.. raw:: html - - <iframe id="ifrm01" onload="setIframeHeight(this.id)" width="700" frameborder="0" scrolling="no" src="../../../_static/vpp/http-server-performance-cps.html"></iframe> - -.. raw:: latex - - \begin{figure}[H] - \centering - \graphicspath{{../_build/_static/vpp/}} - \includegraphics[clip, trim=0cm 0cm 5cm 0cm, width=0.70\textwidth]{http-server-performance-cps} - \label{fig:http-server-performance-cps} - \end{figure} - -.. raw:: latex - - \clearpage - -Requests per second -------------------- - -.. raw:: html - - <iframe id="ifrm02" onload="setIframeHeight(this.id)" width="700" frameborder="0" scrolling="no" src="../../../_static/vpp/http-server-performance-rps.html"></iframe> - -.. raw:: latex - - \begin{figure}[H] - \centering - \graphicspath{{../_build/_static/vpp/}} - \includegraphics[clip, trim=0cm 0cm 5cm 0cm, width=0.70\textwidth]{http-server-performance-rps} - \label{fig:http-server-performance-rps} - \end{figure} |