From faf579e9471ee8bd4e9c20beb40ed526d276b59c Mon Sep 17 00:00:00 2001 From: Tibor Frank Date: Mon, 13 Jul 2020 21:15:50 +0200 Subject: Report: remove wrk tests Change-Id: Ie3f6ad2e4b5542e915f310c7b9ebeddf88b6fd8a Signed-off-by: Tibor Frank --- .../methodology_hoststack_testing/index.rst | 1 - .../methodology_http_tcp_with_wrk.rst | 39 -------- .../http_server_performance/index.rst | 111 --------------------- 3 files changed, 151 deletions(-) delete mode 100644 docs/report/introduction/methodology_hoststack_testing/methodology_http_tcp_with_wrk.rst delete mode 100644 docs/report/vpp_performance_tests/hoststack_testing/http_server_performance/index.rst (limited to 'docs') diff --git a/docs/report/introduction/methodology_hoststack_testing/index.rst b/docs/report/introduction/methodology_hoststack_testing/index.rst index e7b5b79610..5feb9cccd2 100644 --- a/docs/report/introduction/methodology_hoststack_testing/index.rst +++ b/docs/report/introduction/methodology_hoststack_testing/index.rst @@ -3,6 +3,5 @@ Hoststack Testing .. toctree:: - methodology_http_tcp_with_wrk methodology_tcp_with_iperf3 methodology_quic_with_vppecho diff --git a/docs/report/introduction/methodology_hoststack_testing/methodology_http_tcp_with_wrk.rst b/docs/report/introduction/methodology_hoststack_testing/methodology_http_tcp_with_wrk.rst deleted file mode 100644 index f5da5339a0..0000000000 --- a/docs/report/introduction/methodology_hoststack_testing/methodology_http_tcp_with_wrk.rst +++ /dev/null @@ -1,39 +0,0 @@ -HTTP/TCP with WRK -^^^^^^^^^^^^^^^^^ - -`WRK HTTP benchmarking tool `_ is used for -TCP/IP and HTTP tests of VPP Host Stack and built-in static HTTP server. -WRK has been chosen as it is capable of generating significant TCP/IP -and HTTP loads by scaling number of threads across multi-core processors. - -This in turn enables high scale benchmarking of the VPP Host Stack TCP/IP -and HTTP service including HTTP TCP/IP Connections-Per-Second (CPS) and -HTTP Requests-Per-Second. - -The initial tests are designed as follows: - -- HTTP and TCP/IP Connections-Per-Second (CPS) - - - WRK configured to use 8 threads across 8 cores, 1 thread per core. - - Maximum of 50 concurrent connections across all WRK threads. - - Timeout for server responses set to 5 seconds. - - Test duration is 30 seconds. - - Expected HTTP test sequence: - - - Single HTTP GET Request sent per open connection. - - Connection close after valid HTTP reply. - - Resulting flow sequence - 8 packets: >Syn, Ack, >Req, - Fin, Ack. - -- HTTP Requests-Per-Second - - - WRK configured to use 8 threads across 8 cores, 1 thread per core. - - Maximum of 50 concurrent connections across all WRK threads. - - Timeout for server responses set to 5 seconds. - - Test duration is 30 seconds. - - Expected HTTP test sequence: - - - Multiple HTTP GET Requests sent in sequence per open connection. - - Connection close after set test duration time. - - Resulting flow sequence: >Syn, Ack, >Req[1], Req[n], Fin, Ack. diff --git a/docs/report/vpp_performance_tests/hoststack_testing/http_server_performance/index.rst b/docs/report/vpp_performance_tests/hoststack_testing/http_server_performance/index.rst deleted file mode 100644 index 52d87239d3..0000000000 --- a/docs/report/vpp_performance_tests/hoststack_testing/http_server_performance/index.rst +++ /dev/null @@ -1,111 +0,0 @@ - -.. raw:: latex - - \clearpage - -.. raw:: html - - - -HTTP/TCP with WRK -~~~~~~~~~~~~~~~~~ - -Performance graphs are generated by multiple executions of the same -performance tests across physical testbeds hosted LF FD.io labs: 3n-hsw. -Box-and-Whisker plots are used to display variations in measured -throughput values, without making any assumptions of the underlying -statistical distribution. - -For each test case, Box-and-Whisker plots show the quartiles (Min, 1st -quartile / 25th percentile, 2nd quartile / 50th percentile / mean, 3rd -quartile / 75th percentile, Max) across collected data set. Outliers are -plotted as individual points. - -Additional information about graph data: - -#. **X-axis Labels**: indices of individual test suites as listed in - Graph Legend. - -#. **Y-axis Labels**: measured Connections Per Second [cps] or Requests Per - Second [rps] throughput values. - -#. **Graph Legend**: lists X-axis indices with associated CSIT test - suites executed to generate graphed test results. - -#. **Hover Information**: lists minimum, first quartile, median, - third quartile, and maximum. If either type of outlier is present the - whisker on the appropriate side is taken to 1.5×IQR from the quartile - (the "inner fence") rather than the max or min, and individual outlying - data points are displayed as unfilled circles (for suspected outliers) - or filled circles (for outliers). (The "outer fence" is 3×IQR from the - quartile.) - -.. note:: - - Data sources for reported test results: i) `FD.io test executor vpp - performance job 2n-clx`_, ii) archived FD.io jobs test result `output files - <../../_static/archive/>`_. - - CSIT source code for the test cases used for plots can be found in - `CSIT git repository `_. - -.. raw:: latex - - \clearpage - -Connections per second ----------------------- - -.. raw:: html - - - -.. raw:: latex - - \begin{figure}[H] - \centering - \graphicspath{{../_build/_static/vpp/}} - \includegraphics[clip, trim=0cm 0cm 5cm 0cm, width=0.70\textwidth]{http-server-performance-cps} - \label{fig:http-server-performance-cps} - \end{figure} - -.. raw:: latex - - \clearpage - -Requests per second -------------------- - -.. raw:: html - - - -.. raw:: latex - - \begin{figure}[H] - \centering - \graphicspath{{../_build/_static/vpp/}} - \includegraphics[clip, trim=0cm 0cm 5cm 0cm, width=0.70\textwidth]{http-server-performance-rps} - \label{fig:http-server-performance-rps} - \end{figure} -- cgit 1.2.3-korg