aboutsummaryrefslogtreecommitdiffstats
path: root/docs/report
diff options
context:
space:
mode:
authorTibor Frank <tifrank@cisco.com>2020-07-13 21:15:50 +0200
committerTibor Frank <tifrank@cisco.com>2020-07-13 21:15:50 +0200
commitfaf579e9471ee8bd4e9c20beb40ed526d276b59c (patch)
treea72faeeed0febee9bcede9d80bcbf3cf9e8549d1 /docs/report
parentca585727f655942827ea4db1ae0318485655a109 (diff)
Report: remove wrk tests
Change-Id: Ie3f6ad2e4b5542e915f310c7b9ebeddf88b6fd8a Signed-off-by: Tibor Frank <tifrank@cisco.com>
Diffstat (limited to 'docs/report')
-rw-r--r--docs/report/introduction/methodology_hoststack_testing/index.rst1
-rw-r--r--docs/report/introduction/methodology_hoststack_testing/methodology_http_tcp_with_wrk.rst39
-rw-r--r--docs/report/vpp_performance_tests/hoststack_testing/http_server_performance/index.rst111
3 files changed, 0 insertions, 151 deletions
diff --git a/docs/report/introduction/methodology_hoststack_testing/index.rst b/docs/report/introduction/methodology_hoststack_testing/index.rst
index e7b5b79610..5feb9cccd2 100644
--- a/docs/report/introduction/methodology_hoststack_testing/index.rst
+++ b/docs/report/introduction/methodology_hoststack_testing/index.rst
@@ -3,6 +3,5 @@ Hoststack Testing
.. toctree::
- methodology_http_tcp_with_wrk
methodology_tcp_with_iperf3
methodology_quic_with_vppecho
diff --git a/docs/report/introduction/methodology_hoststack_testing/methodology_http_tcp_with_wrk.rst b/docs/report/introduction/methodology_hoststack_testing/methodology_http_tcp_with_wrk.rst
deleted file mode 100644
index f5da5339a0..0000000000
--- a/docs/report/introduction/methodology_hoststack_testing/methodology_http_tcp_with_wrk.rst
+++ /dev/null
@@ -1,39 +0,0 @@
-HTTP/TCP with WRK
-^^^^^^^^^^^^^^^^^
-
-`WRK HTTP benchmarking tool <https://github.com/wg/wrk>`_ is used for
-TCP/IP and HTTP tests of VPP Host Stack and built-in static HTTP server.
-WRK has been chosen as it is capable of generating significant TCP/IP
-and HTTP loads by scaling number of threads across multi-core processors.
-
-This in turn enables high scale benchmarking of the VPP Host Stack TCP/IP
-and HTTP service including HTTP TCP/IP Connections-Per-Second (CPS) and
-HTTP Requests-Per-Second.
-
-The initial tests are designed as follows:
-
-- HTTP and TCP/IP Connections-Per-Second (CPS)
-
- - WRK configured to use 8 threads across 8 cores, 1 thread per core.
- - Maximum of 50 concurrent connections across all WRK threads.
- - Timeout for server responses set to 5 seconds.
- - Test duration is 30 seconds.
- - Expected HTTP test sequence:
-
- - Single HTTP GET Request sent per open connection.
- - Connection close after valid HTTP reply.
- - Resulting flow sequence - 8 packets: >Syn, <Syn-Ack, >Ack, >Req,
- <Rep, >Fin, <Fin, >Ack.
-
-- HTTP Requests-Per-Second
-
- - WRK configured to use 8 threads across 8 cores, 1 thread per core.
- - Maximum of 50 concurrent connections across all WRK threads.
- - Timeout for server responses set to 5 seconds.
- - Test duration is 30 seconds.
- - Expected HTTP test sequence:
-
- - Multiple HTTP GET Requests sent in sequence per open connection.
- - Connection close after set test duration time.
- - Resulting flow sequence: >Syn, <Syn-Ack, >Ack, >Req[1], <Rep[1],
- .., >Req[n], <Rep[n], >Fin, <Fin, >Ack.
diff --git a/docs/report/vpp_performance_tests/hoststack_testing/http_server_performance/index.rst b/docs/report/vpp_performance_tests/hoststack_testing/http_server_performance/index.rst
deleted file mode 100644
index 52d87239d3..0000000000
--- a/docs/report/vpp_performance_tests/hoststack_testing/http_server_performance/index.rst
+++ /dev/null
@@ -1,111 +0,0 @@
-
-.. raw:: latex
-
- \clearpage
-
-.. raw:: html
-
- <script type="text/javascript">
-
- function getDocHeight(doc) {
- doc = doc || document;
- var body = doc.body, html = doc.documentElement;
- var height = Math.max( body.scrollHeight, body.offsetHeight,
- html.clientHeight, html.scrollHeight, html.offsetHeight );
- return height;
- }
-
- function setIframeHeight(id) {
- var ifrm = document.getElementById(id);
- var doc = ifrm.contentDocument? ifrm.contentDocument:
- ifrm.contentWindow.document;
- ifrm.style.visibility = 'hidden';
- ifrm.style.height = "10px"; // reset to minimal height ...
- // IE opt. for bing/msn needs a bit added or scrollbar appears
- ifrm.style.height = getDocHeight( doc ) + 4 + "px";
- ifrm.style.visibility = 'visible';
- }
-
- </script>
-
-HTTP/TCP with WRK
-~~~~~~~~~~~~~~~~~
-
-Performance graphs are generated by multiple executions of the same
-performance tests across physical testbeds hosted LF FD.io labs: 3n-hsw.
-Box-and-Whisker plots are used to display variations in measured
-throughput values, without making any assumptions of the underlying
-statistical distribution.
-
-For each test case, Box-and-Whisker plots show the quartiles (Min, 1st
-quartile / 25th percentile, 2nd quartile / 50th percentile / mean, 3rd
-quartile / 75th percentile, Max) across collected data set. Outliers are
-plotted as individual points.
-
-Additional information about graph data:
-
-#. **X-axis Labels**: indices of individual test suites as listed in
- Graph Legend.
-
-#. **Y-axis Labels**: measured Connections Per Second [cps] or Requests Per
- Second [rps] throughput values.
-
-#. **Graph Legend**: lists X-axis indices with associated CSIT test
- suites executed to generate graphed test results.
-
-#. **Hover Information**: lists minimum, first quartile, median,
- third quartile, and maximum. If either type of outlier is present the
- whisker on the appropriate side is taken to 1.5×IQR from the quartile
- (the "inner fence") rather than the max or min, and individual outlying
- data points are displayed as unfilled circles (for suspected outliers)
- or filled circles (for outliers). (The "outer fence" is 3×IQR from the
- quartile.)
-
-.. note::
-
- Data sources for reported test results: i) `FD.io test executor vpp
- performance job 2n-clx`_, ii) archived FD.io jobs test result `output files
- <../../_static/archive/>`_.
-
- CSIT source code for the test cases used for plots can be found in
- `CSIT git repository <https://git.fd.io/csit/tree/tests/vpp/perf/tcp?h=rls2001>`_.
-
-.. raw:: latex
-
- \clearpage
-
-Connections per second
-----------------------
-
-.. raw:: html
-
- <iframe id="ifrm01" onload="setIframeHeight(this.id)" width="700" frameborder="0" scrolling="no" src="../../../_static/vpp/http-server-performance-cps.html"></iframe>
-
-.. raw:: latex
-
- \begin{figure}[H]
- \centering
- \graphicspath{{../_build/_static/vpp/}}
- \includegraphics[clip, trim=0cm 0cm 5cm 0cm, width=0.70\textwidth]{http-server-performance-cps}
- \label{fig:http-server-performance-cps}
- \end{figure}
-
-.. raw:: latex
-
- \clearpage
-
-Requests per second
--------------------
-
-.. raw:: html
-
- <iframe id="ifrm02" onload="setIframeHeight(this.id)" width="700" frameborder="0" scrolling="no" src="../../../_static/vpp/http-server-performance-rps.html"></iframe>
-
-.. raw:: latex
-
- \begin{figure}[H]
- \centering
- \graphicspath{{../_build/_static/vpp/}}
- \includegraphics[clip, trim=0cm 0cm 5cm 0cm, width=0.70\textwidth]{http-server-performance-rps}
- \label{fig:http-server-performance-rps}
- \end{figure}