diff options
author | Tibor Frank <tifrank@cisco.com> | 2018-02-06 14:16:31 +0100 |
---|---|---|
committer | Tibor Frank <tifrank@cisco.com> | 2018-02-07 13:36:39 +0000 |
commit | b1589042d816ce58648153c20906520916feff49 (patch) | |
tree | 30f43d4fd5549942f28303d59ccdf22643dd07f4 /docs/report | |
parent | c3550796453ef56884755e302aa5e428f7ec8dad (diff) |
CSIT-907: process wrk results in PAL
- CSIT-908: LLD
- CSIT-909: Data model
- CSIT-910: Algorithm
- CSIT-911: Static content
Change-Id: I26b33c2a7e0f320f62c78871576ca400a83b307c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Diffstat (limited to 'docs/report')
3 files changed, 91 insertions, 31 deletions
diff --git a/docs/report/detailed_test_results/vpp_http_server_perf_results/index.rst b/docs/report/detailed_test_results/vpp_http_server_perf_results/index.rst deleted file mode 100644 index a052f2c3aa..0000000000 --- a/docs/report/detailed_test_results/vpp_http_server_perf_results/index.rst +++ /dev/null @@ -1,31 +0,0 @@ -VPP HTTP Server Performance Results -=================================== - -.. note:: - - Data sources for reported test results: i) `FD.io test executor vpp - performance jobs`_, ii) archived FD.io jobs test result `output files - <../../_static/archive/>`_. - -Tests results -------------- - -:: - - ============================================================================== - Connections per second - ============================================================================== - tc01-1t1c-ethip4tcphttp-httpserver-cps 82150 cps - tc02-2t2c-ethip4tcphttp-httpserver-cps 58310 cps - tc03-4t4c-ethip4tcphttp-httpserver-cps 59080 cps - ============================================================================== - -:: - - ============================================================================== - Requests per second - ============================================================================== - tc04-1t1c-ethip4tcphttp-httpserver-rps 97390 rps - tc05-2t2c-ethip4tcphttp-httpserver-rps 162570 rps - tc06-4t4c-ethip4tcphttp-httpserver-rps 189380 rps - ============================================================================== diff --git a/docs/report/vpp_performance_tests/http_server_performance/index.rst b/docs/report/vpp_performance_tests/http_server_performance/index.rst new file mode 100644 index 0000000000..a5faf62af5 --- /dev/null +++ b/docs/report/vpp_performance_tests/http_server_performance/index.rst @@ -0,0 +1,90 @@ +VPP HTTP Server Performance Results +=================================== + +Plotted results are generated by multiple executions of the same CSIT +performance tests across three physical testbeds within LF FD.io labs. +To provide a descriptive summary view, Box-and-Whisker plots are used to +display variation in measured performance values, without making any +assumptions of the underlying statistical distribution. + +For each plotted test case, Box-and-Whisker plots show the quartiles +(Min, 1st quartile / 25th percentile, 2nd quartile / 50th percentile / +mean, 3rd quartile / 75th percentile, Max) across collected data set +(data set size stated in the note below). Outliers are plotted as +individual points. Min and max values are plotted as bottom and top +Whiskers respectively. 2nd and 3rd quartiles are plotted as bottom and +top edge of the box. If multiple samples match only two values, and all +samples fall between them, then no whiskers are plotted. If all samples +have the same value, only a horizontal line is plotted. + +.. note:: + + Data sources for reported test results: i) `FD.io test executor vpp + performance jobs`_, ii) archived FD.io jobs test result `output files + <../../_static/archive/>`_. + +Connections per second +---------------------- + +.. raw:: html + + <iframe width="700" height="1000" frameborder="0" scrolling="no" src="../../_static/vpp/http-server-performance-cps.html"></iframe> + +.. raw:: latex + + \begin{figure}[H] + \centering + \graphicspath{{../_build/_static/vpp/}} + \includegraphics[clip, trim=0cm 8cm 5cm 0cm, width=0.70\textwidth]{http-server-performance-cps} + \label{fig:http-server-performance-cps} + \end{figure} + +*Figure 1. VPP HTTP Server Performance - Connections per Second* + +CSIT source code for the test cases used for above plots can be found in CSIT +git repository: + +.. only:: html + + .. program-output:: cd ../../../../../ && set +x && cd tests/vpp/perf/tcp && grep -E '(1t1c|2t2c|4t4c)-ethip4tcphttp-httpserver-cps' * + :shell: + +.. only:: latex + + .. code-block:: bash + + $ cd tests/vpp/perf/tcp + $ grep -E '(1t1c|2t2c|4t4c)-ethip4tcphttp-httpserver-cps' * + +Requests per second +------------------- + +.. raw:: html + + <iframe width="700" height="1000" frameborder="0" scrolling="no" src="../../_static/vpp/http-server-performance-rps.html"></iframe> + +.. raw:: latex + + \begin{figure}[H] + \centering + \graphicspath{{../_build/_static/vpp/}} + \includegraphics[clip, trim=0cm 8cm 5cm 0cm, width=0.70\textwidth]{http-server-performance-rps} + \label{fig:http-server-performance-rps} + \end{figure} + +*Figure 2. VPP HTTP Server Performance - Requests per Second* + +CSIT source code for the test cases used for above plots can be found in CSIT +git repository: + +.. only:: html + + .. program-output:: cd ../../../../../ && set +x && cd tests/vpp/perf/tcp && grep -E '(1t1c|2t2c|4t4c)-ethip4tcphttp-httpserver-rps' * + :shell: + +.. only:: latex + + .. code-block:: bash + + $ cd tests/vpp/perf/tcp + $ grep -E '(1t1c|2t2c|4t4c)-ethip4tcphttp-httpserver-rps' * diff --git a/docs/report/vpp_performance_tests/index.rst b/docs/report/vpp_performance_tests/index.rst index 971b31d689..085aae93b1 100644 --- a/docs/report/vpp_performance_tests/index.rst +++ b/docs/report/vpp_performance_tests/index.rst @@ -7,6 +7,7 @@ VPP Performance Tests csit_release_notes packet_throughput_graphs/index packet_latency_graphs/index + http_server_performance/index throughput_speedup_multi_core/index test_environment documentation/index |