diff options
author | Tibor Frank <tifrank@cisco.com> | 2019-02-12 10:13:41 +0100 |
---|---|---|
committer | Tibor Frank <tifrank@cisco.com> | 2019-02-12 10:51:52 +0100 |
commit | b21dc3f42eb5cd77277ef44912cdb7c1f0acbff7 (patch) | |
tree | e5fa7ef02cf9ea369c747d0ed4d1297dd8c77b8e /docs/report/vpp_performance_tests | |
parent | 201be740d4dc17a9eea94ee97494929703c8534b (diff) |
Report: Add hover info to graph's descriptions
Change-Id: I39e6b18d73bbd35eda50cdb8191f7762bbe965e5
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Diffstat (limited to 'docs/report/vpp_performance_tests')
8 files changed, 58 insertions, 6 deletions
diff --git a/docs/report/vpp_performance_tests/http_server_performance/index.rst b/docs/report/vpp_performance_tests/http_server_performance/index.rst index e864931e2f..b067042f17 100644 --- a/docs/report/vpp_performance_tests/http_server_performance/index.rst +++ b/docs/report/vpp_performance_tests/http_server_performance/index.rst @@ -42,6 +42,25 @@ quartile / 25th percentile, 2nd quartile / 50th percentile / mean, 3rd quartile / 75th percentile, Max) across collected data set. Outliers are plotted as individual points. +Additional information about graph data: + +#. **X-axis Labels**: indices of individual test suites as listed in + Graph Legend. + +#. **Y-axis Labels**: measured Connections Per Second [cps] or Requests Per + Second [rps] throughput values. + +#. **Graph Legend**: lists X-axis indices with associated CSIT test + suites executed to generate graphed test results. + +#. **Hover Information**: lists minimum, first quartile, median, + third quartile, and maximum. If either type of outlier is present the + whisker on the appropriate side is taken to 1.5×IQR from the quartile + (the "inner fence") rather than the max or min, and individual outlying + data points are displayed as unfilled circles (for suspected outliers) + or filled circles (for outliers). (The "outer fence" is 3×IQR from the + quartile.) + .. note:: Data sources for reported test results: i) `FD.io test executor vpp diff --git a/docs/report/vpp_performance_tests/nf_service_density/cnf_service_chains.rst b/docs/report/vpp_performance_tests/nf_service_density/cnf_service_chains.rst index 56d1782692..32c46a080b 100644 --- a/docs/report/vpp_performance_tests/nf_service_density/cnf_service_chains.rst +++ b/docs/report/vpp_performance_tests/nf_service_density/cnf_service_chains.rst @@ -47,12 +47,12 @@ Additional information about graph data: #. **Y-axis Labels**: number of service chains. -#. **Z-axis Color Scale**: lists 64B Packet Throughput (mean MRR value) +#. **Z-axis Color Scale**: lists 64B Packet Throughput (mean MRR/NDR/PDR value) in Mpps. #. **Hover Information**: specific test substring listing memif-chain-docker_container combinations, number of runs executed, - mean MRR throughput in Mpps, standard deviation. + mean MRR/NDR/PDR throughput in Mpps, standard deviation. .. note:: diff --git a/docs/report/vpp_performance_tests/nf_service_density/cnf_service_pipelines.rst b/docs/report/vpp_performance_tests/nf_service_density/cnf_service_pipelines.rst index dac7ca8413..45d79f4536 100644 --- a/docs/report/vpp_performance_tests/nf_service_density/cnf_service_pipelines.rst +++ b/docs/report/vpp_performance_tests/nf_service_density/cnf_service_pipelines.rst @@ -47,12 +47,12 @@ Additional information about graph data: #. **Y-axis Labels**: number of service pipelines. -#. **Z-axis Color Scale**: lists 64B Packet Throughput (mean MRR value) +#. **Z-axis Color Scale**: lists 64B Packet Throughput (mean MRR/NDR/PDR value) in Mpps. #. **Hover Information**: specific test substring listing memif-pipeline-docker_container combinations, number of runs - executed, mean MRR throughput in Mpps, standard deviation. + executed, mean MRR/NDR/PDR throughput in Mpps, standard deviation. .. note:: diff --git a/docs/report/vpp_performance_tests/nf_service_density/vnf_service_chains.rst b/docs/report/vpp_performance_tests/nf_service_density/vnf_service_chains.rst index 12c9bd4afd..9dba258e86 100644 --- a/docs/report/vpp_performance_tests/nf_service_density/vnf_service_chains.rst +++ b/docs/report/vpp_performance_tests/nf_service_density/vnf_service_chains.rst @@ -47,11 +47,11 @@ Additional information about graph data: #. **Y-axis Labels**: number of service chains. -#. **Z-axis Color Scale**: lists 64B Packet Throughput (mean MRR value) +#. **Z-axis Color Scale**: lists 64B Packet Throughput (mean MRR/NDR/PDR value) in Mpps. #. **Hover Information**: specific test substring listing vhost-chain-vm - combinations, number of runs executed, mean MRR throughput in Mpps, + combinations, number of runs executed, mean MRR/NDR/PDR throughput in Mpps, standard deviation. .. note:: diff --git a/docs/report/vpp_performance_tests/packet_latency_graphs/index.rst b/docs/report/vpp_performance_tests/packet_latency_graphs/index.rst index c6c40d7a7d..912b499327 100644 --- a/docs/report/vpp_performance_tests/packet_latency_graphs/index.rst +++ b/docs/report/vpp_performance_tests/packet_latency_graphs/index.rst @@ -31,6 +31,10 @@ Additional information about graph data: #. **Graph Legend**: lists X-axis indices with associated CSIT test suites executed to generate graphed test results. +#. **Hover Information**: lists number of runs executed, specific test + substring, packet flow direction, maximal, mean and minimal values of + measured latencies. + .. note:: Test results have been generated by diff --git a/docs/report/vpp_performance_tests/packet_throughput_graphs/index.rst b/docs/report/vpp_performance_tests/packet_throughput_graphs/index.rst index 9bc7184ba8..4dea96f575 100644 --- a/docs/report/vpp_performance_tests/packet_throughput_graphs/index.rst +++ b/docs/report/vpp_performance_tests/packet_throughput_graphs/index.rst @@ -35,6 +35,13 @@ Additional information about graph data: #. **Graph Legend**: lists X-axis indices with associated CSIT test suites executed to generate graphed test results. +#. **Hover Information**: lists minimum, first quartile, median, + third quartile, and maximum. If either type of outlier is present the + whisker on the appropriate side is taken to 1.5×IQR from the quartile + (the "inner fence") rather than the max or min, and individual outlying + data points are displayed as unfilled circles (for suspected outliers) + or filled circles (for outliers). (The "outer fence" is 3×IQR from the + quartile.) .. note:: diff --git a/docs/report/vpp_performance_tests/soak_tests/index.rst b/docs/report/vpp_performance_tests/soak_tests/index.rst index 9cf502a62d..95ff414a62 100644 --- a/docs/report/vpp_performance_tests/soak_tests/index.rst +++ b/docs/report/vpp_performance_tests/soak_tests/index.rst @@ -46,6 +46,9 @@ Additional information about graph data: #. **Graph Legend**: list of X-axis indices with CSIT test suites. +#. **Hover Information**: lists the lower and upper bounds of measured + throughput. + .. note:: Test results have been generated by diff --git a/docs/report/vpp_performance_tests/throughput_speedup_multi_core/index.rst b/docs/report/vpp_performance_tests/throughput_speedup_multi_core/index.rst index b6feb2b8a6..b3504010f3 100644 --- a/docs/report/vpp_performance_tests/throughput_speedup_multi_core/index.rst +++ b/docs/report/vpp_performance_tests/throughput_speedup_multi_core/index.rst @@ -14,6 +14,25 @@ LF FD.io labs: 3n-hsw, 2n-skx, 2n-skx. Grouped bars illustrate the 64B/78B packet throughput speedup ratio for 2- and 4-core multi- threaded VPP configurations relative to 1-core configurations. +Additional information about graph data: + +#. **Graph Title**: describes tested packet path, testbed topology, + processor model, NIC model, packet size used by data plane workers and + indication of VPP DUT configuration. + +#. **X-axis Labels**: number of cores. + +#. **Y-axis Labels**: measured Packets Per Second [pps] throughput + values. + +#. **Graph Legend**: lists CSIT test suites executed to generate graphed test + results. + +#. **Hover Information**: lists number of runs executed, specific test + substring, mean value of the measured packet throughput, calculated perfect + throughput value, difference between measured and perfect values and + relative speedup value. + .. note:: Test results have been generated by |