aboutsummaryrefslogtreecommitdiffstats
path: root/docs/report/vpp_performance_tests
diff options
context:
space:
mode:
authorTibor Frank <tifrank@cisco.com>2019-02-12 10:13:41 +0100
committerTibor Frank <tifrank@cisco.com>2019-02-12 10:51:52 +0100
commitb21dc3f42eb5cd77277ef44912cdb7c1f0acbff7 (patch)
treee5fa7ef02cf9ea369c747d0ed4d1297dd8c77b8e /docs/report/vpp_performance_tests
parent201be740d4dc17a9eea94ee97494929703c8534b (diff)
Report: Add hover info to graph's descriptions
Change-Id: I39e6b18d73bbd35eda50cdb8191f7762bbe965e5 Signed-off-by: Tibor Frank <tifrank@cisco.com>
Diffstat (limited to 'docs/report/vpp_performance_tests')
-rw-r--r--docs/report/vpp_performance_tests/http_server_performance/index.rst19
-rw-r--r--docs/report/vpp_performance_tests/nf_service_density/cnf_service_chains.rst4
-rw-r--r--docs/report/vpp_performance_tests/nf_service_density/cnf_service_pipelines.rst4
-rw-r--r--docs/report/vpp_performance_tests/nf_service_density/vnf_service_chains.rst4
-rw-r--r--docs/report/vpp_performance_tests/packet_latency_graphs/index.rst4
-rw-r--r--docs/report/vpp_performance_tests/packet_throughput_graphs/index.rst7
-rw-r--r--docs/report/vpp_performance_tests/soak_tests/index.rst3
-rw-r--r--docs/report/vpp_performance_tests/throughput_speedup_multi_core/index.rst19
8 files changed, 58 insertions, 6 deletions
diff --git a/docs/report/vpp_performance_tests/http_server_performance/index.rst b/docs/report/vpp_performance_tests/http_server_performance/index.rst
index e864931e2f..b067042f17 100644
--- a/docs/report/vpp_performance_tests/http_server_performance/index.rst
+++ b/docs/report/vpp_performance_tests/http_server_performance/index.rst
@@ -42,6 +42,25 @@ quartile / 25th percentile, 2nd quartile / 50th percentile / mean, 3rd
quartile / 75th percentile, Max) across collected data set. Outliers are
plotted as individual points.
+Additional information about graph data:
+
+#. **X-axis Labels**: indices of individual test suites as listed in
+ Graph Legend.
+
+#. **Y-axis Labels**: measured Connections Per Second [cps] or Requests Per
+ Second [rps] throughput values.
+
+#. **Graph Legend**: lists X-axis indices with associated CSIT test
+ suites executed to generate graphed test results.
+
+#. **Hover Information**: lists minimum, first quartile, median,
+ third quartile, and maximum. If either type of outlier is present the
+ whisker on the appropriate side is taken to 1.5×IQR from the quartile
+ (the "inner fence") rather than the max or min, and individual outlying
+ data points are displayed as unfilled circles (for suspected outliers)
+ or filled circles (for outliers). (The "outer fence" is 3×IQR from the
+ quartile.)
+
.. note::
Data sources for reported test results: i) `FD.io test executor vpp
diff --git a/docs/report/vpp_performance_tests/nf_service_density/cnf_service_chains.rst b/docs/report/vpp_performance_tests/nf_service_density/cnf_service_chains.rst
index 56d1782692..32c46a080b 100644
--- a/docs/report/vpp_performance_tests/nf_service_density/cnf_service_chains.rst
+++ b/docs/report/vpp_performance_tests/nf_service_density/cnf_service_chains.rst
@@ -47,12 +47,12 @@ Additional information about graph data:
#. **Y-axis Labels**: number of service chains.
-#. **Z-axis Color Scale**: lists 64B Packet Throughput (mean MRR value)
+#. **Z-axis Color Scale**: lists 64B Packet Throughput (mean MRR/NDR/PDR value)
in Mpps.
#. **Hover Information**: specific test substring listing
memif-chain-docker_container combinations, number of runs executed,
- mean MRR throughput in Mpps, standard deviation.
+ mean MRR/NDR/PDR throughput in Mpps, standard deviation.
.. note::
diff --git a/docs/report/vpp_performance_tests/nf_service_density/cnf_service_pipelines.rst b/docs/report/vpp_performance_tests/nf_service_density/cnf_service_pipelines.rst
index dac7ca8413..45d79f4536 100644
--- a/docs/report/vpp_performance_tests/nf_service_density/cnf_service_pipelines.rst
+++ b/docs/report/vpp_performance_tests/nf_service_density/cnf_service_pipelines.rst
@@ -47,12 +47,12 @@ Additional information about graph data:
#. **Y-axis Labels**: number of service pipelines.
-#. **Z-axis Color Scale**: lists 64B Packet Throughput (mean MRR value)
+#. **Z-axis Color Scale**: lists 64B Packet Throughput (mean MRR/NDR/PDR value)
in Mpps.
#. **Hover Information**: specific test substring listing
memif-pipeline-docker_container combinations, number of runs
- executed, mean MRR throughput in Mpps, standard deviation.
+ executed, mean MRR/NDR/PDR throughput in Mpps, standard deviation.
.. note::
diff --git a/docs/report/vpp_performance_tests/nf_service_density/vnf_service_chains.rst b/docs/report/vpp_performance_tests/nf_service_density/vnf_service_chains.rst
index 12c9bd4afd..9dba258e86 100644
--- a/docs/report/vpp_performance_tests/nf_service_density/vnf_service_chains.rst
+++ b/docs/report/vpp_performance_tests/nf_service_density/vnf_service_chains.rst
@@ -47,11 +47,11 @@ Additional information about graph data:
#. **Y-axis Labels**: number of service chains.
-#. **Z-axis Color Scale**: lists 64B Packet Throughput (mean MRR value)
+#. **Z-axis Color Scale**: lists 64B Packet Throughput (mean MRR/NDR/PDR value)
in Mpps.
#. **Hover Information**: specific test substring listing vhost-chain-vm
- combinations, number of runs executed, mean MRR throughput in Mpps,
+ combinations, number of runs executed, mean MRR/NDR/PDR throughput in Mpps,
standard deviation.
.. note::
diff --git a/docs/report/vpp_performance_tests/packet_latency_graphs/index.rst b/docs/report/vpp_performance_tests/packet_latency_graphs/index.rst
index c6c40d7a7d..912b499327 100644
--- a/docs/report/vpp_performance_tests/packet_latency_graphs/index.rst
+++ b/docs/report/vpp_performance_tests/packet_latency_graphs/index.rst
@@ -31,6 +31,10 @@ Additional information about graph data:
#. **Graph Legend**: lists X-axis indices with associated CSIT test
suites executed to generate graphed test results.
+#. **Hover Information**: lists number of runs executed, specific test
+ substring, packet flow direction, maximal, mean and minimal values of
+ measured latencies.
+
.. note::
Test results have been generated by
diff --git a/docs/report/vpp_performance_tests/packet_throughput_graphs/index.rst b/docs/report/vpp_performance_tests/packet_throughput_graphs/index.rst
index 9bc7184ba8..4dea96f575 100644
--- a/docs/report/vpp_performance_tests/packet_throughput_graphs/index.rst
+++ b/docs/report/vpp_performance_tests/packet_throughput_graphs/index.rst
@@ -35,6 +35,13 @@ Additional information about graph data:
#. **Graph Legend**: lists X-axis indices with associated CSIT test
suites executed to generate graphed test results.
+#. **Hover Information**: lists minimum, first quartile, median,
+ third quartile, and maximum. If either type of outlier is present the
+ whisker on the appropriate side is taken to 1.5×IQR from the quartile
+ (the "inner fence") rather than the max or min, and individual outlying
+ data points are displayed as unfilled circles (for suspected outliers)
+ or filled circles (for outliers). (The "outer fence" is 3×IQR from the
+ quartile.)
.. note::
diff --git a/docs/report/vpp_performance_tests/soak_tests/index.rst b/docs/report/vpp_performance_tests/soak_tests/index.rst
index 9cf502a62d..95ff414a62 100644
--- a/docs/report/vpp_performance_tests/soak_tests/index.rst
+++ b/docs/report/vpp_performance_tests/soak_tests/index.rst
@@ -46,6 +46,9 @@ Additional information about graph data:
#. **Graph Legend**: list of X-axis indices with CSIT test suites.
+#. **Hover Information**: lists the lower and upper bounds of measured
+ throughput.
+
.. note::
Test results have been generated by
diff --git a/docs/report/vpp_performance_tests/throughput_speedup_multi_core/index.rst b/docs/report/vpp_performance_tests/throughput_speedup_multi_core/index.rst
index b6feb2b8a6..b3504010f3 100644
--- a/docs/report/vpp_performance_tests/throughput_speedup_multi_core/index.rst
+++ b/docs/report/vpp_performance_tests/throughput_speedup_multi_core/index.rst
@@ -14,6 +14,25 @@ LF FD.io labs: 3n-hsw, 2n-skx, 2n-skx. Grouped bars illustrate the
64B/78B packet throughput speedup ratio for 2- and 4-core multi-
threaded VPP configurations relative to 1-core configurations.
+Additional information about graph data:
+
+#. **Graph Title**: describes tested packet path, testbed topology,
+ processor model, NIC model, packet size used by data plane workers and
+ indication of VPP DUT configuration.
+
+#. **X-axis Labels**: number of cores.
+
+#. **Y-axis Labels**: measured Packets Per Second [pps] throughput
+ values.
+
+#. **Graph Legend**: lists CSIT test suites executed to generate graphed test
+ results.
+
+#. **Hover Information**: lists number of runs executed, specific test
+ substring, mean value of the measured packet throughput, calculated perfect
+ throughput value, difference between measured and perfect values and
+ relative speedup value.
+
.. note::
Test results have been generated by