aboutsummaryrefslogtreecommitdiffstats
diff options
context:
space:
mode:
authorTibor Frank <tifrank@cisco.com>2019-09-18 10:40:17 +0200
committerTibor Frank <tifrank@cisco.com>2019-09-18 12:06:27 +0000
commit6aeb3f1bbbda53855f9b0c9148c7e60201502e05 (patch)
treeccedde1a954dd4a1e0848681ee6b812eed54ed6b
parenta80d1aada506196afc12a52b4294ffdf9df6c9cd (diff)
Report: Add disclaimer for reconf tests
+ Improve description for reconf tests Change-Id: Ib1f397eda88a6c1db79b7a3a518584420770fd5c Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 2fc48e8d0a4712ec99dd2bb3a814ec9cb2bc12cf)
-rw-r--r--docs/report/index.html.template1
-rw-r--r--docs/report/introduction/methodology.rst1
-rw-r--r--docs/report/introduction/methodology_data_plane_throughput/index.rst1
-rw-r--r--docs/report/introduction/methodology_reconf.rst (renamed from docs/report/introduction/methodology_data_plane_throughput/methodology_reconf.rst)10
-rw-r--r--docs/report/vpp_performance_tests/index.rst1
-rw-r--r--docs/report/vpp_performance_tests/nf_service_density/index.rst1
-rw-r--r--docs/report/vpp_performance_tests/reconf_tests/index.rst15
-rw-r--r--docs/report/vpp_performance_tests/reconf_tests/vnf_service_chains_reconf.rst (renamed from docs/report/vpp_performance_tests/nf_service_density/vnf_service_chains_reconf.rst)23
8 files changed, 44 insertions, 9 deletions
diff --git a/docs/report/index.html.template b/docs/report/index.html.template
index 554dd9bd76..8a01129982 100644
--- a/docs/report/index.html.template
+++ b/docs/report/index.html.template
@@ -21,6 +21,7 @@ CSIT-1908
vpp_performance_tests/throughput_speedup_multi_core/index
vpp_performance_tests/packet_latency_graphs/index
vpp_performance_tests/soak_tests/index
+ vpp_performance_tests/reconf_tests/index
vpp_performance_tests/nf_service_density/index
vpp_performance_tests/http_server_performance/index
vpp_performance_tests/comparisons/index
diff --git a/docs/report/introduction/methodology.rst b/docs/report/introduction/methodology.rst
index b111fe51d3..af9bfc661a 100644
--- a/docs/report/introduction/methodology.rst
+++ b/docs/report/introduction/methodology.rst
@@ -16,6 +16,7 @@ Test Methodology
methodology_plrsearch
methodology_packet_latency
methodology_multi_core_speedup
+ methodology_reconf
methodology_vpp_startup_settings
methodology_kvm_vms_vhost_user
methodology_lxc_drc_container_memif
diff --git a/docs/report/introduction/methodology_data_plane_throughput/index.rst b/docs/report/introduction/methodology_data_plane_throughput/index.rst
index 71af4a9add..487d300b5b 100644
--- a/docs/report/introduction/methodology_data_plane_throughput/index.rst
+++ b/docs/report/introduction/methodology_data_plane_throughput/index.rst
@@ -7,4 +7,3 @@ Data Plane Throughput
methodology_mlrsearch_tests
methodology_mrr_throughput
methodology_plrsearch
- methodology_reconf
diff --git a/docs/report/introduction/methodology_data_plane_throughput/methodology_reconf.rst b/docs/report/introduction/methodology_reconf.rst
index 8922b32b22..32e0fd7561 100644
--- a/docs/report/introduction/methodology_data_plane_throughput/methodology_reconf.rst
+++ b/docs/report/introduction/methodology_reconf.rst
@@ -1,7 +1,13 @@
.. _reconf_tests:
-Reconf Tests
-^^^^^^^^^^^^
+Reconfiguration Tests
+---------------------
+
+.. important::
+
+ **DISCLAIMER**: Described reconf test methodology is experimental, and
+ subject to change following consultation within csit-dev, vpp-dev
+ and user communities. Current test results should be treated as indicative.
Overview
~~~~~~~~
diff --git a/docs/report/vpp_performance_tests/index.rst b/docs/report/vpp_performance_tests/index.rst
index c5c3e6679d..0f09377732 100644
--- a/docs/report/vpp_performance_tests/index.rst
+++ b/docs/report/vpp_performance_tests/index.rst
@@ -9,6 +9,7 @@ VPP Performance
throughput_speedup_multi_core/index
packet_latency_graphs/index
soak_tests/index
+ reconf_tests/index
nf_service_density/index
http_server_performance/index
comparisons/index
diff --git a/docs/report/vpp_performance_tests/nf_service_density/index.rst b/docs/report/vpp_performance_tests/nf_service_density/index.rst
index 8c827ebcc3..4c3143b36d 100644
--- a/docs/report/vpp_performance_tests/nf_service_density/index.rst
+++ b/docs/report/vpp_performance_tests/nf_service_density/index.rst
@@ -25,4 +25,3 @@ resources.
vnf_service_chains
cnf_service_chains
cnf_service_pipelines
- vnf_service_chains_reconf
diff --git a/docs/report/vpp_performance_tests/reconf_tests/index.rst b/docs/report/vpp_performance_tests/reconf_tests/index.rst
new file mode 100644
index 0000000000..c5da438b29
--- /dev/null
+++ b/docs/report/vpp_performance_tests/reconf_tests/index.rst
@@ -0,0 +1,15 @@
+
+.. raw:: latex
+
+ \clearpage
+
+.. _reconfiguration_tests:
+
+Reconfiguration Tests
+=====================
+
+See :ref:`reconf_tests` for methodology description of this test type.
+
+.. toctree::
+
+ vnf_service_chains_reconf
diff --git a/docs/report/vpp_performance_tests/nf_service_density/vnf_service_chains_reconf.rst b/docs/report/vpp_performance_tests/reconf_tests/vnf_service_chains_reconf.rst
index 66b1af15d3..47934651bc 100644
--- a/docs/report/vpp_performance_tests/nf_service_density/vnf_service_chains_reconf.rst
+++ b/docs/report/vpp_performance_tests/reconf_tests/vnf_service_chains_reconf.rst
@@ -30,10 +30,14 @@
.. _vnf_service_chains_reconf:
-Reconfiguration of VNF Service Chains
-=====================================
+VNF Service Chains
+==================
-See :ref:`reconf_tests` for methodology description of this test type.
+.. important::
+
+ **DISCLAIMER**: Presented test results should be taken with a pinch of
+ salt as they may not represent correctly the system behaviour due
+ to experimental nature of used test methodology (see :ref:`reconf_tests`).
In each test, a single service chain is added, the re-configuration
contains all the steps the initial chains got, except the last step
@@ -41,8 +45,17 @@ contains all the steps the initial chains got, except the last step
Additional information about graph data:
-#. **Graph Title**: describes tested packet path including VNF workload
- running in each VM.
+#. **Graph Title**: describes tested VPP packet path. Format:
+
+ - wire encapsulation ``dot1qip4vlxan``,
+ - VPP forwarding mode ``l2bd``,
+ - total number {Y} of service chains ``{Y}ch``,
+ - total number of chains being reconfigured ``1ach``,
+ - total number of vhost-user interfaces forwarding packets on VPP with {Y}
+ chains and {X} VMs per chain ``{2XY}vh`` (2 interfaces per {X} VMs per {Y}
+ chains),
+ total number {XY} of VNF VMs forwarding packets ``{XY}vm`` and finally
+ - VNF workload in VM ``testpmd``.
#. **X-axis Labels**: indices of individual test suites as listed in
Graph Legend.