aboutsummaryrefslogtreecommitdiffstats
diff options
context:
space:
mode:
-rw-r--r--docs/report/introduction/report_history.rst6
-rw-r--r--docs/report/vpp_performance_tests/reconf_tests/vnf_service_chains_reconf.rst119
-rw-r--r--resources/tools/presentation/conf.py2
-rwxr-xr-xresources/tools/presentation/run_report.sh2
4 files changed, 13 insertions, 116 deletions
diff --git a/docs/report/introduction/report_history.rst b/docs/report/introduction/report_history.rst
index 64f7c24561..753721dc21 100644
--- a/docs/report/introduction/report_history.rst
+++ b/docs/report/introduction/report_history.rst
@@ -6,6 +6,12 @@ FD.io CSIT-1908 Report history and per .[ww] revision changes are listed below.
+----------------+------------------------------------------------------------+
| .[ww] Revision | Changes |
+================+============================================================+
+| .40 | 1. Presented results of :ref:`vnf_service_chains_reconf` |
+| | reconfiguration tests were replaced by the link to |
+| | CSIT-1908.1.40 report presenting results of these tests |
+| | re-run on VPP 19.08.1. |
+| | |
++----------------+------------------------------------------------------------+
| .38 | 1. Added data: |
| | |
| | - NFV Density, 2n-skx |
diff --git a/docs/report/vpp_performance_tests/reconf_tests/vnf_service_chains_reconf.rst b/docs/report/vpp_performance_tests/reconf_tests/vnf_service_chains_reconf.rst
index f17d56743e..ea7618737e 100644
--- a/docs/report/vpp_performance_tests/reconf_tests/vnf_service_chains_reconf.rst
+++ b/docs/report/vpp_performance_tests/reconf_tests/vnf_service_chains_reconf.rst
@@ -35,117 +35,8 @@ VNF Service Chains
.. important::
- **DISCLAIMER**: Presented test results should be taken with a pinch of
- salt as they may not represent correctly the system behaviour due
- to experimental nature of used test methodology (see :ref:`reconf_tests`).
-
-In each test, a single service chain is added, the re-configuration
-contains all the steps the initial chains got, except the last step
-(starting VMs) is skipped.
-
-Additional information about graph data:
-
-#. **Graph Title**: describes tested VPP packet path. Format:
-
- - wire encapsulation ``dot1qip4vlxan``,
- - VPP forwarding mode ``l2bd``,
- - total number {Y} of service chains ``{Y}ch``,
- - total number of chains being reconfigured ``1ach``,
- - total number of vhost-user interfaces forwarding packets on VPP with {Y}
- chains and {X} VMs per chain ``{2XY}vh`` (2 interfaces per {X} VMs per {Y}
- chains),
- - total number {XY} of VNF VMs forwarding packets ``{XY}vm`` and finally
- - VNF workload in VM ``testpmd``.
-
-#. **X-axis Labels**: indices of individual test suites as listed in
- Graph Legend.
-
-#. **Y-axis Labels**: measured Implied time loss [s] values.
-
-#. **Graph Legend**: lists X-axis indices with associated CSIT test
- suites executed to generate graphed test results and the average value and
- standard deviation of measured packet loss in millions of packets.
-
-#. **Hover Information**: lists minimum, first quartile, median,
- third quartile, and maximum. If either type of outlier is present the
- whisker on the appropriate side is taken to 1.5×IQR from the quartile
- (the "inner fence") rather than the max or min, and individual outlying
- data points are displayed as unfilled circles (for suspected outliers)
- or filled circles (for outliers). (The "outer fence" is 3×IQR from the
- quartile.)
-
-.. note::
-
- Test results have been generated by
- `FD.io test executor vpp performance job 2n-skx`_ with RF
- result files csit-vpp-perf-|srelease|-\*.zip
- `archived here <../../_static/archive/>`_.
-
-.. raw:: latex
-
- \clearpage
-
-2n-skx-xxv710
-~~~~~~~~~~~~~
-
-imix-2t1c-dot1qip4vxlan-l2bd
-----------------------------
-
-.. raw:: html
-
- <center>
- <iframe id="01" onload="setIframeHeight(this.id)" width="700" frameborder="0" scrolling="no" src="../../_static/vpp/2n-skx-xxv710-imix-2t1c-dot1qip4vxlan-l2bd-reconf.html"></iframe>
- </center>
-
-.. raw:: latex
-
- \begin{figure}[H]
- \centering
- \graphicspath{{../_build/_static/vpp/}}
- \includegraphics[clip, trim=0cm 0cm 5cm 0cm, width=0.70\textwidth]{2n-skx-xxv710-imix-2t1c-dot1qip4vxlan-l2bd-reconf}
- \label{fig:2n-skx-xxv710-imix-2t1c-dot1qip4vxlan-l2bd-reconf}
- \end{figure}
-
-.. raw:: latex
-
- \clearpage
-
-imix-4t2c-dot1qip4vxlan-l2bd
-----------------------------
-
-.. raw:: html
-
- <center>
- <iframe id="02" onload="setIframeHeight(this.id)" width="700" frameborder="0" scrolling="no" src="../../_static/vpp/2n-skx-xxv710-imix-4t2c-dot1qip4vxlan-l2bd-reconf.html"></iframe>
- </center>
-
-.. raw:: latex
-
- \begin{figure}[H]
- \centering
- \graphicspath{{../_build/_static/vpp/}}
- \includegraphics[clip, trim=0cm 0cm 5cm 0cm, width=0.70\textwidth]{2n-skx-xxv710-imix-4t2c-dot1qip4vxlan-l2bd-reconf}
- \label{fig:2n-skx-xxv710-imix-4t2c-dot1qip4vxlan-l2bd-reconf}
- \end{figure}
-
-.. raw:: latex
-
- \clearpage
-
-imix-8t4c-dot1qip4vxlan-l2bd
-----------------------------
-
-.. raw:: html
-
- <center>
- <iframe id="03" onload="setIframeHeight(this.id)" width="700" frameborder="0" scrolling="no" src="../../_static/vpp/2n-skx-xxv710-imix-8t4c-dot1qip4vxlan-l2bd-reconf.html"></iframe>
- </center>
-
-.. raw:: latex
-
- \begin{figure}[H]
- \centering
- \graphicspath{{../_build/_static/vpp/}}
- \includegraphics[clip, trim=0cm 0cm 5cm 0cm, width=0.70\textwidth]{2n-skx-xxv710-imix-8t4c-dot1qip4vxlan-l2bd-reconf}
- \label{fig:2n-skx-xxv710-imix-8t4c-dot1qip4vxlan-l2bd-reconf}
- \end{figure}
+ **DISCLAIMER**: Previously, this page has been showing results
+ for reconf tests. They were using the traffic generator in a new way,
+ that turned out to be wrong. We have fixed the tests,
+ and re-run them on VPP 19.08.1 so look at the correct results
+ `here <https://docs.fd.io/csit/rls1908_1/report/vpp_performance_tests/reconf_tests/vnf_service_chains_reconf.html>`_.
diff --git a/resources/tools/presentation/conf.py b/resources/tools/presentation/conf.py
index bd85deef0e..a42fafc73c 100644
--- a/resources/tools/presentation/conf.py
+++ b/resources/tools/presentation/conf.py
@@ -45,7 +45,7 @@ source_suffix = ['.rst', '.md']
master_doc = 'index'
# General information about the project.
-report_week = '38'
+report_week = '40'
project = u'FD.io CSIT-1908.{week}'.format(week=report_week)
copyright = u'2019, FD.io'
author = u'FD.io CSIT'
diff --git a/resources/tools/presentation/run_report.sh b/resources/tools/presentation/run_report.sh
index 24b6c21a70..dcca276874 100755
--- a/resources/tools/presentation/run_report.sh
+++ b/resources/tools/presentation/run_report.sh
@@ -38,7 +38,7 @@ export PYTHONPATH=`pwd`
python pal.py \
--specification specification.yaml \
--release ${RELEASE} \
- --week "38" \
+ --week "40" \
--logging INFO \
--force