diff options
4 files changed, 13 insertions, 116 deletions
diff --git a/docs/report/introduction/report_history.rst b/docs/report/introduction/report_history.rst index 64f7c24561..753721dc21 100644 --- a/docs/report/introduction/report_history.rst +++ b/docs/report/introduction/report_history.rst @@ -6,6 +6,12 @@ FD.io CSIT-1908 Report history and per .[ww] revision changes are listed below. +----------------+------------------------------------------------------------+ | .[ww] Revision | Changes | +================+============================================================+ +| .40 | 1. Presented results of :ref:`vnf_service_chains_reconf` | +| | reconfiguration tests were replaced by the link to | +| | CSIT-1908.1.40 report presenting results of these tests | +| | re-run on VPP 19.08.1. | +| | | ++----------------+------------------------------------------------------------+ | .38 | 1. Added data: | | | | | | - NFV Density, 2n-skx | diff --git a/docs/report/vpp_performance_tests/reconf_tests/vnf_service_chains_reconf.rst b/docs/report/vpp_performance_tests/reconf_tests/vnf_service_chains_reconf.rst index f17d56743e..ea7618737e 100644 --- a/docs/report/vpp_performance_tests/reconf_tests/vnf_service_chains_reconf.rst +++ b/docs/report/vpp_performance_tests/reconf_tests/vnf_service_chains_reconf.rst @@ -35,117 +35,8 @@ VNF Service Chains .. important:: - **DISCLAIMER**: Presented test results should be taken with a pinch of - salt as they may not represent correctly the system behaviour due - to experimental nature of used test methodology (see :ref:`reconf_tests`). - -In each test, a single service chain is added, the re-configuration -contains all the steps the initial chains got, except the last step -(starting VMs) is skipped. - -Additional information about graph data: - -#. **Graph Title**: describes tested VPP packet path. Format: - - - wire encapsulation ``dot1qip4vlxan``, - - VPP forwarding mode ``l2bd``, - - total number {Y} of service chains ``{Y}ch``, - - total number of chains being reconfigured ``1ach``, - - total number of vhost-user interfaces forwarding packets on VPP with {Y} - chains and {X} VMs per chain ``{2XY}vh`` (2 interfaces per {X} VMs per {Y} - chains), - - total number {XY} of VNF VMs forwarding packets ``{XY}vm`` and finally - - VNF workload in VM ``testpmd``. - -#. **X-axis Labels**: indices of individual test suites as listed in - Graph Legend. - -#. **Y-axis Labels**: measured Implied time loss [s] values. - -#. **Graph Legend**: lists X-axis indices with associated CSIT test - suites executed to generate graphed test results and the average value and - standard deviation of measured packet loss in millions of packets. - -#. **Hover Information**: lists minimum, first quartile, median, - third quartile, and maximum. If either type of outlier is present the - whisker on the appropriate side is taken to 1.5×IQR from the quartile - (the "inner fence") rather than the max or min, and individual outlying - data points are displayed as unfilled circles (for suspected outliers) - or filled circles (for outliers). (The "outer fence" is 3×IQR from the - quartile.) - -.. note:: - - Test results have been generated by - `FD.io test executor vpp performance job 2n-skx`_ with RF - result files csit-vpp-perf-|srelease|-\*.zip - `archived here <../../_static/archive/>`_. - -.. raw:: latex - - \clearpage - -2n-skx-xxv710 -~~~~~~~~~~~~~ - -imix-2t1c-dot1qip4vxlan-l2bd ----------------------------- - -.. raw:: html - - <center> - <iframe id="01" onload="setIframeHeight(this.id)" width="700" frameborder="0" scrolling="no" src="../../_static/vpp/2n-skx-xxv710-imix-2t1c-dot1qip4vxlan-l2bd-reconf.html"></iframe> - </center> - -.. raw:: latex - - \begin{figure}[H] - \centering - \graphicspath{{../_build/_static/vpp/}} - \includegraphics[clip, trim=0cm 0cm 5cm 0cm, width=0.70\textwidth]{2n-skx-xxv710-imix-2t1c-dot1qip4vxlan-l2bd-reconf} - \label{fig:2n-skx-xxv710-imix-2t1c-dot1qip4vxlan-l2bd-reconf} - \end{figure} - -.. raw:: latex - - \clearpage - -imix-4t2c-dot1qip4vxlan-l2bd ----------------------------- - -.. raw:: html - - <center> - <iframe id="02" onload="setIframeHeight(this.id)" width="700" frameborder="0" scrolling="no" src="../../_static/vpp/2n-skx-xxv710-imix-4t2c-dot1qip4vxlan-l2bd-reconf.html"></iframe> - </center> - -.. raw:: latex - - \begin{figure}[H] - \centering - \graphicspath{{../_build/_static/vpp/}} - \includegraphics[clip, trim=0cm 0cm 5cm 0cm, width=0.70\textwidth]{2n-skx-xxv710-imix-4t2c-dot1qip4vxlan-l2bd-reconf} - \label{fig:2n-skx-xxv710-imix-4t2c-dot1qip4vxlan-l2bd-reconf} - \end{figure} - -.. raw:: latex - - \clearpage - -imix-8t4c-dot1qip4vxlan-l2bd ----------------------------- - -.. raw:: html - - <center> - <iframe id="03" onload="setIframeHeight(this.id)" width="700" frameborder="0" scrolling="no" src="../../_static/vpp/2n-skx-xxv710-imix-8t4c-dot1qip4vxlan-l2bd-reconf.html"></iframe> - </center> - -.. raw:: latex - - \begin{figure}[H] - \centering - \graphicspath{{../_build/_static/vpp/}} - \includegraphics[clip, trim=0cm 0cm 5cm 0cm, width=0.70\textwidth]{2n-skx-xxv710-imix-8t4c-dot1qip4vxlan-l2bd-reconf} - \label{fig:2n-skx-xxv710-imix-8t4c-dot1qip4vxlan-l2bd-reconf} - \end{figure} + **DISCLAIMER**: Previously, this page has been showing results + for reconf tests. They were using the traffic generator in a new way, + that turned out to be wrong. We have fixed the tests, + and re-run them on VPP 19.08.1 so look at the correct results + `here <https://docs.fd.io/csit/rls1908_1/report/vpp_performance_tests/reconf_tests/vnf_service_chains_reconf.html>`_. diff --git a/resources/tools/presentation/conf.py b/resources/tools/presentation/conf.py index bd85deef0e..a42fafc73c 100644 --- a/resources/tools/presentation/conf.py +++ b/resources/tools/presentation/conf.py @@ -45,7 +45,7 @@ source_suffix = ['.rst', '.md'] master_doc = 'index' # General information about the project. -report_week = '38' +report_week = '40' project = u'FD.io CSIT-1908.{week}'.format(week=report_week) copyright = u'2019, FD.io' author = u'FD.io CSIT' diff --git a/resources/tools/presentation/run_report.sh b/resources/tools/presentation/run_report.sh index 24b6c21a70..dcca276874 100755 --- a/resources/tools/presentation/run_report.sh +++ b/resources/tools/presentation/run_report.sh @@ -38,7 +38,7 @@ export PYTHONPATH=`pwd` python pal.py \ --specification specification.yaml \ --release ${RELEASE} \ - --week "38" \ + --week "40" \ --logging INFO \ --force |