aboutsummaryrefslogtreecommitdiffstats
path: root/docs/report/vpp_performance_tests
diff options
context:
space:
mode:
authorMaciek Konstantynowicz <mkonstan@cisco.com>2018-08-17 22:40:16 +0100
committerMaciek Konstantynowicz <mkonstan@cisco.com>2018-08-17 22:44:16 +0100
commit0546e1656070b734ec57a4d8f732392bcafee0df (patch)
tree77014b33f8b29b910c3369e743ee7e3cd6696900 /docs/report/vpp_performance_tests
parent899b1fc9800b1ccc802a57812846be9911a4c6d0 (diff)
report 18.07: draft v0.9 editorial nit-picking.
Change-Id: I7fb9dff8f5ebce0ac03ef99c74b14b02638042ac Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
Diffstat (limited to 'docs/report/vpp_performance_tests')
-rw-r--r--docs/report/vpp_performance_tests/comparisons/3n-skx_vs_3n-hsw_testbeds.rst47
-rw-r--r--docs/report/vpp_performance_tests/comparisons/current_vs_previous_release.rst61
-rw-r--r--docs/report/vpp_performance_tests/csit_release_notes.rst10
-rw-r--r--docs/report/vpp_performance_tests/throughput_trending.rst4
4 files changed, 41 insertions, 81 deletions
diff --git a/docs/report/vpp_performance_tests/comparisons/3n-skx_vs_3n-hsw_testbeds.rst b/docs/report/vpp_performance_tests/comparisons/3n-skx_vs_3n-hsw_testbeds.rst
index c9e0bbbb99..b49a447405 100644
--- a/docs/report/vpp_performance_tests/comparisons/3n-skx_vs_3n-hsw_testbeds.rst
+++ b/docs/report/vpp_performance_tests/comparisons/3n-skx_vs_3n-hsw_testbeds.rst
@@ -6,15 +6,6 @@ MRR) is calculated for the same tests executed on 3-Node Skylake (3n-
skx) and 3-Node Haswell (3n-hsw) physical testbed types, in 1-core,
2-core and 4-core configurations.
-NDR Comparison
-~~~~~~~~~~~~~~
-
-NDR comparison between testbed types is available in CSV and pretty
-ASCII formats:
-
- - `CSV NDR comparison <../_static/vpp/performance-compare-testbeds-3n-hsw-3n-skx-ndr.csv>`_,
- - `ASCII NDR comparison <../_static/vpp/performance-compare-testbeds-3n-hsw-3n-skx-ndr.txt>`_.
-
.. note::
Test results have been generated by
@@ -24,38 +15,26 @@ ASCII formats:
files csit-vpp-perf-|srelease|-\*.zip
`archived here <../_static/archive/>`_.
-PDR Comparison
+NDR Comparison
~~~~~~~~~~~~~~
-PDR comparison between testbed types is available in CSV and pretty
-ASCII formats:
+Comparison tables in ASCII and CSV formats:
- - `CSV PDR comparison <../_static/vpp/performance-compare-testbeds-3n-hsw-3n-skx-pdr.csv>`_,
- - `ASCII PDR comparison <../_static/vpp/performance-compare-testbeds-3n-hsw-3n-skx-pdr.txt>`_.
+ - `ASCII NDR comparison <../_static/vpp/performance-compare-testbeds-3n-hsw-3n-skx-ndr.txt>`_
+ - `CSV NDR comparison <../_static/vpp/performance-compare-testbeds-3n-hsw-3n-skx-ndr.csv>`_
-.. note::
+PDR Comparison
+~~~~~~~~~~~~~~
- Test results have been generated by
- `FD.io test executor vpp performance job 3n-hsw`_ and
- `FD.io test executor vpp performance job 3n-skx`_
- with RF result
- files csit-vpp-perf-|srelease|-\*.zip
- `archived here <../_static/archive/>`_.
+Comparison tables in ASCII and CSV formats:
+
+ - `ASCII PDR comparison <../_static/vpp/performance-compare-testbeds-3n-hsw-3n-skx-pdr.txt>`_
+ - `CSV PDR comparison <../_static/vpp/performance-compare-testbeds-3n-hsw-3n-skx-pdr.csv>`_
MRR Comparison
~~~~~~~~~~~~~~
-MRR comparison between testbed types is available in CSV and pretty
-ASCII formats:
-
- - `CSV MRR comparison <../_static/vpp/performance-compare-testbeds-3n-hsw-3n-skx-mrr.csv>`_,
- - `ASCII MRR comparison <../_static/vpp/performance-compare-testbeds-3n-hsw-3n-skx-mrr.txt>`_.
-
-.. note::
+Comparison tables in ASCII and CSV formats:
- Test results have been generated by
- `FD.io test executor vpp performance job 3n-hsw`_ and
- `FD.io test executor vpp performance job 3n-skx`_
- with RF result
- files csit-vpp-perf-|srelease|-\*.zip
- `archived here <../_static/archive/>`_.
+ - `ASCII MRR comparison <../_static/vpp/performance-compare-testbeds-3n-hsw-3n-skx-mrr.txt>`_
+ - `CSV MRR comparison <../_static/vpp/performance-compare-testbeds-3n-hsw-3n-skx-mrr.csv>`_
diff --git a/docs/report/vpp_performance_tests/comparisons/current_vs_previous_release.rst b/docs/report/vpp_performance_tests/comparisons/current_vs_previous_release.rst
index c2a87dc2ab..228d8f889b 100644
--- a/docs/report/vpp_performance_tests/comparisons/current_vs_previous_release.rst
+++ b/docs/report/vpp_performance_tests/comparisons/current_vs_previous_release.rst
@@ -16,17 +16,6 @@ repeatability and makes the relative change of mean throughput value not
fully representative for these tests. The root causes behind poor
results repeatability vary between the test cases.
-NDR Comparison
-~~~~~~~~~~~~~~
-
-NDR throughput comparison between releases is available in CSV and pretty
-ASCII formats:
-
- - `CSV 1t1c NDR changes <../_static/vpp/performance-changes-1t1c-ndr.csv>`_,
- - `CSV 2t2c NDR changes <../_static/vpp/performance-changes-2t2c-ndr.csv>`_,
- - `ASCII 1t1c NDR changes <../_static/vpp/performance-changes-1t1c-ndr.txt>`_,
- - `ASCII 2t2c NDR changes <../_static/vpp/performance-changes-2t2c-ndr.txt>`_.
-
.. note::
Test results have been generated by
@@ -35,42 +24,34 @@ ASCII formats:
files csit-vpp-perf-|srelease|-\*.zip
`archived here <../_static/archive/>`_.
-PDR Comparison
+NDR Comparison
~~~~~~~~~~~~~~
-PDR throughput comparison between releases is available in CSV and pretty
-ASCII formats:
+Comparison tables in ASCII and CSV formats:
- - `CSV 1t1c PDR changes <../_static/vpp/performance-changes-1t1c-pdr.csv>`_,
- - `CSV 2t2c PDR changes <../_static/vpp/performance-changes-2t2c-pdr.csv>`_,
- - `ASCII 1t1c PDR changes <../_static/vpp/performance-changes-1t1c-pdr.txt>`_,
- - `ASCII 2t2c PDR changes <../_static/vpp/performance-changes-2t2c-pdr.txt>`_.
+ - `ASCII 1t1c NDR comparison <../_static/vpp/performance-changes-1t1c-ndr.txt>`_
+ - `ASCII 2t2c NDR comparison <../_static/vpp/performance-changes-2t2c-ndr.txt>`_
+ - `CSV 1t1c NDR comparison <../_static/vpp/performance-changes-1t1c-ndr.csv>`_
+ - `CSV 2t2c NDR comparison <../_static/vpp/performance-changes-2t2c-ndr.csv>`_
-.. note::
+PDR Comparison
+~~~~~~~~~~~~~~
- Test results have been generated by
- `FD.io test executor vpp performance job 3n-hsw`_,
- with RF result
- files csit-vpp-perf-|srelease|-\*.zip
- `archived here <../_static/archive/>`_.
+Comparison tables in ASCII and CSV formats:
+
+ - `ASCII 1t1c PDR comparison <../_static/vpp/performance-changes-1t1c-pdr.txt>`_
+ - `ASCII 2t2c PDR comparison <../_static/vpp/performance-changes-2t2c-pdr.txt>`_
+ - `CSV 1t1c PDR comparison <../_static/vpp/performance-changes-1t1c-pdr.csv>`_
+ - `CSV 2t2c PDR comparison <../_static/vpp/performance-changes-2t2c-pdr.csv>`_
MRR Comparison
~~~~~~~~~~~~~~
-MRR throughput comparison between releases is available in CSV and pretty
-ASCII formats:
-
- - `CSV 1t1c MRR changes <../_static/vpp/performance-changes-1t1c-mrr.csv>`_,
- - `CSV 2t2c MRR changes <../_static/vpp/performance-changes-2t2c-mrr.csv>`_,
- - `CSV 4t4c MRR changes <../_static/vpp/performance-changes-4t4c-mrr.csv>`_,
- - `ASCII 1t1c MRR changes <../_static/vpp/performance-changes-1t1c-mrr.txt>`_,
- - `ASCII 2t2c MRR changes <../_static/vpp/performance-changes-2t2c-mrr.txt>`_,
- - `ASCII 4t4c MRR changes <../_static/vpp/performance-changes-4t4c-mrr.txt>`_.
-
-.. note::
+Comparison tables in ASCII and CSV formats:
- Test results have been generated by
- `FD.io test executor vpp performance job 3n-hsw`_,
- with RF result
- files csit-vpp-perf-|srelease|-\*.zip
- `archived here <../_static/archive/>`_.
+ - `ASCII 1t1c MRR comparison <../_static/vpp/performance-changes-1t1c-mrr.txt>`_
+ - `ASCII 2t2c MRR comparison <../_static/vpp/performance-changes-2t2c-mrr.txt>`_
+ - `ASCII 4t4c MRR comparison <../_static/vpp/performance-changes-4t4c-mrr.txt>`_
+ - `CSV 1t1c MRR comparison <../_static/vpp/performance-changes-1t1c-mrr.csv>`_
+ - `CSV 2t2c MRR comparison <../_static/vpp/performance-changes-2t2c-mrr.csv>`_
+ - `CSV 4t4c MRR comparison <../_static/vpp/performance-changes-4t4c-mrr.csv>`_
diff --git a/docs/report/vpp_performance_tests/csit_release_notes.rst b/docs/report/vpp_performance_tests/csit_release_notes.rst
index 0318e7a01e..233bf4545a 100644
--- a/docs/report/vpp_performance_tests/csit_release_notes.rst
+++ b/docs/report/vpp_performance_tests/csit_release_notes.rst
@@ -4,7 +4,7 @@ Release Notes
Changes in |csit-release|
-------------------------
-#. **VPP Performance Tests**
+#. VPP PERFORMANCE TESTS
- **MRR Throughput**: MRR (Maximum Receive Rate) test code has now
configurable trial duration and number of consecutive executions.
@@ -44,12 +44,12 @@ Changes in |csit-release|
Ansible playbooks refactor for quick server (re)installation and
reference pointers of configuration.
-#. **Presentation and Analytics Layer**
+#. PRESENTATION AND ANALYTICS LAYER
- - **Performance trending**: Further improved continuous performance
- trending with anomaly detection and analysis.
+ - **Performance trending**: Further improvements of continuous
+ performance trending, anomaly detection and analysis.
-#. **Test Framework Optimizations**
+#. TEST FRAMEWORK OPTIMIZATIONS
- **General Code Housekeeping**: Ongoing RF keywords optimizations,
removal of redundant RF keywords.
diff --git a/docs/report/vpp_performance_tests/throughput_trending.rst b/docs/report/vpp_performance_tests/throughput_trending.rst
index c2ca421d57..6607423e0f 100644
--- a/docs/report/vpp_performance_tests/throughput_trending.rst
+++ b/docs/report/vpp_performance_tests/throughput_trending.rst
@@ -4,7 +4,7 @@ Throughput Trending
In addition to reporting throughput comparison between VPP releases,
CSIT provides continuous performance trending for VPP master branch:
-#. `VPP Performance Dashboard <https://docs.fd.io/csit/master/trending/introduction/index.html>`_
+#. `Performance Dashboard <https://docs.fd.io/csit/master/trending/introduction/index.html>`_
- per VPP test case throughput trend, trend compliance and summary of
detected anomalies.
@@ -12,6 +12,6 @@ CSIT provides continuous performance trending for VPP master branch:
- throughput test metrics, trend calculations and anomaly
classification (progression, regression).
-#. `Trendline Graphs <https://docs.fd.io/csit/master/trending/trending/index.html>`_
+#. `VPP Trendline Graphs <https://docs.fd.io/csit/master/trending/trending/index.html>`_
- per VPP build MRR throughput measurements against the trendline
with anomaly highlights and associated CSIT test jobs. \ No newline at end of file