diff options
author | Maciek Konstantynowicz <mkonstan@cisco.com> | 2018-08-17 22:40:16 +0100 |
---|---|---|
committer | Maciek Konstantynowicz <mkonstan@cisco.com> | 2018-08-17 22:44:16 +0100 |
commit | 0546e1656070b734ec57a4d8f732392bcafee0df (patch) | |
tree | 77014b33f8b29b910c3369e743ee7e3cd6696900 /docs/report/vpp_performance_tests | |
parent | 899b1fc9800b1ccc802a57812846be9911a4c6d0 (diff) |
report 18.07: draft v0.9 editorial nit-picking.
Change-Id: I7fb9dff8f5ebce0ac03ef99c74b14b02638042ac
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
Diffstat (limited to 'docs/report/vpp_performance_tests')
4 files changed, 41 insertions, 81 deletions
diff --git a/docs/report/vpp_performance_tests/comparisons/3n-skx_vs_3n-hsw_testbeds.rst b/docs/report/vpp_performance_tests/comparisons/3n-skx_vs_3n-hsw_testbeds.rst index c9e0bbbb99..b49a447405 100644 --- a/docs/report/vpp_performance_tests/comparisons/3n-skx_vs_3n-hsw_testbeds.rst +++ b/docs/report/vpp_performance_tests/comparisons/3n-skx_vs_3n-hsw_testbeds.rst @@ -6,15 +6,6 @@ MRR) is calculated for the same tests executed on 3-Node Skylake (3n- skx) and 3-Node Haswell (3n-hsw) physical testbed types, in 1-core, 2-core and 4-core configurations. -NDR Comparison -~~~~~~~~~~~~~~ - -NDR comparison between testbed types is available in CSV and pretty -ASCII formats: - - - `CSV NDR comparison <../_static/vpp/performance-compare-testbeds-3n-hsw-3n-skx-ndr.csv>`_, - - `ASCII NDR comparison <../_static/vpp/performance-compare-testbeds-3n-hsw-3n-skx-ndr.txt>`_. - .. note:: Test results have been generated by @@ -24,38 +15,26 @@ ASCII formats: files csit-vpp-perf-|srelease|-\*.zip `archived here <../_static/archive/>`_. -PDR Comparison +NDR Comparison ~~~~~~~~~~~~~~ -PDR comparison between testbed types is available in CSV and pretty -ASCII formats: +Comparison tables in ASCII and CSV formats: - - `CSV PDR comparison <../_static/vpp/performance-compare-testbeds-3n-hsw-3n-skx-pdr.csv>`_, - - `ASCII PDR comparison <../_static/vpp/performance-compare-testbeds-3n-hsw-3n-skx-pdr.txt>`_. + - `ASCII NDR comparison <../_static/vpp/performance-compare-testbeds-3n-hsw-3n-skx-ndr.txt>`_ + - `CSV NDR comparison <../_static/vpp/performance-compare-testbeds-3n-hsw-3n-skx-ndr.csv>`_ -.. note:: +PDR Comparison +~~~~~~~~~~~~~~ - Test results have been generated by - `FD.io test executor vpp performance job 3n-hsw`_ and - `FD.io test executor vpp performance job 3n-skx`_ - with RF result - files csit-vpp-perf-|srelease|-\*.zip - `archived here <../_static/archive/>`_. +Comparison tables in ASCII and CSV formats: + + - `ASCII PDR comparison <../_static/vpp/performance-compare-testbeds-3n-hsw-3n-skx-pdr.txt>`_ + - `CSV PDR comparison <../_static/vpp/performance-compare-testbeds-3n-hsw-3n-skx-pdr.csv>`_ MRR Comparison ~~~~~~~~~~~~~~ -MRR comparison between testbed types is available in CSV and pretty -ASCII formats: - - - `CSV MRR comparison <../_static/vpp/performance-compare-testbeds-3n-hsw-3n-skx-mrr.csv>`_, - - `ASCII MRR comparison <../_static/vpp/performance-compare-testbeds-3n-hsw-3n-skx-mrr.txt>`_. - -.. note:: +Comparison tables in ASCII and CSV formats: - Test results have been generated by - `FD.io test executor vpp performance job 3n-hsw`_ and - `FD.io test executor vpp performance job 3n-skx`_ - with RF result - files csit-vpp-perf-|srelease|-\*.zip - `archived here <../_static/archive/>`_. + - `ASCII MRR comparison <../_static/vpp/performance-compare-testbeds-3n-hsw-3n-skx-mrr.txt>`_ + - `CSV MRR comparison <../_static/vpp/performance-compare-testbeds-3n-hsw-3n-skx-mrr.csv>`_ diff --git a/docs/report/vpp_performance_tests/comparisons/current_vs_previous_release.rst b/docs/report/vpp_performance_tests/comparisons/current_vs_previous_release.rst index c2a87dc2ab..228d8f889b 100644 --- a/docs/report/vpp_performance_tests/comparisons/current_vs_previous_release.rst +++ b/docs/report/vpp_performance_tests/comparisons/current_vs_previous_release.rst @@ -16,17 +16,6 @@ repeatability and makes the relative change of mean throughput value not fully representative for these tests. The root causes behind poor results repeatability vary between the test cases. -NDR Comparison -~~~~~~~~~~~~~~ - -NDR throughput comparison between releases is available in CSV and pretty -ASCII formats: - - - `CSV 1t1c NDR changes <../_static/vpp/performance-changes-1t1c-ndr.csv>`_, - - `CSV 2t2c NDR changes <../_static/vpp/performance-changes-2t2c-ndr.csv>`_, - - `ASCII 1t1c NDR changes <../_static/vpp/performance-changes-1t1c-ndr.txt>`_, - - `ASCII 2t2c NDR changes <../_static/vpp/performance-changes-2t2c-ndr.txt>`_. - .. note:: Test results have been generated by @@ -35,42 +24,34 @@ ASCII formats: files csit-vpp-perf-|srelease|-\*.zip `archived here <../_static/archive/>`_. -PDR Comparison +NDR Comparison ~~~~~~~~~~~~~~ -PDR throughput comparison between releases is available in CSV and pretty -ASCII formats: +Comparison tables in ASCII and CSV formats: - - `CSV 1t1c PDR changes <../_static/vpp/performance-changes-1t1c-pdr.csv>`_, - - `CSV 2t2c PDR changes <../_static/vpp/performance-changes-2t2c-pdr.csv>`_, - - `ASCII 1t1c PDR changes <../_static/vpp/performance-changes-1t1c-pdr.txt>`_, - - `ASCII 2t2c PDR changes <../_static/vpp/performance-changes-2t2c-pdr.txt>`_. + - `ASCII 1t1c NDR comparison <../_static/vpp/performance-changes-1t1c-ndr.txt>`_ + - `ASCII 2t2c NDR comparison <../_static/vpp/performance-changes-2t2c-ndr.txt>`_ + - `CSV 1t1c NDR comparison <../_static/vpp/performance-changes-1t1c-ndr.csv>`_ + - `CSV 2t2c NDR comparison <../_static/vpp/performance-changes-2t2c-ndr.csv>`_ -.. note:: +PDR Comparison +~~~~~~~~~~~~~~ - Test results have been generated by - `FD.io test executor vpp performance job 3n-hsw`_, - with RF result - files csit-vpp-perf-|srelease|-\*.zip - `archived here <../_static/archive/>`_. +Comparison tables in ASCII and CSV formats: + + - `ASCII 1t1c PDR comparison <../_static/vpp/performance-changes-1t1c-pdr.txt>`_ + - `ASCII 2t2c PDR comparison <../_static/vpp/performance-changes-2t2c-pdr.txt>`_ + - `CSV 1t1c PDR comparison <../_static/vpp/performance-changes-1t1c-pdr.csv>`_ + - `CSV 2t2c PDR comparison <../_static/vpp/performance-changes-2t2c-pdr.csv>`_ MRR Comparison ~~~~~~~~~~~~~~ -MRR throughput comparison between releases is available in CSV and pretty -ASCII formats: - - - `CSV 1t1c MRR changes <../_static/vpp/performance-changes-1t1c-mrr.csv>`_, - - `CSV 2t2c MRR changes <../_static/vpp/performance-changes-2t2c-mrr.csv>`_, - - `CSV 4t4c MRR changes <../_static/vpp/performance-changes-4t4c-mrr.csv>`_, - - `ASCII 1t1c MRR changes <../_static/vpp/performance-changes-1t1c-mrr.txt>`_, - - `ASCII 2t2c MRR changes <../_static/vpp/performance-changes-2t2c-mrr.txt>`_, - - `ASCII 4t4c MRR changes <../_static/vpp/performance-changes-4t4c-mrr.txt>`_. - -.. note:: +Comparison tables in ASCII and CSV formats: - Test results have been generated by - `FD.io test executor vpp performance job 3n-hsw`_, - with RF result - files csit-vpp-perf-|srelease|-\*.zip - `archived here <../_static/archive/>`_. + - `ASCII 1t1c MRR comparison <../_static/vpp/performance-changes-1t1c-mrr.txt>`_ + - `ASCII 2t2c MRR comparison <../_static/vpp/performance-changes-2t2c-mrr.txt>`_ + - `ASCII 4t4c MRR comparison <../_static/vpp/performance-changes-4t4c-mrr.txt>`_ + - `CSV 1t1c MRR comparison <../_static/vpp/performance-changes-1t1c-mrr.csv>`_ + - `CSV 2t2c MRR comparison <../_static/vpp/performance-changes-2t2c-mrr.csv>`_ + - `CSV 4t4c MRR comparison <../_static/vpp/performance-changes-4t4c-mrr.csv>`_ diff --git a/docs/report/vpp_performance_tests/csit_release_notes.rst b/docs/report/vpp_performance_tests/csit_release_notes.rst index 0318e7a01e..233bf4545a 100644 --- a/docs/report/vpp_performance_tests/csit_release_notes.rst +++ b/docs/report/vpp_performance_tests/csit_release_notes.rst @@ -4,7 +4,7 @@ Release Notes Changes in |csit-release| ------------------------- -#. **VPP Performance Tests** +#. VPP PERFORMANCE TESTS - **MRR Throughput**: MRR (Maximum Receive Rate) test code has now configurable trial duration and number of consecutive executions. @@ -44,12 +44,12 @@ Changes in |csit-release| Ansible playbooks refactor for quick server (re)installation and reference pointers of configuration. -#. **Presentation and Analytics Layer** +#. PRESENTATION AND ANALYTICS LAYER - - **Performance trending**: Further improved continuous performance - trending with anomaly detection and analysis. + - **Performance trending**: Further improvements of continuous + performance trending, anomaly detection and analysis. -#. **Test Framework Optimizations** +#. TEST FRAMEWORK OPTIMIZATIONS - **General Code Housekeeping**: Ongoing RF keywords optimizations, removal of redundant RF keywords. diff --git a/docs/report/vpp_performance_tests/throughput_trending.rst b/docs/report/vpp_performance_tests/throughput_trending.rst index c2ca421d57..6607423e0f 100644 --- a/docs/report/vpp_performance_tests/throughput_trending.rst +++ b/docs/report/vpp_performance_tests/throughput_trending.rst @@ -4,7 +4,7 @@ Throughput Trending In addition to reporting throughput comparison between VPP releases, CSIT provides continuous performance trending for VPP master branch: -#. `VPP Performance Dashboard <https://docs.fd.io/csit/master/trending/introduction/index.html>`_ +#. `Performance Dashboard <https://docs.fd.io/csit/master/trending/introduction/index.html>`_ - per VPP test case throughput trend, trend compliance and summary of detected anomalies. @@ -12,6 +12,6 @@ CSIT provides continuous performance trending for VPP master branch: - throughput test metrics, trend calculations and anomaly classification (progression, regression). -#. `Trendline Graphs <https://docs.fd.io/csit/master/trending/trending/index.html>`_ +#. `VPP Trendline Graphs <https://docs.fd.io/csit/master/trending/trending/index.html>`_ - per VPP build MRR throughput measurements against the trendline with anomaly highlights and associated CSIT test jobs.
\ No newline at end of file |