diff options
Diffstat (limited to 'docs/cpta/introduction')
-rw-r--r-- | docs/cpta/introduction/dashboard.rst | 293 | ||||
-rw-r--r-- | docs/cpta/introduction/failures.rst | 104 | ||||
-rw-r--r-- | docs/cpta/introduction/introduction.rst | 24 | ||||
-rw-r--r-- | docs/cpta/introduction/weekly.rst | 107 |
4 files changed, 0 insertions, 528 deletions
diff --git a/docs/cpta/introduction/dashboard.rst b/docs/cpta/introduction/dashboard.rst deleted file mode 100644 index 9cd41816af..0000000000 --- a/docs/cpta/introduction/dashboard.rst +++ /dev/null @@ -1,293 +0,0 @@ -Data Plane Performance -====================== - -.. _Dashboard: - -Legend to the tables: - - - **Test Case**: name of FD.io CSIT test case, naming convention - `here <https://wiki.fd.io/view/CSIT/csit-test-naming>`_. - - **Trend [Mpps]**: Population average of the last group of runs. - - **Runs [#]**: Number of runs belonging to the last sample group. - - **Long-Term Change [%]**: Relative change of Last Trend vs. - maximum of trend values over the last quarter except last week. - - **Regressions [#]**: Number of regressions detected - in last few runs (4 for weekly, 14 for daily). - - **Progressions [#]**: Number of progressions detected - in last few runs (4 for weekly, 14 for daily). - -For full explanation see :ref:`Trend_Compliance` document. - -2n-icx ------- - -VPP worker on 2t1c -`````````````````` - -.. include:: ../../../_build/_static/vpp/performance-trending-dashboard-2t1c-2n-icx.rst - -VPP worker on 4t2c -`````````````````` - -.. include:: ../../../_build/_static/vpp/performance-trending-dashboard-4t2c-2n-icx.rst - -VPP worker on 8t4c -`````````````````` - -.. include:: ../../../_build/_static/vpp/performance-trending-dashboard-8t4c-2n-icx.rst - -NDR Weekly VPP worker on 2t1c -````````````````````````````` - -.. include:: ../../../_build/_static/vpp/performance-trending-dashboard-2t1c-2n-icx-ndr.rst - -PDR Weekly VPP worker on 2t1c -````````````````````````````` - -.. include:: ../../../_build/_static/vpp/performance-trending-dashboard-2t1c-2n-icx-pdr.rst - -3n-icx ------- - -VPP worker on 2t1c -`````````````````` - -.. include:: ../../../_build/_static/vpp/performance-trending-dashboard-2t1c-3n-icx.rst - -VPP worker on 4t2c -`````````````````` - -.. include:: ../../../_build/_static/vpp/performance-trending-dashboard-4t2c-3n-icx.rst - -VPP worker on 8t4c -`````````````````` - -.. include:: ../../../_build/_static/vpp/performance-trending-dashboard-8t4c-3n-icx.rst - -NDR Weekly VPP worker on 2t1c -````````````````````````````` - -.. include:: ../../../_build/_static/vpp/performance-trending-dashboard-2t1c-3n-icx-ndr.rst - -PDR Weekly VPP worker on 2t1c -````````````````````````````` - -.. include:: ../../../_build/_static/vpp/performance-trending-dashboard-2t1c-3n-icx-pdr.rst - -3n-alt ------- - -VPP worker on 1t1c -`````````````````` - -.. include:: ../../../_build/_static/vpp/performance-trending-dashboard-1t1c-3n-alt.rst - -VPP worker on 2t2c -`````````````````` - -.. include:: ../../../_build/_static/vpp/performance-trending-dashboard-2t2c-3n-alt.rst - -VPP worker on 4t4c -`````````````````` - -.. include:: ../../../_build/_static/vpp/performance-trending-dashboard-4t4c-3n-alt.rst - -2n-skx ------- - -VPP worker on 2t1c -`````````````````` - -.. include:: ../../../_build/_static/vpp/performance-trending-dashboard-2t1c-2n-skx.rst - -VPP worker on 4t2c -`````````````````` - -.. include:: ../../../_build/_static/vpp/performance-trending-dashboard-4t2c-2n-skx.rst - -VPP worker on 8t4c -`````````````````` - -.. include:: ../../../_build/_static/vpp/performance-trending-dashboard-8t4c-2n-skx.rst - -NDR Weekly VPP worker on 2t1c -````````````````````````````` - -.. include:: ../../../_build/_static/vpp/performance-trending-dashboard-2t1c-2n-skx-ndr.rst - -PDR Weekly VPP worker on 2t1c -````````````````````````````` - -.. include:: ../../../_build/_static/vpp/performance-trending-dashboard-2t1c-2n-skx-pdr.rst - -3n-skx ------- - -VPP worker on 2t1c -`````````````````` - -.. include:: ../../../_build/_static/vpp/performance-trending-dashboard-2t1c-3n-skx.rst - -VPP worker on 4t2c -`````````````````` - -.. include:: ../../../_build/_static/vpp/performance-trending-dashboard-4t2c-3n-skx.rst - -VPP worker on 8t4c -`````````````````` - -.. include:: ../../../_build/_static/vpp/performance-trending-dashboard-8t4c-3n-skx.rst - -NDR Weekly VPP worker on 2t1c -````````````````````````````` - -.. include:: ../../../_build/_static/vpp/performance-trending-dashboard-2t1c-3n-skx-ndr.rst - -PDR Weekly VPP worker on 2t1c -````````````````````````````` - -.. include:: ../../../_build/_static/vpp/performance-trending-dashboard-2t1c-3n-skx-pdr.rst - -3n-tsh ------- - -VPP worker on 1t1c -`````````````````` - -.. include:: ../../../_build/_static/vpp/performance-trending-dashboard-1t1c-3n-tsh.rst - -VPP worker on 2t2c -`````````````````` - -.. include:: ../../../_build/_static/vpp/performance-trending-dashboard-2t2c-3n-tsh.rst - -VPP worker on 4t4c -`````````````````` - -.. include:: ../../../_build/_static/vpp/performance-trending-dashboard-4t4c-3n-tsh.rst - -2n-dnv ------- - -VPP worker on 1t1c -`````````````````` - -.. include:: ../../../_build/_static/vpp/performance-trending-dashboard-1t1c-2n-dnv.rst - -VPP worker on 2t2c -`````````````````` - -.. include:: ../../../_build/_static/vpp/performance-trending-dashboard-2t2c-2n-dnv.rst - -VPP worker on 4t4c -`````````````````` - -.. include:: ../../../_build/_static/vpp/performance-trending-dashboard-4t4c-2n-dnv.rst - -3n-dnv ------- - -VPP worker on 1t1c -`````````````````` - -.. include:: ../../../_build/_static/vpp/performance-trending-dashboard-1t1c-3n-dnv.rst - -VPP worker on 2t2c -`````````````````` - -.. include:: ../../../_build/_static/vpp/performance-trending-dashboard-2t2c-3n-dnv.rst - -VPP worker on 4t4c -`````````````````` - -.. include:: ../../../_build/_static/vpp/performance-trending-dashboard-4t4c-3n-dnv.rst - -2n-clx ------- - -VPP worker on 2t1c -`````````````````` - -.. include:: ../../../_build/_static/vpp/performance-trending-dashboard-2t1c-2n-clx.rst - -VPP worker on 4t2c -`````````````````` - -.. include:: ../../../_build/_static/vpp/performance-trending-dashboard-4t2c-2n-clx.rst - -VPP worker on 8t4c -`````````````````` - -.. include:: ../../../_build/_static/vpp/performance-trending-dashboard-8t4c-2n-clx.rst - -2n-aws ------- - -VPP worker on 2t1c -`````````````````` - -.. include:: ../../../_build/_static/vpp/performance-trending-dashboard-2t1c-2n-aws.rst - -VPP worker on 4t2c -`````````````````` - -.. include:: ../../../_build/_static/vpp/performance-trending-dashboard-4t2c-2n-aws.rst - -3n-aws ------- - -VPP worker on 2t1c -`````````````````` - -.. include:: ../../../_build/_static/vpp/performance-trending-dashboard-2t1c-3n-aws.rst - -VPP worker on 4t2c -`````````````````` - -.. include:: ../../../_build/_static/vpp/performance-trending-dashboard-4t2c-3n-aws.rst - -NDR Weekly VPP worker on 2t1c -````````````````````````````` - -.. include:: ../../../_build/_static/vpp/performance-trending-dashboard-2t1c-2n-clx-ndr.rst - -PDR Weekly VPP worker on 2t1c -````````````````````````````` - -.. include:: ../../../_build/_static/vpp/performance-trending-dashboard-2t1c-2n-clx-pdr.rst - -2n-zn2 ------- - -VPP worker on 2t1c -`````````````````` - -.. include:: ../../../_build/_static/vpp/performance-trending-dashboard-2t1c-2n-zn2.rst - -VPP worker on 4t2c -`````````````````` - -.. include:: ../../../_build/_static/vpp/performance-trending-dashboard-4t2c-2n-zn2.rst - -VPP worker on 8t4c -`````````````````` - -.. include:: ../../../_build/_static/vpp/performance-trending-dashboard-8t4c-2n-zn2.rst - -2n-tx2 ------- - -VPP worker on 2t1c -`````````````````` - -.. include:: ../../../_build/_static/vpp/performance-trending-dashboard-1t1c-2n-tx2.rst - -VPP worker on 4t2c -`````````````````` - -.. include:: ../../../_build/_static/vpp/performance-trending-dashboard-2t2c-2n-tx2.rst - -VPP worker on 8t4c -`````````````````` - -.. include:: ../../../_build/_static/vpp/performance-trending-dashboard-4t4c-2n-tx2.rst diff --git a/docs/cpta/introduction/failures.rst b/docs/cpta/introduction/failures.rst deleted file mode 100644 index 36a2d415f6..0000000000 --- a/docs/cpta/introduction/failures.rst +++ /dev/null @@ -1,104 +0,0 @@ -Failed Tests -============ - -The table lists the tests which failed over the <N=14> runs of the trending -jobs. - -Legend to the tables: - - - **Test Case**: name of FD.io CSIT test case, naming convention - `here <https://wiki.fd.io/view/CSIT/csit-test-naming>`_. - - **Failures [#]**: number of test failures over the trending period. - - **Last Failure [Time]**: timestamp of last failure. - - **Last Failure [VPP-Build-Id]**: VPP build as of last failure. - - **Last Failure [CSIT-Job-Build-Id]**: CSIT build as of last failure. - -2n-icx-mrr ----------- - -.. include:: ../../../_build/_static/vpp/failed-tests-2n-icx.rst - -2n-icx-ndrpdr -------------- - -.. include:: ../../../_build/_static/vpp/failed-tests-2n-icx-ndrpdr.rst - -3n-icx-mrr ----------- - -.. include:: ../../../_build/_static/vpp/failed-tests-3n-icx.rst - -3n-icx-ndrpdr -------------- - -.. include:: ../../../_build/_static/vpp/failed-tests-3n-icx-ndrpdr.rst - -3n-alt-mrr ----------- - -.. include:: ../../../_build/_static/vpp/failed-tests-3n-alt.rst - -2n-skx-mrr ----------- - -.. include:: ../../../_build/_static/vpp/failed-tests-2n-skx.rst - -2n-skx-ndrpdr -------------- - -.. include:: ../../../_build/_static/vpp/failed-tests-2n-skx-ndrpdr.rst - -3n-skx-mrr ----------- - -.. include:: ../../../_build/_static/vpp/failed-tests-3n-skx.rst - -3n-skx-ndrpdr -------------- - -.. include:: ../../../_build/_static/vpp/failed-tests-3n-skx-ndrpdr.rst - -3n-tsh-mrr ----------- - -.. include:: ../../../_build/_static/vpp/failed-tests-3n-tsh.rst - -2n-tx2-mrr ----------- - -.. include:: ../../../_build/_static/vpp/failed-tests-2n-tx2.rst - -2n-dnv-mrr ----------- - -.. include:: ../../../_build/_static/vpp/failed-tests-2n-dnv.rst - -3n-dnv-mrr ----------- - -.. include:: ../../../_build/_static/vpp/failed-tests-3n-dnv.rst - -2n-clx-mrr ----------- - -.. include:: ../../../_build/_static/vpp/failed-tests-2n-clx.rst - -2n-clx-ndrpdr -------------- - -.. include:: ../../../_build/_static/vpp/failed-tests-2n-clx-ndrpdr.rst - -2n-zn2-mrr ----------- - -.. include:: ../../../_build/_static/vpp/failed-tests-2n-zn2.rst - -2n-aws-mrr ----------- - -.. include:: ../../../_build/_static/vpp/failed-tests-2n-aws.rst - -3n-aws-mrr ----------- - -.. include:: ../../../_build/_static/vpp/failed-tests-3n-aws.rst diff --git a/docs/cpta/introduction/introduction.rst b/docs/cpta/introduction/introduction.rst deleted file mode 100644 index e095d8f18b..0000000000 --- a/docs/cpta/introduction/introduction.rst +++ /dev/null @@ -1,24 +0,0 @@ -Description -=========== - -Performance dashboard tables provide the latest VPP throughput trend, -trend compliance and detected anomalies, all on a per VPP test case -basis. Linked trendline graphs enable further drill-down into the -trendline compliance, sequence and nature of anomalies, as well as -pointers to performance test builds/logs and VPP (or DPDK) builds. -Performance trending is currently based on the Maximum Receive Rate (MRR) tests. -MRR tests measure the packet forwarding rate under the maximum load offered -by traffic generator over a set trial duration, regardless of packet -loss. See :ref:`trending_methodology` section for more detail including -trend and anomaly calculations. - -Data samples are generated by the CSIT VPP (and DPDK) performance trending jobs -executed twice a day (target start: every 12 hrs, 02:00, 14:00 UTC). All -trend and anomaly evaluation is based on an algorithm which divides test runs -into groups according to minimum description length principle. -The trend value is the population average of the results within a group. - -Tested VPP worker-thread-core combinations (1t1c, 2t1c, 2t2c, 4t2c, 4t4c, 8t4c) -are listed in separate tables in section 1.x. Followed by trending methodology -in section 2. and trending graphs in sections 3.x. Performance test data -used for trending graphs is provided in sections 4.x. diff --git a/docs/cpta/introduction/weekly.rst b/docs/cpta/introduction/weekly.rst deleted file mode 100644 index 861b69e941..0000000000 --- a/docs/cpta/introduction/weekly.rst +++ /dev/null @@ -1,107 +0,0 @@ -NDRPDR Weekly Comparison -======================== - -2n-icx ------- - -NDR Comparison -`````````````` - -Comparison tables in HTML, ASCII and CSV formats: - - - `HTML 2t1c NDR comparison <../_static/vpp/ndrpdr-weekly-comp-2n-icx-2t1c-ndr_in.html>`_ - - `ASCII 2t1c NDR comparison <../_static/vpp/ndrpdr-weekly-comp-2n-icx-2t1c-ndr.txt>`_ - - `CSV 2t1c NDR comparison <../_static/vpp/ndrpdr-weekly-comp-2n-icx-2t1c-ndr.csv>`_ - -PDR Comparison -`````````````` - -Comparison tables in HTML, ASCII and CSV formats: - - - `HTML 2t1c PDR comparison <../_static/vpp/ndrpdr-weekly-comp-2n-icx-2t1c-pdr_in.html>`_ - - `ASCII 2t1c PDR comparison <../_static/vpp/ndrpdr-weekly-comp-2n-icx-2t1c-pdr.txt>`_ - - `CSV 2t1c PDR comparison <../_static/vpp/ndrpdr-weekly-comp-2n-icx-2t1c-pdr.csv>`_ - -3n-icx ------- - -NDR Comparison -`````````````` - -Comparison tables in HTML, ASCII and CSV formats: - - - `HTML 2t1c NDR comparison <../_static/vpp/ndrpdr-weekly-comp-3n-icx-2t1c-ndr_in.html>`_ - - `ASCII 2t1c NDR comparison <../_static/vpp/ndrpdr-weekly-comp-3n-icx-2t1c-ndr.txt>`_ - - `CSV 2t1c NDR comparison <../_static/vpp/ndrpdr-weekly-comp-3n-icx-2t1c-ndr.csv>`_ - -PDR Comparison -`````````````` - -Comparison tables in HTML, ASCII and CSV formats: - - - `HTML 2t1c PDR comparison <../_static/vpp/ndrpdr-weekly-comp-3n-icx-2t1c-pdr_in.html>`_ - - `ASCII 2t1c PDR comparison <../_static/vpp/ndrpdr-weekly-comp-3n-icx-2t1c-pdr.txt>`_ - - `CSV 2t1c PDR comparison <../_static/vpp/ndrpdr-weekly-comp-3n-icx-2t1c-pdr.csv>`_ - -2n-skx ------- - -NDR Comparison -`````````````` - -Comparison tables in HTML, ASCII and CSV formats: - - - `HTML 2t1c NDR comparison <../_static/vpp/ndrpdr-weekly-comp-2n-skx-2t1c-ndr_in.html>`_ - - `ASCII 2t1c NDR comparison <../_static/vpp/ndrpdr-weekly-comp-2n-skx-2t1c-ndr.txt>`_ - - `CSV 2t1c NDR comparison <../_static/vpp/ndrpdr-weekly-comp-2n-skx-2t1c-ndr.csv>`_ - -PDR Comparison -`````````````` - -Comparison tables in HTML, ASCII and CSV formats: - - - `HTML 2t1c PDR comparison <../_static/vpp/ndrpdr-weekly-comp-2n-skx-2t1c-pdr_in.html>`_ - - `ASCII 2t1c PDR comparison <../_static/vpp/ndrpdr-weekly-comp-2n-skx-2t1c-pdr.txt>`_ - - `CSV 2t1c PDR comparison <../_static/vpp/ndrpdr-weekly-comp-2n-skx-2t1c-pdr.csv>`_ - -3n-skx ------- - -NDR Comparison -`````````````` - -Comparison tables in HTML, ASCII and CSV formats: - - - `HTML 2t1c NDR comparison <../_static/vpp/ndrpdr-weekly-comp-3n-skx-2t1c-ndr_in.html>`_ - - `ASCII 2t1c NDR comparison <../_static/vpp/ndrpdr-weekly-comp-3n-skx-2t1c-ndr.txt>`_ - - `CSV 2t1c NDR comparison <../_static/vpp/ndrpdr-weekly-comp-3n-skx-2t1c-ndr.csv>`_ - -PDR Comparison -`````````````` - -Comparison tables in HTML, ASCII and CSV formats: - - - `HTML 2t1c PDR comparison <../_static/vpp/ndrpdr-weekly-comp-3n-skx-2t1c-pdr_in.html>`_ - - `ASCII 2t1c PDR comparison <../_static/vpp/ndrpdr-weekly-comp-3n-skx-2t1c-pdr.txt>`_ - - `CSV 2t1c PDR comparison <../_static/vpp/ndrpdr-weekly-comp-3n-skx-2t1c-pdr.csv>`_ - -2n-clx ------- - -NDR Comparison -`````````````` - -Comparison tables in HTML, ASCII and CSV formats: - - - `HTML 2t1c NDR comparison <../_static/vpp/ndrpdr-weekly-comp-2n-clx-2t1c-ndr_in.html>`_ - - `ASCII 2t1c NDR comparison <../_static/vpp/ndrpdr-weekly-comp-2n-clx-2t1c-ndr.txt>`_ - - `CSV 2t1c NDR comparison <../_static/vpp/ndrpdr-weekly-comp-2n-clx-2t1c-ndr.csv>`_ - -PDR Comparison -`````````````` - -Comparison tables in HTML, ASCII and CSV formats: - - - `HTML 2t1c PDR comparison <../_static/vpp/ndrpdr-weekly-comp-2n-clx-2t1c-pdr_in.html>`_ - - `ASCII 2t1c PDR comparison <../_static/vpp/ndrpdr-weekly-comp-2n-clx-2t1c-pdr.txt>`_ - - `CSV 2t1c PDR comparison <../_static/vpp/ndrpdr-weekly-comp-2n-clx-2t1c-pdr.csv>`_ |