aboutsummaryrefslogtreecommitdiffstats
path: root/docs/cpta/introduction
diff options
context:
space:
mode:
authorpmikus <peter.mikus@protonmail.ch>2022-10-04 09:02:54 +0200
committerPeter Mikus <peter.mikus@protonmail.ch>2022-10-04 07:06:12 +0000
commit59734b2f72358f6315cbfadc1b1a0ef56b7e23ec (patch)
tree173ced7ea243b8da73f41bea0ac0bcc50763923f /docs/cpta/introduction
parent4aa89eb4eb3c954a5540cb70b23315ce652eef4f (diff)
feat(docs): Telemetry ressurection
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I49248625c6c829c75e5597a98b4ca73545a81bc8
Diffstat (limited to 'docs/cpta/introduction')
-rw-r--r--docs/cpta/introduction/dashboard.rst293
-rw-r--r--docs/cpta/introduction/failures.rst104
-rw-r--r--docs/cpta/introduction/introduction.rst24
-rw-r--r--docs/cpta/introduction/weekly.rst107
4 files changed, 0 insertions, 528 deletions
diff --git a/docs/cpta/introduction/dashboard.rst b/docs/cpta/introduction/dashboard.rst
deleted file mode 100644
index 9cd41816af..0000000000
--- a/docs/cpta/introduction/dashboard.rst
+++ /dev/null
@@ -1,293 +0,0 @@
-Data Plane Performance
-======================
-
-.. _Dashboard:
-
-Legend to the tables:
-
- - **Test Case**: name of FD.io CSIT test case, naming convention
- `here <https://wiki.fd.io/view/CSIT/csit-test-naming>`_.
- - **Trend [Mpps]**: Population average of the last group of runs.
- - **Runs [#]**: Number of runs belonging to the last sample group.
- - **Long-Term Change [%]**: Relative change of Last Trend vs.
- maximum of trend values over the last quarter except last week.
- - **Regressions [#]**: Number of regressions detected
- in last few runs (4 for weekly, 14 for daily).
- - **Progressions [#]**: Number of progressions detected
- in last few runs (4 for weekly, 14 for daily).
-
-For full explanation see :ref:`Trend_Compliance` document.
-
-2n-icx
-------
-
-VPP worker on 2t1c
-``````````````````
-
-.. include:: ../../../_build/_static/vpp/performance-trending-dashboard-2t1c-2n-icx.rst
-
-VPP worker on 4t2c
-``````````````````
-
-.. include:: ../../../_build/_static/vpp/performance-trending-dashboard-4t2c-2n-icx.rst
-
-VPP worker on 8t4c
-``````````````````
-
-.. include:: ../../../_build/_static/vpp/performance-trending-dashboard-8t4c-2n-icx.rst
-
-NDR Weekly VPP worker on 2t1c
-`````````````````````````````
-
-.. include:: ../../../_build/_static/vpp/performance-trending-dashboard-2t1c-2n-icx-ndr.rst
-
-PDR Weekly VPP worker on 2t1c
-`````````````````````````````
-
-.. include:: ../../../_build/_static/vpp/performance-trending-dashboard-2t1c-2n-icx-pdr.rst
-
-3n-icx
-------
-
-VPP worker on 2t1c
-``````````````````
-
-.. include:: ../../../_build/_static/vpp/performance-trending-dashboard-2t1c-3n-icx.rst
-
-VPP worker on 4t2c
-``````````````````
-
-.. include:: ../../../_build/_static/vpp/performance-trending-dashboard-4t2c-3n-icx.rst
-
-VPP worker on 8t4c
-``````````````````
-
-.. include:: ../../../_build/_static/vpp/performance-trending-dashboard-8t4c-3n-icx.rst
-
-NDR Weekly VPP worker on 2t1c
-`````````````````````````````
-
-.. include:: ../../../_build/_static/vpp/performance-trending-dashboard-2t1c-3n-icx-ndr.rst
-
-PDR Weekly VPP worker on 2t1c
-`````````````````````````````
-
-.. include:: ../../../_build/_static/vpp/performance-trending-dashboard-2t1c-3n-icx-pdr.rst
-
-3n-alt
-------
-
-VPP worker on 1t1c
-``````````````````
-
-.. include:: ../../../_build/_static/vpp/performance-trending-dashboard-1t1c-3n-alt.rst
-
-VPP worker on 2t2c
-``````````````````
-
-.. include:: ../../../_build/_static/vpp/performance-trending-dashboard-2t2c-3n-alt.rst
-
-VPP worker on 4t4c
-``````````````````
-
-.. include:: ../../../_build/_static/vpp/performance-trending-dashboard-4t4c-3n-alt.rst
-
-2n-skx
-------
-
-VPP worker on 2t1c
-``````````````````
-
-.. include:: ../../../_build/_static/vpp/performance-trending-dashboard-2t1c-2n-skx.rst
-
-VPP worker on 4t2c
-``````````````````
-
-.. include:: ../../../_build/_static/vpp/performance-trending-dashboard-4t2c-2n-skx.rst
-
-VPP worker on 8t4c
-``````````````````
-
-.. include:: ../../../_build/_static/vpp/performance-trending-dashboard-8t4c-2n-skx.rst
-
-NDR Weekly VPP worker on 2t1c
-`````````````````````````````
-
-.. include:: ../../../_build/_static/vpp/performance-trending-dashboard-2t1c-2n-skx-ndr.rst
-
-PDR Weekly VPP worker on 2t1c
-`````````````````````````````
-
-.. include:: ../../../_build/_static/vpp/performance-trending-dashboard-2t1c-2n-skx-pdr.rst
-
-3n-skx
-------
-
-VPP worker on 2t1c
-``````````````````
-
-.. include:: ../../../_build/_static/vpp/performance-trending-dashboard-2t1c-3n-skx.rst
-
-VPP worker on 4t2c
-``````````````````
-
-.. include:: ../../../_build/_static/vpp/performance-trending-dashboard-4t2c-3n-skx.rst
-
-VPP worker on 8t4c
-``````````````````
-
-.. include:: ../../../_build/_static/vpp/performance-trending-dashboard-8t4c-3n-skx.rst
-
-NDR Weekly VPP worker on 2t1c
-`````````````````````````````
-
-.. include:: ../../../_build/_static/vpp/performance-trending-dashboard-2t1c-3n-skx-ndr.rst
-
-PDR Weekly VPP worker on 2t1c
-`````````````````````````````
-
-.. include:: ../../../_build/_static/vpp/performance-trending-dashboard-2t1c-3n-skx-pdr.rst
-
-3n-tsh
-------
-
-VPP worker on 1t1c
-``````````````````
-
-.. include:: ../../../_build/_static/vpp/performance-trending-dashboard-1t1c-3n-tsh.rst
-
-VPP worker on 2t2c
-``````````````````
-
-.. include:: ../../../_build/_static/vpp/performance-trending-dashboard-2t2c-3n-tsh.rst
-
-VPP worker on 4t4c
-``````````````````
-
-.. include:: ../../../_build/_static/vpp/performance-trending-dashboard-4t4c-3n-tsh.rst
-
-2n-dnv
-------
-
-VPP worker on 1t1c
-``````````````````
-
-.. include:: ../../../_build/_static/vpp/performance-trending-dashboard-1t1c-2n-dnv.rst
-
-VPP worker on 2t2c
-``````````````````
-
-.. include:: ../../../_build/_static/vpp/performance-trending-dashboard-2t2c-2n-dnv.rst
-
-VPP worker on 4t4c
-``````````````````
-
-.. include:: ../../../_build/_static/vpp/performance-trending-dashboard-4t4c-2n-dnv.rst
-
-3n-dnv
-------
-
-VPP worker on 1t1c
-``````````````````
-
-.. include:: ../../../_build/_static/vpp/performance-trending-dashboard-1t1c-3n-dnv.rst
-
-VPP worker on 2t2c
-``````````````````
-
-.. include:: ../../../_build/_static/vpp/performance-trending-dashboard-2t2c-3n-dnv.rst
-
-VPP worker on 4t4c
-``````````````````
-
-.. include:: ../../../_build/_static/vpp/performance-trending-dashboard-4t4c-3n-dnv.rst
-
-2n-clx
-------
-
-VPP worker on 2t1c
-``````````````````
-
-.. include:: ../../../_build/_static/vpp/performance-trending-dashboard-2t1c-2n-clx.rst
-
-VPP worker on 4t2c
-``````````````````
-
-.. include:: ../../../_build/_static/vpp/performance-trending-dashboard-4t2c-2n-clx.rst
-
-VPP worker on 8t4c
-``````````````````
-
-.. include:: ../../../_build/_static/vpp/performance-trending-dashboard-8t4c-2n-clx.rst
-
-2n-aws
-------
-
-VPP worker on 2t1c
-``````````````````
-
-.. include:: ../../../_build/_static/vpp/performance-trending-dashboard-2t1c-2n-aws.rst
-
-VPP worker on 4t2c
-``````````````````
-
-.. include:: ../../../_build/_static/vpp/performance-trending-dashboard-4t2c-2n-aws.rst
-
-3n-aws
-------
-
-VPP worker on 2t1c
-``````````````````
-
-.. include:: ../../../_build/_static/vpp/performance-trending-dashboard-2t1c-3n-aws.rst
-
-VPP worker on 4t2c
-``````````````````
-
-.. include:: ../../../_build/_static/vpp/performance-trending-dashboard-4t2c-3n-aws.rst
-
-NDR Weekly VPP worker on 2t1c
-`````````````````````````````
-
-.. include:: ../../../_build/_static/vpp/performance-trending-dashboard-2t1c-2n-clx-ndr.rst
-
-PDR Weekly VPP worker on 2t1c
-`````````````````````````````
-
-.. include:: ../../../_build/_static/vpp/performance-trending-dashboard-2t1c-2n-clx-pdr.rst
-
-2n-zn2
-------
-
-VPP worker on 2t1c
-``````````````````
-
-.. include:: ../../../_build/_static/vpp/performance-trending-dashboard-2t1c-2n-zn2.rst
-
-VPP worker on 4t2c
-``````````````````
-
-.. include:: ../../../_build/_static/vpp/performance-trending-dashboard-4t2c-2n-zn2.rst
-
-VPP worker on 8t4c
-``````````````````
-
-.. include:: ../../../_build/_static/vpp/performance-trending-dashboard-8t4c-2n-zn2.rst
-
-2n-tx2
-------
-
-VPP worker on 2t1c
-``````````````````
-
-.. include:: ../../../_build/_static/vpp/performance-trending-dashboard-1t1c-2n-tx2.rst
-
-VPP worker on 4t2c
-``````````````````
-
-.. include:: ../../../_build/_static/vpp/performance-trending-dashboard-2t2c-2n-tx2.rst
-
-VPP worker on 8t4c
-``````````````````
-
-.. include:: ../../../_build/_static/vpp/performance-trending-dashboard-4t4c-2n-tx2.rst
diff --git a/docs/cpta/introduction/failures.rst b/docs/cpta/introduction/failures.rst
deleted file mode 100644
index 36a2d415f6..0000000000
--- a/docs/cpta/introduction/failures.rst
+++ /dev/null
@@ -1,104 +0,0 @@
-Failed Tests
-============
-
-The table lists the tests which failed over the <N=14> runs of the trending
-jobs.
-
-Legend to the tables:
-
- - **Test Case**: name of FD.io CSIT test case, naming convention
- `here <https://wiki.fd.io/view/CSIT/csit-test-naming>`_.
- - **Failures [#]**: number of test failures over the trending period.
- - **Last Failure [Time]**: timestamp of last failure.
- - **Last Failure [VPP-Build-Id]**: VPP build as of last failure.
- - **Last Failure [CSIT-Job-Build-Id]**: CSIT build as of last failure.
-
-2n-icx-mrr
-----------
-
-.. include:: ../../../_build/_static/vpp/failed-tests-2n-icx.rst
-
-2n-icx-ndrpdr
--------------
-
-.. include:: ../../../_build/_static/vpp/failed-tests-2n-icx-ndrpdr.rst
-
-3n-icx-mrr
-----------
-
-.. include:: ../../../_build/_static/vpp/failed-tests-3n-icx.rst
-
-3n-icx-ndrpdr
--------------
-
-.. include:: ../../../_build/_static/vpp/failed-tests-3n-icx-ndrpdr.rst
-
-3n-alt-mrr
-----------
-
-.. include:: ../../../_build/_static/vpp/failed-tests-3n-alt.rst
-
-2n-skx-mrr
-----------
-
-.. include:: ../../../_build/_static/vpp/failed-tests-2n-skx.rst
-
-2n-skx-ndrpdr
--------------
-
-.. include:: ../../../_build/_static/vpp/failed-tests-2n-skx-ndrpdr.rst
-
-3n-skx-mrr
-----------
-
-.. include:: ../../../_build/_static/vpp/failed-tests-3n-skx.rst
-
-3n-skx-ndrpdr
--------------
-
-.. include:: ../../../_build/_static/vpp/failed-tests-3n-skx-ndrpdr.rst
-
-3n-tsh-mrr
-----------
-
-.. include:: ../../../_build/_static/vpp/failed-tests-3n-tsh.rst
-
-2n-tx2-mrr
-----------
-
-.. include:: ../../../_build/_static/vpp/failed-tests-2n-tx2.rst
-
-2n-dnv-mrr
-----------
-
-.. include:: ../../../_build/_static/vpp/failed-tests-2n-dnv.rst
-
-3n-dnv-mrr
-----------
-
-.. include:: ../../../_build/_static/vpp/failed-tests-3n-dnv.rst
-
-2n-clx-mrr
-----------
-
-.. include:: ../../../_build/_static/vpp/failed-tests-2n-clx.rst
-
-2n-clx-ndrpdr
--------------
-
-.. include:: ../../../_build/_static/vpp/failed-tests-2n-clx-ndrpdr.rst
-
-2n-zn2-mrr
-----------
-
-.. include:: ../../../_build/_static/vpp/failed-tests-2n-zn2.rst
-
-2n-aws-mrr
-----------
-
-.. include:: ../../../_build/_static/vpp/failed-tests-2n-aws.rst
-
-3n-aws-mrr
-----------
-
-.. include:: ../../../_build/_static/vpp/failed-tests-3n-aws.rst
diff --git a/docs/cpta/introduction/introduction.rst b/docs/cpta/introduction/introduction.rst
deleted file mode 100644
index e095d8f18b..0000000000
--- a/docs/cpta/introduction/introduction.rst
+++ /dev/null
@@ -1,24 +0,0 @@
-Description
-===========
-
-Performance dashboard tables provide the latest VPP throughput trend,
-trend compliance and detected anomalies, all on a per VPP test case
-basis. Linked trendline graphs enable further drill-down into the
-trendline compliance, sequence and nature of anomalies, as well as
-pointers to performance test builds/logs and VPP (or DPDK) builds.
-Performance trending is currently based on the Maximum Receive Rate (MRR) tests.
-MRR tests measure the packet forwarding rate under the maximum load offered
-by traffic generator over a set trial duration, regardless of packet
-loss. See :ref:`trending_methodology` section for more detail including
-trend and anomaly calculations.
-
-Data samples are generated by the CSIT VPP (and DPDK) performance trending jobs
-executed twice a day (target start: every 12 hrs, 02:00, 14:00 UTC). All
-trend and anomaly evaluation is based on an algorithm which divides test runs
-into groups according to minimum description length principle.
-The trend value is the population average of the results within a group.
-
-Tested VPP worker-thread-core combinations (1t1c, 2t1c, 2t2c, 4t2c, 4t4c, 8t4c)
-are listed in separate tables in section 1.x. Followed by trending methodology
-in section 2. and trending graphs in sections 3.x. Performance test data
-used for trending graphs is provided in sections 4.x.
diff --git a/docs/cpta/introduction/weekly.rst b/docs/cpta/introduction/weekly.rst
deleted file mode 100644
index 861b69e941..0000000000
--- a/docs/cpta/introduction/weekly.rst
+++ /dev/null
@@ -1,107 +0,0 @@
-NDRPDR Weekly Comparison
-========================
-
-2n-icx
-------
-
-NDR Comparison
-``````````````
-
-Comparison tables in HTML, ASCII and CSV formats:
-
- - `HTML 2t1c NDR comparison <../_static/vpp/ndrpdr-weekly-comp-2n-icx-2t1c-ndr_in.html>`_
- - `ASCII 2t1c NDR comparison <../_static/vpp/ndrpdr-weekly-comp-2n-icx-2t1c-ndr.txt>`_
- - `CSV 2t1c NDR comparison <../_static/vpp/ndrpdr-weekly-comp-2n-icx-2t1c-ndr.csv>`_
-
-PDR Comparison
-``````````````
-
-Comparison tables in HTML, ASCII and CSV formats:
-
- - `HTML 2t1c PDR comparison <../_static/vpp/ndrpdr-weekly-comp-2n-icx-2t1c-pdr_in.html>`_
- - `ASCII 2t1c PDR comparison <../_static/vpp/ndrpdr-weekly-comp-2n-icx-2t1c-pdr.txt>`_
- - `CSV 2t1c PDR comparison <../_static/vpp/ndrpdr-weekly-comp-2n-icx-2t1c-pdr.csv>`_
-
-3n-icx
-------
-
-NDR Comparison
-``````````````
-
-Comparison tables in HTML, ASCII and CSV formats:
-
- - `HTML 2t1c NDR comparison <../_static/vpp/ndrpdr-weekly-comp-3n-icx-2t1c-ndr_in.html>`_
- - `ASCII 2t1c NDR comparison <../_static/vpp/ndrpdr-weekly-comp-3n-icx-2t1c-ndr.txt>`_
- - `CSV 2t1c NDR comparison <../_static/vpp/ndrpdr-weekly-comp-3n-icx-2t1c-ndr.csv>`_
-
-PDR Comparison
-``````````````
-
-Comparison tables in HTML, ASCII and CSV formats:
-
- - `HTML 2t1c PDR comparison <../_static/vpp/ndrpdr-weekly-comp-3n-icx-2t1c-pdr_in.html>`_
- - `ASCII 2t1c PDR comparison <../_static/vpp/ndrpdr-weekly-comp-3n-icx-2t1c-pdr.txt>`_
- - `CSV 2t1c PDR comparison <../_static/vpp/ndrpdr-weekly-comp-3n-icx-2t1c-pdr.csv>`_
-
-2n-skx
-------
-
-NDR Comparison
-``````````````
-
-Comparison tables in HTML, ASCII and CSV formats:
-
- - `HTML 2t1c NDR comparison <../_static/vpp/ndrpdr-weekly-comp-2n-skx-2t1c-ndr_in.html>`_
- - `ASCII 2t1c NDR comparison <../_static/vpp/ndrpdr-weekly-comp-2n-skx-2t1c-ndr.txt>`_
- - `CSV 2t1c NDR comparison <../_static/vpp/ndrpdr-weekly-comp-2n-skx-2t1c-ndr.csv>`_
-
-PDR Comparison
-``````````````
-
-Comparison tables in HTML, ASCII and CSV formats:
-
- - `HTML 2t1c PDR comparison <../_static/vpp/ndrpdr-weekly-comp-2n-skx-2t1c-pdr_in.html>`_
- - `ASCII 2t1c PDR comparison <../_static/vpp/ndrpdr-weekly-comp-2n-skx-2t1c-pdr.txt>`_
- - `CSV 2t1c PDR comparison <../_static/vpp/ndrpdr-weekly-comp-2n-skx-2t1c-pdr.csv>`_
-
-3n-skx
-------
-
-NDR Comparison
-``````````````
-
-Comparison tables in HTML, ASCII and CSV formats:
-
- - `HTML 2t1c NDR comparison <../_static/vpp/ndrpdr-weekly-comp-3n-skx-2t1c-ndr_in.html>`_
- - `ASCII 2t1c NDR comparison <../_static/vpp/ndrpdr-weekly-comp-3n-skx-2t1c-ndr.txt>`_
- - `CSV 2t1c NDR comparison <../_static/vpp/ndrpdr-weekly-comp-3n-skx-2t1c-ndr.csv>`_
-
-PDR Comparison
-``````````````
-
-Comparison tables in HTML, ASCII and CSV formats:
-
- - `HTML 2t1c PDR comparison <../_static/vpp/ndrpdr-weekly-comp-3n-skx-2t1c-pdr_in.html>`_
- - `ASCII 2t1c PDR comparison <../_static/vpp/ndrpdr-weekly-comp-3n-skx-2t1c-pdr.txt>`_
- - `CSV 2t1c PDR comparison <../_static/vpp/ndrpdr-weekly-comp-3n-skx-2t1c-pdr.csv>`_
-
-2n-clx
-------
-
-NDR Comparison
-``````````````
-
-Comparison tables in HTML, ASCII and CSV formats:
-
- - `HTML 2t1c NDR comparison <../_static/vpp/ndrpdr-weekly-comp-2n-clx-2t1c-ndr_in.html>`_
- - `ASCII 2t1c NDR comparison <../_static/vpp/ndrpdr-weekly-comp-2n-clx-2t1c-ndr.txt>`_
- - `CSV 2t1c NDR comparison <../_static/vpp/ndrpdr-weekly-comp-2n-clx-2t1c-ndr.csv>`_
-
-PDR Comparison
-``````````````
-
-Comparison tables in HTML, ASCII and CSV formats:
-
- - `HTML 2t1c PDR comparison <../_static/vpp/ndrpdr-weekly-comp-2n-clx-2t1c-pdr_in.html>`_
- - `ASCII 2t1c PDR comparison <../_static/vpp/ndrpdr-weekly-comp-2n-clx-2t1c-pdr.txt>`_
- - `CSV 2t1c PDR comparison <../_static/vpp/ndrpdr-weekly-comp-2n-clx-2t1c-pdr.csv>`_