From e1ac55281241ef8705be5919dcb034a0376c6c32 Mon Sep 17 00:00:00 2001 From: Tibor Frank Date: Wed, 25 Jan 2023 14:00:04 +0100 Subject: Report: Add Trex comparisons Signed-off-by: Tibor Frank Change-Id: Id6e0c66bc1b09f546ae047840cfeeb68012a982c (cherry picked from commit b828c1b7f96ed1350276237a7b7bda05fad3d866) --- .../comparisons/current_vs_previous_release.rst | 53 ++++++++++++++++++++++ .../trex_performance_tests/comparisons/index.rst | 11 +++++ docs/report/trex_performance_tests/index.rst | 1 + 3 files changed, 65 insertions(+) create mode 100644 docs/report/trex_performance_tests/comparisons/current_vs_previous_release.rst create mode 100644 docs/report/trex_performance_tests/comparisons/index.rst (limited to 'docs/report/trex_performance_tests') diff --git a/docs/report/trex_performance_tests/comparisons/current_vs_previous_release.rst b/docs/report/trex_performance_tests/comparisons/current_vs_previous_release.rst new file mode 100644 index 0000000000..a55918ff94 --- /dev/null +++ b/docs/report/trex_performance_tests/comparisons/current_vs_previous_release.rst @@ -0,0 +1,53 @@ +Current vs Previous Release +--------------------------- + +Listed mean and standard deviation values are computed based on a series +of the same tests executed against respective VPP releases to verify +test results repeatability, with percentage change calculated for mean +values. Note that the standard deviation is quite high for a small +number of packet throughput tests, what indicates poor test results +repeatability and makes the relative change of mean throughput value not +fully representative for these tests. The root causes behind poor +results repeatability vary between the test cases. + +1n-aws-nitro50g +~~~~~~~~~~~~~~~ + +NDR Comparison +`````````````` + +Comparison tables in HTML, ASCII and CSV formats: + + - `HTML NDR comparison `_ + - `ASCII NDR comparison <../../_static/trex/performance-changes-1n-aws-ndr.txt>`_ + - `CSV NDR comparison <../../_static/trex/performance-changes-1n-aws-ndr-csv.csv>`_ + +PDR Comparison +`````````````` + +Comparison tables in HTML, ASCII and CSV formats: + + - `HTML PDR comparison `_ + - `ASCII PDR comparison <../../_static/trex/performance-changes-1n-aws-pdr.txt>`_ + - `CSV PDR comparison <../../_static/trex/performance-changes-1n-aws-pdr-csv.csv>`_ + +2n-icx-e810cq +~~~~~~~~~~~~~ + +NDR Comparison +`````````````` + +Comparison tables in HTML, ASCII and CSV formats: + + - `HTML NDR comparison `_ + - `ASCII NDR comparison <../../_static/trex/performance-changes-2n-icx-ndr.txt>`_ + - `CSV NDR comparison <../../_static/trex/performance-changes-2n-icx-ndr-csv.csv>`_ + +PDR Comparison +`````````````` + +Comparison tables in HTML, ASCII and CSV formats: + + - `HTML PDR comparison `_ + - `ASCII PDR comparison <../../_static/trex/performance-changes-2n-icx-pdr.txt>`_ + - `CSV PDR comparison <../../_static/trex/performance-changes-2n-icx-pdr-csv.csv>`_ diff --git a/docs/report/trex_performance_tests/comparisons/index.rst b/docs/report/trex_performance_tests/comparisons/index.rst new file mode 100644 index 0000000000..28672f8fb1 --- /dev/null +++ b/docs/report/trex_performance_tests/comparisons/index.rst @@ -0,0 +1,11 @@ + +.. raw:: latex + + \clearpage + +Comparisons +=========== + +.. toctree:: + + current_vs_previous_release diff --git a/docs/report/trex_performance_tests/index.rst b/docs/report/trex_performance_tests/index.rst index 48e3aeada5..024d31c2a0 100644 --- a/docs/report/trex_performance_tests/index.rst +++ b/docs/report/trex_performance_tests/index.rst @@ -6,6 +6,7 @@ TRex Performance overview csit_release_notes packet_throughput_graphs/index + comparisons/index throughput_trending test_environment -- cgit 1.2.3-korg