From 0bc9c329e559da689056e48d3036ef647456c3bc Mon Sep 17 00:00:00 2001 From: Tibor Frank Date: Tue, 26 May 2020 15:52:55 +0200 Subject: Report: configure report rls2005 Ticket: CSIT-1722 Type: feature Change-Id: I76f7f323f000cbfc802c6206b6232665bb88448c Signed-off-by: Tibor Frank (cherry picked from commit 7248cf97d0f950cda2e1167478d44455e03ddc8d) --- docs/report/index.html.template | 2 +- docs/report/index.pdf.template | 2 +- docs/report/introduction/report_history.rst | 118 +----------- .../comparisons/current_vs_previous_release.rst | 197 +++++++++++---------- 4 files changed, 103 insertions(+), 216 deletions(-) (limited to 'docs') diff --git a/docs/report/index.html.template b/docs/report/index.html.template index c89f7525c7..9ec3017ccd 100644 --- a/docs/report/index.html.template +++ b/docs/report/index.html.template @@ -1,4 +1,4 @@ -CSIT-2001 +CSIT-2005 ========= .. toctree:: diff --git a/docs/report/index.pdf.template b/docs/report/index.pdf.template index a43be43ad9..54d4f85a47 100644 --- a/docs/report/index.pdf.template +++ b/docs/report/index.pdf.template @@ -1,4 +1,4 @@ -CSIT-2001 +CSIT-2005 ========= .. toctree:: diff --git a/docs/report/introduction/report_history.rst b/docs/report/introduction/report_history.rst index f7d92b57c7..3e60fa64cf 100644 --- a/docs/report/introduction/report_history.rst +++ b/docs/report/introduction/report_history.rst @@ -1,126 +1,12 @@ Report History ============== -FD.io CSIT-2001 Report history and per .[ww] revision changes are listed below. +FD.io CSIT-2005 Report history and per .[ww] revision changes are listed below. +----------------+------------------------------------------------------------+ | .[ww] Revision | Changes | +================+============================================================+ -| .20 | 1. Added data: | -| | | -| | - VPP performance tests 2n-skx | -| | | -| | - all set selected for analysis and graphs | -| | - MRR tests | -| | | -| | - VPP performance tests 3n-skx | -| | | -| | - all set selected for analysis and graphs | -| | - MRR tests | -| | | -| | - test sets: crypto, L2, IPv6, memif, vhost, IPv4 | -| | | -| | - Hoststack 3n-hsw tests | -| | | -| | - Reconfiguration Tests 2n-skx | -| | | -| | - Soak Tests 2n-skx | -| | | -| | 2. Added Root Cause Analysis for VPP performance tests | -| | 2n-skx and 3n-skx. | -| | | -+----------------+------------------------------------------------------------+ -| .19 | Skipped. | -+----------------+------------------------------------------------------------+ -| .18 | Skipped. | -+----------------+------------------------------------------------------------+ -| .17 | Skipped. | -+----------------+------------------------------------------------------------+ -| .16 | Skipped. | -+----------------+------------------------------------------------------------+ -| .15 | Skipped. | -+----------------+------------------------------------------------------------+ -| .14 | Skipped. | -+----------------+------------------------------------------------------------+ -| .13 | Skipped. | -+----------------+------------------------------------------------------------+ -| .12 | Skipped. | -+----------------+------------------------------------------------------------+ -| .11 | 1. Added Soak tests | -| | | -| | 2. Added data: | -| | | -| | - VPP performance tests 3n-tsh | -| | | -| | - all set selected for analysis and graphs | -| | | -+----------------+------------------------------------------------------------+ -| .10 | 1. Added data: | -| | | -| | - VPP performance tests 3n-hsw | -| | | -| | - test sets IP4, IPSec | -| | - sets selected for analysis and graphs | -| | | -| | - VPP performance tests 2n-clx | -| | | -| | - test sets IP4, IP6, L2, Memif, loadbalancer, VHost | -| | VTS | -| | - all sets selected for analysis and graphs | -| | | -| | 2. Added reconfiguration tests: | -| | | -| | - 2n-clx | -| | | -| | 3. Added Hoststack tests | -| | | -| | 4. Edited Test Methodology --> Hoststack Testing | -| | | -| | 5. Added TCP/IP tests | -| | | -+----------------+------------------------------------------------------------+ -| .09 | 1. Added data: | -| | | -| | - VPP performance tests 3n-hsw | -| | | -| | - test sets IP4, L2, VHost | -| | | -| | - VPP performance tests 2n-clx | -| | | -| | - test sets IP4, IP6, L2 | -| | - all sets selected for analysis and graphs | -| | | -| | - VPP performance tests 3n-dnv | -| | | -| | - test sets IPSec, IP4 Tunnels | -| | | -| | - VPP performance tests 3n-tsh | -| | | -| | - all set selected for analysis and graphs | -| | | -| | - VPP MRR tests 2n-clx | -| | | -| | - all sets selected for analysis and graphs | -| | | -| | - DPDK performance tests 2n-clx | -| | | -| | - all sets selected for analysis and graphs | -| | | -+----------------+------------------------------------------------------------+ -| .08 | 1. Added PDF version | -| | | -| | 2. Added data: | -| | | -| | - VPP performance tests 3n-hsw | -| | - VPP performance tests 3n-tsh | -| | - VPP MRR tests 3n-tsh | -| | - DPDK performance tests 3n-tsh | -| | | -| | 3. Chapters "Detailed Results", "Test Configuration" and | -| | "Test Operational Data" split into sub-chapters. | -| | | -+----------------+------------------------------------------------------------+ -| .07 | Initial version | +| .23 | Initial version | | | | +----------------+------------------------------------------------------------+ diff --git a/docs/report/vpp_performance_tests/comparisons/current_vs_previous_release.rst b/docs/report/vpp_performance_tests/comparisons/current_vs_previous_release.rst index 2dcec8834d..a6d0ce0c8d 100644 --- a/docs/report/vpp_performance_tests/comparisons/current_vs_previous_release.rst +++ b/docs/report/vpp_performance_tests/comparisons/current_vs_previous_release.rst @@ -38,59 +38,60 @@ results repeatability vary between the test cases. 2n-skx ~~~~~~ -NDR Comparison with RCA -``````````````````````` +.. + NDR Comparison with RCA + ``````````````````````` -Comparison tables in HTML, ASCII and CSV formats: + Comparison tables in HTML, ASCII and CSV formats: - - `HTML 2t1c NDR RCA `_ - - `ASCII 2t1c NDR RCA <../../_static/vpp/performance-rca-2n-skx-2t1c-ndr.txt>`_ - - `CSV 2t1c NDR RCA <../../_static/vpp/performance-rca-2n-skx-2t1c-ndr-csv.csv>`_ + - `HTML 2t1c NDR RCA `_ + - `ASCII 2t1c NDR RCA <../../_static/vpp/performance-rca-2n-skx-2t1c-ndr.txt>`_ + - `CSV 2t1c NDR RCA <../../_static/vpp/performance-rca-2n-skx-2t1c-ndr-csv.csv>`_ -PDR Comparison with RCA -``````````````````````` + PDR Comparison with RCA + ``````````````````````` -Comparison tables in HTML, ASCII and CSV formats: + Comparison tables in HTML, ASCII and CSV formats: - - `HTML 2t1c PDR RCA `_ - - `ASCII 2t1c PDR RCA <../../_static/vpp/performance-rca-2n-skx-2t1c-pdr.txt>`_ - - `CSV 2t1c PDR RCA <../../_static/vpp/performance-rca-2n-skx-2t1c-pdr-csv.csv>`_ + - `HTML 2t1c PDR RCA `_ + - `ASCII 2t1c PDR RCA <../../_static/vpp/performance-rca-2n-skx-2t1c-pdr.txt>`_ + - `CSV 2t1c PDR RCA <../../_static/vpp/performance-rca-2n-skx-2t1c-pdr-csv.csv>`_ -.. - NDR Comparison - `````````````` +NDR Comparison +`````````````` - Comparison tables in HTML, ASCII and CSV formats: +Comparison tables in HTML, ASCII and CSV formats: - - `HTML 2t1c NDR comparison `_ - - `HTML 4t2c NDR comparison `_ - - `ASCII 2t1c NDR comparison <../../_static/vpp/performance-changes-2n-skx-2t1c-ndr.txt>`_ - - `ASCII 4t2c NDR comparison <../../_static/vpp/performance-changes-2n-skx-4t2c-ndr.txt>`_ - - `CSV 2t1c NDR comparison <../../_static/vpp/performance-changes-2n-skx-2t1c-ndr.csv>`_ - - `CSV 4t2c NDR comparison <../../_static/vpp/performance-changes-2n-skx-4t2c-ndr.csv>`_ - - - `HTML 2t1c NFV Service Density NDR comparison `_ - - `HTML 4t2c NFV Service Density NDR comparison `_ - - `HTML 8t4c NFV Service Density NDR comparison `_ - - `ASCII 2t1c NFV Service Density NDR comparison <../../_static/vpp/performance-changes-nfv-2n-skx-2t1c-ndr.txt>`_ - - `ASCII 4t2c NFV Service Density NDR comparison <../../_static/vpp/performance-changes-nfv-2n-skx-4t2c-ndr.txt>`_ - - `ASCII 8t4c NFV Service Density NDR comparison <../../_static/vpp/performance-changes-nfv-2n-skx-8t4c-ndr.txt>`_ - - `CSV 2t1c NFV Service Density NDR comparison <../../_static/vpp/performance-changes-nfv-2n-skx-2t1c-ndr.csv>`_ - - `CSV 4t2c NFV Service Density NDR comparison <../../_static/vpp/performance-changes-nfv-2n-skx-4t2c-ndr.csv>`_ - - `CSV 8t4c NFV Service Density NDR comparison <../../_static/vpp/performance-changes-nfv-2n-skx-8t4c-ndr.csv>`_ - - PDR Comparison - `````````````` + - `HTML 2t1c NDR comparison `_ + - `HTML 4t2c NDR comparison `_ + - `ASCII 2t1c NDR comparison <../../_static/vpp/performance-changes-2n-skx-2t1c-ndr.txt>`_ + - `ASCII 4t2c NDR comparison <../../_static/vpp/performance-changes-2n-skx-4t2c-ndr.txt>`_ + - `CSV 2t1c NDR comparison <../../_static/vpp/performance-changes-2n-skx-2t1c-ndr.csv>`_ + - `CSV 4t2c NDR comparison <../../_static/vpp/performance-changes-2n-skx-4t2c-ndr.csv>`_ + + - `HTML 2t1c NFV Service Density NDR comparison `_ + - `HTML 4t2c NFV Service Density NDR comparison `_ + - `HTML 8t4c NFV Service Density NDR comparison `_ + - `ASCII 2t1c NFV Service Density NDR comparison <../../_static/vpp/performance-changes-nfv-2n-skx-2t1c-ndr.txt>`_ + - `ASCII 4t2c NFV Service Density NDR comparison <../../_static/vpp/performance-changes-nfv-2n-skx-4t2c-ndr.txt>`_ + - `ASCII 8t4c NFV Service Density NDR comparison <../../_static/vpp/performance-changes-nfv-2n-skx-8t4c-ndr.txt>`_ + - `CSV 2t1c NFV Service Density NDR comparison <../../_static/vpp/performance-changes-nfv-2n-skx-2t1c-ndr.csv>`_ + - `CSV 4t2c NFV Service Density NDR comparison <../../_static/vpp/performance-changes-nfv-2n-skx-4t2c-ndr.csv>`_ + - `CSV 8t4c NFV Service Density NDR comparison <../../_static/vpp/performance-changes-nfv-2n-skx-8t4c-ndr.csv>`_ - Comparison tables in HTML, ASCII and CSV formats: +PDR Comparison +`````````````` + +Comparison tables in HTML, ASCII and CSV formats: - - `HTML 2t1c PDR comparison `_ - - `HTML 4t2c PDR comparison `_ - - `ASCII 2t1c PDR comparison <../../_static/vpp/performance-changes-2n-skx-2t1c-pdr.txt>`_ - - `ASCII 4t2c PDR comparison <../../_static/vpp/performance-changes-2n-skx-4t2c-pdr.txt>`_ - - `CSV 2t1c PDR comparison <../../_static/vpp/performance-changes-2n-skx-2t1c-pdr.csv>`_ - - `CSV 4t2c PDR comparison <../../_static/vpp/performance-changes-2n-skx-4t2c-pdr.csv>`_ + - `HTML 2t1c PDR comparison `_ + - `HTML 4t2c PDR comparison `_ + - `ASCII 2t1c PDR comparison <../../_static/vpp/performance-changes-2n-skx-2t1c-pdr.txt>`_ + - `ASCII 4t2c PDR comparison <../../_static/vpp/performance-changes-2n-skx-4t2c-pdr.txt>`_ + - `CSV 2t1c PDR comparison <../../_static/vpp/performance-changes-2n-skx-2t1c-pdr.csv>`_ + - `CSV 4t2c PDR comparison <../../_static/vpp/performance-changes-2n-skx-4t2c-pdr.csv>`_ +.. - `HTML 2t1c NFV Service Density PDR comparison `_ - `HTML 4t2c NFV Service Density PDR comparison `_ - `HTML 8t4c NFV Service Density PDR comparison `_ @@ -101,22 +102,22 @@ Comparison tables in HTML, ASCII and CSV formats: - `CSV 4t2c NFV Service Density PDR comparison <../../_static/vpp/performance-changes-nfv-2n-skx-4t2c-pdr.csv>`_ - `CSV 8t4c NFV Service Density PDR comparison <../../_static/vpp/performance-changes-nfv-2n-skx-8t4c-pdr.csv>`_ - MRR Comparison - `````````````` - - Comparison tables in HTML, ASCII and CSV formats: +MRR Comparison +`````````````` - - `HTML 2t1c MRR comparison `_ - - `HTML 4t2c MRR comparison `_ - - `HTML 8t4c MRR comparison `_ - - `ASCII 2t1c MRR comparison <../../_static/vpp/performance-changes-2n-skx-2t1c-mrr.txt>`_ - - `ASCII 4t2c MRR comparison <../../_static/vpp/performance-changes-2n-skx-4t2c-mrr.txt>`_ - - `ASCII 8t4c MRR comparison <../../_static/vpp/performance-changes-2n-skx-8t4c-mrr.txt>`_ - - `CSV 2t1c MRR comparison <../../_static/vpp/performance-changes-2n-skx-2t1c-mrr.csv>`_ - - `CSV 4t2c MRR comparison <../../_static/vpp/performance-changes-2n-skx-4t2c-mrr.csv>`_ - - `CSV 8t4c MRR comparison <../../_static/vpp/performance-changes-2n-skx-8t4c-mrr.csv>`_ +Comparison tables in HTML, ASCII and CSV formats: + - `HTML 2t1c MRR comparison `_ + - `HTML 4t2c MRR comparison `_ + - `HTML 8t4c MRR comparison `_ + - `ASCII 2t1c MRR comparison <../../_static/vpp/performance-changes-2n-skx-2t1c-mrr.txt>`_ + - `ASCII 4t2c MRR comparison <../../_static/vpp/performance-changes-2n-skx-4t2c-mrr.txt>`_ + - `ASCII 8t4c MRR comparison <../../_static/vpp/performance-changes-2n-skx-8t4c-mrr.txt>`_ + - `CSV 2t1c MRR comparison <../../_static/vpp/performance-changes-2n-skx-2t1c-mrr.csv>`_ + - `CSV 4t2c MRR comparison <../../_static/vpp/performance-changes-2n-skx-4t2c-mrr.csv>`_ + - `CSV 8t4c MRR comparison <../../_static/vpp/performance-changes-2n-skx-8t4c-mrr.csv>`_ +.. - `HTML 2t1c NFV Service Density MRR comparison `_ - `HTML 4t2c NFV Service Density MRR comparison `_ - `HTML 8t4c NFV Service Density MRR comparison `_ @@ -130,63 +131,63 @@ Comparison tables in HTML, ASCII and CSV formats: 3n-skx ~~~~~~ -NDR Comparison with RCA -``````````````````````` +.. + NDR Comparison with RCA + ``````````````````````` -Comparison tables in HTML, ASCII and CSV formats: + Comparison tables in HTML, ASCII and CSV formats: - - `HTML 2t1c NDR RCA `_ - - `ASCII 2t1c NDR RCA <../../_static/vpp/performance-rca-3n-skx-2t1c-ndr.txt>`_ - - `CSV 2t1c NDR RCA <../../_static/vpp/performance-rca-3n-skx-2t1c-ndr-csv.csv>`_ + - `HTML 2t1c NDR RCA `_ + - `ASCII 2t1c NDR RCA <../../_static/vpp/performance-rca-3n-skx-2t1c-ndr.txt>`_ + - `CSV 2t1c NDR RCA <../../_static/vpp/performance-rca-3n-skx-2t1c-ndr-csv.csv>`_ -PDR Comparison with RCA -``````````````````````` + PDR Comparison with RCA + ``````````````````````` -Comparison tables in HTML, ASCII and CSV formats: + Comparison tables in HTML, ASCII and CSV formats: - - `HTML 2t1c PDR RCA `_ - - `ASCII 2t1c PDR RCA <../../_static/vpp/performance-rca-3n-skx-2t1c-pdr.txt>`_ - - `CSV 2t1c PDR RCA <../../_static/vpp/performance-rca-3n-skx-2t1c-pdr-csv.csv>`_ + - `HTML 2t1c PDR RCA `_ + - `ASCII 2t1c PDR RCA <../../_static/vpp/performance-rca-3n-skx-2t1c-pdr.txt>`_ + - `CSV 2t1c PDR RCA <../../_static/vpp/performance-rca-3n-skx-2t1c-pdr-csv.csv>`_ -.. - NDR Comparison - `````````````` +NDR Comparison +`````````````` - Comparison tables in HTML, ASCII and CSV formats: +Comparison tables in HTML, ASCII and CSV formats: - - `HTML 2t1c NDR comparison `_ - - `HTML 4t2c NDR comparison `_ - - `ASCII 2t1c NDR comparison <../../_static/vpp/performance-changes-3n-skx-2t1c-ndr.txt>`_ - - `ASCII 4t2c NDR comparison <../../_static/vpp/performance-changes-3n-skx-4t2c-ndr.txt>`_ - - `CSV 2t1c NDR comparison <../../_static/vpp/performance-changes-3n-skx-2t1c-ndr.csv>`_ - - `CSV 4t2c NDR comparison <../../_static/vpp/performance-changes-3n-skx-4t2c-ndr.csv>`_ + - `HTML 2t1c NDR comparison `_ + - `HTML 4t2c NDR comparison `_ + - `ASCII 2t1c NDR comparison <../../_static/vpp/performance-changes-3n-skx-2t1c-ndr.txt>`_ + - `ASCII 4t2c NDR comparison <../../_static/vpp/performance-changes-3n-skx-4t2c-ndr.txt>`_ + - `CSV 2t1c NDR comparison <../../_static/vpp/performance-changes-3n-skx-2t1c-ndr.csv>`_ + - `CSV 4t2c NDR comparison <../../_static/vpp/performance-changes-3n-skx-4t2c-ndr.csv>`_ - PDR Comparison - `````````````` +PDR Comparison +`````````````` - Comparison tables in HTML, ASCII and CSV formats: +Comparison tables in HTML, ASCII and CSV formats: - - `HTML 2t1c PDR comparison `_ - - `HTML 4t2c PDR comparison `_ - - `ASCII 2t1c PDR comparison <../../_static/vpp/performance-changes-3n-skx-2t1c-pdr.txt>`_ - - `ASCII 4t2c PDR comparison <../../_static/vpp/performance-changes-3n-skx-4t2c-pdr.txt>`_ - - `CSV 2t1c PDR comparison <../../_static/vpp/performance-changes-3n-skx-2t1c-pdr.csv>`_ - - `CSV 4t2c PDR comparison <../../_static/vpp/performance-changes-3n-skx-4t2c-pdr.csv>`_ + - `HTML 2t1c PDR comparison `_ + - `HTML 4t2c PDR comparison `_ + - `ASCII 2t1c PDR comparison <../../_static/vpp/performance-changes-3n-skx-2t1c-pdr.txt>`_ + - `ASCII 4t2c PDR comparison <../../_static/vpp/performance-changes-3n-skx-4t2c-pdr.txt>`_ + - `CSV 2t1c PDR comparison <../../_static/vpp/performance-changes-3n-skx-2t1c-pdr.csv>`_ + - `CSV 4t2c PDR comparison <../../_static/vpp/performance-changes-3n-skx-4t2c-pdr.csv>`_ - MRR Comparison - `````````````` +MRR Comparison +`````````````` - Comparison tables in HTML, ASCII and CSV formats: +Comparison tables in HTML, ASCII and CSV formats: - - `HTML 2t1c MRR comparison `_ - - `HTML 4t2c MRR comparison `_ - - `HTML 8t4c MRR comparison `_ - - `ASCII 2t1c MRR comparison <../../_static/vpp/performance-changes-3n-skx-2t1c-mrr.txt>`_ - - `ASCII 4t2c MRR comparison <../../_static/vpp/performance-changes-3n-skx-4t2c-mrr.txt>`_ - - `ASCII 8t4c MRR comparison <../../_static/vpp/performance-changes-3n-skx-8t4c-mrr.txt>`_ - - `CSV 2t1c MRR comparison <../../_static/vpp/performance-changes-3n-skx-2t1c-mrr.csv>`_ - - `CSV 4t2c MRR comparison <../../_static/vpp/performance-changes-3n-skx-4t2c-mrr.csv>`_ - - `CSV 8t4c MRR comparison <../../_static/vpp/performance-changes-3n-skx-8t4c-mrr.csv>`_ + - `HTML 2t1c MRR comparison `_ + - `HTML 4t2c MRR comparison `_ + - `HTML 8t4c MRR comparison `_ + - `ASCII 2t1c MRR comparison <../../_static/vpp/performance-changes-3n-skx-2t1c-mrr.txt>`_ + - `ASCII 4t2c MRR comparison <../../_static/vpp/performance-changes-3n-skx-4t2c-mrr.txt>`_ + - `ASCII 8t4c MRR comparison <../../_static/vpp/performance-changes-3n-skx-8t4c-mrr.txt>`_ + - `CSV 2t1c MRR comparison <../../_static/vpp/performance-changes-3n-skx-2t1c-mrr.csv>`_ + - `CSV 4t2c MRR comparison <../../_static/vpp/performance-changes-3n-skx-4t2c-mrr.csv>`_ + - `CSV 8t4c MRR comparison <../../_static/vpp/performance-changes-3n-skx-8t4c-mrr.csv>`_ 3n-hsw ~~~~~~ -- cgit 1.2.3-korg