aboutsummaryrefslogtreecommitdiffstats
path: root/resources/tools/presentation/generator_tables.py
AgeCommit message (Collapse)AuthorFilesLines
2020-04-15PAL: Integrate new comp tables 2Tibor Frank1-97/+95
Change-Id: Id7267f5ab13a362894c5fe5a2ae40d51d4b5a36d Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-04-09PAL: Integrate new comp tablesTibor Frank1-86/+476
Change-Id: Ibadf4fabb69bdd9d2412ed8f33c97ab12303800f Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-04-02Trending: Update graphs - 2n-clxTibor Frank1-13/+2
Change-Id: I05a61b075c467681f2e05b17f0245a5e77a911b5 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-04-02Report: HTML comparison tables.Tibor Frank1-38/+47
Change-Id: I144d1ee15505a9d08acdacb50f53df02420d60a8 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-04-02Report: Comparison tablesTibor Frank1-13/+13
Change-Id: Iafff8f88e1d54ede712d8fc3b4afa88172f599ab Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-04-01Report: Comparison html tablesTibor Frank1-8/+55
Change-Id: I901e20ec6bc7214bf3376a57aee3eba4149ec8a1 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-04-01Report: Comparisom tables - LegendTibor Frank1-35/+184
Change-Id: I9bea40d22f9a4aa4f5161f203ba5cc04685a8b19 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-03-27Report: Fix: Header of comparison tablesTibor Frank1-6/+9
Change-Id: Ic20ee4ceb79f9c10bcfe95bc20fa044c8e65202d Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-03-27Report: Header of comparison tablesTibor Frank1-67/+64
Change-Id: Icbfd4f306cbec2840292cb6a350a8e5b09047fa4 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-03-24Report: Add mrr stdev to comp tablesTibor Frank1-48/+99
Change-Id: I94336a7e624b82a5794ff09085c46028f4416a49 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-03-24Report: Add RCA to comp tablesTibor Frank1-51/+58
For now, only these comaprison tables: - table_perf_comparison_nic - table_perf_comparison Change-Id: I52c5a960eafbe2bbf11f6c371d4a72419373dc76 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-03-23Report: Add dataTibor Frank1-8/+32
Change-Id: I72cf83bfae9f07691157d2baee436e4021cd87dc Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-03-23Report: Remove decimals from delta and stdev in tablesTibor Frank1-8/+8
Change-Id: Ib8aa70b4bd2519f077bbb76da1f41a74215a9f2e Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-03-20Report: Add dataTibor Frank1-5/+8
Change-Id: I54fc75cc46f95116a0631fdb67f631f61419e473 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-03-20PAL: Add stdev of delta to tablesTibor Frank1-37/+75
Change-Id: I00fc401d25d78d14a7bb1de4f7445029436c2426 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-03-17Report: Add 2n-skx avf and MRR testsTibor Frank1-2/+2
Change-Id: I09542db32bc7cf998b0aac00b109b767d083a34e Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-03-15Report: Add 3n-skx NDRTibor Frank1-1/+1
Change-Id: Ia5eba3f4a5d0c52bce87590881a02276e55c5341 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-03-13Report: hide 2n-skx NDR dataTibor Frank1-1/+1
Change-Id: Iee860b33338cfe60ba04081b9bd6cb6b685adb9b Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-03-13Report: Remove skx NDR from detailed test resultsTibor Frank1-1/+8
Change-Id: I47cd491c44bd259c69c758aac600bfe94d59538f Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-03-09Report: Detailed test resultsTibor Frank1-1/+2
- 3rd level Change-Id: Iae8141ff64ae61711ae8e69b67a92cfcb0f3f937 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-03-03Report: Fix _generate_html_tableTibor Frank1-1/+1
Change-Id: I711755fee488fb9ce07cd2d4dc868fc39bd07a54 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-03-02Report: Detailed test resultsTibor Frank1-35/+27
- sub-chapters reorg Change-Id: I0a90bcfde1e8be368e7ddaf9a41abbe52851cd62 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-02-27Report: Do not show failed tests in "Detailed Test Results"Tibor Frank1-10/+25
Change-Id: I6019af7f0b2af29c876a39a3243fe29843e3b1da Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-02-26Report: Compare 3n-hsw to 2n-clxTibor Frank1-10/+30
Change-Id: I259d8eea5ef0a812ea47a10f2144834f0f5fad65 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-02-19Report: Sort tests in tablesTibor Frank1-6/+16
Change-Id: I862a35270a72d66d7cc3c0eaf5fb2bff20dcac7d Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-02-18Trending: PlotsTibor Frank1-1/+1
- remove not needed params - i40e --> dpdk Change-Id: Ib63a66486b040b01a929f3ee0a4e80468c9d4e28 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-02-18Report: Add dataTibor Frank1-1/+0
Change-Id: I25f6a2ad739aade9bf0923767287bf803ecd0ec0 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-02-18Report: Detailed test resultsTibor Frank1-88/+1
Change-Id: I9af4bc9de4f4606449fd257c4321d9cd980d5f01 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-02-14Report: Detailed test results table 2Tibor Frank1-3/+12
Change-Id: Ica89d51b5590ba6ceaedb7a4d244abee78f30755 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-02-14Report: Detailed test results tableTibor Frank1-2/+9
Change-Id: I2fd223ac522d8a88546269db0752995d0c77e4fe Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-02-13Report: FixesTibor Frank1-3/+3
Change-Id: I00c059d89be00357d5751d851c1d1df073af896f Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-02-13Report: Format of tablesTibor Frank1-1/+1
Change-Id: I783ad52f7efab0e99d5238c0af0432aa77155193 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-02-13Reprot: Add dpdk tshTibor Frank1-0/+4
Change-Id: I577b6957a605f11bc66494273fa37a6345fc117e Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-02-11Report: Add dataTibor Frank1-1/+1
Change-Id: I5e36d083d67b9e987d77388fe6c565f521702117 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-02-11Report: Filter data for Latency graphsTibor Frank1-1/+1
Change-Id: I7d0354086c7d63bc79f2b2f97345d84842d6a911 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-02-07PAL: Operational dataTibor Frank1-1/+196
Change-Id: I43eb12117ddc9b6df447f0303881bf7ec6153900 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-02-03Trending: Add cx556a to urlsTibor Frank1-3/+9
Change-Id: Ib86e9b1ad340c214fd98c7e736449e5ae3206096 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-01-31Trending: Add mellanoxTibor Frank1-0/+2
Change-Id: Id6f621ee4d604da96cf65c7f1cb889ec055df9b1 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-01-17Report: Prepare data setsTibor Frank1-12/+78
Change-Id: Ice90ffe8563d6283050f2b229fc5e50ab64ac253 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-01-10Autogen: Generate also NIC drivers.Vratko Polak1-9/+9
+ Disallowed -avf- (or -rdma-) as "template" suites. + GBP suite switched to DPDK driver in repo. + Each NIC has its own list of supported drivers, in Constants. + Updated tag expressions for daily jobs: + Feature, ipsec, memif, scale, srv6, tunnels, vhost and vts are tested only with vfio-pci. + Other (base, dot1q, dot1ad) tested with all drivers. + Setup actions currently depend on driver, generated. - The performance_rdma action is trivial for now. - Several tests fail, to be fixed later, e.g. by performance_rdma. + Reconf tests are also supported. + Added DRV_VFIO_PCI tags missing, mainly in density tests. - Vhost suites (density, reconf) are failing, but suites look good. - TCP suites do not support NIC drivers yet. - DPDK obviously not supported. + Use Python 3 in regenerate scripts. + Fix typos binded => bound. + File open modes set either u"rt" or u"wt" everywhere. + Remove a trailing space in an environment variable name. Change-Id: I290470675dc5c9e88b2eaa5ab6285ecd9ed7827a Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-12-09Trending: Use MppsTibor Frank1-1/+1
Change-Id: I63efaa244aa4931a8ab474bc64520e1f501ad57a Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-12-04Trending: ReorganizationTibor Frank1-127/+111
+ use selection of tests by their full names + finalize trending_test_groups.md + modify static content + modify anchors + specifications: + container memif + ip4 + ip4 tunnels + ip6 + ipsec + l2 + srv6 + vhost + vts + dpdk + add 2n-clx + hyperlinks Change-Id: Ibe073330317539896c6fbfcbd4a7a279b58bdb95 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-12-04PAL: Add HDRHistogram graphs for latencyTibor Frank1-1/+1
Change-Id: I4d5cc369c341411a4a035dba47b945b3bf43014f Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-12-03Python3: PALTibor Frank1-828/+954
- files renamed: - utils.py --> pal_utils.py - errors.py --> pal_errors.py - functions/methods renamed: - plot_service_density_reconf_box_name --> plot_nf_reconf_box_name - plot_performance_box_name --> plot_perf_box_name - plot_latency_error_bars_name --> plot_lat_err_bars_name - plot_throughput_speedup_analysis_name --> plot_tsa_name - plot_service_density_heatmap --> plot_nf_heatmap - table_performance_comparison --> table_perf_comparison - table_performance_comparison_nic --> table_perf_comparison_nic - table_performance_trending_dashboard_html --> table_perf_trending_dash_html - functions/methods removed: - plot_service_density_heatmap_compare - plot_throughput_speedup_analysis - plot_latency_error_bars - plot_soak_boxes - plot_soak_bars Change-Id: Icddc01d3ccb451abb92b9e5d912b642d01866033 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-12-02Use Jumpavg 0.2.0 in PALVratko Polak1-3/+3
+ As a side effect, PAL is now part of "resource" package tree. - Testable only with 23558 (the rest of PAL Python 3 migration). Change-Id: Icbd90fd71458c07bced86f4bab9fa4e68282c38c Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-10-28PAL: Add sortable html table for comparisonsTibor Frank1-17/+134
Change-Id: I2d690685c5728e5f36b09d542e0f6d1a08cd151a Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-10-03Trending: Report also nr of passed tests in emailTibor Frank1-1/+9
Change-Id: I7ae188f5f684bd93352255d6b5c491b6d78c822c Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-12PAL: Add NFV reconf testsTibor Frank1-2/+3
Change-Id: I6fe36f05423c3c43081872153adf0f1a899381b6 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-11Report: Add dataTibor Frank1-1/+1
Change-Id: I2092c6420a40e1c3199183e580f00eaca37706c6 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-10PAL: Add replacing of data in tablesTibor Frank1-206/+144
+ vhost data Change-Id: I86fc97ba5c3b0feffec2dfb0ac11c5d3c9d53a81 Signed-off-by: Tibor Frank <tifrank@cisco.com>