aboutsummaryrefslogtreecommitdiffstats
path: root/resources/tools/presentation/generator_tables.py
AgeCommit message (Collapse)AuthorFilesLines
2020-01-17Report: Prepare data setsTibor Frank1-12/+78
Change-Id: Ice90ffe8563d6283050f2b229fc5e50ab64ac253 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-01-10Autogen: Generate also NIC drivers.Vratko Polak1-9/+9
+ Disallowed -avf- (or -rdma-) as "template" suites. + GBP suite switched to DPDK driver in repo. + Each NIC has its own list of supported drivers, in Constants. + Updated tag expressions for daily jobs: + Feature, ipsec, memif, scale, srv6, tunnels, vhost and vts are tested only with vfio-pci. + Other (base, dot1q, dot1ad) tested with all drivers. + Setup actions currently depend on driver, generated. - The performance_rdma action is trivial for now. - Several tests fail, to be fixed later, e.g. by performance_rdma. + Reconf tests are also supported. + Added DRV_VFIO_PCI tags missing, mainly in density tests. - Vhost suites (density, reconf) are failing, but suites look good. - TCP suites do not support NIC drivers yet. - DPDK obviously not supported. + Use Python 3 in regenerate scripts. + Fix typos binded => bound. + File open modes set either u"rt" or u"wt" everywhere. + Remove a trailing space in an environment variable name. Change-Id: I290470675dc5c9e88b2eaa5ab6285ecd9ed7827a Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-12-09Trending: Use MppsTibor Frank1-1/+1
Change-Id: I63efaa244aa4931a8ab474bc64520e1f501ad57a Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-12-04Trending: ReorganizationTibor Frank1-127/+111
+ use selection of tests by their full names + finalize trending_test_groups.md + modify static content + modify anchors + specifications: + container memif + ip4 + ip4 tunnels + ip6 + ipsec + l2 + srv6 + vhost + vts + dpdk + add 2n-clx + hyperlinks Change-Id: Ibe073330317539896c6fbfcbd4a7a279b58bdb95 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-12-04PAL: Add HDRHistogram graphs for latencyTibor Frank1-1/+1
Change-Id: I4d5cc369c341411a4a035dba47b945b3bf43014f Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-12-03Python3: PALTibor Frank1-828/+954
- files renamed: - utils.py --> pal_utils.py - errors.py --> pal_errors.py - functions/methods renamed: - plot_service_density_reconf_box_name --> plot_nf_reconf_box_name - plot_performance_box_name --> plot_perf_box_name - plot_latency_error_bars_name --> plot_lat_err_bars_name - plot_throughput_speedup_analysis_name --> plot_tsa_name - plot_service_density_heatmap --> plot_nf_heatmap - table_performance_comparison --> table_perf_comparison - table_performance_comparison_nic --> table_perf_comparison_nic - table_performance_trending_dashboard_html --> table_perf_trending_dash_html - functions/methods removed: - plot_service_density_heatmap_compare - plot_throughput_speedup_analysis - plot_latency_error_bars - plot_soak_boxes - plot_soak_bars Change-Id: Icddc01d3ccb451abb92b9e5d912b642d01866033 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-12-02Use Jumpavg 0.2.0 in PALVratko Polak1-3/+3
+ As a side effect, PAL is now part of "resource" package tree. - Testable only with 23558 (the rest of PAL Python 3 migration). Change-Id: Icbd90fd71458c07bced86f4bab9fa4e68282c38c Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-10-28PAL: Add sortable html table for comparisonsTibor Frank1-17/+134
Change-Id: I2d690685c5728e5f36b09d542e0f6d1a08cd151a Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-10-03Trending: Report also nr of passed tests in emailTibor Frank1-1/+9
Change-Id: I7ae188f5f684bd93352255d6b5c491b6d78c822c Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-12PAL: Add NFV reconf testsTibor Frank1-2/+3
Change-Id: I6fe36f05423c3c43081872153adf0f1a899381b6 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-11Report: Add dataTibor Frank1-1/+1
Change-Id: I2092c6420a40e1c3199183e580f00eaca37706c6 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-10PAL: Add replacing of data in tablesTibor Frank1-206/+144
+ vhost data Change-Id: I86fc97ba5c3b0feffec2dfb0ac11c5d3c9d53a81 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-05Report: Add DNV dataTibor Frank1-8/+10
Change-Id: I020373b1553300459654ded31d940b0a5562eb8a Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-05Report: Fix listing order of new vs. see footnoteTibor Frank1-8/+56
Change-Id: I01426c3e4d40af0902e7776088e0489e141a2362 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-04Report: Add dataTibor Frank1-4/+4
Change-Id: I6a32e0bdd1a693550214e7bea49b76313449f24d Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-03Report: Comparison tablesTibor Frank1-10/+14
Change-Id: I108e1292c5de8024060c220b877b668b8843c68f Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-03Report: Comparison tablesTibor Frank1-6/+6
Change-Id: I90f635f62573154e37a319ca1cbb760401d17c05 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-03Report: Comparison tablesTibor Frank1-24/+60
Change-Id: Ib4132c4d25f6a7c936793f403877a5819a6dd55a Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-03Report: add dataTibor Frank1-2/+2
Change-Id: I51fd0b9e07d09224452f842689925d1166246f19 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-03CSIT-1590: Performance comparison analysisTibor Frank1-4/+6
Change-Id: I802b5b9cbeb486587f395aeca76cbe3df68b40c4 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-03CSIT-1590: Performance comparison analysisTibor Frank1-2/+4
Change-Id: I09d502fcd7b286e41b141e43933bcf09262a8749 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-02PAL: list all sel tests in table_performance_comparisonTibor Frank1-3/+17
Change-Id: I99ccbca3e56a58a662c569d195ecdef20d3ea348 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-02PAL: list all sel tests in table_performance_comparison_nicTibor Frank1-3/+16
Change-Id: I21bb76aab4a1e627a13057f896ea7bfc34c03463 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-08-26Report: TablesTibor Frank1-0/+235
Change-Id: I5084163758c5f15f482c6c8e08ee70c4a4f50431 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-08-09Trending: Fix ipsecTibor Frank1-0/+4
Change-Id: I0f35098047bc1137cbf2a1ae39107698b1e9bf79 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-08-09Trending: TSH ipsec testsTibor Frank1-2/+2
Change-Id: Ib9f867e2b55a61019b487c96b0a05e9fa175dd0f Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-08-08Trending: ipsecTibor Frank1-0/+6
Change-Id: I2fc623ac152b8559a230b340be2f1cc92c7e934a Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-08-02Trending: Add 8 big input filesTibor Frank1-2/+2
Change-Id: I9891c9589014be04fa69973e092fdf8b9926a56f Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-08-02Trending: Fix ignore list processingTibor Frank1-2/+2
Change-Id: I27c2ae25cc9cf6996f3c22417479b300faa73994 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-05-17Report: table_soak_vs_ndrTibor Frank1-3/+4
Change-Id: Ia313fb43c315990212501b4139f3f1f7bc9d67f5 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-05-17Report soak comparison: Add stdev for deltaVratko Polak1-3/+9
Change-Id: Ibbff3c123afac2e68caf33f3ccd5fc4909509917 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-05-15Trending: Add IPSECSWTibor Frank1-0/+4
Change-Id: I5437d46759c3fcf9a8f44d02d43a70f3f3b2635d Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-05-15CSIT-1504: Soak tests - box plotsTibor Frank1-11/+14
- table: stdev, round deltas to 2 dec places Change-Id: I29cd1f7c9ba8ef73a8281d42ac9f6a06ed30bbdf Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-05-13CSIT-1500: Add comparison table for SOAK vs NDRPDRTibor Frank1-1/+5
- fix text case name Change-Id: I01c228a920729b2e2ab3e4fb4669d68469b1c58f Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-05-13CSIT-1500: Add comparison table for SOAK vs NDRPDRTibor Frank1-0/+109
Change-Id: I890b28b7a8c1f60cce4c985ccd94fcdfd3c47d7d Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-05-10Report: Add message if no oper data is presentTibor Frank1-0/+2
Change-Id: Ic70f603a652ae1297aba29187d1f61f30678be41 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-05-10Report: Add message if no oper data is presentTibor Frank1-1/+1
Change-Id: I9295dd21934bf5d7f14b282ee5830056362581c7 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-04-10Trending: Reduce input dataTibor Frank1-1/+7
Change-Id: Ia787036e4a717b9693df09fc75738369d6d39b57 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-04-04Trending: AlertsTibor Frank1-0/+45
Change-Id: I1c744f4eeefe3082be02daa681bfc032d6db4d15 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-03-08CSIT-1452: Make PAL use PapiHistory instead of VatHistoryTibor Frank1-2/+2
- First step: Add PapiHistory Change-Id: I499d64f951f17f04557a7ba793dcc1593f37a1bd Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-02-04Trending: Remove NF_DENSITY tests from trendingTibor Frank1-2/+2
- also memif tests removed from graphs where they must not be. Change-Id: I1cbb02ba2dcdcd3a286c9ac4489c946993ac4790 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-01-21Report: Compare NICs tablesTibor Frank1-2/+2
- Change logging level from warning to debug. Change-Id: I644bdf3a5d13a45a7835c8181ca95d63ff762233 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-01-21CSIT-1395: Create comparison tables for NICsTibor Frank1-3/+114
Change-Id: Ib8583041a0d16a6242160b4f51eae973ef33504f Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-01-14CSIT-1402: Add VICs to trendingTibor Frank1-0/+4
Change-Id: Ia854d9888130cf7b3df81644bc953e5524976dbc Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-01-07Trending: Add latest changes to the "new" dirTibor Frank1-1/+1
Change-Id: Ib5d1c9561c5d21f2d72b5c1b643c114f37bacd1a Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-01-04Trending: Remove unneeded tests from DashboardTibor Frank1-6/+12
Change-Id: I0f57735bcc578b42994721ca88dc1bb60af475de Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-11-28CSIT-1340: Fix the list of failed tests in TrendingTibor Frank1-7/+18
Change-Id: I7c4adeb96d893f4d6d50f0fafcb5e908f57d478a Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-11-20CSIT-1359: Add 3n-skx and 2n-skx comparisons to ReportTibor Frank1-1/+8
- 3n-Skx vs. 2n-Skx Testbeds Change-Id: I63e1d34d4589bbb771961ed3c21f0271fee728ad Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-09-12CSIT-1269: Add VTS tests to trendingTibor Frank1-1/+6
Change-Id: I9ddbad8e4c3f64553c72f77f93eb9d6c21602eca Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-09-07CSIT-1270: Split feature tests in trendingTibor Frank1-4/+18
Change-Id: Iecc841737552fea07b7fcf297c478479f7872ae7 Signed-off-by: Tibor Frank <tifrank@cisco.com>