aboutsummaryrefslogtreecommitdiffstats
path: root/resources/tools/presentation/generator_tables.py
AgeCommit message (Collapse)AuthorFilesLines
2020-03-03Report: Fix _generate_html_tableTibor Frank1-1/+1
Change-Id: I711755fee488fb9ce07cd2d4dc868fc39bd07a54 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 2a4a12ac1473d7d90e90a880867dfc21b986e386)
2020-03-02Report: Detailed test resultsTibor Frank1-35/+27
- sub-chapters reorg Change-Id: I0a90bcfde1e8be368e7ddaf9a41abbe52851cd62 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 691f24ec052cc9d48d6abe143bcae95486f94388)
2020-02-27Report: Do not show failed tests in "Detailed Test Results"Tibor Frank1-10/+25
Change-Id: I6019af7f0b2af29c876a39a3243fe29843e3b1da Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit d10c83488ecc30f5b870e36c2b7c9a9449eac6aa)
2020-02-26Report: Compare 3n-hsw to 2n-clxTibor Frank1-10/+30
Change-Id: I259d8eea5ef0a812ea47a10f2144834f0f5fad65 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 2d6410d275210acd535aae6873221ab0759e5d1e)
2020-02-19Report: Sort tests in tablesTibor Frank1-6/+16
Change-Id: I862a35270a72d66d7cc3c0eaf5fb2bff20dcac7d Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit a4e15f5d5ab4bf94fd40deca12bf9a1787535ab3)
2020-02-18Trending: PlotsTibor Frank1-1/+1
- remove not needed params - i40e --> dpdk Change-Id: Ib63a66486b040b01a929f3ee0a4e80468c9d4e28 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit b51708f0ad28301b87bd66d31713d436f4b9cce2)
2020-02-18Report: Add dataTibor Frank1-1/+0
Change-Id: I25f6a2ad739aade9bf0923767287bf803ecd0ec0 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 0f70d751c7a31dc81bc7a1dc9854a07ff8c4b1b8)
2020-02-18Report: Detailed test resultsTibor Frank1-88/+1
Change-Id: I9af4bc9de4f4606449fd257c4321d9cd980d5f01 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 8ca63f49d365d589af2a6667cfdceda098b677cc)
2020-02-14Report: Detailed test results table 2Tibor Frank1-3/+12
Change-Id: Ica89d51b5590ba6ceaedb7a4d244abee78f30755 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit ebe8b93eff2b7860ee2a506b18661aa2c1930390)
2020-02-14Report: Detailed test results tableTibor Frank1-2/+9
Change-Id: I2fd223ac522d8a88546269db0752995d0c77e4fe Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit c81eac1e36b37c78f144a4218c231da846a908f6)
2020-02-13Report: FixesTibor Frank1-3/+3
Change-Id: I00c059d89be00357d5751d851c1d1df073af896f Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 09dbdddf56966f0be9dbe3c4176fe1a588ca3c17)
2020-02-13Report: Format of tablesTibor Frank1-1/+1
Change-Id: I783ad52f7efab0e99d5238c0af0432aa77155193 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit b47c8f8ed56880eda3f64cf06abd47155ea97db0)
2020-02-13Reprot: Add dpdk tshTibor Frank1-0/+4
Change-Id: I577b6957a605f11bc66494273fa37a6345fc117e Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 280f41f5b7ee7415f75839b3096efe4b3935b581)
2020-02-11Report: Add dataTibor Frank1-1/+1
Change-Id: I5e36d083d67b9e987d77388fe6c565f521702117 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 7b890eb5e4fda01ea1147033f86824247f1a6cf5)
2020-02-11Report: Filter data for Latency graphsTibor Frank1-1/+1
Change-Id: I7d0354086c7d63bc79f2b2f97345d84842d6a911 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 0ba8b76dc5ac35b39b1a9200c1c81410d632d8aa)
2020-02-07PAL: Operational dataTibor Frank1-1/+196
Change-Id: I43eb12117ddc9b6df447f0303881bf7ec6153900 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 2c06090c7b919783a91d3ca9ca8c8319b5c35b07)
2020-01-17Report: Prepare data setsTibor Frank1-12/+78
Change-Id: Ice90ffe8563d6283050f2b229fc5e50ab64ac253 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit e864945ddfd65b99b3311fddc9260dba3a02b1bc)
2020-01-10Autogen: Generate also NIC drivers.Vratko Polak1-9/+9
+ Disallowed -avf- (or -rdma-) as "template" suites. + GBP suite switched to DPDK driver in repo. + Each NIC has its own list of supported drivers, in Constants. + Updated tag expressions for daily jobs: + Feature, ipsec, memif, scale, srv6, tunnels, vhost and vts are tested only with vfio-pci. + Other (base, dot1q, dot1ad) tested with all drivers. + Setup actions currently depend on driver, generated. - The performance_rdma action is trivial for now. - Several tests fail, to be fixed later, e.g. by performance_rdma. + Reconf tests are also supported. + Added DRV_VFIO_PCI tags missing, mainly in density tests. - Vhost suites (density, reconf) are failing, but suites look good. - TCP suites do not support NIC drivers yet. - DPDK obviously not supported. + Use Python 3 in regenerate scripts. + Fix typos binded => bound. + File open modes set either u"rt" or u"wt" everywhere. + Remove a trailing space in an environment variable name. Change-Id: I290470675dc5c9e88b2eaa5ab6285ecd9ed7827a Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-12-09Trending: Use MppsTibor Frank1-1/+1
Change-Id: I63efaa244aa4931a8ab474bc64520e1f501ad57a Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-12-04Trending: ReorganizationTibor Frank1-127/+111
+ use selection of tests by their full names + finalize trending_test_groups.md + modify static content + modify anchors + specifications: + container memif + ip4 + ip4 tunnels + ip6 + ipsec + l2 + srv6 + vhost + vts + dpdk + add 2n-clx + hyperlinks Change-Id: Ibe073330317539896c6fbfcbd4a7a279b58bdb95 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-12-04PAL: Add HDRHistogram graphs for latencyTibor Frank1-1/+1
Change-Id: I4d5cc369c341411a4a035dba47b945b3bf43014f Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-12-03Python3: PALTibor Frank1-828/+954
- files renamed: - utils.py --> pal_utils.py - errors.py --> pal_errors.py - functions/methods renamed: - plot_service_density_reconf_box_name --> plot_nf_reconf_box_name - plot_performance_box_name --> plot_perf_box_name - plot_latency_error_bars_name --> plot_lat_err_bars_name - plot_throughput_speedup_analysis_name --> plot_tsa_name - plot_service_density_heatmap --> plot_nf_heatmap - table_performance_comparison --> table_perf_comparison - table_performance_comparison_nic --> table_perf_comparison_nic - table_performance_trending_dashboard_html --> table_perf_trending_dash_html - functions/methods removed: - plot_service_density_heatmap_compare - plot_throughput_speedup_analysis - plot_latency_error_bars - plot_soak_boxes - plot_soak_bars Change-Id: Icddc01d3ccb451abb92b9e5d912b642d01866033 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-12-02Use Jumpavg 0.2.0 in PALVratko Polak1-3/+3
+ As a side effect, PAL is now part of "resource" package tree. - Testable only with 23558 (the rest of PAL Python 3 migration). Change-Id: Icbd90fd71458c07bced86f4bab9fa4e68282c38c Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-10-28PAL: Add sortable html table for comparisonsTibor Frank1-17/+134
Change-Id: I2d690685c5728e5f36b09d542e0f6d1a08cd151a Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-10-03Trending: Report also nr of passed tests in emailTibor Frank1-1/+9
Change-Id: I7ae188f5f684bd93352255d6b5c491b6d78c822c Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-12PAL: Add NFV reconf testsTibor Frank1-2/+3
Change-Id: I6fe36f05423c3c43081872153adf0f1a899381b6 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-11Report: Add dataTibor Frank1-1/+1
Change-Id: I2092c6420a40e1c3199183e580f00eaca37706c6 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-10PAL: Add replacing of data in tablesTibor Frank1-206/+144
+ vhost data Change-Id: I86fc97ba5c3b0feffec2dfb0ac11c5d3c9d53a81 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-05Report: Add DNV dataTibor Frank1-8/+10
Change-Id: I020373b1553300459654ded31d940b0a5562eb8a Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-05Report: Fix listing order of new vs. see footnoteTibor Frank1-8/+56
Change-Id: I01426c3e4d40af0902e7776088e0489e141a2362 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-04Report: Add dataTibor Frank1-4/+4
Change-Id: I6a32e0bdd1a693550214e7bea49b76313449f24d Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-03Report: Comparison tablesTibor Frank1-10/+14
Change-Id: I108e1292c5de8024060c220b877b668b8843c68f Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-03Report: Comparison tablesTibor Frank1-6/+6
Change-Id: I90f635f62573154e37a319ca1cbb760401d17c05 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-03Report: Comparison tablesTibor Frank1-24/+60
Change-Id: Ib4132c4d25f6a7c936793f403877a5819a6dd55a Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-03Report: add dataTibor Frank1-2/+2
Change-Id: I51fd0b9e07d09224452f842689925d1166246f19 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-03CSIT-1590: Performance comparison analysisTibor Frank1-4/+6
Change-Id: I802b5b9cbeb486587f395aeca76cbe3df68b40c4 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-03CSIT-1590: Performance comparison analysisTibor Frank1-2/+4
Change-Id: I09d502fcd7b286e41b141e43933bcf09262a8749 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-02PAL: list all sel tests in table_performance_comparisonTibor Frank1-3/+17
Change-Id: I99ccbca3e56a58a662c569d195ecdef20d3ea348 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-02PAL: list all sel tests in table_performance_comparison_nicTibor Frank1-3/+16
Change-Id: I21bb76aab4a1e627a13057f896ea7bfc34c03463 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-08-26Report: TablesTibor Frank1-0/+235
Change-Id: I5084163758c5f15f482c6c8e08ee70c4a4f50431 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-08-09Trending: Fix ipsecTibor Frank1-0/+4
Change-Id: I0f35098047bc1137cbf2a1ae39107698b1e9bf79 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-08-09Trending: TSH ipsec testsTibor Frank1-2/+2
Change-Id: Ib9f867e2b55a61019b487c96b0a05e9fa175dd0f Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-08-08Trending: ipsecTibor Frank1-0/+6
Change-Id: I2fc623ac152b8559a230b340be2f1cc92c7e934a Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-08-02Trending: Add 8 big input filesTibor Frank1-2/+2
Change-Id: I9891c9589014be04fa69973e092fdf8b9926a56f Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-08-02Trending: Fix ignore list processingTibor Frank1-2/+2
Change-Id: I27c2ae25cc9cf6996f3c22417479b300faa73994 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-05-17Report: table_soak_vs_ndrTibor Frank1-3/+4
Change-Id: Ia313fb43c315990212501b4139f3f1f7bc9d67f5 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-05-17Report soak comparison: Add stdev for deltaVratko Polak1-3/+9
Change-Id: Ibbff3c123afac2e68caf33f3ccd5fc4909509917 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-05-15Trending: Add IPSECSWTibor Frank1-0/+4
Change-Id: I5437d46759c3fcf9a8f44d02d43a70f3f3b2635d Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-05-15CSIT-1504: Soak tests - box plotsTibor Frank1-11/+14
- table: stdev, round deltas to 2 dec places Change-Id: I29cd1f7c9ba8ef73a8281d42ac9f6a06ed30bbdf Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-05-13CSIT-1500: Add comparison table for SOAK vs NDRPDRTibor Frank1-1/+5
- fix text case name Change-Id: I01c228a920729b2e2ab3e4fb4669d68469b1c58f Signed-off-by: Tibor Frank <tifrank@cisco.com>