aboutsummaryrefslogtreecommitdiffstats
path: root/resources/tools/presentation/generator_tables.py
AgeCommit message (Collapse)AuthorFilesLines
2020-05-22CSIT-1703: Trending: Improve sorting in the dashboardTibor Frank1-1/+2
New order: 1. regressions, 2. progressions, 3. short-term diff, 4. long-term diff, 5. test name. Change-Id: Ie232d6759a088173fd56e2563c293cdfac352a98 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit d832848a4db1248a3a7c2fee8c325257aca2dec7)
2020-05-19Trending: CSIT-1717: Add links from dashboard to graphsTibor Frank1-10/+66
+ fix TB names in alerts Change-Id: Ia10e9b82b57e90f7ae4592bd6ecf8b71dea71cc8 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit dd36153562829ad84022cf5aa7746862c8f09156)
2020-05-15Trending: Add alerts for NDRPDR weekly testsTibor Frank1-9/+12
Change-Id: I35a806f8dd61e2c6d6dca2cdcfa4f7131e061cea Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit e244fff23cc6d0ff85ab50632316b7bf9db2ea62)
2020-05-12Report: Fix header of comp tables, add dataTibor Frank1-4/+3
Change-Id: I6d8727a08dce888bfbc620ebe34b6bd35bac488b Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit a487639f5c0405ba8afadc1887d14f3cb7960e89)
2020-05-07Trending: NDRPDR dashboardTibor Frank1-4/+4
Change-Id: I7f4c84dd47874c484f34f389b93de635c66a77c1 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 48cd54ff00049d58494834d25d3f0ac846ce4017) (cherry picked from commit 8cd8cd07576857ba9c5d75059889f011fb2881dd)
2020-05-05Trending: CSIT-1301: Display stdev in hover infoTibor Frank1-10/+22
+ make possible to use dashboard for ndrpdr tests + fixes in ndrpdr weekly comparison Change-Id: I846dc207ea620fad78424a445b32095160d4431d Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 68079ecfc6265a621d8e91b43d08fff5801f75d7) (cherry picked from commit 60d0062d8cdf93271548d06b06b54eb20280907a)
2020-05-04Report: Fix typo in specification.Tibor Frank1-0/+4
Change-Id: Ie61f8c1eef8828ce30f82e33ef0c40b8f77de26b Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 00d8063d0ebc8587c6bf52af824b7ae5e98baf1e)
2020-04-30PAL: Comparison tablesTibor Frank1-966/+15
- Add tags to columns in "table_comparison" - replace "table_perf_comparison" by "table_comparison" - replace "table_perf_comparison_nic" by "table_comparison" Change-Id: Ie9d871cb2fe04ab2efbc07737806826161a55ef4 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 4f7ce5c8b8362009da3dcda9fd8e077be821adc7)
2020-04-29Report: Add dataTibor Frank1-3/+3
Signed-off-by: Tibor Frank <tifrank@cisco.com> Change-Id: I05ca2f6d33049809dd7b71a35923328e7b30a462 (cherry picked from commit 31eec6c8047d1a0b2ad18680c2b1e7dd8ed40d3d) (cherry picked from commit 1d42e3a9cf1ae55ba9970519f19f10ff12c94e15)
2020-04-28Trending: NDRPDR weekly comparisonTibor Frank1-6/+182
Change-Id: I6c5166e1fabfe7471af92a1423c0c89ca6b040a4 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 51b4c826796b9f1f3267a0d6a8f2ba796c24d8d4) (cherry picked from commit e260db588739d80e4a8c46c6aba80425bc11b96e)
2020-04-20Report: Comparison tablesTibor Frank1-6/+6
Change-Id: I18df883d66932fdafba83fd1b831736c4cb9ffa9 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 2d1f2d6608bf405146497bf371d58ece3176cb12)
2020-04-15Report: Current vs. PreviousTibor Frank1-8/+12
Change-Id: Ic6cdabf65846a0d7d1e38025a1a7459947aed385 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 68ad5eab0fe4aacde4a813cd052a34aab25adc07)
2020-04-15PAL: Integrate new comp tables 2Tibor Frank1-97/+95
Change-Id: Id7267f5ab13a362894c5fe5a2ae40d51d4b5a36d Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 3f2ecafbe60b3664ab7b18ecfe8e4acb46a3cd3b)
2020-04-09PAL: Integrate new comp tablesTibor Frank1-86/+476
Change-Id: Ibadf4fabb69bdd9d2412ed8f33c97ab12303800f Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit bf31370e5e5fa3b597229a631ca1d58788aae794)
2020-04-02Trending: Update graphs - 2n-clxTibor Frank1-13/+2
Change-Id: I05a61b075c467681f2e05b17f0245a5e77a911b5 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit f3c2a4d8551c1ac0d05ebff4f5e7f492fb2e80d6)
2020-04-02Report: HTML comparison tables.Tibor Frank1-38/+47
Change-Id: I144d1ee15505a9d08acdacb50f53df02420d60a8 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 2be78e25da37491046ccb3a39f738c2a534805f0)
2020-04-02Report: Comparison tablesTibor Frank1-13/+13
Change-Id: Iafff8f88e1d54ede712d8fc3b4afa88172f599ab Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit fafa2a32fec6584fb24e22ba5db4e4cda3acdfc0)
2020-04-01Report: Comparison html tablesTibor Frank1-8/+55
Change-Id: I901e20ec6bc7214bf3376a57aee3eba4149ec8a1 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 919d9ebab430db35c303a26f52be0751962183be)
2020-04-01Report: Comparisom tables - LegendTibor Frank1-35/+184
Change-Id: I9bea40d22f9a4aa4f5161f203ba5cc04685a8b19 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 1bcf59c1928924cac6cc508ec13cb87a9673573c)
2020-03-27Report: Fix: Header of comparison tablesTibor Frank1-6/+9
Change-Id: Ic20ee4ceb79f9c10bcfe95bc20fa044c8e65202d Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 30b3fba0385f66897b9330801d8e80e348bb2652)
2020-03-27Report: Header of comparison tablesTibor Frank1-67/+64
Change-Id: Icbfd4f306cbec2840292cb6a350a8e5b09047fa4 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit c1801539cbefb0cfff8dc808f467f6456a660d4e)
2020-03-24Report: Add mrr stdev to comp tablesTibor Frank1-48/+99
Change-Id: I94336a7e624b82a5794ff09085c46028f4416a49 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit b95d8570e5edb080d7cfc001daed66b47811068a)
2020-03-24Report: Add RCA to comp tablesTibor Frank1-51/+58
For now, only these comaprison tables: - table_perf_comparison_nic - table_perf_comparison Change-Id: I52c5a960eafbe2bbf11f6c371d4a72419373dc76 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 6b353c8ae146ed5ce1c30addff6744954ed4d305)
2020-03-23Report: Add dataTibor Frank1-8/+32
Change-Id: I72cf83bfae9f07691157d2baee436e4021cd87dc Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit d3467a74642fc11c81533414d552a757094a8a3c)
2020-03-23Report: Remove decimals from delta and stdev in tablesTibor Frank1-8/+8
Change-Id: Ib8aa70b4bd2519f077bbb76da1f41a74215a9f2e Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 967cdb11f34dce8fe427e7db7130afcd8464d7b3)
2020-03-20Report: Add dataTibor Frank1-5/+8
Change-Id: I54fc75cc46f95116a0631fdb67f631f61419e473 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 94fce874d3ea20b775235c8323052b0390686fe2)
2020-03-20PAL: Add stdev of delta to tablesTibor Frank1-37/+75
Change-Id: I00fc401d25d78d14a7bb1de4f7445029436c2426 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit b63b36461f180236483711f37e22911925e9039e)
2020-03-17Report: Add 2n-skx avf and MRR testsTibor Frank1-2/+2
Change-Id: I09542db32bc7cf998b0aac00b109b767d083a34e Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit ec2963ab584c8c80f53178adb364a5f46cd95d95)
2020-03-15Report: Add 3n-skx NDRTibor Frank1-1/+1
Change-Id: Ia5eba3f4a5d0c52bce87590881a02276e55c5341 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit e623a04c190479ebfd0f5af69b9c129d22456e3c)
2020-03-13Report: hide 2n-skx NDR dataTibor Frank1-1/+1
Change-Id: Iee860b33338cfe60ba04081b9bd6cb6b685adb9b Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit d74845dfa5875bc54882d8d74debe103dac07761)
2020-03-13Report: Remove skx NDR from detailed test resultsTibor Frank1-1/+8
Change-Id: I47cd491c44bd259c69c758aac600bfe94d59538f Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit bc2886111faedc0d43dcd3fe3cac787dc6e767a9)
2020-03-09Report: Detailed test resultsTibor Frank1-1/+2
- 3rd level Change-Id: Iae8141ff64ae61711ae8e69b67a92cfcb0f3f937 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 6420897309b9e677f9352e5bfee007b3421eb2c5)
2020-03-03Report: Fix _generate_html_tableTibor Frank1-1/+1
Change-Id: I711755fee488fb9ce07cd2d4dc868fc39bd07a54 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 2a4a12ac1473d7d90e90a880867dfc21b986e386)
2020-03-02Report: Detailed test resultsTibor Frank1-35/+27
- sub-chapters reorg Change-Id: I0a90bcfde1e8be368e7ddaf9a41abbe52851cd62 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 691f24ec052cc9d48d6abe143bcae95486f94388)
2020-02-27Report: Do not show failed tests in "Detailed Test Results"Tibor Frank1-10/+25
Change-Id: I6019af7f0b2af29c876a39a3243fe29843e3b1da Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit d10c83488ecc30f5b870e36c2b7c9a9449eac6aa)
2020-02-26Report: Compare 3n-hsw to 2n-clxTibor Frank1-10/+30
Change-Id: I259d8eea5ef0a812ea47a10f2144834f0f5fad65 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 2d6410d275210acd535aae6873221ab0759e5d1e)
2020-02-19Report: Sort tests in tablesTibor Frank1-6/+16
Change-Id: I862a35270a72d66d7cc3c0eaf5fb2bff20dcac7d Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit a4e15f5d5ab4bf94fd40deca12bf9a1787535ab3)
2020-02-18Trending: PlotsTibor Frank1-1/+1
- remove not needed params - i40e --> dpdk Change-Id: Ib63a66486b040b01a929f3ee0a4e80468c9d4e28 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit b51708f0ad28301b87bd66d31713d436f4b9cce2)
2020-02-18Report: Add dataTibor Frank1-1/+0
Change-Id: I25f6a2ad739aade9bf0923767287bf803ecd0ec0 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 0f70d751c7a31dc81bc7a1dc9854a07ff8c4b1b8)
2020-02-18Report: Detailed test resultsTibor Frank1-88/+1
Change-Id: I9af4bc9de4f4606449fd257c4321d9cd980d5f01 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 8ca63f49d365d589af2a6667cfdceda098b677cc)
2020-02-14Report: Detailed test results table 2Tibor Frank1-3/+12
Change-Id: Ica89d51b5590ba6ceaedb7a4d244abee78f30755 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit ebe8b93eff2b7860ee2a506b18661aa2c1930390)
2020-02-14Report: Detailed test results tableTibor Frank1-2/+9
Change-Id: I2fd223ac522d8a88546269db0752995d0c77e4fe Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit c81eac1e36b37c78f144a4218c231da846a908f6)
2020-02-13Report: FixesTibor Frank1-3/+3
Change-Id: I00c059d89be00357d5751d851c1d1df073af896f Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 09dbdddf56966f0be9dbe3c4176fe1a588ca3c17)
2020-02-13Report: Format of tablesTibor Frank1-1/+1
Change-Id: I783ad52f7efab0e99d5238c0af0432aa77155193 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit b47c8f8ed56880eda3f64cf06abd47155ea97db0)
2020-02-13Reprot: Add dpdk tshTibor Frank1-0/+4
Change-Id: I577b6957a605f11bc66494273fa37a6345fc117e Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 280f41f5b7ee7415f75839b3096efe4b3935b581)
2020-02-11Report: Add dataTibor Frank1-1/+1
Change-Id: I5e36d083d67b9e987d77388fe6c565f521702117 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 7b890eb5e4fda01ea1147033f86824247f1a6cf5)
2020-02-11Report: Filter data for Latency graphsTibor Frank1-1/+1
Change-Id: I7d0354086c7d63bc79f2b2f97345d84842d6a911 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 0ba8b76dc5ac35b39b1a9200c1c81410d632d8aa)
2020-02-07PAL: Operational dataTibor Frank1-1/+196
Change-Id: I43eb12117ddc9b6df447f0303881bf7ec6153900 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 2c06090c7b919783a91d3ca9ca8c8319b5c35b07)
2020-01-17Report: Prepare data setsTibor Frank1-12/+78
Change-Id: Ice90ffe8563d6283050f2b229fc5e50ab64ac253 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit e864945ddfd65b99b3311fddc9260dba3a02b1bc)
2020-01-10Autogen: Generate also NIC drivers.Vratko Polak1-9/+9
+ Disallowed -avf- (or -rdma-) as "template" suites. + GBP suite switched to DPDK driver in repo. + Each NIC has its own list of supported drivers, in Constants. + Updated tag expressions for daily jobs: + Feature, ipsec, memif, scale, srv6, tunnels, vhost and vts are tested only with vfio-pci. + Other (base, dot1q, dot1ad) tested with all drivers. + Setup actions currently depend on driver, generated. - The performance_rdma action is trivial for now. - Several tests fail, to be fixed later, e.g. by performance_rdma. + Reconf tests are also supported. + Added DRV_VFIO_PCI tags missing, mainly in density tests. - Vhost suites (density, reconf) are failing, but suites look good. - TCP suites do not support NIC drivers yet. - DPDK obviously not supported. + Use Python 3 in regenerate scripts. + Fix typos binded => bound. + File open modes set either u"rt" or u"wt" everywhere. + Remove a trailing space in an environment variable name. Change-Id: I290470675dc5c9e88b2eaa5ab6285ecd9ed7827a Signed-off-by: Vratko Polak <vrpolak@cisco.com>