aboutsummaryrefslogtreecommitdiffstats
path: root/resources/tools
AgeCommit message (Collapse)AuthorFilesLines
2022-02-18Report: Add dataTibor Frank1-10/+16
Change-Id: If66753eae0416da9371cd124d790635b276210d3 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 583c98b8cbcf915c2a2d4fa5e195d8a15a997705)
2022-02-17Report: Add dataTibor Frank1-8/+49
Change-Id: I1c9f58a27f1e881cca3e639d084547dfac88af91 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 1f7bfaf0f94fe68aadf41fde09b57c2f3171dea9)
2022-02-16Report: Add dataTibor Frank1-12/+42
Change-Id: I908272cd297d9c4c27bfeb8d945a2a7dcf9ca494 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit fa01a6c0347dbc40618e3419e005a5da7ae99bde)
2022-02-15Report: Add dataTibor Frank1-21/+57
Change-Id: Ia50d5531f0a026512a694d349b37fef4916117a2 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit d6199f77dc6d8d110adb8ac0680ef81eff88e069)
2022-02-14Report: Remove 2n-icx vsap from statsTibor Frank1-2/+0
Change-Id: I3794109781f2b599e24cc2749b76b776f6d66d29 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit fb31765ac3f1b7c55eea7ca8ebc7e45185cb0a7d)
2022-02-14Report: Enable stats tables for 2n-icxTibor Frank1-25/+13
Change-Id: Ia1db6924f52aafa096ccdc23361f001b05331af8 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 61844eb0397f65133642929078fcbe678b0a7d4a)
2022-02-14Report: Fix typoTibor Frank2-3/+3
Change-Id: Ia7e3550a3904880cf5a6a8c867fef6d0c72462fe Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit ea59c76c67254c10a016dcd60974d58dcf10a18f)
2022-02-14Report: Add dataTibor Frank2-2/+2
Change-Id: I14da70eea5a9268709d28edec1617499e3926b7e Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit aae45cfa26d184413c13e55bacce85c524cdc571)
2022-02-14Report: Add RC2 dataTibor Frank3-143/+216
Change-Id: I60b46dd75cae3a75fb17faa1d6020ebaf37cae96 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit c564c79f4aa329ef1df8ef732e7971ab968acfbc)
2022-02-10Report: Small fixesTibor Frank2-77/+78
Change-Id: I9c453f299aa291afec0605ce4a4a87e2b21dc480 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 841acf20d513fbf7b7b9e82cab02567ebd908c19)
2022-02-10Report: Add 2n-icx GSOTibor Frank2-0/+19
Change-Id: I171980a4ec67b85c3d0f2a680ebff29a2e6afcf2 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 113ff4499daceefec04a3a25e594ee5554e80738)
2022-02-10Report: Add icx soak, reconf, nfvTibor Frank2-2/+287
Change-Id: I96e59e75c0bb877e0aa68c2d9eccd73959358350 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 1ec63f657dff7ce76eefa7787089866e9b99717c)
2022-02-07Report: Small fixesTibor Frank1-0/+22
Change-Id: Ib2cb94c747168b773409c18e3e366ebf3400ab99 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit e7197f5428b5eb836a6fa636ff4ec9f14a65deca)
2022-02-07Trending: Add icx latency trending graphsTibor Frank1-29/+29
Change-Id: I75dc5fa2e0f8d92651ec22293875c8b3568a2159 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 54fcebc6cdab6a2bff1e88bb07970ef3fe112508)
2022-02-07Trending: Add icx nfvTibor Frank2-0/+106
Change-Id: I77b3bf9d77224221cafac1c8825e9f8c397c8e41 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit c1b75945e67f1673afd5b2979636d22d861226bc)
2022-02-07Trending: Add icx weeklyTibor Frank2-0/+599
- Tables - data - dashboard - failed tests - last failed tests - weekly comparison tables - graphs - stats - dpdk_mrr - vpp_ndrpdr - DPDK MRR - VPP NDRPDR Change-Id: I371ba97992a0fcc1906d96c5020c9e2b13c396ce Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit e5796ad7fac33f70942e4fd0f126a9c97e9fe9be)
2022-02-04Report: Suite doc formatTibor Frank1-9/+1
Change-Id: Ia2fb6c72d07ad008c36ff0ecd76b9dcd8b4abab4 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit aead5d42f927ebaeff2bf1b2f4063d6adfd99f36)
2022-02-03Report: Add dpdk icx static contentTibor Frank1-11/+4
Change-Id: I79f1d70a3395551cfff872bd1d66ee900b9129b8 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 9af72734b4ff4cc239e69e8f787228e68d02501c)
2022-02-03PAL: Process exception while writing tableTibor Frank1-4/+11
- table_merged_details Change-Id: I4ee8b1c2f56c367e22d6e75853c8bb074d62935b Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 100fc988c8140e36affac9fadc770328cc1d34b2)
2022-02-03Report: Add dataTibor Frank1-7/+7
Change-Id: I9b3f1da0a889c73e4a0e00f3a283ca51e6ba64f0 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 11c41202e1d2e5f7e21975ea77372f2c91dbe4b0)
2022-02-02Report: fix specTibor Frank1-2/+2
Change-Id: Id5570aa55b2fec5973c4e924124dddf398eeecfc Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 3ef9715d1867b6a93e5dfdfcf84cf24f65f3ef44)
2022-02-02Report: Add ICXTibor Frank3-650/+1153
- Stats - DPDK - comparisom tables - detailed results - graphs - tput - speedup - VPP - detailed results - graphs - tput - speedup Change-Id: Ic0b10247ee376262ee61487bdd4b4b461dcf5308 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit f4c31f23462c376e442b35242b2502541baccb83)
2022-02-02trending: icx addedViliam Luc1-1/+1
Signed-off-by: Viliam Luc <vluc@cisco.com> Change-Id: Ib742be7841b462eaa97ba1f6f87f7ac63bde03df (cherry picked from commit bfd31ed5f42e106121e142c1da20bd9ab0745dd1)
2022-02-01Report: Add dataTibor Frank1-1/+1
Change-Id: Ia516ffda944356cd9fbe18bc147371dcf7e9996d Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit f01d6e878cfe4213fd8bb02eb6cca4aa6536fdbd)
2022-02-01Report: Add dataTibor Frank1-170/+142
Change-Id: I8908036f7eb84d22d0c23abfe149b8f5aa188639 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit ea53ece9afb2bf58763ea508c063bdf8649fa413)
2022-02-01Trending: Fix - 3n-icx specTibor Frank1-0/+1
Change-Id: I869e808fced5458dcc348d1fdc183580634aa977 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit c800466d73d4f7233f677a7c30949392583c8f55)
2022-01-31Trending: Add 3n-icxTibor Frank3-0/+282
Change-Id: Id836184c0eca10b5b1d353e1783764ff5119ffea Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit d3d4f9989b2fa7977bb545e0fb847bb3e785e8ba)
2022-01-31Trending: Add 2n-icxTibor Frank4-5/+348
Change-Id: I2d71c557f6b3c4d93466c096c9d5c0fabc36f486 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 3d629c4e670186a8506bfd9f50c85453c4fa7acd)
2022-01-27Report: Add dataTibor Frank1-0/+11
Change-Id: I1b8a3c10a065bf9f68ad855f2a892cd47af35f03 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 29c1d6edc81681cdd70f1eccb1e36d7ebab79ca6)
2022-01-26Report: Add dataTibor Frank1-5/+14
Change-Id: I29e3bab8bcb57076f0eece519fa870a8645c2ce6 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 6b90944aac25d514b44041f0dca44dd0b34d8537)
2022-01-25trending: fix re-pro showing wrong dataViliam Luc1-18/+17
vpp-2n-zn2-mrr, CSIT build: https://jenkins.fd.io/view/csit/job/csit-vpp-perf-mrr-daily-master-2n-zn2/484, vpp version: 22.06-rc0~0-g017a67665~b2179 4t2c-avf-eth-l2bdbasemaclrn-mrr 10ge2p1x710 64B 29.6 1 -0.2 2t2c-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-mrr 10ge2p1x520 64B 1.14 1 -58.08 4t4c-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-mrr 10ge2p1x520 64B 1.98 1 -57.73 4t4c-ethip4-ip4base-mrr 10ge2p1x553 64B 2.97 1 -79.05 1t1c-eth-l2patch-mrr 10ge2p1x553 64B 2.98 1 -75.94 2t2c-eth-l2bdbasemaclrn-mrr 10ge2p1x553 64B 8.27 1 -11.0 2t1c-af-xdp-ethip4-ip4scale2m-mrr 25ge2p1xxv710 64B 6.21 1 -53.14 vpp-2n-tx2-mrr, CSIT build: https://jenkins.fd.io/view/csit/job/csit-vpp-perf-mrr-daily-master-2n-tx2/265, vpp version: 22.02-rc0~508-g88a9c0e02~b851 4t2c-avf-eth-l2bdbasemaclrn-mrr 10ge2p1x710 64B 29.6 1 -0.2 2t2c-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-mrr 10ge2p1x520 64B 1.14 1 -58.08 4t4c-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-mrr 10ge2p1x520 64B 1.98 1 -57.73 4t4c-ethip4-ip4base-mrr 10ge2p1x553 64B 2.97 1 -79.05 1t1c-eth-l2patch-mrr 10ge2p1x553 64B 2.98 1 -75.94 2t2c-eth-l2bdbasemaclrn-mrr 10ge2p1x553 64B 8.27 1 -11.0 2t1c-af-xdp-ethip4-ip4scale2m-mrr 25ge2p1xxv710 64B 6.21 1 -53.14 The same data for different TB. Signed-off-by: Viliam Luc <vluc@cisco.com> Change-Id: Iefce9a7196bae6fde45ee1935184efab4735e6e0 (cherry picked from commit 8967c82701a5b4e66536db6baefccbcfe5f8dfaf)
2022-01-25Report: Add Comparison tablesTibor Frank2-6/+434
- DPDK: 2n-tx2, 3n-tsh - VPP: 2n-aws, 3n-aws Change-Id: I9f78fec4f87eef389278b81103fb2cab647f7923 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 6e5cf8806c8c30bc58a5e6ad2e7dff1932c0d7d8)
2022-01-24Trending: Add awsTibor Frank1-8/+48
Change-Id: Ib571aef30424b84cf7c7abd7a8fee7b78f977b48 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 6c0c46585063c486867200e92b35b1e782a8d36e)
2022-01-24Report: Configure Report 2202Tibor Frank4-1871/+1529
Change-Id: I9be8b74716b09b2395fbab95eb37877867abbc22 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit ac1fbfcd12d5bd4db1b04bbf27b6d47880bcd3e7)
2022-01-19trending: fix empty regressions and progressionsViliam Luc1-5/+5
Signed-off-by: Viliam Luc <vluc@cisco.com> Change-Id: I1405c5d1dbf9e137afbc5fd5d9f83ea572613ea9
2022-01-19Trending: Add NAT44Det tests for 2n-zn2Tibor Frank1-81/+0
Change-Id: I1068048590ff797b608f7578655fb9ce13f2ffe9 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-01-18trending: new view in regressions and progressionsViliam Luc3-54/+145
Signed-off-by: Viliam Luc <vluc@cisco.com> Change-Id: I8524319a215ff551cf67c30d0b08ddae69883f61
2022-01-17trending: shorten error messagesViliam Luc1-1/+33
Sometimes error messages are longer than 1000 chars. This change looks for [;, :, '] in messages between 128 and 256 character. If it finds any of these the error message will be cut from beggining to this character. If there's no character from the list in error message and message is longer than 128 chars. It will be cut from beggining to 129 character of error message Signed-off-by: Viliam Luc <vluc@cisco.com> Change-Id: I283f8ee8d81422235d897370dbc9508fafda6a7f
2022-01-17Report: Add 2n-tx2 ipsec testsTibor Frank1-0/+186
- throughput - speedup - todo: latency Change-Id: I01db52ce8283b1ac5ba724149f590817ab92b7a2 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-01-17Revert "Report: Temporarily change report specs"Tibor Frank2-0/+13926
This reverts commit cd1f9904e173ecb34836b33cb551ab9b9d378e18. Reason for revert: Not needed Change-Id: Id0739d4fba2d2abadd8ee9954c724a54b39cd8a8 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-01-17Report: Temporarily change report specsTibor Frank2-13926/+0
Change-Id: Ic8724a9676c2b2c37ee4f2de4c056b770a10d5af Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-01-17Revert "Temporarily change report specs"Tibor Frank2-0/+13930
This reverts commit cc04963a4ad9bfd8dce0e31fd41226fa35e5e5d6. Reason for revert: Some data-sets missing. Change-Id: Id2363c2a71c0e87ad3d3e206a09d7af3984a1f36 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-01-17Temporarily change report specsTibor Frank2-13930/+0
- to generate tables with oper data Change-Id: I06878713cd085d72eb3b9fef0c1aae1102dfb363 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-01-17PAL: Fix sh-runTibor Frank2-25/+12
- do not post-process telemetry data Change-Id: I800a99d8e92016d1fa675b18e2b2d30db4a15077 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-01-11feat(uti): Dash demoPeter Mikus21-0/+1486
- displays the table with trending data downloaded from trending pages Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Ic0d48290105ccd846c7de9ee4d8acb78e0b72f00
2021-12-22feat(telemetry): show hardwarepmikus1-58/+0
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I0c0bf055e5963ac794f66cce9d5d45bb628facee
2021-12-17trending: hotfix failing trending emailsViliam Luc2-7/+24
Legend was showing for each job_name. When trying to fix it we broke the cpta with I/O operation. This fixes legend positioning and I/O operation error. Signed-off-by: Viliam Luc <vluc@cisco.com> Change-Id: I809daa3eabe6a728e5e183630fc7c6615dfef8bf
2021-12-15UTI: Export resultsVratko Polak1-1/+18
+ Model version 1.0.0. - Only some result types are exported. + MRR, NDRPDR and SOAK. - Other result types to be added later. + In contrast, all test types are detected. + Convert custom classes to JSON-serializable equivalents. + Sort dict keys before converting to JSON. + Override the order for some known keys. + Export sets as sorted arrays. + Convert to info content from serialized raw content. + Also export outputs for suite setups and teardowns. + Info files for setup/teardown exist only temporarily. + The data is merged into suite.info.json file. + This simplifies presentation of total suite duration. + Define model via JSON schema: - Just test case, suite setup/teardown/suite to be added later. - Just info, raw to be added later. + Proper descriptions. + Json is generated from yaml. + This is a convenience for maintainers. + The officially used schema is the .json one. + TODOs written into a separate .txt file. + Validate exported instance against the schema. + Include format checking. + Update CSIT requirements for validation dependencies. + This needs python-dateutil==2.8.2, only a patch bump. + Compute bandwidth also for soak tests. + This unifies with NDRPDR to simplify schema definition. - PAL may need an update for parsing soak test message. + Include SSH log items, raw output only. + Generate all outputs in a single filesystem tree. + Move raw outputs into test_output_raw.tar.xz. + Rename existing tar with suites to generated_robot_files.tar.xz. Change-Id: I69ff7b330ed1a14dc435fd0ef008e753c0d7f78c Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-12-15trending: legend positioningViliam Luc1-2/+2
Signed-off-by: Viliam Luc <vluc@cisco.com> Change-Id: If655d953eb8317f0cba6b3cb35bec232031df7dc
2021-12-14trending: fix broken trendingViliam Luc1-6/+20
Signed-off-by: Viliam Luc <vluc@cisco.com> Change-Id: I1ecbfa48f3765884720f0490b9b9da1f69bd2b1a