aboutsummaryrefslogtreecommitdiffstats
path: root/resources/tools
AgeCommit message (Collapse)AuthorFilesLines
2024-04-09fix(perpatch): Sort comparison output by test nameVratko Polak1-2/+2
Change-Id: Id68a4e2b7514b9cf2e1f2f30b78dc0cd696a673a Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-04-04Fix(perpatch): improve compare script outputVratko Polak1-9/+8
+ Make tests more searchable by "Test name" prefix. + Shorten the output code (fewer duplication and continues). Change-Id: I0adfac146a689466345a30646e41fe948ea264ae Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-03-26fix(perpatch): Do not repeat test nameVratko Polak1-2/+1
When searching for a specific test, it is confusing to see the name twice, first time close to previous test classification. Change-Id: I43d838090f89d23af9da1dc93f9dd1946aebae75 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-01-22feat(bisect): Tolerate zero testsVratko Polak1-8/+10
Needed when the anomaly causes failure in the global suite setup. Also needs a jumpavg fix, in the subsequent change. Change-Id: Ifa8f8fcfc0b25416afa064e606a59b79aa279b61 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2023-12-13feat(bisect): introduce scripts for VPP bisectingVratko Polak2-56/+134
+ Parsing common with per-patch job is moved to a library. Ticket: CSIT-1618 Change-Id: I185bea084a29e6a37ef94e9da42b192a6a81fc17 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2023-09-08feat(perpatch): parse results from jsonVratko Polak1-57/+116
+ Use test names in output. - Methodology updated in subsequent change. Change-Id: I6a62f87249ea79262778f68d00f9bb81134f0b02 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2023-07-17feat(crc): print warnings in crc checker scriptVratko Polak1-1/+2
Robot already prints warnings when running tests, but not many people are looking at robot console output. This makes the warnings visible also in VPP API CRC job console log. Change-Id: I9044a2970f46e132ec80ae0faa2e0adacc889447 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2023-05-24remove(tools): presentation, docspmikus67-46611/+0
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: Icc07d18b9c0bd00af157bb817205e5b54824d525
2023-03-24Report: Fix bug in 3n-alt comparison tablesTibor Frank1-4/+4
Signed-off-by: Tibor Frank <tifrank@cisco.com> Change-Id: Ie80b69ba97e5434b72b1cf42aaa2f787dab870c6
2023-03-13feat(docs): Move job_specs to resourcespmikus1-4/+4
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: Iee0ded1f2fb43a09a7a1d61f593f4e92ead3dbb3
2023-03-09Report: Add rls dataTibor Frank2-8/+8
Signed-off-by: Tibor Frank <tifrank@cisco.com> Change-Id: I4eea313430d448928d68e554a00c7a78e3864020
2023-03-08Report: Disable archiving of input filesTibor Frank1-1/+1
Signed-off-by: Tibor Frank <tifrank@cisco.com> Change-Id: I4d6a4c2a4670fe2f942921c888efa99c8c8dbf57
2023-03-08Report: Add rls dataTibor Frank2-13/+31
Signed-off-by: Tibor Frank <tifrank@cisco.com> Change-Id: I51498c2f115484eeeb15b36411ae62fa0c11a356
2023-03-07Report: Enable archiving of input filesTibor Frank1-1/+1
Signed-off-by: Tibor Frank <tifrank@cisco.com> Change-Id: I2990a9c91892c7c690f2da377dc698d4acf0d620
2023-03-07Report: fixesTibor Frank2-6/+7
Signed-off-by: Tibor Frank <tifrank@cisco.com> Change-Id: Ie4e3b49f8e26a4381260ba4aeef5540a35c4c15a
2023-03-07Report: Enable pdfTibor Frank1-2/+2
Signed-off-by: Tibor Frank <tifrank@cisco.com> Change-Id: Ic0d614257995e441ac617ac9ad1032c1d3c86b63
2023-03-07Report: Add release dataTibor Frank1-0/+6
Signed-off-by: Tibor Frank <tifrank@cisco.com> Change-Id: I87f6cf93ebb03299d69b6cb8691dd66184744ab9
2023-03-06Report: Add data, graphs, remove oper dataTibor Frank2-19/+75
- Add release data - Add ipsec-3n-icx-e810xxv tput and speedup - Remove operational data - no data available Signed-off-by: Tibor Frank <tifrank@cisco.com> Change-Id: I86cc20a219f9e0f2a13cb67f77208d63b0180dd0
2023-03-06Report: Add release dataTibor Frank1-7/+16
Signed-off-by: Tibor Frank <tifrank@cisco.com> Change-Id: I91428ea138ee1fac1d17d6e0791e7c76a30a3322
2023-03-05Report: Add rls dataTibor Frank1-6/+92
Signed-off-by: Tibor Frank <tifrank@cisco.com> Change-Id: I1b2e99969069f2b00129fd72caa952c73d4bdda1
2023-03-03Report: Add rls dataTibor Frank2-8/+256
Signed-off-by: Tibor Frank <tifrank@cisco.com> Change-Id: Iba36f4e4b06ece31c3b7d4e408c0982f39df7525
2023-03-03Report: Add rls dataTibor Frank2-4/+37
Signed-off-by: Tibor Frank <tifrank@cisco.com> Change-Id: I65280548b3b889e88367291059a991c1c92689e2
2023-03-02Report: Add release dataTibor Frank1-2/+46
Signed-off-by: Tibor Frank <tifrank@cisco.com> Change-Id: Ia763ae7fd73a3e36322429afc6f67c7070b5252b
2023-03-01Report: Add rls dataTibor Frank1-7/+32
Signed-off-by: Tibor Frank <tifrank@cisco.com> Change-Id: I49e22986fbfc4a372537b3eb674cfa37ac8cf5e4
2023-02-28Report: Add release dataTibor Frank1-0/+25
Signed-off-by: Tibor Frank <tifrank@cisco.com> Change-Id: I257e5962b2adbb4e968db51c58bf4379cbd6921d
2023-02-27Report: Add release dataTibor Frank2-3/+10
Signed-off-by: Tibor Frank <tifrank@cisco.com> Change-Id: I94868a21f41f31cf30547fed1986a123286b5f27
2023-02-27Report: Add release dataTibor Frank2-161/+141
Signed-off-by: Tibor Frank <tifrank@cisco.com> Change-Id: Ifebc3c5842c0c8a0a3deeedf3113d5874d603c76
2023-02-17Report: Add rc2 dataTibor Frank1-1/+5
Signed-off-by: Tibor Frank <tifrank@cisco.com> Change-Id: I6d1c72083a788ed1c10b79aece3b657495763816
2023-02-15Report: Add rc2 dataTibor Frank1-3/+5
Signed-off-by: Tibor Frank <tifrank@cisco.com> Change-Id: I2de2301f1a691ccb628b5d0f3480edb27a6f57b9
2023-02-14Report: Add rc2 dataTibor Frank1-9/+13
Signed-off-by: Tibor Frank <tifrank@cisco.com> Change-Id: I7f3b0ec5df91f84e5a8a02ff2fc196787a37403e
2023-02-13Report: Fix links to vpp device jobsTibor Frank1-2/+2
Signed-off-by: Tibor Frank <tifrank@cisco.com> Change-Id: I2041001718b7c7e5bd2baa792221a644d9b0ba5f
2023-02-13Fix issue in csit hoststack testYulong Pei1-5/+7
1. ABTool.py, fix error in parsing the return result of ab 2. DUTSetup.py, add sleep to wait for the program to start Signed-off-by: Peng Lu <pengx.lu@intel.com> Signed-off-by: Xinfeng Zhao <xinfengx.zhao@intel.com> Signed-off-by: Yulong Pei <yulong.pei@intel.com> Change-Id: I1cffa28d8492bcc27ae188f1e084b80afad60502
2023-02-13Report: Add vpp-device-1n-tx2Tibor Frank4-26/+87
Signed-off-by: Tibor Frank <tifrank@cisco.com> Change-Id: Ic0fb5fc3ba52524d8796ba4f47f36ea3992705be
2023-02-13Report: Add rc2 dataTibor Frank2-57/+128
Signed-off-by: Tibor Frank <tifrank@cisco.com> Change-Id: I8f4f493a3dc52ce067fc5d94972b0a06f20a227e
2023-02-09Report: Add 3n-icx e810cqTibor Frank1-11/+522
Signed-off-by: Tibor Frank <tifrank@cisco.com> Change-Id: Icfd7126e775a9869d185b7ac33512afa0b045e64
2023-02-09Report: Add 2n-icx e810cqTibor Frank1-0/+581
Signed-off-by: Tibor Frank <tifrank@cisco.com> Change-Id: I78d67ff96a6fcd36e8d8e2d61c64d00dc11eba48
2023-02-09Report: Add e810cq hoststack testsTibor Frank1-0/+62
Signed-off-by: Tibor Frank <tifrank@cisco.com> Change-Id: I6a581c23121834e38598016a3900f3a4257fa064
2023-02-06Report: Set the range on y-axis for hoststackTibor Frank2-4/+5
Signed-off-by: Tibor Frank <tifrank@cisco.com> Change-Id: Ie5162073983646febea5c9a963a0a44a3c1c1dca
2023-02-06Report: Add mlx5 latencyTibor Frank4-16/+18
Signed-off-by: Tibor Frank <tifrank@cisco.com> Change-Id: I73effa0711aee8143c7f66c809087e44a1b12e73
2023-02-03Report: Add mlx5 testsTibor Frank3-3/+200
Signed-off-by: Tibor Frank <tifrank@cisco.com> Change-Id: Ifca88af4dc0fde18f459e490f12a8e57b71aab89
2023-01-25fix(report): Dataset used in TRex perf changesTibor Frank1-16/+16
Signed-off-by: Tibor Frank <tifrank@cisco.com> Change-Id: Iccb3f11216d2d9c9ba6aa15ec7c77ae58dffff89
2023-01-25Report: Add Trex comparisonsTibor Frank3-2/+103
Signed-off-by: Tibor Frank <tifrank@cisco.com> Change-Id: Id6e0c66bc1b09f546ae047840cfeeb68012a982c
2023-01-25Report: Add curr vs prev comp for 3n-snrTibor Frank2-89/+335
Signed-off-by: Tibor Frank <tifrank@cisco.com> Change-Id: I68e8b5961091169e862b16c71791d0f9295151de
2023-01-25Report: Add rc1 dataTibor Frank2-30/+30
Signed-off-by: Tibor Frank <tifrank@cisco.com> Change-Id: I7a79422b70aee1ac05f4b8a7257ff2fa5946e5f3
2023-01-24Report: Configure rls2302.rc1Tibor Frank5-2469/+1825
Signed-off-by: Tibor Frank <tifrank@cisco.com> Change-Id: I2b4ff328de320aa58ae36e88f4a8e6c3dc1d72f3
2023-01-20fix(core): AB librarypmikus1-29/+29
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: Ib79a3f010abd28a57248c03ca62e8070df000c77
2023-01-11feat(model): Hoststack typepmikus2-62/+29
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: Ia7eefc28645c78ad346d294099ef6258faa9814f
2023-01-05Report: Remove DNV testbedsTibor Frank27-1858/+34
Signed-off-by: Tibor Frank <tifrank@cisco.com> Change-Id: Id54919579a245ef9f44a9599b8e2d4f3bd320e84
2022-12-06feat(telemetry): Add telemetry exportpmikus4-9/+14
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: Ibb8a59fd4e08bc736494c7ab18e689a55f7a98dc
2022-12-06feat(model): Cleanup and introduce telemetrypmikus1-19/+2
- Due to divergence from original design path the RAW was never consumed. It adds too much code complexity and requires processing on both storage and compute. Removing entirely to make modeling efficient. - log (apparently SSH) section will never be consumed in the way it is coded in model. This section is also not part of model schema itself due to the point above. - Introducing telemetry section that is going to carry telemetry items required for CDash. Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I7e0256c6c9715de8ee559eed29dce96329aac97d