aboutsummaryrefslogtreecommitdiffstats
path: root/resources/tools/integrated
AgeCommit message (Collapse)AuthorFilesLines
2024-04-09fix(perpatch): Sort comparison output by test nameVratko Polak1-2/+2
Change-Id: Id68a4e2b7514b9cf2e1f2f30b78dc0cd696a673a Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-04-04Fix(perpatch): improve compare script outputVratko Polak1-9/+8
+ Make tests more searchable by "Test name" prefix. + Shorten the output code (fewer duplication and continues). Change-Id: I0adfac146a689466345a30646e41fe948ea264ae Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-03-26fix(perpatch): Do not repeat test nameVratko Polak1-2/+1
When searching for a specific test, it is confusing to see the name twice, first time close to previous test classification. Change-Id: I43d838090f89d23af9da1dc93f9dd1946aebae75 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-01-22feat(bisect): Tolerate zero testsVratko Polak1-8/+10
Needed when the anomaly causes failure in the global suite setup. Also needs a jumpavg fix, in the subsequent change. Change-Id: Ifa8f8fcfc0b25416afa064e606a59b79aa279b61 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2023-12-13feat(bisect): introduce scripts for VPP bisectingVratko Polak2-56/+134
+ Parsing common with per-patch job is moved to a library. Ticket: CSIT-1618 Change-Id: I185bea084a29e6a37ef94e9da42b192a6a81fc17 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2023-09-08feat(perpatch): parse results from jsonVratko Polak1-57/+116
+ Use test names in output. - Methodology updated in subsequent change. Change-Id: I6a62f87249ea79262778f68d00f9bb81134f0b02 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2023-07-17feat(crc): print warnings in crc checker scriptVratko Polak1-1/+2
Robot already prints warnings when running tests, but not many people are looking at robot console output. This makes the warnings visible also in VPP API CRC job console log. Change-Id: I9044a2970f46e132ec80ae0faa2e0adacc889447 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-06-10FIX: Pylint reducepmikus3-6/+6
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I909942dbb920df7f0fe15c0c92cda92c3cd8d8ad
2020-04-20Flag day: requirements for candidatesVratko Polak1-4/+8
Change-Id: I0446263333812a57a8d0f7f288044482bee04a14 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-12-16Perpatch compare: pylint fixes.Vratko Polak1-95/+92
+ Do not execute on import. + Replace hack() with sorted(). Change-Id: Ic439a799ab29d42ae21faf70b2aea6dce6e89510 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-12-16Do not execute crc check on importVratko Polak1-39/+57
Other guilty scripts already have open changes that fix them. Change-Id: Ife75e999d6d3f3f506b0f5dcdb679ce1f1e6bdbe Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-12-09Perpatch compare: avg_diff is not an intVratko Polak1-1/+1
Change-Id: I1d003cb517ef95c76002862e540497d8c40cb913 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-12-09FIX: integer divisionsJan Gelety1-2/+2
Change-Id: I28caf62f418bf18601cd379603d03c307e3ba9c8 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-12-02Refactor jumpavg to be more readable and usableVratko Polak1-0/+130
This is the python3 change, the python2 is still used for testing bisect. + New version is 0.2.0 due to amount o API changes. + Jumpavg is now part of CSIT resource package tree. + Perpatch migrated to new jumpavg. - PAL NOT updated (the update moved to a different Change). Change-Id: I7d7a8bf8a411196c20c2a40a8c64478d6709bc07 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-11-28Python3: resources and librariesJan Gelety1-25/+28
Change-Id: I1392c06b1d64f62b141d24c0d42a8e36913b15e2 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-08-07FIX: PylintPeter Mikus1-3/+3
- my bad Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I8c1f57f6b648b99338f3f6a6ff9ec943082e9bc4
2019-07-31Add VPP API CRC checkingVratko Polak2-0/+83
+ Include both checking at runtime and standalone static quick check. + Runtime checking does not look for missing messages, as messages belonging to disabled plugins are not visible. + Standalone check script has nice loud output. Change-Id: I1dfc3846d1bcdad0b09017d4ce8edd5028e17e0c Signed-off-by: Vratko Polak <vrpolak@cisco.com>