aboutsummaryrefslogtreecommitdiffstats
path: root/resources/libraries/bash/entry
diff options
context:
space:
mode:
authorVratko Polak <vrpolak@cisco.com>2023-08-17 14:17:33 +0200
committerVratko Polak <vrpolak@cisco.com>2023-08-17 14:17:33 +0200
commit0634490c0557d94856f6061c323cf6a2592f294b (patch)
treee44b680b5626d64680c46833498d27bf411d25b0 /resources/libraries/bash/entry
parent14f0a243ce732df3ea7316fc20ce6132dc54f384 (diff)
Add ability to parse more kinds of test results
Previously, only BMRR results were recongnized. Now also lower bounds for PDR (optionally NDR) and soak are recongnized. This code expects all tests are of the same type, e.g. when both MRR and NDRPDR tests are run, only MRR result will get parsed. If test or parsing fails, generate fake data based on overall pass or fail, so at least passrate of unknown tests can be compared in theory. Currently affects only per-patch job (vpp-csit-verify-perf-*), but is useful mainly for the upcoming bisect job. + Do not force MRR test type in vpp-csit jobs. - Some test results are still not recognized (e.g. hoststack). + Do not exit per-patch job early on robot failure. + Only changes that introduce a failure (not present in parent) get -1. + The same is true also for introducing unrecognized test results. - The fake values from passrate can be misleading. + Add default nic tag only if NIC tag is missing. + In all jobs, not only in vpp-csit ones. + Do not add NIC tags for device jobs. - No job supports NDR parsing yet. + Can be enabled in future from ci-management side. Change-Id: Iee904116d1ffed69aec7e31821c67d8447f49ebe Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Diffstat (limited to 'resources/libraries/bash/entry')
-rw-r--r--resources/libraries/bash/entry/per_patch_perf.sh2
1 files changed, 0 insertions, 2 deletions
diff --git a/resources/libraries/bash/entry/per_patch_perf.sh b/resources/libraries/bash/entry/per_patch_perf.sh
index 4a756d2c25..b1854992e2 100644
--- a/resources/libraries/bash/entry/per_patch_perf.sh
+++ b/resources/libraries/bash/entry/per_patch_perf.sh
@@ -74,14 +74,12 @@ for ((iter=0; iter<iterations; iter++)); do
check_download_dir || die
run_robot || die
archive_parse_test_results "csit_current/${iter}" || die
- die_on_robot_error || die
# TODO: Use less heavy way to avoid apt remove failures.
ansible_playbook "cleanup" || die
select_build "build_parent" || die
check_download_dir || die
run_robot || die
archive_parse_test_results "csit_parent/${iter}" || die
- die_on_robot_error || die
done
untrap_and_unreserve_testbed || die
compare_test_results # The error code becomes this script's error code.