Add ability to parse more kinds of test results

Previously, only BMRR results were recongnized.
Now also lower bounds for PDR (optionally NDR) and soak are recongnized.
This code expects all tests are of the same type,
e.g. when both MRR and NDRPDR tests are run,
only MRR result will get parsed.

If test or parsing fails, generate fake data based on overall pass or fail,
so at least passrate of unknown tests can be compared in theory.

Currently affects only per-patch job (vpp-csit-verify-perf-*),
but is useful mainly for the upcoming bisect job.

+ Do not force MRR test type in vpp-csit jobs.
 - Some test results are still not recognized (e.g. hoststack).
+ Do not exit per-patch job early on robot failure.
 + Only changes that introduce a failure (not present in parent) get -1.
 + The same is true also for introducing unrecognized test results.
 - The fake values from passrate can be misleading.
+ Add default nic tag only if NIC tag is missing.
 + In all jobs, not only in vpp-csit ones.
 + Do not add NIC tags for device jobs.
- No job supports NDR parsing yet.
 + Can be enabled in future from ci-management side.

Change-Id: Iee904116d1ffed69aec7e31821c67d8447f49ebe
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

1 files changed, 0 insertions, 2 deletions

diff --git a/resources/libraries/bash/entry/per_patch_perf.sh b/resources/libraries/bash/entry/per_patch_perf.sh
index 4a756d2c25..b1854992e2 100644
--- a/resources/libraries/bash/entry/per_patch_perf.sh
+++ b/resources/libraries/bash/entry/per_patch_perf.sh
@@ -74,14 +74,12 @@ for ((iter=0; iter<iterations; iter++)); do
     check_download_dir || die
     run_robot || die
     archive_parse_test_results "csit_current/${iter}" || die
-    die_on_robot_error || die
     # TODO: Use less heavy way to avoid apt remove failures.
     ansible_playbook "cleanup" || die
     select_build "build_parent" || die
     check_download_dir || die
     run_robot || die
     archive_parse_test_results "csit_parent/${iter}" || die
-    die_on_robot_error || die
 done
 untrap_and_unreserve_testbed || die
 compare_test_results  # The error code becomes this script's error code.