Age | Commit message (Collapse) | Author | Files | Lines |
|
Previously, only BMRR results were recongnized.
Now also lower bounds for PDR (optionally NDR) and soak are recongnized.
This code expects all tests are of the same type,
e.g. when both MRR and NDRPDR tests are run,
only MRR result will get parsed.
If test or parsing fails, generate fake data based on overall pass or fail,
so at least passrate of unknown tests can be compared in theory.
Currently affects only per-patch job (vpp-csit-verify-perf-*),
but is useful mainly for the upcoming bisect job.
+ Do not force MRR test type in vpp-csit jobs.
- Some test results are still not recognized (e.g. hoststack).
+ Do not exit per-patch job early on robot failure.
+ Only changes that introduce a failure (not present in parent) get -1.
+ The same is true also for introducing unrecognized test results.
- The fake values from passrate can be misleading.
+ Add default nic tag only if NIC tag is missing.
+ In all jobs, not only in vpp-csit ones.
+ Do not add NIC tags for device jobs.
- No job supports NDR parsing yet.
+ Can be enabled in future from ci-management side.
Change-Id: Iee904116d1ffed69aec7e31821c67d8447f49ebe
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: I8127beeb6664aa51ef5cb313d658ab2e5638b581
|
|
Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: Ie63b3d6c7ff376d808587e7c96f386946c939a81
|
|
Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: I1528d7760228d50a4d89c0e413ad86aa882088ed
|
|
Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: Ic13b8cd3f2976c66d8956f0cee0784c3bae12a65
|
|
Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: Iea4c536a6e421efdaf493fb3cba0dde5abad162d
|
|
Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: I14975b21e7f480c3bca5ba6a04514008af219039
|
|
Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: I4c192210e1aef1275e8a9b56eab7956798aca15d
|
|
Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: Ia13e920ef11d364893a51957778e60084f4ac0f9
|
|
Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: Iccbe5f0cabe6fdd5274126cf970549673edd4f1c
|
|
The current invocation is deprecated:
WARNING: Running the setup command as `meson [options]` instead
of `meson setup [options]` is ambiguous and deprecated.
Change-Id: Ieffa7f295e4ea7634ee5e8f77e373c5e9314b3cf
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
|
|
Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: I4e19d8fe38802652b25e6a1c577e816328cebd2d
|
|
Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: I2e0feccef5c5b15b035490dfaf521c8c9a1795f8
|
|
Change-Id: Ic8daac7dfc10788baa44d3cf8cf587296ec5070d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
|
|
Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: I3f7efcbfc82f683e7afc986d00fa71ae7413d93d
|
|
Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: I206118daa0383e8a7d160aaf1c3dd53fc3ab9279
|
|
Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: I44fd0fd94ba91758cfa37b11cba44955a0b24f72
|
|
Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: Ife3aed308cac696876316e4ad17f17e7993f96d0
|
|
Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: I4dcb0034b8f914b7863ac8ddede4d644d64c2d47
|
|
Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: Ia9f5b1c9036b9f09c4d9bb041a41e9b49d2ead7f
|
|
Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: Iee0ded1f2fb43a09a7a1d61f593f4e92ead3dbb3
|
|
Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: I3308f12046dfeed7db872a3a901806acf81cdb15
|
|
+ per_patch_device does not need that call (yet).
Change-Id: I4c85a038962a2cfea3fa91bb4a3c37a8348132ca
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: Ied301e8fcca22af8420364f2e158dfdd49bdc58d
|
|
Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: Iccaa4f8945e5eb48272737338a52c9edbf1cb58b
|
|
Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: Iab5e8c21e4defb92e257459a64101a6f19609917
|
|
Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: I461899d72e92e5c5db9f64261206ec0e6704e0c8
|
|
Fixes: bfbdfaedb044b7643b81f47e76285baedfee9e25
Change-Id: Iaefff972d6d47ccdd34b2ccb150375d084df6d93
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: I1c7df34cfb78cf767081acea435dc205b3f44a15
|
|
Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: I276cbfe4f761ddb4ccc652a276be2614adc6117e
|
|
- Static content will be removed separately
Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: I0992e941e1c24552837eaf7e8d3f6564b3cb21c8
|
|
- Due to divergence from original design path the RAW was never
consumed. It adds too much code complexity and requires processing
on both storage and compute. Removing entirely to make modeling
efficient.
- log (apparently SSH) section will never be consumed in the way it is
coded in model. This section is also not part of model schema itself
due to the point above.
- Introducing telemetry section that is going to carry telemetry
items required for CDash.
Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: I7e0256c6c9715de8ee559eed29dce96329aac97d
|
|
Flipping logic depends whether TG and DUT ports are reordered.
# If TG and DUT ports are reordered -> flip
# If TG reordered and DUT not reordered -> don't flip
# If DUT reordered and TG not reordered -> don't flip
# If DUT and TG not reordered -> flip
Change-Id: I7202a17e03e48d112ed5b98e3ef0e3816ce50f14
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I2a7e35bc3671cafaf696e5200d22e531e251b1ba
|
|
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ic646f555855b1a13a86711ce4ce01ddfc2b44b1f
|
|
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I1ff6ce2eeaf074773f27ce0d4d414c4963a7a2de
|
|
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Id4b8f033c5a6e30ed0d64d3306858d0f06991017
|
|
Change-Id: Ic3c78f8f447f59bcd10fd8b88f50f93f7279430b
Signed-off-by: Jing Peng <jing@meter.com>
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
Due to some integration changes with upcoming Ubuntu
22.04 (and mainly python) bump, upgrading the full
pip package list to latest version.
Keyword 'BuiltIn.Run Keyword Unless' is deprecated
- will be part of subsequent change
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ie3bdc424c7c0efb4fe4f1fa7c73137b916c17116
|
|
Signed-off-by: Viliam Luc <vluc@cisco.com>
Change-Id: I935ee5cf5bd7e760ef29fdc338f981e4e7cc333f
|
|
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I2ff6393aa885f03ba52a2cf79d49dac1815e2a86
|
|
The previous code assumes each tox script is a checker.
We want to add fixer scripts (not voting but editing) soon.
This is the less interesting part of the process,
renaming things and updating comments.
Includes some basic descriptions of how fixers differ from checkers.
Change-Id: I1ca1572a328acd02b41dcf4e70d7cb3746a03b03
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
+ print testpmd and l3fwd pid after start
Testpmd and l3fwd utility can be started but link might not be
ready yet. This fix start the utility on all DUTs and do the
check later.
Signed-off-by: Viliam Luc <vluc@cisco.com>
Change-Id: If476e22f206d9a6a0dd399879a88eafedca92bb6
|
|
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ife55633c620a3c762f4d939013a7f6fafb640aa6
|
|
Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Id4d84aa7268080843b099fd7ab9851234612968b
|
|
Update ansible, topologies, bash scripts and job specs.
Change-Id: I834b991f281e0b29b4af9dc37fe8028460298d83
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
|
|
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I12d2d58de01693b18628cd73b5d8c36467506f32
|
|
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I5f68fd84a9ea034c5d8ff175807033aa0b60d5a2
|
|
The previous grep was too strict about test message.
Change-Id: Ib0c120a32d205b905f257e5b3c948a309ed8abb2
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I0cfc9d9fbb1a82a308231a5d2c0b12cb632c469b
|