Age | Commit message (Collapse) | Author | Files | Lines |
|
Update the jobspec according to the current Arm policy:
1. Run most of the tests on cx6, crypto coverage being the most
important,
2. Match the cx6 ipv4 crypto coverage with x710 with the DPDK driver,
3. Run basic ipv4 and l2 tests with x710 with borh DPDK and native (avf)
drivers.
The above is the policy used in performance testing where time is a
major constraint. The same is true for functional testing to some
extent, so it makes sense to apply the same logic for choosing the tests.
There are 10 tests which are failing on cx6 without an identified
reason. They are disabled until we find the root cause and address it.
In the meantime, the tests are enabled for x710 with the DPDK driver:
ethip4-l2xcbase-eth-2memif-1dcr
ethip4-l2bdbasemaclrn-eth-2memif-1dcr
ethip4-l2bdbasemaclrn-eth-2tap
ethip4-l2bdbasemaclrn
ethip4-l2bdbasemaclrn-iacl1sf
ethip4-l2bdbasemaclrn-iacl1sl
ethip4-l2bdbasemaclrn-oacl1sf
ethip4-l2bdbasemaclrn-oacl1sl
ethip4-l2patch
ethip4-l2xcbase
When the cx6 issue has been resolved, these should be enabled for cx6
and disabled for x710, with the exception of ethip4-l2bdbasemaclrn,
which should be running on both.
Change-Id: Id48f450063e405b1faca57431676f91d62e829b9
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
|
|
Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: I131cc9957b288f4e02e9d02394a1681dbb539d83
|
|
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
Change-Id: Ib2a1ceb9145ef5495c76954ac70cedc5af6fa297
|
|
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
Change-Id: Ic27f46876a93cc01d5f14bbefe0dccd84ab41027
|
|
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
Change-Id: Ia6e07111af543280b2365840bced02f94cf91e75
|
|
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
Change-Id: Idca0738320b56196e98aeec3050312111a90609a
|
|
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
Change-Id: I1770a3f49e19d337d4ed6760fb062ba4d445574d
|
|
+ Parsing common with per-patch job is moved to a library.
Ticket: CSIT-1618
Change-Id: I185bea084a29e6a37ef94e9da42b192a6a81fc17
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
Ticket: CSIT-1618
Change-Id: I0c17f1e8f09a3944032d44efa8ecd36fef2056a2
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
- terraform ansible is not supported on aarch
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
Change-Id: I3d1a592b4ed97fe635813dccbf78dc42d14e0fa9
|
|
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
Change-Id: Ia713b9a0b962820b014bad3582bc095ec802380c
|
|
Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: If25495e0eec60ac84dfaaafec3080f02a17fc740
|
|
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
Change-Id: I87d0d297c79b1f0c0aa46ff7304586ab1898fed1
|
|
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
Change-Id: I5a94ae7caf1c3ee08efa7bd5db19c3b2c356705a
|
|
+ Fix globs for selecting topology yaml files.
+ Remove skx.
+ Sort alphabetically.
Change-Id: Iefb8a53875792219815824dfc1125c99e55f86b6
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
Change-Id: I5b59243aa9236183595d71198763187ed14d68a0
|
|
Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: I766fe7c0837ad2694645230e5fcc1d59bbf59898
|
|
Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: Ib03e469da3e93944ae7fb612e7a71df36f711cdd
|
|
Change-Id: I0e4e4758b3abbfc2fe2e18200b85477293de218b
Signed-off-by: Naveen Joy <najoy@cisco.com>
Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
|
|
Also add IPsec 10000tnlhwasync int mode and 4tnlhwasync policy mode
test suites, in order to compare sw crypto and QAT crypto and IPsec
int mode and policy mode performance.
Signed-off-by: Yulong Pei <yulong.pei@intel.com>
Signed-off-by: xinfeng zhao <xinfengx.zhao@intel.com>
Change-Id: I0aed06a0c75c1a545720649d3561a0aa5a861db2
|
|
Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: Icf68d2f244432f49f6b8fb0876807d694a1e8e31
|
|
Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: Ia8067fb1683295fb711bbba81a35b0e6d18b084f
|
|
Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: I38aeb3d75793addafb44f407fabf6bac6705b682
|
|
+ Use test names in output.
- Methodology updated in subsequent change.
Change-Id: I6a62f87249ea79262778f68d00f9bb81134f0b02
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: I3aad4fc5a56a1c02e975f664449a6f9d50fc300e
|
|
Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: I20e720302561f5f7d1f7a80a83548077a88025af
|
|
If cleanup fails, we still want to examine robot logs
for any hints of why a node may have stopped working properly.
Bootstrapt scripts for device tests are doing that already,
so this patch only edits the perf verify bootstrap script.
Change-Id: I8b8ad7bcbbbbc26874068efe1b20e8053f0d5650
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
Previously, only BMRR results were recongnized.
Now also lower bounds for PDR (optionally NDR) and soak are recongnized.
This code expects all tests are of the same type,
e.g. when both MRR and NDRPDR tests are run,
only MRR result will get parsed.
If test or parsing fails, generate fake data based on overall pass or fail,
so at least passrate of unknown tests can be compared in theory.
Currently affects only per-patch job (vpp-csit-verify-perf-*),
but is useful mainly for the upcoming bisect job.
+ Do not force MRR test type in vpp-csit jobs.
- Some test results are still not recognized (e.g. hoststack).
+ Do not exit per-patch job early on robot failure.
+ Only changes that introduce a failure (not present in parent) get -1.
+ The same is true also for introducing unrecognized test results.
- The fake values from passrate can be misleading.
+ Add default nic tag only if NIC tag is missing.
+ In all jobs, not only in vpp-csit ones.
+ Do not add NIC tags for device jobs.
- No job supports NDR parsing yet.
+ Can be enabled in future from ci-management side.
Change-Id: Iee904116d1ffed69aec7e31821c67d8447f49ebe
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: I8127beeb6664aa51ef5cb313d658ab2e5638b581
|
|
Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: Ie63b3d6c7ff376d808587e7c96f386946c939a81
|
|
Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: I1528d7760228d50a4d89c0e413ad86aa882088ed
|
|
Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: Ic13b8cd3f2976c66d8956f0cee0784c3bae12a65
|
|
Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: Iea4c536a6e421efdaf493fb3cba0dde5abad162d
|
|
Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: I14975b21e7f480c3bca5ba6a04514008af219039
|
|
Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: I4c192210e1aef1275e8a9b56eab7956798aca15d
|
|
Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: Ia13e920ef11d364893a51957778e60084f4ac0f9
|
|
Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: Iccbe5f0cabe6fdd5274126cf970549673edd4f1c
|
|
The current invocation is deprecated:
WARNING: Running the setup command as `meson [options]` instead
of `meson setup [options]` is ambiguous and deprecated.
Change-Id: Ieffa7f295e4ea7634ee5e8f77e373c5e9314b3cf
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
|
|
Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: I4e19d8fe38802652b25e6a1c577e816328cebd2d
|
|
Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: I2e0feccef5c5b15b035490dfaf521c8c9a1795f8
|
|
Change-Id: Ic8daac7dfc10788baa44d3cf8cf587296ec5070d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
|
|
Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: I3f7efcbfc82f683e7afc986d00fa71ae7413d93d
|
|
Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: I206118daa0383e8a7d160aaf1c3dd53fc3ab9279
|
|
Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: I44fd0fd94ba91758cfa37b11cba44955a0b24f72
|
|
Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: Ife3aed308cac696876316e4ad17f17e7993f96d0
|
|
Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: I4dcb0034b8f914b7863ac8ddede4d644d64c2d47
|
|
Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: Ia9f5b1c9036b9f09c4d9bb041a41e9b49d2ead7f
|
|
Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: Iee0ded1f2fb43a09a7a1d61f593f4e92ead3dbb3
|
|
Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: I3308f12046dfeed7db872a3a901806acf81cdb15
|
|
+ per_patch_device does not need that call (yet).
Change-Id: I4c85a038962a2cfea3fa91bb4a3c37a8348132ca
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|