aboutsummaryrefslogtreecommitdiffstats
path: root/resources
AgeCommit message (Collapse)AuthorFilesLines
2023-09-08feat(infra): Add 1n_sprpmikus3-4/+224
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I20e720302561f5f7d1f7a80a83548077a88025af
2023-09-07job-specs: reduce the number of tests in daily, weekly, iterative jobsTibor Frank6-1111/+5
- 2n-spr, 2n-icx, 2n-clx - fix 2n-clx Change-Id: I4ad6da2c4c4a14c29f0f8f9b6af1cbc48f864795 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2023-09-04fix(hoststack): hardcode DUT1 for nginxVratko Polak1-17/+17
Previously, the Set up LDP or VCL Nginx on DUT node keyword was wrongly documenting its "dut" argument as type string, while using the value as a node dict instead. As most of the code already used direct dut1 variables, this patch eliminates the dut argument altogether and puts DUT1 into the keyword name. Change-Id: Ie29afc175b98c1b1cb554438da9178738662d108 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2023-09-04fix(bootstrap): move archives before cleanupVratko Polak1-1/+1
If cleanup fails, we still want to examine robot logs for any hints of why a node may have stopped working properly. Bootstrapt scripts for device tests are doing that already, so this patch only edits the perf verify bootstrap script. Change-Id: I8b8ad7bcbbbbc26874068efe1b20e8053f0d5650 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2023-08-18fix(core): AVF init problemoper-230821pmikus1-1/+1
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I67eac5f0e68e9e84041816a8a6e6b8df3fdff664
2023-08-17feat(swasync): switch to polling modeVratko Polak4-21/+419
Performance of adaptive mode is bad (different bug), keep continuity of ipsec swasync tests (when VPP allows). As 23.06-release does not have the new API message, the new CSIT code needs to be more careful around CRC checking. + Add new crc collection with the new API call used. + Also keep the old collection so older VPP does not fail. + Document how papi executor works with VPP without a message. + Prevent CRC checker from raising bodus errors with old VPP. Change-Id: I9ff933a8a9558289d22d55526905d63e7894378c Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2023-08-17Add ability to parse more kinds of test resultsVratko Polak3-26/+209
Previously, only BMRR results were recongnized. Now also lower bounds for PDR (optionally NDR) and soak are recongnized. This code expects all tests are of the same type, e.g. when both MRR and NDRPDR tests are run, only MRR result will get parsed. If test or parsing fails, generate fake data based on overall pass or fail, so at least passrate of unknown tests can be compared in theory. Currently affects only per-patch job (vpp-csit-verify-perf-*), but is useful mainly for the upcoming bisect job. + Do not force MRR test type in vpp-csit jobs. - Some test results are still not recognized (e.g. hoststack). + Do not exit per-patch job early on robot failure. + Only changes that introduce a failure (not present in parent) get -1. + The same is true also for introducing unrecognized test results. - The fake values from passrate can be misleading. + Add default nic tag only if NIC tag is missing. + In all jobs, not only in vpp-csit ones. + Do not add NIC tags for device jobs. - No job supports NDR parsing yet. + Can be enabled in future from ci-management side. Change-Id: Iee904116d1ffed69aec7e31821c67d8447f49ebe Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2023-08-17feat(ansible): Bump DPDK 23.07pmikus1-1/+1
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: Ieb1576aa45e689dda8358c4ad4708b3b09b5216c
2023-08-17fix(core): Variables for GSOpmikus1-4/+4
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I6768f65551deb335ba7b9fc07bca164bca9381fe
2023-08-15fix(core): Pylint leftoverspmikus2-3/+3
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I8d3e93f61ba7929b79da386fbfcece992fea7324
2023-08-15GSO: Add export of results to json files.Tibor Frank4-3/+12
Change-Id: Iac742f0571b11e06662af6bf1b680d0b4e196ddd Signed-off-by: Tibor Frank <tifrank@cisco.com>
2023-08-11feat(core): QAT initialization refactorpmikus5-109/+48
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: Idc91da55ab0b5c6b8eb53e8b4ce4da18a1ae891c
2023-08-07fix(core): Disable core dbg analysispmikus1-4/+5
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: Ia85c4a48155c1e760120a61b39bacbb9de1ab673
2023-08-04fix(core): QAT VF bindpmikus2-12/+16
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: Iafae1a1f538b928d3bb80bf9610a0bf7de646f8a
2023-07-27fix(core): QAT initializationpmikus5-86/+108
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I28af64b7d39a97bbb84f9d987a3f5d3a2d02701b
2023-07-27feat(core): Core allocationpmikus9-122/+146
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I782b87190dbee6e0a12c97f616b80539cd6614bd
2023-07-26job-spes: Remove gtpuhw tests from mlxTibor Frank5-37/+1
Change-Id: I7ff782992ac6d5a9d585932df8986f3b457fc7e1 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2023-07-25job-spec: Remove rdma tests from 2n-spr coverageTibor Frank16-712/+0
Change-Id: I3a96edf248dc6b0896cf68bdffbf9d40e73c8f61 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2023-07-17feat(crc): print warnings in crc checker scriptVratko Polak2-2/+18
Robot already prints warnings when running tests, but not many people are looking at robot console output. This makes the warnings visible also in VPP API CRC job console log. Change-Id: I9044a2970f46e132ec80ae0faa2e0adacc889447 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2023-07-14feat(crc): bump messages for cycle after 2306Vratko Polak3-17/+132
The supported VPP code is 380c62d7040bf285d449f1d05692141c40089470 which is the latest commit before stable/2306 diverged from master. + Separate messages into blocks with paths to .api sources. + Prepare memif for use_dma (currently always false). + Use srv6 test teardown action in srv6 device tests. - Do not use sr_policy_add_v2 from 37258 yet. - Leave a TODO to do it eventually, for now inputs are too different. - Do not use index based policer calls from 37873. - The policer_add_del is not deprecated yet and inputs are different. Change-Id: I350138f09542ec12ce4bec140203175940ccf9d4 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2023-07-14fix(packer): Namingpmikus1-3/+3
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I8127beeb6664aa51ef5cb313d658ab2e5638b581
2023-07-14feat(aws): Add new flavorspmikus2-3/+116
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: Ie63b3d6c7ff376d808587e7c96f386946c939a81
2023-07-14fix(jumpavg): penalize stdev also for size=2Vratko Polak1-4/+7
This fix is mainly needed for bisection using PDR values. The impact on trending is smaller but still beneficial, as this fix should reduce the amount of false anomalies for two-band and other unstable tests. + Update metadata for 0.4.1 release into PyPI. Change-Id: Iabab4df50f4c4ad034362820904a237c507fa710 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2023-07-07fix(core): Remove output_info.xml processingoper-230710pmikus7-64/+42
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I1528d7760228d50a4d89c0e413ad86aa882088ed
2023-06-21feat(infra): update 3n-alt cx6 iterative testsJuraj Linkeš3-8/+44
Add ipsec reassembly test cases to bring in line with 3n-icx. Add ipsec policy test cases with flow cache enabled for both inbound and outbound traffic. Remove GTPU hardware tests as the NIC doesn't support GTPU offload RX. Change-Id: I7b18914f983d5974b390f995ec638a64b9bbccbb Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2023-06-20fix(core): Altra issues with mlxpmikus1-1/+1
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: Iad8e468200df4ab77f4ed44010b1b029e840714f
2023-06-19feat(infra): update 3n-alt jobspecs with mlx cx6Maciek Konstantynowicz38-1433/+384
The lists prioritize the new Mellanox Connect-X6 NIC but retain a small number of XL710 test cases to preserve at least some coverage. They also add the avf driver for the XL710 NIC to ensure the driver is tested in at a small amount. Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech> Change-Id: Id399d075d94344fdedbe4ab71d98a33fe37f913f
2023-06-16Add cryptodev device 4xxxYulong Pei4-4/+11
QAT_4xxx is integrated QAT device on SPR platform. Signed-off-by: xinfeng zhao <xinfengx.zhao@intel.com> Signed-off-by: Yulong Pei <yulong.pei@intel.com> Change-Id: If1d4b3d72a2c66855ac8c1c42516f0cb78bdfab2
2023-06-16feat(job_specs): Supress rdma_corepmikus129-4869/+4839
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: Ie7b7401eb76e9f97f17d2f672a340ca617141388
2023-06-15fix(job_specs): Move hoststack from rdma to mlx5pmikus2-5/+25
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I8f8c97325cd2646415cfa62ef0436514b23fb701
2023-06-15fix(tests): Hoststack 2n-xyzpmikus1-6/+19
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I85de04e4a0ed1a642c40c8ca6840cbc1977b10be
2023-06-15fix(core): hard vpp killpmikus1-1/+1
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: Ie99c70ebda54153eb361954cbbd4f8191454a022
2023-06-13fix(jobspec): replace the rest of scale2m testsVratko Polak8-64/+64
A previous change has renamed the suites themselves, so the replacement in jobspecs has to be done everywhere. Fixes: cbdbc95ffc63a1eb2ffc170a979e11bfa0d4162a Change-Id: I102e9b45d2e71b8cf99fb7d7dbdd19772de613c2 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2023-06-12feat(infra): Add Mellanox CX6 to 3n-icxpmikus90-1031/+2773
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: Ic13b8cd3f2976c66d8956f0cee0784c3bae12a65
2023-06-09feat(infra): CX6 for 3n-altoper-rls2306-230612pmikus26-7/+1256
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: Iea4c536a6e421efdaf493fb3cba0dde5abad162d
2023-06-08feat(infra): Add CX7 to 2n-icxpmikus94-723/+2184
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: Ia83a78299e279754352add230428102a8cee7772
2023-06-08fix(job_specs): 3na-sprpmikus1-218/+218
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I74a23d1864a56c3906e08c70fd1d306d47b468da
2023-06-07feat(jobspec): add iterative reassembly testsVratko Polak8-0/+64
+ Only to some 3node testbeds (alt, icx, snr and tsh). + Both MRR and NDRPDR. + 1518B only. All core counts. + Primary NIC only. Drv_vfio_pci only. + Only two suites: + ethip4ipsec1000tnlsw-ip4base-int-aes256gcm-reassembly + ethip4gtpusw-ip4base-reassembly - This is expected to fail frequently due to VPP-2077. + Added to the end of crypto or ip4-tunnels section, as the focus is on fragmentation and reassembly, not on encap/decap. - Coverage not added here. Change-Id: Ifca2a13e43b9d3b7ddc0eaa8fd6d3e1a56b90c7f Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2023-06-07feat(jumpavg): support small values via unit paramVratko Polak7-46/+88
Previously, Jumpavg was known to give wrong results when the data contains values of order one or smaller. This change introduces a new "unit" parameter, which changes how the information content is calculated. For example if the data values are mutiplies of 0.01, the unit parameter should be set to 0.01 to compensate. For callers not knowing their correct unit value, another parameter is introduced, called "sbps" (meaning Significant Bits Per Sample). A binary integer number with this many ones is how much units should the maximal sample be. This way jumpavg computes the corresponding "unit" value to use. If neither "unit" nor "sbps" are given, the "sbps" value of 12 is applied. + Rename files to conform to snake_style naming. + Fix normalization for the "opposite triangle" distribution. + Simplify logic, all groups now start as "normal", not "unknown". + Minor style improvements as suggested by pylint. + From user perspective, this change should be backward compatible. - The normalization fix is a behavior change, but it is a bugfix and the new behavior should be better. Change-Id: I5a5ca11757f087fff13faf1d0b8e34a741400258 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2023-06-06fix(core): Trap for AWSpmikus1-1/+1
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I14975b21e7f480c3bca5ba6a04514008af219039
2023-06-02fix(dpdk): CX7 supportoper-230605pmikus1-2/+6
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: Ib98b25bd3c98b5e6dbcb1bfe8478bd41bf37d71c
2023-06-02job-spec: Replace TRex scale2m-tg tests by scale20k-tgTibor Frank3-18/+18
Change-Id: If7e00460fee4eee50479dc089c026670dcf3edf9 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2023-06-01fix(core): Comparison hashpmikus1-1/+3
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I84b46e6a792d72cb56a9a42d40db8cc13866b836
2023-05-31fix(tests): Disable VHOST for vpp_devicepmikus2-8/+8
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I4704b18eb74847fa7c040a27b7296912d27d6ca5
2023-05-31"fix(test): Hoststack"Peter Mikus2-10/+8
Change-Id: I6ec27d787b59d4bc13b8c04f4217302cc3021581 Signed-off-by: pmikus <peter.mikus@protonmail.ch>
2023-05-30fix(tests): Hoststack compatibilitypmikus1-0/+2
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I198fe62ddba8910c6bd8256739cc2503b87dfc75
2023-05-30fix(dpdk): Flip routespmikus1-1/+1
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I4c192210e1aef1275e8a9b56eab7956798aca15d
2023-05-29feat(tox): Cleanup docspmikus1-51/+0
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: Ia13e920ef11d364893a51957778e60084f4ac0f9
2023-05-26feat(core): T-Rex 3.03pmikus1-1/+1
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I58607f50e2889092e40ff831ed4f1515444e29f8
2023-05-26job-spec: Add 2n-spr cx7veat coverage testsTibor Frank17-0/+1248
Change-Id: I947f961e665f5eb2f2f055a47cd0119011666b28 Signed-off-by: Tibor Frank <tifrank@cisco.com>