aboutsummaryrefslogtreecommitdiffstats
path: root/resources/job_specs
AgeCommit message (Collapse)AuthorFilesLines
11 daysjob-spec: Remove NF_TESTPMD tests from TBs using containersTibor Frank8-405/+1
- These tests keep failing on this kind of testbeds for ages. Change-Id: Id0cdebe215ddcdcd773452e9a9f48094c4514713 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2024-10-28fix(ansible): Calibration rolePeter Mikus2-14/+0
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: Ie590eb5eaed0bec9b75ce786062f62f4a3a1d19d
2024-10-25fix(job_specs): NvidiaPeter Mikus2-6/+6
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: I954402879b7c88162a9a33675b65160b3b777a4a
2024-10-24feat(ansible): Ubuntu 24.04Peter Mikus5-293/+293
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: Id486cbf0cdade79450912b54c068a3287c4edd36
2024-10-15feat(all): Nvidia GracePeter Mikus11-413/+433
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: If89513d29fc7bb995daa4449145e9f004c1c36ec
2024-09-23feat(bonding): Add simple suite for minimal coverageVratko Polak2-2/+18
- We want 2-link suite, as it has a non-trivial traffic pattern. - Not done here, as it needs edits in multiple layers. + Add 1-link suite to compare (and for 1-link testbeds). + Simplify also old bonding keywords. + Partial support for future multi-link suites. + Update jobspecs for minimal coverage: + Only add to iterative, both MRR and NDRPDR. - Coverage jobspecs to be updated later. + {1,2,4}c 64B tests, only to 3n-icx for now. + For both primary NIC+driver combinations there. Change-Id: I6da3b99a44b5ae83cc52921d5e2034fe5218270c Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-09-09feat(tests): Remove unwanted testsPeter Mikus5-170/+0
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: Iea2fc50883e66a77fa2c7aed48fa1c79ef4c36d9
2024-09-05job-spec: Remove job specs which are not usedTibor Frank7-601/+0
- nfv-density - reconf Change-Id: I0e74c520907ad933ef7029e1789eabad3325a0e7 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2024-09-02job-spec: Remove job-specs using CLX, TSH and TX2 testbedsTibor Frank88-5993/+0
- Those testbeds have been removed. Change-Id: I59ca4af8b39c84945e352505405d054c75f7fb17 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2024-07-31feat(job_specs): Update 1n-sprpmikus1-12/+12
Due to upgrade of ubuntu 24.04 the E810 stopped working. To be investigated. Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: Iee7ede4ba4377af114be7cce0a5e9c63865cd8dc
2024-07-30feat(infra): Ubuntu 24.04 LTSpmikus1-78/+78
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: I7d672d07e6ed6bf6582888e8826bbc1cb6d94d17
2024-07-29feat(job_spec): vpp_devicepmikus2-211/+3
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: I0b2eeea045fe241129f978ec96eec5c0c5bc9938
2024-07-16job-spec: Add imix and 1518B framesizes to ip4scale60kTibor Frank3-0/+22
Change-Id: I498540140965ecec70390e0b13c2418a31cf1dc8 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2024-06-04fix(jobspec): IPsec HWasync has 1c, not 3cVratko Polak4-8/+8
Fixes: d29977e35bb15cd7df21c082432f03eab87e2e66 Change-Id: I1a20ded1181f5a3b33a0f6640554a939218d9791 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-05-31feat(jobspec): Add new new ipsec with UDP encapVratko Polak14-66/+212
+ Only for dpdk-plugin and primary NIC. + Prefer Intel, as that seems to have more stable performance. + Only one testcase per suite: 1518B 1c. + Add full set of 10k AES256GCM tests where not present already. + Remove multi-core ipsec AVF tests from 3n-icx to keep duration small. - Performance of those was limited by CSIT-1948 anyway. Change-Id: I9166f15b44071dafe89ac8ca7982f659006027ba Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-05-31feat(jobspec): Align weekly ndrpdr to daily mrrVratko Polak4-161/+135
+ This mainly uncomments a bucnh of 3n-alt xl710 ipsec tests. + Otherwise the difference was quite small. Change-Id: I8b67fcce157f36ed79e9692a0581e1115b3f6886 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-05-31feat(jobspecs): Add more soak testsVratko Polak5-40/+171
+ Add l2xcbase. + Add 200k scale, both ip4 and ip6. + Test 200k and l2bdmaclearn also on: + Primary NIC with secondary driver. + Secondary NIC and its primary driver. + Add 1518B memif test cases, for 2n-spr also with DMA (including 64B). + This needed an edit in autogen. + Switch crypto tests to drv_vfio_pci as AVF has bad RSS on those. + Add two SRv6 cases to 3n-icx as it does not support hwasync crypto. + Repair name of UDP ASTF tests. Change-Id: I91e20ec80dc4984c55d39b5f5ad38f26b48da33e Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-05-21fix(various): filespmikus1-1/+1
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I601a54e543114957592548618df2f2f4bf790f82
2024-05-17feat(device): Reconfigurepmikus1-15/+15
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: I5ca0fc5832c249553c79dd9c5d4148ba64e61654
2024-05-07Add 2048B file size cps rps tests in job specs for http-ldpreload-nginx-1_21_5.oper-240513Maciek Konstantynowicz2-2/+30
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> Change-Id: Id4b562259e6d86642152298bf500b353f1785939 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2024-05-01Revert "fix(jobspec): Delete ipsec nfv density tests"Peter Mikus2-0/+144
This reverts commit 573d59a0e3cafe60522e51dc9e5ba776c0a0a6e4. Change-Id: I6fef1876d6f7274310243aa743f68b7e51daf486 Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
2024-04-29job-spec: fix dmaTibor Frank1-19/+1
Change-Id: I6202314a26fcba8cebc42eeebc3708732116caeb Signed-off-by: Tibor Frank <tifrank@cisco.com>
2024-04-29job-spec: Add eth-ip4tcphttp-dma-ldpreload-nginx-1_21_5Tibor Frank2-2/+32
- 2n-icx and - 2n-spr Change-Id: I6c1ebcd38081b86209a27fdf224923b236179ee4 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2024-04-26fix(jobspec): Delete ipsec nfv density testsVratko Polak2-144/+0
We already deleted the job and the suites. Change-Id: I0d9c4da14651884d6eeb3e200277b0ef5823df60 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-04-25feat(density): Delete ipsec nfv_density testsVratko Polak1-43/+0
They are broken for more than two years and they relied on CLIs that changed in VPP anyway. Ticket: CSIT-1856 Change-Id: I0f278ff61a9da5e6040e08bf3e92049cb33c8a93 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-04-25job-spec: Add more ipsec hw tests to 3n-snr and 3n-icxdTibor Frank4-0/+28
Change-Id: I1e874ad107dd961e886e544f7d7017086523f894 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2024-04-25job-spec: Add ipsec hw tests to 3n-snr and 3n-icxdTibor Frank4-0/+56
Change-Id: I46a6cf74da419e85b5b22a93a5703709a677a8ad Signed-off-by: Tibor Frank <tifrank@cisco.com>
2024-04-19feat(jobspec): Unify soak jobspecsVratko Polak5-115/+106
Added 9 common tests (only one for non-default NIC+driver), 4 specific to nodeness (ASTF for 2-node, IPsec for 3-node). + First round, we can add more tests when duration is stable. - Left TODOs for possible improvements. Change-Id: I4724e3a05af0dfbf2ca0c146f1bbd4665d9e0cf0 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-04-18feat(job_specs): Add soak testpmikus11-46/+189
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: I48240d2df2ee7908d07da86a4e4da359178d0b9e
2024-04-10feat(job-spec): Unify memif 1518B tests for 2n-sprVratko Polak4-0/+34
+ Add 4c 1518B tests to all memif 2n-spr coverage suites. + Add 1518B cases to iterative, so recently added DMA can be compared. Change-Id: I589fd7efe30bb70e0255bb5c94fa23c2782a7860 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-04-03job-spec: Add memif DMA 1518B testsTibor Frank4-0/+26
Change-Id: I82ccfc639f7652d9a2ac248200ed2d49f93947dc Signed-off-by: Tibor Frank <tifrank@cisco.com>
2024-03-20job-spec: Add DMA testsTibor Frank4-0/+62
Change-Id: I6530519eaab2d09a187dddd803815888606ff17d Signed-off-by: Tibor Frank <tifrank@cisco.com>
2024-03-14feat(tests): Fix scaling of 6p3nicoper-240318pmikus2-8/+8
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: I84d9cf2892423e62b116b07982d3e87120b66271
2024-03-04feat(device): cx6 update of 1n-alt device jobspecJuraj Linkeš1-65/+112
Update the jobspec according to the current Arm policy: 1. Run most of the tests on cx6, crypto coverage being the most important, 2. Match the cx6 ipv4 crypto coverage with x710 with the DPDK driver, 3. Run basic ipv4 and l2 tests with x710 with borh DPDK and native (avf) drivers. The above is the policy used in performance testing where time is a major constraint. The same is true for functional testing to some extent, so it makes sense to apply the same logic for choosing the tests. There are 10 tests which are failing on cx6 without an identified reason. They are disabled until we find the root cause and address it. In the meantime, the tests are enabled for x710 with the DPDK driver: ethip4-l2xcbase-eth-2memif-1dcr ethip4-l2bdbasemaclrn-eth-2memif-1dcr ethip4-l2bdbasemaclrn-eth-2tap ethip4-l2bdbasemaclrn ethip4-l2bdbasemaclrn-iacl1sf ethip4-l2bdbasemaclrn-iacl1sl ethip4-l2bdbasemaclrn-oacl1sf ethip4-l2bdbasemaclrn-oacl1sl ethip4-l2patch ethip4-l2xcbase When the cx6 issue has been resolved, these should be enabled for cx6 and disabled for x710, with the exception of ethip4-l2bdbasemaclrn, which should be running on both. Change-Id: Id48f450063e405b1faca57431676f91d62e829b9 Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2024-02-28job-spec: add more ip4scale tests to 2n-spr and 3na-sprTibor Frank4-0/+40
Change-Id: I9c9a6ecd6698cb58e7114543de54eb01549d4af0 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2024-01-31feat(job_specs): 2n-c7gnpmikus10-0/+196
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: Idca0738320b56196e98aeec3050312111a90609a
2024-01-23feat(device): Add 1n-alt vpp devicepmikus1-1/+1
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: I3d2bb0408f15fd14989d1179d7f08710a3d86e67
2024-01-17feat(device): Driver compatibilitypmikus1-2/+2
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: I55421ca38df412950f4b2487e5db901a1850ed12
2023-12-11feat(job_specs): Add 200ge6p3cx7veat testspmikus98-4707/+4715
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: Ia713b9a0b962820b014bad3582bc095ec802380c
2023-11-16workaround(job_specs): Temporarily disable af_xdppmikus8-166/+166
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I5276dbe7da224a677f7cfb07ef5b48326dd3e46f
2023-11-08feat(csit): 3n-icxdpmikus19-0/+1146
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: I7f0eee8b94f65550eae68edeacf343ff982dd85a
2023-11-02fix(job_specs): 1n-vboxpmikus1-51/+0
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I0c333fe9954aaac7253064c33c9281e9246963f6
2023-10-30code and doc updates for vagrant VM dev/test environ setupNaveen Joy1-0/+209
Change-Id: I0e4e4758b3abbfc2fe2e18200b85477293de218b Signed-off-by: Naveen Joy <najoy@cisco.com> Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
2023-10-18fix(specs): 1n-spr remove VM tests, add flow vfio-pcipmikus1-16/+16
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: I2b243aa33f41d267f83727f7747a9a28ffdd1c07
2023-10-18fix(specs): 1n-spr disable flow testspmikus1-11/+11
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: Ibddb430707510e2b3e803c892a7feeea6ab82ccd
2023-10-18fix(specs): 1n-spr disable flow testspmikus1-16/+16
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: Ic4df3c303cd0758875dfcfdc3d0884a1b37448df
2023-09-21fix(job_specs): c6inpmikus12-0/+198
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: Ia42f1bf77e2b88153922f3c0a387e60a9c63440b
2023-09-20feat(infra): update 3n-alt ipsec testsJuraj Linkeš2-44/+262
Remove 4 tunnel flow cache test cases, as those don't benefit from flow cache much. Add mrr ipsec test cases for the XL710 Intel NIC to increase coverage. Don't add ndrpdr for XL710, only add commented out counterparts to align with the mrr list. Also modify the existing flow cache configuration by adding the fast path config as well. These are independent features, but the fast path code added this dependency. Change-Id: Ide88fd8c1abe96c577a86925dcc2dc4e63f897d4 Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2023-09-14Add IPsec and wireguard hwasync test cases to 3nb-spr job specsxinfeng zhao4-29/+261
Also add IPsec 10000tnlhwasync int mode and 4tnlhwasync policy mode test suites, in order to compare sw crypto and QAT crypto and IPsec int mode and policy mode performance. Signed-off-by: Yulong Pei <yulong.pei@intel.com> Signed-off-by: xinfeng zhao <xinfengx.zhao@intel.com> Change-Id: I0aed06a0c75c1a545720649d3561a0aa5a861db2
2023-09-08feat(infra): Add 1n_sprpmikus1-0/+208
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I20e720302561f5f7d1f7a80a83548077a88025af