aboutsummaryrefslogtreecommitdiffstats
path: root/resources/job_specs
AgeCommit message (Collapse)AuthorFilesLines
2024-04-25job-spec: Add ipsec hw tests to 3n-snr and 3n-icxdTibor Frank4-0/+56
Change-Id: I46a6cf74da419e85b5b22a93a5703709a677a8ad Signed-off-by: Tibor Frank <tifrank@cisco.com>
2024-04-19feat(jobspec): Unify soak jobspecsVratko Polak5-115/+106
Added 9 common tests (only one for non-default NIC+driver), 4 specific to nodeness (ASTF for 2-node, IPsec for 3-node). + First round, we can add more tests when duration is stable. - Left TODOs for possible improvements. Change-Id: I4724e3a05af0dfbf2ca0c146f1bbd4665d9e0cf0 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-04-18feat(job_specs): Add soak testpmikus11-46/+189
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: I48240d2df2ee7908d07da86a4e4da359178d0b9e
2024-04-10feat(job-spec): Unify memif 1518B tests for 2n-sprVratko Polak4-0/+34
+ Add 4c 1518B tests to all memif 2n-spr coverage suites. + Add 1518B cases to iterative, so recently added DMA can be compared. Change-Id: I589fd7efe30bb70e0255bb5c94fa23c2782a7860 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-04-03job-spec: Add memif DMA 1518B testsTibor Frank4-0/+26
Change-Id: I82ccfc639f7652d9a2ac248200ed2d49f93947dc Signed-off-by: Tibor Frank <tifrank@cisco.com>
2024-03-20job-spec: Add DMA testsTibor Frank4-0/+62
Change-Id: I6530519eaab2d09a187dddd803815888606ff17d Signed-off-by: Tibor Frank <tifrank@cisco.com>
2024-03-14feat(tests): Fix scaling of 6p3nicoper-240318pmikus2-8/+8
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: I84d9cf2892423e62b116b07982d3e87120b66271
2024-03-04feat(device): cx6 update of 1n-alt device jobspecJuraj Linkeš1-65/+112
Update the jobspec according to the current Arm policy: 1. Run most of the tests on cx6, crypto coverage being the most important, 2. Match the cx6 ipv4 crypto coverage with x710 with the DPDK driver, 3. Run basic ipv4 and l2 tests with x710 with borh DPDK and native (avf) drivers. The above is the policy used in performance testing where time is a major constraint. The same is true for functional testing to some extent, so it makes sense to apply the same logic for choosing the tests. There are 10 tests which are failing on cx6 without an identified reason. They are disabled until we find the root cause and address it. In the meantime, the tests are enabled for x710 with the DPDK driver: ethip4-l2xcbase-eth-2memif-1dcr ethip4-l2bdbasemaclrn-eth-2memif-1dcr ethip4-l2bdbasemaclrn-eth-2tap ethip4-l2bdbasemaclrn ethip4-l2bdbasemaclrn-iacl1sf ethip4-l2bdbasemaclrn-iacl1sl ethip4-l2bdbasemaclrn-oacl1sf ethip4-l2bdbasemaclrn-oacl1sl ethip4-l2patch ethip4-l2xcbase When the cx6 issue has been resolved, these should be enabled for cx6 and disabled for x710, with the exception of ethip4-l2bdbasemaclrn, which should be running on both. Change-Id: Id48f450063e405b1faca57431676f91d62e829b9 Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2024-02-28job-spec: add more ip4scale tests to 2n-spr and 3na-sprTibor Frank4-0/+40
Change-Id: I9c9a6ecd6698cb58e7114543de54eb01549d4af0 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2024-01-31feat(job_specs): 2n-c7gnpmikus10-0/+196
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: Idca0738320b56196e98aeec3050312111a90609a
2024-01-23feat(device): Add 1n-alt vpp devicepmikus1-1/+1
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: I3d2bb0408f15fd14989d1179d7f08710a3d86e67
2024-01-17feat(device): Driver compatibilitypmikus1-2/+2
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: I55421ca38df412950f4b2487e5db901a1850ed12
2023-12-11feat(job_specs): Add 200ge6p3cx7veat testspmikus98-4707/+4715
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: Ia713b9a0b962820b014bad3582bc095ec802380c
2023-11-16workaround(job_specs): Temporarily disable af_xdppmikus8-166/+166
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I5276dbe7da224a677f7cfb07ef5b48326dd3e46f
2023-11-08feat(csit): 3n-icxdpmikus19-0/+1146
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: I7f0eee8b94f65550eae68edeacf343ff982dd85a
2023-11-02fix(job_specs): 1n-vboxpmikus1-51/+0
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I0c333fe9954aaac7253064c33c9281e9246963f6
2023-10-30code and doc updates for vagrant VM dev/test environ setupNaveen Joy1-0/+209
Change-Id: I0e4e4758b3abbfc2fe2e18200b85477293de218b Signed-off-by: Naveen Joy <najoy@cisco.com> Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
2023-10-18fix(specs): 1n-spr remove VM tests, add flow vfio-pcipmikus1-16/+16
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: I2b243aa33f41d267f83727f7747a9a28ffdd1c07
2023-10-18fix(specs): 1n-spr disable flow testspmikus1-11/+11
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: Ibddb430707510e2b3e803c892a7feeea6ab82ccd
2023-10-18fix(specs): 1n-spr disable flow testspmikus1-16/+16
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: Ic4df3c303cd0758875dfcfdc3d0884a1b37448df
2023-09-21fix(job_specs): c6inpmikus12-0/+198
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: Ia42f1bf77e2b88153922f3c0a387e60a9c63440b
2023-09-20feat(infra): update 3n-alt ipsec testsJuraj Linkeš2-44/+262
Remove 4 tunnel flow cache test cases, as those don't benefit from flow cache much. Add mrr ipsec test cases for the XL710 Intel NIC to increase coverage. Don't add ndrpdr for XL710, only add commented out counterparts to align with the mrr list. Also modify the existing flow cache configuration by adding the fast path config as well. These are independent features, but the fast path code added this dependency. Change-Id: Ide88fd8c1abe96c577a86925dcc2dc4e63f897d4 Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2023-09-14Add IPsec and wireguard hwasync test cases to 3nb-spr job specsxinfeng zhao4-29/+261
Also add IPsec 10000tnlhwasync int mode and 4tnlhwasync policy mode test suites, in order to compare sw crypto and QAT crypto and IPsec int mode and policy mode performance. Signed-off-by: Yulong Pei <yulong.pei@intel.com> Signed-off-by: xinfeng zhao <xinfengx.zhao@intel.com> Change-Id: I0aed06a0c75c1a545720649d3561a0aa5a861db2
2023-09-08feat(infra): Add 1n_sprpmikus1-0/+208
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I20e720302561f5f7d1f7a80a83548077a88025af
2023-09-07job-specs: reduce the number of tests in daily, weekly, iterative jobsTibor Frank6-1111/+5
- 2n-spr, 2n-icx, 2n-clx - fix 2n-clx Change-Id: I4ad6da2c4c4a14c29f0f8f9b6af1cbc48f864795 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2023-07-26job-spes: Remove gtpuhw tests from mlxTibor Frank5-37/+1
Change-Id: I7ff782992ac6d5a9d585932df8986f3b457fc7e1 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2023-07-25job-spec: Remove rdma tests from 2n-spr coverageTibor Frank16-712/+0
Change-Id: I3a96edf248dc6b0896cf68bdffbf9d40e73c8f61 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2023-06-21feat(infra): update 3n-alt cx6 iterative testsJuraj Linkeš2-8/+36
Add ipsec reassembly test cases to bring in line with 3n-icx. Add ipsec policy test cases with flow cache enabled for both inbound and outbound traffic. Remove GTPU hardware tests as the NIC doesn't support GTPU offload RX. Change-Id: I7b18914f983d5974b390f995ec638a64b9bbccbb Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2023-06-19feat(infra): update 3n-alt jobspecs with mlx cx6Maciek Konstantynowicz38-1433/+384
The lists prioritize the new Mellanox Connect-X6 NIC but retain a small number of XL710 test cases to preserve at least some coverage. They also add the avf driver for the XL710 NIC to ensure the driver is tested in at a small amount. Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech> Change-Id: Id399d075d94344fdedbe4ab71d98a33fe37f913f
2023-06-16feat(job_specs): Supress rdma_corepmikus129-4869/+4839
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: Ie7b7401eb76e9f97f17d2f672a340ca617141388
2023-06-15fix(job_specs): Move hoststack from rdma to mlx5pmikus2-5/+25
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I8f8c97325cd2646415cfa62ef0436514b23fb701
2023-06-13fix(jobspec): replace the rest of scale2m testsVratko Polak8-64/+64
A previous change has renamed the suites themselves, so the replacement in jobspecs has to be done everywhere. Fixes: cbdbc95ffc63a1eb2ffc170a979e11bfa0d4162a Change-Id: I102e9b45d2e71b8cf99fb7d7dbdd19772de613c2 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2023-06-12feat(infra): Add Mellanox CX6 to 3n-icxpmikus89-1030/+2772
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: Ic13b8cd3f2976c66d8956f0cee0784c3bae12a65
2023-06-09feat(infra): CX6 for 3n-altoper-rls2306-230612pmikus23-6/+1247
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: Iea4c536a6e421efdaf493fb3cba0dde5abad162d
2023-06-08feat(infra): Add CX7 to 2n-icxpmikus94-723/+2184
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: Ia83a78299e279754352add230428102a8cee7772
2023-06-08fix(job_specs): 3na-sprpmikus1-218/+218
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I74a23d1864a56c3906e08c70fd1d306d47b468da
2023-06-07feat(jobspec): add iterative reassembly testsVratko Polak8-0/+64
+ Only to some 3node testbeds (alt, icx, snr and tsh). + Both MRR and NDRPDR. + 1518B only. All core counts. + Primary NIC only. Drv_vfio_pci only. + Only two suites: + ethip4ipsec1000tnlsw-ip4base-int-aes256gcm-reassembly + ethip4gtpusw-ip4base-reassembly - This is expected to fail frequently due to VPP-2077. + Added to the end of crypto or ip4-tunnels section, as the focus is on fragmentation and reassembly, not on encap/decap. - Coverage not added here. Change-Id: Ifca2a13e43b9d3b7ddc0eaa8fd6d3e1a56b90c7f Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2023-06-02job-spec: Replace TRex scale2m-tg tests by scale20k-tgTibor Frank3-18/+18
Change-Id: If7e00460fee4eee50479dc089c026670dcf3edf9 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2023-05-31fix(tests): Disable VHOST for vpp_devicepmikus2-8/+8
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I4704b18eb74847fa7c040a27b7296912d27d6ca5
2023-05-31"fix(test): Hoststack"Peter Mikus1-8/+8
Change-Id: I6ec27d787b59d4bc13b8c04f4217302cc3021581 Signed-off-by: pmikus <peter.mikus@protonmail.ch>
2023-05-26job-spec: Add 2n-spr cx7veat coverage testsTibor Frank17-0/+1248
Change-Id: I947f961e665f5eb2f2f055a47cd0119011666b28 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2023-05-24job-spec: 2n-spr dpdk coverageTibor Frank1-0/+44
Change-Id: I56e62660053694e2b54467fed7c843ff5b201e1d Signed-off-by: Tibor Frank <tifrank@cisco.com>
2023-05-24feat(job_specs): Remove x710pmikus110-1695/+150
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: Ib0e3be90cf5a15b24568a8bf05722d22e46fdd31
2023-05-09feat(job_specs): Add 3nab-sprpmikus119-131/+6581
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I2e0feccef5c5b15b035490dfaf521c8c9a1795f8
2023-04-20job-specs: Reduce iterative, add e810cq to coverageTibor Frank99-6657/+5720
- iterative, daily MRR, weekly NDRPDR: - reduce* tests with xxv710 NIC for TBs: - 2n-icx - reduction from 480 to 303 tests - 3n-icx - reduction from 441 to 306 tests - 2n-clx - reduction from 504 to 444 tests - add tests tests with e810cq NIC for TB to ensure test coverage: - 2n-clx - coverage: - add tests with e810cq NIC for TBs: - 2n-icx - 3n-icx - 2n-clx - reduce* tests with xxv710 NIC for TBs: - 2n-icx - 3n-icx - 2n-clx * Used the same approach as it was used for x710 some time ago: - keep only base tests, prefer avf driver. Signed-off-by: Tibor Frank <tifrank@cisco.com> Change-Id: I63e950e1a5df18e5f7992aa7805b9b202ee75eb5
2023-04-19fix(jobspec): Use mlx5_core instead of avf for cx7Vratko Polak2-184/+184
Mellanox cards do not support AVF driver, and rdma_core driver had worse performace. Change-Id: I619301b6ed4966f9a69274d514cca21511a2cc72 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2023-03-29feat(job_specs): Update 2n-spr jobspmikus21-0/+1317
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I97e2cbe12f14fc90a074cdfbf662b60b2b217647
2023-03-29feat(job_specs): Update 2n-spr daily jobspmikus7-43/+538
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I09cb0934cfe57dcd5fcca1199cc974b5ecfbed8f
2023-03-29feat(job_specs): Update 2n-spr daily jobspmikus4-21/+367
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: Ib1fd6c2e3bea90124b5ff91409e4dfeaed162cb6
2023-03-13feat(docs): Move job_specs to resourcespmikus275-0/+22839
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: Iee0ded1f2fb43a09a7a1d61f593f4e92ead3dbb3