aboutsummaryrefslogtreecommitdiffstats
path: root/resources/job_specs/report_iterative
AgeCommit message (Collapse)AuthorFilesLines
2024-09-23feat(bonding): Add simple suite for minimal coverageVratko Polak2-2/+18
- We want 2-link suite, as it has a non-trivial traffic pattern. - Not done here, as it needs edits in multiple layers. + Add 1-link suite to compare (and for 1-link testbeds). + Simplify also old bonding keywords. + Partial support for future multi-link suites. + Update jobspecs for minimal coverage: + Only add to iterative, both MRR and NDRPDR. - Coverage jobspecs to be updated later. + {1,2,4}c 64B tests, only to 3n-icx for now. + For both primary NIC+driver combinations there. Change-Id: I6da3b99a44b5ae83cc52921d5e2034fe5218270c Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-09-05job-spec: Remove job specs which are not usedTibor Frank6-600/+0
- nfv-density - reconf Change-Id: I0e74c520907ad933ef7029e1789eabad3325a0e7 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2024-09-02job-spec: Remove job-specs using CLX, TSH and TX2 testbedsTibor Frank17-2349/+0
- Those testbeds have been removed. Change-Id: I59ca4af8b39c84945e352505405d054c75f7fb17 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2024-07-16job-spec: Add imix and 1518B framesizes to ip4scale60kTibor Frank2-0/+12
Change-Id: I498540140965ecec70390e0b13c2418a31cf1dc8 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2024-06-04fix(jobspec): IPsec HWasync has 1c, not 3cVratko Polak4-8/+8
Fixes: d29977e35bb15cd7df21c082432f03eab87e2e66 Change-Id: I1a20ded1181f5a3b33a0f6640554a939218d9791 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-05-31feat(jobspec): Add new new ipsec with UDP encapVratko Polak14-66/+212
+ Only for dpdk-plugin and primary NIC. + Prefer Intel, as that seems to have more stable performance. + Only one testcase per suite: 1518B 1c. + Add full set of 10k AES256GCM tests where not present already. + Remove multi-core ipsec AVF tests from 3n-icx to keep duration small. - Performance of those was limited by CSIT-1948 anyway. Change-Id: I9166f15b44071dafe89ac8ca7982f659006027ba Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-05-31feat(jobspec): Align weekly ndrpdr to daily mrrVratko Polak4-161/+135
+ This mainly uncomments a bucnh of 3n-alt xl710 ipsec tests. + Otherwise the difference was quite small. Change-Id: I8b67fcce157f36ed79e9692a0581e1115b3f6886 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-05-31feat(jobspecs): Add more soak testsVratko Polak5-40/+171
+ Add l2xcbase. + Add 200k scale, both ip4 and ip6. + Test 200k and l2bdmaclearn also on: + Primary NIC with secondary driver. + Secondary NIC and its primary driver. + Add 1518B memif test cases, for 2n-spr also with DMA (including 64B). + This needed an edit in autogen. + Switch crypto tests to drv_vfio_pci as AVF has bad RSS on those. + Add two SRv6 cases to 3n-icx as it does not support hwasync crypto. + Repair name of UDP ASTF tests. Change-Id: I91e20ec80dc4984c55d39b5f5ad38f26b48da33e Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-05-07Add 2048B file size cps rps tests in job specs for http-ldpreload-nginx-1_21_5.oper-240513Maciek Konstantynowicz2-2/+30
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> Change-Id: Id4b562259e6d86642152298bf500b353f1785939 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2024-05-01Revert "fix(jobspec): Delete ipsec nfv density tests"Peter Mikus1-0/+143
This reverts commit 573d59a0e3cafe60522e51dc9e5ba776c0a0a6e4. Change-Id: I6fef1876d6f7274310243aa743f68b7e51daf486 Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
2024-04-29job-spec: fix dmaTibor Frank1-19/+1
Change-Id: I6202314a26fcba8cebc42eeebc3708732116caeb Signed-off-by: Tibor Frank <tifrank@cisco.com>
2024-04-29job-spec: Add eth-ip4tcphttp-dma-ldpreload-nginx-1_21_5Tibor Frank2-2/+32
- 2n-icx and - 2n-spr Change-Id: I6c1ebcd38081b86209a27fdf224923b236179ee4 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2024-04-26fix(jobspec): Delete ipsec nfv density testsVratko Polak1-143/+0
We already deleted the job and the suites. Change-Id: I0d9c4da14651884d6eeb3e200277b0ef5823df60 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-04-25feat(density): Delete ipsec nfv_density testsVratko Polak1-43/+0
They are broken for more than two years and they relied on CLIs that changed in VPP anyway. Ticket: CSIT-1856 Change-Id: I0f278ff61a9da5e6040e08bf3e92049cb33c8a93 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-04-25job-spec: Add more ipsec hw tests to 3n-snr and 3n-icxdTibor Frank4-0/+28
Change-Id: I1e874ad107dd961e886e544f7d7017086523f894 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2024-04-25job-spec: Add ipsec hw tests to 3n-snr and 3n-icxdTibor Frank4-0/+56
Change-Id: I46a6cf74da419e85b5b22a93a5703709a677a8ad Signed-off-by: Tibor Frank <tifrank@cisco.com>
2024-04-19feat(jobspec): Unify soak jobspecsVratko Polak5-115/+106
Added 9 common tests (only one for non-default NIC+driver), 4 specific to nodeness (ASTF for 2-node, IPsec for 3-node). + First round, we can add more tests when duration is stable. - Left TODOs for possible improvements. Change-Id: I4724e3a05af0dfbf2ca0c146f1bbd4665d9e0cf0 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-04-18feat(job_specs): Add soak testpmikus6-46/+184
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: I48240d2df2ee7908d07da86a4e4da359178d0b9e
2024-04-10feat(job-spec): Unify memif 1518B tests for 2n-sprVratko Polak2-0/+24
+ Add 4c 1518B tests to all memif 2n-spr coverage suites. + Add 1518B cases to iterative, so recently added DMA can be compared. Change-Id: I589fd7efe30bb70e0255bb5c94fa23c2782a7860 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-04-03job-spec: Add memif DMA 1518B testsTibor Frank2-0/+24
Change-Id: I82ccfc639f7652d9a2ac248200ed2d49f93947dc Signed-off-by: Tibor Frank <tifrank@cisco.com>
2024-03-20job-spec: Add DMA testsTibor Frank2-0/+32
Change-Id: I6530519eaab2d09a187dddd803815888606ff17d Signed-off-by: Tibor Frank <tifrank@cisco.com>
2024-03-14feat(tests): Fix scaling of 6p3nicoper-240318pmikus2-8/+8
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: I84d9cf2892423e62b116b07982d3e87120b66271
2024-02-28job-spec: add more ip4scale tests to 2n-spr and 3na-sprTibor Frank4-0/+40
Change-Id: I9c9a6ecd6698cb58e7114543de54eb01549d4af0 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2024-01-31feat(job_specs): 2n-c7gnpmikus4-0/+128
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: Idca0738320b56196e98aeec3050312111a90609a
2023-12-11feat(job_specs): Add 200ge6p3cx7veat testspmikus17-892/+900
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: Ia713b9a0b962820b014bad3582bc095ec802380c
2023-11-16workaround(job_specs): Temporarily disable af_xdppmikus8-166/+166
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I5276dbe7da224a677f7cfb07ef5b48326dd3e46f
2023-11-08feat(csit): 3n-icxdpmikus4-0/+442
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: I7f0eee8b94f65550eae68edeacf343ff982dd85a
2023-09-21fix(job_specs): c6inpmikus4-0/+128
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: Ia42f1bf77e2b88153922f3c0a387e60a9c63440b
2023-09-20feat(infra): update 3n-alt ipsec testsJuraj Linkeš2-44/+262
Remove 4 tunnel flow cache test cases, as those don't benefit from flow cache much. Add mrr ipsec test cases for the XL710 Intel NIC to increase coverage. Don't add ndrpdr for XL710, only add commented out counterparts to align with the mrr list. Also modify the existing flow cache configuration by adding the fast path config as well. These are independent features, but the fast path code added this dependency. Change-Id: Ide88fd8c1abe96c577a86925dcc2dc4e63f897d4 Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2023-09-14Add IPsec and wireguard hwasync test cases to 3nb-spr job specsxinfeng zhao2-29/+113
Also add IPsec 10000tnlhwasync int mode and 4tnlhwasync policy mode test suites, in order to compare sw crypto and QAT crypto and IPsec int mode and policy mode performance. Signed-off-by: Yulong Pei <yulong.pei@intel.com> Signed-off-by: xinfeng zhao <xinfengx.zhao@intel.com> Change-Id: I0aed06a0c75c1a545720649d3561a0aa5a861db2
2023-09-07job-specs: reduce the number of tests in daily, weekly, iterative jobsTibor Frank6-1111/+5
- 2n-spr, 2n-icx, 2n-clx - fix 2n-clx Change-Id: I4ad6da2c4c4a14c29f0f8f9b6af1cbc48f864795 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2023-07-26job-spes: Remove gtpuhw tests from mlxTibor Frank4-16/+0
Change-Id: I7ff782992ac6d5a9d585932df8986f3b457fc7e1 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2023-06-21feat(infra): update 3n-alt cx6 iterative testsJuraj Linkeš2-8/+36
Add ipsec reassembly test cases to bring in line with 3n-icx. Add ipsec policy test cases with flow cache enabled for both inbound and outbound traffic. Remove GTPU hardware tests as the NIC doesn't support GTPU offload RX. Change-Id: I7b18914f983d5974b390f995ec638a64b9bbccbb Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2023-06-19feat(infra): update 3n-alt jobspecs with mlx cx6Maciek Konstantynowicz2-741/+232
The lists prioritize the new Mellanox Connect-X6 NIC but retain a small number of XL710 test cases to preserve at least some coverage. They also add the avf driver for the XL710 NIC to ensure the driver is tested in at a small amount. Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech> Change-Id: Id399d075d94344fdedbe4ab71d98a33fe37f913f
2023-06-16feat(job_specs): Supress rdma_corepmikus12-1261/+1193
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: Ie7b7401eb76e9f97f17d2f672a340ca617141388
2023-06-15fix(job_specs): Move hoststack from rdma to mlx5pmikus1-5/+5
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I8f8c97325cd2646415cfa62ef0436514b23fb701
2023-06-13fix(jobspec): replace the rest of scale2m testsVratko Polak4-24/+24
A previous change has renamed the suites themselves, so the replacement in jobspecs has to be done everywhere. Fixes: cbdbc95ffc63a1eb2ffc170a979e11bfa0d4162a Change-Id: I102e9b45d2e71b8cf99fb7d7dbdd19772de613c2 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2023-06-12feat(infra): Add Mellanox CX6 to 3n-icxpmikus7-383/+522
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: Ic13b8cd3f2976c66d8956f0cee0784c3bae12a65
2023-06-09feat(infra): CX6 for 3n-altoper-rls2306-230612pmikus4-5/+512
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: Iea4c536a6e421efdaf493fb3cba0dde5abad162d
2023-06-08feat(infra): Add CX7 to 2n-icxpmikus16-275/+789
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: Ia83a78299e279754352add230428102a8cee7772
2023-06-08fix(job_specs): 3na-sprpmikus1-218/+218
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I74a23d1864a56c3906e08c70fd1d306d47b468da
2023-06-07feat(jobspec): add iterative reassembly testsVratko Polak8-0/+64
+ Only to some 3node testbeds (alt, icx, snr and tsh). + Both MRR and NDRPDR. + 1518B only. All core counts. + Primary NIC only. Drv_vfio_pci only. + Only two suites: + ethip4ipsec1000tnlsw-ip4base-int-aes256gcm-reassembly + ethip4gtpusw-ip4base-reassembly - This is expected to fail frequently due to VPP-2077. + Added to the end of crypto or ip4-tunnels section, as the focus is on fragmentation and reassembly, not on encap/decap. - Coverage not added here. Change-Id: Ifca2a13e43b9d3b7ddc0eaa8fd6d3e1a56b90c7f Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2023-06-02job-spec: Replace TRex scale2m-tg tests by scale20k-tgTibor Frank2-8/+8
Change-Id: If7e00460fee4eee50479dc089c026670dcf3edf9 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2023-05-31"fix(test): Hoststack"Peter Mikus1-8/+8
Change-Id: I6ec27d787b59d4bc13b8c04f4217302cc3021581 Signed-off-by: pmikus <peter.mikus@protonmail.ch>
2023-05-24feat(job_specs): Remove x710pmikus35-473/+52
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: Ib0e3be90cf5a15b24568a8bf05722d22e46fdd31
2023-05-09feat(job_specs): Add 3nab-sprpmikus11-127/+848
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I2e0feccef5c5b15b035490dfaf521c8c9a1795f8
2023-04-20job-specs: Reduce iterative, add e810cq to coverageTibor Frank6-1396/+368
- iterative, daily MRR, weekly NDRPDR: - reduce* tests with xxv710 NIC for TBs: - 2n-icx - reduction from 480 to 303 tests - 3n-icx - reduction from 441 to 306 tests - 2n-clx - reduction from 504 to 444 tests - add tests tests with e810cq NIC for TB to ensure test coverage: - 2n-clx - coverage: - add tests with e810cq NIC for TBs: - 2n-icx - 3n-icx - 2n-clx - reduce* tests with xxv710 NIC for TBs: - 2n-icx - 3n-icx - 2n-clx * Used the same approach as it was used for x710 some time ago: - keep only base tests, prefer avf driver. Signed-off-by: Tibor Frank <tifrank@cisco.com> Change-Id: I63e950e1a5df18e5f7992aa7805b9b202ee75eb5
2023-04-19fix(jobspec): Use mlx5_core instead of avf for cx7Vratko Polak2-184/+184
Mellanox cards do not support AVF driver, and rdma_core driver had worse performace. Change-Id: I619301b6ed4966f9a69274d514cca21511a2cc72 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2023-03-29feat(job_specs): Update 2n-spr daily jobspmikus7-43/+538
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I09cb0934cfe57dcd5fcca1199cc974b5ecfbed8f
2023-03-29feat(job_specs): Update 2n-spr daily jobspmikus4-21/+367
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: Ib1fd6c2e3bea90124b5ff91409e4dfeaed162cb6