aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2024-04-30feat(profiles): Do not repeat seeds in 6p profilesVratko Polak12-66/+18
On one hand, using seed==1 for all W-E streams and seed=2 for all E-W streams would make 6p tests even more comparable with 2p tests. But current rnd profiles were mixing the two seed values. On the other hand, using unique seed values for each stream would ensure VPP is less likely to deviate from average preformance. As the second approach also results in smaller profile files, this patch applies that approach. Change-Id: If0f57282a2899a1a4fb154dd6ed810064cb5c212 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-04-30fix(profiles): Properly randomize in last profileVratko Polak1-7/+14
The file trex-stl-ethip6-ip6dst-rnd1000000-6p.py was not properly edited when converting from a non-random profile. Change-Id: I2fdf424176c69467dcf00cd4dc15f147c3576817 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-04-30cleanup(ip4scale): Delete recently orphaned rnd profilesVratko Polak3-418/+0
The rnd suites were already migrated to use the -2p profiles instead. The non-rnd traffic profiles (without -2p) are still used in trex suites and some ipsec suites, so they cannot be removed yet. Change-Id: Ibc97b039c218418701081d3838ef40987110ef64 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-04-29Update VPP_STABLE_VER filesTibor Frank1-1/+1
Change-Id: I927f8aa6797fd6f081bc2f618b1b7e379aaa3e12 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2024-04-29job-spec: fix dmaTibor Frank1-19/+1
Change-Id: I6202314a26fcba8cebc42eeebc3708732116caeb Signed-off-by: Tibor Frank <tifrank@cisco.com>
2024-04-29job-spec: Add eth-ip4tcphttp-dma-ldpreload-nginx-1_21_5Tibor Frank2-2/+32
- 2n-icx and - 2n-spr Change-Id: I6c1ebcd38081b86209a27fdf224923b236179ee4 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2024-04-26Revert "fix(IPsecUtil): Delete keywords no longer used"Vratko Polak1-0/+43
This reverts commit 79635f7cdfb7046230473570068f97a159cf87b4. Peter says he is using those. Change-Id: I47886ba0676bc74d5189a2986ac347f49fdde36c Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-04-26fix(IPsecUtil): Delete keywords no longer usedVratko Polak1-43/+0
When deleting ipsec nvf density suites, I removed the main L2 Robot keyword, but forgot to remove the associated L1 Python keywords. Change-Id: I0f72699dcab272aec5c531cdaacceed30356cd02 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-04-26fix(jobspec): Delete ipsec nfv density testsVratko Polak2-144/+0
We already deleted the job and the suites. Change-Id: I0d9c4da14651884d6eeb3e200277b0ef5823df60 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-04-26feat(tests): IPsecHW rxq ratiopmikus25-0/+25
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: I17866709e1c7edf078055aef4db15774e136b111
2024-04-26feat(profiles): IPv6 unseedpmikus1-3/+1
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: I72a91c6270bd43fd41b8d7389b759305d9a3d408
2024-04-25feat(density): Delete ipsec nfv_density testsVratko Polak38-6197/+0
They are broken for more than two years and they relied on CLIs that changed in VPP anyway. Ticket: CSIT-1856 Change-Id: I0f278ff61a9da5e6040e08bf3e92049cb33c8a93 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-04-25fix(methodology): Update info for soak and ndrpdrVratko Polak2-37/+50
Change-Id: I58fa4b3494c6148735a992f2c0e8a7ba771660a8 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-04-25job-spec: Add more ipsec hw tests to 3n-snr and 3n-icxdTibor Frank4-0/+28
Change-Id: I1e874ad107dd961e886e544f7d7017086523f894 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2024-04-25C-Dash: Add soak testsTibor Frank12-33/+115
Change-Id: Ibe17b7dc2125fa6ace496897a7cf9115a5f2c736 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2024-04-25job-spec: Add ipsec hw tests to 3n-snr and 3n-icxdTibor Frank4-0/+56
Change-Id: I46a6cf74da419e85b5b22a93a5703709a677a8ad Signed-off-by: Tibor Frank <tifrank@cisco.com>
2024-04-25feat(profiles): Cleanup IPv6 profilespmikus14-993/+123
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: Ib9d1d819e59be768377f3a61578c22699a10f0a8
2024-04-25Revert "fix(ip6scale): Unify rnd profiles"Peter Mikus0-0/+0
This reverts commit b06f091ae65a7323231d84d188b863698169508b. Reason for revert: . Change-Id: I4c36a8ca1dd28db853e9eefef9a409142d073779 Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
2024-04-25Revert "fix(ip6scale): Unify rnd profiles"Peter Mikus6-17/+34
This reverts commit b06f091ae65a7323231d84d188b863698169508b. Reason for revert: . Change-Id: I99b7c3365e7e74aadcf366c8ca284ad458dcc8e6 Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
2024-04-24fix(ip6scale): Unify rnd profilesVratko Polak6-34/+17
Some were not even using STLVmFlowVarRepeatableRandom. + Simplify seed calculation. Change-Id: If3211dd2336838ee1ad7137563ddf8cc90ebea00 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-04-24style(ipsec): add type hints to IPsecUtilVratko Polak1-229/+253
+ Update docstrings to match. Change-Id: I20f8f0247a9cf38a2d9a98fa8905eb55d91817f7 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-04-23feat(etl): SOAKpmikus2-171/+245
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: Ic8cd4cc6de271ca39b2b9d4e07da2718772e9a38
2024-04-22style(ipsec): Unify mutiline stringsVratko Polak1-79/+72
+ One more pylint improvement not worth a separate change. Change-Id: I5a2a3a4c70909fefd3fdf6f3ed8b344d19fc823e Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-04-22style(ipsec): Fix some issues reported by pylintVratko Polak2-41/+31
+ Fix typo "enale". - Many style and complexity issues remain: C0302, R0904, R0914, R0913, R1735, R0915, R1734. Change-Id: I7e8c7ecefd8f8f94dcbc28427baa52a9c8ea1227 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-04-22Add hoststack with DMA test suitesxinfengx5-18/+335
Change-Id: Idef14bef816a04ca43ab9aced4b1441ef818e066 Signed-off-by: xinfengx <xinfengx.zhao@intel.com>
2024-04-22fix(ip6scale): Document correct prefix lengthVratko Polak14-18/+18
We are testing /128 in ip6 scale tests for a long time, but we did not update the suite documentation when we switched. This does that. Note that ip6 bas (and feature) tests are still using /64. Change-Id: I5e108497b3f516195fce0e480ca3ec18d204bd84 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-04-22Update VPP_STABLE_VER filesTibor Frank1-1/+1
Change-Id: If4175b67b34c96a097cbc7f250535159eef816be Signed-off-by: Tibor Frank <tifrank@cisco.com>
2024-04-19feat(jobspec): Unify soak jobspecsVratko Polak5-115/+106
Added 9 common tests (only one for non-default NIC+driver), 4 specific to nodeness (ASTF for 2-node, IPsec for 3-node). + First round, we can add more tests when duration is stable. - Left TODOs for possible improvements. Change-Id: I4724e3a05af0dfbf2ca0c146f1bbd4665d9e0cf0 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-04-18feat(tests): IPv6 fixespmikus7-45/+43
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: I9bc9f9fe410c0fa78e20a234487e63eb42f3fe3f
2024-04-18feat(job_specs): Add soak testpmikus12-46/+195
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: I48240d2df2ee7908d07da86a4e4da359178d0b9e
2024-04-18Revert "fix(ip6): Use updated profile names in 2n suites"Peter Mikus3-6/+6
This reverts commit b3c5215bba37bd6555231da8c40ae90d9fc570c9. Reason for revert: Makes no sense Change-Id: Iabe098114a0e98a89e815daf706745917d8504a6 Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
2024-04-17fix(ipsec): Prepare IPsecUtil for upcoming changesVratko Polak1-44/+36
+ Separate sad into two cycles. + Do not update flags in each iteration. + Update inner dicts. Change-Id: Ic81dfc6e614cc78ff321fba748d48a30678cc88a Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-04-17style(ipsec): Do not import ipsec.robot to suitesVratko Polak131-308/+177
It is already available via default.robot import. Change-Id: I52c8f5d62f641edfbbc4b750e40274a75b169a22 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-04-17feat(tox): add copyright year fixer scriptVratko Polak5-13/+71
It uses rather simple sed commands, but seems to work well enough. + Improve readme. + Shortened comments about why 3 lines. Change-Id: I50b395dfeb586f671f7c4c82f22369de90b351ec Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-04-17fix(ip6): Use updated profile names in 2n suitesVratko Polak3-6/+6
Change-Id: If5cc42bac1c49d1f1d960e0812ab352564bc29d2 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-04-16style(IPsecUtil): Apply black formattingVratko Polak1-465/+714
Change-Id: I7cc2bc69c6849360abff0bd18b2ae3b93e2303c4 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-04-15feat(api): Use newest API messages after rls2402Vratko Polak5-53/+437
+ gtpu_add_del_tunnel_v2 + Add comments on used values and unused fields. + ipsec_sad_entry_add_v2 + Explicitly pass current default values. + ipsec_sa_v5_dump + policer_add + The old is_add argument removed, it was never false. + sr_policy_add_v2 + Add comments about currently unused fields. + Support also older VP builds with wrong reply. + rdma_create_v4 + Add comments about unused fields. Change-Id: I3d5bc345c4cf099661626770c4d86bc230643cca Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-04-15Update VPP_STABLE_VER filesTibor Frank1-1/+1
Change-Id: If792605aebeeedc722bc677b693be75858ac61e0 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2024-04-11feat(tests): IPv6 scalepmikus35-35/+2504
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: I720b7c96a6ac9f328aff57437e51254364604911
2024-04-10feat(job-spec): Unify memif 1518B tests for 2n-sprVratko Polak4-0/+34
+ Add 4c 1518B tests to all memif 2n-spr coverage suites. + Add 1518B cases to iterative, so recently added DMA can be compared. Change-Id: I589fd7efe30bb70e0255bb5c94fa23c2782a7860 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-04-10fix(report): Update RCAVratko Polak1-1/+1
Probably last update this cycle. Few remamining failures were seen, but they are probably too rare to reproduce. Change-Id: Ia0e1dd20ed23412584624dc313c9de09d2081429 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-04-09fix(perpatch): Sort comparison output by test nameVratko Polak2-3/+7
Change-Id: Id68a4e2b7514b9cf2e1f2f30b78dc0cd696a673a Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-04-08Update VPP_STABLE_VER filesTibor Frank1-1/+1
Change-Id: I9e7cd93d7b07ba86e11eb9b75a9a11a6f3b4c617 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2024-04-04Fix(perpatch): improve compare script outputVratko Polak1-9/+8
+ Make tests more searchable by "Test name" prefix. + Shorten the output code (fewer duplication and continues). Change-Id: I0adfac146a689466345a30646e41fe948ea264ae Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-04-03job-spec: Add memif DMA 1518B testsTibor Frank4-0/+26
Change-Id: I82ccfc639f7652d9a2ac248200ed2d49f93947dc Signed-off-by: Tibor Frank <tifrank@cisco.com>
2024-04-02Revert "fix(topologies): Disable tb31 so jobs use tb32"Peter Mikus1-0/+0
This reverts commit 2734517899b6c109da520e6aef0866c8b78ec708. Reason for revert: not a proper solution, just hides an issue Change-Id: I51cb6875748c29e5bae5894c0cbabf1caf231817 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2024-04-02Update VPP_STABLE_VER filesTibor Frank1-1/+1
Change-Id: I31939169c1dee80d496fa9d5bcfa3ef3b071eb1a Signed-off-by: Tibor Frank <tifrank@cisco.com>
2024-03-27fix(topologies): Disable tb31 so jobs use tb32Vratko Polak1-0/+0
As tb31 is the first reserved for 3n-icxd jobs, most runs are currently failing due to CSIT-1951 (TwentyFiveGigabitEthernet89/0/2 does not do up). Change-Id: I045e10daf114e02d3b46fc0e5a0cf9d080605092 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-03-27fix(report): Update RCA for this weekVratko Polak1-5/+7
Change-Id: I4c3dfc60361d1109c92f64b4fe360f7063cdf9b9 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-03-26fix(perpatch): Do not repeat test nameVratko Polak1-2/+1
When searching for a specific test, it is confusing to see the name twice, first time close to previous test classification. Change-Id: I43d838090f89d23af9da1dc93f9dd1946aebae75 Signed-off-by: Vratko Polak <vrpolak@cisco.com>