aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2024-05-22Update DPDK_STABLE_VER filesTibor Frank1-1/+1
Change-Id: Ia4355295e783f29c87db6ed009370bd794d9b4ce Signed-off-by: Tibor Frank <tifrank@cisco.com>
2024-05-22C-Doc: Add placeholder for 2406 rls notes.Tibor Frank15-122/+418
Change-Id: I89f2d314ff5ed33a86407489733544f197ad3d87 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2024-05-21C-Dash: Enable reading of constants from env variablesTibor Frank8-183/+268
+ add switching on/off the apps Change-Id: I46e0cd2f214fd6a05ec0b87a433708bc4b6e2eb1 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2024-05-21fix(various): filespmikus3-4/+4
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I601a54e543114957592548618df2f2f4bf790f82
2024-05-21fix(hoststack): Use TX checksum offloadVratko Polak14-10/+16
Some tests were already doing that via Set Test Variable, this moves the flag into Variables table for every suite. Change-Id: I54e86f3fd10354dc87c2f04c70bbab771f89f3d2 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-05-20fix(perf): Increase threshold for jumboVratko Polak1-2/+2
The old limit of 1522 was introduced long time ago. First, it appeared here [0], where it is correct as that suite has zero overhead. The first suite with wrong logic seems to be here [1] (no "Add No Multi Seg to all DUTs" in 1518B testcase). And when I was moving that logic to a keyword in [2], I did not realize it is wrong with overhead. This Change uses 1800 as the new threshold, matching the value used for non-jumbo MTU. [0] https://gerrit.fd.io/r/c/csit/+/2652/12/tests/perf/Bridge_Domain_Intel-X520-DA2.robot#70 [1] https://gerrit.fd.io/r/c/csit/+/4454/96/tests/perf/40ge2p1xl710-ethip4ipsecscaleip4-ip4base-interfaces-aes-gcm-ndrpdrdisc.robot#229 [2] https://gerrit.fd.io/r/c/csit/+/13411/35/resources/libraries/robot/performance/performance_utils.robot#84 Change-Id: Iff3703fcff0e4bbb1a6b10be359fa5ef67fd5422 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-05-20Update VPP_STABLE_VER filesTibor Frank1-1/+1
Change-Id: I818cc10e971c85cd8e712c05536b5813bf18749a Signed-off-by: Tibor Frank <tifrank@cisco.com>
2024-05-17feat(device): Reconfigurepmikus3-23/+35
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: I5ca0fc5832c249553c79dd9c5d4148ba64e61654
2024-05-16feat(bootstrap): Add more granular eb scriptspmikus2-47/+52
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: Icbcd373ef815fa082d9be022fc201c96df140536
2024-05-14feat(CpuUtils): Allow suites to forbid siblingsVratko Polak5-1/+9
Some perf suites use a single unidirectional flow of traffic. On SMT-enabled machines, 1C tests create 2 workers by default. But if there is only one stream/flow, only one worker does useful work. The other worker on the sibling logical core does busy-wait, which provably lowers the peformance. Some suites already set smt_used (as a suite variable) to False for these purposes. This change edits a lower-level L1 keyword to honor this value, and adds the suite variable to single stream (and client) hoststack suites, where the detrimental effect of busy siblings was observed. Change-Id: I203f1a700d8e6cd84640b9c0b40487cb832908aa Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-05-13feat(hoststack): Apply no-muti-segVratko Polak10-20/+20
+ State frame size as 1518 octets, even if some packets are smaller. + This implicitly makes CSIT keywords to apply n-milti-seg. - Real frame size is currently not important. Change-Id: I754eac7e7ebf0378efb27149862004e35c387505 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-05-13Update VPP_STABLE_VER filesTibor Frank1-1/+1
Change-Id: I8ab964a6196dc3e81a4b7a9e7d8a7f0c0e2a0002 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2024-05-07Add 2048B file size cps rps tests in job specs for http-ldpreload-nginx-1_21_5.oper-240513Maciek Konstantynowicz2-2/+30
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> Change-Id: Id4b562259e6d86642152298bf500b353f1785939 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2024-05-06C-Dash: replace s3-logs by logsTibor Frank1-1/+1
Change-Id: Ib702521379e3f93b6e223882e187827e84b1189c Signed-off-by: Tibor Frank <tifrank@cisco.com>
2024-05-06Update VPP_STABLE_VER filesTibor Frank1-1/+1
Change-Id: I09706e24780e34dc8f02e36acc25ec7066aea9cd Signed-off-by: Tibor Frank <tifrank@cisco.com>
2024-05-01Revert "fix(jobspec): Delete ipsec nfv density tests"Peter Mikus2-0/+144
This reverts commit 573d59a0e3cafe60522e51dc9e5ba776c0a0a6e4. Change-Id: I6fef1876d6f7274310243aa743f68b7e51daf486 Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
2024-05-01Revert "feat(profiles): Do not repeat seeds in 6p profiles"Peter Mikus12-18/+66
This reverts commit b8f31fc3da4b0a6ab5805eea61af0fe7e869a453. Change-Id: I65f79bb323f48d9e7b3ed7a1990db1b1486da26e Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
2024-05-01Revert "style(scale): Apply black to new traffic profiles"Peter Mikus24-246/+246
This reverts commit 4e2635deff33db4bea476003ac222ffd9ab504b1. Change-Id: Idb9145fbf13e7943392a72f77ef9a1b479187732 Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
2024-04-30feat(ipsec): Use strings instead of enums in RobotVratko Polak124-788/+518
Only related to enums appearing in ipsec suites. + Add conversion utility as enum_utils.py file. + Rename PolicyAction closer to ipsec_types.api: IpsecSpdAction. + Device and perf suites updated to use str in Variables table. - Perf suites are being tested. Change-Id: I3b1678c4d6cc303c590e5e3665ab1b05d104a121 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-04-30fix(hoststack): Remove unwanted api trace in DMA testKai Ji1-1/+0
Change-Id: I48ec272fb150c09221142b8d73830d7b6741d0b5 Signed-off-by: Kai Ji <kai.ji@intel.com>
2024-04-30style(scale): Apply black to new traffic profilesVratko Polak24-246/+246
+ Add trailing commas to prevent black from collapsing argument lists. Change-Id: I8a2f2aca0df7a9271a073f87603f9abfa4870b11 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-04-30feat(profiles): Do not repeat seeds in 6p profilesVratko Polak12-66/+18
On one hand, using seed==1 for all W-E streams and seed=2 for all E-W streams would make 6p tests even more comparable with 2p tests. But current rnd profiles were mixing the two seed values. On the other hand, using unique seed values for each stream would ensure VPP is less likely to deviate from average preformance. As the second approach also results in smaller profile files, this patch applies that approach. Change-Id: If0f57282a2899a1a4fb154dd6ed810064cb5c212 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-04-30fix(profiles): Properly randomize in last profileVratko Polak1-7/+14
The file trex-stl-ethip6-ip6dst-rnd1000000-6p.py was not properly edited when converting from a non-random profile. Change-Id: I2fdf424176c69467dcf00cd4dc15f147c3576817 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-04-30cleanup(ip4scale): Delete recently orphaned rnd profilesVratko Polak3-418/+0
The rnd suites were already migrated to use the -2p profiles instead. The non-rnd traffic profiles (without -2p) are still used in trex suites and some ipsec suites, so they cannot be removed yet. Change-Id: Ibc97b039c218418701081d3838ef40987110ef64 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-04-29Update VPP_STABLE_VER filesTibor Frank1-1/+1
Change-Id: I927f8aa6797fd6f081bc2f618b1b7e379aaa3e12 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2024-04-29job-spec: fix dmaTibor Frank1-19/+1
Change-Id: I6202314a26fcba8cebc42eeebc3708732116caeb Signed-off-by: Tibor Frank <tifrank@cisco.com>
2024-04-29job-spec: Add eth-ip4tcphttp-dma-ldpreload-nginx-1_21_5Tibor Frank2-2/+32
- 2n-icx and - 2n-spr Change-Id: I6c1ebcd38081b86209a27fdf224923b236179ee4 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2024-04-26Revert "fix(IPsecUtil): Delete keywords no longer used"Vratko Polak1-0/+43
This reverts commit 79635f7cdfb7046230473570068f97a159cf87b4. Peter says he is using those. Change-Id: I47886ba0676bc74d5189a2986ac347f49fdde36c Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-04-26fix(IPsecUtil): Delete keywords no longer usedVratko Polak1-43/+0
When deleting ipsec nvf density suites, I removed the main L2 Robot keyword, but forgot to remove the associated L1 Python keywords. Change-Id: I0f72699dcab272aec5c531cdaacceed30356cd02 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-04-26fix(jobspec): Delete ipsec nfv density testsVratko Polak2-144/+0
We already deleted the job and the suites. Change-Id: I0d9c4da14651884d6eeb3e200277b0ef5823df60 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-04-26feat(tests): IPsecHW rxq ratiopmikus25-0/+25
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: I17866709e1c7edf078055aef4db15774e136b111
2024-04-26feat(profiles): IPv6 unseedpmikus1-3/+1
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: I72a91c6270bd43fd41b8d7389b759305d9a3d408
2024-04-25feat(density): Delete ipsec nfv_density testsVratko Polak38-6197/+0
They are broken for more than two years and they relied on CLIs that changed in VPP anyway. Ticket: CSIT-1856 Change-Id: I0f278ff61a9da5e6040e08bf3e92049cb33c8a93 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-04-25fix(methodology): Update info for soak and ndrpdrVratko Polak2-37/+50
Change-Id: I58fa4b3494c6148735a992f2c0e8a7ba771660a8 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-04-25job-spec: Add more ipsec hw tests to 3n-snr and 3n-icxdTibor Frank4-0/+28
Change-Id: I1e874ad107dd961e886e544f7d7017086523f894 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2024-04-25C-Dash: Add soak testsTibor Frank12-33/+115
Change-Id: Ibe17b7dc2125fa6ace496897a7cf9115a5f2c736 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2024-04-25job-spec: Add ipsec hw tests to 3n-snr and 3n-icxdTibor Frank4-0/+56
Change-Id: I46a6cf74da419e85b5b22a93a5703709a677a8ad Signed-off-by: Tibor Frank <tifrank@cisco.com>
2024-04-25feat(profiles): Cleanup IPv6 profilespmikus14-993/+123
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: Ib9d1d819e59be768377f3a61578c22699a10f0a8
2024-04-25Revert "fix(ip6scale): Unify rnd profiles"Peter Mikus0-0/+0
This reverts commit b06f091ae65a7323231d84d188b863698169508b. Reason for revert: . Change-Id: I4c36a8ca1dd28db853e9eefef9a409142d073779 Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
2024-04-25Revert "fix(ip6scale): Unify rnd profiles"Peter Mikus6-17/+34
This reverts commit b06f091ae65a7323231d84d188b863698169508b. Reason for revert: . Change-Id: I99b7c3365e7e74aadcf366c8ca284ad458dcc8e6 Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
2024-04-24fix(ip6scale): Unify rnd profilesVratko Polak6-34/+17
Some were not even using STLVmFlowVarRepeatableRandom. + Simplify seed calculation. Change-Id: If3211dd2336838ee1ad7137563ddf8cc90ebea00 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-04-24style(ipsec): add type hints to IPsecUtilVratko Polak1-229/+253
+ Update docstrings to match. Change-Id: I20f8f0247a9cf38a2d9a98fa8905eb55d91817f7 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-04-23feat(etl): SOAKpmikus2-171/+245
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: Ic8cd4cc6de271ca39b2b9d4e07da2718772e9a38
2024-04-22style(ipsec): Unify mutiline stringsVratko Polak1-79/+72
+ One more pylint improvement not worth a separate change. Change-Id: I5a2a3a4c70909fefd3fdf6f3ed8b344d19fc823e Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-04-22style(ipsec): Fix some issues reported by pylintVratko Polak2-41/+31
+ Fix typo "enale". - Many style and complexity issues remain: C0302, R0904, R0914, R0913, R1735, R0915, R1734. Change-Id: I7e8c7ecefd8f8f94dcbc28427baa52a9c8ea1227 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-04-22Add hoststack with DMA test suitesxinfengx5-18/+335
Change-Id: Idef14bef816a04ca43ab9aced4b1441ef818e066 Signed-off-by: xinfengx <xinfengx.zhao@intel.com>
2024-04-22fix(ip6scale): Document correct prefix lengthVratko Polak14-18/+18
We are testing /128 in ip6 scale tests for a long time, but we did not update the suite documentation when we switched. This does that. Note that ip6 bas (and feature) tests are still using /64. Change-Id: I5e108497b3f516195fce0e480ca3ec18d204bd84 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-04-22Update VPP_STABLE_VER filesTibor Frank1-1/+1
Change-Id: If4175b67b34c96a097cbc7f250535159eef816be Signed-off-by: Tibor Frank <tifrank@cisco.com>
2024-04-19feat(jobspec): Unify soak jobspecsVratko Polak5-115/+106
Added 9 common tests (only one for non-default NIC+driver), 4 specific to nodeness (ASTF for 2-node, IPsec for 3-node). + First round, we can add more tests when duration is stable. - Left TODOs for possible improvements. Change-Id: I4724e3a05af0dfbf2ca0c146f1bbd4665d9e0cf0 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-04-18feat(tests): IPv6 fixespmikus7-45/+43
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: I9bc9f9fe410c0fa78e20a234487e63eb42f3fe3f