aboutsummaryrefslogtreecommitdiffstats
path: root/resources
AgeCommit message (Collapse)AuthorFilesLines
2024-05-31feat(jobspecs): Add more soak testsVratko Polak6-43/+171
+ Add l2xcbase. + Add 200k scale, both ip4 and ip6. + Test 200k and l2bdmaclearn also on: + Primary NIC with secondary driver. + Secondary NIC and its primary driver. + Add 1518B memif test cases, for 2n-spr also with DMA (including 64B). + This needed an edit in autogen. + Switch crypto tests to drv_vfio_pci as AVF has bad RSS on those. + Add two SRv6 cases to 3n-icx as it does not support hwasync crypto. + Repair name of UDP ASTF tests. Change-Id: I91e20ec80dc4984c55d39b5f5ad38f26b48da33e Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-05-31feat(hoststack): Enable L4 checksum RX offloadVratko Polak2-0/+10
As hoststack is never tested in container/VM (yet), configuration there does not check the new flag. Change-Id: Icac4837efcf035cad0f1e126e1bf90811aba16b2 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-05-31style(jumbo): Unify naming of jumbo flagVratko Polak5-44/+44
Previously, the flag was sometimes called "jumbo", sometimes "jumbo_frames". As we never use "jumbo" for things other than frame size, unify the flag to "jumbo". Change-Id: Ib688389799a4550ac9f51375f4defc06a02e6f03 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-05-31Revert "feat(hoststack): Enable L4 checksum RX offload"Peter Mikus5-15/+2
This reverts commit 4e897a7a91e8b4782da05a4c906392e62c8f8ab5. Reason for revert: Container/Qemu is not conditioned. Change-Id: I497caa2db24803f40811b3c60c359b4772cacda7 Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
2024-05-30feat(hoststack): Enable L4 checksum RX offloadVratko Polak5-2/+15
Change-Id: I169b06433ae962811aafa91ce90fe169b0bc4c71 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-05-29fix(core): AWS interface initializationpmikus2-5/+61
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I3ef110e8fec2fa8abafead1392a1b2af5e59f803
2024-05-28fix(hoststack): Do not limit number of RX queuesVratko Polak1-6/+2
This makes most scale hoststack tests correctly use both sibling cores. - Except quic multi-client ones, which start failing instead. - To be fixed later. - VPP startup.conf looks correct to me. - All quic tests suffer from CSIT-1935 so no big loss. Change-Id: If22c01651140865e188733039890f1fb0ceaa57a Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-05-28feat(hoststack): Add stat pre/post actionsVratko Polak2-21/+19
While adding runtime actions to hoststack tests is not easy, adding pre and post actions for stats is easy. The main hoststack measurement is treated as the stats trial, the same way as the 10 measurements in MRR tests are. + Remove the previous partial info via "show" CLI commands. - As in other VPP tests, stat telemetry is not exported. Change-Id: Ib567aa810418568520d4d543c6d50431e85a3269 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-05-21fix(various): filespmikus1-1/+1
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I601a54e543114957592548618df2f2f4bf790f82
2024-05-20fix(perf): Increase threshold for jumboVratko Polak1-2/+2
The old limit of 1522 was introduced long time ago. First, it appeared here [0], where it is correct as that suite has zero overhead. The first suite with wrong logic seems to be here [1] (no "Add No Multi Seg to all DUTs" in 1518B testcase). And when I was moving that logic to a keyword in [2], I did not realize it is wrong with overhead. This Change uses 1800 as the new threshold, matching the value used for non-jumbo MTU. [0] https://gerrit.fd.io/r/c/csit/+/2652/12/tests/perf/Bridge_Domain_Intel-X520-DA2.robot#70 [1] https://gerrit.fd.io/r/c/csit/+/4454/96/tests/perf/40ge2p1xl710-ethip4ipsecscaleip4-ip4base-interfaces-aes-gcm-ndrpdrdisc.robot#229 [2] https://gerrit.fd.io/r/c/csit/+/13411/35/resources/libraries/robot/performance/performance_utils.robot#84 Change-Id: Iff3703fcff0e4bbb1a6b10be359fa5ef67fd5422 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-05-17feat(device): Reconfigurepmikus2-19/+21
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: I5ca0fc5832c249553c79dd9c5d4148ba64e61654
2024-05-16feat(bootstrap): Add more granular eb scriptspmikus2-47/+52
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: Icbcd373ef815fa082d9be022fc201c96df140536
2024-05-14feat(CpuUtils): Allow suites to forbid siblingsVratko Polak1-1/+5
Some perf suites use a single unidirectional flow of traffic. On SMT-enabled machines, 1C tests create 2 workers by default. But if there is only one stream/flow, only one worker does useful work. The other worker on the sibling logical core does busy-wait, which provably lowers the peformance. Some suites already set smt_used (as a suite variable) to False for these purposes. This change edits a lower-level L1 keyword to honor this value, and adds the suite variable to single stream (and client) hoststack suites, where the detrimental effect of busy siblings was observed. Change-Id: I203f1a700d8e6cd84640b9c0b40487cb832908aa Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-05-07Add 2048B file size cps rps tests in job specs for http-ldpreload-nginx-1_21_5.oper-240513Maciek Konstantynowicz2-2/+30
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> Change-Id: Id4b562259e6d86642152298bf500b353f1785939 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2024-05-01Revert "fix(jobspec): Delete ipsec nfv density tests"Peter Mikus2-0/+144
This reverts commit 573d59a0e3cafe60522e51dc9e5ba776c0a0a6e4. Change-Id: I6fef1876d6f7274310243aa743f68b7e51daf486 Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
2024-04-30feat(ipsec): Use strings instead of enums in RobotVratko Polak3-235/+268
Only related to enums appearing in ipsec suites. + Add conversion utility as enum_utils.py file. + Rename PolicyAction closer to ipsec_types.api: IpsecSpdAction. + Device and perf suites updated to use str in Variables table. - Perf suites are being tested. Change-Id: I3b1678c4d6cc303c590e5e3665ab1b05d104a121 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-04-30fix(hoststack): Remove unwanted api trace in DMA testKai Ji1-1/+0
Change-Id: I48ec272fb150c09221142b8d73830d7b6741d0b5 Signed-off-by: Kai Ji <kai.ji@intel.com>
2024-04-29job-spec: fix dmaTibor Frank1-19/+1
Change-Id: I6202314a26fcba8cebc42eeebc3708732116caeb Signed-off-by: Tibor Frank <tifrank@cisco.com>
2024-04-29job-spec: Add eth-ip4tcphttp-dma-ldpreload-nginx-1_21_5Tibor Frank2-2/+32
- 2n-icx and - 2n-spr Change-Id: I6c1ebcd38081b86209a27fdf224923b236179ee4 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2024-04-26Revert "fix(IPsecUtil): Delete keywords no longer used"Vratko Polak1-0/+43
This reverts commit 79635f7cdfb7046230473570068f97a159cf87b4. Peter says he is using those. Change-Id: I47886ba0676bc74d5189a2986ac347f49fdde36c Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-04-26fix(IPsecUtil): Delete keywords no longer usedVratko Polak1-43/+0
When deleting ipsec nvf density suites, I removed the main L2 Robot keyword, but forgot to remove the associated L1 Python keywords. Change-Id: I0f72699dcab272aec5c531cdaacceed30356cd02 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-04-26fix(jobspec): Delete ipsec nfv density testsVratko Polak2-144/+0
We already deleted the job and the suites. Change-Id: I0d9c4da14651884d6eeb3e200277b0ef5823df60 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-04-25feat(density): Delete ipsec nfv_density testsVratko Polak2-160/+0
They are broken for more than two years and they relied on CLIs that changed in VPP anyway. Ticket: CSIT-1856 Change-Id: I0f278ff61a9da5e6040e08bf3e92049cb33c8a93 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-04-25job-spec: Add more ipsec hw tests to 3n-snr and 3n-icxdTibor Frank4-0/+28
Change-Id: I1e874ad107dd961e886e544f7d7017086523f894 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2024-04-25job-spec: Add ipsec hw tests to 3n-snr and 3n-icxdTibor Frank4-0/+56
Change-Id: I46a6cf74da419e85b5b22a93a5703709a677a8ad Signed-off-by: Tibor Frank <tifrank@cisco.com>
2024-04-24style(ipsec): add type hints to IPsecUtilVratko Polak1-229/+253
+ Update docstrings to match. Change-Id: I20f8f0247a9cf38a2d9a98fa8905eb55d91817f7 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-04-22style(ipsec): Unify mutiline stringsVratko Polak1-79/+72
+ One more pylint improvement not worth a separate change. Change-Id: I5a2a3a4c70909fefd3fdf6f3ed8b344d19fc823e Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-04-22style(ipsec): Fix some issues reported by pylintVratko Polak1-39/+29
+ Fix typo "enale". - Many style and complexity issues remain: C0302, R0904, R0914, R0913, R1735, R0915, R1734. Change-Id: I7e8c7ecefd8f8f94dcbc28427baa52a9c8ea1227 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-04-22Add hoststack with DMA test suitesxinfengx3-18/+91
Change-Id: Idef14bef816a04ca43ab9aced4b1441ef818e066 Signed-off-by: xinfengx <xinfengx.zhao@intel.com>
2024-04-19feat(jobspec): Unify soak jobspecsVratko Polak5-115/+106
Added 9 common tests (only one for non-default NIC+driver), 4 specific to nodeness (ASTF for 2-node, IPsec for 3-node). + First round, we can add more tests when duration is stable. - Left TODOs for possible improvements. Change-Id: I4724e3a05af0dfbf2ca0c146f1bbd4665d9e0cf0 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-04-18feat(tests): IPv6 fixespmikus1-15/+19
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: I9bc9f9fe410c0fa78e20a234487e63eb42f3fe3f
2024-04-18feat(job_specs): Add soak testpmikus12-46/+195
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: I48240d2df2ee7908d07da86a4e4da359178d0b9e
2024-04-17fix(ipsec): Prepare IPsecUtil for upcoming changesVratko Polak1-44/+36
+ Separate sad into two cycles. + Do not update flags in each iteration. + Update inner dicts. Change-Id: Ic81dfc6e614cc78ff321fba748d48a30678cc88a Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-04-17feat(tox): add copyright year fixer scriptVratko Polak4-13/+67
It uses rather simple sed commands, but seems to work well enough. + Improve readme. + Shortened comments about why 3 lines. Change-Id: I50b395dfeb586f671f7c4c82f22369de90b351ec Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-04-16style(IPsecUtil): Apply black formattingVratko Polak1-465/+714
Change-Id: I7cc2bc69c6849360abff0bd18b2ae3b93e2303c4 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-04-15feat(api): Use newest API messages after rls2402Vratko Polak5-53/+437
+ gtpu_add_del_tunnel_v2 + Add comments on used values and unused fields. + ipsec_sad_entry_add_v2 + Explicitly pass current default values. + ipsec_sa_v5_dump + policer_add + The old is_add argument removed, it was never false. + sr_policy_add_v2 + Add comments about currently unused fields. + Support also older VP builds with wrong reply. + rdma_create_v4 + Add comments about unused fields. Change-Id: I3d5bc345c4cf099661626770c4d86bc230643cca Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-04-11feat(tests): IPv6 scalepmikus3-3/+87
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: I720b7c96a6ac9f328aff57437e51254364604911
2024-04-10feat(job-spec): Unify memif 1518B tests for 2n-sprVratko Polak4-0/+34
+ Add 4c 1518B tests to all memif 2n-spr coverage suites. + Add 1518B cases to iterative, so recently added DMA can be compared. Change-Id: I589fd7efe30bb70e0255bb5c94fa23c2782a7860 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-04-09fix(perpatch): Sort comparison output by test nameVratko Polak2-3/+7
Change-Id: Id68a4e2b7514b9cf2e1f2f30b78dc0cd696a673a Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-04-04Fix(perpatch): improve compare script outputVratko Polak1-9/+8
+ Make tests more searchable by "Test name" prefix. + Shorten the output code (fewer duplication and continues). Change-Id: I0adfac146a689466345a30646e41fe948ea264ae Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-04-03job-spec: Add memif DMA 1518B testsTibor Frank4-0/+26
Change-Id: I82ccfc639f7652d9a2ac248200ed2d49f93947dc Signed-off-by: Tibor Frank <tifrank@cisco.com>
2024-03-26fix(perpatch): Do not repeat test nameVratko Polak1-2/+1
When searching for a specific test, it is confusing to see the name twice, first time close to previous test classification. Change-Id: I43d838090f89d23af9da1dc93f9dd1946aebae75 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-03-25fix(terraform): vpp-device filespmikus2-102/+112
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: I7f640aa28ecf3a60696676b0cf8afb7a080e1b12
2024-03-25Revert "fix(core): Disable core dbg analysis"Vratko Polak1-7/+6
This reverts commit ffca8b8655c772fc6273702cae2151e7ac7a846d. + Add 10 second sleep, could help if core is big. Change-Id: Id2b3199737f8c50cee713e8626dce1bfa72ea4e1 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-03-20job-spec: Add DMA testsTibor Frank4-0/+62
Change-Id: I6530519eaab2d09a187dddd803815888606ff17d Signed-off-by: Tibor Frank <tifrank@cisco.com>
2024-03-14feat(tests): Fix scaling of 6p3nicoper-240318pmikus6-49/+49
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: I84d9cf2892423e62b116b07982d3e87120b66271
2024-03-04feat(device): cx6 update of 1n-alt device jobspecJuraj Linkeš2-70/+126
Update the jobspec according to the current Arm policy: 1. Run most of the tests on cx6, crypto coverage being the most important, 2. Match the cx6 ipv4 crypto coverage with x710 with the DPDK driver, 3. Run basic ipv4 and l2 tests with x710 with borh DPDK and native (avf) drivers. The above is the policy used in performance testing where time is a major constraint. The same is true for functional testing to some extent, so it makes sense to apply the same logic for choosing the tests. There are 10 tests which are failing on cx6 without an identified reason. They are disabled until we find the root cause and address it. In the meantime, the tests are enabled for x710 with the DPDK driver: ethip4-l2xcbase-eth-2memif-1dcr ethip4-l2bdbasemaclrn-eth-2memif-1dcr ethip4-l2bdbasemaclrn-eth-2tap ethip4-l2bdbasemaclrn ethip4-l2bdbasemaclrn-iacl1sf ethip4-l2bdbasemaclrn-iacl1sl ethip4-l2bdbasemaclrn-oacl1sf ethip4-l2bdbasemaclrn-oacl1sl ethip4-l2patch ethip4-l2xcbase When the cx6 issue has been resolved, these should be enabled for cx6 and disabled for x710, with the exception of ethip4-l2bdbasemaclrn, which should be running on both. Change-Id: Id48f450063e405b1faca57431676f91d62e829b9 Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2024-02-28job-spec: add more ip4scale tests to 2n-spr and 3na-sprTibor Frank4-0/+40
Change-Id: I9c9a6ecd6698cb58e7114543de54eb01549d4af0 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2024-02-15fix(core): daily jobs should not do prefixingpmikus1-5/+7
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I131cc9957b288f4e02e9d02394a1681dbb539d83
2024-02-15fix(bootstrap): typopmikus1-1/+1
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: Ib2a1ceb9145ef5495c76954ac70cedc5af6fa297