aboutsummaryrefslogtreecommitdiffstats
path: root/resources
AgeCommit message (Collapse)AuthorFilesLines
2024-08-09fix(papi): do not check client in asyncVratko Polak1-1/+3
This is primarily to avoid excessive logging in scenarios with multiple get_replies (not just .add) per session. Change-Id: Ic5b1c295965cd8d32c71a7851ec7823568483b06 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-08-07fix(papi): Do not check CRC on NoneVratko Polak1-0/+4
None can happen when VPP crashes (and pipe is not detected as broken yet) or stalls. Avoid CRC check in that case, raise early with error message. Change-Id: I15a957420320affd72dbd99fa48c309b28f0511a Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-08-07fix(pip): Requirements for 24.04pmikus1-1/+1
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I7511fb128d81f5d91fb2cc0d71f193efaefd9f41
2024-08-01feat(ebs): Install hugo if not foundoper-240805pmikus1-3/+3
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: Ice4c09579a174c0ce3d26c8429016d55414bfb93
2024-07-31feat(bootstrap): Split gather.shpmikus4-130/+182
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: I8bf1fbf49d224b89f2da4a7f08bdf932cad9fd35
2024-07-31feat(job_specs): Update 1n-sprpmikus1-12/+12
Due to upgrade of ubuntu 24.04 the E810 stopped working. To be investigated. Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: Iee7ede4ba4377af114be7cce0a5e9c63865cd8dc
2024-07-30feat(infra): Ubuntu 24.04 LTSpmikus2-80/+80
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: I7d672d07e6ed6bf6582888e8826bbc1cb6d94d17
2024-07-29feat(job_spec): vpp_devicepmikus2-211/+3
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: I0b2eeea045fe241129f978ec96eec5c0c5bc9938
2024-07-26feat(TGen): Include reason on TRex errorVratko Polak1-3/+3
This adds noise to console output, but prevents other possible bugs from looking just like CSIT-1936. Ticket: CSIT-1936 Change-Id: If30c59a96ebd9cec6aea40ca820b775d5f3548c6 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-07-26fix(container): Remove obsolete LXC optionVratko Polak1-2/+1
CSIT-1944 Change-Id: I0f763369acc560a5ab2d9db28fc25f20b1c5ffe7 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-07-19fix(api): Remove support for old behaviorsVratko Polak2-390/+3
The 2406 cycle did not upgrade any messages used by CSIT. But there were few workarounds in CSIT code to accomodate vehavior of older VPP builds. Two removed. One (re PAPI) stays, as that needs more testing. Change-Id: I0595cf1d8b9d9ea80113f59130cbbdf00a249157 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-07-17fix(bootstrap): External topologies read"pmikus1-28/+27
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: Iefa96896004d8c9cc06df90f0a744c497b443106
2024-07-16feat(core): Change external testbed detection"pmikus2-24/+33
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: Id005feac8104bb0b7da08d8dd9baaa3c5117e157
2024-07-16job-spec: Add imix and 1518B framesizes to ip4scale60kTibor Frank3-0/+22
Change-Id: I498540140965ecec70390e0b13c2418a31cf1dc8 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2024-06-28fix(core): VPP Initialisation issue on MLX.oper-240701pmikus2-2/+3
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: I2113e5e2067e13465ee1fedc6a2ba1c5bc1d7254
2024-06-25fix(core): typopmikus1-1/+1
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: I8ae87a8ee350cfe601a9deab2f115b75d26bd02a
2024-06-25feat(core): Add option to disable sriov checkpmikus1-1/+7
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: Ie8dbdf8b231dcbbbf2c90ad0f16d6b48fbdd8c5c
2024-06-18feat(core): Adjust T-Rex for external topologiespmikus1-1/+2
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: Id3f0a4a26404951bc7ce82655538b72848508e18
2024-06-18fix(trex): Add MTUpmikus2-1/+14
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: I91a3136a29192fb25ec4845e0924b96977f591f5
2024-06-12feat(multi): Multiple VPP instancespmikus2-17/+96
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: I28f2752f725c9816a557667033bf7d656fb0d414
2024-06-04fix(jobspec): IPsec HWasync has 1c, not 3cVratko Polak4-8/+8
Fixes: d29977e35bb15cd7df21c082432f03eab87e2e66 Change-Id: I1a20ded1181f5a3b33a0f6640554a939218d9791 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-05-31feat(jobspec): Add new new ipsec with UDP encapVratko Polak14-66/+212
+ Only for dpdk-plugin and primary NIC. + Prefer Intel, as that seems to have more stable performance. + Only one testcase per suite: 1518B 1c. + Add full set of 10k AES256GCM tests where not present already. + Remove multi-core ipsec AVF tests from 3n-icx to keep duration small. - Performance of those was limited by CSIT-1948 anyway. Change-Id: I9166f15b44071dafe89ac8ca7982f659006027ba Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-05-31feat(jobspec): Align weekly ndrpdr to daily mrrVratko Polak4-161/+135
+ This mainly uncomments a bucnh of 3n-alt xl710 ipsec tests. + Otherwise the difference was quite small. Change-Id: I8b67fcce157f36ed79e9692a0581e1115b3f6886 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-05-31feat(ipsec): Add suites for more algsVratko Polak2-11/+87
+ Add suite with UDP encap. + Add suite with anti replay enabled. + Add new enums where needed by the new suites. + Apply trimming in enum_util to support "3DES". + All 10ktnl suites written and tested. + New robot tags added. + Fix one comment from the parent. Change-Id: I2581814dbb327891d8658dd009c4e52ffd318e3b Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-05-31feat(jobspecs): Add more soak testsVratko Polak6-43/+171
+ Add l2xcbase. + Add 200k scale, both ip4 and ip6. + Test 200k and l2bdmaclearn also on: + Primary NIC with secondary driver. + Secondary NIC and its primary driver. + Add 1518B memif test cases, for 2n-spr also with DMA (including 64B). + This needed an edit in autogen. + Switch crypto tests to drv_vfio_pci as AVF has bad RSS on those. + Add two SRv6 cases to 3n-icx as it does not support hwasync crypto. + Repair name of UDP ASTF tests. Change-Id: I91e20ec80dc4984c55d39b5f5ad38f26b48da33e Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-05-31feat(hoststack): Enable L4 checksum RX offloadVratko Polak2-0/+10
As hoststack is never tested in container/VM (yet), configuration there does not check the new flag. Change-Id: Icac4837efcf035cad0f1e126e1bf90811aba16b2 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-05-31style(jumbo): Unify naming of jumbo flagVratko Polak5-44/+44
Previously, the flag was sometimes called "jumbo", sometimes "jumbo_frames". As we never use "jumbo" for things other than frame size, unify the flag to "jumbo". Change-Id: Ib688389799a4550ac9f51375f4defc06a02e6f03 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-05-31Revert "feat(hoststack): Enable L4 checksum RX offload"Peter Mikus5-15/+2
This reverts commit 4e897a7a91e8b4782da05a4c906392e62c8f8ab5. Reason for revert: Container/Qemu is not conditioned. Change-Id: I497caa2db24803f40811b3c60c359b4772cacda7 Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
2024-05-30feat(hoststack): Enable L4 checksum RX offloadVratko Polak5-2/+15
Change-Id: I169b06433ae962811aafa91ce90fe169b0bc4c71 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-05-29fix(core): AWS interface initializationpmikus2-5/+61
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I3ef110e8fec2fa8abafead1392a1b2af5e59f803
2024-05-28fix(hoststack): Do not limit number of RX queuesVratko Polak1-6/+2
This makes most scale hoststack tests correctly use both sibling cores. - Except quic multi-client ones, which start failing instead. - To be fixed later. - VPP startup.conf looks correct to me. - All quic tests suffer from CSIT-1935 so no big loss. Change-Id: If22c01651140865e188733039890f1fb0ceaa57a Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-05-28feat(hoststack): Add stat pre/post actionsVratko Polak2-21/+19
While adding runtime actions to hoststack tests is not easy, adding pre and post actions for stats is easy. The main hoststack measurement is treated as the stats trial, the same way as the 10 measurements in MRR tests are. + Remove the previous partial info via "show" CLI commands. - As in other VPP tests, stat telemetry is not exported. Change-Id: Ib567aa810418568520d4d543c6d50431e85a3269 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-05-21fix(various): filespmikus1-1/+1
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I601a54e543114957592548618df2f2f4bf790f82
2024-05-20fix(perf): Increase threshold for jumboVratko Polak1-2/+2
The old limit of 1522 was introduced long time ago. First, it appeared here [0], where it is correct as that suite has zero overhead. The first suite with wrong logic seems to be here [1] (no "Add No Multi Seg to all DUTs" in 1518B testcase). And when I was moving that logic to a keyword in [2], I did not realize it is wrong with overhead. This Change uses 1800 as the new threshold, matching the value used for non-jumbo MTU. [0] https://gerrit.fd.io/r/c/csit/+/2652/12/tests/perf/Bridge_Domain_Intel-X520-DA2.robot#70 [1] https://gerrit.fd.io/r/c/csit/+/4454/96/tests/perf/40ge2p1xl710-ethip4ipsecscaleip4-ip4base-interfaces-aes-gcm-ndrpdrdisc.robot#229 [2] https://gerrit.fd.io/r/c/csit/+/13411/35/resources/libraries/robot/performance/performance_utils.robot#84 Change-Id: Iff3703fcff0e4bbb1a6b10be359fa5ef67fd5422 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-05-17feat(device): Reconfigurepmikus2-19/+21
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: I5ca0fc5832c249553c79dd9c5d4148ba64e61654
2024-05-16feat(bootstrap): Add more granular eb scriptspmikus2-47/+52
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: Icbcd373ef815fa082d9be022fc201c96df140536
2024-05-14feat(CpuUtils): Allow suites to forbid siblingsVratko Polak1-1/+5
Some perf suites use a single unidirectional flow of traffic. On SMT-enabled machines, 1C tests create 2 workers by default. But if there is only one stream/flow, only one worker does useful work. The other worker on the sibling logical core does busy-wait, which provably lowers the peformance. Some suites already set smt_used (as a suite variable) to False for these purposes. This change edits a lower-level L1 keyword to honor this value, and adds the suite variable to single stream (and client) hoststack suites, where the detrimental effect of busy siblings was observed. Change-Id: I203f1a700d8e6cd84640b9c0b40487cb832908aa Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-05-07Add 2048B file size cps rps tests in job specs for http-ldpreload-nginx-1_21_5.oper-240513Maciek Konstantynowicz2-2/+30
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> Change-Id: Id4b562259e6d86642152298bf500b353f1785939 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2024-05-01Revert "fix(jobspec): Delete ipsec nfv density tests"Peter Mikus2-0/+144
This reverts commit 573d59a0e3cafe60522e51dc9e5ba776c0a0a6e4. Change-Id: I6fef1876d6f7274310243aa743f68b7e51daf486 Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
2024-04-30feat(ipsec): Use strings instead of enums in RobotVratko Polak3-235/+268
Only related to enums appearing in ipsec suites. + Add conversion utility as enum_utils.py file. + Rename PolicyAction closer to ipsec_types.api: IpsecSpdAction. + Device and perf suites updated to use str in Variables table. - Perf suites are being tested. Change-Id: I3b1678c4d6cc303c590e5e3665ab1b05d104a121 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-04-30fix(hoststack): Remove unwanted api trace in DMA testKai Ji1-1/+0
Change-Id: I48ec272fb150c09221142b8d73830d7b6741d0b5 Signed-off-by: Kai Ji <kai.ji@intel.com>
2024-04-29job-spec: fix dmaTibor Frank1-19/+1
Change-Id: I6202314a26fcba8cebc42eeebc3708732116caeb Signed-off-by: Tibor Frank <tifrank@cisco.com>
2024-04-29job-spec: Add eth-ip4tcphttp-dma-ldpreload-nginx-1_21_5Tibor Frank2-2/+32
- 2n-icx and - 2n-spr Change-Id: I6c1ebcd38081b86209a27fdf224923b236179ee4 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2024-04-26Revert "fix(IPsecUtil): Delete keywords no longer used"Vratko Polak1-0/+43
This reverts commit 79635f7cdfb7046230473570068f97a159cf87b4. Peter says he is using those. Change-Id: I47886ba0676bc74d5189a2986ac347f49fdde36c Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-04-26fix(IPsecUtil): Delete keywords no longer usedVratko Polak1-43/+0
When deleting ipsec nvf density suites, I removed the main L2 Robot keyword, but forgot to remove the associated L1 Python keywords. Change-Id: I0f72699dcab272aec5c531cdaacceed30356cd02 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-04-26fix(jobspec): Delete ipsec nfv density testsVratko Polak2-144/+0
We already deleted the job and the suites. Change-Id: I0d9c4da14651884d6eeb3e200277b0ef5823df60 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-04-25feat(density): Delete ipsec nfv_density testsVratko Polak2-160/+0
They are broken for more than two years and they relied on CLIs that changed in VPP anyway. Ticket: CSIT-1856 Change-Id: I0f278ff61a9da5e6040e08bf3e92049cb33c8a93 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-04-25job-spec: Add more ipsec hw tests to 3n-snr and 3n-icxdTibor Frank4-0/+28
Change-Id: I1e874ad107dd961e886e544f7d7017086523f894 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2024-04-25job-spec: Add ipsec hw tests to 3n-snr and 3n-icxdTibor Frank4-0/+56
Change-Id: I46a6cf74da419e85b5b22a93a5703709a677a8ad Signed-off-by: Tibor Frank <tifrank@cisco.com>
2024-04-24style(ipsec): add type hints to IPsecUtilVratko Polak1-229/+253
+ Update docstrings to match. Change-Id: I20f8f0247a9cf38a2d9a98fa8905eb55d91817f7 Signed-off-by: Vratko Polak <vrpolak@cisco.com>