aboutsummaryrefslogtreecommitdiffstats
path: root/resources/libraries/robot
AgeCommit message (Collapse)AuthorFilesLines
2024-09-23feat(bonding): Add simple suite for minimal coverageVratko Polak2-114/+15
- We want 2-link suite, as it has a non-trivial traffic pattern. - Not done here, as it needs edits in multiple layers. + Add 1-link suite to compare (and for 1-link testbeds). + Simplify also old bonding keywords. + Partial support for future multi-link suites. + Update jobspecs for minimal coverage: + Only add to iterative, both MRR and NDRPDR. - Coverage jobspecs to be updated later. + {1,2,4}c 64B tests, only to 3n-icx for now. + For both primary NIC+driver combinations there. Change-Id: I6da3b99a44b5ae83cc52921d5e2034fe5218270c Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-09-19feat(robot): Infra actionoper-240923Peter Mikus1-1/+1
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: I5d1718bbf61317c2d36e782b0ccb37b8ceb6e71e
2024-09-19feat(robot): Infra actionPeter Mikus1-0/+32
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: I55f6e954c865fa0574b9521bd885b68d2a87d39b
2024-06-28fix(core): VPP Initialisation issue on MLX.oper-240701pmikus1-1/+2
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: I2113e5e2067e13465ee1fedc6a2ba1c5bc1d7254
2024-06-12feat(multi): Multiple VPP instancespmikus1-0/+31
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: I28f2752f725c9816a557667033bf7d656fb0d414
2024-05-31feat(hoststack): Enable L4 checksum RX offloadVratko Polak1-0/+5
As hoststack is never tested in container/VM (yet), configuration there does not check the new flag. Change-Id: Icac4837efcf035cad0f1e126e1bf90811aba16b2 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-05-31Revert "feat(hoststack): Enable L4 checksum RX offload"Peter Mikus1-5/+0
This reverts commit 4e897a7a91e8b4782da05a4c906392e62c8f8ab5. Reason for revert: Container/Qemu is not conditioned. Change-Id: I497caa2db24803f40811b3c60c359b4772cacda7 Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
2024-05-30feat(hoststack): Enable L4 checksum RX offloadVratko Polak1-0/+5
Change-Id: I169b06433ae962811aafa91ce90fe169b0bc4c71 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-05-29fix(core): AWS interface initializationpmikus1-0/+6
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I3ef110e8fec2fa8abafead1392a1b2af5e59f803
2024-05-28fix(hoststack): Do not limit number of RX queuesVratko Polak1-6/+2
This makes most scale hoststack tests correctly use both sibling cores. - Except quic multi-client ones, which start failing instead. - To be fixed later. - VPP startup.conf looks correct to me. - All quic tests suffer from CSIT-1935 so no big loss. Change-Id: If22c01651140865e188733039890f1fb0ceaa57a Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-05-28feat(hoststack): Add stat pre/post actionsVratko Polak1-1/+18
While adding runtime actions to hoststack tests is not easy, adding pre and post actions for stats is easy. The main hoststack measurement is treated as the stats trial, the same way as the 10 measurements in MRR tests are. + Remove the previous partial info via "show" CLI commands. - As in other VPP tests, stat telemetry is not exported. Change-Id: Ib567aa810418568520d4d543c6d50431e85a3269 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-05-20fix(perf): Increase threshold for jumboVratko Polak1-2/+2
The old limit of 1522 was introduced long time ago. First, it appeared here [0], where it is correct as that suite has zero overhead. The first suite with wrong logic seems to be here [1] (no "Add No Multi Seg to all DUTs" in 1518B testcase). And when I was moving that logic to a keyword in [2], I did not realize it is wrong with overhead. This Change uses 1800 as the new threshold, matching the value used for non-jumbo MTU. [0] https://gerrit.fd.io/r/c/csit/+/2652/12/tests/perf/Bridge_Domain_Intel-X520-DA2.robot#70 [1] https://gerrit.fd.io/r/c/csit/+/4454/96/tests/perf/40ge2p1xl710-ethip4ipsecscaleip4-ip4base-interfaces-aes-gcm-ndrpdrdisc.robot#229 [2] https://gerrit.fd.io/r/c/csit/+/13411/35/resources/libraries/robot/performance/performance_utils.robot#84 Change-Id: Iff3703fcff0e4bbb1a6b10be359fa5ef67fd5422 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-04-30feat(ipsec): Use strings instead of enums in RobotVratko Polak1-9/+7
Only related to enums appearing in ipsec suites. + Add conversion utility as enum_utils.py file. + Rename PolicyAction closer to ipsec_types.api: IpsecSpdAction. + Device and perf suites updated to use str in Variables table. - Perf suites are being tested. Change-Id: I3b1678c4d6cc303c590e5e3665ab1b05d104a121 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-04-30fix(hoststack): Remove unwanted api trace in DMA testKai Ji1-1/+0
Change-Id: I48ec272fb150c09221142b8d73830d7b6741d0b5 Signed-off-by: Kai Ji <kai.ji@intel.com>
2024-04-22Add hoststack with DMA test suitesxinfengx1-18/+62
Change-Id: Idef14bef816a04ca43ab9aced4b1441ef818e066 Signed-off-by: xinfengx <xinfengx.zhao@intel.com>
2024-04-11feat(tests): IPv6 scalepmikus1-2/+1
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: I720b7c96a6ac9f328aff57437e51254364604911
2024-03-25fix(terraform): vpp-device filespmikus1-0/+1
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: I7f640aa28ecf3a60696676b0cf8afb7a080e1b12
2024-03-14feat(tests): Fix scaling of 6p3nicoper-240318pmikus1-4/+4
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: I84d9cf2892423e62b116b07982d3e87120b66271
2024-02-06Add memif with DMA test suitesxinfengx2-1/+33
Change-Id: I8c27b5956c0c26bb2de48321675e285ed961412f Signed-off-by: xinfengx <xinfengx.zhao@intel.com>
2023-11-03feat(tests): 6p3nic ip4 testsoper-231106pmikus1-2/+2
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: I69ee305b25b9e05d2305cb82aba71ef6418780ab
2023-10-25feat(MLRsearch): use goal result as in draft05Vratko Polak2-3/+3
No effect on NDRPDR results, just different result packaging between the MLRsearch library and the rest of CSIT. - PyPI metadata still to be updated in a separate Change. Change-Id: I547134da189d1d7761594e92f36cc7c1c232ee32 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2023-10-19feat(MLRseach): Update to v8 conditional throughputVratko Polak1-2/+2
Hopefully, with CSIT config values, PDR lower than NDR will not happen. + Bump duration_sum default to an odd number, so users are not surprised by not seeing standard median behavior. For CSIT this should not matter, overheads hide ties and number of trials (at least for STL) should stay the same. Change-Id: Id7130f978c31e71227499612424007c473bcfac2 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2023-10-18feat(MLRsearch): MLRsearch v7Vratko Polak2-95/+56
Replaces MLRv2, suitable for "big bang" upgrade across CSIT. PyPI metadata updated only partially (full edits will come separately). Pylint wants less complexity, but the differences are only minor. + Use the same (new CSIT) defaults everywhere, also in Python library. + Update also PLRsearch to use the new result class. + Make upper bound optional in UTI. + Fix ASTF approximate duration detection. + Do not keep approximated_receive_rate (for MRR) in result structure. Change-Id: I03406f32d5c93f56b527cb3f93791b61955dfd74 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2023-10-13fix(pylint): Minor warningspmikus1-1/+1
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: Id646ab09ae51d3153446f1ae334f62ba7710be14
2023-10-09Model: Add bandwidth to mrrTibor Frank1-2/+2
Change-Id: I4277f23d94fa191890041bb43e2fcd4eb5e42019 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2023-09-22fix(core): TRex self loop testspmikus1-1/+1
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I8945daffd500f689b3eb630f1ce7e1dc4f05aca8
2023-09-21fix(core): String mappingpmikus1-1/+1
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I4db3fc1b70469a966e51afe3bfa93cb4bcffa654
2023-09-21feat(core): Multilink backendpmikus3-74/+5
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I8d168979ab9722e0056e97edb228f29cbfa245e3
2023-09-20feat(infra): update 3n-alt ipsec testsJuraj Linkeš1-0/+2
Remove 4 tunnel flow cache test cases, as those don't benefit from flow cache much. Add mrr ipsec test cases for the XL710 Intel NIC to increase coverage. Don't add ndrpdr for XL710, only add commented out counterparts to align with the mrr list. Also modify the existing flow cache configuration by adding the fast path config as well. These are independent features, but the fast path code added this dependency. Change-Id: Ide88fd8c1abe96c577a86925dcc2dc4e63f897d4 Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2023-09-04fix(hoststack): hardcode DUT1 for nginxVratko Polak1-17/+17
Previously, the Set up LDP or VCL Nginx on DUT node keyword was wrongly documenting its "dut" argument as type string, while using the value as a node dict instead. As most of the code already used direct dut1 variables, this patch eliminates the dut argument altogether and puts DUT1 into the keyword name. Change-Id: Ie29afc175b98c1b1cb554438da9178738662d108 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2023-08-17fix(core): Variables for GSOpmikus1-4/+4
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I6768f65551deb335ba7b9fc07bca164bca9381fe
2023-08-15GSO: Add export of results to json files.Tibor Frank1-0/+6
Change-Id: Iac742f0571b11e06662af6bf1b680d0b4e196ddd Signed-off-by: Tibor Frank <tifrank@cisco.com>
2023-08-11feat(core): QAT initialization refactorpmikus2-30/+1
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: Idc91da55ab0b5c6b8eb53e8b4ce4da18a1ae891c
2023-08-04fix(core): QAT VF bindpmikus1-1/+1
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: Iafae1a1f538b928d3bb80bf9610a0bf7de646f8a
2023-07-27fix(core): QAT initializationpmikus2-1/+1
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I28af64b7d39a97bbb84f9d987a3f5d3a2d02701b
2023-07-27feat(core): Core allocationpmikus4-13/+27
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I782b87190dbee6e0a12c97f616b80539cd6614bd
2023-06-21feat(infra): update 3n-alt cx6 iterative testsJuraj Linkeš1-0/+8
Add ipsec reassembly test cases to bring in line with 3n-icx. Add ipsec policy test cases with flow cache enabled for both inbound and outbound traffic. Remove GTPU hardware tests as the NIC doesn't support GTPU offload RX. Change-Id: I7b18914f983d5974b390f995ec638a64b9bbccbb Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2023-06-16Add cryptodev device 4xxxYulong Pei2-2/+3
QAT_4xxx is integrated QAT device on SPR platform. Signed-off-by: xinfeng zhao <xinfengx.zhao@intel.com> Signed-off-by: Yulong Pei <yulong.pei@intel.com> Change-Id: If1d4b3d72a2c66855ac8c1c42516f0cb78bdfab2
2023-06-15fix(tests): Hoststack 2n-xyzpmikus1-6/+19
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I85de04e4a0ed1a642c40c8ca6840cbc1977b10be
2023-05-31"fix(test): Hoststack"Peter Mikus1-2/+0
Change-Id: I6ec27d787b59d4bc13b8c04f4217302cc3021581 Signed-off-by: pmikus <peter.mikus@protonmail.ch>
2023-05-30fix(tests): Hoststack compatibilitypmikus1-0/+2
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I198fe62ddba8910c6bd8256739cc2503b87dfc75
2023-05-24feat(reassembly): add few suites for ip reassemblyVratko Polak1-0/+20
In tunneling scenarios, VPP needs to reassembly packet fragments before decapsulation. Conveniently, VPP also fragments the packets after encapsulation (at least for some encapsulation protocols) if they do not fit into MTU. So this change adds few suites, adapted from existing 3-node ones which additionally lower MTU on DUT1-DUT2 link. The intended packet size is 1518B. 64B packets will fit, and most of IMIX packets will also fit without fragmentation. VPP refuses to reassembly 9000B packets as they have too many fragments. + Add a keyword so suites need only one additional line of code. + Add new test tag REASSEMBLY for the added suites. + Tell autogen the one soak test case for reaseembly should be 1518B. - It is possible to increase fragment limit for 9000B, not done yet. - Ipsec policy suites are added but they should not be used. - VPP does fragmentation twice (before and after encapsulation). - VPP does not perform reassembly (only last fragment is decrypted). - TRex does not realize the packet from VPP is only a fragment. - The result is false pass with unfairly good performance. + Suites still included, to simplify verifying VPP fixes for the above. Change-Id: If33c60d767fea161d9e4ffabb8ded3d81c8f39ed Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2023-05-22feat(interface): apply MTU for dpdk plugin ifacesVratko Polak5-41/+28
When changing MTU on a running VPP, the interface has to be down. - Other plugins (rdma, avf, af_xdp) need vastly different logic, so support for them will be added later. + Mlx5-core does not need to set MTU on Linux interface. + MTU setting now does not happen at final setting path up, it happens in driver initialization layer instead E.g. AVF tests will not attempt to change MTU. + MTU edit removed from some non-hardware interfaces (including memif) e.g. bond interfaces. MTU on parent hw interface seems to be enough. + The non-jumbo MTU value used is 1800, so 1518B tests with additional encapsulation can still work. + When VPP MTU setting fails, the failure is now propagated. Previously, the failure was just logged and ignored, but now there is no reason to hide it. Ticket: CSIT-1797 Change-Id: I3b853f1faf90001d544cbbb87b2affbb882ffba0 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2023-05-15fix(core): Container entropypmikus1-2/+1
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I45760143ae0ccb0cc0edf0931ad47f5cf48ec968
2023-05-10feat(infra): Remove system.d dependencypmikus1-4/+3
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: Icb7b6124dcba7bb57c18ceb91120284f6fe02c2e
2023-05-05fix(core): Docker detectionpmikus1-3/+4
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I976f96410b06b4f4d7500b03b1f5dd54486bbf42
2023-04-05fix(telemetry): Enable MRRpmikus1-1/+1
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I11896900a73f97194a2935202343dc28756cbb28
2023-04-03Enable IPsec policy fast path inboundYulong Pei1-3/+6
This will greatly improve the performance of IPsec policy cases Signed-off-by: xinfeng zhao <xinfengx.zhao@intel.com> Signed-off-by: Yulong Pei <yulong.pei@intel.com> Change-Id: Ib42b5650791be7fcc8649873eaf12616aeba5aec
2023-02-24Fix: detaches the attached XDP/BPF program before af_xdp test runYulong Pei1-0/+2
When call create af_xdp interface api, it will load default xdp program (xsk_def_prog.o) on the NIC interface, the program will be unloaded when call delete af_xdp interface api, but current csit config did not call delete api for af_xdp test cases, that will cause af_xdp test case fails to run on Intel E810 NIC when the interface already have xdp program attached, so this patch is to fix this issue by to detach any attached XDP/BPF program on the interface before af_xdp test case run. Signed-off-by: Yulong Pei <yulong.pei@intel.com> Change-Id: I1a557b4c4a7e88c5715cec771a001df29ac4ae6f Signed-off-by: Yulong Pei <yulong.pei@intel.com>
2023-02-22fix(core): log but not export from teardownpmikus3-6/+12
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I0f5f1000f55110455e86db4c461fba3c87fb198e