aboutsummaryrefslogtreecommitdiffstats
path: root/tests
AgeCommit message (Collapse)AuthorFilesLines
2024-09-09feat(tests): Remove unwanted testsPeter Mikus2-293/+0
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: Iea2fc50883e66a77fa2c7aed48fa1c79ef4c36d9
2024-09-05tests: Remove tests which are not usedTibor Frank20-3236/+0
- VTS - reconf - link bonding Change-Id: I2685c02b96fde08796e7208ac84cf08fec1af0c4 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2024-08-22fix(ip4scale6): 6 TRex ports means 6 traffic directionsVratko Polak6-0/+6
Without this, Robot computes from single-port load incorrectly. Change-Id: I4c83e959c64be1e7d2dd557db20b95be1ce3d0ae Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-06-28fix(core): VPP Initialisation issue on MLX.oper-240701pmikus1-1/+2
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: I2113e5e2067e13465ee1fedc6a2ba1c5bc1d7254
2024-06-03fix(ipsec): Enable anti_replay for -ar- suitesVratko Polak11-0/+11
The -ar- suites had everything edited, except that one agrument that would actually enable anti-replay. Fixes: b9dff484de0725bca3f65739519d952e3be55cbe Change-Id: Ib2c590a9be5271348ee15d4e4ab1b7c663559477 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-05-31feat(ipsec): Add suites for more algsVratko Polak12-0/+1991
+ Add suite with UDP encap. + Add suite with anti replay enabled. + Add new enums where needed by the new suites. + Apply trimming in enum_util to support "3DES". + All 10ktnl suites written and tested. + New robot tags added. + Fix one comment from the parent. Change-Id: I2581814dbb327891d8658dd009c4e52ffd318e3b Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-05-31feat(hoststack): Enable L4 checksum RX offloadVratko Polak14-0/+14
As hoststack is never tested in container/VM (yet), configuration there does not check the new flag. Change-Id: Icac4837efcf035cad0f1e126e1bf90811aba16b2 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-05-31Revert "feat(hoststack): Enable L4 checksum RX offload"Peter Mikus14-14/+0
This reverts commit 4e897a7a91e8b4782da05a4c906392e62c8f8ab5. Reason for revert: Container/Qemu is not conditioned. Change-Id: I497caa2db24803f40811b3c60c359b4772cacda7 Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
2024-05-30feat(hoststack): Enable L4 checksum RX offloadVratko Polak14-0/+14
Change-Id: I169b06433ae962811aafa91ce90fe169b0bc4c71 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-05-29style(crypto): Move robot tag DRV_VFIO_PCIVratko Polak131-246/+246
Move DRV_VFIO_PCI after TXQ_SIZE_0. Upcoming suites need more space in the preceding line. 131 suite files edited, luckily doable by two commands: $ sed -i 's/ | DRV_VFIO_PCI//' *.robot $ sed -i 's/ | TXQ_SIZE_0/ | TXQ_SIZE_0 | DRV_VFIO_PCI/' *.robot Change-Id: Idf30d20d321922718d523a216056d22ae67e50aa Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-05-21fix(various): filespmikus1-2/+2
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I601a54e543114957592548618df2f2f4bf790f82
2024-05-21fix(hoststack): Use TX checksum offloadVratko Polak14-10/+16
Some tests were already doing that via Set Test Variable, this moves the flag into Variables table for every suite. Change-Id: I54e86f3fd10354dc87c2f04c70bbab771f89f3d2 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-05-14feat(CpuUtils): Allow suites to forbid siblingsVratko Polak4-0/+4
Some perf suites use a single unidirectional flow of traffic. On SMT-enabled machines, 1C tests create 2 workers by default. But if there is only one stream/flow, only one worker does useful work. The other worker on the sibling logical core does busy-wait, which provably lowers the peformance. Some suites already set smt_used (as a suite variable) to False for these purposes. This change edits a lower-level L1 keyword to honor this value, and adds the suite variable to single stream (and client) hoststack suites, where the detrimental effect of busy siblings was observed. Change-Id: I203f1a700d8e6cd84640b9c0b40487cb832908aa Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-05-13feat(hoststack): Apply no-muti-segVratko Polak10-20/+20
+ State frame size as 1518 octets, even if some packets are smaller. + This implicitly makes CSIT keywords to apply n-milti-seg. - Real frame size is currently not important. Change-Id: I754eac7e7ebf0378efb27149862004e35c387505 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-04-30feat(ipsec): Use strings instead of enums in RobotVratko Polak121-553/+250
Only related to enums appearing in ipsec suites. + Add conversion utility as enum_utils.py file. + Rename PolicyAction closer to ipsec_types.api: IpsecSpdAction. + Device and perf suites updated to use str in Variables table. - Perf suites are being tested. Change-Id: I3b1678c4d6cc303c590e5e3665ab1b05d104a121 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-04-26feat(tests): IPsecHW rxq ratiopmikus25-0/+25
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: I17866709e1c7edf078055aef4db15774e136b111
2024-04-25feat(density): Delete ipsec nfv_density testsVratko Polak36-6037/+0
They are broken for more than two years and they relied on CLIs that changed in VPP anyway. Ticket: CSIT-1856 Change-Id: I0f278ff61a9da5e6040e08bf3e92049cb33c8a93 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-04-25feat(profiles): Cleanup IPv6 profilespmikus2-6/+6
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: Ib9d1d819e59be768377f3a61578c22699a10f0a8
2024-04-22style(ipsec): Fix some issues reported by pylintVratko Polak1-2/+2
+ Fix typo "enale". - Many style and complexity issues remain: C0302, R0904, R0914, R0913, R1735, R0915, R1734. Change-Id: I7e8c7ecefd8f8f94dcbc28427baa52a9c8ea1227 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-04-22Add hoststack with DMA test suitesxinfengx2-0/+244
Change-Id: Idef14bef816a04ca43ab9aced4b1441ef818e066 Signed-off-by: xinfengx <xinfengx.zhao@intel.com>
2024-04-22fix(ip6scale): Document correct prefix lengthVratko Polak14-18/+18
We are testing /128 in ip6 scale tests for a long time, but we did not update the suite documentation when we switched. This does that. Note that ip6 bas (and feature) tests are still using /64. Change-Id: I5e108497b3f516195fce0e480ca3ec18d204bd84 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-04-18feat(tests): IPv6 fixespmikus6-30/+24
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: I9bc9f9fe410c0fa78e20a234487e63eb42f3fe3f
2024-04-18Revert "fix(ip6): Use updated profile names in 2n suites"Peter Mikus3-6/+6
This reverts commit b3c5215bba37bd6555231da8c40ae90d9fc570c9. Reason for revert: Makes no sense Change-Id: Iabe098114a0e98a89e815daf706745917d8504a6 Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
2024-04-17style(ipsec): Do not import ipsec.robot to suitesVratko Polak131-308/+177
It is already available via default.robot import. Change-Id: I52c8f5d62f641edfbbc4b750e40274a75b169a22 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-04-17fix(ip6): Use updated profile names in 2n suitesVratko Polak3-6/+6
Change-Id: If5cc42bac1c49d1f1d960e0812ab352564bc29d2 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-04-11feat(tests): IPv6 scalepmikus17-29/+903
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: I720b7c96a6ac9f328aff57437e51254364604911
2024-03-21feat(tests): Remove unsupported suitesVratko Polak8-1364/+0
The new suites were added in [1] and the VPP functionality was removed in [2]. [1] https://gerrit.fd.io/r/c/csit/+/28508 [2] https://gerrit.fd.io/r/c/vpp/+/31443 Change-Id: Id3fa984bf9f61a1dd831d637695ac6844c86ffc8 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-03-14feat(tests): Fix scaling of 6p3nicoper-240318pmikus18-18/+259
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: I84d9cf2892423e62b116b07982d3e87120b66271
2024-02-06Add memif with DMA test suitesxinfengx4-0/+622
Change-Id: I8c27b5956c0c26bb2de48321675e285ed961412f Signed-off-by: xinfengx <xinfengx.zhao@intel.com>
2023-11-03feat(tests): 6p3nic ip4 testsoper-231106pmikus18-251/+455
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: I69ee305b25b9e05d2305cb82aba71ef6418780ab
2023-10-26feat(trex): cleanup t-rex profilespmikus653-1067/+1067
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: Ib93dc1552945fe91ab5346b9b759d56c7468debf
2023-09-21feat(core): Multilink backendpmikus14-40/+40
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I8d168979ab9722e0056e97edb228f29cbfa245e3
2023-09-14Add IPsec and wireguard hwasync test cases to 3nb-spr job specsxinfeng zhao2-0/+340
Also add IPsec 10000tnlhwasync int mode and 4tnlhwasync policy mode test suites, in order to compare sw crypto and QAT crypto and IPsec int mode and policy mode performance. Signed-off-by: Yulong Pei <yulong.pei@intel.com> Signed-off-by: xinfeng zhao <xinfengx.zhao@intel.com> Change-Id: I0aed06a0c75c1a545720649d3561a0aa5a861db2
2023-09-04fix(hoststack): hardcode DUT1 for nginxVratko Polak2-2/+2
Previously, the Set up LDP or VCL Nginx on DUT node keyword was wrongly documenting its "dut" argument as type string, while using the value as a node dict instead. As most of the code already used direct dut1 variables, this patch eliminates the dut argument altogether and puts DUT1 into the keyword name. Change-Id: Ie29afc175b98c1b1cb554438da9178738662d108 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2023-07-14feat(crc): bump messages for cycle after 2306Vratko Polak6-12/+12
The supported VPP code is 380c62d7040bf285d449f1d05692141c40089470 which is the latest commit before stable/2306 diverged from master. + Separate messages into blocks with paths to .api sources. + Prepare memif for use_dma (currently always false). + Use srv6 test teardown action in srv6 device tests. - Do not use sr_policy_add_v2 from 37258 yet. - Leave a TODO to do it eventually, for now inputs are too different. - Do not use index based policer calls from 37873. - The policer_add_del is not deprecated yet and inputs are different. Change-Id: I350138f09542ec12ce4bec140203175940ccf9d4 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2023-06-21feat(infra): update 3n-alt cx6 iterative testsJuraj Linkeš2-0/+354
Add ipsec reassembly test cases to bring in line with 3n-icx. Add ipsec policy test cases with flow cache enabled for both inbound and outbound traffic. Remove GTPU hardware tests as the NIC doesn't support GTPU offload RX. Change-Id: I7b18914f983d5974b390f995ec638a64b9bbccbb Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2023-06-02job-spec: Replace TRex scale2m-tg tests by scale20k-tgTibor Frank2-16/+16
Change-Id: If7e00460fee4eee50479dc089c026670dcf3edf9 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2023-05-31"fix(test): Hoststack"Peter Mikus8-13/+13
Change-Id: I6ec27d787b59d4bc13b8c04f4217302cc3021581 Signed-off-by: pmikus <peter.mikus@protonmail.ch>
2023-05-30fix(test): Hoststackpmikus8-13/+13
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I676696928fd1758c9dddf4f2580b9e924fe71b53
2023-05-29feat(tox): Cleanup docspmikus1-142/+0
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: Ia13e920ef11d364893a51957778e60084f4ac0f9
2023-05-29docs(var): Next releasepmikus1-0/+142
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I5cd45dd59f13e1ca942f44341b5f37e257c2b51e
2023-05-24feat(reassembly): add few suites for ip reassemblyVratko Polak7-0/+1174
In tunneling scenarios, VPP needs to reassembly packet fragments before decapsulation. Conveniently, VPP also fragments the packets after encapsulation (at least for some encapsulation protocols) if they do not fit into MTU. So this change adds few suites, adapted from existing 3-node ones which additionally lower MTU on DUT1-DUT2 link. The intended packet size is 1518B. 64B packets will fit, and most of IMIX packets will also fit without fragmentation. VPP refuses to reassembly 9000B packets as they have too many fragments. + Add a keyword so suites need only one additional line of code. + Add new test tag REASSEMBLY for the added suites. + Tell autogen the one soak test case for reaseembly should be 1518B. - It is possible to increase fragment limit for 9000B, not done yet. - Ipsec policy suites are added but they should not be used. - VPP does fragmentation twice (before and after encapsulation). - VPP does not perform reassembly (only last fragment is decrypted). - TRex does not realize the packet from VPP is only a fragment. - The result is false pass with unfairly good performance. + Suites still included, to simplify verifying VPP fixes for the above. Change-Id: If33c60d767fea161d9e4ffabb8ded3d81c8f39ed Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2023-05-10feat(infra): Remove system.d dependencypmikus2-6/+5
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: Icb7b6124dcba7bb57c18ceb91120284f6fe02c2e
2023-04-20Add 100k tunnels ipsec policy mode with fastpath enabled test suiteYulong Pei1-0/+178
Signed-off-by: xinfeng zhao <xinfengx.zhao@intel.com> Signed-off-by: Yulong Pei <yulong.pei@intel.com> Change-Id: I3708253adf4c7421ff48eee6aefb735b39726359
2023-04-03Enable IPsec policy fast path inboundYulong Pei3-3/+6
This will greatly improve the performance of IPsec policy cases Signed-off-by: xinfeng zhao <xinfengx.zhao@intel.com> Signed-off-by: Yulong Pei <yulong.pei@intel.com> Change-Id: Ib42b5650791be7fcc8649873eaf12616aeba5aec
2023-03-02fix(virtio): add vhost pluginVratko Polak5-10/+10
Previously, only vhost suites got the plugin. Fixes: 5e663cf4cfa7c3ce187dc4f223fa94dfb41f484b Change-Id: I020410581583c6226936aa9480913c751b5e8852 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2023-02-09Add 1M flows test suites of VPP IP4 and VPP IP6Yulong Pei4-0/+579
VPP routing with one million fib rules also is a key indicator for performance benchmark Signed-off-by: xinfeng zhao <xinfengx.zhao@intel.com> Signed-off-by: Yulong Pei <yulong.pei@intel.com> Change-Id: I19b52f6b96bdc5ed1e76305d258825fb17bd3af9
2023-02-02fix(perf/hoststack/quic): enable plugin_crypto_openssl.soDave Wallace4-9/+9
- convert hoststack tests to use app-api-socket instead of vpp-api-socket Change-Id: Ibcd87f3624e33168ed3afcb30267262efc927e7c Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
2023-01-24Tune host stack performance testsFilip Tehlar2-16/+26
* remove evt_qs_memfd_seg and evt_qs_seg_size as they are obsolete * use app socket api instead of vpp's api * apply rx and tx descriptors constraints * increase event queue size for nginx tests Signed-off-by: Filip Tehlar <ftehlar@cisco.com> Change-Id: Ie7ac12b8f587e0b1962884127e8eb68a4e588aee Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
2023-01-19Add 40k tunnels ipsec policy mode with fastpath enabled test suiteYulong Pei3-6/+182
In order to compare performance number with existed routing based ipip interface mode 40k tunnels ipsec test. Signed-off-by: xinfeng zhao <xinfengx.zhao@intel.com> Signed-off-by: Yulong Pei <yulong.pei@intel.com> Change-Id: I94816a8c18f08b539114d6ca9d4e1218a2b6ea5f