aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2024-06-05feat(release): Update VPP release notesoper-rls2406-240610Vratko Polak2-3/+19
+ List added and edited perf tests. + List new device NICs and tests on them. + Copy known device issues, even thougth new jobspecs avoid them. Change-Id: I3e791c6d6395a4d9ac720fb0c9291464cf6d7395 Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit 94f937dc9f179c38a7ca5103faf4cdc22ac501e3)
2024-06-04fix(jobspec): IPsec HWasync has 1c, not 3cVratko Polak4-8/+8
Fixes: d29977e35bb15cd7df21c082432f03eab87e2e66 Change-Id: I1a20ded1181f5a3b33a0f6640554a939218d9791 Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit a7d5674bac305f467a83705225b4a7a9414372c5)
2024-06-04C-Docs: Add env ver 15Tibor Frank5-4/+8
Change-Id: I53d24a291907c862e2214e9152cede8f0ac05345 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 7a2891dc32f4faee75d05e1349396f0fbe36b0f7)
2024-06-04C-Dash: Add "hosts" to rls2406 iterative dataTibor Frank3-4/+2
Change-Id: I038639ad010935d6144c79acb25e0e357beb3e96 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 3f10e048edb08a14df79d24777f466a637a3fd5b)
2024-06-04C-Docs: Add links to C-Dash appsTibor Frank4-2/+27
Change-Id: I1bb9b3af12737203d45f981b80be88290d2c7be4 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit a250e3195d6a4789828795d083f6661343de0f0a)
2024-06-04C-Dash: Fix: Zero division errorTibor Frank1-1/+3
Change-Id: Ie3a61153c3e286f196617be438c2056a001b6faa Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 8e60591baa0f4460dc4b6cd8c0252b10f299354d)
2024-06-04C-Docs: Update rls2406 notes.Tibor Frank4-14/+10
Change-Id: Iba15dc18b9e49dee0776e2897e45264a20ff2817 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 73e61c46d48ba153819059237118f6a976c6d7eb)
2024-06-04C-Dash: Add rls2406 dataTibor Frank11-53/+104
Change-Id: Id597a02e3d8586f4c712ebf9eaddc46315b2a844 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 47f1e18328182a1f9159141e7cf83d9ee060c71c)
2024-06-03fix(ipsec): Enable anti_replay for -ar- suitesVratko Polak11-0/+11
The -ar- suites had everything edited, except that one agrument that would actually enable anti-replay. Fixes: b9dff484de0725bca3f65739519d952e3be55cbe Change-Id: Ib2c590a9be5271348ee15d4e4ab1b7c663559477 Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit bb61b785ec75dc6d20beecde15f994c82b6b27cb)
2024-05-31feat(jobspec): Add new new ipsec with UDP encapoper-rls2406-240603Vratko Polak14-66/+212
+ Only for dpdk-plugin and primary NIC. + Prefer Intel, as that seems to have more stable performance. + Only one testcase per suite: 1518B 1c. + Add full set of 10k AES256GCM tests where not present already. + Remove multi-core ipsec AVF tests from 3n-icx to keep duration small. - Performance of those was limited by CSIT-1948 anyway. Change-Id: I9166f15b44071dafe89ac8ca7982f659006027ba Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit f4c15ef5413ca34b6b3d96f7d533bd3da32ab3f8) (cherry picked from commit c52dca038117b0dd52cbe4482e67ea8bd48537a6)
2024-05-31feat(jobspec): Align weekly ndrpdr to daily mrrVratko Polak4-161/+135
+ This mainly uncomments a bucnh of 3n-alt xl710 ipsec tests. + Otherwise the difference was quite small. Change-Id: I8b67fcce157f36ed79e9692a0581e1115b3f6886 Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit c92d64074dfb49ddcb92da730b18f725c58eb002) (cherry picked from commit c326f7594b530e80a30acc8486099078901ef40f)
2024-05-31feat(ipsec): Add suites for more algsVratko Polak15-13/+2108
+ Add suite with UDP encap. + Add suite with anti replay enabled. + Add new enums where needed by the new suites. + Apply trimming in enum_util to support "3DES". + All 10ktnl suites written and tested. + New robot tags added. + Fix one comment from the parent. Change-Id: I2581814dbb327891d8658dd009c4e52ffd318e3b Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit b9dff484de0725bca3f65739519d952e3be55cbe)
2024-05-31fix(hoststack): Do not limit number of RX queuesVratko Polak1-6/+2
This makes most scale hoststack tests correctly use both sibling cores. - Except quic multi-client ones, which start failing instead. - To be fixed later. - VPP startup.conf looks correct to me. - All quic tests suffer from CSIT-1935 so no big loss. Change-Id: If22c01651140865e188733039890f1fb0ceaa57a Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit e417ac6f71f32064075d7f270c71f18f4cbe6f69)
2024-05-31feat(hoststack): Add stat pre/post actionsVratko Polak2-21/+19
While adding runtime actions to hoststack tests is not easy, adding pre and post actions for stats is easy. The main hoststack measurement is treated as the stats trial, the same way as the 10 measurements in MRR tests are. + Remove the previous partial info via "show" CLI commands. - As in other VPP tests, stat telemetry is not exported. Change-Id: Ib567aa810418568520d4d543c6d50431e85a3269 Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit 3dc8a53fc419e0491d1bd53e23473aed019fedc1)
2024-05-31feat(jobspecs): Add more soak testsVratko Polak6-43/+171
+ Add l2xcbase. + Add 200k scale, both ip4 and ip6. + Test 200k and l2bdmaclearn also on: + Primary NIC with secondary driver. + Secondary NIC and its primary driver. + Add 1518B memif test cases, for 2n-spr also with DMA (including 64B). + This needed an edit in autogen. + Switch crypto tests to drv_vfio_pci as AVF has bad RSS on those. + Add two SRv6 cases to 3n-icx as it does not support hwasync crypto. + Repair name of UDP ASTF tests. Change-Id: I91e20ec80dc4984c55d39b5f5ad38f26b48da33e Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit 3d20e3980839f01466c5750c2372fba55c47768e)
2024-05-31feat(profiles): Do not share seeds between streamsVratko Polak6-27/+27
Avoiding any predictable memory access patterns is more important than similarity between 2p and 6p profiles. + Seed values now match parts of IP source address. Change-Id: Ib1830cf9d3e7b329e54de19a92ecea77c8baeeb5 Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit 3151535b07b7602e73925224250670af9449db68)
2024-05-31feat(hoststack): Enable L4 checksum RX offloadVratko Polak16-0/+24
As hoststack is never tested in container/VM (yet), configuration there does not check the new flag. Change-Id: Icac4837efcf035cad0f1e126e1bf90811aba16b2 Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit e66952b110969a1f0d2369847c39953197d57734)
2024-05-31style(jumbo): Unify naming of jumbo flagVratko Polak5-44/+44
Previously, the flag was sometimes called "jumbo", sometimes "jumbo_frames". As we never use "jumbo" for things other than frame size, unify the flag to "jumbo". Change-Id: Ib688389799a4550ac9f51375f4defc06a02e6f03 Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit 10e9064182d5590d96afb335a24d583b5c8222f4)
2024-05-31Revert "feat(hoststack): Enable L4 checksum RX offload"Peter Mikus19-29/+2
This reverts commit a8293c188485d69bd5e2dd161d4b0fd38df85bbf. Reason for revert: Container/Qemu is not conditioned. Change-Id: If822577dd83eb8c8b2db078ed99375bc2606b8bd Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
2024-05-30feat(hoststack): Enable L4 checksum RX offloadVratko Polak19-2/+29
Change-Id: I169b06433ae962811aafa91ce90fe169b0bc4c71 Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit 4e897a7a91e8b4782da05a4c906392e62c8f8ab5)
2024-05-30fix(packer): Update AWS imagepmikus5-75/+89
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: I1907fcb88dff0bb62cc6f5a8bf3ea58e3ad1578d (cherry picked from commit fa300743951b31a8109769c075d1edba9e6a85bd)
2024-05-30feat(terraform): New AWS AMI imagepmikus2-4/+4
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: I6951c4fc9f96a0acf44ba3201c91c9cb903889d7 (cherry picked from commit 5bb211044c10e791277d7de8561dc50af30c6abc)
2024-05-30fix(core): AWS interface initializationpmikus2-5/+61
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I3ef110e8fec2fa8abafead1392a1b2af5e59f803 (cherry picked from commit 5ab88c226c98bc2e47ca93ef8538e7b10a073427)
2024-05-29style(crypto): Move robot tag DRV_VFIO_PCIVratko Polak131-246/+246
Move DRV_VFIO_PCI after TXQ_SIZE_0. Upcoming suites need more space in the preceding line. 131 suite files edited, luckily doable by two commands: $ sed -i 's/ | DRV_VFIO_PCI//' *.robot $ sed -i 's/ | TXQ_SIZE_0/ | TXQ_SIZE_0 | DRV_VFIO_PCI/' *.robot Change-Id: Idf30d20d321922718d523a216056d22ae67e50aa Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit 26b060d6da1bf6abd46089be73c5ab70ec4aff05) (cherry picked from commit 5db639e6a0f9112f97dcb52d7a6b1eb8cd540326)
2024-05-23Initial update of VPP_STABLE_VER filesoper-rls2406-240523Tibor Frank3-3/+3
Change-Id: I756b6662bc8ed137ce70882c3c0f14f7c8a02adb Signed-off-by: Tibor Frank <tifrank@cisco.com>
2024-05-22fix(etl): Typo"pmikus17-18/+1
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: Ibd49015bc810a040d28509efc2e4bca26875229e
2024-05-22feat(etl): Release pipelinespmikus34-632/+729
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I4ce20267b4747bf1901b6175e0ec5936b583a510
2024-05-22Update DPDK_STABLE_VER filesTibor Frank1-1/+1
Change-Id: Ia4355295e783f29c87db6ed009370bd794d9b4ce Signed-off-by: Tibor Frank <tifrank@cisco.com>
2024-05-22C-Doc: Add placeholder for 2406 rls notes.Tibor Frank15-122/+418
Change-Id: I89f2d314ff5ed33a86407489733544f197ad3d87 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2024-05-21C-Dash: Enable reading of constants from env variablesTibor Frank8-183/+268
+ add switching on/off the apps Change-Id: I46e0cd2f214fd6a05ec0b87a433708bc4b6e2eb1 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2024-05-21fix(various): filespmikus3-4/+4
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I601a54e543114957592548618df2f2f4bf790f82
2024-05-21fix(hoststack): Use TX checksum offloadVratko Polak14-10/+16
Some tests were already doing that via Set Test Variable, this moves the flag into Variables table for every suite. Change-Id: I54e86f3fd10354dc87c2f04c70bbab771f89f3d2 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-05-20fix(perf): Increase threshold for jumboVratko Polak1-2/+2
The old limit of 1522 was introduced long time ago. First, it appeared here [0], where it is correct as that suite has zero overhead. The first suite with wrong logic seems to be here [1] (no "Add No Multi Seg to all DUTs" in 1518B testcase). And when I was moving that logic to a keyword in [2], I did not realize it is wrong with overhead. This Change uses 1800 as the new threshold, matching the value used for non-jumbo MTU. [0] https://gerrit.fd.io/r/c/csit/+/2652/12/tests/perf/Bridge_Domain_Intel-X520-DA2.robot#70 [1] https://gerrit.fd.io/r/c/csit/+/4454/96/tests/perf/40ge2p1xl710-ethip4ipsecscaleip4-ip4base-interfaces-aes-gcm-ndrpdrdisc.robot#229 [2] https://gerrit.fd.io/r/c/csit/+/13411/35/resources/libraries/robot/performance/performance_utils.robot#84 Change-Id: Iff3703fcff0e4bbb1a6b10be359fa5ef67fd5422 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-05-20Update VPP_STABLE_VER filesTibor Frank1-1/+1
Change-Id: I818cc10e971c85cd8e712c05536b5813bf18749a Signed-off-by: Tibor Frank <tifrank@cisco.com>
2024-05-17feat(device): Reconfigurepmikus3-23/+35
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: I5ca0fc5832c249553c79dd9c5d4148ba64e61654
2024-05-16feat(bootstrap): Add more granular eb scriptspmikus2-47/+52
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: Icbcd373ef815fa082d9be022fc201c96df140536
2024-05-14feat(CpuUtils): Allow suites to forbid siblingsVratko Polak5-1/+9
Some perf suites use a single unidirectional flow of traffic. On SMT-enabled machines, 1C tests create 2 workers by default. But if there is only one stream/flow, only one worker does useful work. The other worker on the sibling logical core does busy-wait, which provably lowers the peformance. Some suites already set smt_used (as a suite variable) to False for these purposes. This change edits a lower-level L1 keyword to honor this value, and adds the suite variable to single stream (and client) hoststack suites, where the detrimental effect of busy siblings was observed. Change-Id: I203f1a700d8e6cd84640b9c0b40487cb832908aa Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-05-13feat(hoststack): Apply no-muti-segVratko Polak10-20/+20
+ State frame size as 1518 octets, even if some packets are smaller. + This implicitly makes CSIT keywords to apply n-milti-seg. - Real frame size is currently not important. Change-Id: I754eac7e7ebf0378efb27149862004e35c387505 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-05-13Update VPP_STABLE_VER filesTibor Frank1-1/+1
Change-Id: I8ab964a6196dc3e81a4b7a9e7d8a7f0c0e2a0002 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2024-05-07Add 2048B file size cps rps tests in job specs for http-ldpreload-nginx-1_21_5.oper-240513Maciek Konstantynowicz2-2/+30
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> Change-Id: Id4b562259e6d86642152298bf500b353f1785939 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2024-05-06C-Dash: replace s3-logs by logsTibor Frank1-1/+1
Change-Id: Ib702521379e3f93b6e223882e187827e84b1189c Signed-off-by: Tibor Frank <tifrank@cisco.com>
2024-05-06Update VPP_STABLE_VER filesTibor Frank1-1/+1
Change-Id: I09706e24780e34dc8f02e36acc25ec7066aea9cd Signed-off-by: Tibor Frank <tifrank@cisco.com>
2024-05-01Revert "fix(jobspec): Delete ipsec nfv density tests"Peter Mikus2-0/+144
This reverts commit 573d59a0e3cafe60522e51dc9e5ba776c0a0a6e4. Change-Id: I6fef1876d6f7274310243aa743f68b7e51daf486 Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
2024-05-01Revert "feat(profiles): Do not repeat seeds in 6p profiles"Peter Mikus12-18/+66
This reverts commit b8f31fc3da4b0a6ab5805eea61af0fe7e869a453. Change-Id: I65f79bb323f48d9e7b3ed7a1990db1b1486da26e Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
2024-05-01Revert "style(scale): Apply black to new traffic profiles"Peter Mikus24-246/+246
This reverts commit 4e2635deff33db4bea476003ac222ffd9ab504b1. Change-Id: Idb9145fbf13e7943392a72f77ef9a1b479187732 Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
2024-04-30feat(ipsec): Use strings instead of enums in RobotVratko Polak124-788/+518
Only related to enums appearing in ipsec suites. + Add conversion utility as enum_utils.py file. + Rename PolicyAction closer to ipsec_types.api: IpsecSpdAction. + Device and perf suites updated to use str in Variables table. - Perf suites are being tested. Change-Id: I3b1678c4d6cc303c590e5e3665ab1b05d104a121 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-04-30fix(hoststack): Remove unwanted api trace in DMA testKai Ji1-1/+0
Change-Id: I48ec272fb150c09221142b8d73830d7b6741d0b5 Signed-off-by: Kai Ji <kai.ji@intel.com>
2024-04-30style(scale): Apply black to new traffic profilesVratko Polak24-246/+246
+ Add trailing commas to prevent black from collapsing argument lists. Change-Id: I8a2f2aca0df7a9271a073f87603f9abfa4870b11 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-04-30feat(profiles): Do not repeat seeds in 6p profilesVratko Polak12-66/+18
On one hand, using seed==1 for all W-E streams and seed=2 for all E-W streams would make 6p tests even more comparable with 2p tests. But current rnd profiles were mixing the two seed values. On the other hand, using unique seed values for each stream would ensure VPP is less likely to deviate from average preformance. As the second approach also results in smaller profile files, this patch applies that approach. Change-Id: If0f57282a2899a1a4fb154dd6ed810064cb5c212 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-04-30fix(profiles): Properly randomize in last profileVratko Polak1-7/+14
The file trex-stl-ethip6-ip6dst-rnd1000000-6p.py was not properly edited when converting from a non-random profile. Change-Id: I2fdf424176c69467dcf00cd4dc15f147c3576817 Signed-off-by: Vratko Polak <vrpolak@cisco.com>