aboutsummaryrefslogtreecommitdiffstats
path: root/resources/libraries/python
AgeCommit message (Collapse)AuthorFilesLines
2024-05-31feat(hoststack): Add stat pre/post actionsVratko Polak1-20/+1
While adding runtime actions to hoststack tests is not easy, adding pre and post actions for stats is easy. The main hoststack measurement is treated as the stats trial, the same way as the 10 measurements in MRR tests are. + Remove the previous partial info via "show" CLI commands. - As in other VPP tests, stat telemetry is not exported. Change-Id: Ib567aa810418568520d4d543c6d50431e85a3269 Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit 3dc8a53fc419e0491d1bd53e23473aed019fedc1)
2024-05-31feat(jobspecs): Add more soak testsVratko Polak1-3/+0
+ Add l2xcbase. + Add 200k scale, both ip4 and ip6. + Test 200k and l2bdmaclearn also on: + Primary NIC with secondary driver. + Secondary NIC and its primary driver. + Add 1518B memif test cases, for 2n-spr also with DMA (including 64B). + This needed an edit in autogen. + Switch crypto tests to drv_vfio_pci as AVF has bad RSS on those. + Add two SRv6 cases to 3n-icx as it does not support hwasync crypto. + Repair name of UDP ASTF tests. Change-Id: I91e20ec80dc4984c55d39b5f5ad38f26b48da33e Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit 3d20e3980839f01466c5750c2372fba55c47768e)
2024-05-31feat(hoststack): Enable L4 checksum RX offloadVratko Polak1-0/+5
As hoststack is never tested in container/VM (yet), configuration there does not check the new flag. Change-Id: Icac4837efcf035cad0f1e126e1bf90811aba16b2 Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit e66952b110969a1f0d2369847c39953197d57734)
2024-05-31style(jumbo): Unify naming of jumbo flagVratko Polak5-44/+44
Previously, the flag was sometimes called "jumbo", sometimes "jumbo_frames". As we never use "jumbo" for things other than frame size, unify the flag to "jumbo". Change-Id: Ib688389799a4550ac9f51375f4defc06a02e6f03 Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit 10e9064182d5590d96afb335a24d583b5c8222f4)
2024-05-31Revert "feat(hoststack): Enable L4 checksum RX offload"Peter Mikus4-10/+2
This reverts commit a8293c188485d69bd5e2dd161d4b0fd38df85bbf. Reason for revert: Container/Qemu is not conditioned. Change-Id: If822577dd83eb8c8b2db078ed99375bc2606b8bd Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
2024-05-30feat(hoststack): Enable L4 checksum RX offloadVratko Polak4-2/+10
Change-Id: I169b06433ae962811aafa91ce90fe169b0bc4c71 Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit 4e897a7a91e8b4782da05a4c906392e62c8f8ab5)
2024-05-30fix(core): AWS interface initializationpmikus1-5/+55
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I3ef110e8fec2fa8abafead1392a1b2af5e59f803 (cherry picked from commit 5ab88c226c98bc2e47ca93ef8538e7b10a073427)
2024-05-14feat(CpuUtils): Allow suites to forbid siblingsVratko Polak1-1/+5
Some perf suites use a single unidirectional flow of traffic. On SMT-enabled machines, 1C tests create 2 workers by default. But if there is only one stream/flow, only one worker does useful work. The other worker on the sibling logical core does busy-wait, which provably lowers the peformance. Some suites already set smt_used (as a suite variable) to False for these purposes. This change edits a lower-level L1 keyword to honor this value, and adds the suite variable to single stream (and client) hoststack suites, where the detrimental effect of busy siblings was observed. Change-Id: I203f1a700d8e6cd84640b9c0b40487cb832908aa Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-04-30feat(ipsec): Use strings instead of enums in RobotVratko Polak2-226/+261
Only related to enums appearing in ipsec suites. + Add conversion utility as enum_utils.py file. + Rename PolicyAction closer to ipsec_types.api: IpsecSpdAction. + Device and perf suites updated to use str in Variables table. - Perf suites are being tested. Change-Id: I3b1678c4d6cc303c590e5e3665ab1b05d104a121 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-04-26Revert "fix(IPsecUtil): Delete keywords no longer used"Vratko Polak1-0/+43
This reverts commit 79635f7cdfb7046230473570068f97a159cf87b4. Peter says he is using those. Change-Id: I47886ba0676bc74d5189a2986ac347f49fdde36c Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-04-26fix(IPsecUtil): Delete keywords no longer usedVratko Polak1-43/+0
When deleting ipsec nvf density suites, I removed the main L2 Robot keyword, but forgot to remove the associated L1 Python keywords. Change-Id: I0f72699dcab272aec5c531cdaacceed30356cd02 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-04-25feat(density): Delete ipsec nfv_density testsVratko Polak1-117/+0
They are broken for more than two years and they relied on CLIs that changed in VPP anyway. Ticket: CSIT-1856 Change-Id: I0f278ff61a9da5e6040e08bf3e92049cb33c8a93 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-04-24style(ipsec): add type hints to IPsecUtilVratko Polak1-229/+253
+ Update docstrings to match. Change-Id: I20f8f0247a9cf38a2d9a98fa8905eb55d91817f7 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-04-22style(ipsec): Unify mutiline stringsVratko Polak1-79/+72
+ One more pylint improvement not worth a separate change. Change-Id: I5a2a3a4c70909fefd3fdf6f3ed8b344d19fc823e Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-04-22style(ipsec): Fix some issues reported by pylintVratko Polak1-39/+29
+ Fix typo "enale". - Many style and complexity issues remain: C0302, R0904, R0914, R0913, R1735, R0915, R1734. Change-Id: I7e8c7ecefd8f8f94dcbc28427baa52a9c8ea1227 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-04-22Add hoststack with DMA test suitesxinfengx1-0/+20
Change-Id: Idef14bef816a04ca43ab9aced4b1441ef818e066 Signed-off-by: xinfengx <xinfengx.zhao@intel.com>
2024-04-18feat(tests): IPv6 fixespmikus1-15/+19
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: I9bc9f9fe410c0fa78e20a234487e63eb42f3fe3f
2024-04-17fix(ipsec): Prepare IPsecUtil for upcoming changesVratko Polak1-44/+36
+ Separate sad into two cycles. + Do not update flags in each iteration. + Update inner dicts. Change-Id: Ic81dfc6e614cc78ff321fba748d48a30678cc88a Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-04-17feat(tox): add copyright year fixer scriptVratko Polak1-1/+1
It uses rather simple sed commands, but seems to work well enough. + Improve readme. + Shortened comments about why 3 lines. Change-Id: I50b395dfeb586f671f7c4c82f22369de90b351ec Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-04-16style(IPsecUtil): Apply black formattingVratko Polak1-465/+714
Change-Id: I7cc2bc69c6849360abff0bd18b2ae3b93e2303c4 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-04-15feat(api): Use newest API messages after rls2402Vratko Polak4-35/+41
+ gtpu_add_del_tunnel_v2 + Add comments on used values and unused fields. + ipsec_sad_entry_add_v2 + Explicitly pass current default values. + ipsec_sa_v5_dump + policer_add + The old is_add argument removed, it was never false. + sr_policy_add_v2 + Add comments about currently unused fields. + Support also older VP builds with wrong reply. + rdma_create_v4 + Add comments about unused fields. Change-Id: I3d5bc345c4cf099661626770c4d86bc230643cca Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-04-11feat(tests): IPv6 scalepmikus2-1/+86
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: I720b7c96a6ac9f328aff57437e51254364604911
2024-04-09fix(perpatch): Sort comparison output by test nameVratko Polak1-1/+5
Change-Id: Id68a4e2b7514b9cf2e1f2f30b78dc0cd696a673a Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-03-25fix(terraform): vpp-device filespmikus1-102/+111
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: I7f640aa28ecf3a60696676b0cf8afb7a080e1b12
2024-03-25Revert "fix(core): Disable core dbg analysis"Vratko Polak1-7/+6
This reverts commit ffca8b8655c772fc6273702cae2151e7ac7a846d. + Add 10 second sleep, could help if core is big. Change-Id: Id2b3199737f8c50cee713e8626dce1bfa72ea4e1 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-03-14feat(tests): Fix scaling of 6p3nicoper-240318pmikus3-37/+37
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: I84d9cf2892423e62b116b07982d3e87120b66271
2024-02-13feat(core): QAT RXQ allocationpmikus1-4/+8
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: I78501f08b29a202c0e1129b79af6a63299e8ee36
2024-02-07fix(bootstrap): skip suites for virtual NICVratko Polak1-2/+2
As the skipping logic looks at available topologies, fix skipping by adding virtual to vagrant.yaml Change-Id: I5e7bf1dc2f4f4787917f1f989a974255cf2591a9 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-02-06Add memif with DMA test suitesxinfengx4-3/+279
Change-Id: I8c27b5956c0c26bb2de48321675e285ed961412f Signed-off-by: xinfengx <xinfengx.zhao@intel.com>
2024-01-31fix(autogen): Do not set nic_code from nic_nameVratko Polak1-8/+1
This should fix some suites wrongly using nic_pfs=6. Change-Id: Ifb7bd24b9a2d1764634eea4a43b4509f16e03da2 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-01-24fix(PLRsearch): handle unsent packets as lossVratko Polak1-5/+20
Change-Id: Icaa88523ede0b1fad6e6cb667a8f307ea5f4a12d Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-01-24fix(PLRsearch): fix some pylint violationsVratko Polak3-6/+6
- Complexity and logging would require a larger change. Change-Id: I69f8e47b1806c880cd626bc5a8f5ae6290246093 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-01-24style(PLRsearch): format according to blackVratko Polak4-99/+157
Change-Id: I26e0ce172740f7f440469578294f8c13fec5850b Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-01-22fix(jumpavg): Tolerate zero sized runsVratko Polak1-1/+3
Change-Id: I7c2426fe47ca9ee44338423597be90a71aaa3653 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-01-22feat(papi): Tolerate behavior after 39871Vratko Polak1-14/+31
Even when VPP switches back to (or adds support for) the old behavior, this enables bisect to work for all VPP commits in 2402 cycle. Change-Id: Ic2b71bee1db723d9d13229d9f4288d1699d246c6 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-01-18feat(crc): Bump messages after 23.10 releaseoper-240122Vratko Polak2-5/+5
+ Post-release rdma_create_v4 will be added next cycle. Change-Id: Ief129b5be4a2c5d27f4674491c96c548573ecfb1 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-01-15feat(ansible): DPDK compatibility matrixpmikus1-1/+1
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: I746471b59e1fb00a00007b6e9f2ba02d873ae3e2
2023-12-13feat(bisect): introduce scripts for VPP bisectingVratko Polak1-0/+108
+ Parsing common with per-patch job is moved to a library. Ticket: CSIT-1618 Change-Id: I185bea084a29e6a37ef94e9da42b192a6a81fc17 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2023-12-13fix(Interfaces): do not use JsonParserVratko Polak3-73/+2
In past, there perhaps were Robot keywords needing JsonParser. But now the single remaining call site can call json.loads directly. + Delete now unused resources/libraries/python/parsers/. Change-Id: I9c5d94d6b320f917f1f621abb83556ebccadc3ec Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2023-12-11feat(job_specs): Add 200ge6p3cx7veat testspmikus1-15/+15
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: Ia713b9a0b962820b014bad3582bc095ec802380c
2023-12-07fix(CpuUtils): correct robot variable namesVratko Polak1-4/+4
Fixes: 76fcd8422842d0756338502213de561eaa93e670 Change-Id: Ie642aeed5c55d479e0e4b87be965b4b5f70d6612 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2023-11-23fix(infra): QAT initpmikus1-8/+10
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I862f9ca12e9149eab2d0701368cdc65f294629cc
2023-11-21fix(core): Suite generatorpmikus2-185/+201
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: Ie47a2d736f90000741204bec144cbf2e4052bb2c
2023-11-10feat(vpp_device): Main core allocation randomizationpmikus1-5/+8
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I0c261b08dc9b88b853922520598ddb29d222e86c
2023-11-08fix crypto device init functionsxinfeng zhao1-0/+16
Change-Id: I96616f6895c9a0c9fb7dc876b2e8b83eff379f16 Signed-off-by: xinfeng zhao <xinfengx.zhao@intel.com>
2023-11-08feat(csit): 3n-icxdpmikus1-0/+8
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: I7f0eee8b94f65550eae68edeacf343ff982dd85a
2023-11-03feat(tests): 6p3nic ip4 testsoper-231106pmikus4-34/+83
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: I69ee305b25b9e05d2305cb82aba71ef6418780ab
2023-10-30code and doc updates for vagrant VM dev/test environ setupNaveen Joy2-1/+6
Change-Id: I0e4e4758b3abbfc2fe2e18200b85477293de218b Signed-off-by: Naveen Joy <najoy@cisco.com> Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
2023-10-25feat(core): Multilink TRex Sync mode IIpmikus1-57/+71
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: Idf4df372520d4a72c0738a89290d16710485f140
2023-10-25feat(MLRsearch): use goal result as in draft05Vratko Polak6-37/+86
No effect on NDRPDR results, just different result packaging between the MLRsearch library and the rest of CSIT. - PyPI metadata still to be updated in a separate Change. Change-Id: I547134da189d1d7761594e92f36cc7c1c232ee32 Signed-off-by: Vratko Polak <vrpolak@cisco.com>