aboutsummaryrefslogtreecommitdiffstats
path: root/resources/libraries/robot
AgeCommit message (Collapse)AuthorFilesLines
13 daysfix(hoststack): Base ldpreload path on CPU archVratko Polak1-3/+3
Without this, Nginx drop all packets on 2n-grc. + Also fix iperf3, even though we do not have working 3n ARM testbed. - If something else breaks Nginx, failed requests still count as real. Change-Id: Ib8d13986d2d58aaf3f63e70152bec45b303475f0 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2025-01-29fix(aws): c6in, c7gnPeter Mikus1-4/+2
Signed-off-by: Peter Mikus <peter.mikus@icloud.com> Change-Id: Ib08ee0ef0f83af9d63b372b9a027759879cceadc
2025-01-21fix(telemetry): fix perf stat issue on ArmJay Wang1-1/+4
VPP CSIT utilises perf stat command to monitor the perf events defined in perf_stat_runtime.yaml file. However, the raw event specification format(cpu/event=0xXXX,umask=0xXXX/u) is specific to x86 platforms(Intel/AMD). On ARM platforms, we stick to the symbolic names of the perf events. Signed-off-by: Jay Wang <jay.wang2@arm.com> Change-Id: I967bc4bddf5fc9ffbe61c276efdd95d69f7c4412
2025-01-14feat(avf): Migrate to plugins/dev_iavfVratko Polak1-2/+4
Change-Id: I4f4f17560f4c65a8f308e1f394207b7cec474b96 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2025-01-10fix(hoststack): Do not set api segment gidVratko Polak1-1/+0
Change-Id: I6d2ca1d35210a61f831b89ad373c712f31462ff0 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2025-01-09feat(hoststack): Run stat_post_trial if wait failsVratko Polak1-3/+5
Stat outputs are useful when investigating why client is slow. This fixes only AB tests. Iperf3 would need more complicated code. Change-Id: I4e523519b0b6f39c310de96aace7eb03a40a3b74 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2025-01-08fix(core): Container startupPeter Mikus1-2/+1
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: I95dcc11d25f5dc3cf395f6d69dc4e04d7653f7f2
2025-01-05fix(telemetry): fix perfmon issues on ArmJay Wang1-3/+9
To enable perfmon plugin on AArch64, users have to set kernel/perf_user_access to 1 to allow userspace applications to directly access PMU counters. Additionally, replace bundle cache-hierarchy with bundle cache-data as it is the correct bundle name on AArch64. Signed-off-by: Jay Wang <jay.wang2@arm.com> Change-Id: I67b86e255c8e62d3672a8f52db88eed3daf6ff59
2024-12-09fix(export): Report iperf3 version from DUT1Vratko Polak1-2/+2
Both GSO and hoststack tests are running iperf3 on DUT nodes, not on TG, so version should be detected on DUT1. Change-Id: I6babda800a409658c31a19cea86941231ea7c193 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-11-25feat(dma): Add show dma as test teardownVratko Polak1-1/+9
Add the teardown to memif and nginx tests, for memif it needs to be before "container" teardown. Change-Id: I142b76d3e47554d3a8050e04b9598592b43f22c1 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-09-23feat(bonding): Add simple suite for minimal coverageVratko Polak2-114/+15
- We want 2-link suite, as it has a non-trivial traffic pattern. - Not done here, as it needs edits in multiple layers. + Add 1-link suite to compare (and for 1-link testbeds). + Simplify also old bonding keywords. + Partial support for future multi-link suites. + Update jobspecs for minimal coverage: + Only add to iterative, both MRR and NDRPDR. - Coverage jobspecs to be updated later. + {1,2,4}c 64B tests, only to 3n-icx for now. + For both primary NIC+driver combinations there. Change-Id: I6da3b99a44b5ae83cc52921d5e2034fe5218270c Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-09-19feat(robot): Infra actionoper-240923Peter Mikus1-1/+1
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: I5d1718bbf61317c2d36e782b0ccb37b8ceb6e71e
2024-09-19feat(robot): Infra actionPeter Mikus1-0/+32
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: I55f6e954c865fa0574b9521bd885b68d2a87d39b
2024-06-28fix(core): VPP Initialisation issue on MLX.oper-240701pmikus1-1/+2
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: I2113e5e2067e13465ee1fedc6a2ba1c5bc1d7254
2024-06-12feat(multi): Multiple VPP instancespmikus1-0/+31
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: I28f2752f725c9816a557667033bf7d656fb0d414
2024-05-31feat(hoststack): Enable L4 checksum RX offloadVratko Polak1-0/+5
As hoststack is never tested in container/VM (yet), configuration there does not check the new flag. Change-Id: Icac4837efcf035cad0f1e126e1bf90811aba16b2 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-05-31Revert "feat(hoststack): Enable L4 checksum RX offload"Peter Mikus1-5/+0
This reverts commit 4e897a7a91e8b4782da05a4c906392e62c8f8ab5. Reason for revert: Container/Qemu is not conditioned. Change-Id: I497caa2db24803f40811b3c60c359b4772cacda7 Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
2024-05-30feat(hoststack): Enable L4 checksum RX offloadVratko Polak1-0/+5
Change-Id: I169b06433ae962811aafa91ce90fe169b0bc4c71 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-05-29fix(core): AWS interface initializationpmikus1-0/+6
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I3ef110e8fec2fa8abafead1392a1b2af5e59f803
2024-05-28fix(hoststack): Do not limit number of RX queuesVratko Polak1-6/+2
This makes most scale hoststack tests correctly use both sibling cores. - Except quic multi-client ones, which start failing instead. - To be fixed later. - VPP startup.conf looks correct to me. - All quic tests suffer from CSIT-1935 so no big loss. Change-Id: If22c01651140865e188733039890f1fb0ceaa57a Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-05-28feat(hoststack): Add stat pre/post actionsVratko Polak1-1/+18
While adding runtime actions to hoststack tests is not easy, adding pre and post actions for stats is easy. The main hoststack measurement is treated as the stats trial, the same way as the 10 measurements in MRR tests are. + Remove the previous partial info via "show" CLI commands. - As in other VPP tests, stat telemetry is not exported. Change-Id: Ib567aa810418568520d4d543c6d50431e85a3269 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-05-20fix(perf): Increase threshold for jumboVratko Polak1-2/+2
The old limit of 1522 was introduced long time ago. First, it appeared here [0], where it is correct as that suite has zero overhead. The first suite with wrong logic seems to be here [1] (no "Add No Multi Seg to all DUTs" in 1518B testcase). And when I was moving that logic to a keyword in [2], I did not realize it is wrong with overhead. This Change uses 1800 as the new threshold, matching the value used for non-jumbo MTU. [0] https://gerrit.fd.io/r/c/csit/+/2652/12/tests/perf/Bridge_Domain_Intel-X520-DA2.robot#70 [1] https://gerrit.fd.io/r/c/csit/+/4454/96/tests/perf/40ge2p1xl710-ethip4ipsecscaleip4-ip4base-interfaces-aes-gcm-ndrpdrdisc.robot#229 [2] https://gerrit.fd.io/r/c/csit/+/13411/35/resources/libraries/robot/performance/performance_utils.robot#84 Change-Id: Iff3703fcff0e4bbb1a6b10be359fa5ef67fd5422 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-04-30feat(ipsec): Use strings instead of enums in RobotVratko Polak1-9/+7
Only related to enums appearing in ipsec suites. + Add conversion utility as enum_utils.py file. + Rename PolicyAction closer to ipsec_types.api: IpsecSpdAction. + Device and perf suites updated to use str in Variables table. - Perf suites are being tested. Change-Id: I3b1678c4d6cc303c590e5e3665ab1b05d104a121 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-04-30fix(hoststack): Remove unwanted api trace in DMA testKai Ji1-1/+0
Change-Id: I48ec272fb150c09221142b8d73830d7b6741d0b5 Signed-off-by: Kai Ji <kai.ji@intel.com>
2024-04-22Add hoststack with DMA test suitesxinfengx1-18/+62
Change-Id: Idef14bef816a04ca43ab9aced4b1441ef818e066 Signed-off-by: xinfengx <xinfengx.zhao@intel.com>
2024-04-11feat(tests): IPv6 scalepmikus1-2/+1
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: I720b7c96a6ac9f328aff57437e51254364604911
2024-03-25fix(terraform): vpp-device filespmikus1-0/+1
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: I7f640aa28ecf3a60696676b0cf8afb7a080e1b12
2024-03-14feat(tests): Fix scaling of 6p3nicoper-240318pmikus1-4/+4
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: I84d9cf2892423e62b116b07982d3e87120b66271
2024-02-06Add memif with DMA test suitesxinfengx2-1/+33
Change-Id: I8c27b5956c0c26bb2de48321675e285ed961412f Signed-off-by: xinfengx <xinfengx.zhao@intel.com>
2023-11-03feat(tests): 6p3nic ip4 testsoper-231106pmikus1-2/+2
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: I69ee305b25b9e05d2305cb82aba71ef6418780ab
2023-10-25feat(MLRsearch): use goal result as in draft05Vratko Polak2-3/+3
No effect on NDRPDR results, just different result packaging between the MLRsearch library and the rest of CSIT. - PyPI metadata still to be updated in a separate Change. Change-Id: I547134da189d1d7761594e92f36cc7c1c232ee32 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2023-10-19feat(MLRseach): Update to v8 conditional throughputVratko Polak1-2/+2
Hopefully, with CSIT config values, PDR lower than NDR will not happen. + Bump duration_sum default to an odd number, so users are not surprised by not seeing standard median behavior. For CSIT this should not matter, overheads hide ties and number of trials (at least for STL) should stay the same. Change-Id: Id7130f978c31e71227499612424007c473bcfac2 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2023-10-18feat(MLRsearch): MLRsearch v7Vratko Polak2-95/+56
Replaces MLRv2, suitable for "big bang" upgrade across CSIT. PyPI metadata updated only partially (full edits will come separately). Pylint wants less complexity, but the differences are only minor. + Use the same (new CSIT) defaults everywhere, also in Python library. + Update also PLRsearch to use the new result class. + Make upper bound optional in UTI. + Fix ASTF approximate duration detection. + Do not keep approximated_receive_rate (for MRR) in result structure. Change-Id: I03406f32d5c93f56b527cb3f93791b61955dfd74 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2023-10-13fix(pylint): Minor warningspmikus1-1/+1
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: Id646ab09ae51d3153446f1ae334f62ba7710be14
2023-10-09Model: Add bandwidth to mrrTibor Frank1-2/+2
Change-Id: I4277f23d94fa191890041bb43e2fcd4eb5e42019 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2023-09-22fix(core): TRex self loop testspmikus1-1/+1
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I8945daffd500f689b3eb630f1ce7e1dc4f05aca8
2023-09-21fix(core): String mappingpmikus1-1/+1
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I4db3fc1b70469a966e51afe3bfa93cb4bcffa654
2023-09-21feat(core): Multilink backendpmikus3-74/+5
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I8d168979ab9722e0056e97edb228f29cbfa245e3
2023-09-20feat(infra): update 3n-alt ipsec testsJuraj Linkeš1-0/+2
Remove 4 tunnel flow cache test cases, as those don't benefit from flow cache much. Add mrr ipsec test cases for the XL710 Intel NIC to increase coverage. Don't add ndrpdr for XL710, only add commented out counterparts to align with the mrr list. Also modify the existing flow cache configuration by adding the fast path config as well. These are independent features, but the fast path code added this dependency. Change-Id: Ide88fd8c1abe96c577a86925dcc2dc4e63f897d4 Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2023-09-04fix(hoststack): hardcode DUT1 for nginxVratko Polak1-17/+17
Previously, the Set up LDP or VCL Nginx on DUT node keyword was wrongly documenting its "dut" argument as type string, while using the value as a node dict instead. As most of the code already used direct dut1 variables, this patch eliminates the dut argument altogether and puts DUT1 into the keyword name. Change-Id: Ie29afc175b98c1b1cb554438da9178738662d108 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2023-08-17fix(core): Variables for GSOpmikus1-4/+4
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I6768f65551deb335ba7b9fc07bca164bca9381fe
2023-08-15GSO: Add export of results to json files.Tibor Frank1-0/+6
Change-Id: Iac742f0571b11e06662af6bf1b680d0b4e196ddd Signed-off-by: Tibor Frank <tifrank@cisco.com>
2023-08-11feat(core): QAT initialization refactorpmikus2-30/+1
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: Idc91da55ab0b5c6b8eb53e8b4ce4da18a1ae891c
2023-08-04fix(core): QAT VF bindpmikus1-1/+1
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: Iafae1a1f538b928d3bb80bf9610a0bf7de646f8a
2023-07-27fix(core): QAT initializationpmikus2-1/+1
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I28af64b7d39a97bbb84f9d987a3f5d3a2d02701b
2023-07-27feat(core): Core allocationpmikus4-13/+27
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I782b87190dbee6e0a12c97f616b80539cd6614bd
2023-06-21feat(infra): update 3n-alt cx6 iterative testsJuraj Linkeš1-0/+8
Add ipsec reassembly test cases to bring in line with 3n-icx. Add ipsec policy test cases with flow cache enabled for both inbound and outbound traffic. Remove GTPU hardware tests as the NIC doesn't support GTPU offload RX. Change-Id: I7b18914f983d5974b390f995ec638a64b9bbccbb Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2023-06-16Add cryptodev device 4xxxYulong Pei2-2/+3
QAT_4xxx is integrated QAT device on SPR platform. Signed-off-by: xinfeng zhao <xinfengx.zhao@intel.com> Signed-off-by: Yulong Pei <yulong.pei@intel.com> Change-Id: If1d4b3d72a2c66855ac8c1c42516f0cb78bdfab2
2023-06-15fix(tests): Hoststack 2n-xyzpmikus1-6/+19
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I85de04e4a0ed1a642c40c8ca6840cbc1977b10be
2023-05-31"fix(test): Hoststack"Peter Mikus1-2/+0
Change-Id: I6ec27d787b59d4bc13b8c04f4217302cc3021581 Signed-off-by: pmikus <peter.mikus@protonmail.ch>