aboutsummaryrefslogtreecommitdiffstats
path: root/resources/libraries
AgeCommit message (Collapse)AuthorFilesLines
2023-10-19fix(model): bump schema version for new MLRVratko Polak1-1/+1
Change-Id: I35230692241a5f54420ece3340530f6c608828bb Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2023-10-19feat(MLRseach): Update to v8 conditional throughputVratko Polak6-31/+78
Hopefully, with CSIT config values, PDR lower than NDR will not happen. + Bump duration_sum default to an odd number, so users are not surprised by not seeing standard median behavior. For CSIT this should not matter, overheads hide ties and number of trials (at least for STL) should stay the same. Change-Id: Id7130f978c31e71227499612424007c473bcfac2 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2023-10-18feat(MLRsearch): MLRsearch v7Vratko Polak51-1463/+4444
Replaces MLRv2, suitable for "big bang" upgrade across CSIT. PyPI metadata updated only partially (full edits will come separately). Pylint wants less complexity, but the differences are only minor. + Use the same (new CSIT) defaults everywhere, also in Python library. + Update also PLRsearch to use the new result class. + Make upper bound optional in UTI. + Fix ASTF approximate duration detection. + Do not keep approximated_receive_rate (for MRR) in result structure. Change-Id: I03406f32d5c93f56b527cb3f93791b61955dfd74 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2023-10-13fix(pylint): Minor warningspmikus6-19/+15
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: Id646ab09ae51d3153446f1ae334f62ba7710be14
2023-10-13fix(pylint): DUTSetuppmikus1-6/+4
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: Ibe13acbd104e780f42e104755db026dcdd478f62
2023-10-13feat(core): Multilink TRex ASTF Async modepmikus1-8/+8
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: I9e4eac451578c0f6b86b1dde237512184c163def
2023-10-12feat(core): Multilink TRex Sync mode I.pmikus2-16/+15
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: I9f579385299e69e4d5679ed451ae0b4c30406733
2023-10-12fix(core): Multilink TRex Async modepmikus1-1/+1
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I8635e5731260bf0daecf87c852bc2dfb867fe650
2023-10-11feat(core): Multilink TRex Async modepmikus1-11/+7
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I02468203f3eb4545b6662bad2ce9aa72ecd5a5f6
2023-10-09feat(trex): Multilinkpmikus4-30/+54
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: I36c5d175a34555ad9ce88d69a824f366b54dbc81
2023-10-09Model: Add bandwidth to mrrTibor Frank3-117/+127
Change-Id: I4277f23d94fa191890041bb43e2fcd4eb5e42019 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2023-09-22fix(core): IP neighboroper-230925pmikus1-1/+1
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: Id72bbee0f5623f82cb097a5169c60fda3584d83e
2023-09-22fix(core): TRex self loop testspmikus2-2/+2
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I8945daffd500f689b3eb630f1ce7e1dc4f05aca8
2023-09-21fix(core): AWS BPS limitpmikus1-1/+1
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I684be7f41772b96d918b5f009d2052139f7219cf
2023-09-21fix(core): String mappingpmikus1-1/+1
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I4db3fc1b70469a966e51afe3bfa93cb4bcffa654
2023-09-21feat(core): Multilink backendpmikus5-122/+155
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I8d168979ab9722e0056e97edb228f29cbfa245e3
2023-09-20feat(infra): update 3n-alt ipsec testsJuraj Linkeš1-0/+2
Remove 4 tunnel flow cache test cases, as those don't benefit from flow cache much. Add mrr ipsec test cases for the XL710 Intel NIC to increase coverage. Don't add ndrpdr for XL710, only add commented out counterparts to align with the mrr list. Also modify the existing flow cache configuration by adding the fast path config as well. These are independent features, but the fast path code added this dependency. Change-Id: Ide88fd8c1abe96c577a86925dcc2dc4e63f897d4 Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2023-09-14Add IPsec and wireguard hwasync test cases to 3nb-spr job specsxinfeng zhao1-3/+0
Also add IPsec 10000tnlhwasync int mode and 4tnlhwasync policy mode test suites, in order to compare sw crypto and QAT crypto and IPsec int mode and policy mode performance. Signed-off-by: Yulong Pei <yulong.pei@intel.com> Signed-off-by: xinfeng zhao <xinfengx.zhao@intel.com> Change-Id: I0aed06a0c75c1a545720649d3561a0aa5a861db2
2023-09-12feat(core): 1n_spr swap interfacespmikus1-1/+1
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: Icf68d2f244432f49f6b8fb0876807d694a1e8e31
2023-09-12fix(core): 1n_sprpmikus1-3/+3
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: Ia8067fb1683295fb711bbba81a35b0e6d18b084f
2023-09-11fix(core): 1n_sprpmikus1-1/+1
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I38aeb3d75793addafb44f407fabf6bac6705b682
2023-09-08feat(perpatch): parse results from jsonVratko Polak2-240/+2
+ Use test names in output. - Methodology updated in subsequent change. Change-Id: I6a62f87249ea79262778f68d00f9bb81134f0b02 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2023-09-08feat(cleanup): Some old codepmikus6-308/+2
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I3aad4fc5a56a1c02e975f664449a6f9d50fc300e
2023-09-08feat(infra): Add 1n_sprpmikus2-4/+16
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I20e720302561f5f7d1f7a80a83548077a88025af
2023-09-04fix(hoststack): hardcode DUT1 for nginxVratko Polak1-17/+17
Previously, the Set up LDP or VCL Nginx on DUT node keyword was wrongly documenting its "dut" argument as type string, while using the value as a node dict instead. As most of the code already used direct dut1 variables, this patch eliminates the dut argument altogether and puts DUT1 into the keyword name. Change-Id: Ie29afc175b98c1b1cb554438da9178738662d108 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2023-09-04fix(bootstrap): move archives before cleanupVratko Polak1-1/+1
If cleanup fails, we still want to examine robot logs for any hints of why a node may have stopped working properly. Bootstrapt scripts for device tests are doing that already, so this patch only edits the perf verify bootstrap script. Change-Id: I8b8ad7bcbbbbc26874068efe1b20e8053f0d5650 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2023-08-18fix(core): AVF init problemoper-230821pmikus1-1/+1
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I67eac5f0e68e9e84041816a8a6e6b8df3fdff664
2023-08-17feat(swasync): switch to polling modeVratko Polak3-21/+40
Performance of adaptive mode is bad (different bug), keep continuity of ipsec swasync tests (when VPP allows). As 23.06-release does not have the new API message, the new CSIT code needs to be more careful around CRC checking. + Add new crc collection with the new API call used. + Also keep the old collection so older VPP does not fail. + Document how papi executor works with VPP without a message. + Prevent CRC checker from raising bodus errors with old VPP. Change-Id: I9ff933a8a9558289d22d55526905d63e7894378c Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2023-08-17Add ability to parse more kinds of test resultsVratko Polak3-26/+209
Previously, only BMRR results were recongnized. Now also lower bounds for PDR (optionally NDR) and soak are recongnized. This code expects all tests are of the same type, e.g. when both MRR and NDRPDR tests are run, only MRR result will get parsed. If test or parsing fails, generate fake data based on overall pass or fail, so at least passrate of unknown tests can be compared in theory. Currently affects only per-patch job (vpp-csit-verify-perf-*), but is useful mainly for the upcoming bisect job. + Do not force MRR test type in vpp-csit jobs. - Some test results are still not recognized (e.g. hoststack). + Do not exit per-patch job early on robot failure. + Only changes that introduce a failure (not present in parent) get -1. + The same is true also for introducing unrecognized test results. - The fake values from passrate can be misleading. + Add default nic tag only if NIC tag is missing. + In all jobs, not only in vpp-csit ones. + Do not add NIC tags for device jobs. - No job supports NDR parsing yet. + Can be enabled in future from ci-management side. Change-Id: Iee904116d1ffed69aec7e31821c67d8447f49ebe Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2023-08-17feat(ansible): Bump DPDK 23.07pmikus1-1/+1
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: Ieb1576aa45e689dda8358c4ad4708b3b09b5216c
2023-08-17fix(core): Variables for GSOpmikus1-4/+4
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I6768f65551deb335ba7b9fc07bca164bca9381fe
2023-08-15fix(core): Pylint leftoverspmikus2-3/+3
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I8d3e93f61ba7929b79da386fbfcece992fea7324
2023-08-15GSO: Add export of results to json files.Tibor Frank3-2/+9
Change-Id: Iac742f0571b11e06662af6bf1b680d0b4e196ddd Signed-off-by: Tibor Frank <tifrank@cisco.com>
2023-08-11feat(core): QAT initialization refactorpmikus5-109/+48
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: Idc91da55ab0b5c6b8eb53e8b4ce4da18a1ae891c
2023-08-07fix(core): Disable core dbg analysispmikus1-4/+5
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: Ia85c4a48155c1e760120a61b39bacbb9de1ab673
2023-08-04fix(core): QAT VF bindpmikus2-12/+16
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: Iafae1a1f538b928d3bb80bf9610a0bf7de646f8a
2023-07-27fix(core): QAT initializationpmikus5-86/+108
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I28af64b7d39a97bbb84f9d987a3f5d3a2d02701b
2023-07-27feat(core): Core allocationpmikus9-122/+146
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I782b87190dbee6e0a12c97f616b80539cd6614bd
2023-07-17feat(crc): print warnings in crc checker scriptVratko Polak1-1/+16
Robot already prints warnings when running tests, but not many people are looking at robot console output. This makes the warnings visible also in VPP API CRC job console log. Change-Id: I9044a2970f46e132ec80ae0faa2e0adacc889447 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2023-07-14feat(crc): bump messages for cycle after 2306Vratko Polak2-9/+17
The supported VPP code is 380c62d7040bf285d449f1d05692141c40089470 which is the latest commit before stable/2306 diverged from master. + Separate messages into blocks with paths to .api sources. + Prepare memif for use_dma (currently always false). + Use srv6 test teardown action in srv6 device tests. - Do not use sr_policy_add_v2 from 37258 yet. - Leave a TODO to do it eventually, for now inputs are too different. - Do not use index based policer calls from 37873. - The policer_add_del is not deprecated yet and inputs are different. Change-Id: I350138f09542ec12ce4bec140203175940ccf9d4 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2023-07-14fix(packer): Namingpmikus1-3/+3
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I8127beeb6664aa51ef5cb313d658ab2e5638b581
2023-07-14feat(aws): Add new flavorspmikus2-3/+116
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: Ie63b3d6c7ff376d808587e7c96f386946c939a81
2023-07-14fix(jumpavg): penalize stdev also for size=2Vratko Polak1-4/+7
This fix is mainly needed for bisection using PDR values. The impact on trending is smaller but still beneficial, as this fix should reduce the amount of false anomalies for two-band and other unstable tests. + Update metadata for 0.4.1 release into PyPI. Change-Id: Iabab4df50f4c4ad034362820904a237c507fa710 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2023-07-07fix(core): Remove output_info.xml processingoper-230710pmikus7-64/+42
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I1528d7760228d50a4d89c0e413ad86aa882088ed
2023-06-21feat(infra): update 3n-alt cx6 iterative testsJuraj Linkeš1-0/+8
Add ipsec reassembly test cases to bring in line with 3n-icx. Add ipsec policy test cases with flow cache enabled for both inbound and outbound traffic. Remove GTPU hardware tests as the NIC doesn't support GTPU offload RX. Change-Id: I7b18914f983d5974b390f995ec638a64b9bbccbb Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2023-06-20fix(core): Altra issues with mlxpmikus1-1/+1
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: Iad8e468200df4ab77f4ed44010b1b029e840714f
2023-06-16Add cryptodev device 4xxxYulong Pei4-4/+11
QAT_4xxx is integrated QAT device on SPR platform. Signed-off-by: xinfeng zhao <xinfengx.zhao@intel.com> Signed-off-by: Yulong Pei <yulong.pei@intel.com> Change-Id: If1d4b3d72a2c66855ac8c1c42516f0cb78bdfab2
2023-06-15fix(tests): Hoststack 2n-xyzpmikus1-6/+19
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I85de04e4a0ed1a642c40c8ca6840cbc1977b10be
2023-06-15fix(core): hard vpp killpmikus1-1/+1
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: Ie99c70ebda54153eb361954cbbd4f8191454a022
2023-06-12feat(infra): Add Mellanox CX6 to 3n-icxpmikus1-1/+1
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: Ic13b8cd3f2976c66d8956f0cee0784c3bae12a65