aboutsummaryrefslogtreecommitdiffstats
path: root/resources/libraries
AgeCommit message (Collapse)AuthorFilesLines
2021-12-22add 2-node ipsec hwasync casesxinfeng zhao1-1/+0
Signed-off-by: xinfeng zhao <xinfengx.zhao@intel.com> Change-Id: I1590d438216e4c886aae03f83364837153623dbc
2021-12-21feat(infra): DPDK 21.11pmikus1-1/+1
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: Ib52fab112d458decfecf39c77085bcd85f811eba
2021-12-15fix(dpdk): allowpmikus1-2/+2
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: Ic7f24767b60eef5ddb7cdf5f933d82930c625f5c
2021-12-15UTI: Export resultsVratko Polak21-41/+1356
+ Model version 1.0.0. - Only some result types are exported. + MRR, NDRPDR and SOAK. - Other result types to be added later. + In contrast, all test types are detected. + Convert custom classes to JSON-serializable equivalents. + Sort dict keys before converting to JSON. + Override the order for some known keys. + Export sets as sorted arrays. + Convert to info content from serialized raw content. + Also export outputs for suite setups and teardowns. + Info files for setup/teardown exist only temporarily. + The data is merged into suite.info.json file. + This simplifies presentation of total suite duration. + Define model via JSON schema: - Just test case, suite setup/teardown/suite to be added later. - Just info, raw to be added later. + Proper descriptions. + Json is generated from yaml. + This is a convenience for maintainers. + The officially used schema is the .json one. + TODOs written into a separate .txt file. + Validate exported instance against the schema. + Include format checking. + Update CSIT requirements for validation dependencies. + This needs python-dateutil==2.8.2, only a patch bump. + Compute bandwidth also for soak tests. + This unifies with NDRPDR to simplify schema definition. - PAL may need an update for parsing soak test message. + Include SSH log items, raw output only. + Generate all outputs in a single filesystem tree. + Move raw outputs into test_output_raw.tar.xz. + Rename existing tar with suites to generated_robot_files.tar.xz. Change-Id: I69ff7b330ed1a14dc435fd0ef008e753c0d7f78c Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-12-15Tox: Add checker for CSIT model versionVratko Polak3-0/+84
+ Implementation stub so checker can check already. + Also add documentation stub for the implemented model. + Checker checks also for bumps in documentation version. - Not comparing implementation and documentation version yet. Change-Id: I4d19c00315a1c171de325c4494c28f5210635f32 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-12-13doc: fixing documentation structureViliam Luc2-16/+20
When building documentation using sphinx we see ~1200 similar warnings [0] [0] - https://s3-logs.fd.io/vex-yul-rot-jenkins-1/csit-verify-tox-master-ubuntu2004-x86_64/3289/doc_verify.log.gz These warning are harmless and can be fixed later Signed-off-by: Viliam Luc <vluc@cisco.com> Change-Id: I1ac1099d38935971d47491dde905715345d3935c
2021-12-06PLRsearch: Update docscringsVratko Polak1-3/+11
Previous code changes updated code comments, but not docstring. Change-Id: I5be3fd07620cc97c9088efceb72c2f68ab103915 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-12-01feat(Performance): Add 2M/1G hugepagespmikus8-55/+48
+ Add ability to switch between hugepages. Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I84d8eae28ed414a32e5ba82e6c9ed10d7f0ef9cb
2021-11-25PAPI: Include more details in PAPI fail messageVratko Polak1-3/+4
This helps to distinguish different symptoms for PAL failure alerting. Change-Id: Idd8e8f4b427641fa055516bdf17715f6b967ca72 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-11-10Fix autogen.sh checkerVratko Polak1-2/+2
Previously, the FAIL message was not printed. Change-Id: Id3fc6c126edd42b55cec73294696a0426a73d634 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-11-08vpp_device: bind to vfio-pci before running testsJuraj Linkeš3-19/+111
In rare cases, binding the whole /dev/vfio folder will result in unusable VFs: notice dpdk EAL: Cannot open /dev/vfio/151: Device or resource busy [0], section 4.3.1. provides some clues as to what's going on and how to avoid the failure. Mounting /dev/vfio reset the file descriptors of all devices under /dev/vfio. Vfio-pci creates a device when an interface is bound to it. The rare failure then occurs when /dev/vfio is mounted while a process is using the file descriptors result in that process using invalid file descriptors (or file descriptors belonging to a different VF). Fix the issue by binding i40e and ice VFs to vfio-pci before containers are created and make sure that the VFs are not unbound later in testing. Only bind DUT VFs since the TG uses the kernel driver. [0]: https://connect.redhat.com/sites/default/files/2021-03/Cloud Native Network Function Requirements.pdf Ticket: CSIT-1794 Change-Id: I83db91b29d16669fb034b141ad247f6f796fdf64 Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2021-11-02fix(autogen): VSAP testcase namingpmikus1-0/+1
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: Ic6d440ffdf7e27c9e6ce65605178163652758f77
2021-10-28fix(Autogen): VSAP driver combinationspmikus1-8/+39
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: Ieac8cd32009bebbd1a3324a81becfbf3abb814ab
2021-10-25IPsec: add nth SPD entry outbound flow cache TCsJuraj Linkeš2-0/+12
Add 1, 10, 100 and 1000 SPD entries using IPv4 outbound flow cache optimization. Change-Id: I7abb65a82454c17ef754cb11386186610f0c27e8 Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2021-10-20fix(Terraform): Change AWS AZpmikus2-0/+4
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I19c160e40e01bd7f69c08188f61d2bcbc3fd4bcb (cherry picked from commit 8be983ad917cd47fa8da4256fa8ada14ecfcd425)
2021-10-20doc gen: fix doc generatorViliam Luc1-13/+9
Change-Id: I75e836ce728fd333764f17d69813093cb947ef4f Signed-off-by: Viliam Luc <vluc@cisco.com>
2021-10-18fix(flow): Move import back to functionspmikus1-2/+28
+ This makes a problem. It would be better to have ENUMS in code as everywhere else Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I90f8e7c0177cb6a76eef5d4444f0ec22f57236c4
2021-10-13DUTSetup: FIX Format symbolxizhanx1-2/+2
Signed-off-by: xizhanx <xix.zhang@intel.com> Change-Id: Ic6ccc206632023297d35d0020397e8fd5706ea1c
2021-10-08fix(Pylint): Small fixespmikus7-41/+25
+ Just few obvious one Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I9bbac293a56d6b2943bef03cb3b8943e967dae6b
2021-10-08Add flow test suitesxinfeng zhao5-3/+642
The comms DDP package needs to be installed to support all flow protocols Signed-off-by: xinfeng zhao <xinfengx.zhao@intel.com> Change-Id: I6ab1bd8beb9edb8c9889a0ed9a999080ca3cef3d
2021-10-06docstring: Docstring warnings fixed.Viliam Luc10-29/+29
Change-Id: I8679c819b7c6ecd9e680bdc6edeafd2124def0b5 Signed-off-by: Viliam Luc <vluc@cisco.com>
2021-10-06Fix: Do not touch PAPI history on bad DICT__nodesVratko Polak1-1/+6
Usually, DICT__nodes is populated from reserved topology yaml. But is some cases (doc generation, maybe pylint) there is no yaml. The proper fix is to never execute any business logic just when a module is imported. This is just a quick workaround. Ticket: CSIT-1793 Change-Id: I6d7250dc75d12baf120758ade8730af89431265a Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-10-06Bash: Process job-specs without cores and driversTibor Frank1-1/+3
- job-spec for trex tests modified Change-Id: Id04d76648f30baacfa027b182a838d2f681afcec Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-10-04FIX: Set correct teardown rate in NDRPDRVratko Polak1-1/+1
It should be in transactions per second, so target rate (min rate). Change-Id: I56a12d65466320fe5e4b2ee7d3b9946c9b3c414f Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-09-29feat(DPDK): Bump payload version to 21.08pmikus1-1/+1
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: Ic249493a39faa8f429ae4fa1de644d74d874151b
2021-09-29MLRsearch: Increase timeout to 20 minutesVratko Polak2-3/+3
There are sporadic failures due to timeout. An earlier edit changed how the timeout is applied (now it is for the whole search, previously it was for final phase only) so failures are not unexpected. Increasing timeout value from 12 minutes to 20 minutes (both for NDRPDR and for NDR part of RECONF) as the frequency shows it will not prolong runs much. The timeout is increased both in Robot call site and in Python keyword default argument. Change-Id: I3f07125ba9eeb90ce5819b1450044441b8b3977a Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-09-28fix(Core): Interface not recognizedpmikus1-0/+4
+ Make better error message. Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I2dbb9a50215bd6665c5c278653edd9324314e6b8
2021-09-28fix(DPDK): Increase install timeoutpmikus1-1/+1
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: Ib87e173daba3315c51794a12e22f7961a5709699
2021-09-22fix Device: Cleanup previous interfacespmikus1-2/+2
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I62deca750d4494427d2ea1916e0678c06dad7533
2021-09-20API: Remove old_cmd supportVratko Polak2-17/+4
Master branch is no longer expected to work with such old VPP builds, and CRC values were removed already anyway. Change-Id: I707a61bc82d7d8998100fcd9fe78b90e7b074675 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-09-17Performance keywords: Use matching runtime rateVratko Polak1-0/+1
Previously, runtime rate was not modified, so max rate was always used, even in ndrpdr with two stats trials. Now, each call to "Send traffic at specified rate" keyword sets the given rate as runtime rate. Change-Id: I3eb41eeadd6b64d23056c67c23a25f9565bb0424 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-09-14back-to-back: add tg n2n suitesViliam Luc1-4/+16
Change-Id: I911e121475221fbf5449ed49dc6236caf13742b0 Signed-off-by: Viliam Luc <vluc@cisco.com>
2021-09-14API: Use newer message versionsVratko Polak4-37/+50
Based on latest common ancestor of master and stable/2106: 1372178e0e674143bfec14b17050d5e92e4fcf1a Only ipsec_sad_entry_add_del_v3 needs non-trivial argument edits. Change-Id: I813367292a830e5a1fac765e9f24057b6b0192ee Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-09-10back-to-back tests: add TG testsViliam Luc6-29/+224
Change-Id: I9d028294deb1e31b6d185deb1c7523e0226a0ada Signed-off-by: Viliam Luc <vluc@cisco.com>
2021-09-07Terraform: Add job name as VPC IDpmikus1-0/+3
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I82819c924012c966ba91fdf39ffba500ee0ce6b0
2021-08-30Infra: vpp_device NICspmikus1-2/+4
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I06d4012552eee918ae29e0bd789d3d316840ad4a
2021-08-24Fix vpp-csit device jobVratko Polak2-9/+12
It uses different bootstrap than csit-vpp. Just cherry-pick the edits from https://gerrit.fd.io/r/c/csit/+/33513/15/resources/libraries/bash/entry/bootstrap_vpp_device.sh + Match just *device* when reading testplan. + Do not prepend MRR for vpp device jobs. Change-Id: I13e171551ebc87af0ac3e3a1a1bcfae7cad8326c Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-08-24Telemetry: vpp devicepmikus2-30/+7
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I80efb278cf824dd8b1d38bb3ff3df43366e7295a
2021-08-24Fix DPDK nb_cores allocationpmikus4-43/+27
+ Migrate the call to main python util Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I8d00165071d4764121740c1c77819b8ffc65b3ba
2021-08-23DPDK bump to v21.05 and c_args fixJuraj Linkeš1-1/+2
Fixes: c849edfc256d ("DPDK build: fix l3fwd build and update Meson opts") Change-Id: I4b50a8f3cdc5aa4bd20ce99d477fdaf1087fcac3 Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2021-08-23FIX: Docs generationpmikus2-38/+47
+ Tests will be fixed with renamed hoststack tests. + Tox is at least working Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: Ibee30cd54c78b67d2ef907cdd14a71ae197be59e
2021-08-23DPDK build: fix l3fwd build and update Meson optsJuraj Linkeš2-12/+11
Fix l3fwd patch which broke because the code got moved. Rework two Meson options: * RTE_LIBRTE_I40E_16BYTE_RX_DESC using Meson option c_args instead of CFLAGS. According to Meson docs, using c_args is the proper way to pass C compiler arguments and the support for CFLAGS is there for legacy reasons and not guaranteed to work. * Add platform=generic which mirrors VPP configuration. This removes the need to hack Arm CPU and NUMA values as the generic build uses high enough values. Change-Id: Ibcb17879bdf26329881819c332c1782b9c713182 Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2021-08-20Scale tests: Use exec commands and VAT executorVratko Polak2-35/+75
This is the same appoach as in ipsec tests. This is the fastest way to fix scale tests. - Some argument combinations are not supported, e.g. multipath=False. + Make multipath=True default. - Devicetest using local=True only works with PAPI. + But that was true already in rls2106, so no need to fix here. + Add two more formats to NetworkIncrement. + Check address is aligned, unless call side disables that. + Only one keyword for two devicetests disables the check. + Papi history condition to print first and last. + Minor docstring edits. Change-Id: I32d24e2f821b412b5841a50d2f87e1c86345b1aa Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-08-20Move tc_naming to generic placepmikus1-0/+0
+ Mental excercise Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I40ca8e4ded9c898b9435bf00b8b16983143ed7c9
2021-08-20Improve NetworkIncrementVratko Polak2-22/+38
+ Set 1 as default value for increment. + Update IPsecUtil. + Tolerate address with host bits set when incrementing. + Call sites can check initial value on their own. + Support multiple ways of converting to string. - Only the previous "dash" format is supported here. + Update docstrings. Change-Id: I0c71a6327cca6a319715b3fcfbbee800cac14287 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-08-20Tox: Remove obsolete checkerspmikus1-100/+0
+ coverage is not used + naming is now covered fully by suitegen which can be improved to do detections of packet encapsulations Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I9631988e144d3878a6b146214e3aea75694ebf3f
2021-08-19vpp_device: Multiple NICs (suitegen)pmikus6-68/+97
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I81958fbf6ef240d53a0fb8708ca882baf02f606c
2021-08-19Migrate report/trending/docs to bash frameworkpmikus4-0/+349
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: Idf8462f15a2dd76b42dcaea9df6a0fc15a45503f
2021-08-19vpp_device: Multiple NICs (infra)pmikus2-48/+139
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: Ie8662b6a485374b5df68dec9c82065cf59f28c8f
2021-08-11Infra: Add terraform no-color output.pmikus1-2/+2
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I851e979c9b0db41c83facb92010c1b16885ee5a0