aboutsummaryrefslogtreecommitdiffstats
path: root/resources/libraries/bash
AgeCommit message (Collapse)AuthorFilesLines
2021-12-15UTI: Export resultsVratko Polak2-2/+31
+ Model version 1.0.0. - Only some result types are exported. + MRR, NDRPDR and SOAK. - Other result types to be added later. + In contrast, all test types are detected. + Convert custom classes to JSON-serializable equivalents. + Sort dict keys before converting to JSON. + Override the order for some known keys. + Export sets as sorted arrays. + Convert to info content from serialized raw content. + Also export outputs for suite setups and teardowns. + Info files for setup/teardown exist only temporarily. + The data is merged into suite.info.json file. + This simplifies presentation of total suite duration. + Define model via JSON schema: - Just test case, suite setup/teardown/suite to be added later. - Just info, raw to be added later. + Proper descriptions. + Json is generated from yaml. + This is a convenience for maintainers. + The officially used schema is the .json one. + TODOs written into a separate .txt file. + Validate exported instance against the schema. + Include format checking. + Update CSIT requirements for validation dependencies. + This needs python-dateutil==2.8.2, only a patch bump. + Compute bandwidth also for soak tests. + This unifies with NDRPDR to simplify schema definition. - PAL may need an update for parsing soak test message. + Include SSH log items, raw output only. + Generate all outputs in a single filesystem tree. + Move raw outputs into test_output_raw.tar.xz. + Rename existing tar with suites to generated_robot_files.tar.xz. Change-Id: I69ff7b330ed1a14dc435fd0ef008e753c0d7f78c Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-12-15Tox: Add checker for CSIT model versionVratko Polak1-0/+65
+ Implementation stub so checker can check already. + Also add documentation stub for the implemented model. + Checker checks also for bumps in documentation version. - Not comparing implementation and documentation version yet. Change-Id: I4d19c00315a1c171de325c4494c28f5210635f32 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-12-13doc: fixing documentation structureViliam Luc1-0/+3
When building documentation using sphinx we see ~1200 similar warnings [0] [0] - https://s3-logs.fd.io/vex-yul-rot-jenkins-1/csit-verify-tox-master-ubuntu2004-x86_64/3289/doc_verify.log.gz These warning are harmless and can be fixed later Signed-off-by: Viliam Luc <vluc@cisco.com> Change-Id: I1ac1099d38935971d47491dde905715345d3935c
2021-11-10Fix autogen.sh checkerVratko Polak1-2/+2
Previously, the FAIL message was not printed. Change-Id: Id3fc6c126edd42b55cec73294696a0426a73d634 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-11-08vpp_device: bind to vfio-pci before running testsJuraj Linkeš1-15/+101
In rare cases, binding the whole /dev/vfio folder will result in unusable VFs: notice dpdk EAL: Cannot open /dev/vfio/151: Device or resource busy [0], section 4.3.1. provides some clues as to what's going on and how to avoid the failure. Mounting /dev/vfio reset the file descriptors of all devices under /dev/vfio. Vfio-pci creates a device when an interface is bound to it. The rare failure then occurs when /dev/vfio is mounted while a process is using the file descriptors result in that process using invalid file descriptors (or file descriptors belonging to a different VF). Fix the issue by binding i40e and ice VFs to vfio-pci before containers are created and make sure that the VFs are not unbound later in testing. Only bind DUT VFs since the TG uses the kernel driver. [0]: https://connect.redhat.com/sites/default/files/2021-03/Cloud Native Network Function Requirements.pdf Ticket: CSIT-1794 Change-Id: I83db91b29d16669fb034b141ad247f6f796fdf64 Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2021-10-20fix(Terraform): Change AWS AZpmikus2-0/+4
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I19c160e40e01bd7f69c08188f61d2bcbc3fd4bcb (cherry picked from commit 8be983ad917cd47fa8da4256fa8ada14ecfcd425)
2021-10-20doc gen: fix doc generatorViliam Luc1-13/+9
Change-Id: I75e836ce728fd333764f17d69813093cb947ef4f Signed-off-by: Viliam Luc <vluc@cisco.com>
2021-10-08Add flow test suitesxinfeng zhao1-0/+4
The comms DDP package needs to be installed to support all flow protocols Signed-off-by: xinfeng zhao <xinfengx.zhao@intel.com> Change-Id: I6ab1bd8beb9edb8c9889a0ed9a999080ca3cef3d
2021-10-06Bash: Process job-specs without cores and driversTibor Frank1-1/+3
- job-spec for trex tests modified Change-Id: Id04d76648f30baacfa027b182a838d2f681afcec Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-09-22fix Device: Cleanup previous interfacespmikus1-2/+2
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I62deca750d4494427d2ea1916e0678c06dad7533
2021-09-10back-to-back tests: add TG testsViliam Luc1-0/+14
Change-Id: I9d028294deb1e31b6d185deb1c7523e0226a0ada Signed-off-by: Viliam Luc <vluc@cisco.com>
2021-09-07Terraform: Add job name as VPC IDpmikus1-0/+3
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I82819c924012c966ba91fdf39ffba500ee0ce6b0
2021-08-30Infra: vpp_device NICspmikus1-2/+4
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I06d4012552eee918ae29e0bd789d3d316840ad4a
2021-08-24Fix vpp-csit device jobVratko Polak2-9/+12
It uses different bootstrap than csit-vpp. Just cherry-pick the edits from https://gerrit.fd.io/r/c/csit/+/33513/15/resources/libraries/bash/entry/bootstrap_vpp_device.sh + Match just *device* when reading testplan. + Do not prepend MRR for vpp device jobs. Change-Id: I13e171551ebc87af0ac3e3a1a1bcfae7cad8326c Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-08-23DPDK bump to v21.05 and c_args fixJuraj Linkeš1-1/+2
Fixes: c849edfc256d ("DPDK build: fix l3fwd build and update Meson opts") Change-Id: I4b50a8f3cdc5aa4bd20ce99d477fdaf1087fcac3 Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2021-08-23FIX: Docs generationpmikus2-38/+47
+ Tests will be fixed with renamed hoststack tests. + Tox is at least working Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: Ibee30cd54c78b67d2ef907cdd14a71ae197be59e
2021-08-23DPDK build: fix l3fwd build and update Meson optsJuraj Linkeš2-12/+11
Fix l3fwd patch which broke because the code got moved. Rework two Meson options: * RTE_LIBRTE_I40E_16BYTE_RX_DESC using Meson option c_args instead of CFLAGS. According to Meson docs, using c_args is the proper way to pass C compiler arguments and the support for CFLAGS is there for legacy reasons and not guaranteed to work. * Add platform=generic which mirrors VPP configuration. This removes the need to hack Arm CPU and NUMA values as the generic build uses high enough values. Change-Id: Ibcb17879bdf26329881819c332c1782b9c713182 Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2021-08-20Move tc_naming to generic placepmikus1-0/+0
+ Mental excercise Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I40ca8e4ded9c898b9435bf00b8b16983143ed7c9
2021-08-20Tox: Remove obsolete checkerspmikus1-100/+0
+ coverage is not used + naming is now covered fully by suitegen which can be improved to do detections of packet encapsulations Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I9631988e144d3878a6b146214e3aea75694ebf3f
2021-08-19vpp_device: Multiple NICs (suitegen)pmikus4-68/+18
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I81958fbf6ef240d53a0fb8708ca882baf02f606c
2021-08-19Migrate report/trending/docs to bash frameworkpmikus4-0/+349
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: Idf8462f15a2dd76b42dcaea9df6a0fc15a45503f
2021-08-19vpp_device: Multiple NICs (infra)pmikus2-48/+139
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: Ie8662b6a485374b5df68dec9c82065cf59f28c8f
2021-08-11Infra: Add terraform no-color output.pmikus1-2/+2
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I851e979c9b0db41c83facb92010c1b16885ee5a0
2021-08-09FIX: Terraform installationpmikus1-2/+4
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I2963520237c0bcc30836df3722a945060bd438d3
2021-08-09FIX: Terraform installpmikus1-0/+2
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I1bc29338bf677c5777474ea07954df4ca0ed0a31
2021-08-09Infra: Install terraformpmikus1-1/+3
+ Unless docker images gets updated Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I9d09b24ca7bef71dad5774ae2b5e2e67e7b8f285
2021-08-06Verify tags: Use suite tagsVratko Polak1-5/+5
When I make a typo in GERRIT_EVENT, old code starts many ASTF tests. Change-Id: Iac1c2cc620919d33b0e77bd28b145f3fd38d28ff Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-07-27FIX: Executable bit for ansible pluginpmikus1-3/+5
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I2416a9682710441d098acfff50e943ac3f788500
2021-07-26Infra: Terraform add ansible plugin initpmikus1-0/+10
+ Manual override Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: If296d28dc3eaa023c935a0887a14ac10e83076ba
2021-07-19Report: Add rls dataTibor Frank1-0/+1
Change-Id: I9c81563c904b02c5ca6ede5dc3d0922851c11ae4 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-07-13job-spec: Add hoststack and vsapTibor Frank1-0/+1
+ hoststack + vsap (cps, rps) + add e810cq to common.sh Change-Id: I2e897597d13e488f7324a7b91826ca32fd93c84f Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-07-12Tox: Move logs to archive also on -1Vratko Polak1-3/+4
Change-Id: Id29925da9c8e0bc0a28a9f4d38c332852c687317 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-07-09CI-MAN: Unify backupspmikus1-0/+6
+ tox must follow the $WORKSPACE/archives rule Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I717afded894c3a5468bbf5013b242be5e1a9cb6e
2021-07-08Infra: AWS Jenkins Integrationpmikus3-31/+144
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I5910ce0701f865403aa772c7ad5d8eb126c6ec2c
2021-06-16Line length: Fix recent mergesVratko Polak7-27/+43
Not fixing .rst, .md, .yaml, conf.py, .vat, and so on. Change-Id: Icc585d6dbebc8eb5c483b10326302571e94c614d Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-06-10FIX: Pylint reducepmikus26-29/+29
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I909942dbb920df7f0fe15c0c92cda92c3cd8d8ad
2021-06-10Infra: vpp_device -> Ubuntu 20.04pmikus1-2/+4
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: If24c385b93e1ba310ea258984c97494b4cab467c
2021-06-01Tox: Run pylint also for GPLVratko Polak1-2/+2
Change-Id: Ic6c5d35dc602638b06962fcad30d8517c9553552 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-05-20perf: add TCP Nginx+LDPRELOAD suitesxizhanx3-3/+177
1. Suite steup add download nginx 2. Add nginx-1.14.2/1.15.0 ldp test suite 3. Add NginxUtils,NginxConfigGenerator method 4. Taskset the PID of nginx to the unused cores in VPP and these cores are under NIC's NUMA ID 5. cleanup add Kill Processes - nohup Signed-off-by: xizhanx <xix.zhang@intel.com> Change-Id: Idbf0e4ec3bf63e88281a8e3e34f52e00a6801c85 Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
2021-04-27Infra: AWS - add CSIT parameters to bootstrapTomas Alexy3-2/+29
Signed-off-by: Tomas Alexy <tomas.alexy@pantheon.tech> Change-Id: I41b5905bcaab303a74d9985283e469922e5fba94
2021-04-20tox: Add job-spec checkerTibor Frank1-0/+60
Change-Id: I2bbdc28431b6271d1950ec0e74bf708cae841146 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-04-15common.sh - fix 3n AWS topology tag selectionTomas Alexy1-2/+2
Signed-off-by: Tomas Alexy <tomas.alexy@pantheon.tech> Change-Id: Ic6dd4a14887d572487d7d4efcca8a437cf140ca9
2021-04-14Infra: common.sh - add ENA 50g NICTomas Alexy1-0/+1
Signed-off-by: Tomas Alexy <tomas.alexy@pantheon.tech> Change-Id: Idc672f6086ab9d4ad38b52947a52c667d0908d8f
2021-04-12Infra: AWS bootstrap integrationTomas Alexy2-3/+45
Signed-off-by: Tomas Alexy <tomas.alexy@pantheon.tech> Change-Id: I254c79201a198ee054851c934167a24e9e8803cb
2021-04-08Ansible git movepmikus1-4/+4
+ Better accessibility + Compliant with fdio.infra._function_ - function [pxe|terraform|ansible|vagrant] + dill==0.3.3 also applied on TBs - ci-man to follow today - Docs to be updated in separate patch Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: Iff9eaa29d63044188cc8160db2d9b44b7635782a
2021-04-06DPDK buid: Fix sed commandVratko Polak1-1/+1
The previous way of concatenating strings would not work even in Python. Change-Id: Ice06f4a06fefbc4e42ee2572786244207dfefa11 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-03-29FIX: VPP version file name based on OSpmikus1-13/+13
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: Icab8b87498e8487268857bb04c5ba7069d9297e3
2021-03-26ansible: update TX2 VPP Device hugepages and ifsJuraj Linkeš1-8/+2
These interfaces are not used, so remove them until we actually use them. Use less amount of hugepages since we don't need as much and the rest of the memory is more useful for build/host processes. Change-Id: I52b2d6e2812e5cadeab9e51a1bae3688794f414a Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2021-03-23Infra: fix NUMA count in Arm DPDK buildJuraj Linkeš1-3/+6
The default NUMA value for Taishan build is insufficient and results in failed test runs. Fix by increasing the amount to what's on the device. Change-Id: Ia7c761e81ee9063d7129472d9caa8cebbbb7e1cf Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2021-03-20Tox: Increase verbosityVratko Polak1-2/+3
CSIT is becoming stricter in avoiding downloads during run, as everything should be pre-cached in executor image. This change makes it easier for human to detect downloads. Change-Id: If7085f96ef1033f7f9405a86232a3d39a239d3e1 Signed-off-by: Vratko Polak <vrpolak@cisco.com>