aboutsummaryrefslogtreecommitdiffstats
path: root/resources/libraries/bash
AgeCommit message (Collapse)AuthorFilesLines
2019-04-24Move generate_tests earlier in entry scriptsVratko Polak4-8/+8
The idea is to run test generation and archivation before testbed reservation, as during generation and archivation the testbed can be used by another job. The two steps are moved just before (physical or docker) reservation, as they currently take considerable time, so simpler steps are kept before to save time if they fail. Coincidentally, it is also just after activate_virtualenv, Python is needed for test generation. Change-Id: I8b41b91dba8118e89301e3fcf89d5cd14ac054a2 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-04-17Increase reliability of per patch perf jobVratko Polak1-4/+8
CSIT-1485 - Measurement results are inconsistent, creating false positives. - To avoid false positives, sensitivity has to be lowered. + Measurements are no more interleaved. + Measurement result are no longer filtered. + The job now runs faster. - Ip6base regressions smaller than 4% are tolerated. + Ip6base false positives can happen, but less than 10% of the time. - Part of job parameters is set on ci-management level. + Voter script output is improved. Change-Id: I0ec7d5df8b397daf7ff0277a1137ee9f36d8d866 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-04-13Use package location for apt-cache show commandJan Gelety1-1/+3
Change-Id: I141baa77c78ec467a56fcafb86061efe198dca9d Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-04-15Remove obsolete QEMU installationPeter Mikus1-16/+0
+Unify QEMU parameter to Contants. Change-Id: I95adfc97dd7008c19e60ba3fa8668818b503bee8 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-04-15Add output.xml with only INFO logging levePeter Mikus1-0/+8
- Useful for post-processing. Change-Id: I6f71087f8c6f6d66fd86207d5df9abd10e94f855 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-04-09Add vagrant setup for testing VPP device locallyLudovit Mikula1-2/+2
Fixed trailing whitespaces Fixed tabs vs. spaces Removed dead code Changed network interface naming Changed default number of retries for VPP startup to 120 Updated number of hugepages during provisioning Externalized CSIT related sysctl settings to 90-csit.conf Removed hardcoded local docker image name. Added new interface required for honeycomb device testing. Change-Id: I5eb38c8b1a4d96e4220dbd2e202e94f1d47e804e Signed-off-by: Ludovit Mikula <ludovit.mikula@pantheon.tech>
2019-04-08Upgrade autogen to NICs and search typesVratko Polak11-146/+1604
+ All perf suites updated, as autogen change is backward incompatible. + Only x710 -ndrpdr suites remain in git repository. + Removed retry feature of run_tests. + Renamed topology_type and traffic_type to traffic_profile. + Renamed framesize to frame_size; nic_model to nic_name. + Reordered Variables table to start with nic_name and overhead. + Fixed wrong overhead value in some cbc-sha1 suites. + Fixed some suite tags. ++ Introduced tags to distinguish suites, such as IPSECINT. + Bound crypto hardware to NIC name. + Implemented NIC limit hiding. + Also search and teardown related arguments are now hidden. + Main measurement keywords updated to new arg handling. + Max rate related keywords moved to performance_limits.robot + Teardowns unified. + Generated tests are archived. ++ Generated directory is .gitignore-d. + Regenerator raises an exception on seeing non-compatible suite. ++ Relatively helpful message should be seen in exception. + Suite and template Documentation has generated parts. +- With short NIC names only. + Autogen checker also upgraded. + Tag expressions replaced with long files to ensure analogous tests. Change-Id: I60e9a999187e7da1f60d0eb4fb02afa14682aa46 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-04-05Fixes for Taishan testbedjuraj.linkes2-16/+26
* rename NICs in Taishan testbed to Intel-X520-DA2 * fix testbed NIC selection * remove unnecessary 82599es tests * blacklist unsupported tests on Taishan testbed * lowercase previously created bash local variables Change-Id: I3b7f59e2edc00929fab2f5a0fce483f236f83075 Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>
2019-03-20Add tox checker for lengths of new lines onlyVratko Polak2-1/+53
- Still non-voting, but useful. Change-Id: Idd6f345f0f14fdbc237ff66f5e010801ea08dc5b Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-03-07Fix PYTHONPATH in activate_environmentVratko Polak1-1/+1
This affects jobs which install the virtual environment to a directory other than ${CSIT_DIR}. Change-Id: I1546043112f7504feb0452883b2ff57530dd2c9d Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-03-06FIX: Selecting VPP packagesPeter Mikus1-1/+1
Change-Id: Id6e093eaf62835606cd6bf7e9157d79c8c33c83a Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-03-06FIX: Selecting VPP packagesPeter Mikus1-1/+2
There is an issue when multiple VPP versions of same commit but different build is in repository. Artifacts.sh will find multiple version and cennot properly download only one. 00:00:46.522 ++ apt-get -y download libvppinfra=19.04-rc0~290-gd4295e61a~b2173 19.04-rc0~290-gd4295e61a~b2172 19.04-rc0~290-gd4295e61a~b2171 libvppinfra-dev=19.04-rc0~290-gd4295e61a~b2173 19.04-rc0~290-gd4295e61a~b2172 19.04-rc0~290-gd4295e61a~b2171 <truncated...//pm> This patch will select latest as the behavior is result of re-merge effect. Change-Id: I8ce21244e2b05e60af0ea51107f9138173844330 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-03-01Add ARM Taishan testbed33 perftestStanislav Chlebec3-19/+81
Change-Id: Iaa0e7fbca7de26c7dce8b389cc3494f628a2ecd0 Signed-off-by: Stanislav Chlebec <stanislav.chlebec@pantheon.tech> Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>
2019-02-27CSIT-1449 Ansible: Adding calibration supportPeter Mikus4-225/+67
- Remove obsolete bootstrap_setup.sh. - Add calibration support into ansible. - Inject Ansible run with calibration to every job. Change-Id: Ib2d6cd0c04d3bce700b205bef34c3c88edb26e28 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-02-27CSIT-1418 Switch performance jobs to VPP-bionic buildPeter Mikus1-10/+3
Change-Id: Ia38e70a418570d168bf330ce1b3c91351b326181 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-02-27Add tox.ini and few checker scriptsVratko Polak8-23/+237
The plan is to change csit-validate-pylint-master job to fail if (and only if) tox fails. This will allow us to easily add checks, with or without the voting power. Each check produces log (ignored in .gitignore) the voting job can archive. + Made autogen quiet by default, to avoid spam in autogen checker. + Unified the way direct csit subdirectories are git-ignored. Change-Id: I6477b1ef7da6d3e30f68c5850d04900cc52f431e Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-02-22CSIT-1437 Create portable host-setup documentPeter Mikus1-1/+1
- Ansible simplified and optimalized - Porting global variables into single file - Rework the README.md - Tested outside LF environemnt Change-Id: I124cffa5c4510edf365e8b558da0c8c498f55d50 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-02-20FIX: Static variables all over the place for per patchPeter Mikus2-11/+26
- Incredible why is it so hard to write scripts not hardcoding anything. Change-Id: I48cf2cc3d25f9665a9ff7ca26756d3b70cdd2f9c Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-02-19CSIT-1419 Convert vpp-virl job to vpp-devicePeter Mikus3-71/+108
Change-Id: I5af6de4b96775a72855e1644ca4d8d9b4b2f9e25 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-02-19Allow more perftest strings in get_test_tag_stringVratko Polak1-4/+9
This is needed to support other TBs in perpatch job. Change-Id: I9de70e818a32fa9990d90cb14498a26570b774a4 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-02-19Expose DPDK version into separate Variable filePeter Mikus1-3/+6
Change-Id: If9707297a430285a242c3dae49c216d952a9be12 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-02-12Bump DPDK to 19.02Peter Mikus1-1/+1
Change-Id: I9ea7b5104d3124dd6ae36fd91cf056ace9f93e3d Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-02-04Improve 1n-skx vpp_device mapping functionPeter Mikus1-6/+20
Improve mapping function for 1n-skx vpp_device to pickup available DUT1 net_dev and replace the name with TG net_dev prefix. This way we can eliminate situation, when pair with not equal VLANs are picked. Change-Id: If78329e730bfb4df34fb8d8924c8715d69a15e0c Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-02-04CSIT-1416 Remove installation of vpp from containersPeter Mikus1-25/+4
Use parent system (Host, Container) installation of VPP. This will save the internet bandwith by skip installing of prerequisites packages. It will also skip dpkg install and simplify the process of initializing VPP inside container. Previosly initialization of VPP in container takes about 55s. With this patch it is reduced to 2-3s. This patch removes the bloated VOLUME creation between container sidecars (a.k.a nested container) and fixes the hugepage allocation. Change-Id: Ifa2be532edb77354657e1b84568bdc34993b00d0 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-02-04Trending: Remove NF_DENSITY tests from trendingTibor Frank1-2/+10
- also memif tests removed from graphs where they must not be. Change-Id: I1cbb02ba2dcdcd3a286c9ac4489c946993ac4790 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-01-31Add TB23 back into production poolPeter Mikus1-1/+1
Change-Id: I69a16b1baa5147f22b7c5742c2ccf6e030474937 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-01-30FIX: Cleanup mechanics for vpp_devicePeter Mikus1-3/+10
Change-Id: Ice975127f8ecdd4cead418151cf37d61dfb218a0 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-01-24CSIT-1407 FIX vpp install after VPP changesPeter Mikus2-3/+4
Change-Id: I9148f6de75c3100f827eedec48c4c0ccb343bc54 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-01-23VPP_Device - add baseline tests - part IIb)Jan Gelety1-3/+25
CSIT-1372 Add following baseline tests to VPP_Device: - ip4 eth2p-ethip4-ip4base-eth-2memif-1dcr-dev - ip6 eth2p-ethip6-ip6base-eth-2memif-1dcr-dev - l2bd eth2p-eth-l2bdbasemaclrn-eth-2memif-1dcr-dev - l2xc eth2p-eth-l2xcbase-eth-2memif-1dcr-dev Change-Id: Ic4a3a01b62d800c528a9c9371891dcc26b875220 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-01-10CSIT-1362: migrate to package cloud for HC performance testsMichal Cmarada1-0/+115
Change-Id: I43f62ea97e432504eb4ece85744d7fd6ff426113 Signed-off-by: Michal Cmarada <mcmarada@cisco.com>
2019-01-10VPP_Device - add baseline tests - part IIa)Jan Gelety1-1/+3
CSIT-1372 Add following baseline tests to VPP_Device: - ip4 eth2p-ethip4-ip4base-eth-2vhost-1vm-dev - ip6 eth2p-ethip6-ip6base-eth-2vhost-1vm-dev - l2bd eth2p-eth-l2bdbasemaclrn-eth-2vhost-1vm-dev - l2xc eth2p-eth-l2xcbase-eth-2vhost-1vm-dev + fix doc strings in all vpp_device tests Change-Id: Icc5ed801f3e8f6dedaa611779bd86fc20102fa74 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-01-09fix permissions for dut_setup.shMichal Cmarada1-0/+0
Change-Id: Ia11125e889a981a762c54281375a4e78159d8c69 Signed-off-by: Michal Cmarada <mcmarada@cisco.com>
2019-01-04CSIT-1382 Create weekly/semiweekly job for vpp-devicePeter Mikus1-4/+5
- Update gather function Change-Id: If130b93fd8c9752bb804a8ecc53c1598e8669031 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-11-29FIX: VPP_Device - use vpp bionic packagesJan Gelety1-3/+10
Because there is already used ubuntu bionic on VPP device testbed and used download script from pacakgecloud site donwloads packages based on host OS we need additional file to store vpp bionic stable version for VPP_Device tests. Change-Id: If834dc8af7dffa19b8ddeae013c3da9b37a5a81a Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-11-27CSIT python API introductionJan Gelety1-2/+2
Jira: CSIT-1336 Change-Id: I96d2b0221c5a7466484a82339fc132c5921532d1 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-11-08Add trigger fro DPDK testsTibor Frank1-0/+2
Change-Id: I214026c5df83778e87623770225e0fbb041ccc1c Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-11-08FIX: Ligato testsPeter Mikus1-1/+1
- Freeze stable sfc_controller version - Remove kafka connection - Add debug level outputs - Use mater branch instead of dev Change-Id: Icde06a741cae6393fe482a493eb214d015f145bf Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-10-24Remove usage of vpp-ext-deps packageJan Gelety3-17/+2
This package is not needed for csit enymore. Change-Id: Ie32a9c9322873e66554bb69112d4428697c866db Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-10-24CSIT-1260 Create initial version of bootstrap including VF reservationPeter Mikus5-16/+826
Change-Id: I153d378849ea76444915b7fc219237db1b7bca1a Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-10-22Per patch: multiple BMRR callsVratko Polak3-82/+111
This is to reduce sensitivity on testbed unstable performance. Also add topo_cleanupbefore every pybot run to avoid issues with VPP uninstall. TRACE prints are left there to simplify investigation of false positives if/when they happen. Change-Id: I9b0cdcfbbe4aa0735a0596746ac32c9e93af0897 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-10-19FIX: Correct the packagecloud.io URL pathPeter Mikus1-1/+3
Change-Id: I8aae4cb85f9bb1efaa19d75e2fd7c9593f20756d Signed-off-by: Peter Mikus <pmikus@cisco.com> (cherry picked from commit e44edcedef4dd2fee1c21b122b4bc6bb8586598e)
2018-10-17Script for PXE host stagingPeter Mikus2-0/+225
Introducing script for staging server via PXE and controlling CIMC/IPMI reboot. Change-Id: I1667e1906e7de73b7bca994d82de75e12c0d382a Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-10-10CSIT-1297: Modify the bootstrap.sh to run only selected mrr suitesTibor Frank1-7/+12
Change-Id: I2f5ac334e09bc35bfaefc112cf0bb7f57290a732 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-10-03CSIT-1297: Modify the bootstrap.sh to run only selected mrr suitesTibor Frank1-15/+82
Change-Id: I7071abd6c4a52a86efea573a4f9bcb54547dc004 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-10-03CSIT-1294 FIX: ValueError: CTR mode needs counter parameter, not IVPeter Mikus1-1/+1
The issue is caused by python-crypto library in upstream Ubuntu 1804 repo. Unless there is permanent fix there is workaround to always download fresh version, not preinstalled. Change-Id: Ic2318eb532a6e7a910e4ffb209556c17e6070d3d Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-10-01CSIT-1327 Migrate from vpp-dkms-dpdk to vpp-ext-depsPeter Mikus2-11/+12
Change-Id: I6fad3303c5c331ad36d163ba735907e35931dea0 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-09-27Exclude dot1q in the default tag arrayVratko Polak1-4/+4
Mainly useful to reduce test set for per patch. Change-Id: I55a5f2d268c3105ac32d25ae317e149d3c3b4e14 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-09-27FIX: testcode detection in perf jobsPeter Mikus1-3/+3
Change-Id: I4c0c5afa8a8dff814382cb0ad6d9df0410179755 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-09-26CSIT-1316 Fix ligato building mechanics in CSIT bootstrapsPeter Mikus2-30/+26
Change-Id: Ia8da73cbf7ab213b61a330b757419330667be24b Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-09-26CSIT-1317 ADD: Ability to blacklist tags per topologyPeter Mikus1-2/+17
- Add option to override some tags per topology. Change-Id: I4045ebbee1c5d32e29cdb6c5c84e0dcd9217b2cf Signed-off-by: Peter Mikus <pmikus@cisco.com>