aboutsummaryrefslogtreecommitdiffstats
path: root/resources/libraries/bash/function/common.sh
AgeCommit message (Collapse)AuthorFilesLines
2019-09-12Topology: CascadelakePeter Mikus1-0/+11
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I1533f00dd4b40f9dda82b1e9b5b15a81bbb9f7fb
2019-08-19FIX: Topology reservationPeter Mikus1-35/+0
Last attempt [0] is doing more harm then good. If testbed is down but recovered quickly enough (reboot, temporary ssh connectivity issue, ...) it never gets back into pool making other testbeds overloaded and queued. This patch is suppose to partially revert previous behavior until proper patch will follow. [0] https://gerrit.fd.io/r/c/csit/+/21148 Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I8203946d10d3e7dd51e97519d679246b5dae59e3
2019-08-15TOX: DOC verifyPeter Mikus1-0/+3
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Ifa4de8e60742f5c4cf4c2f377692313e23f9983b
2019-08-12FIX: Remove unwanted Jenkins dependencyPeter Mikus1-3/+0
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I7a43c3183dc276fa5e4806f31a52cf5844792d4d
2019-08-09Skip bad testbeds in reservationVratko Polak1-19/+42
Previously, ssh-inaccesible testbeds were handled the same way as reserved, never ending the wait loop. With this, if no testbed is accessible, the job fails early. Change-Id: I01bc79094fe0232a47d795e53e3daa52e8742bac Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-08-06VPPD: Dot1QPeter Mikus1-1/+15
Change-Id: I0d3c925ea4a6896a0df98db6ddaf4238e6291bf1 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-07-31Add: Prerequisites checkerPeter Mikus1-0/+33
Change-Id: Ida54722ee5c73a0b3e0a8e22692795daf5bb09f3 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-07-23Update documentation of select_arch_osVratko Polak1-6/+3
Change-Id: I619a18918b0710a59a3b36283aa79da06d640fae Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-07-233n-tsh timeout, testbed tags and ansible updatejuraj.linkes1-5/+3
* disable AVF tests which don't work with x520 * increase VPPApiClient timeout to 14s, as x520 show hardware is slower on Taishan * re-enable vhost and memif tests * remove tx2 mrr daily tag list; no tx2 is used for perf testing * remove taishan workaround * add scipy arm prerequisites and scipy workaround * rework inventories/lf_inventory/hosts; move cpu_microarchitecture to host files Change-Id: I5f10bd07b8146ac3b8be8c54fbb4d924a9373813 Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>
2019-07-23Add support for aarch64 container imagesjuraj.linkes1-2/+14
Change-Id: I84f13d7139a6e5f7004426018c2d27425c5fa97e Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>
2019-07-19Add support for default_nic in mrr tag listsjuraj.linkes1-2/+3
Change-Id: I1fdc6f3019af6d46b985164c573d44b0e440febd Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>
2019-07-17Revert "Avoid ci-management archiving files twice"Peter Mikus1-0/+25
This reverts commit ccfe499e2a27f2caf234ecbb2ec948120810eab6. Change-Id: I076bdaf255f6fa5cc6b0f25926850d62f450fd94 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-07-17Use PapiSocketProvider for most PAPI callsVratko Polak1-87/+96
Ticket: CSIT-1541 Ticket: VPP-1722 Ticket: CSIT-1546 + Increase timeout to hide x520 slownes of show hardware detail. - Install sshpass and update ssh client in virl bootstrap. + Added TODOs to remove when CSIT-1546 is fixed. + Enable default socksvr on any startup conf. + Improve OptionString init and repr. - The non-socket executor still kept for stats. + Remove everything unrelated to stats from non-socket executor. - Remove some debug-loooking calls to avoid failures. TODO: Introduce proper parsing to the affected keywords. + Reduce logging from PAPI code to level INFO. - Needs https://gerrit.fd.io/r/20660 to fully work. + Change default values for LocalExecution.run() + Return code check enabled by default. Code is more readable when rc!=0 is allowed explicitly, and the test code will now detect unexpected failures. + Logging disabled by default. Output XML is large already. Important logging can be enabled explicitly. + Restore alphabetical order in common.sh functions. Change-Id: I05882cb6b620ad14638f7404b5ad38c7a5de9e6c Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-07-12Avoid ci-management archiving files twiceVratko Polak1-25/+0
https://gerrit.fd.io/r/20119 has changed the way archival works, everything should now go to logs.fd.io (instead of appearing on run page in jenkins.fd.io). The glob pattern for archiving is quite eager, doing recursive search. That is good, as it can find also misplaced useful outputs. But it also means our usage of copy_archives function creates two copies of archived directories, usually archives/ and archives/archive/. This change simply removes copy_archives, relying on the new recursive search. A solution with changing ARCHIVE_DIR and moving if needed would be better, but looking at amout of jobs and various func bootstraps, it is not worth the effort. Change-Id: Iad2bc09455944307e59eecafa64d1db6dc8befe8 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-07-12Add per arch mrr daily test for denverton platformYulong Pei1-1/+4
Change-Id: Ica7d6bf0dbdfde3de70eabd131c79cadd8af3a16 Signed-off-by: Yulong Pei <yulong.pei@intel.com>
2019-07-11CSIT-1477: add 1n_tx2 VPP Devicejuraj.linkes1-4/+8
- add 1n_tx2 testbed - update VF reservation to meet 1n_tx2 testbed needs - update ansible with 1n_tx2 Change-Id: Ia075a913d4859f537fd0e6bff731ea88aff01dd9 Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>
2019-07-10Bash functions style cleanupVratko Polak1-59/+80
+ Update rst documentation for bash style + Command substitution: + Clarify when to use backticks. + Recommend avoiding nested command substitution. + Do not recommend putting command substitution results into quotes. + Function definition content: + Move "set -exuo pipefail" after comment only blocks. + Other set flags allowed for functions with good reasons. + Apply the new recommendations. - Blank lines unified in code but no written recommendation in rst. + Add missing references to functions called, variables read or set. + Add TODOs to where lists would be long. + Minor improvements to function descriptions. + Make "if" expressions more python-like. + Add missing "|| die" (or "|| true") where spotted. + Downgrade DEFAULT_NIC to a local variable. + Add TODO to list reasons for blacklisted tags. Change-Id: I05dce030a8c2cb1b3a242d8b977e8fe150d8ee20 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-06-26Introduce EXPECTED_FAILINGPeter Mikus1-7/+1
Change-Id: I6c578e9126778c584ccb57a4a2c76d96dea8fb35 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-06-24Store "tag" and "url" in files in reservation dirVratko Polak1-1/+8
String "Unknown" is used if test run tag or url is not supplied, so this change should be backward compatible. + Used "runtag", as both "test" and "tag" start with taken "-t". + Fixed some pylint violations. + Docstring explaining the steps taken and reasoning behind two files. + Other minor improvements. Change-Id: If704d02e51374087fe39ad0f69432477d1b310d3 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-06-20Add 2n-dnv and 3n-dnv configuration to bootstrap-verify-perf.shYulong Pei1-0/+33
Change-Id: I90427de5b611e432e5e46ab8758a31e376215914 Signed-off-by: Yulong Pei <yulong.pei@intel.com>
2019-06-18Fix exit from reservation loopVratko Polak1-1/+5
Break from the while loop is on both success and no testbeds. Change-Id: Iea368034927965c7f99f5502240bd768e3f62eec Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-06-18Continue reservation when cleanup failsVratko Polak1-5/+31
+ Only on not-failed-yet testbeds. + If any, else give up. Change-Id: I3209507d3d57a77ef6afad3184ca25e098910311 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-06-14Add comments for some tag exclusionsVratko Polak1-0/+7
Change-Id: I9daa70e433a2942d29c4e64856cb76d31f94a6f3 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-06-09FIX: Disable AVF on 3n-hswPeter Mikus1-3/+2
Change-Id: Id7c81a92dd50db365c219529a687fa37fd05ceb3 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-06-06Simplify mrr daily tag expressionVratko Polak1-5/+8
The number of tests executed is intentionally smaller, as recently the runtime has gone up too much. New numbers: csit-vpp-perf-mrr-daily-master: 120 csit-vpp-perf-mrr-daily-master-2n-skx: 72 csit-vpp-perf-mrr-daily-master-3n-skx: 126 More details included as diff files. + Less per-testbed exceptions. - Single/double links tags still set at two places. Change-Id: I1149d3e52edf38c7d9d3e0160c533e35ae944d0d Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-06-05FIX: OS detectionPeter Mikus1-16/+18
Change-Id: I3ba6c7dc6a72e376419990ce7f5acc8d373f246f Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-06-05CSIT changes to support new Centos 7 device testing container image.Thomas F Herbert1-1/+30
CSIT-1505 Parse {os} parameter from job and use it to separate the correct image for each distro and the correct stable package versions. Use two vpp device image names, one for Ubuntu and one for Centos. Centos sut image is in https://hub.docker.com/r/snergster/csit-sut-centos Source for Centos sut image: https://github.com/snergfdio/multivppcache/tree/master/csit-sut-centos Change-Id: I568c82710d730c4ed0ca25bc12cb6074e1cbe27e Signed-off-by: Thomas F Herbert <therbert@redhat.com>
2019-06-05Remove intrusive useless loggingPeter Mikus1-0/+2
Change-Id: Ib633266daaf67f257867f5ba0b2836f777ecd3bf Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-06-04Add possibility to use other then default NIC per VPP patchJan Gelety1-1/+5
Change-Id: I25e51022e0ec961fce444bc8f0f4413d0e95d7eb Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-05-22Exclude IPSECHW tests on NICs other than xl710Vratko Polak1-0/+1
The next version of suite generator will avoid generating them, for now we just exclude by a tag expression. Change-Id: I68c80c412ea327c11366f539b10de19df50152c2 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-05-16Make topology files read dynamically from directoryPeter Mikus1-24/+6
Change-Id: Id43c7c299d2e112b6caf00a3d340e6051ab337b6 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-05-15Avoid double link tests for nic_intel-xxv710Vratko Polak1-0/+2
Change-Id: Id9beeed270b91a35108adef594f50105198225d6 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-04-15Add output.xml with only INFO logging levePeter Mikus1-0/+8
- Useful for post-processing. Change-Id: I6f71087f8c6f6d66fd86207d5df9abd10e94f855 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-04-08Upgrade autogen to NICs and search typesVratko Polak1-131/+81
+ All perf suites updated, as autogen change is backward incompatible. + Only x710 -ndrpdr suites remain in git repository. + Removed retry feature of run_tests. + Renamed topology_type and traffic_type to traffic_profile. + Renamed framesize to frame_size; nic_model to nic_name. + Reordered Variables table to start with nic_name and overhead. + Fixed wrong overhead value in some cbc-sha1 suites. + Fixed some suite tags. ++ Introduced tags to distinguish suites, such as IPSECINT. + Bound crypto hardware to NIC name. + Implemented NIC limit hiding. + Also search and teardown related arguments are now hidden. + Main measurement keywords updated to new arg handling. + Max rate related keywords moved to performance_limits.robot + Teardowns unified. + Generated tests are archived. ++ Generated directory is .gitignore-d. + Regenerator raises an exception on seeing non-compatible suite. ++ Relatively helpful message should be seen in exception. + Suite and template Documentation has generated parts. +- With short NIC names only. + Autogen checker also upgraded. + Tag expressions replaced with long files to ensure analogous tests. Change-Id: I60e9a999187e7da1f60d0eb4fb02afa14682aa46 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-04-05Fixes for Taishan testbedjuraj.linkes1-6/+16
* rename NICs in Taishan testbed to Intel-X520-DA2 * fix testbed NIC selection * remove unnecessary 82599es tests * blacklist unsupported tests on Taishan testbed * lowercase previously created bash local variables Change-Id: I3b7f59e2edc00929fab2f5a0fce483f236f83075 Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>
2019-03-07Fix PYTHONPATH in activate_environmentVratko Polak1-1/+1
This affects jobs which install the virtual environment to a directory other than ${CSIT_DIR}. Change-Id: I1546043112f7504feb0452883b2ff57530dd2c9d Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-03-01Add ARM Taishan testbed33 perftestStanislav Chlebec1-5/+30
Change-Id: Iaa0e7fbca7de26c7dce8b389cc3494f628a2ecd0 Signed-off-by: Stanislav Chlebec <stanislav.chlebec@pantheon.tech> Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>
2019-02-27Add tox.ini and few checker scriptsVratko Polak1-17/+20
The plan is to change csit-validate-pylint-master job to fail if (and only if) tox fails. This will allow us to easily add checks, with or without the voting power. Each check produces log (ignored in .gitignore) the voting job can archive. + Made autogen quiet by default, to avoid spam in autogen checker. + Unified the way direct csit subdirectories are git-ignored. Change-Id: I6477b1ef7da6d3e30f68c5850d04900cc52f431e Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-02-19Allow more perftest strings in get_test_tag_stringVratko Polak1-4/+9
This is needed to support other TBs in perpatch job. Change-Id: I9de70e818a32fa9990d90cb14498a26570b774a4 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-02-04Trending: Remove NF_DENSITY tests from trendingTibor Frank1-2/+10
- also memif tests removed from graphs where they must not be. Change-Id: I1cbb02ba2dcdcd3a286c9ac4489c946993ac4790 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-01-31Add TB23 back into production poolPeter Mikus1-1/+1
Change-Id: I69a16b1baa5147f22b7c5742c2ccf6e030474937 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-11-08Add trigger fro DPDK testsTibor Frank1-0/+2
Change-Id: I214026c5df83778e87623770225e0fbb041ccc1c Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-10-24CSIT-1260 Create initial version of bootstrap including VF reservationPeter Mikus1-13/+207
Change-Id: I153d378849ea76444915b7fc219237db1b7bca1a Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-10-22Per patch: multiple BMRR callsVratko Polak1-4/+18
This is to reduce sensitivity on testbed unstable performance. Also add topo_cleanupbefore every pybot run to avoid issues with VPP uninstall. TRACE prints are left there to simplify investigation of false positives if/when they happen. Change-Id: I9b0cdcfbbe4aa0735a0596746ac32c9e93af0897 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-10-10CSIT-1297: Modify the bootstrap.sh to run only selected mrr suitesTibor Frank1-7/+12
Change-Id: I2f5ac334e09bc35bfaefc112cf0bb7f57290a732 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-10-03CSIT-1297: Modify the bootstrap.sh to run only selected mrr suitesTibor Frank1-15/+82
Change-Id: I7071abd6c4a52a86efea573a4f9bcb54547dc004 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-10-03CSIT-1294 FIX: ValueError: CTR mode needs counter parameter, not IVPeter Mikus1-1/+1
The issue is caused by python-crypto library in upstream Ubuntu 1804 repo. Unless there is permanent fix there is workaround to always download fresh version, not preinstalled. Change-Id: Ic2318eb532a6e7a910e4ffb209556c17e6070d3d Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-09-27Exclude dot1q in the default tag arrayVratko Polak1-4/+4
Mainly useful to reduce test set for per patch. Change-Id: I55a5f2d268c3105ac32d25ae317e149d3c3b4e14 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-09-27FIX: testcode detection in perf jobsPeter Mikus1-3/+3
Change-Id: I4c0c5afa8a8dff814382cb0ad6d9df0410179755 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-09-26CSIT-1317 ADD: Ability to blacklist tags per topologyPeter Mikus1-2/+17
- Add option to override some tags per topology. Change-Id: I4045ebbee1c5d32e29cdb6c5c84e0dcd9217b2cf Signed-off-by: Peter Mikus <pmikus@cisco.com>