aboutsummaryrefslogtreecommitdiffstats
path: root/resources/libraries/bash/entry
AgeCommit message (Collapse)AuthorFilesLines
2020-02-04Ansible: Cleanup and speedupPeter Mikus1-1/+0
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Ia2ce482798204ad426f93f334c97e28eb51139fd
2020-01-17perf: add TCP Iperf3+LDPRELOAD test suiteDave Wallace1-3/+3
Change-Id: Icff49fb31cce342a2a4ae799e844ec91f9e5e366 Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
2019-12-02FIX: Perpatch PY3Peter Mikus1-1/+1
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Iae97cf4490fea38f5f03bdaa120ee7ae48b941ab
2019-11-11Remove the leftovers of the old testbed cleanupVratko Polak1-2/+2
Change-Id: I464db6fb6c220f23f2fe69df2c793175975d7b72 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-11-07Source ansible.sh for entry scripts using cleanupVratko Polak1-0/+2
Change-Id: Iee02577ee0c054feb61edee807182c6808f235b0 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-10-18Autogen checker: Fix difference reporting branchVratko Polak1-2/+3
Change-Id: I85da5ec38643524fa1af7ed7628025a4a52463f5 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-08-23Introduce reconfig suites, for dot1q+ip4+vxlanVratko Polak1-2/+2
Ticket: CSIT-1551 + Config copied from other suites. + Layer keywords prepared for additional chains. + Renamed "create" argument to "vlan_per_chain". + TrafficGenerator result extraction improvements. + Also unified TG type and subtype checking. + Throughput estimated as PDR for zero PLR. + Actual Qemu start is skipped. + Parse xstats instead of stats in trex stop scipt. - Because stats are unconditionally cleared on each script connect. + Remember start values to get better ReceiveMeasurementResult at stop. + Expose loss count and time as appropriate test message. + Autogen support. + Multiple chain amounts and core densities. - Only 1 additional chain. + Proper TAGs. Documented. + Clarified min framesize tags are for TG-DUT. + Added a TODO concerning overhead values. + Added 118B tag. + Robot performance keywords improvements. + Added missing return value documentation. + Frame size as required test variable, not an explicit argument. + MLRsearch keyword to store result (not into test message). - TODO: De-duplicate: main keyword to measure, minor to set test message. - But implementation uses the fact default arguments are different. + Keywords for starting and stopping background traffic. - No checks whether start-stop pair is complete. + Multiple minor indentation and logging improvements. - Missing / TODOs: - Support also vlan_per_chain=True? - Support dot1q without vxlan? - Support also deletion? - How to package config steps so -reconf can be generated from -ndrpdr? Change-Id: If0270697f9ffa837c34ef802917220a53f156703 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-08-19VPP perf per patch: Reverse the order of testsVratko Polak1-4/+5
If current VPP is broken, we want to fail early. If there is API change, we are more interested in current results, even if parent is likely to fail. Change-Id: I552485bbb9fe0053bae39de7939f94a5971bb63b Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-08-15TOX: DOC verifyPeter Mikus1-0/+59
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Ifa4de8e60742f5c4cf4c2f377692313e23f9983b
2019-08-14VAT-to-PAPI: Fix HTTP/TCP testsDave Wallace1-2/+2
Change-Id: Ie728bc73eb7429d246e82dd195fc63191c3ac51d Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
2019-07-31TOX: Coverage checkPeter Mikus1-0/+100
Change-Id: Ib4585729f7b84bbcf1db62db801a6b2f24337803 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-07-31Add: Prerequisites checkerPeter Mikus4-0/+4
Change-Id: Ida54722ee5c73a0b3e0a8e22692795daf5bb09f3 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-07-31Add VPP API CRC checkingVratko Polak1-0/+45
+ Include both checking at runtime and standalone static quick check. + Runtime checking does not look for missing messages, as messages belonging to disabled plugins are not visible. + Standalone check script has nice loud output. Change-Id: I1dfc3846d1bcdad0b09017d4ce8edd5028e17e0c Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-07-23Add support for aarch64 container imagesjuraj.linkes4-4/+4
Change-Id: I84f13d7139a6e5f7004426018c2d27425c5fa97e Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>
2019-07-19FIX: naming convention fixes for TOXPeter Mikus1-1/+1
Change-Id: I0644fbd0e136dee3a91fd9406155f971b3c726eb Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-07-19TOX: Naming conventionsPeter Mikus1-0/+142
Change-Id: I038d90fc481e5f74085d0fe6165b12769d98e8a1 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-07-17Revert "Avoid ci-management archiving files twice"Peter Mikus4-1/+6
This reverts commit ccfe499e2a27f2caf234ecbb2ec948120810eab6. Change-Id: I076bdaf255f6fa5cc6b0f25926850d62f450fd94 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-07-12Avoid ci-management archiving files twiceVratko Polak4-6/+1
https://gerrit.fd.io/r/20119 has changed the way archival works, everything should now go to logs.fd.io (instead of appearing on run page in jenkins.fd.io). The glob pattern for archiving is quite eager, doing recursive search. That is good, as it can find also misplaced useful outputs. But it also means our usage of copy_archives function creates two copies of archived directories, usually archives/ and archives/archive/. This change simply removes copy_archives, relying on the new recursive search. A solution with changing ARCHIVE_DIR and moving if needed would be better, but looking at amout of jobs and various func bootstraps, it is not worth the effort. Change-Id: Iad2bc09455944307e59eecafa64d1db6dc8befe8 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-07-10Fix few pylint violationsVratko Polak1-1/+1
+ Stop attempting to check test/ as module inits are not there. Change-Id: Ia4e498061be3e3118b07e98c9c2f761f2454653e Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-07-02Replace license checker with global noticesVratko Polak1-106/+0
Caring about per-file notices is too distracting. Change-Id: I3f07a9fd1d3a4350135dd3d14f4944647af39a0b Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-06-28Add copyright checker to toxVratko Polak1-0/+106
+ Only looks at files edited since HEAD~. + Only checks files of whitelisted extensions. + Distinguishes missing and outdated copyrights. + Any line with "Copyright" substring can work. + Many copyright lines are tolerated, if at least one has correct year. + Voting. Change-Id: I2cda0459cb191eeec7aada69c508973568039d87 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-06-18Continue reservation when cleanup failsVratko Polak2-3/+3
+ Only on not-failed-yet testbeds. + If any, else give up. Change-Id: I3209507d3d57a77ef6afad3184ca25e098910311 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-06-05FIX: OS detectionPeter Mikus3-0/+3
Change-Id: I3ba6c7dc6a72e376419990ce7f5acc8d373f246f Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-06-05CSIT changes to support new Centos 7 device testing container image.Thomas F Herbert1-0/+1
CSIT-1505 Parse {os} parameter from job and use it to separate the correct image for each distro and the correct stable package versions. Use two vpp device image names, one for Ubuntu and one for Centos. Centos sut image is in https://hub.docker.com/r/snergster/csit-sut-centos Source for Centos sut image: https://github.com/snergfdio/multivppcache/tree/master/csit-sut-centos Change-Id: I568c82710d730c4ed0ca25bc12cb6074e1cbe27e Signed-off-by: Thomas F Herbert <therbert@redhat.com>
2019-05-31Add meltdown spectre to calibration setPeter Mikus1-1/+1
+ Fix the version of MMD tool to always latest Change-Id: Iafd7f40d618b8e4995b5cc12fe06056719f58517 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-04-24Move generate_tests earlier in entry scriptsVratko Polak4-8/+8
The idea is to run test generation and archivation before testbed reservation, as during generation and archivation the testbed can be used by another job. The two steps are moved just before (physical or docker) reservation, as they currently take considerable time, so simpler steps are kept before to save time if they fail. Coincidentally, it is also just after activate_virtualenv, Python is needed for test generation. Change-Id: I8b41b91dba8118e89301e3fcf89d5cd14ac054a2 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-04-17Increase reliability of per patch perf jobVratko Polak1-4/+8
CSIT-1485 - Measurement results are inconsistent, creating false positives. - To avoid false positives, sensitivity has to be lowered. + Measurements are no more interleaved. + Measurement result are no longer filtered. + The job now runs faster. - Ip6base regressions smaller than 4% are tolerated. + Ip6base false positives can happen, but less than 10% of the time. - Part of job parameters is set on ci-management level. + Voter script output is improved. Change-Id: I0ec7d5df8b397daf7ff0277a1137ee9f36d8d866 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-04-08Upgrade autogen to NICs and search typesVratko Polak6-15/+41
+ All perf suites updated, as autogen change is backward incompatible. + Only x710 -ndrpdr suites remain in git repository. + Removed retry feature of run_tests. + Renamed topology_type and traffic_type to traffic_profile. + Renamed framesize to frame_size; nic_model to nic_name. + Reordered Variables table to start with nic_name and overhead. + Fixed wrong overhead value in some cbc-sha1 suites. + Fixed some suite tags. ++ Introduced tags to distinguish suites, such as IPSECINT. + Bound crypto hardware to NIC name. + Implemented NIC limit hiding. + Also search and teardown related arguments are now hidden. + Main measurement keywords updated to new arg handling. + Max rate related keywords moved to performance_limits.robot + Teardowns unified. + Generated tests are archived. ++ Generated directory is .gitignore-d. + Regenerator raises an exception on seeing non-compatible suite. ++ Relatively helpful message should be seen in exception. + Suite and template Documentation has generated parts. +- With short NIC names only. + Autogen checker also upgraded. + Tag expressions replaced with long files to ensure analogous tests. Change-Id: I60e9a999187e7da1f60d0eb4fb02afa14682aa46 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-03-20Add tox checker for lengths of new lines onlyVratko Polak2-1/+53
- Still non-voting, but useful. Change-Id: Idd6f345f0f14fdbc237ff66f5e010801ea08dc5b Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-02-27CSIT-1449 Ansible: Adding calibration supportPeter Mikus2-35/+2
- Remove obsolete bootstrap_setup.sh. - Add calibration support into ansible. - Inject Ansible run with calibration to every job. Change-Id: Ib2d6cd0c04d3bce700b205bef34c3c88edb26e28 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-02-27Add tox.ini and few checker scriptsVratko Polak7-6/+217
The plan is to change csit-validate-pylint-master job to fail if (and only if) tox fails. This will allow us to easily add checks, with or without the voting power. Each check produces log (ignored in .gitignore) the voting job can archive. + Made autogen quiet by default, to avoid spam in autogen checker. + Unified the way direct csit subdirectories are git-ignored. Change-Id: I6477b1ef7da6d3e30f68c5850d04900cc52f431e Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-02-20FIX: Static variables all over the place for per patchPeter Mikus1-1/+1
- Incredible why is it so hard to write scripts not hardcoding anything. Change-Id: I48cf2cc3d25f9665a9ff7ca26756d3b70cdd2f9c Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-02-19CSIT-1419 Convert vpp-virl job to vpp-devicePeter Mikus2-6/+62
Change-Id: I5af6de4b96775a72855e1644ca4d8d9b4b2f9e25 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-10-24CSIT-1260 Create initial version of bootstrap including VF reservationPeter Mikus3-3/+49
Change-Id: I153d378849ea76444915b7fc219237db1b7bca1a Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-10-22Per patch: multiple BMRR callsVratko Polak1-12/+22
This is to reduce sensitivity on testbed unstable performance. Also add topo_cleanupbefore every pybot run to avoid issues with VPP uninstall. TRACE prints are left there to simplify investigation of false positives if/when they happen. Change-Id: I9b0cdcfbbe4aa0735a0596746ac32c9e93af0897 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-10-17Script for PXE host stagingPeter Mikus1-0/+35
Introducing script for staging server via PXE and controlling CIMC/IPMI reboot. Change-Id: I1667e1906e7de73b7bca994d82de75e12c0d382a Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-09-06CSIT-1264: Add oper branch wrapper entry scriptVratko Polak2-1/+50
Change-Id: I569b089b711f89fecca8dd31d6906ef311982877 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-08-30CSIT-1135: Scripts for VPP per-patch testingVratko Polak3-0/+119
+ Scripts do not rely on (other) bootstraps. + Perf verify bootstrap is also the new style sript now. + Scripts are divided to functions for better re-use. + Functions are sourced from small number of large "library" files. - Still using jumpavg from pipy. - Perpatch has specific simplified parsing (instead of the PAL one). - Bash style document is in a separate Change. Change-Id: If88fa528ce155ea86b614e3d77c0550b91bbdf11 Signed-off-by: Vratko Polak <vrpolak@cisco.com>