aboutsummaryrefslogtreecommitdiffstats
path: root/resources/libraries/bash/entry
AgeCommit message (Collapse)AuthorFilesLines
2019-04-17Increase reliability of per patch perf jobVratko Polak1-4/+8
CSIT-1485 - Measurement results are inconsistent, creating false positives. - To avoid false positives, sensitivity has to be lowered. + Measurements are no more interleaved. + Measurement result are no longer filtered. + The job now runs faster. - Ip6base regressions smaller than 4% are tolerated. + Ip6base false positives can happen, but less than 10% of the time. - Part of job parameters is set on ci-management level. + Voter script output is improved. Change-Id: I0ec7d5df8b397daf7ff0277a1137ee9f36d8d866 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-04-08Upgrade autogen to NICs and search typesVratko Polak6-15/+41
+ All perf suites updated, as autogen change is backward incompatible. + Only x710 -ndrpdr suites remain in git repository. + Removed retry feature of run_tests. + Renamed topology_type and traffic_type to traffic_profile. + Renamed framesize to frame_size; nic_model to nic_name. + Reordered Variables table to start with nic_name and overhead. + Fixed wrong overhead value in some cbc-sha1 suites. + Fixed some suite tags. ++ Introduced tags to distinguish suites, such as IPSECINT. + Bound crypto hardware to NIC name. + Implemented NIC limit hiding. + Also search and teardown related arguments are now hidden. + Main measurement keywords updated to new arg handling. + Max rate related keywords moved to performance_limits.robot + Teardowns unified. + Generated tests are archived. ++ Generated directory is .gitignore-d. + Regenerator raises an exception on seeing non-compatible suite. ++ Relatively helpful message should be seen in exception. + Suite and template Documentation has generated parts. +- With short NIC names only. + Autogen checker also upgraded. + Tag expressions replaced with long files to ensure analogous tests. Change-Id: I60e9a999187e7da1f60d0eb4fb02afa14682aa46 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-03-20Add tox checker for lengths of new lines onlyVratko Polak2-1/+53
- Still non-voting, but useful. Change-Id: Idd6f345f0f14fdbc237ff66f5e010801ea08dc5b Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-02-27CSIT-1449 Ansible: Adding calibration supportPeter Mikus2-35/+2
- Remove obsolete bootstrap_setup.sh. - Add calibration support into ansible. - Inject Ansible run with calibration to every job. Change-Id: Ib2d6cd0c04d3bce700b205bef34c3c88edb26e28 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-02-27Add tox.ini and few checker scriptsVratko Polak7-6/+217
The plan is to change csit-validate-pylint-master job to fail if (and only if) tox fails. This will allow us to easily add checks, with or without the voting power. Each check produces log (ignored in .gitignore) the voting job can archive. + Made autogen quiet by default, to avoid spam in autogen checker. + Unified the way direct csit subdirectories are git-ignored. Change-Id: I6477b1ef7da6d3e30f68c5850d04900cc52f431e Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-02-20FIX: Static variables all over the place for per patchPeter Mikus1-1/+1
- Incredible why is it so hard to write scripts not hardcoding anything. Change-Id: I48cf2cc3d25f9665a9ff7ca26756d3b70cdd2f9c Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-02-19CSIT-1419 Convert vpp-virl job to vpp-devicePeter Mikus2-6/+62
Change-Id: I5af6de4b96775a72855e1644ca4d8d9b4b2f9e25 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-10-24CSIT-1260 Create initial version of bootstrap including VF reservationPeter Mikus3-3/+49
Change-Id: I153d378849ea76444915b7fc219237db1b7bca1a Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-10-22Per patch: multiple BMRR callsVratko Polak1-12/+22
This is to reduce sensitivity on testbed unstable performance. Also add topo_cleanupbefore every pybot run to avoid issues with VPP uninstall. TRACE prints are left there to simplify investigation of false positives if/when they happen. Change-Id: I9b0cdcfbbe4aa0735a0596746ac32c9e93af0897 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-10-17Script for PXE host stagingPeter Mikus1-0/+35
Introducing script for staging server via PXE and controlling CIMC/IPMI reboot. Change-Id: I1667e1906e7de73b7bca994d82de75e12c0d382a Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-09-06CSIT-1264: Add oper branch wrapper entry scriptVratko Polak2-1/+50
Change-Id: I569b089b711f89fecca8dd31d6906ef311982877 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-08-30CSIT-1135: Scripts for VPP per-patch testingVratko Polak3-0/+119
+ Scripts do not rely on (other) bootstraps. + Perf verify bootstrap is also the new style sript now. + Scripts are divided to functions for better re-use. + Functions are sourced from small number of large "library" files. - Still using jumpavg from pipy. - Perpatch has specific simplified parsing (instead of the PAL one). - Bash style document is in a separate Change. Change-Id: If88fa528ce155ea86b614e3d77c0550b91bbdf11 Signed-off-by: Vratko Polak <vrpolak@cisco.com>