aboutsummaryrefslogtreecommitdiffstats
path: root/resources/tools/scripts
AgeCommit message (Collapse)AuthorFilesLines
2020-01-17Fix unreservationVratko Polak1-2/+3
It got broken by the previous reservation fix. Change-Id: I5d9091b7fa4fcc37148c0223fe8eb83f7e5b6770 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2020-01-17Fix reservation if connect failsVratko Polak1-4/+8
Change-Id: I136cc51cbd5a01451e04a39c5d8e5554d6d39305 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2020-01-10Autogen: Generate also NIC drivers.Vratko Polak1-1/+1
+ Disallowed -avf- (or -rdma-) as "template" suites. + GBP suite switched to DPDK driver in repo. + Each NIC has its own list of supported drivers, in Constants. + Updated tag expressions for daily jobs: + Feature, ipsec, memif, scale, srv6, tunnels, vhost and vts are tested only with vfio-pci. + Other (base, dot1q, dot1ad) tested with all drivers. + Setup actions currently depend on driver, generated. - The performance_rdma action is trivial for now. - Several tests fail, to be fixed later, e.g. by performance_rdma. + Reconf tests are also supported. + Added DRV_VFIO_PCI tags missing, mainly in density tests. - Vhost suites (density, reconf) are failing, but suites look good. - TCP suites do not support NIC drivers yet. - DPDK obviously not supported. + Use Python 3 in regenerate scripts. + Fix typos binded => bound. + File open modes set either u"rt" or u"wt" everywhere. + Remove a trailing space in an environment variable name. Change-Id: I290470675dc5c9e88b2eaa5ab6285ecd9ed7827a Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-12-16FIX PIP requirement packagesPeter Mikus1-15/+0
+ CSIT will only use packages installed from master PIP requirement.txt file + All CSIT subsequent code must use single function and PIP list for virtualenv - Report/PAL/doc/trending will follow in next patch Change-Id: Ia9150fb05a144182a5a163178d553370ede55cdd Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-12-05Use new gdb commands for core dump examinationVratko Polak1-0/+35
Change-Id: I96f40fa816055a656209cbbcae8259a74cc4bd80 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-12-02Refactor jumpavg to be more readable and usableVratko Polak2-129/+2
This is the python3 change, the python2 is still used for testing bisect. + New version is 0.2.0 due to amount o API changes. + Jumpavg is now part of CSIT resource package tree. + Perpatch migrated to new jumpavg. - PAL NOT updated (the update moved to a different Change). Change-Id: I7d7a8bf8a411196c20c2a40a8c64478d6709bc07 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-12-02FIX: Perpatch PY3Peter Mikus1-0/+1
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Iae97cf4490fea38f5f03bdaa120ee7ae48b941ab
2019-11-28Python3: resources and librariesJan Gelety2-63/+57
Change-Id: I1392c06b1d64f62b141d24c0d42a8e36913b15e2 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-11-21NSH_SFC: RemoveTibor Frank1-65/+0
Change-Id: Ib7f9dff7bede4f8ec3148f234109132be920de82 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-11-19HONEYCOMB: RemovePeter Mikus2-288/+0
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I60d80564050cb786c7b1e0a08f31f8292f82197e
2019-11-11Remove the leftovers of the old testbed cleanupVratko Polak1-137/+0
Change-Id: I464db6fb6c220f23f2fe69df2c793175975d7b72 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-11-05Cleanup via AnsiblePeter Mikus4-759/+0
+ Remove dependency on topo_ scripts that depends on custom SSH() that depends on framework itself. This way the cleanup is independent of failure in our SSH libs. + Simple ansible command can do cleanup of a machine: ansible-playbook --inventory inventories/lf_inventory/hosts site.yaml \ --limit '10.32.8.18' --tags 'cleanup' + Add vpp_device reset and cleanup. + Remove historical scripts. - Still in testing beta phase. - Need to add SRIOV cleanup. Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I68e23304c7ad01041f51263c328c6e8d9b555cb7
2019-10-09FIX: Add SRIOV cleanupPeter Mikus1-3/+5
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I344cbab78e1491b1dc0b64598f1eae23c8d2cdcf
2019-10-04FIX: Add SRIOV cleanupPeter Mikus1-11/+19
If Jenkins interrupt pybot during AVF tests (that is happening more frequently as coverage increased) the interfaces remains in link UP state. Next run VPP cannot grab interfaces as they are in UP state in and kernel driver. This results in testcase failing. Patch is supposed to do put interfaces in topology down so VPP can bind them back to vfio-pci. Change-Id: I2aa9e5944d39474965eac3c5f1b472f58e9aa8b5 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-08-19FIX: Topology reservationPeter Mikus1-16/+19
Last attempt [0] is doing more harm then good. If testbed is down but recovered quickly enough (reboot, temporary ssh connectivity issue, ...) it never gets back into pool making other testbeds overloaded and queued. This patch is suppose to partially revert previous behavior until proper patch will follow. [0] https://gerrit.fd.io/r/c/csit/+/21148 Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I8203946d10d3e7dd51e97519d679246b5dae59e3
2019-08-12FIX: Remove unwanted Jenkins dependencyPeter Mikus1-29/+10
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I7a43c3183dc276fa5e4806f31a52cf5844792d4d
2019-08-09Skip bad testbeds in reservationVratko Polak1-3/+12
Previously, ssh-inaccesible testbeds were handled the same way as reserved, never ending the wait loop. With this, if no testbed is accessible, the job fails early. Change-Id: I01bc79094fe0232a47d795e53e3daa52e8742bac Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-06-24Store "tag" and "url" in files in reservation dirVratko Polak1-21/+88
String "Unknown" is used if test run tag or url is not supplied, so this change should be backward compatible. + Used "runtag", as both "test" and "tag" start with taken "-t". + Fixed some pylint violations. + Docstring explaining the steps taken and reasoning behind two files. + Other minor improvements. Change-Id: If704d02e51374087fe39ad0f69432477d1b310d3 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-04-26fix removal of build packages for honeycombMichal Cmarada1-2/+2
Change-Id: I19be5008067067c2e7c78e7673a9ceaaf2f52c8f Signed-off-by: Michal Cmarada <mcmarada@cisco.com>
2019-04-17Increase reliability of per patch perf jobVratko Polak1-26/+41
CSIT-1485 - Measurement results are inconsistent, creating false positives. - To avoid false positives, sensitivity has to be lowered. + Measurements are no more interleaved. + Measurement result are no longer filtered. + The job now runs faster. - Ip6base regressions smaller than 4% are tolerated. + Ip6base false positives can happen, but less than 10% of the time. - Part of job parameters is set on ci-management level. + Voter script output is improved. Change-Id: I0ec7d5df8b397daf7ff0277a1137ee9f36d8d866 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-04-05Add vpp-api-python for honeycomb testsMichal Cmarada2-9/+9
- Csit is migrating VAT scripts to PAPI, therefore python package for vpp is needed in honeycomb tests. Change-Id: I724cdd87e7ba899f9d9f95e08f5ce636435f7780 Signed-off-by: Michal Cmarada <mcmarada@cisco.com>
2019-03-11add support for using custom jvpp commitMichal Cmarada1-4/+59
Change-Id: I492541a0a0d6cdc08f03e4c47fc86f22716cf065 Signed-off-by: Michal Cmarada <mcmarada@cisco.com>
2019-03-06add dpdk-plugin for honeycomb download artifactsMichal Cmarada2-2/+2
Change-Id: I90c491e8039b20bbb0ef23bb1912e275030bef0b Signed-off-by: Michal Cmarada <mcmarada@cisco.com>
2019-03-05CSIT-1362: migrate package download scripts for hc2vpp jobsMichal Cmarada2-101/+142
As part of Bionic update for honeycomb (HC2VPP-372) scripts need to be updated. Switching to Packagecloud instead of nexus simplifies this process. Change-Id: I243367e8c1d7c3de5890d6846c199563cef457bf Signed-off-by: Michal Cmarada <mcmarada@cisco.com>
2019-02-20FIX: Static variables all over the place for per patchPeter Mikus1-5/+5
- Incredible why is it so hard to write scripts not hardcoding anything. Change-Id: I48cf2cc3d25f9665a9ff7ca26756d3b70cdd2f9c Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-02-08CSIT-845 Capture VPP core-dump from vpp crash on DUTsPeter Mikus1-1/+10
Change-Id: I987dcd5092d8527c9aefbe093e1ed7ae144d191b Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-02-05FIX: Cleanup docker images per jobPeter Mikus1-1/+1
Change-Id: Ib14d989d5f44a2aeeec122e2f63a9832a213f920 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-11-23Move reservation directory to TG node.Vratko Polak1-10/+14
Testing has showed SSH access to DUT affects performance. Downside: No support for non-Linux TGs. Complication: After merge there might be conflicts with older jobs, including jobs for other branches. Change-Id: Icefddc5a9ca8f4d830460e53a82bb45231f7222e Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-10-22Per patch: multiple BMRR callsVratko Polak1-25/+56
This is to reduce sensitivity on testbed unstable performance. Also add topo_cleanupbefore every pybot run to avoid issues with VPP uninstall. TRACE prints are left there to simplify investigation of false positives if/when they happen. Change-Id: I9b0cdcfbbe4aa0735a0596746ac32c9e93af0897 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-09-13CSIT-1282 Migrate from Nexus.fd.io to packagecloud.ioPeter Mikus1-179/+0
Change-Id: Ib4e72dc8e3c0fedfcd702f4f97bc4f26cbc642e9 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-08-30CSIT-1135: Scripts for VPP per-patch testingVratko Polak2-0/+100
+ Scripts do not rely on (other) bootstraps. + Perf verify bootstrap is also the new style sript now. + Scripts are divided to functions for better re-use. + Functions are sourced from small number of large "library" files. - Still using jumpavg from pipy. - Perpatch has specific simplified parsing (instead of the PAL one). - Bash style document is in a separate Change. Change-Id: If88fa528ce155ea86b614e3d77c0550b91bbdf11 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-08-10CSIT-1193 De-duplicate bootstrap scripts into onePeter Mikus1-0/+118
- DPDK and VPP bootstrap merged into one (ligato will follow). - Added more error detections - Added topo-cleanup.py to cleanup TB before and after test. - Remove installation of VPP Change-Id: I7a86117eb03cbe4ee8fde47baeed58bc86c0dfb2 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-08-06hc2vpp-csit-verify: use vpp packages based on vpp-versionMarek Gradzki1-2/+10
The hc2vpp-csit-verify allows to run HC CSIT tests per hc2vpp patch. The job should not use most recent vpp artifacts for respective branch ('RELEASE'), but version specified in the vpp-version file. The vpp-version file is used by hc2vpp-integration job to produce honeycomb package. Change-Id: If2811a01256e8217de50d220082dbc204443b54a Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
2018-07-30HC Tests: remove trusty from download_hc_*.sh scriptsMarek Gradzki2-16/+4
Ubuntu 14.04 packages are not being published since 1710. Change-Id: I1372fe0eb4eab3c6c3e0f3a7ee435104f3c6f0fb Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
2018-07-30HC Tests: do not use vpp-dbg in CSIT testsMarek Gradzki2-6/+6
Honeycomb package does not require VPP debug symbols and typical HC user does not have them installed. Change-Id: I2cae502cad3216304d6f7ee44913f30c97fb5a20 Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
2018-07-25HC Tests: do not install vpp-dev in hc2vpp-csit-verifyMarek Gradzki1-3/+3
The download_hc_build_pkgs.sh is used by hc2vpp-csit-verify and hc2vpp-csit-verify-odl jobs. These jobs download latest VPP packages and unlike other HC CSIT jobs, build hc2vpp. This patch removes vpp-dev/vpp-devel packages from the list of installed VPP packages to unify the environment with the other HC CSIT jobs. Change-Id: I28742afda05cd85675619a92fbc10f4565bdb321 Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
2018-07-23HC Tests: remove vpp-dpdk-dkms dependencyMarek Gradzki2-12/+3
The vpp-dpdk-dkms is not needed for current VPP versions. Change-Id: I9c1a79fb940b2ba0f332792d4fc088f49f9ee191 Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
2018-07-23HC Tests: disable NSH pluginMarek Gradzki2-14/+18
Change-Id: Ic382b625e5e7201ecc2a2937c15646806c594c61 Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
2018-06-06HC Tests: reenable NSH plugin (CSIT-994)Marek Gradzki2-18/+14
Reverts https://gerrit.fd.io/r/#/c/12572/ Change-Id: Ic55016e3c257a81440332a212e4c0d83e1990668 Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
2018-05-31CSIT-1055: Pkg download script to use package system not curlPeter Mikus2-95/+154
- Rework VPP package download script Change-Id: I51aca96fc3b834d8e17cf349a5a7b9d7105f2184 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-05-15HC tests: disable NSH plugin (CSIT-994)Marek Gradzki2-14/+18
This reverts https://gerrit.fd.io/r/#/c/12209/ Change-Id: I1de4ce6e96644881aa14adf6765e8a67b286595d Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
2018-04-27HC tests: reenable NSH plugin (CSIT-994)Marek Gradzki2-18/+14
Reverts https://gerrit.fd.io/r/#/c/11088/ Change-Id: Ib7b70d33f4a8110656dd39f25b7f5a67a2f52104 Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
2018-03-13HC Tests: disable NSH pluginMarek Gradzki2-14/+18
NSH artifacts in Nexus are outdated and crash VPP. Reenable NSH after it is fixed (CSIT-994). Change-Id: I3a0367682d62d5ccdbf008336ed682e7ab9032a0 Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
2018-02-28Update of VPP_STABLE_VER files + fix Centos dep listPeter Mikus2-2/+2
Change-Id: Icd149927c6b2893f8f716df29d8de475e809be49 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-02-23Adapt hc2vpp-csit bootstrap scripts to HC2VPP-285/CIMANAGE-22Marek Gradzki1-5/+11
Since https://gerrit.fd.io/r/#/c/10668/ and https://gerrit.fd.io/r/#/c/10669/ honeycomb packages from stable branches no longer depend on single VPP version. This patch updates download_hc_pkgs.hc script, used by hc2vpp-csit jobs, to use the latest honeycomb package in such case. Change-Id: If5b006e72caa8cc905137b1bf02af7d9e927e37a Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
2018-01-24FIX: Ignore removing dangling images if there aren't anyPeter Mikus1-1/+1
Change-Id: I0be23e67cfdc54169b9787e90eede28b32406c8b Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-01-10Adapt to hc2vpp refactorMarek Gradzki1-1/+1
Follows: https://gerrit.fd.io/r/#/c/10040/ Change-Id: I234cd795f5b191e413e4b5e3c05294278b1752a8 Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
2017-10-31Update of VPP_STABLE_VER files and DPDK_STABLE_VER fileJan Gelety2-2/+2
- use new vpp ref build - ubuntu 16.04: 18.01-rc0~156-gae5a02f~b3093_amd64 - use new vpp ref build - centos7: 18.01-rc0~156_gae5a02f~b3090.x86_64 - use new dpdk version: 17.08-vpp2 - builds tested by semiweekly jobs: https://jenkins.fd.io/view/csit/job/csit-vpp-verify-master-ubuntu1604-semiweekly/85/ https://jenkins.fd.io/view/csit/job/csit-vpp-verify-master-centos7-semiweekly/85/ - remove vpp-debuginfo centos7 artifact as not provided for new versions Change-Id: I18445feac98304e7e7ecdf77968acebf2d5aef09 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-10-16CSIT-841 Optimize creating of vnf-agent docker image Part IPeter Mikus1-2/+7
- Optimize building of prod_vpp_agent docker image by using dev_vpp_agent docker image pulled from dockerhub/ligato instead of building on slave. - Add detailed logs from every POD deployed in namespace. - Hardening condition for considering PODs Running. Change-Id: I9f771d6365d38fef2ec2e00ab642853e6a44ad03 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-10-12CSIT-748 vnf-agent integrationPeter Mikus1-0/+132
CSIT-773 Implement RF keywords for k8s - Implementation of Test Suite Setup for Ligato vnf-agent testing - Implementation of KubernetesUtil for controlling kubectl - Yaml templates for L2XC topology with 1cswitch and 1cnf - Yaml templates for L2BD topology with 1cswitch and 1cnf - ligato bootstrap script for creating vnf-agent image Change-Id: Iebefde0eb984a27a0afcdf29fe549ca4edf8a61e Signed-off-by: Peter Mikus <pmikus@cisco.com>