aboutsummaryrefslogtreecommitdiffstats
path: root/resources/tools/scripts
AgeCommit message (Collapse)AuthorFilesLines
2019-08-09Skip bad testbeds in reservationVratko Polak1-3/+12
Previously, ssh-inaccesible testbeds were handled the same way as reserved, never ending the wait loop. With this, if no testbed is accessible, the job fails early. Change-Id: I01bc79094fe0232a47d795e53e3daa52e8742bac Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-06-24Store "tag" and "url" in files in reservation dirVratko Polak1-21/+88
String "Unknown" is used if test run tag or url is not supplied, so this change should be backward compatible. + Used "runtag", as both "test" and "tag" start with taken "-t". + Fixed some pylint violations. + Docstring explaining the steps taken and reasoning behind two files. + Other minor improvements. Change-Id: If704d02e51374087fe39ad0f69432477d1b310d3 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-04-26fix removal of build packages for honeycombMichal Cmarada1-2/+2
Change-Id: I19be5008067067c2e7c78e7673a9ceaaf2f52c8f Signed-off-by: Michal Cmarada <mcmarada@cisco.com>
2019-04-17Increase reliability of per patch perf jobVratko Polak1-26/+41
CSIT-1485 - Measurement results are inconsistent, creating false positives. - To avoid false positives, sensitivity has to be lowered. + Measurements are no more interleaved. + Measurement result are no longer filtered. + The job now runs faster. - Ip6base regressions smaller than 4% are tolerated. + Ip6base false positives can happen, but less than 10% of the time. - Part of job parameters is set on ci-management level. + Voter script output is improved. Change-Id: I0ec7d5df8b397daf7ff0277a1137ee9f36d8d866 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-04-05Add vpp-api-python for honeycomb testsMichal Cmarada2-9/+9
- Csit is migrating VAT scripts to PAPI, therefore python package for vpp is needed in honeycomb tests. Change-Id: I724cdd87e7ba899f9d9f95e08f5ce636435f7780 Signed-off-by: Michal Cmarada <mcmarada@cisco.com>
2019-03-11add support for using custom jvpp commitMichal Cmarada1-4/+59
Change-Id: I492541a0a0d6cdc08f03e4c47fc86f22716cf065 Signed-off-by: Michal Cmarada <mcmarada@cisco.com>
2019-03-06add dpdk-plugin for honeycomb download artifactsMichal Cmarada2-2/+2
Change-Id: I90c491e8039b20bbb0ef23bb1912e275030bef0b Signed-off-by: Michal Cmarada <mcmarada@cisco.com>
2019-03-05CSIT-1362: migrate package download scripts for hc2vpp jobsMichal Cmarada2-101/+142
As part of Bionic update for honeycomb (HC2VPP-372) scripts need to be updated. Switching to Packagecloud instead of nexus simplifies this process. Change-Id: I243367e8c1d7c3de5890d6846c199563cef457bf Signed-off-by: Michal Cmarada <mcmarada@cisco.com>
2019-02-20FIX: Static variables all over the place for per patchPeter Mikus1-5/+5
- Incredible why is it so hard to write scripts not hardcoding anything. Change-Id: I48cf2cc3d25f9665a9ff7ca26756d3b70cdd2f9c Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-02-08CSIT-845 Capture VPP core-dump from vpp crash on DUTsPeter Mikus1-1/+10
Change-Id: I987dcd5092d8527c9aefbe093e1ed7ae144d191b Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-02-05FIX: Cleanup docker images per jobPeter Mikus1-1/+1
Change-Id: Ib14d989d5f44a2aeeec122e2f63a9832a213f920 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-11-23Move reservation directory to TG node.Vratko Polak1-10/+14
Testing has showed SSH access to DUT affects performance. Downside: No support for non-Linux TGs. Complication: After merge there might be conflicts with older jobs, including jobs for other branches. Change-Id: Icefddc5a9ca8f4d830460e53a82bb45231f7222e Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-10-22Per patch: multiple BMRR callsVratko Polak1-25/+56
This is to reduce sensitivity on testbed unstable performance. Also add topo_cleanupbefore every pybot run to avoid issues with VPP uninstall. TRACE prints are left there to simplify investigation of false positives if/when they happen. Change-Id: I9b0cdcfbbe4aa0735a0596746ac32c9e93af0897 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-09-13CSIT-1282 Migrate from Nexus.fd.io to packagecloud.ioPeter Mikus1-179/+0
Change-Id: Ib4e72dc8e3c0fedfcd702f4f97bc4f26cbc642e9 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-08-30CSIT-1135: Scripts for VPP per-patch testingVratko Polak2-0/+100
+ Scripts do not rely on (other) bootstraps. + Perf verify bootstrap is also the new style sript now. + Scripts are divided to functions for better re-use. + Functions are sourced from small number of large "library" files. - Still using jumpavg from pipy. - Perpatch has specific simplified parsing (instead of the PAL one). - Bash style document is in a separate Change. Change-Id: If88fa528ce155ea86b614e3d77c0550b91bbdf11 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-08-10CSIT-1193 De-duplicate bootstrap scripts into onePeter Mikus1-0/+118
- DPDK and VPP bootstrap merged into one (ligato will follow). - Added more error detections - Added topo-cleanup.py to cleanup TB before and after test. - Remove installation of VPP Change-Id: I7a86117eb03cbe4ee8fde47baeed58bc86c0dfb2 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-08-06hc2vpp-csit-verify: use vpp packages based on vpp-versionMarek Gradzki1-2/+10
The hc2vpp-csit-verify allows to run HC CSIT tests per hc2vpp patch. The job should not use most recent vpp artifacts for respective branch ('RELEASE'), but version specified in the vpp-version file. The vpp-version file is used by hc2vpp-integration job to produce honeycomb package. Change-Id: If2811a01256e8217de50d220082dbc204443b54a Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
2018-07-30HC Tests: remove trusty from download_hc_*.sh scriptsMarek Gradzki2-16/+4
Ubuntu 14.04 packages are not being published since 1710. Change-Id: I1372fe0eb4eab3c6c3e0f3a7ee435104f3c6f0fb Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
2018-07-30HC Tests: do not use vpp-dbg in CSIT testsMarek Gradzki2-6/+6
Honeycomb package does not require VPP debug symbols and typical HC user does not have them installed. Change-Id: I2cae502cad3216304d6f7ee44913f30c97fb5a20 Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
2018-07-25HC Tests: do not install vpp-dev in hc2vpp-csit-verifyMarek Gradzki1-3/+3
The download_hc_build_pkgs.sh is used by hc2vpp-csit-verify and hc2vpp-csit-verify-odl jobs. These jobs download latest VPP packages and unlike other HC CSIT jobs, build hc2vpp. This patch removes vpp-dev/vpp-devel packages from the list of installed VPP packages to unify the environment with the other HC CSIT jobs. Change-Id: I28742afda05cd85675619a92fbc10f4565bdb321 Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
2018-07-23HC Tests: remove vpp-dpdk-dkms dependencyMarek Gradzki2-12/+3
The vpp-dpdk-dkms is not needed for current VPP versions. Change-Id: I9c1a79fb940b2ba0f332792d4fc088f49f9ee191 Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
2018-07-23HC Tests: disable NSH pluginMarek Gradzki2-14/+18
Change-Id: Ic382b625e5e7201ecc2a2937c15646806c594c61 Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
2018-06-06HC Tests: reenable NSH plugin (CSIT-994)Marek Gradzki2-18/+14
Reverts https://gerrit.fd.io/r/#/c/12572/ Change-Id: Ic55016e3c257a81440332a212e4c0d83e1990668 Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
2018-05-31CSIT-1055: Pkg download script to use package system not curlPeter Mikus2-95/+154
- Rework VPP package download script Change-Id: I51aca96fc3b834d8e17cf349a5a7b9d7105f2184 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-05-15HC tests: disable NSH plugin (CSIT-994)Marek Gradzki2-14/+18
This reverts https://gerrit.fd.io/r/#/c/12209/ Change-Id: I1de4ce6e96644881aa14adf6765e8a67b286595d Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
2018-04-27HC tests: reenable NSH plugin (CSIT-994)Marek Gradzki2-18/+14
Reverts https://gerrit.fd.io/r/#/c/11088/ Change-Id: Ib7b70d33f4a8110656dd39f25b7f5a67a2f52104 Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
2018-03-13HC Tests: disable NSH pluginMarek Gradzki2-14/+18
NSH artifacts in Nexus are outdated and crash VPP. Reenable NSH after it is fixed (CSIT-994). Change-Id: I3a0367682d62d5ccdbf008336ed682e7ab9032a0 Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
2018-02-28Update of VPP_STABLE_VER files + fix Centos dep listPeter Mikus2-2/+2
Change-Id: Icd149927c6b2893f8f716df29d8de475e809be49 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-02-23Adapt hc2vpp-csit bootstrap scripts to HC2VPP-285/CIMANAGE-22Marek Gradzki1-5/+11
Since https://gerrit.fd.io/r/#/c/10668/ and https://gerrit.fd.io/r/#/c/10669/ honeycomb packages from stable branches no longer depend on single VPP version. This patch updates download_hc_pkgs.hc script, used by hc2vpp-csit jobs, to use the latest honeycomb package in such case. Change-Id: If5b006e72caa8cc905137b1bf02af7d9e927e37a Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
2018-01-24FIX: Ignore removing dangling images if there aren't anyPeter Mikus1-1/+1
Change-Id: I0be23e67cfdc54169b9787e90eede28b32406c8b Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-01-10Adapt to hc2vpp refactorMarek Gradzki1-1/+1
Follows: https://gerrit.fd.io/r/#/c/10040/ Change-Id: I234cd795f5b191e413e4b5e3c05294278b1752a8 Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
2017-10-31Update of VPP_STABLE_VER files and DPDK_STABLE_VER fileJan Gelety2-2/+2
- use new vpp ref build - ubuntu 16.04: 18.01-rc0~156-gae5a02f~b3093_amd64 - use new vpp ref build - centos7: 18.01-rc0~156_gae5a02f~b3090.x86_64 - use new dpdk version: 17.08-vpp2 - builds tested by semiweekly jobs: https://jenkins.fd.io/view/csit/job/csit-vpp-verify-master-ubuntu1604-semiweekly/85/ https://jenkins.fd.io/view/csit/job/csit-vpp-verify-master-centos7-semiweekly/85/ - remove vpp-debuginfo centos7 artifact as not provided for new versions Change-Id: I18445feac98304e7e7ecdf77968acebf2d5aef09 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-10-16CSIT-841 Optimize creating of vnf-agent docker image Part IPeter Mikus1-2/+7
- Optimize building of prod_vpp_agent docker image by using dev_vpp_agent docker image pulled from dockerhub/ligato instead of building on slave. - Add detailed logs from every POD deployed in namespace. - Hardening condition for considering PODs Running. Change-Id: I9f771d6365d38fef2ec2e00ab642853e6a44ad03 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-10-12CSIT-748 vnf-agent integrationPeter Mikus1-0/+132
CSIT-773 Implement RF keywords for k8s - Implementation of Test Suite Setup for Ligato vnf-agent testing - Implementation of KubernetesUtil for controlling kubectl - Yaml templates for L2XC topology with 1cswitch and 1cnf - Yaml templates for L2BD topology with 1cswitch and 1cnf - ligato bootstrap script for creating vnf-agent image Change-Id: Iebefde0eb984a27a0afcdf29fe549ca4edf8a61e Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-09-06HC Test: re-enable NSH tests, minor fixesselias2-12/+10
NSH plugin was fixed in https://gerrit.fd.io/r/8218 - updated lispGPE test data - added missing teardown to multi-IP traffic test - marked L2-fib update revert case as failing Change-Id: I5cf8c718e808d5d8cb69e2f769c829c868bf9924 Signed-off-by: selias <samelias@cisco.com>
2017-08-25HC Test: Disable NSH plugin installation and testsselias2-10/+12
- VPP refuses to start with vpp-nsh-plugin installed Change-Id: If1ca45295c63094d2542fc829b8eae7dc0e4977c Signed-off-by: selias <samelias@cisco.com>
2017-06-30CSIT-619 HC Test: Honeycomb performance testing - initial commitselias2-31/+53
- keywords and scripts for HC performance testing setup - basic performance suite: operational data read - traffic script and keywords used in tests Change-Id: Ic0290be73a7c925ea2561f8cd2524c5cb83fcda2 Signed-off-by: selias <samelias@cisco.com>
2017-06-29CSIT-687: Directory structure reorganizationTibor Frank9-0/+1045
Change-Id: I772c9e214be2461adf58124998d272e7d795220f Signed-off-by: Tibor Frank <tifrank@cisco.com> Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>