Age | Commit message (Collapse) | Author | Files | Lines |
|
Last attempt [0] is doing more harm then good. If testbed is down
but recovered quickly enough (reboot, temporary ssh connectivity
issue, ...) it never gets back into pool making other testbeds
overloaded and queued.
This patch is suppose to partially revert previous behavior until
proper patch will follow.
[0] https://gerrit.fd.io/r/c/csit/+/21148
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I8203946d10d3e7dd51e97519d679246b5dae59e3
|
|
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I7a43c3183dc276fa5e4806f31a52cf5844792d4d
|
|
Previously, ssh-inaccesible testbeds
were handled the same way as reserved,
never ending the wait loop.
With this, if no testbed is accessible,
the job fails early.
Change-Id: I01bc79094fe0232a47d795e53e3daa52e8742bac
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
String "Unknown" is used if test run tag or url is not supplied,
so this change should be backward compatible.
+ Used "runtag", as both "test" and "tag" start with taken "-t".
+ Fixed some pylint violations.
+ Docstring explaining the steps taken and reasoning behind two files.
+ Other minor improvements.
Change-Id: If704d02e51374087fe39ad0f69432477d1b310d3
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
Change-Id: I19be5008067067c2e7c78e7673a9ceaaf2f52c8f
Signed-off-by: Michal Cmarada <mcmarada@cisco.com>
|
|
CSIT-1485
- Measurement results are inconsistent, creating false positives.
- To avoid false positives, sensitivity has to be lowered.
+ Measurements are no more interleaved.
+ Measurement result are no longer filtered.
+ The job now runs faster.
- Ip6base regressions smaller than 4% are tolerated.
+ Ip6base false positives can happen, but less than 10% of the time.
- Part of job parameters is set on ci-management level.
+ Voter script output is improved.
Change-Id: I0ec7d5df8b397daf7ff0277a1137ee9f36d8d866
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
- Csit is migrating VAT scripts to PAPI, therefore
python package for vpp is needed in honeycomb tests.
Change-Id: I724cdd87e7ba899f9d9f95e08f5ce636435f7780
Signed-off-by: Michal Cmarada <mcmarada@cisco.com>
|
|
Change-Id: I492541a0a0d6cdc08f03e4c47fc86f22716cf065
Signed-off-by: Michal Cmarada <mcmarada@cisco.com>
|
|
Change-Id: I90c491e8039b20bbb0ef23bb1912e275030bef0b
Signed-off-by: Michal Cmarada <mcmarada@cisco.com>
|
|
As part of Bionic update for honeycomb (HC2VPP-372)
scripts need to be updated. Switching to Packagecloud instead
of nexus simplifies this process.
Change-Id: I243367e8c1d7c3de5890d6846c199563cef457bf
Signed-off-by: Michal Cmarada <mcmarada@cisco.com>
|
|
- Incredible why is it so hard to write scripts not hardcoding
anything.
Change-Id: I48cf2cc3d25f9665a9ff7ca26756d3b70cdd2f9c
Signed-off-by: Peter Mikus <pmikus@cisco.com>
|
|
Change-Id: I987dcd5092d8527c9aefbe093e1ed7ae144d191b
Signed-off-by: Peter Mikus <pmikus@cisco.com>
|
|
Change-Id: Ib14d989d5f44a2aeeec122e2f63a9832a213f920
Signed-off-by: Peter Mikus <pmikus@cisco.com>
|
|
Testing has showed SSH access to DUT affects performance.
Downside: No support for non-Linux TGs.
Complication: After merge there might be conflicts with older jobs,
including jobs for other branches.
Change-Id: Icefddc5a9ca8f4d830460e53a82bb45231f7222e
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
This is to reduce sensitivity on testbed unstable performance.
Also add topo_cleanupbefore every pybot run
to avoid issues with VPP uninstall.
TRACE prints are left there to simplify investigation
of false positives if/when they happen.
Change-Id: I9b0cdcfbbe4aa0735a0596746ac32c9e93af0897
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
Change-Id: Ib4e72dc8e3c0fedfcd702f4f97bc4f26cbc642e9
Signed-off-by: Peter Mikus <pmikus@cisco.com>
|
|
+ Scripts do not rely on (other) bootstraps.
+ Perf verify bootstrap is also the new style sript now.
+ Scripts are divided to functions for better re-use.
+ Functions are sourced from small number of large "library" files.
- Still using jumpavg from pipy.
- Perpatch has specific simplified parsing (instead of the PAL one).
- Bash style document is in a separate Change.
Change-Id: If88fa528ce155ea86b614e3d77c0550b91bbdf11
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
- DPDK and VPP bootstrap merged into one (ligato will follow).
- Added more error detections
- Added topo-cleanup.py to cleanup TB before and after test.
- Remove installation of VPP
Change-Id: I7a86117eb03cbe4ee8fde47baeed58bc86c0dfb2
Signed-off-by: Peter Mikus <pmikus@cisco.com>
|
|
The hc2vpp-csit-verify allows to run HC CSIT tests per hc2vpp patch.
The job should not use most recent vpp artifacts
for respective branch ('RELEASE'),
but version specified in the vpp-version file.
The vpp-version file is used by hc2vpp-integration job
to produce honeycomb package.
Change-Id: If2811a01256e8217de50d220082dbc204443b54a
Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
|
|
Ubuntu 14.04 packages are not being published since 1710.
Change-Id: I1372fe0eb4eab3c6c3e0f3a7ee435104f3c6f0fb
Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
|
|
Honeycomb package does not require VPP debug symbols
and typical HC user does not have them installed.
Change-Id: I2cae502cad3216304d6f7ee44913f30c97fb5a20
Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
|
|
The download_hc_build_pkgs.sh is used by
hc2vpp-csit-verify and hc2vpp-csit-verify-odl jobs.
These jobs download latest VPP packages
and unlike other HC CSIT jobs, build hc2vpp.
This patch removes vpp-dev/vpp-devel packages
from the list of installed VPP packages
to unify the environment with the other HC CSIT jobs.
Change-Id: I28742afda05cd85675619a92fbc10f4565bdb321
Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
|
|
The vpp-dpdk-dkms is not needed for current VPP versions.
Change-Id: I9c1a79fb940b2ba0f332792d4fc088f49f9ee191
Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
|
|
Change-Id: Ic382b625e5e7201ecc2a2937c15646806c594c61
Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
|
|
Reverts https://gerrit.fd.io/r/#/c/12572/
Change-Id: Ic55016e3c257a81440332a212e4c0d83e1990668
Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
|
|
- Rework VPP package download script
Change-Id: I51aca96fc3b834d8e17cf349a5a7b9d7105f2184
Signed-off-by: Peter Mikus <pmikus@cisco.com>
|
|
This reverts https://gerrit.fd.io/r/#/c/12209/
Change-Id: I1de4ce6e96644881aa14adf6765e8a67b286595d
Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
|
|
Reverts https://gerrit.fd.io/r/#/c/11088/
Change-Id: Ib7b70d33f4a8110656dd39f25b7f5a67a2f52104
Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
|
|
NSH artifacts in Nexus are outdated and crash VPP.
Reenable NSH after it is fixed (CSIT-994).
Change-Id: I3a0367682d62d5ccdbf008336ed682e7ab9032a0
Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
|
|
Change-Id: Icd149927c6b2893f8f716df29d8de475e809be49
Signed-off-by: Peter Mikus <pmikus@cisco.com>
|
|
Since
https://gerrit.fd.io/r/#/c/10668/
and
https://gerrit.fd.io/r/#/c/10669/
honeycomb packages from stable branches
no longer depend on single VPP version.
This patch updates download_hc_pkgs.hc script,
used by hc2vpp-csit jobs, to use the latest honeycomb package
in such case.
Change-Id: If5b006e72caa8cc905137b1bf02af7d9e927e37a
Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
|
|
Change-Id: I0be23e67cfdc54169b9787e90eede28b32406c8b
Signed-off-by: Peter Mikus <pmikus@cisco.com>
|
|
Follows:
https://gerrit.fd.io/r/#/c/10040/
Change-Id: I234cd795f5b191e413e4b5e3c05294278b1752a8
Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
|
|
- use new vpp ref build - ubuntu 16.04:
18.01-rc0~156-gae5a02f~b3093_amd64
- use new vpp ref build - centos7:
18.01-rc0~156_gae5a02f~b3090.x86_64
- use new dpdk version:
17.08-vpp2
- builds tested by semiweekly jobs:
https://jenkins.fd.io/view/csit/job/csit-vpp-verify-master-ubuntu1604-semiweekly/85/
https://jenkins.fd.io/view/csit/job/csit-vpp-verify-master-centos7-semiweekly/85/
- remove vpp-debuginfo centos7 artifact as not provided for new versions
Change-Id: I18445feac98304e7e7ecdf77968acebf2d5aef09
Signed-off-by: Jan Gelety <jgelety@cisco.com>
|
|
- Optimize building of prod_vpp_agent docker image by using
dev_vpp_agent docker image pulled from dockerhub/ligato instead of
building on slave.
- Add detailed logs from every POD deployed in namespace.
- Hardening condition for considering PODs Running.
Change-Id: I9f771d6365d38fef2ec2e00ab642853e6a44ad03
Signed-off-by: Peter Mikus <pmikus@cisco.com>
|
|
CSIT-773 Implement RF keywords for k8s
- Implementation of Test Suite Setup for Ligato vnf-agent testing
- Implementation of KubernetesUtil for controlling kubectl
- Yaml templates for L2XC topology with 1cswitch and 1cnf
- Yaml templates for L2BD topology with 1cswitch and 1cnf
- ligato bootstrap script for creating vnf-agent image
Change-Id: Iebefde0eb984a27a0afcdf29fe549ca4edf8a61e
Signed-off-by: Peter Mikus <pmikus@cisco.com>
|
|
NSH plugin was fixed in https://gerrit.fd.io/r/8218
- updated lispGPE test data
- added missing teardown to multi-IP traffic test
- marked L2-fib update revert case as failing
Change-Id: I5cf8c718e808d5d8cb69e2f769c829c868bf9924
Signed-off-by: selias <samelias@cisco.com>
|
|
- VPP refuses to start with vpp-nsh-plugin installed
Change-Id: If1ca45295c63094d2542fc829b8eae7dc0e4977c
Signed-off-by: selias <samelias@cisco.com>
|
|
- keywords and scripts for HC performance testing setup
- basic performance suite: operational data read
- traffic script and keywords used in tests
Change-Id: Ic0290be73a7c925ea2561f8cd2524c5cb83fcda2
Signed-off-by: selias <samelias@cisco.com>
|
|
Change-Id: I772c9e214be2461adf58124998d272e7d795220f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
|