aboutsummaryrefslogtreecommitdiffstats
path: root/resources/libraries/bash
AgeCommit message (Collapse)AuthorFilesLines
2020-05-18Add csit-vpp-perf-report-iterative jobJan Gelety1-0/+5
- job will be used to collect vpp performance iterative data for csit report Change-Id: I4cff5caa0a97d08b11f3eb9b72963deaf1b04c73 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2020-05-14FIX: Download only vpp packagesJan Gelety1-1/+1
Signed-off-by: Jan Gelety <jgelety@cisco.com> Change-Id: I88682b972947d73ae8433b550bd5e96b0b7c2c76 (cherry picked from commit 36237cf89a092fee57faa6b2b1726d40df493845)
2020-05-13Infra: PIP installation freezepmikus1-3/+3
+ Waiting for Docker image to be updated. Then next step I will disable any update attempt. Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I92d4e27be0537a95473cd723a45e6185b26ce599
2020-05-13job-specs: new job test spec files including test count and durationsJan Gelety12-3152/+15
Change-Id: I4ad87092bff1c072051ca1c7243d8dedb1c4576e Signed-off-by: Jan Gelety <jgelety@cisco.com> Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2020-05-12FIX: L3fwd properlypmikus1-4/+4
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: Ibdfc0350a101c4815f25456176e25bb1d90fd881
2020-05-04Print more info when checking out oper branchVratko Polak1-0/+7
Change-Id: Ic8d1080edacea1d27eb80e61f48cd4cd4430c139 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2020-04-23Performance: DPDK refactorPeter Mikus8-0/+611
+ Rework BASH scripts (more code to python). + Move BASH into libraries. + Allows RDMA usage. + Fix 9000B tests. + Rename confusing l2fwd -> testpmd. + Fix suite setup. + Fix PCI whitelist to not accidentally pickup wrong interface. + Fix deprecated DPDK cli arguments. - MLX5 jumbo are disabled on NIC (i will increase separately). https://jenkins.fd.io/job/csit-dpdk-perf-verify-master-2n-clx/6/console (l3fwd still broken) - MLX5 IMIX seems to be some TRex issue with IMIX for mlx5 (i will handle separately) Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I31d1b67305fa247cb5e1f57e739d3ef30dc1a04b
2020-04-06Ansible: Speed up by pipeliningPeter Mikus1-2/+6
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I3ad5675cda017b3dcf8cba88d56d5d6c11184e20
2020-04-02Fix: select correct oper branch checkout_csit_for_vppJan Gelety1-1/+4
Signed-off-by: Jan Gelety <jgelety@cisco.com> Change-Id: I2e72b7e136d3907a038cb7729c11d155a12c486f (cherry picked from commit 9e2e4eaa2c6854eee47f7057d16b75339f453f89)
2020-02-28bash: tolerate -dev as a package nameVratko Polak1-2/+2
Misbehaving projects can create it, and apt thinks it is a cli option. Change-Id: Icc42231e2d498f976281ce725373c6679fe61fa4 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2020-02-21Tox: Add copyright year tox checkerVratko Polak2-2/+72
Only added/edited files already containing copyright notice are checked for the correct year (and only if in first 3 lines). Change-Id: I22c057431847fda3a7dfd4577f8346fadfe4c4f6 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2020-02-18Perpatch: Fix bash ansible callsVratko Polak1-2/+2
The function ansible_hosts got renamed to ansible_playbook in https://gerrit.fd.io/r/c/csit/+/24511 Change-Id: Ife4e7b13f634fcdda95f80c18bc86cfded139b5d Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2020-02-18Download latest VPP packages for hourly jobsjuraj.linkes1-3/+4
1n-tx2 vpp-device tests are supposed to give us a view of how VPP patches affect VPP device tests, so download the latest packages for them as well. Also replace round brackets with curly brackets in the condition to make it faster according to https://github.com/koalaman/shellcheck/wiki/SC2235. Change-Id: I9caafea3590d04af9cb34d6bb536ff786fe08411 Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>
2020-02-16daily: Do not run nf_density chain_ipsec tests on 3n-hswJan Gelety1-26/+0
Change-Id: I9a1afaf3654b96161c4c1de483c99c1f849b6980 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2020-02-04Ansible: Cleanup and speedupPeter Mikus3-13/+36
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Ia2ce482798204ad426f93f334c97e28eb51139fd
2020-01-23FIX: nfv_densityJan Gelety1-32/+32
- use correct osi_layer=L2 (so L2 spoofing check is switched off in case of avf driver) - add pci address information to eth interface in topology file - nfv_density chain_ipsec tests work only with DPDK in current implementation Change-Id: I233c6e5634a14581960c7459b87f11fcee8365bd Signed-off-by: Jan Gelety <jgelety@cisco.com>
2020-01-22Generate tests in deterministic orderVratko Polak1-1/+2
Change-Id: I47e45f395976fd65a8da0e93bc33588cc213c79e Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2020-01-20reduce test cases for 2n-dnv and 3n-dnv mrr daily testYulong Pei2-202/+2
since dnv platform is to use by low end market product, no need care more about too much flows performance test. Change-Id: Id7204b0353cbf968e641f14ed980f01af75971b2 Signed-off-by: Yulong Pei <yulong.pei@intel.com>
2020-01-17perf: add TCP Iperf3+LDPRELOAD test suiteDave Wallace1-3/+3
Change-Id: Icff49fb31cce342a2a4ae799e844ec91f9e5e366 Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
2020-01-16FIX: remove 4drc nfv_density chain ipsec tests from 3n-hsw daily jobJan Gelety1-12/+0
- not enough cpu cores reported Change-Id: If3ddbbf4f5af741f328c45ac6b8c874e61d348ab Signed-off-by: Jan Gelety <jgelety@cisco.com>
2020-01-10Trending: new daily setJan Gelety13-258/+2994
New daily sets are prepared based on information in https://gerrit.fd.io/r/c/csit/+/24073/1/docs/job_specs/perf_tests_job_specs.md and previous test set definitions in docs/job_specs/test_select_list_[2n|3n]_[clx|skx|hsw|tsh|dnv].md files. - mrr-daily-2n-clx: 510 TCs (incl. nfv_density), expected exec. time 8:50h - mrr-daily-2n-skx: 525 TCs (incl. nfv_density), expected exec. time 7:55h - mrr-daily-3n-skx: 393 TCs (incl. nfv_density), expected exec. time 11:00h - mrr-daily-3n-hsw: 177 TCs (incl. nfv_density), expected exec. time 7:10h - mrr-daily-3n-tsh: 204 TCs, expected exec. time 21:00h - mrr-daily-2n-dnv: 84 TCs, expected exec. time 2:25h - mrr-daily-3n-dnv: 144 TCs, expected exec. time 6:35h + add some missing test suites + add trex-sl-2n-ethip4udp-1000u15p.py T-Rex traffic profile + correction of TS and TC names and tags in directory tests/vpp/perf/nfv_density/chain_ipsec Change-Id: Icfc86e9af97ed8dd8ccd2a34355c99aad69a28c0 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2020-01-10Autogen: Generate also NIC drivers.Vratko Polak8-112/+89
+ Disallowed -avf- (or -rdma-) as "template" suites. + GBP suite switched to DPDK driver in repo. + Each NIC has its own list of supported drivers, in Constants. + Updated tag expressions for daily jobs: + Feature, ipsec, memif, scale, srv6, tunnels, vhost and vts are tested only with vfio-pci. + Other (base, dot1q, dot1ad) tested with all drivers. + Setup actions currently depend on driver, generated. - The performance_rdma action is trivial for now. - Several tests fail, to be fixed later, e.g. by performance_rdma. + Reconf tests are also supported. + Added DRV_VFIO_PCI tags missing, mainly in density tests. - Vhost suites (density, reconf) are failing, but suites look good. - TCP suites do not support NIC drivers yet. - DPDK obviously not supported. + Use Python 3 in regenerate scripts. + Fix typos binded => bound. + File open modes set either u"rt" or u"wt" everywhere. + Remove a trailing space in an environment variable name. Change-Id: I290470675dc5c9e88b2eaa5ab6285ecd9ed7827a Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2020-01-07Remove leftovers related to XenialVratko Polak1-1/+1
+ File VPP_STABLE_VER_UBUNTU. + Subtree docs/report/vpp_functional_tests/. Change-Id: Ifd9dd922152199de9f1352da709b1533d6c15aba Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-12-16Vagrant: Introduce CentOS8Peter Mikus1-2/+2
+ Full ansible compatibility - Docker currently not working in Centos8 as it was not yet released Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I837091621db6bbebc9fee729496384cabe2f5357
2019-12-16FIX PIP requirement packagesPeter Mikus2-5/+1
+ CSIT will only use packages installed from master PIP requirement.txt file + All CSIT subsequent code must use single function and PIP list for virtualenv - Report/PAL/doc/trending will follow in next patch Change-Id: Ia9150fb05a144182a5a163178d553370ede55cdd Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-12-13Reduce spam from device bootstrapVratko Polak1-0/+6
It uses "declare -f" to paste the complete common.sh file. Twice. The output from ssh remote side still remains visible, but avoiding the spam should ease scrolling to Robot console output. Change-Id: I746484ada7650a6dfa6794e76550757af5413a82 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-12-05Improve quoting of asterisksVratko Polak1-3/+3
When quoted, the asterisks are understood as literal characters. When unquoted, so they act as globs patterns. When used to match files already present in the filesystem, the asterisks should be unquoted. When used to match a package name (not a file), the asterisks should be quoted to prevent the bash expansion, as programs such as apt-get and yum do their own expasion afterwards. Unquoted asterisks for matching package names may happen to work when there are no files to match the bash expansion, but quoted asterisks are sure to avoid accidents. Also, we want an asterisk both before and after "vpp", due to package names such as libvppinfra-dev and python3-vpp-api. Change-Id: I657a24c24a71d865915aba201bd0d3276cb33281 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-12-05FIX: Some leftovers + csit_sut image syncPeter Mikus1-4/+3
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I9b47f9a31c11f155ba5b4676ccf0fc4c413a3942
2019-12-02Refactor jumpavg to be more readable and usableVratko Polak1-3/+4
This is the python3 change, the python2 is still used for testing bisect. + New version is 0.2.0 due to amount o API changes. + Jumpavg is now part of CSIT resource package tree. + Perpatch migrated to new jumpavg. - PAL NOT updated (the update moved to a different Change). Change-Id: I7d7a8bf8a411196c20c2a40a8c64478d6709bc07 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-12-02FIX: Perpatch PY3Peter Mikus2-3/+3
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Iae97cf4490fea38f5f03bdaa120ee7ae48b941ab
2019-11-29Python3: PIP requirementPeter Mikus1-5/+6
- Install via PIP3 - Use virtualenv Python3 interpret Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Iad22b344b418a1d91774d23d5ea17bfd48d394b3
2019-11-19HONEYCOMB: RemovePeter Mikus1-122/+0
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I60d80564050cb786c7b1e0a08f31f8292f82197e
2019-11-18Improve test tag string parsingVratko Polak1-21/+12
Instead of just adding the missing -clx, the new way aims to be forward compatible. The new implementation is quite permissive, ignoring all "word" chars sticking to the trigger word and returning everything after that and space up to the endline. + Unified perftest and devicetest handling. + Consequently, triggers like "devicetest-1n-skx GBP" will work now. Change-Id: I3bda6105195180d35a589a75318f569e36f03461 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-11-13LIGATO: RemovePeter Mikus1-133/+1
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I0c9b8b07ed3a113e24a38faaddd5ed06fae67768
2019-11-11New weekly mrr triggerJan Gelety2-433/+5
Change-Id: Iff21ad109e5f0a8ed06bd561e75c8a708e84c036 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-11-11Remove the leftovers of the old testbed cleanupVratko Polak2-15/+2
Change-Id: I464db6fb6c220f23f2fe69df2c793175975d7b72 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-11-08Prevent many TC triggered by bad tag expressionsVratko Polak1-2/+8
Typical example: Use multiple perftest lines in a comment. Atypical example: Use perftest as an expression (without any ANDs). Fix: Die if "perftest" is found in the tag expression (before prefixing). Change-Id: I0230541b30557ce7a4e9d57c8303cd432f86747d Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-11-07FIX: use correct NIC for mr-daily-master jobJan Gelety1-1/+1
Change-Id: I57bc8c7eda7ea959d92f7e35b7989d64b20743a0 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-11-07Source ansible.sh for entry scripts using cleanupVratko Polak2-0/+4
Change-Id: Iee02577ee0c054feb61edee807182c6808f235b0 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-11-05Cleanup via AnsiblePeter Mikus2-4/+3
+ Remove dependency on topo_ scripts that depends on custom SSH() that depends on framework itself. This way the cleanup is independent of failure in our SSH libs. + Simple ansible command can do cleanup of a machine: ansible-playbook --inventory inventories/lf_inventory/hosts site.yaml \ --limit '10.32.8.18' --tags 'cleanup' + Add vpp_device reset and cleanup. + Remove historical scripts. - Still in testing beta phase. - Need to add SRIOV cleanup. Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I68e23304c7ad01041f51263c328c6e8d9b555cb7
2019-10-29New daily triggersJan Gelety6-12/+285
New daily triggers defined based on requirements defined in https://gerrit.fd.io/r/c/csit/+/22341/34/resources/tools/presentation/doc/trending_test_groups.md Change-Id: I95bff10d9a2e29c712a33f7c043933244b712fd0 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-10-18Autogen checker: Fix difference reporting branchVratko Polak1-2/+3
Change-Id: I85da5ec38643524fa1af7ed7628025a4a52463f5 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-09-12Topology: CascadelakePeter Mikus2-0/+12
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I1533f00dd4b40f9dda82b1e9b5b15a81bbb9f7fb
2019-08-23Introduce reconfig suites, for dot1q+ip4+vxlanVratko Polak1-2/+2
Ticket: CSIT-1551 + Config copied from other suites. + Layer keywords prepared for additional chains. + Renamed "create" argument to "vlan_per_chain". + TrafficGenerator result extraction improvements. + Also unified TG type and subtype checking. + Throughput estimated as PDR for zero PLR. + Actual Qemu start is skipped. + Parse xstats instead of stats in trex stop scipt. - Because stats are unconditionally cleared on each script connect. + Remember start values to get better ReceiveMeasurementResult at stop. + Expose loss count and time as appropriate test message. + Autogen support. + Multiple chain amounts and core densities. - Only 1 additional chain. + Proper TAGs. Documented. + Clarified min framesize tags are for TG-DUT. + Added a TODO concerning overhead values. + Added 118B tag. + Robot performance keywords improvements. + Added missing return value documentation. + Frame size as required test variable, not an explicit argument. + MLRsearch keyword to store result (not into test message). - TODO: De-duplicate: main keyword to measure, minor to set test message. - But implementation uses the fact default arguments are different. + Keywords for starting and stopping background traffic. - No checks whether start-stop pair is complete. + Multiple minor indentation and logging improvements. - Missing / TODOs: - Support also vlan_per_chain=True? - Support dot1q without vxlan? - Support also deletion? - How to package config steps so -reconf can be generated from -ndrpdr? Change-Id: If0270697f9ffa837c34ef802917220a53f156703 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-08-19VPP perf per patch: Reverse the order of testsVratko Polak1-4/+5
If current VPP is broken, we want to fail early. If there is API change, we are more interested in current results, even if parent is likely to fail. Change-Id: I552485bbb9fe0053bae39de7939f94a5971bb63b Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-08-19FIX: Topology reservationPeter Mikus1-35/+0
Last attempt [0] is doing more harm then good. If testbed is down but recovered quickly enough (reboot, temporary ssh connectivity issue, ...) it never gets back into pool making other testbeds overloaded and queued. This patch is suppose to partially revert previous behavior until proper patch will follow. [0] https://gerrit.fd.io/r/c/csit/+/21148 Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I8203946d10d3e7dd51e97519d679246b5dae59e3
2019-08-15TOX: DOC verifyPeter Mikus2-0/+62
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Ifa4de8e60742f5c4cf4c2f377692313e23f9983b
2019-08-14VAT-to-PAPI: Fix HTTP/TCP testsDave Wallace1-2/+2
Change-Id: Ie728bc73eb7429d246e82dd195fc63191c3ac51d Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
2019-08-12FIX: Remove unwanted Jenkins dependencyPeter Mikus1-3/+0
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I7a43c3183dc276fa5e4806f31a52cf5844792d4d
2019-08-09Skip bad testbeds in reservationVratko Polak1-19/+42
Previously, ssh-inaccesible testbeds were handled the same way as reserved, never ending the wait loop. With this, if no testbed is accessible, the job fails early. Change-Id: I01bc79094fe0232a47d795e53e3daa52e8742bac Signed-off-by: Vratko Polak <vrpolak@cisco.com>