aboutsummaryrefslogtreecommitdiffstats
path: root/resources/libraries
AgeCommit message (Collapse)AuthorFilesLines
2020-07-31Framework: Perf stat capturingPeter Mikus4-10/+84
Change-Id: I3bbe1fe0073ddeead5219993675f24955e8c3dfd Signed-off-by: Peter Mikus <pmikus@cisco.com>
2020-07-30Introduce per DUT configurable statspmikus2-17/+68
- test/suite/global - binary logic is not working Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: Ia3d81cbf2c5f04d1093a0a408c84a9ffc6f3eef0
2020-07-28Soak: Avoid a possible deadlock.Vratko Polak1-3/+5
Change-Id: I31c2d7744b5cd3021132fb188480b8edec74986c Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2020-07-24NDRPDR: Allow smaller min_rate, 9001 ppsVratko Polak1-12/+16
+ Latency measurements need more than 9000 pps. - Previously 0% measurement used 9500 pps. Change-Id: Ic0841de096dfa8a61329f98aa1ba6d3f0ce60c66 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2020-07-23FIX: Log required cli_cmd not "cli_inband"Jan Gelety1-2/+2
Change-Id: If0975b1d54882390c5be418927e2961d0f4c8429 Signed-off-by: Jan Gelety <jgelety@cisco.com> Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2020-07-23perpatch: Echo MAKE_PARALLEL_* var before buildJuraj Linkeš1-1/+15
VPP uses MAKE_PARALLEL_FLAGS or MAKE_PARALLEL_JOBS to limit the number of cpus to use during build, so emit a line on stdout if it's used. Change-Id: I669398d474d172abb6c848a45f24f1bdd56990d8 Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2020-07-16Remove remains of WRK testsTibor Frank7-277/+0
Change-Id: If61783fb717757c6189f06924412bd079e15a08f Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-07-13Soak: Do not allow negative lossVratko Polak2-2/+11
Change-Id: I6da359d25edc415e44263d3f85f166369e564987 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2020-07-13Soak: Fix worker exception passingVratko Polak1-2/+10
Change-Id: I636f020e97df1b37ac8b6a30af511eebe611b56f Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2020-07-13Soak: Fix failure conditionVratko Polak1-3/+3
Previously, number of directions was not taken into account. Also, ideally PLRsearch never reports value under the hard minimum, so successful results are now required to be more than 10% better. Change-Id: I8622726b97bd1da3e139c8044a2932837fc268b7 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2020-07-09Framework: Allow change of MRR settingspmikus1-24/+39
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: Ie88f0df239725a4de62d727e1923cdb3ad040809
2020-06-30make graph node variant can be configured from gerrit triggerYulong Pei4-1/+33
for example, below will trigger VPP with default code path test in CSIT, "csit-2n-clx-perftest mrrAND64bANDnic_intel-xxv710ANDeth-l2bdbasemaclrnNOTdrv_avf" and below will trigger VPP with avx512 code path test in CSIT, "csit-2n-clx-perftest icl mrrAND64bANDnic_intel-xxv710ANDeth-l2bdbasemaclrnNOTdrv_avf" Change-Id: Id3abf932203ce00f34f8643c5bc4d5fc4d3e6efb Signed-off-by: Yulong Pei <yulong.pei@intel.com>
2020-06-23Revert "Tweak TRex cores and RDMA pps limit"Vratko Polak1-6/+2
This reverts commit 925c5bfcffb2bc6b833a8e64b7f3a06bbca52197. It was affecting 2005 performance, confusing comparisons. The revert includes the RDMA limit. Change-Id: I9c31b061ee59bc5cb14d623ac98a65763ef75f1c Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2020-06-11Update selection of report-iterative test setsTibor Frank1-1/+4
- Create the same directory structure for report-iterative as it is for report-coverage. - Move files from report-iterative directory to created sub-directories. - Rename the moved files to keep the convention defined in report-coverage. - Update the corresponding functionality in resources/libraries/bash/function/common.sh The patches: - https://gerrit.fd.io/r/c/csit/+/27486 - https://gerrit.fd.io/r/c/csit/+/27484 - https://gerrit.fd.io/r/c/csit/+/27485 must be updated. Change-Id: I1aaf22690e3df5abf56893bb1d2d380debc54ddd Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-06-10NAT44 EI testsMaros Mullner1-18/+46
Signed-off-by: Maros Mullner <maros.mullner@pantheon.tech> Change-Id: Ib5f58f60a1409ed139e2846793bf52fdc02a6571
2020-06-09Remove leading tc[nn] from test namesJuraj Linkeš3-21/+13
The test names are unique without it and the information doesn't add anything extra. Change-Id: Idc7d6d1d21c8c05691e1757227a0a3787406d370 Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2020-06-03FIX: IP4 IP6 3n-onlypmikus2-3/+3
ARP not resolved as ARP plugin is not in use. Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I655d39794f99e32a2f3905154d78e83853356ccf
2020-06-03Fix DPDK build on armJuraj Linkeš1-0/+6
Directive #include <file> in GCC implementation searches for files in a standard list of system directories, which leads to a build error on Taishan arm machines: /tmp/openvpp-testing/dpdk/lib/librte_ethdev/rte_ethdev.h:4287:10: fatal error: rte_ethdev_core.h: No such file or directory #include <rte_ethdev_core.h> Fix this by replacing the directive with #include "file" which searches for files first in the directory containing the current file and other directories only after that. Change-Id: If283b81c992c001a2f980312cdd99053c3d703d9 Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2020-05-27FIX: check if testpmd is aliveJan Gelety1-3/+5
Change-Id: I12f21a4a7ae7c8593c42fa8e6cc4d65e36d41270 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2020-05-28Remove hugepage dirs when killing dpdkJuraj Linkeš1-1/+1
There could be directories under /dev/hugepages/ so remove those as well. Change-Id: I8ecdde159b8e0049460d0bcdc8b1a2c85b1ed25f Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2020-05-26FIX: do not fail when skipping patch for l3fwdJan Gelety2-3/+5
Change-Id: I1159fb29d43f61628922cdbd51313f710aa72f4a Signed-off-by: Jan Gelety <jgelety@cisco.com>
2020-05-26FIX: add dpdk mrr_weekly and report_iterative job specsJan Gelety1-4/+5
- split job specs to directories Change-Id: I9a71621216ab0bdf85d147ce03f473e7cbb0b266 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2020-05-26Add csit-vpp/dpdk-perf-report-coverage job and job specificationsJan Gelety1-0/+8
- note: currently dpdk report-coverge test sets are equal to dpdk report-iterative test sets Change-Id: Ib9a718bfea4b24842742f49ee2eca022aa8a08e5 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2020-05-18Add csit-vpp-perf-report-iterative jobJan Gelety1-0/+5
- job will be used to collect vpp performance iterative data for csit report Change-Id: I4cff5caa0a97d08b11f3eb9b72963deaf1b04c73 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2020-05-15Performance: Tests with virtio driver in VMPeter Mikus1-7/+8
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I20e01dfe83a961dc8202d33783a678d38e71cff2
2020-05-14FIX: Download only vpp packagesJan Gelety1-1/+1
Signed-off-by: Jan Gelety <jgelety@cisco.com> Change-Id: I88682b972947d73ae8433b550bd5e96b0b7c2c76 (cherry picked from commit 36237cf89a092fee57faa6b2b1726d40df493845)
2020-05-14Execute also show runtime CLIVratko Polak1-0/+2
Example of a test with missing info: https://logs.fd.io/production/vex-yul-rot-jenkins-1/csit-vpp-perf-mrr-daily-master-2n-clx/287/archives/log.html.gz#s1-s1-s1-s4-s8-t3-k2-k9-k1-k1-k4-k1 - Missing any -outpt and -tx nodes. - Zeros in vectors in rdma-input node (even though calls are there). Placing the CLI call after the stats one, to confirm stats does not "break" the CLI. + Using an earlier parent, to dodge some test failures. Change-Id: I79072b54b6bf964dab4f21428e186394bafda72a Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2020-05-13Infra: PIP installation freezepmikus1-3/+3
+ Waiting for Docker image to be updated. Then next step I will disable any update attempt. Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I92d4e27be0537a95473cd723a45e6185b26ce599
2020-05-13job-specs: new job test spec files including test count and durationsJan Gelety12-3152/+15
Change-Id: I4ad87092bff1c072051ca1c7243d8dedb1c4576e Signed-off-by: Jan Gelety <jgelety@cisco.com> Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2020-05-07FIX: SRv6 encapJan Gelety1-1/+2
Change-Id: I4b75b343fc144489d81f82dbb4917b4a70a9911b Signed-off-by: Jan Gelety <jgelety@cisco.com>
2020-05-12FIX: L3fwd properlypmikus1-4/+4
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: Ibdfc0350a101c4815f25456176e25bb1d90fd881
2020-05-11CSIT-1597 API cleanup: ipsecJan Gelety1-2/+6
- cover API changes in VPP: https://gerrit.fd.io/r/c/vpp/+/26276 - update vpp stable to version 20.05-rc0~727 Change-Id: I39a0b5e60fac6a74aff2426f6a448c0e117ab647 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2020-05-07perf: refactor 'setup suite topology interfaces'Dave Wallace2-73/+79
- and 'setup suite topology interfaces no tg' to use a common keyword to create suite variables using the required topology information. Change-Id: I46894948bc86eb7ce72d036e5b84f09c5c1385db Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
2020-05-06FIX: dot1q-ip6pmikus1-1/+1
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: Ied48646bd9de41e5a55e0006440d057c5fddf694
2020-05-06Separate files needing GPL licenseVratko Polak4-449/+39
+ Keep apache license for now, until this is completed: https://wiki.fd.io/view/TSC/Relicensing_Procedure + Add utilities for switching license comment blocks. - They do not preserve attributes, so executable flag is lost. + Move the affected files to GPL/. + Update paths so files are executed from the new location. + Change the way scripts are started to do not require executable flag. + Employ OptionString when constructing longer command lines. + Move also PacketVerifier.py and TrafficScriptArg.py as they are linked with traffic scripts. + That means the two files are outside "resources" package tree now. + Added __init__.py files so relative imports work in new package tree. + Start traffic scripts as python modules to allow relative imports. + Once again needed because they are outside the default PYTHONPATH. Change-Id: Ieb135629e890adbaf5b79497570f3be25b746f9f Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2020-05-06Performance: Fix l3fwd in 3nodepmikus1-1/+2
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I32fd935078fb117bb1570e20a11baa2de46447e8
2020-05-04FIX: IPsecvagrant1-4/+0
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Iacd7aa49d9832233033fe18fc228ccd45c12b4db
2020-05-04Print more info when checking out oper branchVratko Polak1-0/+7
Change-Id: Ic8d1080edacea1d27eb80e61f48cd4cd4430c139 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2020-05-04VPP-DEV API Coverages: SRv6Jan Gelety3-83/+204
Jira: CSIT-1698 Change-Id: I6d9154284990df8877850e4014716510016e485b Signed-off-by: Jan Gelety <jgelety@cisco.com>
2020-04-29FIX: dot1qip4vxlan-l2bdPeter Mikus1-2/+2
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Ia4415090263357d16cfd5f5bc93931ded5688557
2020-04-28CSIT-1597 API cleanup: lispJan Gelety5-1303/+189
- cover API changes in VPP: https://gerrit.fd.io/r/c/vpp/+/24663 - update vpp stable to version 20.05-rc0~637 - remove unused L1 and L2 lisp KWs Change-Id: I2672b6a375ad70c82f331dcc991c145e868108b9 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2020-04-27Performance: MLX best practicePeter Mikus2-4/+52
- Part II Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I869a3d7e051dcbae3a230d4646219e70e5de2e87
2020-04-27Performance: TRex approximatedDuration and approximateRatePeter Mikus2-4/+23
- API to provide duration for send and receive traffic Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Id186a200be66b7703348e6fd3099ffd405e915ae
2020-04-27FIX: NF_density IPv4 profilePeter Mikus1-2/+2
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I471c0cb98c24416d893248b55b376b03a4b8830a
2020-04-27FIX: NAT44 3-node testsPeter Mikus1-1/+1
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I3d9074175e1aaf5afba4e351790644df4ad33914
2020-04-23Fix 3n ip4 scale initVratko Polak1-1/+1
Last argument to Vpp Add Ip Neighbor should be a MAC address. Change-Id: Ia93ddf68aa2b8647c66b6a72210db3a8a01b81fb Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2020-04-23FIX: Mellanox jumbo framesPeter Mikus2-34/+29
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I84b3c07e22a313e96ac59fc7818960c502507651
2020-04-23Performance: DPDK refactorPeter Mikus19-240/+1062
+ Rework BASH scripts (more code to python). + Move BASH into libraries. + Allows RDMA usage. + Fix 9000B tests. + Rename confusing l2fwd -> testpmd. + Fix suite setup. + Fix PCI whitelist to not accidentally pickup wrong interface. + Fix deprecated DPDK cli arguments. - MLX5 jumbo are disabled on NIC (i will increase separately). https://jenkins.fd.io/job/csit-dpdk-perf-verify-master-2n-clx/6/console (l3fwd still broken) - MLX5 IMIX seems to be some TRex issue with IMIX for mlx5 (i will handle separately) Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I31d1b67305fa247cb5e1f57e739d3ef30dc1a04b
2020-04-22FIX: NF_density MAC addressesPeter Mikus4-30/+30
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I0e773060c344fda7b06937a81a53863a96a4373a
2020-04-20FIX: NF_density testsPeter Mikus1-5/+7
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Ic305d135b14697332436d6afd76173eff0c3874b