aboutsummaryrefslogtreecommitdiffstats
path: root/resources/libraries
AgeCommit message (Collapse)AuthorFilesLines
2020-04-23Performance: DPDK refactorPeter Mikus19-240/+1062
+ Rework BASH scripts (more code to python). + Move BASH into libraries. + Allows RDMA usage. + Fix 9000B tests. + Rename confusing l2fwd -> testpmd. + Fix suite setup. + Fix PCI whitelist to not accidentally pickup wrong interface. + Fix deprecated DPDK cli arguments. - MLX5 jumbo are disabled on NIC (i will increase separately). https://jenkins.fd.io/job/csit-dpdk-perf-verify-master-2n-clx/6/console (l3fwd still broken) - MLX5 IMIX seems to be some TRex issue with IMIX for mlx5 (i will handle separately) Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I31d1b67305fa247cb5e1f57e739d3ef30dc1a04b
2020-04-22FIX: NF_density MAC addressesPeter Mikus4-30/+30
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I0e773060c344fda7b06937a81a53863a96a4373a
2020-04-20FIX: NF_density testsPeter Mikus1-5/+7
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Ic305d135b14697332436d6afd76173eff0c3874b
2020-03-31FIX: ip4Jan Gelety1-1/+1
Change-Id: I57fcb06c72caf517231f09478d9d6089d2f46af4 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2020-04-17FIX: Proper NUMA computePeter Mikus2-1/+4
+ FIX for Vratko's FIX Change-Id: Ia6ff137120d84bdd2b9e02e3e935c62d1c732b7b Signed-off-by: Peter Mikus <pmikus@cisco.com>
2020-04-17Fix numa detectionVratko Polak1-1/+1
On 3n-hsw, xl-710 is numa 1. The old code returned 0, causing performance regression. Fixes: 14a71b74b414df7616ccb5ada3d50ecb90d96bae Change-Id: I81d3f711b6a37438f6411e29baafae9dec1c00a4 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2020-04-17VPP-DEV API Coverages: IPSEC interfaceJan Gelety3-324/+655
+ some pylint fixies Change-Id: I650ce16282ae953a1a5ee96e810702c01f71efd6 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2020-04-14FIX: RDMA typoPeter Mikus1-1/+1
Change-Id: Ie2f11cd5144daf249200fe07430b0809185bccce Signed-off-by: Peter Mikus <pmikus@cisco.com>
2020-04-09Performance: FIX T-Rex configPeter Mikus1-2/+3
- MLX, ENA - Part I Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I9f4b407770515fe6009ef5dfdba2b27fa2ff654f
2020-04-08FIX: Add show log output when test failed.Peter Mikus2-1/+7
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I6bdce8156ba214be210c195a9f3effd718301a86
2020-04-06Ansible: Speed up by pipeliningPeter Mikus1-2/+6
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I3ad5675cda017b3dcf8cba88d56d5d6c11184e20
2020-04-06Improve pf layerPeter Mikus27-1771/+1446
+ Merge single/double link + Introduce _pf{n}[0] variables so we can access physical function same way as virtual function + Cleanup code by moving complex logic to python + Prepare code for multiple vf functions Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Ic2e74a38bfa146441357de8f0916aeb638941c49
2020-04-02Fix: select correct oper branch checkout_csit_for_vppJan Gelety1-1/+4
Signed-off-by: Jan Gelety <jgelety@cisco.com> Change-Id: I2e72b7e136d3907a038cb7729c11d155a12c486f (cherry picked from commit 9e2e4eaa2c6854eee47f7057d16b75339f453f89)
2020-04-01Tweak TRex cores and RDMA pps limitVratko Polak1-2/+6
The previous values lead to duration stretching, which affects MRR results (making receive rate bigger than it really is). + Move timestamp for starting of traffic, the previous position was too conservative. Change-Id: Ie983f0d3eacf56d57caa551d1b7fbb87ece6c158 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2020-03-31SRv6: Make show command output visibleVratko Polak1-12/+3
Change-Id: Ie8764f1746fa51d8b6e8621db68ffd2966168a07 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2020-03-27CSIT-1597 API cleanup: aclJan Gelety1-43/+42
- cover API changes in VPP: https://gerrit.fd.io/r/c/vpp/+/26184 - update vpp stable to version 20.05-rc0~424 Change-Id: Ie621a29db25755151bfee76a045a423fd1267ada Signed-off-by: Jan Gelety <jgelety@cisco.com>
2020-03-25FIX: vxlan_add_del_tunnel in TestConfig.pyJan Gelety1-4/+7
Change-Id: I1e4ab1b40fd4a2f48df1dc33b7b17266382df20b Signed-off-by: Jan Gelety <jgelety@cisco.com>
2020-03-24CSIT-1597 API cleanup: srv6Jan Gelety2-52/+27
- cover API changes in VPP: https://gerrit.fd.io/r/c/vpp/+/25647 - update vpp stable to version 20.05-rc0~398 Change-Id: I5ebc84a702264b0b37e3886b48ec0713d174f880 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2020-03-19perf: Fix broken hoststack testsDave Wallace3-14/+14
- Rename NSIM attribute names as changed in b9f4ba11 Change-Id: I6bc232c9954cfd9004d1d0cf22446957e78a641a Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
2020-03-18FIX: qsz typoPeter Mikus1-2/+2
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I56e87868de0bb45e863f1d806e2efc3f5ec5df96
2020-03-17NodePath: Make path computation deterministicVratko Polak2-8/+10
In Python3, set operations seem to result in indeterministic order. + Remove verbose logging from topology.py Change-Id: I47cc90637a0b2969e1686b4216b7d8fe4fe2aaab Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2020-03-17CSIT-1597 API cleanup: vpeJan Gelety1-9/+1
- cover API changes in VPP: https://gerrit.fd.io/r/c/vpp/+/25567 - update vpp stable to version 20.05-rc0~352 Change-Id: I205d7d3de48d480e070d3e2d3e3ab83480b69c77 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2020-03-17FIX: VHOST vppPeter Mikus3-23/+17
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Id0d41a2e62ee6cce212fb2c09a0357d794426a00
2020-03-16CSIT-1597 API cleanup: vxlanJan Gelety2-23/+15
- cover API changes in VPP: https://gerrit.fd.io/r/c/vpp/+/25569 - update vpp stable to version 20.05-rc0~345 - some pylint fixies in Policer.py Change-Id: Iba2c877d0e74526c69826c5ec4afd64ed2055d31 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2020-03-16Final changes for AWS.Maros Mullner2-9/+3
Modified cpuutils numa to work with aws 18xlarge instances. Added dmidecode package to calibration role as is not installed by default. Added required constants Signed-off-by: Maros Mullner <maros.mullner@pantheon.tech> Change-Id: I99608d9df3cff0b085ad26c30e339216b17581eb
2020-03-13Use separate module for ip address objectJan Gelety5-62/+85
Reason: with upcomming vpp api changes the ip object will be used in more csit python libraries, e.g. InterfaceUtil.py, so we need to avoid circular import issue (e.g. InterfaceUtil.pyu <-> IPUtil.py) Change-Id: Ia658b187d4e326f58e33019dd54f8ac7b9137d78 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2020-03-12rls2001 perf: fix hoststack test packet sizesDave Wallace2-7/+13
- TCP packet size is 1460B not 9000B - QUIC packet size is 1280B not 9000B Change-Id: I6604a74fa533db4ac782782c85ea54038688627a Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
2020-03-10CSIT-1597 API cleanup: policerJan Gelety1-26/+27
- cover API changes in VPP: https://gerrit.fd.io/r/c/vpp/+/25566 - update vpp stable to version 20.05-rc0~327 Change-Id: I6af2e4e21c9190e87a63c5a9c8529bbc7f8adf1a Signed-off-by: Jan Gelety <jgelety@cisco.com>
2020-03-10FIX: typo in VppCounters.pyJan Gelety1-3/+3
Change-Id: I4b5955af9732dd3ef185a618ffcf939d0a05ac17 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2020-03-11FIX: CountersPeter Mikus1-16/+16
Change-Id: Ib7eeea5338491b4bd9ecd96b30da95f5dc116937 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2020-03-10CSIT-1597 API cleanup: ipsecJan Gelety1-16/+16
- cover API changes in VPP: https://gerrit.fd.io/r/c/vpp/+/25529 - update vpp stable to version 20.05-rc0~312-g287d5e109 Change-Id: I6c7b3520f4bb306c3b0b59247b4ba2d5f170686c Signed-off-by: Jan Gelety <jgelety@cisco.com>
2020-03-10Regenerator: Fix pylint errorsTibor Frank2-9/+7
Change-Id: I91458b897003f5d8f7f7ac9214aa824c113cecea Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-03-10Ansible: LTS supportPeter Mikus1-1/+1
- There is currently no other way to support multiple version of playbooks. Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I2ade4a57d726b793e422996e83bf767ac4315488
2020-03-10Make RXQs/TXQs configurablePeter Mikus4-36/+50
Change-Id: Ib30bc4697fcba93a6723ee492a59a0523425f623 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2020-03-10Clean up long lines in nsim.robotDave Wallace1-16/+22
Change-Id: Ic9def0376ecb49c12e63aafa747fcc524ebb79c2 Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
2020-03-09CSIT-1597 API cleanup: l2Jan Gelety2-30/+29
- cover API changes in VPP: https://gerrit.fd.io/r/c/vpp/+/22970 - update vpp stable to version 20.05-rc0~307 Change-Id: I3b4c69ee60b0add12edeb8d5e6ac6006b519593b Signed-off-by: Jan Gelety <jgelety@cisco.com>
2020-03-03perf: Clean up Hoststack testsDave Wallace4-131/+86
- Update test names with clients/streams - Convert test results to JSON output * iperf3 results include bits_per_second * vpp_echo results include both client and server output which includes time in seconds and rx_data/tx_data in bytes which can be used to calculate the average bits per second. Tx and Rx data will always be the same: BPS = (client tx_data * 8) / ((client time + server time) / 2) - Fix WRK test results data formatting errors Change-Id: Ie2aeb665e3cc0739b16f97ba2628eebe6e041d22 Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
2020-02-28bash: tolerate -dev as a package nameVratko Polak1-2/+2
Misbehaving projects can create it, and apt thinks it is a cli option. Change-Id: Icc42231e2d498f976281ce725373c6679fe61fa4 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2020-02-28Fix argument order in MLRsearchVratko Polak1-1/+1
Introduced in last refactor. Luckily, the result were still correct, just with confusing logs and perhaps longer search time in unstable test cases. Change-Id: I26dd5714fb588ea07afe85583b3ab3b4bd53d9ec Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2020-02-25FIX: check if t-rex is running at test setup of all perf testsJan Gelety2-55/+72
Change-Id: I9af632035a1415666b2470c62a41d1b6acbf33c8 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2020-02-25FIX: avoid t-rex suite tear down action to fail successfull testsJan Gelety2-3/+6
- try to kill t-rex only if it is running - do not fail the whole test suite when t-rex test suite tear down action has failed Change-Id: I3748a08a3da4dd3617cb54e8fdd344d49566fc7d Signed-off-by: Jan Gelety <jgelety@cisco.com>
2020-02-21Tox: Add copyright year tox checkerVratko Polak2-2/+72
Only added/edited files already containing copyright notice are checked for the correct year (and only if in first 3 lines). Change-Id: I22c057431847fda3a7dfd4577f8346fadfe4c4f6 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2020-02-18Perpatch: Fix bash ansible callsVratko Polak1-2/+2
The function ansible_hosts got renamed to ansible_playbook in https://gerrit.fd.io/r/c/csit/+/24511 Change-Id: Ife4e7b13f634fcdda95f80c18bc86cfded139b5d Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2020-02-18Add option to run Trex with --force parameter to startMaros Mullner2-6/+11
regardless of ports state. Signed-off-by: Maros Mullner <maros.mullner@pantheon.tech> Change-Id: Iaafb5ff3a53a290ca79506bdb559a32d39570482
2020-02-18Download latest VPP packages for hourly jobsjuraj.linkes1-3/+4
1n-tx2 vpp-device tests are supposed to give us a view of how VPP patches affect VPP device tests, so download the latest packages for them as well. Also replace round brackets with curly brackets in the condition to make it faster according to https://github.com/koalaman/shellcheck/wiki/SC2235. Change-Id: I9caafea3590d04af9cb34d6bb536ff786fe08411 Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>
2020-02-16daily: Do not run nf_density chain_ipsec tests on 3n-hswJan Gelety1-26/+0
Change-Id: I9a1afaf3654b96161c4c1de483c99c1f849b6980 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2020-02-14Aarch64 fixes for vfio-pci in kernel VMjuraj.linkes1-11/+21
- Add enable_unsafe_noiommu_mode for aarch64 architecture to kernel VM init script - Add binding of pci device through /sys/bus/pci/drivers/vfio-pci/bind - Minor refactor to enhance readability of differences between architectures Change-Id: Ib0ec35bfae054582d9ffcf7a82f8f8b3e3e24856 Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>
2020-02-14Ansible: Update DPDKPeter Mikus2-2/+2
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Ia5c1e40b952c14775f2f038d3a8a293335172f47
2020-02-10FIX: set host physical interface mac address to rdma interfaceJan Gelety1-0/+24
Reason is that the traffic generator is initialized with MAC addresses of physical interfaces in the suite setup while rdma interfaces are created later. Change-Id: I2cf182cde20f14778624740a1f0467096c336306 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2020-02-10FIX: Detection if l2fwd/l3fwd is up/downJan Gelety3-3/+3
Change-Id: Ide5de222e8314a0ea0be59f9a478f8d59147f722 Signed-off-by: Jan Gelety <jgelety@cisco.com>