aboutsummaryrefslogtreecommitdiffstats
path: root/resources/libraries/python
AgeCommit message (Collapse)AuthorFilesLines
2020-04-23Performance: DPDK refactorPeter Mikus8-225/+436
+ Rework BASH scripts (more code to python). + Move BASH into libraries. + Allows RDMA usage. + Fix 9000B tests. + Rename confusing l2fwd -> testpmd. + Fix suite setup. + Fix PCI whitelist to not accidentally pickup wrong interface. + Fix deprecated DPDK cli arguments. - MLX5 jumbo are disabled on NIC (i will increase separately). https://jenkins.fd.io/job/csit-dpdk-perf-verify-master-2n-clx/6/console (l3fwd still broken) - MLX5 IMIX seems to be some TRex issue with IMIX for mlx5 (i will handle separately) Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I31d1b67305fa247cb5e1f57e739d3ef30dc1a04b
2020-04-22FIX: NF_density MAC addressesPeter Mikus2-18/+18
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I0e773060c344fda7b06937a81a53863a96a4373a
2020-04-17FIX: Proper NUMA computePeter Mikus1-0/+3
+ FIX for Vratko's FIX Change-Id: Ia6ff137120d84bdd2b9e02e3e935c62d1c732b7b Signed-off-by: Peter Mikus <pmikus@cisco.com>
2020-04-17VPP-DEV API Coverages: IPSEC interfaceJan Gelety1-315/+575
+ some pylint fixies Change-Id: I650ce16282ae953a1a5ee96e810702c01f71efd6 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2020-04-14FIX: RDMA typoPeter Mikus1-1/+1
Change-Id: Ie2f11cd5144daf249200fe07430b0809185bccce Signed-off-by: Peter Mikus <pmikus@cisco.com>
2020-04-09Performance: FIX T-Rex configPeter Mikus1-2/+3
- MLX, ENA - Part I Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I9f4b407770515fe6009ef5dfdba2b27fa2ff654f
2020-04-08FIX: Add show log output when test failed.Peter Mikus1-0/+4
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I6bdce8156ba214be210c195a9f3effd718301a86
2020-04-06Improve pf layerPeter Mikus3-15/+91
+ Merge single/double link + Introduce _pf{n}[0] variables so we can access physical function same way as virtual function + Cleanup code by moving complex logic to python + Prepare code for multiple vf functions Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Ic2e74a38bfa146441357de8f0916aeb638941c49
2020-04-01Tweak TRex cores and RDMA pps limitVratko Polak1-2/+6
The previous values lead to duration stretching, which affects MRR results (making receive rate bigger than it really is). + Move timestamp for starting of traffic, the previous position was too conservative. Change-Id: Ie983f0d3eacf56d57caa551d1b7fbb87ece6c158 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2020-03-31SRv6: Make show command output visibleVratko Polak1-12/+3
Change-Id: Ie8764f1746fa51d8b6e8621db68ffd2966168a07 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2020-03-27CSIT-1597 API cleanup: aclJan Gelety1-43/+42
- cover API changes in VPP: https://gerrit.fd.io/r/c/vpp/+/26184 - update vpp stable to version 20.05-rc0~424 Change-Id: Ie621a29db25755151bfee76a045a423fd1267ada Signed-off-by: Jan Gelety <jgelety@cisco.com>
2020-03-25FIX: vxlan_add_del_tunnel in TestConfig.pyJan Gelety1-4/+7
Change-Id: I1e4ab1b40fd4a2f48df1dc33b7b17266382df20b Signed-off-by: Jan Gelety <jgelety@cisco.com>
2020-03-24CSIT-1597 API cleanup: srv6Jan Gelety2-52/+27
- cover API changes in VPP: https://gerrit.fd.io/r/c/vpp/+/25647 - update vpp stable to version 20.05-rc0~398 Change-Id: I5ebc84a702264b0b37e3886b48ec0713d174f880 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2020-03-19perf: Fix broken hoststack testsDave Wallace2-12/+12
- Rename NSIM attribute names as changed in b9f4ba11 Change-Id: I6bc232c9954cfd9004d1d0cf22446957e78a641a Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
2020-03-17NodePath: Make path computation deterministicVratko Polak2-8/+10
In Python3, set operations seem to result in indeterministic order. + Remove verbose logging from topology.py Change-Id: I47cc90637a0b2969e1686b4216b7d8fe4fe2aaab Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2020-03-17CSIT-1597 API cleanup: vpeJan Gelety1-9/+1
- cover API changes in VPP: https://gerrit.fd.io/r/c/vpp/+/25567 - update vpp stable to version 20.05-rc0~352 Change-Id: I205d7d3de48d480e070d3e2d3e3ab83480b69c77 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2020-03-17FIX: VHOST vppPeter Mikus2-16/+10
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Id0d41a2e62ee6cce212fb2c09a0357d794426a00
2020-03-16CSIT-1597 API cleanup: vxlanJan Gelety2-23/+15
- cover API changes in VPP: https://gerrit.fd.io/r/c/vpp/+/25569 - update vpp stable to version 20.05-rc0~345 - some pylint fixies in Policer.py Change-Id: Iba2c877d0e74526c69826c5ec4afd64ed2055d31 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2020-03-16Final changes for AWS.Maros Mullner2-9/+3
Modified cpuutils numa to work with aws 18xlarge instances. Added dmidecode package to calibration role as is not installed by default. Added required constants Signed-off-by: Maros Mullner <maros.mullner@pantheon.tech> Change-Id: I99608d9df3cff0b085ad26c30e339216b17581eb
2020-03-13Use separate module for ip address objectJan Gelety5-62/+85
Reason: with upcomming vpp api changes the ip object will be used in more csit python libraries, e.g. InterfaceUtil.py, so we need to avoid circular import issue (e.g. InterfaceUtil.pyu <-> IPUtil.py) Change-Id: Ia658b187d4e326f58e33019dd54f8ac7b9137d78 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2020-03-12rls2001 perf: fix hoststack test packet sizesDave Wallace2-7/+13
- TCP packet size is 1460B not 9000B - QUIC packet size is 1280B not 9000B Change-Id: I6604a74fa533db4ac782782c85ea54038688627a Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
2020-03-10CSIT-1597 API cleanup: policerJan Gelety1-26/+27
- cover API changes in VPP: https://gerrit.fd.io/r/c/vpp/+/25566 - update vpp stable to version 20.05-rc0~327 Change-Id: I6af2e4e21c9190e87a63c5a9c8529bbc7f8adf1a Signed-off-by: Jan Gelety <jgelety@cisco.com>
2020-03-10FIX: typo in VppCounters.pyJan Gelety1-3/+3
Change-Id: I4b5955af9732dd3ef185a618ffcf939d0a05ac17 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2020-03-11FIX: CountersPeter Mikus1-16/+16
Change-Id: Ib7eeea5338491b4bd9ecd96b30da95f5dc116937 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2020-03-10CSIT-1597 API cleanup: ipsecJan Gelety1-16/+16
- cover API changes in VPP: https://gerrit.fd.io/r/c/vpp/+/25529 - update vpp stable to version 20.05-rc0~312-g287d5e109 Change-Id: I6c7b3520f4bb306c3b0b59247b4ba2d5f170686c Signed-off-by: Jan Gelety <jgelety@cisco.com>
2020-03-10Regenerator: Fix pylint errorsTibor Frank2-9/+7
Change-Id: I91458b897003f5d8f7f7ac9214aa824c113cecea Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-03-10Ansible: LTS supportPeter Mikus1-1/+1
- There is currently no other way to support multiple version of playbooks. Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I2ade4a57d726b793e422996e83bf767ac4315488
2020-03-10Make RXQs/TXQs configurablePeter Mikus2-26/+35
Change-Id: Ib30bc4697fcba93a6723ee492a59a0523425f623 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2020-03-09CSIT-1597 API cleanup: l2Jan Gelety1-28/+28
- cover API changes in VPP: https://gerrit.fd.io/r/c/vpp/+/22970 - update vpp stable to version 20.05-rc0~307 Change-Id: I3b4c69ee60b0add12edeb8d5e6ac6006b519593b Signed-off-by: Jan Gelety <jgelety@cisco.com>
2020-03-03perf: Clean up Hoststack testsDave Wallace3-117/+72
- Update test names with clients/streams - Convert test results to JSON output * iperf3 results include bits_per_second * vpp_echo results include both client and server output which includes time in seconds and rx_data/tx_data in bytes which can be used to calculate the average bits per second. Tx and Rx data will always be the same: BPS = (client tx_data * 8) / ((client time + server time) / 2) - Fix WRK test results data formatting errors Change-Id: Ie2aeb665e3cc0739b16f97ba2628eebe6e041d22 Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
2020-02-28Fix argument order in MLRsearchVratko Polak1-1/+1
Introduced in last refactor. Luckily, the result were still correct, just with confusing logs and perhaps longer search time in unstable test cases. Change-Id: I26dd5714fb588ea07afe85583b3ab3b4bd53d9ec Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2020-02-25FIX: check if t-rex is running at test setup of all perf testsJan Gelety1-54/+64
Change-Id: I9af632035a1415666b2470c62a41d1b6acbf33c8 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2020-02-25FIX: avoid t-rex suite tear down action to fail successfull testsJan Gelety1-2/+5
- try to kill t-rex only if it is running - do not fail the whole test suite when t-rex test suite tear down action has failed Change-Id: I3748a08a3da4dd3617cb54e8fdd344d49566fc7d Signed-off-by: Jan Gelety <jgelety@cisco.com>
2020-02-18Add option to run Trex with --force parameter to startMaros Mullner2-6/+11
regardless of ports state. Signed-off-by: Maros Mullner <maros.mullner@pantheon.tech> Change-Id: Iaafb5ff3a53a290ca79506bdb559a32d39570482
2020-02-14Aarch64 fixes for vfio-pci in kernel VMjuraj.linkes1-11/+21
- Add enable_unsafe_noiommu_mode for aarch64 architecture to kernel VM init script - Add binding of pci device through /sys/bus/pci/drivers/vfio-pci/bind - Minor refactor to enhance readability of differences between architectures Change-Id: Ib0ec35bfae054582d9ffcf7a82f8f8b3e3e24856 Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>
2020-02-14Ansible: Update DPDKPeter Mikus2-2/+2
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Ia5c1e40b952c14775f2f038d3a8a293335172f47
2020-02-10FIX: set host physical interface mac address to rdma interfaceJan Gelety1-0/+24
Reason is that the traffic generator is initialized with MAC addresses of physical interfaces in the suite setup while rdma interfaces are created later. Change-Id: I2cf182cde20f14778624740a1f0467096c336306 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2020-02-10FIX: Detection if l2fwd/l3fwd is up/downJan Gelety3-3/+3
Change-Id: Ide5de222e8314a0ea0be59f9a478f8d59147f722 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2020-02-04Revert "Change startup show pci to show ver"juraj.linkes1-2/+2
This reverts commit bb33f1d16f1451253f942da0c55cdea72e71c398. Change-Id: Ida80af970e400460860602db884a943e5599a849 Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>
2020-02-04Add more reconf tests, for IPsecVratko Polak2-100/+121
- Not adding nf_density tests. - Not adding hardware ipsec tests. - Not adding -policy- tests. - Using old crypto_ia32_plugin.so plugin name. + Suitable for cherry-picking to rls2001. Change-Id: Ibf44d6d91e2afa2320637ecd9eb69d5d5dc364aa Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2020-02-03Autogen: Fix typo affecting DPDKVratko Polak1-1/+1
With the typo, only the first type+nic combination is generated. With fix, all combinations are generated. Change-Id: Ieb2db31cebed4940b063505b70f4d12a30da489c Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2020-01-31Remove trailing space from CLI commandVratko Polak1-3/+2
Change-Id: I49adff478302da036ecfacb675983923dc3f1ce1 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2020-01-31T-Rex: CPU pinningPeter Mikus3-97/+73
+ Detect NUMA + Pin based on numa location Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Ife350f8c70e5437ac7c1413c7753f2a2f62777d9
2020-01-30perf: Add hoststack NSIM+LDPRELOAD+IPERF3 test suiteDave Wallace3-14/+18
Change-Id: Ia7a876b1aa240676e1f2d23618c1d4e09ead14f0 Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
2020-01-29perf: QUIC transport hoststack test suiteDave Wallace2-11/+23
Change-Id: I73f4be7ea315c7a5dcce46e1bd3034bcb0a97ee2 Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
2020-01-29IPSEC: Change plugin namingPeter Mikus2-2/+2
https://gerrit.fd.io/r/c/vpp/+/24574 Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Ic2b7c925ceba1e16de87c64003ecceeea69c681c
2020-01-28perf: hoststack iperf3 test tuningDave Wallace6-34/+47
Change-Id: I53425f57fe9ecef9cff2c94642cc7cb24537a961 Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
2020-01-24Attempt to fix journalctlPeter Mikus1-3/+3
- AWK - ECHO - pipe + Much simpler Change-Id: I4876f4eae68c96571dc38fd21e53ba269f5f888e Signed-off-by: Peter Mikus <pmikus@cisco.com>
2020-01-23FIX: nfv_densityJan Gelety1-4/+6
- use correct osi_layer=L2 (so L2 spoofing check is switched off in case of avf driver) - add pci address information to eth interface in topology file - nfv_density chain_ipsec tests work only with DPDK in current implementation Change-Id: I233c6e5634a14581960c7459b87f11fcee8365bd Signed-off-by: Jan Gelety <jgelety@cisco.com>
2020-01-23FIX: Various issuesPeter Mikus2-0/+10
- TrafficProfile - IPsec jumbo - TDLK leftover - Trex scapy server Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I0601ea75ed6e7318c46124fb02e9c61066089791