aboutsummaryrefslogtreecommitdiffstats
path: root/resources/libraries/robot/shared
AgeCommit message (Collapse)AuthorFilesLines
2019-05-09Remove old VPP Restart sequencePeter Mikus1-7/+6
Change-Id: I7f71a9709ad55ce03d73e23cc8a9f5064947ed51 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-05-06CSIT-1493 VPP restart handling codePeter Mikus1-32/+10
Change-Id: Ibe52125089f39e0ff17ec607a3ed00c61d52ab8c Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-04-26NF density tests with dtc=0.5 and dtcr=2Peter Mikus2-5/+17
Change-Id: Icff556142280ad0b6261e0a2bfb71672ee6b3807 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-04-26FIX: Change buffers per numa base on SMTPeter Mikus1-1/+3
Change-Id: I4955210e2c723d4b91d8829ac42e47937d17833f Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-04-24FIX: Large number of interfaces and worker threadsPeter Mikus1-8/+4
Add buffers-per-numa (previously num-mbuf) Change-Id: Iad0863668a65b1595630d49a047d591659c7bba5 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-04-17Clean up traffic_profile vs osi_layerVratko Polak1-6/+4
The two types were not well distinguished before. Error introduced in: https://gerrit.fd.io/r/#/c/17811/84/resources/libraries/robot/performance/performance_setup.robot@255 Error hotfixed in: https://gerrit.fd.io/r/#/c/18847/4/resources/libraries/robot/shared/default.robot@109 + Rename some arguments and improve method docstrings. Newly introduced argument name osi_layer should be dissimilar enough. Change-Id: Ie0f6f97dc010fc6477f09c54574970f1d15462e2 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-04-16Add 2n AVF testsPeter Mikus1-4/+4
- Side effect of other troubleshooting, but better to merge then throw away. Change-Id: Idc1a0ca66b35b61c1ffd11242cd7b7133ae4cbd7 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-04-11Add notes for traffic_type argumentVratko Polak1-0/+2
To make this gerrit comment permanently visible in code: https://gerrit.fd.io/r/#/c/17811/50/resources/libraries/python/InterfaceUtil.py@1335 Change-Id: I2b763d88fcc8186c9479a0f0c3336d8eeb8aed95 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-04-08Upgrade autogen to NICs and search typesVratko Polak1-4/+4
+ All perf suites updated, as autogen change is backward incompatible. + Only x710 -ndrpdr suites remain in git repository. + Removed retry feature of run_tests. + Renamed topology_type and traffic_type to traffic_profile. + Renamed framesize to frame_size; nic_model to nic_name. + Reordered Variables table to start with nic_name and overhead. + Fixed wrong overhead value in some cbc-sha1 suites. + Fixed some suite tags. ++ Introduced tags to distinguish suites, such as IPSECINT. + Bound crypto hardware to NIC name. + Implemented NIC limit hiding. + Also search and teardown related arguments are now hidden. + Main measurement keywords updated to new arg handling. + Max rate related keywords moved to performance_limits.robot + Teardowns unified. + Generated tests are archived. ++ Generated directory is .gitignore-d. + Regenerator raises an exception on seeing non-compatible suite. ++ Relatively helpful message should be seen in exception. + Suite and template Documentation has generated parts. +- With short NIC names only. + Autogen checker also upgraded. + Tag expressions replaced with long files to ensure analogous tests. Change-Id: I60e9a999187e7da1f60d0eb4fb02afa14682aa46 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-04-03Remove obsolete FDS testsJan Gelety1-17/+0
Change-Id: Ie161f7003cb33596ac7856783b332a75b5dbc14e Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-03-28Add ipsec crypto test for Denverton platformYulong Pei1-6/+8
add ipsec cryto test to support Denverton hardware crypto device C3xxx. replace HW_cryptodev keyword to HW_DH895xcc or HW_C3xxx, or add more other hardware crypto device type support in the future. Change-Id: I181bca4095757fde7ca45ab3856273ac5930d902 Signed-off-by: Yulong Pei <yulong.pei@intel.com>
2019-03-21Convert functional tests to statefull QemuUtilsPeter Mikus1-3/+3
Change-Id: Ia1b9120c45733db64dc2dc8b03cff5ef5f167548 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-03-18CSIT-1386 KernelVM - Part IPeter Mikus1-19/+5
- Refactor QemuUtils Full refactor of QemuUtils to prepare for thinner VMs. Change-Id: I171ba11a9e6e9faec582bd58df6819598b0ed0b5 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-03-06CSIT-1451: PapiHistoryTibor Frank1-8/+8
Change-Id: Idb51f377fe0c196fbe24aab21c294dad595adcd2 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-02-09FIX: Remove deprecated socket-mem paramPeter Mikus1-1/+0
Change-Id: I7178dacbd470c29e857b44942a62ccf7df53d0b5 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-02-08CSIT-845 Capture VPP core-dump from vpp crash on DUTsPeter Mikus1-0/+2
Change-Id: I987dcd5092d8527c9aefbe093e1ed7ae144d191b Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-02-04CSIT-1416 Remove installation of vpp from containersPeter Mikus2-36/+35
Use parent system (Host, Container) installation of VPP. This will save the internet bandwith by skip installing of prerequisites packages. It will also skip dpkg install and simplify the process of initializing VPP inside container. Previosly initialization of VPP in container takes about 55s. With this patch it is reduced to 2-3s. This patch removes the bloated VOLUME creation between container sidecars (a.k.a nested container) and fixes the hugepage allocation. Change-Id: Ifa2be532edb77354657e1b84568bdc34993b00d0 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-01-30CSIT-1409 Implement pipeline configuration for l2bd with memif/ip4.Peter Mikus2-6/+12
Change-Id: I7463d47a9d65069332eb2a288ff44f4499a8a467 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-01-28CSIT-1403 Implement multichain configuration for l2bd with memif/ip4.Peter Mikus1-25/+41
Change-Id: Ia87156b2ba826eb0a9a93d756b9765c7373ca6ce Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-01-28WORKAROUND: Remove static mbufsPeter Mikus1-1/+3
Due to incomming changes in https://gerrit.fd.io/r/#/c/16638/ We need to temporarily disable mbuf static. Change-Id: I629584ef7bf2a7efcacab6b3d90c0bab92aa9e5b Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-01-23VPP_Device - add baseline tests - part IIb)Jan Gelety3-53/+144
CSIT-1372 Add following baseline tests to VPP_Device: - ip4 eth2p-ethip4-ip4base-eth-2memif-1dcr-dev - ip6 eth2p-ethip6-ip6base-eth-2memif-1dcr-dev - l2bd eth2p-eth-l2bdbasemaclrn-eth-2memif-1dcr-dev - l2xc eth2p-eth-l2xcbase-eth-2memif-1dcr-dev Change-Id: Ic4a3a01b62d800c528a9c9371891dcc26b875220 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-01-10CSIT-1389 Refactor current keywords for multichaining - CNF (II)Peter Mikus1-7/+4
Change-Id: Ic6af8ebf59589bea66322fc87a33218c7dc0c132 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-01-09CSIT-1389 Refactor current keywords for multichaining - CNFPeter Mikus1-50/+54
- Add ability to create matrix of containers (chains x nodeness) - Change default Docker image to csit-dut - Use new resource mapping function Change-Id: Iaac0f2efc99146fbaef0b33dc71b38770610023d Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-12-19FIX: Avoid duplicated KW names in perf and func testsJan Gelety1-2/+2
Change-Id: I66c68edf6e26fa7baa7bdc5f5d60d4d4aa3af6b9 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-12-07VPP_Device - add baseline tests - part IJan Gelety2-119/+242
CSIT-1370 Add following baseline tests to VPP_Device: - ip4 eth2p-ethip4-ip4base-dev - ip6 eth2p-ethip6-ip6base-dev - l2bd eth2p-eth-l2bdbasemaclrn-dev Change-Id: Ic20000eb38c5511c27d020f3aa76b2620d7f7ef9 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-10-25CSIT-1339 Create initial l2xc testPeter Mikus1-0/+22
- L2XC ping ICMPv4/ICMPv6 test Change-Id: I1c1708e8c1050f140a02d56012f63b683fc3eec1 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-09-28FIX: Single memif tests failingPeter Mikus1-1/+0
This patch suppose to fix the single memif TCs failing on SKX nodes. By stoping Host VPP during startup of Guest VPP. This way Guest VPP can take interface on single pass.o Change-Id: I88e6932bf007ce0f6a367927de5f017ffb8fdaca Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-09-05CSIT-1205 Create AVF driver testPeter Mikus1-5/+36
- Add L1 KWs for SR-IOV handling (init Vfs, remove Vfs, ...) - Cleanup L1 KWs for SR-IOV bind/unbind/pci_get/... - Add L2 KWs for Test Setup/Teardown, L2patch, Create AVF interface - Add sample L2patch test fox x710, xxv710 Change-Id: If17077877455a14043617d8ea0d06cbe47b469e3 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-08-24VPP link bonding perf tests with two links between DUTsJan Gelety1-2/+12
Jira: CSIT-1247 Change-Id: Ia6a3f7682eb9a35040682913c0e33a1d61d1e6fa Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-08-20Refactor VHOST codePeter Mikus1-0/+2
CSIT-1164 Create VM vhost tests for 2-node topology CSIT-1173 Implement VM vhost KWs for 2-node topology - Cleanup QemuUtils.py Library (PEP8, some TODOs, readability, multi queue, ring size, qemu version detection) - Cleanup VHOST KWs perf (Unify running QEMU on N-node topology) - Add ability to configure Queues, Hyperthreading, automatically compute number of CPU for VM/Testpmd and RXQ for Testpmd workload. - Partial cleanup of configuration KWs (l2xc, l2bd) for 2-node - Create IPv4 2-node KW Change-Id: I8aae1355bafa651de715cd438fe706c443ea1d88 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-08-10CSIT-1156 Create container memif tests for 2-node topologyPeter Mikus1-1/+2
CSIT-1155 Implement container memif KWs for 2-node topology Change-Id: I4fc7bcab499a0b8a8594114d3f331b0d9610bf9d Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-08-03Add unix full-coredump to VPP default configVratko Polak1-0/+1
Change-Id: Iceea1f25749443d3cf091996026f75d8779e8103 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-07-28FIX: LXC container creation on Ubuntu BionicPeter Mikus1-1/+2
Do not mount whole /dev into container as it can steal the PTS (tty). Currently mounting only /dev/bus for pci devices and /dev/vfio Change-Id: Ie829d35db81317bcd081257453ede7cbec2a302e Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-07-27FIX: Interface up handlingPeter Mikus1-4/+3
- Increase timeout when trying to check interface (this is useful if there are multiple interfaces and dump command take more than TIMEOUT/NR_IF which is happening quite often). - Reverse the order of applying MTU and interface UP to try to prevent API overload during interface initialization phase. Change-Id: I4e8623963d15b3c0d202172b4c58c43a972bb9cb Signed-off-by: Peter Mikus <pmikus@cisco.com> (cherry picked from commit 584345da4f7330f7517e5defd894b4995c2b57b0)
2018-07-26CSIT-1065 High failure rate with K8s/Ligato orchestrationPeter Mikus1-0/+67
- Update Ligato Bootstrap for latest changes - Update Ligato Test cases for latest vpp-agent changes - Convert TC to new format - Add Hyperthreading support Change-Id: Id7c8513b01c66ee6c652b6294ddc50bc10be8f7d Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-07-16Add L2xc/L2bd/Ip4/Ip6 2-node tests for x710Peter Mikus1-1/+4
- CSIT-1161 Add 2-node L2XC tests - CSIT-1160 Add 2-node L2BD tests - CSIT-1157 Add 2-node IP4 tests - CSIT-1153 Add 2-node IP6 KW - CSIT-1158 Add 2-node IP6 tests Change-Id: I7c8fed7018bb355c0de73f6a8bc3a8ec80366972 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-07-13Refactor perf test casesPeter Mikus1-19/+32
- Refactor Performance TCs due to changes in Hyperthreading and RXQ allocations. - Simplify the structure of suite to avoid large refactors in future. Change-Id: Ifb1b9719391f26745f075a900bd9fb39b6cb809c Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-07-13Add stats segment heapsize to default configPeter Mikus1-0/+1
- Scale tests (ip4, ip6) are failing due to low amount of stats segment heapsize. Change-Id: Id9b3e84d5a5c63014c17041c08c00ef6188afa5f Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-07-09CSIT-1142 2-node topology - keywordsPeter Mikus1-75/+41
- Clean up of 2-node setup KWs Change-Id: I59fc901fb57544eceb6a041b56b515cda8babf85 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-07-03CSIT-1046 Make uio driver configurable from topofilesPeter Mikus1-1/+1
Currently we are configuring uio_driver from global variable. This may not be suitable for various topologies where we need different driver per TB. This patch is suppose to put uio_driver into topology files. Change-Id: I56af0697e8b2359ccb126151217976408720c1ba Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-06-08CSIT-1081 Container VPP configuration refactorPeter Mikus2-1/+32
Adopt code for various topology configurations. Change-Id: Iaf9d7995ab8cd06da0c56c5e5664d57d19e74d7c Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-05-14CSIT-1036 Expose option to install DKMS in containerPeter Mikus1-0/+1
Expose DKMS installation as suite variable. This will allow to use DPDK driver for future tests. Change-Id: I38fd014c8cf6f4bf42881af2196cadc679fe53e0 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-05-12CSIT-1079 Add multiple mount dirs into containerPeter Mikus1-7/+3
Pass the list of mount dirs into container LXC/Docker Change-Id: Ie80062563955273791ab63e156bf0b369e5be649 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-04-20FIX: Restart VPP in container before each testPeter Mikus1-0/+6
Change-Id: Iec7045aadc0675e04b8c74cbe28f8b3f193bcf1f Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-04-20FIX: Configure number of memif queus properlyPeter Mikus1-4/+10
Change-Id: I2dcb0300829bc961c80cc30d972d0563aeba9364 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-04-16Make default driver configurablePeter Mikus1-5/+6
- Make UIO driver configurable from global variables. - Prepare code for uio_pci_generic to vfio-pci change Change-Id: I2b49201177a92f51673242a30e2fd8d4f7e59694 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-04-12Add more verbose DPDK logsPeter Mikus1-0/+1
Change-Id: I98a07fa88d4959ab05996e053c5c02ef9bda5039 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-04-06FIX: VAT SSH timeoutPeter Mikus1-1/+1
Currently when VAT cannot connect to VPP via direct API call, there is inner timeout of ~100s until it quits and returns RC. In our code we are setting outer timeout to 10/15s to detect if VAT is not responding. If VAT does not respond quickly enough due to e.g VPP crash, we are incorrectly reporting SSHTimout exception. This fix is suppose to set correct timeout values and also to set some of the calls like show run|hard|err / clear to detect whether they were successfull or not. + Various small library cleanup. Change-Id: I787c4baecd7e086705a4076643e255a875ea8438 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-03-30Change the default plugin behavior in perf testsPeter Mikus1-1/+2
Currently we are selectively disabling plugins by creating list of disabled plugins for performance tests. Thanks to the new API in VPP we can revert the logic to selectivly enable plugins. This is more stable for future onboarding of new plugins into VPP. Change-Id: Ibdd56d6097230d095a304bbb6984b565d9428f51 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-03-22CSIT-1005: Add ipsec MRR testsVratko Polak1-0/+2
+ 40ge2p1xl710-ethip4ipsecbasetnl-ip4base-int-aes-gcm-mrr.robot + 40ge2p1xl710-ethip4ipsecbasetnl-ip4base-int-cbc-sha1-mrr.robot + 40ge2p1xl710-ethip4ipsecbasetnlsw-ip4base-int-aes-gcm-mrr.robot + 40ge2p1xl710-ethip4ipsecbasetnlsw-ip4base-int-cbc-sha1-mrr.robot + 40ge2p1xl710-ethip4ipsecscale1000tnl-ip4base-int-aes-gcm-mrr.robot + 40ge2p1xl710-ethip4ipsecscale1000tnl-ip4base-int-cbc-sha1-mrr.robot Do not add test cases for 9000B framesize yet. Improve other suites to keep the style consistent. Change-Id: I03a58e8d6745083e267b9d53bb3b85efcb2ea827 Signed-off-by: Vratko Polak <vrpolak@cisco.com>