aboutsummaryrefslogtreecommitdiffstats
path: root/resources/libraries/python
AgeCommit message (Collapse)AuthorFilesLines
2019-01-15fix failing tests after namespace updates in HCMichal Cmarada2-22/+15
Change-Id: Idf7cbcf285ff130f771eb3878065e6daa869ac71 Signed-off-by: Michal Cmarada <mcmarada@cisco.com>
2019-01-10VPP_Device - add baseline tests - part IIa)Jan Gelety3-14/+57
CSIT-1372 Add following baseline tests to VPP_Device: - ip4 eth2p-ethip4-ip4base-eth-2vhost-1vm-dev - ip6 eth2p-ethip6-ip6base-eth-2vhost-1vm-dev - l2bd eth2p-eth-l2bdbasemaclrn-eth-2vhost-1vm-dev - l2xc eth2p-eth-l2xcbase-eth-2vhost-1vm-dev + fix doc strings in all vpp_device tests Change-Id: Icc5ed801f3e8f6dedaa611779bd86fc20102fa74 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-01-09CSIT-1389 Refactor current keywords for multichaining - CNFPeter Mikus1-35/+19
- Add ability to create matrix of containers (chains x nodeness) - Change default Docker image to csit-dut - Use new resource mapping function Change-Id: Iaac0f2efc99146fbaef0b33dc71b38770610023d Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-01-08[V4] Add sending unidirectional traffic support for TG in CSITYulong Pei1-6/+97
Extend TG in CSIT to support to send unidirectional traffic, and then it can be used by unidirectional test cases e.g. Load balancer. Change-Id: Ie25bcdf7d4525a6d88d8ecd11a1b6d98275fa4d6 Signed-off-by: Yulong Pei <yulong.pei@intel.com>
2019-01-08CSIT-1387 Implement mapping functionPeter Mikus1-5/+54
Implement universal mapping function for placing the NF threads to cpu cores/threads. - Must be SMT aware. - Must work with N-core NF. - Must be DUT (vswtich) aware. - Must be deterministic. - Must use DTCR and MTCR parameters. Change-Id: I98b61861f85c5af7ecd856719b4adf2ba95c262f Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-01-02VHOST vectors.Peter Mikus1-4/+7
Change-Id: I5e17c5ab5cb99af0ac3d063ffc911bf95457d3e4 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-12-18Adding DMM build artifactssharath2-2/+50
Change-Id: Ia5153d8e716d506c85ec8b723331438efd66ab6a Signed-off-by: sharath <sharathkumarboyanapally@gmail.com>
2018-12-17FIX: Update PAPI to work with string changes in Python APIJan Gelety1-3/+4
Change-Id: I3b5f0568b5928cf12aaf2a555f52dd9809348579 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-11-27CSIT python API introductionJan Gelety4-10/+322
Jira: CSIT-1336 Change-Id: I96d2b0221c5a7466484a82339fc132c5921532d1 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-11-20Fix Acl Plugin tests after update of Acl modelsMichal Cmarada1-26/+10
Change-Id: I8c4090b508e28ae8f289e9dbbd5c72bbc3af4aca Signed-off-by: Michal Cmarada <mcmarada@cisco.com>
2018-10-25CSIT-1339 Create initial l2xc testPeter Mikus1-6/+11
- L2XC ping ICMPv4/ICMPv6 test Change-Id: I1c1708e8c1050f140a02d56012f63b683fc3eec1 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-10-24Migration of DMM-CSIT scripts to DMM reposharath3-125/+178
Change-Id: Ibaa7652b24385805b5cdd1540ed98b09e68c69bc Signed-off-by: sharath <sharathkumarboyanapally@gmail.com>
2018-10-16CSIT-1338 FIX: Failed to get VPP version on hostPeter Mikus1-7/+26
VPP was not initialized (shm), after service restart, quickly enough. This results into vpp_api_test console timeouts when communicating over uninitialized socket. Patch is introducing more stable test to detect service (VPP) is fully ready and initialized. Change-Id: I300a763814feba28cb8163dcd4996b53b2994fec Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-10-10Fix authorization for ODL fluorine testsMichal Cmarada1-1/+1
Change-Id: I2ccca8955949840305350bec1f60bc6d1cddcf82 Signed-off-by: Michal Cmarada <mcmarada@cisco.com>
2018-10-10Add VXLAN scale perf testsJan Gelety5-28/+294
Jira: CSIT-1273 Change-Id: Ic2a41661c158384a5aaa7d4e73f30ffca13ddf82 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-10-02CSIT-1326 VLIB: barrier sync elog tracingPeter Mikus1-7/+7
- API changed. Change-Id: If70e1a930aa14b129ad38ef544cff32ad5a08cdd Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-10-02CSIT-1325 - FIX: AVF tests failing on unbindPeter Mikus1-1/+1
Currently there is and issue when consecutive AVF suites are trying to initialize AVF and bind VF to vfio-pci driver, there seems to be race condition if VPP has already VFs allocated. This patch should introduce safer contstrain to disable VPP prior AVF init. Change-Id: Id8839200f19d9e7a18d161b660cfb1e43a8ca379 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-10-01CSIT-1326 Add barrier event tracesPeter Mikus1-0/+43
Change-Id: I0f734c2f11cc89716371554880f1d7404ea16090 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-09-28FIX: Single memif tests failingPeter Mikus1-0/+9
This patch suppose to fix the single memif TCs failing on SKX nodes. By stoping Host VPP during startup of Guest VPP. This way Guest VPP can take interface on single pass.o Change-Id: I88e6932bf007ce0f6a367927de5f017ffb8fdaca Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-09-28CSIT-1321 Add IP4base tests using AVF driverPeter Mikus1-9/+18
Change-Id: I960c2b4170efa06597851853cfc15bda1c60fe94 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-09-27integration of DMM+lwip testscriptssharath2-63/+157
Change-Id: Ifb1a0702353e71c61a694dea5164df41f4e23389 Signed-off-by: sharath <sharathkumarboyanapally@gmail.com>
2018-09-26Fix jumbo framesTibor Frank2-5/+5
Change-Id: I8aa557fe75133d20eef9832e314357af71f1d19a Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-09-26CSIT-1316 Fix ligato building mechanics in CSIT bootstrapsPeter Mikus1-4/+44
Change-Id: Ia8da73cbf7ab213b61a330b757419330667be24b Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-09-25FIX: Add VatHistory for VATscript files.Peter Mikus1-0/+3
Add ability to see Vat history for file sourced commands. Change-Id: I49b19236bec7253ea412659368cb7ccb5f5e3274 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-09-21Fix autogen regenerator and few suitesVratko Polak1-1/+1
+ "elif" instead of "else if". + Some suites had test cases reordered. + Some suites contained 9000B cases for avf. Change-Id: I3bf8241c317f20dbf66b497a2c8be35ef71307f5 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-09-20CSIT-1205 Create AVF driver test - Add Tests L2BD L2XCPeter Mikus1-6/+18
Change-Id: Ia74a87346fe2c0a170b881b510f1b0558a538f3c Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-09-19CSIT-1291 Improve service handling with container detectionPeter Mikus2-187/+229
Change-Id: Iaeac10676f46e0267041afee927bc6e3201146b2 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-09-06fix CSIT broken issue when numa_node value is -1 on single Socket platformYulong Pei1-2/+5
Single Socket platform e.g. Intel Atom cpu based SOC platform with Ubuntu 16.04.4(kernel 4.13.0-36-generic) or Centos 7.5 (kernel 3.10.0-862.el7), value of /sys/bus/pci/devices/<pci_device_id>/numa_node is -1, this will break CSIT performance test running, but for this kind of SOC platform, it can consider that is not NUMA based platform, numa_node=-1 is reasonable, so fix it at CSIT side, when numa_node=1 and the system's NUMA node count is 1, set numa_node=0. DPDK also did it as this way. Change-Id: I9ac23d3cece2f1489e38f05b50a462bb2ad9f661 Signed-off-by: Yulong Pei <yulong.pei@intel.com>
2018-09-05CSIT-1205 Create AVF driver testPeter Mikus5-125/+420
- Add L1 KWs for SR-IOV handling (init Vfs, remove Vfs, ...) - Cleanup L1 KWs for SR-IOV bind/unbind/pci_get/... - Add L2 KWs for Test Setup/Teardown, L2patch, Create AVF interface - Add sample L2patch test fox x710, xxv710 Change-Id: If17077877455a14043617d8ea0d06cbe47b469e3 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-09-05Fix various pylint violationsVratko Polak19-106/+111
+ SchedUtils.py: Do not use `len(SEQUENCE)` to determine if a sequence is empty + VatHistory.py: Do not use `len(SEQUENCE)` to determine if a sequence is empty + VppCounters.py: Do not use `len(SEQUENCE)` to determine if a sequence is empty + Memif.py: ++ Do not use `len(SEQUENCE)` to determine if a sequence is empty ++ Either all return statements in a function should return an expression, or none of them should. ++ Update :return: on possible None. + Classify.py: Unnecessary "else" after "return" + ContainerUtils.py: Useless super delegation in method '__init__' + CpuUtils.py: Do not use `len(SEQUENCE)` to determine if a sequence is empty + DropRateSearch.py: Either all return statements in a function should return an expression, or none of them should. + IPv4NodeAddress.py: Do not use `len(SEQUENCE)` to determine if a sequence is empty ++ Also improve docstrings. + IPv4Setup.py: Useless super delegation in method '__init__' + IPv6Setup.py: Do not use `len(SEQUENCE)` to determine if a sequence is empty ++ Also improve docstrings. + IPv6Setup.py: standard import "from ipaddress import IPv6Network" should be placed before "from robot.api import logger" + MacSwap.py: Trailing newlines + NATUtil.py: Do not use `len(SEQUENCE)` to determine if a sequence is empty + NodePath.py: Unnecessary "else" after "return" + Tap.py: Do not use `len(SEQUENCE)` to determine if a sequence is empty + topology.py: Either all return statements in a function should return an expression, or none of them should. + topology.py: Unnecessary "else" after "return" ++ Do not use `len(SEQUENCE)` to determine if a sequence is empty ++ Improve docstrings + DUTSetup.py: Do not use `len(SEQUENCE)` to determine if a sequence is empty ++ Also do not compare int(ret_code) just to access zero-ness. + ssh.py: Do not use `len(SEQUENCE)` to determine if a sequence is empty + InterfaceUtil.py: Unnecessary "else" after "return" Change-Id: Iba4244aa79661ee7df15fed5c7c6dbf04dfa88b2 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-09-05Add eth-ip4base-2memif[ndrpdr|mrr] perf tests for 2-node topologyJan Gelety1-0/+1
- added also 3-node test cases for comparison Jira: CSIT-1261 Change-Id: I1bfcc184e925e969d4a610920c4e49af23047507 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-09-04Fix pylint part 1Peter Mikus9-19/+57
- Decrease pylint errors. Part: easy Change-Id: I452e5b5a11e9b78c03cd173a3848babe21b93c73 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-08-24add the expected prompt for ubuntu root userYulong Pei2-3/+3
if ssh use root account to login ubuntu os, its prompt is ":~# ", so add it to let csit test can run with root account. Change-Id: I21f5380245324c8e48099433e3d374188e9001d9 Signed-off-by: Yulong Pei <yulong.pei@intel.com>
2018-08-22CSIT-1222: Do two doublings in external MLRsearchVratko Polak6-20/+70
Make number of doublings configurable, keep Python default at 1, set Robot default to 2. Also make docstring types unique (pylint was complaining about classes and modules having the same name). Increase MLRsearch version to 0.2.0. Change-Id: Ib846032e79ff52994503c0cfef2f86655502c275 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-08-20Refactor VHOST codePeter Mikus4-296/+410
CSIT-1164 Create VM vhost tests for 2-node topology CSIT-1173 Implement VM vhost KWs for 2-node topology - Cleanup QemuUtils.py Library (PEP8, some TODOs, readability, multi queue, ring size, qemu version detection) - Cleanup VHOST KWs perf (Unify running QEMU on N-node topology) - Add ability to configure Queues, Hyperthreading, automatically compute number of CPU for VM/Testpmd and RXQ for Testpmd workload. - Partial cleanup of configuration KWs (l2xc, l2bd) for 2-node - Create IPv4 2-node KW Change-Id: I8aae1355bafa651de715cd438fe706c443ea1d88 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-08-10CSIT-1156 Create container memif tests for 2-node topologyPeter Mikus1-1/+4
CSIT-1155 Implement container memif KWs for 2-node topology Change-Id: I4fc7bcab499a0b8a8594114d3f331b0d9610bf9d Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-08-10CSIT-1193 De-duplicate bootstrap scripts into onePeter Mikus2-4/+7
- DPDK and VPP bootstrap merged into one (ligato will follow). - Added more error detections - Added topo-cleanup.py to cleanup TB before and after test. - Remove installation of VPP Change-Id: I7a86117eb03cbe4ee8fde47baeed58bc86c0dfb2 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-07-31FIX: Revert l3fwd patchingPeter Mikus1-1/+0
For now this solution does not work on Haswells, need to find permanent fix. Change-Id: Id5323a078db3a8f14c009d6f66ee393c89d851ef Signed-off-by: Peter Mikus <pmikus@cisco.com> (cherry picked from commit 5f634b8c486f7a404c9cd33b60cc92a6907e7c64)
2018-07-27FIX: Interface up handlingPeter Mikus2-7/+15
- Increase timeout when trying to check interface (this is useful if there are multiple interfaces and dump command take more than TIMEOUT/NR_IF which is happening quite often). - Reverse the order of applying MTU and interface UP to try to prevent API overload during interface initialization phase. Change-Id: I4e8623963d15b3c0d202172b4c58c43a972bb9cb Signed-off-by: Peter Mikus <pmikus@cisco.com> (cherry picked from commit 584345da4f7330f7517e5defd894b4995c2b57b0)
2018-07-26CSIT-1065 High failure rate with K8s/Ligato orchestrationPeter Mikus1-12/+24
- Update Ligato Bootstrap for latest changes - Update Ligato Test cases for latest vpp-agent changes - Convert TC to new format - Add Hyperthreading support Change-Id: Id7c8513b01c66ee6c652b6294ddc50bc10be8f7d Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-07-25Add MTU handling into perf testsPeter Mikus2-8/+57
- Add ability to configure MTU on interfaces. Put the MTU into configuration keywors for all perf testcases. Change-Id: I364b4bc26b26f2f66f350949c0aaa2a2aa675682 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-07-24CSIT-1097: Migrate L2 to NDRPDR and edit MRRVratko Polak2-11/+13
Change-Id: I738d1794f795e1225bc9709ea2ed2cf9b06d1cf4 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-07-24initial CSIT-DMM test scriptssharath reddy4-0/+341
Change-Id: I77a965751010b85d21335932baa5345a095dc4f3 Signed-off-by: sharath reddy <sharathkumarboyanapally@gmail.com> Signed-off-by: sharath <sharathkumarboyanapally@gmail.com>
2018-07-24CSIT-1097: Migrate Vts suite to NDRPDRVratko Polak2-4/+10
Change-Id: Iaac913bb4b15d743a2e9d565e25d31c089cee3e8 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-07-24CSIT-1097: Migrate ip4 to NDRPDR and edit MRRVratko Polak1-4/+10
Change-Id: I9e3b2973c14f818247658a2ae34456c9fc2bae4e Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-07-19FIX: Increase timeout for VAT for longer API calls.Peter Mikus1-1/+1
Change-Id: Idab5e8d62a42513ddef97025625962b510c3a625 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-07-18CSIT-1097: Ip6 NDRPDR and edited MRR suitesVratko Polak1-1/+8
Change-Id: I912017c6d1eab5530eecb2326887ffd057916ee8 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-07-18CSIT-1201 Create L2patch perf testsPeter Mikus1-0/+30
- XL710, XXV710, X710 - 2n, 3n - all pkt.size groups - ndrpdr, mrr Change-Id: Ibb36d734cd70a0a4d07e3d177fa2477bf9bfaacd Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-07-17CSIT-1186: Add srv6 NDRPDR suitesVratko Polak6-1/+246
Delete the corresponding ndrpdrdisc suites. MRR suites are also edited, to make them less different from NDRPDR suites. Now, there is a script to re-generate testcases of selected suites. For that, resources/libraries/python/autogen is created, with Regenerator holding the most of script logic. The script looks at files matching a glob expression, reuses a "prolog", but overwites test cases with the default template and hardcoded set of testcase arguments. Also, handling of overhead size has been simplified, using new keyword Get Max Rate And Jumbo And Handle Multi Seg. Default value for search timeout is increased to 12 minutes to make timeout failures less frequent. Change-Id: I394ad61f262b3078e5ca719034b15ada48987ee0 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-07-17Refactor DPDK testcases to new structurePeter Mikus2-6/+36
+ RXQ refactor Change-Id: Ic03a2e208b9fe5d324a5ed75a603af4cff1854a9 Signed-off-by: Peter Mikus <pmikus@cisco.com>