aboutsummaryrefslogtreecommitdiffstats
path: root/tests
AgeCommit message (Collapse)AuthorFilesLines
2018-09-10CSIT-1179: Switch MRR to multiple trialsVratko Polak1-2/+2
But keep the detection in PAL using only average, not size nor stdev. Change-Id: I07092bdeb892c871550265757fd2846a36fbb352 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-09-07CSIT-1272: Fix VTS testsTibor Frank6-6/+6
Change-Id: Ibc4ae346032b2b711e4dcd1dbc9c0873e8464b19 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-09-07Create ip6scale tests for 2-node topologyJan Gelety24-162/+1734
Jira: CSIT-1176 Change-Id: I78f4e9cb24a7de0bde24a78d1ca26607598a62b2 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-09-06Fix autogen violationsVratko Polak4-76/+124
Four AVF suites had test cases in different order. Change-Id: I12fbe3508016a79a2153cc004c654a21ee4279bf Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-09-05Create ip4scale tests for 2-node topologyJan Gelety24-138/+1722
Jira: CSIT-1174 Change-Id: I46944a3bc0f508d80c8c944dab0190925ebe21f5 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-09-05CSIT-1205 Create AVF driver testPeter Mikus4-0/+482
- Add L1 KWs for SR-IOV handling (init Vfs, remove Vfs, ...) - Cleanup L1 KWs for SR-IOV bind/unbind/pci_get/... - Add L2 KWs for Test Setup/Teardown, L2patch, Create AVF interface - Add sample L2patch test fox x710, xxv710 Change-Id: If17077877455a14043617d8ea0d06cbe47b469e3 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-09-05Add eth-ip4base-2memif[ndrpdr|mrr] perf tests for 2-node topologyJan Gelety10-0/+1468
- added also 3-node test cases for comparison Jira: CSIT-1261 Change-Id: I1bfcc184e925e969d4a610920c4e49af23047507 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-08-28Create ip4-feature perf tests for 2-node topologyJan Gelety144-846/+4337
- ACL tests - NAT44 tests - iPoliceMarker tests Jira: CSIT-1175, CSIT-1154 Change-Id: Ife7e7df50f7c1c8033bacdb7512e78be6bcdf4eb Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-08-27FIX: Correction of ACL perf test suite documentationJan Gelety72-905/+840
Change-Id: I01cc87f5f5409346566ded52da9d384fdd3fa2c4 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-08-24VPP link bonding perf tests with two links between DUTsJan Gelety12-4/+687
Jira: CSIT-1247 Change-Id: Ia6a3f7682eb9a35040682913c0e33a1d61d1e6fa Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-08-22CSIT-1164 Create VM vhost tests for 2-node topologyPeter Mikus36-0/+4946
Change-Id: I955d3170da94cf35a2fda03259bcdc020ac2b652 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-08-21HC Tests: reenable VxLaN GPE ipv6 testsMarek Gradzki1-4/+2
The issue is no longer present in VPP master branch (1810). Change-Id: I64f4fa8544ace8dc3686db9a1a3f3897ba333c61 Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
2018-08-21FIX: Use correct interface type in x710_1lbvpplacp perf testsJan Gelety4-4/+4
Change-Id: I68db0b0441ffc7d9b5e04048688711915ab24726 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-08-21Add MRR tests for kubernetesVratko Polak41-61/+3454
Fix number of flows in Documentation. Change-Id: I0db62ab79c44db0ea55e000f8ef9cb8ee28a07fe Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-08-20HC Tests: mark BGP v6 tests as criticalMarek Gradzki1-2/+0
TC13 of BGP tests was marked as EXPECTED_FAILING due to HONEYCOMB-403, but the error does not occur on 1807 nor master for some time. Change-Id: I3d8f4ee78fed699927fed05e8fa070cfa95b2166 Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
2018-08-20Refactor VHOST codePeter Mikus99-1368/+622
CSIT-1164 Create VM vhost tests for 2-node topology CSIT-1173 Implement VM vhost KWs for 2-node topology - Cleanup QemuUtils.py Library (PEP8, some TODOs, readability, multi queue, ring size, qemu version detection) - Cleanup VHOST KWs perf (Unify running QEMU on N-node topology) - Add ability to configure Queues, Hyperthreading, automatically compute number of CPU for VM/Testpmd and RXQ for Testpmd workload. - Partial cleanup of configuration KWs (l2xc, l2bd) for 2-node - Create IPv4 2-node KW Change-Id: I8aae1355bafa651de715cd438fe706c443ea1d88 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-08-17copying all .so[newly added] into app directorysharath1-3/+3
Change-Id: I5b89732c5dd1a4b74ffbafbd78803721dbf9c61c Signed-off-by: sharath <sharathkumarboyanapally@gmail.com>
2018-08-17CSIT-1245 - Wrong configuration of srv6proxy-ndrpdr-stat and ↵Peter Mikus2-2/+2
srv6proxy-masq-ndrpdr TCs Change-Id: If5a45b97c90f85f2f193d796adbddd329f2728cd Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-08-15FIX: Set default values for VTS teardown argumentsVratko Polak6-6/+18
Change-Id: Ic45b23073307cd2174415cf3b406a9bb4be56004 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-08-15HC Tests: remove EXPECTED_FAILING tag from policer tests (HC2VPP-375)Marek Gradzki1-4/+0
Translation of classify sessions was fixed in hc2vpp by https://gerrit.fd.io/r/#/c/14180/ This patch reverts https://gerrit.fd.io/r/#/c/14155/ Change-Id: Ia669fa051019585c494dacd10b9585bfff485364 Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
2018-08-13HC Tests: mark policer tests as EXPECTED_FAILING (HC2VPP-373)Marek Gradzki1-0/+4
Change-Id: I394a024e98d74b468a821040db69c1d6eed820ea Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
2018-08-10CSIT-1156 Create container memif tests for 2-node topologyPeter Mikus28-34/+1210
CSIT-1155 Implement container memif KWs for 2-node topology Change-Id: I4fc7bcab499a0b8a8594114d3f331b0d9610bf9d Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-08-10CSIT-1193 De-duplicate bootstrap scripts into onePeter Mikus2-1/+10
- DPDK and VPP bootstrap merged into one (ligato will follow). - Added more error detections - Added topo-cleanup.py to cleanup TB before and after test. - Remove installation of VPP Change-Id: I7a86117eb03cbe4ee8fde47baeed58bc86c0dfb2 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-08-07HC Tests: 18.07 report updateMarek Gradzki2-5/+5
Change-Id: I2c3df89532f0e728c58b54c220d4fe8ab1297ba4 Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
2018-08-06CSIT_VIRL phased migration, prio P0 - apply SKIP_VPP_PATCH tagJan Gelety9-14/+16
Jira: CSIT-1137 Change-Id: I06e00e25060c36a1e7bd5b70bce1f203c1509ef5 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-08-03Fix ommissions from recent ChangesVratko Polak2-0/+153
+ Insert missing "Add worker threads"... keyword to udpsrcscale15 suite. + Add MRR for 40ge2p1xl710-ethip4ipsectptlispgpe-ip4base-cbc-sha1 suite. Change-Id: I467e5469a1421caa25373ab91010bd4d824fb32f Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-07-27FIX: Interface up handlingPeter Mikus8-16/+0
- Increase timeout when trying to check interface (this is useful if there are multiple interfaces and dump command take more than TIMEOUT/NR_IF which is happening quite often). - Reverse the order of applying MTU and interface UP to try to prevent API overload during interface initialization phase. Change-Id: I4e8623963d15b3c0d202172b4c58c43a972bb9cb Signed-off-by: Peter Mikus <pmikus@cisco.com> (cherry picked from commit 584345da4f7330f7517e5defd894b4995c2b57b0)
2018-07-26CSIT-1065 High failure rate with K8s/Ligato orchestrationPeter Mikus41-6305/+3494
- Update Ligato Bootstrap for latest changes - Update Ligato Test cases for latest vpp-agent changes - Convert TC to new format - Add Hyperthreading support Change-Id: Id7c8513b01c66ee6c652b6294ddc50bc10be8f7d Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-07-25Add MTU handling into perf testsPeter Mikus45-45/+11
- Add ability to configure MTU on interfaces. Put the MTU into configuration keywors for all perf testcases. Change-Id: I364b4bc26b26f2f66f350949c0aaa2a2aa675682 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-07-24CSIT-1097: Migrate L2 to NDRPDR and edit MRRVratko Polak168-7320/+13484
Change-Id: I738d1794f795e1225bc9709ea2ed2cf9b06d1cf4 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-07-24CSIT-1202: Unify min_rateVratko Polak3-3/+3
20000 is the bi-directional value, suites should use 10000. Change-Id: I61d6e83f4f6b8f1f9b3dc9457896997f686a2b66 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-07-24CSIT-1097: Unify max NIC bandwidth in ip4Peter Mikus4-15/+12
Also, minor fix in ip6. Change-Id: I3a23e49d2162e34a1d2a8671ae9f7e74b832315c Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-07-24initial CSIT-DMM test scriptssharath reddy4-0/+305
Change-Id: I77a965751010b85d21335932baa5345a095dc4f3 Signed-off-by: sharath reddy <sharathkumarboyanapally@gmail.com> Signed-off-by: sharath <sharathkumarboyanapally@gmail.com>
2018-07-24CSIT-1097: Migrate Vts suite to NDRPDRVratko Polak11-287/+1020
Change-Id: Iaac913bb4b15d743a2e9d565e25d31c089cee3e8 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-07-24CSIT-1097: Migrate ip4 to NDRPDR and edit MRRVratko Polak152-6875/+12460
Change-Id: I9e3b2973c14f818247658a2ae34456c9fc2bae4e Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-07-24CSIT-1097: Edit dpdk suites for new rate and jumboVratko Polak26-949/+871
Change-Id: If2fceb47639dc1add32184271c1e911f7920a51a Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-07-24CSIT-1097: Migrate vm_vhost to NDRPDR and edit MRRVratko Polak126-11852/+10058
Change-Id: Id5eb8fe46b219426803d3e7d135319ce5117738c Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-07-20CSIT-1097: Migrate ip4_tun to NDRPDR and edit MRRVratko Polak19-2380/+1358
Change-Id: I20fe137cfbbcea1e337fe6295818ea105953d006 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-07-20CSIT-1097: Migrate memif to NDRPDR and edit MRRVratko Polak26-1325/+1849
Change-Id: I22db20ec688f1a879e82549aa7aa68dafdc71b6c Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-07-18CSIT-1097: Crypto NDRPDR and missing MRR suitesVratko Polak34-3613/+2873
Change-Id: If40f9283ee889f85e85fad74a490252e812bbe02 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-07-18CSIT-1097: Ip6 NDRPDR and edited MRR suitesVratko Polak38-3775/+2413
Change-Id: I912017c6d1eab5530eecb2326887ffd057916ee8 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-07-18CSIT-1201 Create L2patch perf testsPeter Mikus10-0/+1298
- XL710, XXV710, X710 - 2n, 3n - all pkt.size groups - ndrpdr, mrr Change-Id: Ibb36d734cd70a0a4d07e3d177fa2477bf9bfaacd Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-07-17CSIT-1186: Add MRR and NDRPDR ip6_tunnels testsVratko Polak7-1192/+566
Remove the corresponding NDRPDRdisc tests. Change-Id: Ib46f53e97f703db19bcbcb82c3db0a7f5bb61dbf Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-07-17CSIT-1165 Create DPDK tests for 2-node topologyPeter Mikus8-0/+978
Create DPDK tests for 2-node topology - x710, xxv710 only - l3fwd, testpmd - standard pkt.size group Change-Id: I2fbf6c38a427775da9b289faaa8fe1b8c03d5527 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-07-17CSIT-1186: Add srv6 NDRPDR suitesVratko Polak13-620/+616
Delete the corresponding ndrpdrdisc suites. MRR suites are also edited, to make them less different from NDRPDR suites. Now, there is a script to re-generate testcases of selected suites. For that, resources/libraries/python/autogen is created, with Regenerator holding the most of script logic. The script looks at files matching a glob expression, reuses a "prolog", but overwites test cases with the default template and hardcoded set of testcase arguments. Also, handling of overhead size has been simplified, using new keyword Get Max Rate And Jumbo And Handle Multi Seg. Default value for search timeout is increased to 12 minutes to make timeout failures less frequent. Change-Id: I394ad61f262b3078e5ca719034b15ada48987ee0 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-07-17Refactor DPDK testcases to new structurePeter Mikus23-2154/+1602
+ RXQ refactor Change-Id: Ic03a2e208b9fe5d324a5ed75a603af4cff1854a9 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-07-16Add L2xc/L2bd/Ip4/Ip6 2-node tests for x710Peter Mikus16-0/+2107
- CSIT-1161 Add 2-node L2XC tests - CSIT-1160 Add 2-node L2BD tests - CSIT-1157 Add 2-node IP4 tests - CSIT-1153 Add 2-node IP6 KW - CSIT-1158 Add 2-node IP6 tests Change-Id: I7c8fed7018bb355c0de73f6a8bc3a8ec80366972 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-07-16FIX: VTS suitePeter Mikus1-24/+24
Change-Id: I1766ac51ac34b63feab80329c1ae2c62fc6d8496 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-07-13Refactor perf test casesPeter Mikus310-29595/+6628
- Refactor Performance TCs due to changes in Hyperthreading and RXQ allocations. - Simplify the structure of suite to avoid large refactors in future. Change-Id: Ifb1b9719391f26745f075a900bd9fb39b6cb809c Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-07-11CSIT-1178: Prepare for bursty MRRVratko Polak134-139/+164
+ All suites and tests still refer to MRR instead of BMRR (or FRMOBL). + API change: Traffic should pass with maximum rate first argument got a default value, thus it needs to be moved towards the end of argument list. + Consequently, the value for it has been deleted from suites. + Test message is now compatible only with BMRR parsing. - Reporting of transmit rate is left as TODO. + Global test __init__ with new way of giving defaults to global variables. + The new keyword is put into robot_enhancements.robot resource. + Number of trials and trial duration are now configurable. - Bootstrap scripts have no support for overriding the defaults yet. Change-Id: I4b108cc9c256730e62c03fbacba0a1c314f8ae88 Signed-off-by: Vratko Polak <vrpolak@cisco.com>