aboutsummaryrefslogtreecommitdiffstats
path: root/tests
AgeCommit message (Collapse)AuthorFilesLines
2018-12-11Add missing = to all suite VariablesVratko Polak149-323/+323
Use the following if we ever decide '} =' is better than '}='. $ cd csit/tests $ find . -type f -print0 | xargs -0 sed -i -E 's/^\| \$\{(.*)\}= \|([^|])/\| \$\{\1\} = \|\2/g' FIXME: Add a corresponding check to https://gerrit.fd.io/r/13450 Change-Id: I73c516a0d7e475ff0986fd6515aaae10accd1a3a Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-12-07VPP_Device - add baseline tests - part IJan Gelety4-12/+345
CSIT-1370 Add following baseline tests to VPP_Device: - ip4 eth2p-ethip4-ip4base-dev - ip6 eth2p-ethip6-ip6base-dev - l2bd eth2p-eth-l2bdbasemaclrn-dev Change-Id: Ic20000eb38c5511c27d020f3aa76b2620d7f7ef9 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-11-30CSIT-1299: Revise the graphs in TrendingTibor Frank4-4/+4
Change-Id: Ie8cbc7bc8a58aca41c8cb35c14dbd8e80f027f5c Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-11-29FIX: VPP_Device - use vpp bionic packagesJan Gelety2-1/+2
Because there is already used ubuntu bionic on VPP device testbed and used download script from pacakgecloud site donwloads packages based on host OS we need additional file to store vpp bionic stable version for VPP_Device tests. Change-Id: If834dc8af7dffa19b8ddeae013c3da9b37a5a81a Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-11-29FIX: Exclude softwire func tests from executionJan Gelety3-2/+3
CSIT-1371 Map commands were remove from VAT by patch https://gerrit.fd.io/r/#/c/16115/. Excluding softwire functional tests from execution until corresponding csit KWs are fixed. Change-Id: I2adc580fb4770746c355f12f5ce7e7f8823255d8 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-11-27CSIT python API introductionJan Gelety2-2/+3
Jira: CSIT-1336 Change-Id: I96d2b0221c5a7466484a82339fc132c5921532d1 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-10-25CSIT-1339 Create initial l2xc testPeter Mikus2-0/+126
- L2XC ping ICMPv4/ICMPv6 test Change-Id: I1c1708e8c1050f140a02d56012f63b683fc3eec1 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-10-24Migration of DMM-CSIT scripts to DMM reposharath6-200/+8
Change-Id: Ibaa7652b24385805b5cdd1540ed98b09e68c69bc Signed-off-by: sharath <sharathkumarboyanapally@gmail.com>
2018-10-24Remove usage of vpp-ext-deps packageJan Gelety1-1/+1
This package is not needed for csit enymore. Change-Id: Ie32a9c9322873e66554bb69112d4428697c866db Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-10-20update l2bdbasemaclrn-mrr and l2bdbasemaclrn-ndrpdr for x553 NICYulong Pei2-2/+2
update the test suites to call "Initialize L2 bridge domain in circular topology" since "Initialize L2 bridge domain in 2-node circular topology" was replaced by it. Change-Id: I6d5cb0868353228fbcf37b308ffa0b562649c57a Signed-off-by: Yulong Pei <yulong.pei@intel.com>
2018-10-12Tag l2bdscale as L2BDSCALE, not L2BDBASEVratko Polak24-24/+24
Change-Id: I0d2d2f16f7e0b710f432711d7e0eccf70fcfcc8f Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-10-10CSIT-1297: Modify the bootstrap.sh to run only selected mrr suitesTibor Frank10-10/+10
Change-Id: I2f5ac334e09bc35bfaefc112cf0bb7f57290a732 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-10-10Add VXLAN scale perf testsJan Gelety20-60/+2228
Jira: CSIT-1273 Change-Id: Ic2a41661c158384a5aaa7d4e73f30ffca13ddf82 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-10-02CSIT-1325 - FIX: AVF tests failing on unbindPeter Mikus4-4/+4
Currently there is and issue when consecutive AVF suites are trying to initialize AVF and bind VF to vfio-pci driver, there seems to be race condition if VPP has already VFs allocated. This patch should introduce safer contstrain to disable VPP prior AVF init. Change-Id: Id8839200f19d9e7a18d161b660cfb1e43a8ca379 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-10-01CSIT-1327 Migrate from vpp-dkms-dpdk to vpp-ext-depsPeter Mikus1-1/+1
Change-Id: I6fad3303c5c331ad36d163ba735907e35931dea0 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-09-28CSIT-1321 Add IP4base tests using AVF driverPeter Mikus4-0/+484
Change-Id: I960c2b4170efa06597851853cfc15bda1c60fe94 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-09-27integration of DMM+lwip testscriptssharath7-242/+193
Change-Id: Ifb1a0702353e71c61a694dea5164df41f4e23389 Signed-off-by: sharath <sharathkumarboyanapally@gmail.com>
2018-09-26CSIT-1316 Fix ligato building mechanics in CSIT bootstrapsPeter Mikus1-0/+5
Change-Id: Ia8da73cbf7ab213b61a330b757419330667be24b Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-09-21Fix autogen regenerator and few suitesVratko Polak12-200/+152
+ "elif" instead of "else if". + Some suites had test cases reordered. + Some suites contained 9000B cases for avf. Change-Id: I3bf8241c317f20dbf66b497a2c8be35ef71307f5 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-09-20FIX: 40Ge2P1Vic1385-Eth-L2Bdbasemaclrn-Mrr typoPeter Mikus1-1/+1
- Per trending. Change-Id: I1e24b20bc774dae91df6fb81e3a9132ff79e3beb Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-09-20Add dot1q-l2bdbase-2memif-[ndrpdr|mrr] perf tests for 2-node topologyJan Gelety8-0/+1242
Jira: CSIT-1289 Change-Id: I9e3f1f4a03e3cac9d8831f3a87e0b1bce27a109e Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-09-20Add dot1q-l2bdbase-2vhost-[ndrpdr|mrr] perf tests for 2-node topologyJan Gelety8-94/+696
Jira: CSIT-1286 Change-Id: Id51c7dbf15d846f1286e6efbc5240a2556ec9652 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-09-20CSIT-1205 Create AVF driver test - Add Tests L2BD L2XCPeter Mikus8-0/+969
Change-Id: Ia74a87346fe2c0a170b881b510f1b0558a538f3c Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-09-20Create basic 2-node topology performance tests for Intel-X553 NICYulong Pei10-0/+1280
Intel-X553 is Denverton (Intel Atom cpu based SOC) integrated NIC, add below basic 2-node topology performance test suites for it, the test suites were changed from the existing Intel-x710 test suites, - eth-l2patch-mrr - eth-l2patch-ndrpdr - eth-l2xcbase-mrr - eth-l2xcbase-ndrpdr - eth-l2bdbasemaclrn-mrr - eth-l2bdbasemaclrn-ndrpdr - ethip4-ip4base-mrr - ethip4-ip4base-ndrpdr - ethip6-ip6base-mrr - ethip6-ip6base-ndrpdr Change-Id: Ib6d3655a6e14ae275c197fd7b39d59e17a233326 Signed-off-by: Yulong Pei <yulong.pei@intel.com>
2018-09-18Add dot1q-ip6base-[ndrpdr|mrr] perf tests for 2-node topologyJan Gelety12-4/+1090
Jira: CSIT-1283 Change-Id: I0f6841bafdb47bdbc3efe29801fe66a0d4c388ca Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-09-17Add dot1q-l2[bd|xc]base-[ndrpdr|mrr] perf tests for 2-node topologyJan Gelety16-128/+1231
Jira: CSIT-1284 Change-Id: I8ce4ffc76adf55bf9a8423077b8639601c560c87 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-09-14Add dot1q-ip4base-[ndrpdr|mrr] perf tests for 2-node topologyJan Gelety14-13/+1120
Jira: CSIT-1278 Change-Id: I3cc929222d7fd58f38e33917e84675e9c0b55bbd Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-09-10Create l2bdscale tests for 2-node topologyJan Gelety38-397/+1983
Jira: CSIT-1268 Change-Id: I13bf2e570a7d7231ba19c2c41db2b44c0b8d215a Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-09-10CSIT-1179: Switch MRR to multiple trialsVratko Polak1-2/+2
But keep the detection in PAL using only average, not size nor stdev. Change-Id: I07092bdeb892c871550265757fd2846a36fbb352 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-09-07CSIT-1272: Fix VTS testsTibor Frank6-6/+6
Change-Id: Ibc4ae346032b2b711e4dcd1dbc9c0873e8464b19 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-09-07Create ip6scale tests for 2-node topologyJan Gelety24-162/+1734
Jira: CSIT-1176 Change-Id: I78f4e9cb24a7de0bde24a78d1ca26607598a62b2 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-09-06Fix autogen violationsVratko Polak4-76/+124
Four AVF suites had test cases in different order. Change-Id: I12fbe3508016a79a2153cc004c654a21ee4279bf Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-09-05Create ip4scale tests for 2-node topologyJan Gelety24-138/+1722
Jira: CSIT-1174 Change-Id: I46944a3bc0f508d80c8c944dab0190925ebe21f5 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-09-05CSIT-1205 Create AVF driver testPeter Mikus4-0/+482
- Add L1 KWs for SR-IOV handling (init Vfs, remove Vfs, ...) - Cleanup L1 KWs for SR-IOV bind/unbind/pci_get/... - Add L2 KWs for Test Setup/Teardown, L2patch, Create AVF interface - Add sample L2patch test fox x710, xxv710 Change-Id: If17077877455a14043617d8ea0d06cbe47b469e3 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-09-05Add eth-ip4base-2memif[ndrpdr|mrr] perf tests for 2-node topologyJan Gelety10-0/+1468
- added also 3-node test cases for comparison Jira: CSIT-1261 Change-Id: I1bfcc184e925e969d4a610920c4e49af23047507 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-08-28Create ip4-feature perf tests for 2-node topologyJan Gelety144-846/+4337
- ACL tests - NAT44 tests - iPoliceMarker tests Jira: CSIT-1175, CSIT-1154 Change-Id: Ife7e7df50f7c1c8033bacdb7512e78be6bcdf4eb Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-08-27FIX: Correction of ACL perf test suite documentationJan Gelety72-905/+840
Change-Id: I01cc87f5f5409346566ded52da9d384fdd3fa2c4 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-08-24VPP link bonding perf tests with two links between DUTsJan Gelety12-4/+687
Jira: CSIT-1247 Change-Id: Ia6a3f7682eb9a35040682913c0e33a1d61d1e6fa Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-08-22CSIT-1164 Create VM vhost tests for 2-node topologyPeter Mikus36-0/+4946
Change-Id: I955d3170da94cf35a2fda03259bcdc020ac2b652 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-08-21HC Tests: reenable VxLaN GPE ipv6 testsMarek Gradzki1-4/+2
The issue is no longer present in VPP master branch (1810). Change-Id: I64f4fa8544ace8dc3686db9a1a3f3897ba333c61 Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
2018-08-21FIX: Use correct interface type in x710_1lbvpplacp perf testsJan Gelety4-4/+4
Change-Id: I68db0b0441ffc7d9b5e04048688711915ab24726 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-08-21Add MRR tests for kubernetesVratko Polak41-61/+3454
Fix number of flows in Documentation. Change-Id: I0db62ab79c44db0ea55e000f8ef9cb8ee28a07fe Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-08-20HC Tests: mark BGP v6 tests as criticalMarek Gradzki1-2/+0
TC13 of BGP tests was marked as EXPECTED_FAILING due to HONEYCOMB-403, but the error does not occur on 1807 nor master for some time. Change-Id: I3d8f4ee78fed699927fed05e8fa070cfa95b2166 Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
2018-08-20Refactor VHOST codePeter Mikus99-1368/+622
CSIT-1164 Create VM vhost tests for 2-node topology CSIT-1173 Implement VM vhost KWs for 2-node topology - Cleanup QemuUtils.py Library (PEP8, some TODOs, readability, multi queue, ring size, qemu version detection) - Cleanup VHOST KWs perf (Unify running QEMU on N-node topology) - Add ability to configure Queues, Hyperthreading, automatically compute number of CPU for VM/Testpmd and RXQ for Testpmd workload. - Partial cleanup of configuration KWs (l2xc, l2bd) for 2-node - Create IPv4 2-node KW Change-Id: I8aae1355bafa651de715cd438fe706c443ea1d88 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-08-17copying all .so[newly added] into app directorysharath1-3/+3
Change-Id: I5b89732c5dd1a4b74ffbafbd78803721dbf9c61c Signed-off-by: sharath <sharathkumarboyanapally@gmail.com>
2018-08-17CSIT-1245 - Wrong configuration of srv6proxy-ndrpdr-stat and ↵Peter Mikus2-2/+2
srv6proxy-masq-ndrpdr TCs Change-Id: If5a45b97c90f85f2f193d796adbddd329f2728cd Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-08-15FIX: Set default values for VTS teardown argumentsVratko Polak6-6/+18
Change-Id: Ic45b23073307cd2174415cf3b406a9bb4be56004 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-08-15HC Tests: remove EXPECTED_FAILING tag from policer tests (HC2VPP-375)Marek Gradzki1-4/+0
Translation of classify sessions was fixed in hc2vpp by https://gerrit.fd.io/r/#/c/14180/ This patch reverts https://gerrit.fd.io/r/#/c/14155/ Change-Id: Ia669fa051019585c494dacd10b9585bfff485364 Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
2018-08-13HC Tests: mark policer tests as EXPECTED_FAILING (HC2VPP-373)Marek Gradzki1-0/+4
Change-Id: I394a024e98d74b468a821040db69c1d6eed820ea Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
2018-08-10CSIT-1156 Create container memif tests for 2-node topologyPeter Mikus28-34/+1210
CSIT-1155 Implement container memif KWs for 2-node topology Change-Id: I4fc7bcab499a0b8a8594114d3f331b0d9610bf9d Signed-off-by: Peter Mikus <pmikus@cisco.com>