aboutsummaryrefslogtreecommitdiffstats
path: root/resources
AgeCommit message (Collapse)AuthorFilesLines
2018-09-26CSIT-1316 Fix ligato building mechanics in CSIT bootstrapsPeter Mikus3-34/+70
Change-Id: Ia8da73cbf7ab213b61a330b757419330667be24b Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-09-26CSIT-1317 ADD: Ability to blacklist tags per topologyPeter Mikus1-2/+17
- Add option to override some tags per topology. Change-Id: I4045ebbee1c5d32e29cdb6c5c84e0dcd9217b2cf Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-09-25FIX: Add VatHistory for VATscript files.Peter Mikus1-0/+3
Add ability to see Vat history for file sourced commands. Change-Id: I49b19236bec7253ea412659368cb7ccb5f5e3274 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-09-24CSIT-1292 Update Ansible playbooks with vpp_device tasksPeter Mikus7-3/+122
Change-Id: I22d1fe2fc27d6adb39eba2578e68d06992a3f976 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-09-21Fix autogen regenerator and few suitesVratko Polak1-1/+1
+ "elif" instead of "else if". + Some suites had test cases reordered. + Some suites contained 9000B cases for avf. Change-Id: I3bf8241c317f20dbf66b497a2c8be35ef71307f5 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-09-20FIX: Do not run double link tests on 3n-hswPeter Mikus1-1/+1
Change-Id: I9dfb4bfba4d0650a42e34d0e1f97b60b031f0750 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-09-20Add dot1q-l2bdbase-2memif-[ndrpdr|mrr] perf tests for 2-node topologyJan Gelety1-0/+76
Jira: CSIT-1289 Change-Id: I9e3f1f4a03e3cac9d8831f3a87e0b1bce27a109e Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-09-20Add dot1q-l2bdbase-2vhost-[ndrpdr|mrr] perf tests for 2-node topologyJan Gelety1-15/+31
Jira: CSIT-1286 Change-Id: Id51c7dbf15d846f1286e6efbc5240a2556ec9652 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-09-20CSIT-1205 Create AVF driver test - Add Tests L2BD L2XCPeter Mikus1-6/+18
Change-Id: Ia74a87346fe2c0a170b881b510f1b0558a538f3c Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-09-19CSIT-1291 Improve service handling with container detectionPeter Mikus3-188/+230
Change-Id: Iaeac10676f46e0267041afee927bc6e3201146b2 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-09-19CSIT-1288: Prepare data to be sent by JenkinsTibor Frank2-5/+6
Change-Id: I0840883d52180d09f7de2bd9b0391a0db24105f5 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-09-18CSIT-1288: Prepare data to be sent by JenkinsTibor Frank3-3/+15
- Add creation of tar.gz file Change-Id: I525c713bb3e157cd94337222781066252c3fa517 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-09-18Add dot1q-ip6base-[ndrpdr|mrr] perf tests for 2-node topologyJan Gelety2-0/+195
Jira: CSIT-1283 Change-Id: I0f6841bafdb47bdbc3efe29801fe66a0d4c388ca Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-09-17CSIT-1131: AlertingTibor Frank4-6/+356
- CSIT-1132: Send e-mail with a list of failed tests - CSIT-1288: Prepare data to be sent by Jenkins Change-Id: I7ac720dca44d7c13b22218abbca7a00d36d459cb Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-09-17Add dot1q-l2[bd|xc]base-[ndrpdr|mrr] perf tests for 2-node topologyJan Gelety2-29/+46
Jira: CSIT-1284 Change-Id: I8ce4ffc76adf55bf9a8423077b8639601c560c87 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-09-14Add dot1q-ip4base-[ndrpdr|mrr] perf tests for 2-node topologyJan Gelety3-129/+323
Jira: CSIT-1278 Change-Id: I3cc929222d7fd58f38e33917e84675e9c0b55bbd Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-09-13CSIT-1282 Migrate from Nexus.fd.io to packagecloud.ioPeter Mikus3-196/+164
Change-Id: Ib4e72dc8e3c0fedfcd702f4f97bc4f26cbc642e9 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-09-13CSIT-1280 Single memif container test failingPeter Mikus1-5/+35
- FIX Change-Id: I4b62d08b140dc73eb950d21bc85dc41ad638bbd2 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-09-12Fix: L2 scale tests are not baselineVratko Polak1-1/+1
This fixes select_tags function in common.sh to not include scale l2bd tests in default tag list. This is needed because "L2BDBASE" tag selects also scale tests (contrary to similar IP4BASE and IP6BASE tags). (Line length over 80 characters is left there as an indirect TODO to improve the tags.) Change-Id: Ic1d4a046f327fdd1b8b08eb20f1cdb4b12f337c9 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-09-12Fix: trap for unreserve before cleanupVratko Polak1-3/+3
Change-Id: I978a056ffdfd6daa00a0a1c587774b4a7204b434 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-09-12CSIT-1269: Add VTS tests to trendingTibor Frank2-1/+32
Change-Id: I9ddbad8e4c3f64553c72f77f93eb9d6c21602eca Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-09-10Create l2bdscale tests for 2-node topologyJan Gelety7-26/+442
Jira: CSIT-1268 Change-Id: I13bf2e570a7d7231ba19c2c41db2b44c0b8d215a Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-09-10CSIT-1179: Switch MRR to multiple trialsVratko Polak1-2/+6
But keep the detection in PAL using only average, not size nor stdev. Change-Id: I07092bdeb892c871550265757fd2846a36fbb352 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-09-07CSIT-1270: Split feature tests in trendingTibor Frank2-34/+194
Change-Id: Iecc841737552fea07b7fcf297c478479f7872ae7 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-09-07CSIT-1271: Add VTS tests to MRR jobsTibor Frank1-0/+3
Change-Id: I5c0be60a1819c5c46225b4468ba9c88068231f08 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-09-07CSIT-1262: Add 2n/3n-skx to trendingTibor Frank4-491/+2495
CSIT-1263: Edit Trending static content Change-Id: Ief60f3bea75fb9fd153f7abb0a5933f1a3e317aa Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-09-07Create ip6scale tests for 2-node topologyJan Gelety4-19/+328
Jira: CSIT-1176 Change-Id: I78f4e9cb24a7de0bde24a78d1ca26607598a62b2 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-09-06CSIT-1264: Add oper branch wrapper entry scriptVratko Polak3-1/+133
Change-Id: I569b089b711f89fecca8dd31d6906ef311982877 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-09-06fix CSIT broken issue when numa_node value is -1 on single Socket platformYulong Pei1-2/+5
Single Socket platform e.g. Intel Atom cpu based SOC platform with Ubuntu 16.04.4(kernel 4.13.0-36-generic) or Centos 7.5 (kernel 3.10.0-862.el7), value of /sys/bus/pci/devices/<pci_device_id>/numa_node is -1, this will break CSIT performance test running, but for this kind of SOC platform, it can consider that is not NUMA based platform, numa_node=-1 is reasonable, so fix it at CSIT side, when numa_node=1 and the system's NUMA node count is 1, set numa_node=0. DPDK also did it as this way. Change-Id: I9ac23d3cece2f1489e38f05b50a462bb2ad9f661 Signed-off-by: Yulong Pei <yulong.pei@intel.com>
2018-09-05Create ip4scale tests for 2-node topologyJan Gelety4-13/+313
Jira: CSIT-1174 Change-Id: I46944a3bc0f508d80c8c944dab0190925ebe21f5 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-09-05CSIT-1205 Create AVF driver testPeter Mikus9-132/+546
- Add L1 KWs for SR-IOV handling (init Vfs, remove Vfs, ...) - Cleanup L1 KWs for SR-IOV bind/unbind/pci_get/... - Add L2 KWs for Test Setup/Teardown, L2patch, Create AVF interface - Add sample L2patch test fox x710, xxv710 Change-Id: If17077877455a14043617d8ea0d06cbe47b469e3 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-09-05Add Report historyTibor Frank1-1/+1
Change-Id: I5c7e594bcce266d765d2a517adcbec8e88da7c48 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-09-05Add known issues to report 18.07Tibor Frank1-1/+1
Change-Id: Ide101c80e2ef13021f25096da6afd9e4364ee263 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-09-05Fix various pylint violationsVratko Polak19-106/+111
+ SchedUtils.py: Do not use `len(SEQUENCE)` to determine if a sequence is empty + VatHistory.py: Do not use `len(SEQUENCE)` to determine if a sequence is empty + VppCounters.py: Do not use `len(SEQUENCE)` to determine if a sequence is empty + Memif.py: ++ Do not use `len(SEQUENCE)` to determine if a sequence is empty ++ Either all return statements in a function should return an expression, or none of them should. ++ Update :return: on possible None. + Classify.py: Unnecessary "else" after "return" + ContainerUtils.py: Useless super delegation in method '__init__' + CpuUtils.py: Do not use `len(SEQUENCE)` to determine if a sequence is empty + DropRateSearch.py: Either all return statements in a function should return an expression, or none of them should. + IPv4NodeAddress.py: Do not use `len(SEQUENCE)` to determine if a sequence is empty ++ Also improve docstrings. + IPv4Setup.py: Useless super delegation in method '__init__' + IPv6Setup.py: Do not use `len(SEQUENCE)` to determine if a sequence is empty ++ Also improve docstrings. + IPv6Setup.py: standard import "from ipaddress import IPv6Network" should be placed before "from robot.api import logger" + MacSwap.py: Trailing newlines + NATUtil.py: Do not use `len(SEQUENCE)` to determine if a sequence is empty + NodePath.py: Unnecessary "else" after "return" + Tap.py: Do not use `len(SEQUENCE)` to determine if a sequence is empty + topology.py: Either all return statements in a function should return an expression, or none of them should. + topology.py: Unnecessary "else" after "return" ++ Do not use `len(SEQUENCE)` to determine if a sequence is empty ++ Improve docstrings + DUTSetup.py: Do not use `len(SEQUENCE)` to determine if a sequence is empty ++ Also do not compare int(ret_code) just to access zero-ness. + ssh.py: Do not use `len(SEQUENCE)` to determine if a sequence is empty + InterfaceUtil.py: Unnecessary "else" after "return" Change-Id: Iba4244aa79661ee7df15fed5c7c6dbf04dfa88b2 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-09-05Add eth-ip4base-2memif[ndrpdr|mrr] perf tests for 2-node topologyJan Gelety2-0/+143
- added also 3-node test cases for comparison Jira: CSIT-1261 Change-Id: I1bfcc184e925e969d4a610920c4e49af23047507 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-09-04Fix pylint part 1Peter Mikus9-19/+57
- Decrease pylint errors. Part: easy Change-Id: I452e5b5a11e9b78c03cd173a3848babe21b93c73 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-08-30CSIT-1135: Scripts for VPP per-patch testingVratko Polak9-0/+1409
+ Scripts do not rely on (other) bootstraps. + Perf verify bootstrap is also the new style sript now. + Scripts are divided to functions for better re-use. + Functions are sourced from small number of large "library" files. - Still using jumpavg from pipy. - Perpatch has specific simplified parsing (instead of the PAL one). - Bash style document is in a separate Change. Change-Id: If88fa528ce155ea86b614e3d77c0550b91bbdf11 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-08-28Create ip4-feature perf tests for 2-node topologyJan Gelety6-71/+358
- ACL tests - NAT44 tests - iPoliceMarker tests Jira: CSIT-1175, CSIT-1154 Change-Id: Ife7e7df50f7c1c8033bacdb7512e78be6bcdf4eb Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-08-24add the expected prompt for ubuntu root userYulong Pei2-3/+3
if ssh use root account to login ubuntu os, its prompt is ":~# ", so add it to let csit test can run with root account. Change-Id: I21f5380245324c8e48099433e3d374188e9001d9 Signed-off-by: Yulong Pei <yulong.pei@intel.com>
2018-08-24VPP link bonding perf tests with two links between DUTsJan Gelety3-31/+251
Jira: CSIT-1247 Change-Id: Ia6a3f7682eb9a35040682913c0e33a1d61d1e6fa Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-08-22CSIT-944: PAL Extensions: Mapping tableTibor Frank6-27/+459
Change-Id: I3bebf9ad849c056d2bbac476d22ef5e077af05b3 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-08-22CSIT-1164 Create VM vhost tests for 2-node topologyPeter Mikus1-1/+1
Change-Id: I955d3170da94cf35a2fda03259bcdc020ac2b652 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-08-22CSIT-1222: Do two doublings in external MLRsearchVratko Polak7-22/+74
Make number of doublings configurable, keep Python default at 1, set Robot default to 2. Also make docstring types unique (pylint was complaining about classes and modules having the same name). Increase MLRsearch version to 0.2.0. Change-Id: Ib846032e79ff52994503c0cfef2f86655502c275 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-08-20Refactor VHOST codePeter Mikus9-869/+800
CSIT-1164 Create VM vhost tests for 2-node topology CSIT-1173 Implement VM vhost KWs for 2-node topology - Cleanup QemuUtils.py Library (PEP8, some TODOs, readability, multi queue, ring size, qemu version detection) - Cleanup VHOST KWs perf (Unify running QEMU on N-node topology) - Add ability to configure Queues, Hyperthreading, automatically compute number of CPU for VM/Testpmd and RXQ for Testpmd workload. - Partial cleanup of configuration KWs (l2xc, l2bd) for 2-node - Create IPv4 2-node KW Change-Id: I8aae1355bafa651de715cd438fe706c443ea1d88 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-08-20PAL improvement: Log repr() of PresentationErrorVratko Polak2-3/+5
Change-Id: I491e3a77dda06e6a1caa34f70baaef9751674fbd Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-08-20FIX: PAL: Keep increasing index on errorVratko Polak1-0/+1
The previous fix has added KeyError reporting and recovery, but the reported index got stuck on value 15. Change-Id: I2cec0f678a79ba3e5ca425c92c605e00cf551a35 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-08-18report 18.07: fixed link mapping for generated report pdf file.Maciek Konstantynowicz1-1/+2
Change-Id: I2e23fe3b6f03055beab536e6534dd43d229b7024 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2018-08-18report 18.07: bump report version to v1.0.Maciek Konstantynowicz1-1/+1
Change-Id: Id8d17666bd6cff45641f5d44c63db59603680a54 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2018-08-17report 18.07: Bump report version to v0.9.Maciek Konstantynowicz1-1/+1
Change-Id: Ic4f5520f69d0a97afe54aa8fed269812993d66f7 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2018-08-17report 18.07: Bump report version to 0.8.Maciek Konstantynowicz1-1/+1
Change-Id: Ic5ac9733534fc0f67467c6ea47a4123e246a793a Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>