aboutsummaryrefslogtreecommitdiffstats
path: root/resources
AgeCommit message (Collapse)AuthorFilesLines
2018-09-12Fix: L2 scale tests are not baselineVratko Polak1-1/+1
This fixes select_tags function in common.sh to not include scale l2bd tests in default tag list. This is needed because "L2BDBASE" tag selects also scale tests (contrary to similar IP4BASE and IP6BASE tags). (Line length over 80 characters is left there as an indirect TODO to improve the tags.) Change-Id: Ic1d4a046f327fdd1b8b08eb20f1cdb4b12f337c9 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-09-12Fix: trap for unreserve before cleanupVratko Polak1-3/+3
Change-Id: I978a056ffdfd6daa00a0a1c587774b4a7204b434 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-09-12CSIT-1269: Add VTS tests to trendingTibor Frank2-1/+32
Change-Id: I9ddbad8e4c3f64553c72f77f93eb9d6c21602eca Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-09-10Create l2bdscale tests for 2-node topologyJan Gelety7-26/+442
Jira: CSIT-1268 Change-Id: I13bf2e570a7d7231ba19c2c41db2b44c0b8d215a Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-09-10CSIT-1179: Switch MRR to multiple trialsVratko Polak1-2/+6
But keep the detection in PAL using only average, not size nor stdev. Change-Id: I07092bdeb892c871550265757fd2846a36fbb352 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-09-07CSIT-1270: Split feature tests in trendingTibor Frank2-34/+194
Change-Id: Iecc841737552fea07b7fcf297c478479f7872ae7 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-09-07CSIT-1271: Add VTS tests to MRR jobsTibor Frank1-0/+3
Change-Id: I5c0be60a1819c5c46225b4468ba9c88068231f08 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-09-07CSIT-1262: Add 2n/3n-skx to trendingTibor Frank4-491/+2495
CSIT-1263: Edit Trending static content Change-Id: Ief60f3bea75fb9fd153f7abb0a5933f1a3e317aa Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-09-07Create ip6scale tests for 2-node topologyJan Gelety4-19/+328
Jira: CSIT-1176 Change-Id: I78f4e9cb24a7de0bde24a78d1ca26607598a62b2 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-09-06CSIT-1264: Add oper branch wrapper entry scriptVratko Polak3-1/+133
Change-Id: I569b089b711f89fecca8dd31d6906ef311982877 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-09-06fix CSIT broken issue when numa_node value is -1 on single Socket platformYulong Pei1-2/+5
Single Socket platform e.g. Intel Atom cpu based SOC platform with Ubuntu 16.04.4(kernel 4.13.0-36-generic) or Centos 7.5 (kernel 3.10.0-862.el7), value of /sys/bus/pci/devices/<pci_device_id>/numa_node is -1, this will break CSIT performance test running, but for this kind of SOC platform, it can consider that is not NUMA based platform, numa_node=-1 is reasonable, so fix it at CSIT side, when numa_node=1 and the system's NUMA node count is 1, set numa_node=0. DPDK also did it as this way. Change-Id: I9ac23d3cece2f1489e38f05b50a462bb2ad9f661 Signed-off-by: Yulong Pei <yulong.pei@intel.com>
2018-09-05Create ip4scale tests for 2-node topologyJan Gelety4-13/+313
Jira: CSIT-1174 Change-Id: I46944a3bc0f508d80c8c944dab0190925ebe21f5 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-09-05CSIT-1205 Create AVF driver testPeter Mikus9-132/+546
- Add L1 KWs for SR-IOV handling (init Vfs, remove Vfs, ...) - Cleanup L1 KWs for SR-IOV bind/unbind/pci_get/... - Add L2 KWs for Test Setup/Teardown, L2patch, Create AVF interface - Add sample L2patch test fox x710, xxv710 Change-Id: If17077877455a14043617d8ea0d06cbe47b469e3 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-09-05Add Report historyTibor Frank1-1/+1
Change-Id: I5c7e594bcce266d765d2a517adcbec8e88da7c48 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-09-05Add known issues to report 18.07Tibor Frank1-1/+1
Change-Id: Ide101c80e2ef13021f25096da6afd9e4364ee263 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-09-05Fix various pylint violationsVratko Polak19-106/+111
+ SchedUtils.py: Do not use `len(SEQUENCE)` to determine if a sequence is empty + VatHistory.py: Do not use `len(SEQUENCE)` to determine if a sequence is empty + VppCounters.py: Do not use `len(SEQUENCE)` to determine if a sequence is empty + Memif.py: ++ Do not use `len(SEQUENCE)` to determine if a sequence is empty ++ Either all return statements in a function should return an expression, or none of them should. ++ Update :return: on possible None. + Classify.py: Unnecessary "else" after "return" + ContainerUtils.py: Useless super delegation in method '__init__' + CpuUtils.py: Do not use `len(SEQUENCE)` to determine if a sequence is empty + DropRateSearch.py: Either all return statements in a function should return an expression, or none of them should. + IPv4NodeAddress.py: Do not use `len(SEQUENCE)` to determine if a sequence is empty ++ Also improve docstrings. + IPv4Setup.py: Useless super delegation in method '__init__' + IPv6Setup.py: Do not use `len(SEQUENCE)` to determine if a sequence is empty ++ Also improve docstrings. + IPv6Setup.py: standard import "from ipaddress import IPv6Network" should be placed before "from robot.api import logger" + MacSwap.py: Trailing newlines + NATUtil.py: Do not use `len(SEQUENCE)` to determine if a sequence is empty + NodePath.py: Unnecessary "else" after "return" + Tap.py: Do not use `len(SEQUENCE)` to determine if a sequence is empty + topology.py: Either all return statements in a function should return an expression, or none of them should. + topology.py: Unnecessary "else" after "return" ++ Do not use `len(SEQUENCE)` to determine if a sequence is empty ++ Improve docstrings + DUTSetup.py: Do not use `len(SEQUENCE)` to determine if a sequence is empty ++ Also do not compare int(ret_code) just to access zero-ness. + ssh.py: Do not use `len(SEQUENCE)` to determine if a sequence is empty + InterfaceUtil.py: Unnecessary "else" after "return" Change-Id: Iba4244aa79661ee7df15fed5c7c6dbf04dfa88b2 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-09-05Add eth-ip4base-2memif[ndrpdr|mrr] perf tests for 2-node topologyJan Gelety2-0/+143
- added also 3-node test cases for comparison Jira: CSIT-1261 Change-Id: I1bfcc184e925e969d4a610920c4e49af23047507 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-09-04Fix pylint part 1Peter Mikus9-19/+57
- Decrease pylint errors. Part: easy Change-Id: I452e5b5a11e9b78c03cd173a3848babe21b93c73 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-08-30CSIT-1135: Scripts for VPP per-patch testingVratko Polak9-0/+1409
+ Scripts do not rely on (other) bootstraps. + Perf verify bootstrap is also the new style sript now. + Scripts are divided to functions for better re-use. + Functions are sourced from small number of large "library" files. - Still using jumpavg from pipy. - Perpatch has specific simplified parsing (instead of the PAL one). - Bash style document is in a separate Change. Change-Id: If88fa528ce155ea86b614e3d77c0550b91bbdf11 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-08-28Create ip4-feature perf tests for 2-node topologyJan Gelety6-71/+358
- ACL tests - NAT44 tests - iPoliceMarker tests Jira: CSIT-1175, CSIT-1154 Change-Id: Ife7e7df50f7c1c8033bacdb7512e78be6bcdf4eb Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-08-24add the expected prompt for ubuntu root userYulong Pei2-3/+3
if ssh use root account to login ubuntu os, its prompt is ":~# ", so add it to let csit test can run with root account. Change-Id: I21f5380245324c8e48099433e3d374188e9001d9 Signed-off-by: Yulong Pei <yulong.pei@intel.com>
2018-08-24VPP link bonding perf tests with two links between DUTsJan Gelety3-31/+251
Jira: CSIT-1247 Change-Id: Ia6a3f7682eb9a35040682913c0e33a1d61d1e6fa Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-08-22CSIT-944: PAL Extensions: Mapping tableTibor Frank6-27/+459
Change-Id: I3bebf9ad849c056d2bbac476d22ef5e077af05b3 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-08-22CSIT-1164 Create VM vhost tests for 2-node topologyPeter Mikus1-1/+1
Change-Id: I955d3170da94cf35a2fda03259bcdc020ac2b652 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-08-22CSIT-1222: Do two doublings in external MLRsearchVratko Polak7-22/+74
Make number of doublings configurable, keep Python default at 1, set Robot default to 2. Also make docstring types unique (pylint was complaining about classes and modules having the same name). Increase MLRsearch version to 0.2.0. Change-Id: Ib846032e79ff52994503c0cfef2f86655502c275 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-08-20Refactor VHOST codePeter Mikus9-869/+800
CSIT-1164 Create VM vhost tests for 2-node topology CSIT-1173 Implement VM vhost KWs for 2-node topology - Cleanup QemuUtils.py Library (PEP8, some TODOs, readability, multi queue, ring size, qemu version detection) - Cleanup VHOST KWs perf (Unify running QEMU on N-node topology) - Add ability to configure Queues, Hyperthreading, automatically compute number of CPU for VM/Testpmd and RXQ for Testpmd workload. - Partial cleanup of configuration KWs (l2xc, l2bd) for 2-node - Create IPv4 2-node KW Change-Id: I8aae1355bafa651de715cd438fe706c443ea1d88 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-08-20PAL improvement: Log repr() of PresentationErrorVratko Polak2-3/+5
Change-Id: I491e3a77dda06e6a1caa34f70baaef9751674fbd Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-08-20FIX: PAL: Keep increasing index on errorVratko Polak1-0/+1
The previous fix has added KeyError reporting and recovery, but the reported index got stuck on value 15. Change-Id: I2cec0f678a79ba3e5ca425c92c605e00cf551a35 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-08-18report 18.07: fixed link mapping for generated report pdf file.Maciek Konstantynowicz1-1/+2
Change-Id: I2e23fe3b6f03055beab536e6534dd43d229b7024 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2018-08-18report 18.07: bump report version to v1.0.Maciek Konstantynowicz1-1/+1
Change-Id: Id8d17666bd6cff45641f5d44c63db59603680a54 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2018-08-17report 18.07: Bump report version to v0.9.Maciek Konstantynowicz1-1/+1
Change-Id: Ic4f5520f69d0a97afe54aa8fed269812993d66f7 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2018-08-17report 18.07: Bump report version to 0.8.Maciek Konstantynowicz1-1/+1
Change-Id: Ic5ac9733534fc0f67467c6ea47a4123e246a793a Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2018-08-17Remove DPDK MRR changes section from reportPeter Mikus1-1/+1
Bump report version to 0.7 Change-Id: I77478e3b58daab25bdece1e67795cc911f470136 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-08-17Add new data to 1807 reportpmikus1-0/+24
Change-Id: Ic03c55a198f6deb0cae5c920d7937696dfa19c9e Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-08-16Bump report version to 0.6Peter Mikus1-1/+1
Change-Id: I820288a7209b6c0017ee42f5087f0687679ab078 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-08-16Change report version to 0.5Peter Mikus1-1/+1
Change-Id: I556a8e98d1725ed9465eca2721886869a3a1a39b Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-08-16Add new data set into reportPeter Mikus1-0/+11
Change-Id: Ic280eed9e888524805e019679c8549c75c5981c0 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-08-15Bump report version to finalPeter Mikus1-1/+1
Change-Id: Ie424687a126b2ee5ffcbc5a0774474a67cc0cf50 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-08-15PAL: Log and continue when out of colorsVratko Polak1-6/+14
Previously, IndexError happened in worker, getting the job stuck. Graphs should not need that many colors, so there is a bug to fix still. Change-Id: I1af415119cf06004be5febbd03636f847a7001be Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-08-14CSIT-1208: Add new data to 1807 reportPeter Mikus2-1/+8
Change-Id: Iea304ffd65e4ddbac277274b96207a351cf004fc Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-08-14CSIT-1208: Add new data to 1807 reportPeter Mikus1-1/+48
Change-Id: If575d2dc0e8ddb81afe693c646a911e33559b67e Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-08-14Revert "CSIT-1208: Add new data to 1807 report"Peter Mikus1-48/+0
This reverts commit a0f10dad4aea6c8f8cb0a75c041dce626e39c3d2. Change-Id: I65785d15436d7032908b675cb085b9471d3d6e71 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-08-14CSIT-1208: Add new data to 1807 reportTibor Frank1-0/+48
Change-Id: I96260f9d22d19db608b8b119efede60f69897d98 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-08-10CSIT-1156 Create container memif tests for 2-node topologyPeter Mikus3-98/+120
CSIT-1155 Implement container memif KWs for 2-node topology Change-Id: I4fc7bcab499a0b8a8594114d3f331b0d9610bf9d Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-08-10CSIT-1208: Add new data to 1807 reportTibor Frank1-0/+28
Change-Id: I1c51fe8b37e5a849310418c85be3db8053d67cbe Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-08-10CSIT-1193 De-duplicate bootstrap scripts into onePeter Mikus3-4/+125
- DPDK and VPP bootstrap merged into one (ligato will follow). - Added more error detections - Added topo-cleanup.py to cleanup TB before and after test. - Remove installation of VPP Change-Id: I7a86117eb03cbe4ee8fde47baeed58bc86c0dfb2 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-08-10CSIT-1208: Add new data to 1807 reportTibor Frank1-19/+20
Change-Id: I6f4c03c66a762b129c86a9d751d15f57e62f2ea9 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-08-09CSIT-1229: Add DMM to reportTibor Frank2-0/+58
Change-Id: Ib3ea8c13371a29ea2b4661a8506190dcb15c8ced Signed-off-by: Tibor Frank <tifrank@cisco.com> Signed-off-by: sharath <sharathkumarboyanapally@gmail.com>
2018-08-09CSIT-1208: Add new data to 1807 reportTibor Frank1-7/+31
Change-Id: I103417283196940db841be2a254d5d6e8537938f Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-08-08Report: remove column docTibor Frank1-21/+0
Change-Id: Icef72f6e248b6489f3fe0dc33435f71fa51723aa Signed-off-by: Tibor Frank <tifrank@cisco.com>