aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2019-07-233n-tsh timeout, testbed tags and ansible updatejuraj.linkes46-145/+150
* disable AVF tests which don't work with x520 * increase VPPApiClient timeout to 14s, as x520 show hardware is slower on Taishan * re-enable vhost and memif tests * remove tx2 mrr daily tag list; no tx2 is used for perf testing * remove taishan workaround * add scipy arm prerequisites and scipy workaround * rework inventories/lf_inventory/hosts; move cpu_microarchitecture to host files Change-Id: I5f10bd07b8146ac3b8be8c54fbb4d924a9373813 Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>
2019-07-23Install also sshpass tin centos bootstrapsVratko Polak8-8/+8
Perhaps not needed, but it is better to keep copied code consistent. Change-Id: I068de028586ee6e659e91207f99c2a78ef377e3c Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-07-23Install openssh-client in all centos bootstrapsVratko Polak8-8/+8
Change-Id: Id3de81b88dfdbfecd1b343c50bcda46dd689a3ee Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-07-23Add support for aarch64 container imagesjuraj.linkes8-9/+32
Change-Id: I84f13d7139a6e5f7004426018c2d27425c5fa97e Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>
2019-07-23Trending: Reduce the number of input filesVratko Polak1-27/+9
Another attempt to avoid memory error. Dailies trimmed to ~2 months. Not removed last "skip" item to simplify future editing. Change-Id: Id411eeed109079c4c3f8994d5d6cc296ffe621fc Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-07-23Update of VPP_STABLE_VER files ubuntu18Peter Mikus1-1/+1
- use new vpp ref build - ubuntu 18.04: 19.08-rc0~705-gc75423981 csit-vpp-device-master-ubuntu1804-1n-skx-semiweekly/74/ Change-Id: Iba9eb224f0d0cfb79f8eaec2007a88855d233b9a Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-07-22Remove selected VIRL testsPeter Mikus8-889/+1
- These are not going to be converted to vpp_device Change-Id: I0148be014fee476f3dc1a72c51316aace0f2350f Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-07-19CSIT-1471: Migrate Dhcp library from VAT to PAPIJan Gelety1-4/+9
Change-Id: Ibc9b9b736532cce31994537e632daa4d4e62459c Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-07-19FIX: naming convention fixes for TOXPeter Mikus5-5/+5
Change-Id: I0644fbd0e136dee3a91fd9406155f971b3c726eb Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-07-19VAT API to PAPI CONVERSIONpremkumarv2-15/+41
Change-Id: I9c87cdfb99780f398da5cd90351b303caa89bda9 Signed-off-by: premkumarv <preym17@gmail.com>
2019-07-19TOX: Naming conventionsPeter Mikus2-1/+148
Change-Id: I038d90fc481e5f74085d0fe6165b12769d98e8a1 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-07-19PAL: Skip daily-master-3n-skx/540Vratko Polak1-0/+3
Frequently, reconnect is needed to finish the download, that can lead to IOError. But, MemoryError has also been seen, so perhaps this is a wrong fix. Worth a try, though. Change-Id: Icac17757a1a0ae361faddfa24a818496f14d7340 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-07-19CSIT-1469: Migrate SRv6 library from VAT to PAPIJan Gelety10-167/+293
Change-Id: Ibbec3d1bbda2af9fcab3230fd1747406a89f0cc5 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-07-19Remove un-interested VIRL tests and related resourcesJan Gelety20-2098/+1
Change-Id: I712f5dc238fdf480c7c35250148c12d03ed96d74 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-07-19PLRsearch methodology: Add more comments to graphsVratko Polak3-25/+151
Change-Id: I2d4743c6bb7dc91eca22b01298e4529f6b2e559d Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-07-19FIX: COP ipv6 missing FIBPeter Mikus3-2/+6
- From unknown reason VAT was more tolerant Change-Id: Ia740843c67604a18de40d14cc448138b9f079b41 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-07-19Add support for default_nic in mrr tag listsjuraj.linkes2-6/+7
Change-Id: I1fdc6f3019af6d46b985164c573d44b0e440febd Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>
2019-07-19Bump VPP stable versionVratko Polak3-3/+3
The main goal is to have a build with https://gerrit.fd.io/r/20726 to enable detection of missing API messages. A later build was used, the one just before https://gerrit.fd.io/r/20711 as that looks risky. Change-Id: Id65066389a7ed70dca54acc085272a632859d42c Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-07-12Update of VPP_STABLE_VER filesJan Gelety3-3/+3
- use new vpp ref build - ubuntu 16.04: 19.08-rc0~681-ga0cb32c~b7576 - use new vpp ref build - ubuntu 18.04: 19.08-rc0~681-ga0cb32cb9 - use new vpp ref build - centos7: 19.08-rc0~681_ga0cb32c~b7430 Change-Id: I21baa8090962c2a6fdc3d03f8fbcd86a8e82126c Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-07-18Papi socket: except more errors to insert err_msgVratko Polak1-10/+14
Change-Id: Ided91ee2b47dafb6aad83091126294d79f67aeac Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-07-18Update of VPP_STABLE_VER filesJan Gelety3-3/+3
- use new vpp ref build - ubuntu 16.04: 19.08-rc0~680-g456d2f9~b7573 - use new vpp ref build - ubuntu 18.04: 19.08-rc0~680-g456d2f9c2 - use new vpp ref build - centos7: 19.08-rc0~680_g456d2f9~b7428 Change-Id: I12656e3809c7fc385029449030672b4792f28491 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-07-18VAT-to-PAPI: LISPUtilAndrej Marcinek1-46/+161
Change-Id: I57328dbc33eaf62935a1a14e23f57ebab21c24f5 Signed-off-by: Andrej Marcinek <andrej.marcinek@pantheon.tech>
2019-07-18Trending: Delete presentation_newVratko Polak35-46979/+0
It is outdated an unmaintained. Change-Id: I9b48391906a233cbdf736a3b2d12da80d3a2d77d Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-07-18Trending: Reduce the number of input filesVratko Polak1-42/+6
Change-Id: Ie449aa820bc05d9fed285c04445a5cf715b8ebdf Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-07-17Remove obsolete DPDK bondingPeter Mikus1-99/+0
- Code not used Change-Id: I312635f8038c6d4d4db21d93e43df6b3636feb34 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-07-17FIX: Tags in ansiblePeter Mikus1-0/+1
Change-Id: I6772734b68bc2c09ee550f1a6369e3668f613d92 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-07-17FIX: Put VM interface pinning backPeter Mikus1-0/+6
- Must be there for DPDK NFs Change-Id: Icda8069beab4ce8ced17a372c84524c4824abd9d Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-07-17Revert "Avoid ci-management archiving files twice"Peter Mikus5-1/+31
This reverts commit ccfe499e2a27f2caf234ecbb2ec948120810eab6. Change-Id: I076bdaf255f6fa5cc6b0f25926850d62f450fd94 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-07-11CSIT-1469: Migrate IPsecUtil library from VAT to PAPIJan Gelety37-383/+838
Change-Id: Iac790bf5755a70697e4c4eff32242b04f8e7f789 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-07-17Use PapiSocketProvider for most PAPI callsVratko Polak30-478/+797
Ticket: CSIT-1541 Ticket: VPP-1722 Ticket: CSIT-1546 + Increase timeout to hide x520 slownes of show hardware detail. - Install sshpass and update ssh client in virl bootstrap. + Added TODOs to remove when CSIT-1546 is fixed. + Enable default socksvr on any startup conf. + Improve OptionString init and repr. - The non-socket executor still kept for stats. + Remove everything unrelated to stats from non-socket executor. - Remove some debug-loooking calls to avoid failures. TODO: Introduce proper parsing to the affected keywords. + Reduce logging from PAPI code to level INFO. - Needs https://gerrit.fd.io/r/20660 to fully work. + Change default values for LocalExecution.run() + Return code check enabled by default. Code is more readable when rc!=0 is allowed explicitly, and the test code will now detect unexpected failures. + Logging disabled by default. Output XML is large already. Important logging can be enabled explicitly. + Restore alphabetical order in common.sh functions. Change-Id: I05882cb6b620ad14638f7404b5ad38c7a5de9e6c Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-07-17Refactor VPP Device VM vhost testsjuraj.linkes24-639/+592
* replace the current VM image with kernel img * rework keyword usage to make it consistent with performance tests * remove resources/libraries/robot/shared/qemu.robot as it's not used anywhere anymore Change-Id: Ia5bc19e9e6ed9af031e4d9b5c0c89431fb49fd33 Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>
2019-07-17FIX: Move per-patch building mechanicsPeter Mikus1-5/+2
- Use make pkg-verify Change-Id: Id0f95c9261f1a1b5fa017b0823f87aeb5d6bb6d1 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-07-16fix invalid variable name issue of ipsechw test suitesYulong Pei2-2/+2
Change-Id: Ie7bfaaaa2e4cab4b52dab42f71780f581306659b Signed-off-by: Yulong Pei <yulong.pei@intel.com>
2019-07-11Update of VPP_STABLE_VER filesJan Gelety3-3/+3
- use new vpp ref build - ubuntu 16.04: 19.08-rc0~663-g692b949~b7537 - use new vpp ref build - ubuntu 18.04: 19.08-rc0~663-g692b9498e - use new vpp ref build - centos7: 19.08-rc0~663_g692b949~b7410 Change-Id: Ia80895a0a679b23ac5cbcd540ba9fda02d1868e9 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-07-12VPPD: Cop, iACL, PolicerPeter Mikus31-1408/+1268
- Alignment with PERF Change-Id: Id7b2cb91c88e44cf9265c3376330f6aa579abf7a Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-07-12PapiExecutor always verifiesVratko Polak20-765/+457
Do not support returning unverified replies anymore. Basically, ".get_replies().verify_replies()" is now just ".get_replies()". This allows fairly large simplifications both at call sites and in PapiExecutor.py + Rename get_dumps to get_details. + Introduce get_reply and get_sw_if_index. + Rename variables holding get_*() value, + e.g. get_stats() value is stored to variable named "stats". + Rename "item" of subsequent loop to hint the type instead. + Rename "details" function argument to "verbose". + Process reply details in place, instead of building new list. - Except hybrid blocks which can return both list or single item. - Except human readable text building blocks. + Rename most similar names to sw_if_index. - Except "vpp_sw_index" and some function names. + Use single run_cli_cmd from PapiExecutor. + Do not chain methods over multiple lines. + Small space gain is not worth readability loss. + Include minor code and docstrings improvement. + Add some TODOs. Change-Id: Ib2110a3d2101a74d5837baab3a58dc46aafc6ce3 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-07-12Avoid ci-management archiving files twiceVratko Polak5-31/+1
https://gerrit.fd.io/r/20119 has changed the way archival works, everything should now go to logs.fd.io (instead of appearing on run page in jenkins.fd.io). The glob pattern for archiving is quite eager, doing recursive search. That is good, as it can find also misplaced useful outputs. But it also means our usage of copy_archives function creates two copies of archived directories, usually archives/ and archives/archive/. This change simply removes copy_archives, relying on the new recursive search. A solution with changing ARCHIVE_DIR and moving if needed would be better, but looking at amout of jobs and various func bootstraps, it is not worth the effort. Change-Id: Iad2bc09455944307e59eecafa64d1db6dc8befe8 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-07-12VPPD: Merge IPv4/IPv6Peter Mikus8-436/+24
- Preparation for coverage.sh Change-Id: Id299df9cd57ee69116686c8bc85eaba1cc353122 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-07-12Add per arch mrr daily test for denverton platformYulong Pei7-1/+17
Change-Id: Ica7d6bf0dbdfde3de70eabd131c79cadd8af3a16 Signed-off-by: Yulong Pei <yulong.pei@intel.com>
2019-07-11CSIT-1477: add 1n_tx2 VPP Devicejuraj.linkes14-57/+202
- add 1n_tx2 testbed - update VF reservation to meet 1n_tx2 testbed needs - update ansible with 1n_tx2 Change-Id: Ia075a913d4859f537fd0e6bff731ea88aff01dd9 Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>
2019-07-11FIX: Various naming convention typosPeter Mikus21-21/+21
Change-Id: Ib55d9f3993cb63d3130a6bd338d612bde0235d5d Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-07-11Aligning FUNC/PERF keywords - Data drivenPeter Mikus25-545/+961
Change-Id: I233c8908c724556db09c60de6efa9237068fb4c3 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-07-10Fix few pylint violationsVratko Polak4-11/+9
+ Stop attempting to check test/ as module inits are not there. Change-Id: Ia4e498061be3e3118b07e98c9c2f761f2454653e Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-07-10Tolerate failures when setting MTUVratko Polak1-3/+8
Because some NICs are known to not allow jumbo frames. Change-Id: I45fe636e3a880c6640922468c170f50e85dd2ba2 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-07-10FIX: use correct slicing of classify mask/match stringJan Gelety1-28/+75
Change-Id: I11cc8ddc6925b44a596aa03d71318efd76232d6d Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-07-10Bash functions style cleanupVratko Polak9-147/+226
+ Update rst documentation for bash style + Command substitution: + Clarify when to use backticks. + Recommend avoiding nested command substitution. + Do not recommend putting command substitution results into quotes. + Function definition content: + Move "set -exuo pipefail" after comment only blocks. + Other set flags allowed for functions with good reasons. + Apply the new recommendations. - Blank lines unified in code but no written recommendation in rst. + Add missing references to functions called, variables read or set. + Add TODOs to where lists would be long. + Minor improvements to function descriptions. + Make "if" expressions more python-like. + Add missing "|| die" (or "|| true") where spotted. + Downgrade DEFAULT_NIC to a local variable. + Add TODO to list reasons for blacklisted tags. Change-Id: I05dce030a8c2cb1b3a242d8b977e8fe150d8ee20 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-07-10Modify kernel VM download to custom buildjuraj.linkes4-17/+56
Instead of downloading linux-image-kvm, build custom initrd from currently used kernel on perf sut or vpp device host. Change-Id: I836f9c5264695c44566b7d52f3ec03e26a474524 Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>
2019-07-09Add scale ipsec tunnel tests 20KPeter Mikus44-51/+950
Change-Id: Ib52e1735b6b82ea9fea44c06c379f117068e94c1 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-07-09CSIT-1539 Aligning FUNC/PERF keywords - Phase IIIPeter Mikus123-869/+670
Change-Id: Ibd3e99390bf004173d3d126946b95ffe9ba8f196 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-07-09Update of VPP_STABLE_VER filesJan Gelety3-3/+3
- use new vpp ref build - ubuntu 16.04: 19.08-rc0~603-g69a85b5~b7459 - use new vpp ref build - ubuntu 18.04: 19.08-rc0~603-g69a85b505 - use new vpp ref build - centos7: 19.08-rc0~603_g69a85b5~b7350 Change-Id: I753e3ddd3a5e3f02ecdf11a600ea1b43e9e86d9c Signed-off-by: Jan Gelety <jgelety@cisco.com>