aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2019-06-27VAT-to-PAPI: IPFIX and SPANTibor Frank20-1608/+23
Change-Id: I34bdc17d6350e5a441dabd9154620627780f4c12 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-06-27VAT-to-PAPI: TraceTibor Frank1-9/+8
Change-Id: Id0b6943eec7e8a15cb2db5c89f93a38f21d686c7 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-06-26VAT-to-PAPI: Remove unused VAT files.Tibor Frank15-17/+0
Change-Id: I1563db488e9dd690aa7e732691e306a9e51ececa Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-06-16FIX: IPUtil after vpp api changesJan Gelety12-148/+220
+ do not log all ip_route_add_del api calls to PAPI history in case of scale tests + fix for SRv6 proxy tests + support of more complex structures in api calls/replies in PapiExecutor + update of vpp stable build to version 19.08-rc0~487-gb98dbb1 Change-Id: I9972e126b68ce1cb57f781e3d90ea9b3914de69e Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-06-26Introduce EXPECTED_FAILINGPeter Mikus1-7/+1
Change-Id: I6c578e9126778c584ccb57a4a2c76d96dea8fb35 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-06-16Add support for more complex structures in PAPI calls/repliesJan Gelety1-14/+26
Change-Id: I3f83d1209a08dcf342cc2031191bb82cebc53e4a Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-06-25Align suite/test teardown/setupPeter Mikus414-3962/+3185
+ Phase II - aligning FUNC/PERF setup. + 2n/3n compatibility of suite setup. + Same structure of testcase for DEV/PERF. + DEVICE tests are now running VPP startup config in same way as PERF. + DEVICE is using COREKEEPER! - DEVICE tests are running topology compute twice for backward compatibility. TODO to remove. - Still phase III needed to align TAGS, LIBRARIES and remove OLD setup phase. Change-Id: Ib6e1b0ebf4abebf3cbe73b4fda5cac953c2a7270 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-06-24Store "tag" and "url" in files in reservation dirVratko Polak2-22/+96
String "Unknown" is used if test run tag or url is not supplied, so this change should be backward compatible. + Used "runtag", as both "test" and "tag" start with taken "-t". + Fixed some pylint violations. + Docstring explaining the steps taken and reasoning behind two files. + Other minor improvements. Change-Id: If704d02e51374087fe39ad0f69432477d1b310d3 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-06-21Allow 9000b tests for AVFVratko Polak8-4/+84
See https://gerrit.fd.io/r/20148 Change-Id: I22856b14e3608348f2ccecb1d99d87209db2d776 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-06-21Align suite/test teardown/setupPeter Mikus407-1438/+1008
+ Phase I - aligning FUNC/PERF Change-Id: I46b1e43687ddb29f5ed3c6335fe1baf21ec02822 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-06-21FIX: IPsec TNL test should load pluginsPeter Mikus8-16/+24
Change-Id: I76f643bebec9fd4988478ce0766621fbb6f71fff Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-06-21SetupFramework: log thread error to consoleVratko Polak3-103/+205
Because logger.error from a non-main thread is lost. + Increase verbosity of virtualenv exception. + Introduce LocalExecution.py library. + Include multiple other style improvements. + Add some ssh.py improvements: + Accept also commands of OptionString type. + Introduce a limited form of raise_from for exception chaining. + Add include_reason argument to exec_cmd_no_error. Change-Id: I0cd92bcdaa1a5c4cc20cb99067593fc3b40d2c31 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-06-20perf ipsec: test renamingMaciek Konstantynowicz54-918/+918
Change-Id: Ieacefc7d19438d622ef8e23e9504d80e2a34215f Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2019-06-20Add 2n-dnv and 3n-dnv configuration to bootstrap-verify-perf.shYulong Pei3-0/+159
Change-Id: I90427de5b611e432e5e46ab8758a31e376215914 Signed-off-by: Yulong Pei <yulong.pei@intel.com>
2019-06-19Add continue/fail option for enable tracesTibor Frank2-7/+24
Change-Id: I675f9664391c9f18f312773812f765f345983cc1 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-06-19Trending: Reduce the number of input filesTibor Frank2-180/+35
Change-Id: I37fdd6c01a8e25ecc0353118db3c8e18d848c890 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-06-19VAT-to-PAPI: VPPCountersTibor Frank5-82/+184
Change-Id: I5954fdd61ead9b4143f8cc4e20294cf8e199e0af Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-06-19VAT-to-PAPI: NATUtilTibor Frank11-286/+108
Change-Id: Id64bbf899e78c7c55410a8ce608393c22fa596ab Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-06-18CSIT-1459: Migrate IP libraries from VAT to PAPIJan Gelety125-3192/+1896
Change-Id: Id84cf9c3afd53260b5bbf658a6a3870aa0c91333 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-06-19VAT-to-PAPI: VPPUtilsTibor Frank3-30/+50
Change-Id: If4eb592e2718c4564f1f7929ca6ff91c02f074a6 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-06-19Add 2-node and 3-node denverton to specificationsYulong Pei1-7/+82
Change-Id: I79fc4a4d28e1ec1aaa6590c6df340fa7d33c8654 Signed-off-by: Yulong Pei <yulong.pei@intel.com>
2019-06-19Add scale ipsec tunnel testsPeter Mikus39-221/+1396
- 5K - 10K Change-Id: Iaa2c77d07c3686e09fe327c663d7d7fc42024034 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-06-19Add denverton servers to ansible lf_inventory hostsYulong Pei5-0/+76
Change-Id: Iac3ed425caa8f7c28546f04a6c4adc1f834bffd6 Signed-off-by: Yulong Pei <yulong.pei@intel.com>
2019-06-18Fix exit from reservation loopVratko Polak1-1/+5
Break from the while loop is on both success and no testbeds. Change-Id: Iea368034927965c7f99f5502240bd768e3f62eec Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-06-18Continue reservation when cleanup failsVratko Polak3-8/+34
+ Only on not-failed-yet testbeds. + If any, else give up. Change-Id: I3209507d3d57a77ef6afad3184ca25e098910311 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-06-18Update of VPP_STABLE_VER filesJan Gelety3-3/+3
- use new vpp ref build - ubuntu 16.04: 19.08-rc0~446-g3860a77~b7297 - use new vpp ref build - ubuntu 18.04: 19.08-rc0~446-g3860a77e9 - use new vpp ref build - centos7: 19.08-rc0~446_g3860a77~b7181 Change-Id: I7a99f98c6805fb5ddc17d2f858a4af91ea700d25 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-06-18PAPI: Reduce the amount of logged informationTibor Frank2-9/+24
Change-Id: I5cfd19a9ecca6891232d92d232a159422c0a835e Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-06-17Add more tests to daily jobsVratko Polak5-1352/+6
+ Add baseline tests for all NICs, only min size. + Add scale tests for x710 NIC, only min size and without 4c. New test counts: csit-vpp-perf-mrr-daily-master-2n-skx: 96 csit-vpp-perf-mrr-daily-master-3n-skx: 211 csit-vpp-perf-mrr-daily-master: 223 Change-Id: I14c0699dd8277b6e59cdfa3e41585f50ec75dd29 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-06-17CSIT-1488: Add data to the Report 1904Tibor Frank1-2/+2
Change-Id: Ieb6537c1e1c1b7e0ca4f7ec490a9f0bd379030e9 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-06-17Report 1904: Configure rls 1904.25Tibor Frank3-2/+7
Change-Id: I44bfc2247d4d2def131d89e1d97d8cad7522ccd1 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-06-15FIX: IPsec TNL mode funcPeter Mikus1-0/+4
Change-Id: I4fdcf48d8c60d728b0fe1b44baf0d2042185dd42 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-06-14Add hsw drivers to topology and check against AVFVratko Polak4-1/+65
Change-Id: Ifcc1dcdb3a0b4a7c62e4a41e5b3d016b276e93be Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-06-14Add comments for some tag exclusionsVratko Polak1-0/+7
Change-Id: I9daa70e433a2942d29c4e64856cb76d31f94a6f3 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-06-14FIX: IPsec TNL modePeter Mikus1-32/+6
Change-Id: Ide82ae5fa03d3fec8f4db9db7634be0a1e339cd1 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-06-14FIX: IPsec INT modePeter Mikus1-7/+4
Change-Id: I286490280b6e62f9f212831a5bf1d14db1838fa7 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-06-14PAPI: Fix PyLint errorsTibor Frank2-4/+4
Change-Id: Ieaafbb111f4c3aea9b577c2ab31ca5162400ac46 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-06-14FIX: IPsec Functional teardownPeter Mikus4-6/+6
Change-Id: If63d6815b4e0e9ed426e3bae8008635d9690c4a6 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-06-04virl: re-distribute test suites to virl simulationsJan Gelety1-1/+1
Change-Id: I7758d888f1a5edc42cba3c6131b8c882e709dc91 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-06-12CSIT-1488: Add data to the Report 1904Tibor Frank1-0/+2
Change-Id: If0e75e4bb4623eea913d433affa42a6bb03454b8 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-06-10vpp_device: TAPPeter Mikus9-729/+19
Change-Id: Ife31921daaa5a87f64e61d2eebb98bfdded1dc76 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-06-10vpp_device: IPsecPeter Mikus34-6539/+488
- Remove VM ipsec tests as they are not interesting - Remove duplicate (vpp_device/virl) VM tests - Remove VM tunnel tests and use base tunnel (we do not need tunnel and VM) Change-Id: I5d7b6d8a037878f81a6bdc0114af481b32141dde Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-06-10CSIT-1488: Add data to the Report 1904Tibor Frank1-0/+4
Change-Id: Ia75675d6e89902c3370feaa2e8eb468cdd0fdba1 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-06-10Report: Configure report 1904.24Tibor Frank3-2/+7
Change-Id: I4d6d913f0139fe0fab00668ec16081c04cc6bc0e Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-06-10Python3: TRex driverPeter Mikus4-55/+18
Change-Id: I25f7598b52c87ec1a2d4c6f22680d5200b583e2c Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-06-09FIX: Disable AVF on 3n-hswPeter Mikus1-3/+2
Change-Id: Id7c81a92dd50db365c219529a687fa37fd05ceb3 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-06-09CSIT-1521 Convert NestedVM testcase into KernelVMPeter Mikus28-1544/+344
Change-Id: Ic493253dc29dad4fc7e6541e4b839ca5898a6a40 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-06-06Simplify mrr daily tag expressionVratko Polak6-613/+1362
The number of tests executed is intentionally smaller, as recently the runtime has gone up too much. New numbers: csit-vpp-perf-mrr-daily-master: 120 csit-vpp-perf-mrr-daily-master-2n-skx: 72 csit-vpp-perf-mrr-daily-master-3n-skx: 126 More details included as diff files. + Less per-testbed exceptions. - Single/double links tags still set at two places. Change-Id: I1149d3e52edf38c7d9d3e0160c533e35ae944d0d Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-06-05CSIT-1488: Add data to the Report 1904Tibor Frank1-0/+2
Change-Id: I54b2f02745497ea4cd90d485834b1aa42389f57d Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-06-05FIX: OS detectionPeter Mikus4-16/+21
Change-Id: I3ba6c7dc6a72e376419990ce7f5acc8d373f246f Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-06-05CSIT changes to support new Centos 7 device testing container image.Thomas F Herbert5-6/+40
CSIT-1505 Parse {os} parameter from job and use it to separate the correct image for each distro and the correct stable package versions. Use two vpp device image names, one for Ubuntu and one for Centos. Centos sut image is in https://hub.docker.com/r/snergster/csit-sut-centos Source for Centos sut image: https://github.com/snergfdio/multivppcache/tree/master/csit-sut-centos Change-Id: I568c82710d730c4ed0ca25bc12cb6074e1cbe27e Signed-off-by: Thomas F Herbert <therbert@redhat.com>