aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2019-06-28PAPI-to-VAT: MACSwapTibor Frank6-408/+0
- not used, not needed, deleted Change-Id: I9b4c78b7ba3fbac3805d06a65f2799ed212770b3 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-06-28VAT-to-PAPI: ClassifyTibor Frank29-1229/+708
Change-Id: Ic06a0a65429680e6ecdc3f5288d091c2c2630921 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-06-27VAT-to-PAPI: IPFIX and SPANTibor Frank20-1608/+23
Change-Id: I34bdc17d6350e5a441dabd9154620627780f4c12 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-06-27VAT-to-PAPI: TraceTibor Frank1-9/+8
Change-Id: Id0b6943eec7e8a15cb2db5c89f93a38f21d686c7 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-06-26VAT-to-PAPI: Remove unused VAT files.Tibor Frank15-17/+0
Change-Id: I1563db488e9dd690aa7e732691e306a9e51ececa Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-06-16FIX: IPUtil after vpp api changesJan Gelety12-148/+220
+ do not log all ip_route_add_del api calls to PAPI history in case of scale tests + fix for SRv6 proxy tests + support of more complex structures in api calls/replies in PapiExecutor + update of vpp stable build to version 19.08-rc0~487-gb98dbb1 Change-Id: I9972e126b68ce1cb57f781e3d90ea9b3914de69e Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-06-26Introduce EXPECTED_FAILINGPeter Mikus1-7/+1
Change-Id: I6c578e9126778c584ccb57a4a2c76d96dea8fb35 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-06-16Add support for more complex structures in PAPI calls/repliesJan Gelety1-14/+26
Change-Id: I3f83d1209a08dcf342cc2031191bb82cebc53e4a Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-06-25Align suite/test teardown/setupPeter Mikus414-3962/+3185
+ Phase II - aligning FUNC/PERF setup. + 2n/3n compatibility of suite setup. + Same structure of testcase for DEV/PERF. + DEVICE tests are now running VPP startup config in same way as PERF. + DEVICE is using COREKEEPER! - DEVICE tests are running topology compute twice for backward compatibility. TODO to remove. - Still phase III needed to align TAGS, LIBRARIES and remove OLD setup phase. Change-Id: Ib6e1b0ebf4abebf3cbe73b4fda5cac953c2a7270 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-06-24Store "tag" and "url" in files in reservation dirVratko Polak2-22/+96
String "Unknown" is used if test run tag or url is not supplied, so this change should be backward compatible. + Used "runtag", as both "test" and "tag" start with taken "-t". + Fixed some pylint violations. + Docstring explaining the steps taken and reasoning behind two files. + Other minor improvements. Change-Id: If704d02e51374087fe39ad0f69432477d1b310d3 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-06-21Allow 9000b tests for AVFVratko Polak8-4/+84
See https://gerrit.fd.io/r/20148 Change-Id: I22856b14e3608348f2ccecb1d99d87209db2d776 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-06-21Align suite/test teardown/setupPeter Mikus407-1438/+1008
+ Phase I - aligning FUNC/PERF Change-Id: I46b1e43687ddb29f5ed3c6335fe1baf21ec02822 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-06-21FIX: IPsec TNL test should load pluginsPeter Mikus8-16/+24
Change-Id: I76f643bebec9fd4988478ce0766621fbb6f71fff Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-06-21SetupFramework: log thread error to consoleVratko Polak3-103/+205
Because logger.error from a non-main thread is lost. + Increase verbosity of virtualenv exception. + Introduce LocalExecution.py library. + Include multiple other style improvements. + Add some ssh.py improvements: + Accept also commands of OptionString type. + Introduce a limited form of raise_from for exception chaining. + Add include_reason argument to exec_cmd_no_error. Change-Id: I0cd92bcdaa1a5c4cc20cb99067593fc3b40d2c31 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-06-20perf ipsec: test renamingMaciek Konstantynowicz54-918/+918
Change-Id: Ieacefc7d19438d622ef8e23e9504d80e2a34215f Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2019-06-20Add 2n-dnv and 3n-dnv configuration to bootstrap-verify-perf.shYulong Pei3-0/+159
Change-Id: I90427de5b611e432e5e46ab8758a31e376215914 Signed-off-by: Yulong Pei <yulong.pei@intel.com>
2019-06-19Add continue/fail option for enable tracesTibor Frank2-7/+24
Change-Id: I675f9664391c9f18f312773812f765f345983cc1 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-06-19Trending: Reduce the number of input filesTibor Frank2-180/+35
Change-Id: I37fdd6c01a8e25ecc0353118db3c8e18d848c890 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-06-19VAT-to-PAPI: VPPCountersTibor Frank5-82/+184
Change-Id: I5954fdd61ead9b4143f8cc4e20294cf8e199e0af Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-06-19VAT-to-PAPI: NATUtilTibor Frank11-286/+108
Change-Id: Id64bbf899e78c7c55410a8ce608393c22fa596ab Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-06-18CSIT-1459: Migrate IP libraries from VAT to PAPIJan Gelety125-3192/+1896
Change-Id: Id84cf9c3afd53260b5bbf658a6a3870aa0c91333 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-06-19VAT-to-PAPI: VPPUtilsTibor Frank3-30/+50
Change-Id: If4eb592e2718c4564f1f7929ca6ff91c02f074a6 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-06-19Add 2-node and 3-node denverton to specificationsYulong Pei1-7/+82
Change-Id: I79fc4a4d28e1ec1aaa6590c6df340fa7d33c8654 Signed-off-by: Yulong Pei <yulong.pei@intel.com>
2019-06-19Add scale ipsec tunnel testsPeter Mikus39-221/+1396
- 5K - 10K Change-Id: Iaa2c77d07c3686e09fe327c663d7d7fc42024034 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-06-19Add denverton servers to ansible lf_inventory hostsYulong Pei5-0/+76
Change-Id: Iac3ed425caa8f7c28546f04a6c4adc1f834bffd6 Signed-off-by: Yulong Pei <yulong.pei@intel.com>
2019-06-18Fix exit from reservation loopVratko Polak1-1/+5
Break from the while loop is on both success and no testbeds. Change-Id: Iea368034927965c7f99f5502240bd768e3f62eec Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-06-18Continue reservation when cleanup failsVratko Polak3-8/+34
+ Only on not-failed-yet testbeds. + If any, else give up. Change-Id: I3209507d3d57a77ef6afad3184ca25e098910311 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-06-18Update of VPP_STABLE_VER filesJan Gelety3-3/+3
- use new vpp ref build - ubuntu 16.04: 19.08-rc0~446-g3860a77~b7297 - use new vpp ref build - ubuntu 18.04: 19.08-rc0~446-g3860a77e9 - use new vpp ref build - centos7: 19.08-rc0~446_g3860a77~b7181 Change-Id: I7a99f98c6805fb5ddc17d2f858a4af91ea700d25 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-06-18PAPI: Reduce the amount of logged informationTibor Frank2-9/+24
Change-Id: I5cfd19a9ecca6891232d92d232a159422c0a835e Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-06-17Add more tests to daily jobsVratko Polak5-1352/+6
+ Add baseline tests for all NICs, only min size. + Add scale tests for x710 NIC, only min size and without 4c. New test counts: csit-vpp-perf-mrr-daily-master-2n-skx: 96 csit-vpp-perf-mrr-daily-master-3n-skx: 211 csit-vpp-perf-mrr-daily-master: 223 Change-Id: I14c0699dd8277b6e59cdfa3e41585f50ec75dd29 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-06-17CSIT-1488: Add data to the Report 1904Tibor Frank1-2/+2
Change-Id: Ieb6537c1e1c1b7e0ca4f7ec490a9f0bd379030e9 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-06-17Report 1904: Configure rls 1904.25Tibor Frank3-2/+7
Change-Id: I44bfc2247d4d2def131d89e1d97d8cad7522ccd1 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-06-15FIX: IPsec TNL mode funcPeter Mikus1-0/+4
Change-Id: I4fdcf48d8c60d728b0fe1b44baf0d2042185dd42 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-06-14Add hsw drivers to topology and check against AVFVratko Polak4-1/+65
Change-Id: Ifcc1dcdb3a0b4a7c62e4a41e5b3d016b276e93be Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-06-14Add comments for some tag exclusionsVratko Polak1-0/+7
Change-Id: I9daa70e433a2942d29c4e64856cb76d31f94a6f3 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-06-14FIX: IPsec TNL modePeter Mikus1-32/+6
Change-Id: Ide82ae5fa03d3fec8f4db9db7634be0a1e339cd1 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-06-14FIX: IPsec INT modePeter Mikus1-7/+4
Change-Id: I286490280b6e62f9f212831a5bf1d14db1838fa7 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-06-14PAPI: Fix PyLint errorsTibor Frank2-4/+4
Change-Id: Ieaafbb111f4c3aea9b577c2ab31ca5162400ac46 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-06-14FIX: IPsec Functional teardownPeter Mikus4-6/+6
Change-Id: If63d6815b4e0e9ed426e3bae8008635d9690c4a6 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-06-04virl: re-distribute test suites to virl simulationsJan Gelety1-1/+1
Change-Id: I7758d888f1a5edc42cba3c6131b8c882e709dc91 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-06-12CSIT-1488: Add data to the Report 1904Tibor Frank1-0/+2
Change-Id: If0e75e4bb4623eea913d433affa42a6bb03454b8 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-06-10vpp_device: TAPPeter Mikus9-729/+19
Change-Id: Ife31921daaa5a87f64e61d2eebb98bfdded1dc76 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-06-10vpp_device: IPsecPeter Mikus34-6539/+488
- Remove VM ipsec tests as they are not interesting - Remove duplicate (vpp_device/virl) VM tests - Remove VM tunnel tests and use base tunnel (we do not need tunnel and VM) Change-Id: I5d7b6d8a037878f81a6bdc0114af481b32141dde Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-06-10CSIT-1488: Add data to the Report 1904Tibor Frank1-0/+4
Change-Id: Ia75675d6e89902c3370feaa2e8eb468cdd0fdba1 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-06-10Report: Configure report 1904.24Tibor Frank3-2/+7
Change-Id: I4d6d913f0139fe0fab00668ec16081c04cc6bc0e Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-06-10Python3: TRex driverPeter Mikus4-55/+18
Change-Id: I25f7598b52c87ec1a2d4c6f22680d5200b583e2c Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-06-09FIX: Disable AVF on 3n-hswPeter Mikus1-3/+2
Change-Id: Id7c81a92dd50db365c219529a687fa37fd05ceb3 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-06-09CSIT-1521 Convert NestedVM testcase into KernelVMPeter Mikus28-1544/+344
Change-Id: Ic493253dc29dad4fc7e6541e4b839ca5898a6a40 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-06-06Simplify mrr daily tag expressionVratko Polak6-613/+1362
The number of tests executed is intentionally smaller, as recently the runtime has gone up too much. New numbers: csit-vpp-perf-mrr-daily-master: 120 csit-vpp-perf-mrr-daily-master-2n-skx: 72 csit-vpp-perf-mrr-daily-master-3n-skx: 126 More details included as diff files. + Less per-testbed exceptions. - Single/double links tags still set at two places. Change-Id: I1149d3e52edf38c7d9d3e0160c533e35ae944d0d Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-06-05CSIT-1488: Add data to the Report 1904Tibor Frank1-0/+2
Change-Id: I54b2f02745497ea4cd90d485834b1aa42389f57d Signed-off-by: Tibor Frank <tifrank@cisco.com>