aboutsummaryrefslogtreecommitdiffstats
path: root/resources/libraries
AgeCommit message (Collapse)AuthorFilesLines
2019-06-14Add comments for some tag exclusionsVratko Polak1-0/+7
Change-Id: I9daa70e433a2942d29c4e64856cb76d31f94a6f3 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-06-14FIX: IPsec TNL modePeter Mikus1-32/+6
Change-Id: Ide82ae5fa03d3fec8f4db9db7634be0a1e339cd1 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-06-14FIX: IPsec INT modePeter Mikus1-7/+4
Change-Id: I286490280b6e62f9f212831a5bf1d14db1838fa7 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-06-14PAPI: Fix PyLint errorsTibor Frank2-4/+4
Change-Id: Ieaafbb111f4c3aea9b577c2ab31ca5162400ac46 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-06-10vpp_device: TAPPeter Mikus1-29/+0
Change-Id: Ife31921daaa5a87f64e61d2eebb98bfdded1dc76 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-06-10vpp_device: IPsecPeter Mikus1-50/+2
- Remove VM ipsec tests as they are not interesting - Remove duplicate (vpp_device/virl) VM tests - Remove VM tunnel tests and use base tunnel (we do not need tunnel and VM) Change-Id: I5d7b6d8a037878f81a6bdc0114af481b32141dde Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-06-09FIX: Disable AVF on 3n-hswPeter Mikus1-3/+2
Change-Id: Id7c81a92dd50db365c219529a687fa37fd05ceb3 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-06-09CSIT-1521 Convert NestedVM testcase into KernelVMPeter Mikus3-423/+95
Change-Id: Ic493253dc29dad4fc7e6541e4b839ca5898a6a40 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-06-06Simplify mrr daily tag expressionVratko Polak6-613/+1362
The number of tests executed is intentionally smaller, as recently the runtime has gone up too much. New numbers: csit-vpp-perf-mrr-daily-master: 120 csit-vpp-perf-mrr-daily-master-2n-skx: 72 csit-vpp-perf-mrr-daily-master-3n-skx: 126 More details included as diff files. + Less per-testbed exceptions. - Single/double links tags still set at two places. Change-Id: I1149d3e52edf38c7d9d3e0160c533e35ae944d0d Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-06-05FIX: OS detectionPeter Mikus4-16/+21
Change-Id: I3ba6c7dc6a72e376419990ce7f5acc8d373f246f Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-06-05CSIT changes to support new Centos 7 device testing container image.Thomas F Herbert3-6/+39
CSIT-1505 Parse {os} parameter from job and use it to separate the correct image for each distro and the correct stable package versions. Use two vpp device image names, one for Ubuntu and one for Centos. Centos sut image is in https://hub.docker.com/r/snergster/csit-sut-centos Source for Centos sut image: https://github.com/snergfdio/multivppcache/tree/master/csit-sut-centos Change-Id: I568c82710d730c4ed0ca25bc12cb6074e1cbe27e Signed-off-by: Thomas F Herbert <therbert@redhat.com>
2019-06-05Remove intrusive useless loggingPeter Mikus4-45/+2
Change-Id: Ib633266daaf67f257867f5ba0b2836f777ecd3bf Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-06-05Even more Crypto combinationsPeter Mikus2-179/+250
Change-Id: I10eeb4ee30a57712824e68176d92d1ecb5f0d1b0 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-06-04VAT-to-PAPI: memifTibor Frank2-179/+140
Change-Id: I9e3f1a2a2a1c11a355cd66c940beb663ecc7d7a4 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-06-04fix Honeycomb failing testsMichal Cmarada7-27/+32
- due to VAT to PAPI migration some tests need to be updated - fixed HC tests: ACL, Interfaces/SubInterfaces, Tap Vhost, Vxlan, Vxlan-gpe Change-Id: I9adad041a619b48057bdda388becd53dde484483 Signed-off-by: Michal Cmarada <mcmarada@cisco.com>
2019-06-04VAT-to-PAPI: ContainerUtilsTibor Frank2-18/+22
Change-Id: Id186c3c280a6b876b8212e01b261ad8c65e5f40c Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-06-04VAT-to-PAPI: VhostUserTibor Frank1-33/+62
Change-Id: I235d4654b04275877b3c5f4cf49ef5755c3f4985 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-06-04Add possibility to use other then default NIC per VPP patchJan Gelety1-1/+5
Change-Id: I25e51022e0ec961fce444bc8f0f4413d0e95d7eb Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-05-31Add meltdown spectre to calibration setPeter Mikus2-2/+2
+ Fix the version of MMD tool to always latest Change-Id: Iafd7f40d618b8e4995b5cc12fe06056719f58517 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-05-31CSIT-1468: InterfaceUtil migration from VAT to PAPIJan Gelety10-530/+1009
Change-Id: I0062710d58996be767a852dc00545fedd60a5c72 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-05-29Fix args order in setup_node calljuraj.linkes1-2/+2
Change-Id: I484cda8c8410e2f38d68da82761b1154dda26b1c Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>
2019-05-28Use threads for fw setup and cleanupjuraj.linkes1-54/+62
Using multiprocessing sometimes causes scp to hang when copying files. Threading is also more lightweight. Change-Id: I047b4835bbf1584c80469b27af5394d89087e8a9 Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>
2019-05-27HC2VPP-411: migrate interfaces-state to interfacesMichal Cmarada3-5/+5
- new ietf-interfaces makes interfaces-state obsolete - updates honeycomb tests to latest ietf-interfaces model Change-Id: I5502a5ab23661429caca9498407d7121d423a1a3 Signed-off-by: Michal Cmarada <mcmarada@cisco.com>
2019-05-27FIX: do not generate 9000B perf test in case of vic1385 nicJan Gelety1-0/+3
Change-Id: I7b8e30903a8bc012a3bb43bfb33755e08b56dc1d Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-05-24CSIT-1425 Upgrade TRex to v2.54Tibor Frank2-57/+74
Change-Id: I71010c18210e88828ded0bc679997d76f34886cb Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-05-23CSIT-1506: Rework IPsec base testcasesPeter Mikus1-11/+23
- Add: aes-128-gcm aes-128-gcm aes-256-gcm aes-256-gcm aes-128-cbc hmac-sha-256 aes-256-cbc hmac-sha-512 - Remove: hmac-sha1 - Scale will follow in next patch Change-Id: I789f71cf66cf61b8dbb3c6dbe9b6fdc79866ac33 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-05-22Exclude IPSECHW tests on NICs other than xl710Vratko Polak1-0/+1
The next version of suite generator will avoid generating them, for now we just exclude by a tag expression. Change-Id: I68c80c412ea327c11366f539b10de19df50152c2 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-05-16Avoid !r format appending u on unicodeVratko Polak1-0/+8
Change-Id: I2c0877f4d8b6cad2694c43a4350998cd2b830680 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-05-16FIX: IPsec selection backend.Peter Mikus1-1/+1
Change-Id: Ie4acaecf60e03fc4e843e29d8222fbf2f00bbf44 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-05-16Make topology files read dynamically from directoryPeter Mikus1-24/+6
Change-Id: Id43c7c299d2e112b6caf00a3d340e6051ab337b6 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-05-15Avoid double link tests for nic_intel-xxv710Vratko Polak1-0/+2
Change-Id: Id9beeed270b91a35108adef594f50105198225d6 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-05-15Update of VPP_STABLE_VER files + quick fix for gre create tunnelJan Gelety2-19/+36
- use new vpp ref build - ubuntu 16.04: 19.08-rc0~212-gf6c7aec~b7060 - use new vpp ref build - ubuntu 18.04: 19.08-rc0~212-gf6c7aec95 - use new vpp ref build - centos7: 19.08-rc0~212_gf6c7aec~b6916 Change-Id: Ifd042fae1a46b07a5f463309f2b9cceb8054412f Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-05-15FIX: Honeycomb restart sequencePeter Mikus1-1/+3
Change-Id: I31acda10c4bd8de6f0094e697ef1219e77c5fbb1 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-05-15FIX: Remove old restart sequence - HoneycombPeter Mikus3-13/+22
Change-Id: I12865ea4f48c1902e80e67463fff4cf481a2e24c Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-05-10PLRsearch: Use stat trackers to shorten IntegratorVratko Polak5-408/+706
+ Extract several tracker classes and use them in Integrator. + Apply next_rate workarounds to focus more on critical region. + Rewrite stretch function, as the previous implementation was wrong. + Rework logging: ++ Use injected trace() function in Integrator. ++ Inject function that skips trace logging on default initialization. ++ Use the same multiprocessing-safe passing, but separate queue. + Set duration to 120m in Robot, but keep at 30m in Python. + Apply minor changes to make computations more reproducible: ++ Attempt to log everything needed by reproducibility in one line. ++ Log samples used, and make it settable as upper limit. ++ Use repr output in TRex scripts, to avoid rounding when copypasting. +- Numpy seems to be sharing PRNG between processes. +-- An edit to disable one thread is needed for full reproducibility. +-- Such an edit is prepared, but will not be merged anytime soon. Change-Id: Icf56429b34ab6de2d18a12e6c676e2d242b3ba4c Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-05-10FIX: Missing show run data in NDRPDRPeter Mikus1-0/+27
Change-Id: If4b013ef4bf4bc8f857913f3847ab3b2e2aa5a5d Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-05-09Remove old VPP Restart sequencePeter Mikus4-98/+13
Change-Id: I7f71a9709ad55ce03d73e23cc8a9f5064947ed51 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-05-09Add new higher density NF testsPeter Mikus1-0/+5
Change-Id: Ib2f3f3f8dc3e202dc1db53c739d9309be2ed8a60 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-05-07Fix typos in DUTsetup.pyVratko Polak1-2/+2
Change-Id: I7fb255c26bfb62a273844b3753aa37b742835045 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-05-06CSIT-1493 VPP restart handling codePeter Mikus9-179/+173
Change-Id: Ibe52125089f39e0ff17ec607a3ed00c61d52ab8c Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-04-26NF density tests with dtc=0.5 and dtcr=2Peter Mikus8-180/+171
Change-Id: Icff556142280ad0b6261e0a2bfb71672ee6b3807 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-04-26FIX: Change buffers per numa base on SMTPeter Mikus1-1/+3
Change-Id: I4955210e2c723d4b91d8829ac42e47937d17833f Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-04-24FIX: Crypto testsPeter Mikus1-0/+9
- By adding crypto_ipsecmb.so into the list of loaded plugins Change-Id: I52de9b410441422ad8e337208f40360fbdea264d Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-04-24FIX: Large number of interfaces and worker threadsPeter Mikus3-18/+14
Add buffers-per-numa (previously num-mbuf) Change-Id: Iad0863668a65b1595630d49a047d591659c7bba5 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-04-24Move generate_tests earlier in entry scriptsVratko Polak4-8/+8
The idea is to run test generation and archivation before testbed reservation, as during generation and archivation the testbed can be used by another job. The two steps are moved just before (physical or docker) reservation, as they currently take considerable time, so simpler steps are kept before to save time if they fail. Coincidentally, it is also just after activate_virtualenv, Python is needed for test generation. Change-Id: I8b41b91dba8118e89301e3fcf89d5cd14ac054a2 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-04-23FIX: Create TAP interface after API changeJan Gelety1-1/+1
Change-Id: Ib39671dcb808142037c2950b8b02b9aa64d72a3b Signed-off-by: Jan Gelety <jgelety@cisco.com> (cherry picked from commit 48b40a6789050e8f40405663cc0e437df26fc56a)
2019-04-18FIX: eth_peer parameter after introducing OptionParamsPeter Mikus1-2/+2
Change-Id: Ief72af680a6252faf749b06b5289b8033af99b2d Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-04-18OptionString: Do not convert None to non-empty stringVratko Polak1-2/+3
Change-Id: I2947394a478bde3fe048aef99fd7b5a394764ae2 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-04-17Increase reliability of per patch perf jobVratko Polak1-4/+8
CSIT-1485 - Measurement results are inconsistent, creating false positives. - To avoid false positives, sensitivity has to be lowered. + Measurements are no more interleaved. + Measurement result are no longer filtered. + The job now runs faster. - Ip6base regressions smaller than 4% are tolerated. + Ip6base false positives can happen, but less than 10% of the time. - Part of job parameters is set on ci-management level. + Voter script output is improved. Change-Id: I0ec7d5df8b397daf7ff0277a1137ee9f36d8d866 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-04-17Clean up traffic_profile vs osi_layerVratko Polak6-96/+97
The two types were not well distinguished before. Error introduced in: https://gerrit.fd.io/r/#/c/17811/84/resources/libraries/robot/performance/performance_setup.robot@255 Error hotfixed in: https://gerrit.fd.io/r/#/c/18847/4/resources/libraries/robot/shared/default.robot@109 + Rename some arguments and improve method docstrings. Newly introduced argument name osi_layer should be dissimilar enough. Change-Id: Ie0f6f97dc010fc6477f09c54574970f1d15462e2 Signed-off-by: Vratko Polak <vrpolak@cisco.com>