aboutsummaryrefslogtreecommitdiffstats
path: root/tests
AgeCommit message (Collapse)AuthorFilesLines
2019-08-23Introduce reconfig suites, for dot1q+ip4+vxlanVratko Polak24-24/+1944
Ticket: CSIT-1551 + Config copied from other suites. + Layer keywords prepared for additional chains. + Renamed "create" argument to "vlan_per_chain". + TrafficGenerator result extraction improvements. + Also unified TG type and subtype checking. + Throughput estimated as PDR for zero PLR. + Actual Qemu start is skipped. + Parse xstats instead of stats in trex stop scipt. - Because stats are unconditionally cleared on each script connect. + Remember start values to get better ReceiveMeasurementResult at stop. + Expose loss count and time as appropriate test message. + Autogen support. + Multiple chain amounts and core densities. - Only 1 additional chain. + Proper TAGs. Documented. + Clarified min framesize tags are for TG-DUT. + Added a TODO concerning overhead values. + Added 118B tag. + Robot performance keywords improvements. + Added missing return value documentation. + Frame size as required test variable, not an explicit argument. + MLRsearch keyword to store result (not into test message). - TODO: De-duplicate: main keyword to measure, minor to set test message. - But implementation uses the fact default arguments are different. + Keywords for starting and stopping background traffic. - No checks whether start-stop pair is complete. + Multiple minor indentation and logging improvements. - Missing / TODOs: - Support also vlan_per_chain=True? - Support dot1q without vxlan? - Support also deletion? - How to package config steps so -reconf can be generated from -ndrpdr? Change-Id: If0270697f9ffa837c34ef802917220a53f156703 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-08-23Update CRC list commentsVratko Polak16-16/+16
+ Add testcases and tag expressions for perf occurrences. + Add TNL_1 tag for single tunnel IPsec suites. - Some CRCs were missing before, but form a pair with a listed CRC. - Probably the other half of the pair is not used. - Will be fixed in subsequent Change. Change-Id: I5754210755c13c41226b71045813714a65a1cdf3 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-08-21Add: 2-node ip4 oacl testsJan Gelety78-12/+372
Change-Id: I786fe9f75777e1cd0daee70bc350185dd7fd17e1 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-08-21Add: avf-dot1q testcasesPeter Mikus10-67/+469
+ Few fixes in doc + Align testcases Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I5575db8255a74fd46f37d5cc2637b9b4448bcd7f
2019-08-20Align NF_denisty testsPeter Mikus87-171/+510
+ Apply layer approach for interfaces Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I6c1898b9833f9f42b8912f1b521e30093360d7ea
2019-08-20Add: NF_density combinationsPeter Mikus12-6/+894
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I9ba859cf8ecb2d65c90ec7c6f75dc3e353e74de9
2019-08-19Autogen: Create NICs for TCP suites.Vratko Polak3-18/+18
+ Put Regenerator internal functions ourside class. + Duplicate into _default_ and _tcp_ functions. + Rework Testcase to be a single class with two factories. + Improve suite and testcase naming. Change-Id: I1f835b576c476c1a40c8c52469b1876695f9ae73 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-08-14FIX: Remove eth_avf and portX_vifY interfaces from topo in TC/TS tear downJan Gelety16-15/+16
Change-Id: I90901c4ab14dfa76dc3e1f786a4b986479e0ba47 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-08-14VAT-to-PAPI: Fix HTTP/TCP testsDave Wallace2-60/+116
Change-Id: Ie728bc73eb7429d246e82dd195fc63191c3ac51d Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
2019-08-12Clean: Various librariesPeter Mikus52-1249/+131
- Remove translate TC as they have no perf opposite - Remove unused keywords - Merge similar keywords / rename - Move keywords from perf library to categories Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I6433006136e2497ad8fb17193aa20c578d836999
2019-08-09Clean: L2 bridge domainPeter Mikus12-13/+24
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I3721900b91a9c8e9db8766bdcb9771b6bcf95bca
2019-08-08FIX: Various typos in nf_density + missing KWPeter Mikus4-5/+5
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I73878542672ab2dcfa1db046fbca4b7d931e744c
2019-08-07Clean: IPv6 keywordsPeter Mikus1-1/+1
+ Move all base ipv6 related KW to library + Remove useless KW to save space in output.xml + Remove cross dependency in ip6.robot Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I8c5f72e9852c1017356ab6034c4d271cf7b53265
2019-08-07Clean: IPv4 keywordsPeter Mikus4-4/+16
+ Move all base ipv4 related KW to library + Remove useless KW to save space in output.xml + Remove cross dependency in ip4.robot Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: If1e3a6370d36caf4ce7411fb956a0b7d0f939b6b
2019-08-07Add: AVF ip4scalePeter Mikus12-9/+916
+ Few corrections + Aligning 3n/2n Change-Id: If0918c0df38c5532899bec9ae7a7019117fff477 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-08-06Add: Dot1Q + L2BD + GBPPeter Mikus2-2/+142
Change-Id: I0050f715011ecfa92b3ee88b301809a56abb7946 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-08-06VPPD: Dot1QPeter Mikus7-1297/+74
Change-Id: I0d3c925ea4a6896a0df98db6ddaf4238e6291bf1 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-07-29Remove obsolete L2 KWPeter Mikus6-843/+0
Change-Id: I9a8aa6f5ccf95d632f4e677c8bf14f50b982d930 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-07-26Move: 100tnl tests to 400tnlPeter Mikus4-56/+56
- Just bcause they wanted. Change-Id: I46a83924d61e9191bb02cf9dcfb761156686d545 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-07-25VPPD: VXLANPeter Mikus6-306/+147
Change-Id: Iac518341e6a0fff4a31ad3692ccc5697690db8be Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-07-25VAT-to-PAPI: LISPSetupAndrej Marcinek3-144/+0
Removed CRUD parts from tests Change-Id: Iaca36e62be5144ea3f2831457113959b65489db8 Signed-off-by: Andrej Marcinek <andrej.marcinek@pantheon.tech>
2019-07-24NF_density dot1qip4udpvxlanPeter Mikus68-160/+1248
+ NF_density compatible + Baseline VM tests compatible + Scalability NxM - 3n variant is missing in VXLAN and DOT1Q due to requests to have it asymmetrical - TODO Change-Id: Ia817d7be00622b594b451bc07756240d1a379e04 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-07-23Add scale ipsec tunnel tests 40K, 60KPeter Mikus8-0/+1212
Change-Id: Iecfd7e69a72c8d5893a703fa93439cde0a3edf5f Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-07-22Remove selected VIRL testsPeter Mikus7-888/+0
- These are not going to be converted to vpp_device Change-Id: I0148be014fee476f3dc1a72c51316aace0f2350f Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-07-19FIX: naming convention fixes for TOXPeter Mikus4-4/+4
Change-Id: I0644fbd0e136dee3a91fd9406155f971b3c726eb Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-07-19VAT API to PAPI CONVERSIONpremkumarv1-2/+2
Change-Id: I9c87cdfb99780f398da5cd90351b303caa89bda9 Signed-off-by: premkumarv <preym17@gmail.com>
2019-07-19Remove un-interested VIRL tests and related resourcesJan Gelety7-1289/+0
Change-Id: I712f5dc238fdf480c7c35250148c12d03ed96d74 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-07-19FIX: COP ipv6 missing FIBPeter Mikus2-0/+4
- From unknown reason VAT was more tolerant Change-Id: Ia740843c67604a18de40d14cc448138b9f079b41 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-07-11CSIT-1469: Migrate IPsecUtil library from VAT to PAPIJan Gelety30-30/+44
Change-Id: Iac790bf5755a70697e4c4eff32242b04f8e7f789 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-07-17Refactor VPP Device VM vhost testsjuraj.linkes13-457/+344
* replace the current VM image with kernel img * rework keyword usage to make it consistent with performance tests * remove resources/libraries/robot/shared/qemu.robot as it's not used anywhere anymore Change-Id: Ia5bc19e9e6ed9af031e4d9b5c0c89431fb49fd33 Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>
2019-07-16fix invalid variable name issue of ipsechw test suitesYulong Pei2-2/+2
Change-Id: Ie7bfaaaa2e4cab4b52dab42f71780f581306659b Signed-off-by: Yulong Pei <yulong.pei@intel.com>
2019-07-12VPPD: Cop, iACL, PolicerPeter Mikus27-1269/+1155
- Alignment with PERF Change-Id: Id7b2cb91c88e44cf9265c3376330f6aa579abf7a Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-07-12VPPD: Merge IPv4/IPv6Peter Mikus8-436/+24
- Preparation for coverage.sh Change-Id: Id299df9cd57ee69116686c8bc85eaba1cc353122 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-07-11FIX: Various naming convention typosPeter Mikus21-21/+21
Change-Id: Ib55d9f3993cb63d3130a6bd338d612bde0235d5d Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-07-11Aligning FUNC/PERF keywords - Data drivenPeter Mikus24-541/+943
Change-Id: I233c8908c724556db09c60de6efa9237068fb4c3 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-07-09Add scale ipsec tunnel tests 20KPeter Mikus40-36/+640
Change-Id: Ib52e1735b6b82ea9fea44c06c379f117068e94c1 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-07-09CSIT-1539 Aligning FUNC/PERF keywords - Phase IIIPeter Mikus116-705/+510
Change-Id: Ibd3e99390bf004173d3d126946b95ffe9ba8f196 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-07-08Remove import of removed qemu.robotVratko Polak11-11/+0
The library got removed in https://gerrit.fd.io/r/20219 but the tests are passing in spite of import error. Change-Id: Ide1b896415bbd84d5980d9308272ce57318173bf Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-07-05Remove redundant VIRL testPeter Mikus3-892/+0
Change-Id: I368f4e07d578802973a1c5f6b15e170038d63238 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-07-05Remove pkt_trace as global variablePeter Mikus2-4/+0
- Use explicit parameters Change-Id: I21cbc8cf13ec5e455b20c685c4427a53a655f71f Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-07-03FIX: use len parameter name in prefix structure in ip_route_add_delJan Gelety2-2/+4
+ new vpp stabel build with fixed ipv6 address incrementation Change-Id: Id3f4104a48e45b6fd70ccbd47ad9e3c6925220fd Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-07-03Fix typos in IPsec suitesVratko Polak2-2/+2
Change-Id: I566e5e9ded9efb7b8d391fd77c567047f8a017ca Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-07-02fix missing separator issue of crypto ipsec test suitesYulong Pei17-17/+17
Change-Id: Iaec8b496cfd40e9a24c2226c1f7c6f7dde6a3d82 Signed-off-by: Yulong Pei <yulong.pei@intel.com>
2019-06-17Add packet trace to teardown of all vpp-device func testsJan Gelety4-4/+4
Change-Id: I26ad1f9a481d3d7ecdb0ad4e85d521756302e09b Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-06-28Fix missing pipe in ip6 suiteVratko Polak1-1/+1
Change-Id: I905e6e744519bcdd07360376f9552c5cf895c976 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-06-28VAT-to-PAPI: ClassifyTibor Frank5-812/+90
Change-Id: Ic06a0a65429680e6ecdc3f5288d091c2c2630921 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-06-27VAT-to-PAPI: IPFIX and SPANTibor Frank6-802/+0
Change-Id: I34bdc17d6350e5a441dabd9154620627780f4c12 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-06-16FIX: IPUtil after vpp api changesJan Gelety3-3/+6
+ do not log all ip_route_add_del api calls to PAPI history in case of scale tests + fix for SRv6 proxy tests + support of more complex structures in api calls/replies in PapiExecutor + update of vpp stable build to version 19.08-rc0~487-gb98dbb1 Change-Id: I9972e126b68ce1cb57f781e3d90ea9b3914de69e Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-06-25Align suite/test teardown/setupPeter Mikus400-3124/+2720
+ Phase II - aligning FUNC/PERF setup. + 2n/3n compatibility of suite setup. + Same structure of testcase for DEV/PERF. + DEVICE tests are now running VPP startup config in same way as PERF. + DEVICE is using COREKEEPER! - DEVICE tests are running topology compute twice for backward compatibility. TODO to remove. - Still phase III needed to align TAGS, LIBRARIES and remove OLD setup phase. Change-Id: Ib6e1b0ebf4abebf3cbe73b4fda5cac953c2a7270 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-06-21Allow 9000b tests for AVFVratko Polak7-0/+84
See https://gerrit.fd.io/r/20148 Change-Id: I22856b14e3608348f2ccecb1d99d87209db2d776 Signed-off-by: Vratko Polak <vrpolak@cisco.com>