aboutsummaryrefslogtreecommitdiffstats
path: root/tests/vpp/perf
AgeCommit message (Collapse)AuthorFilesLines
2019-08-19Autogen: Create NICs for TCP suites.Vratko Polak3-18/+18
+ Put Regenerator internal functions ourside class. + Duplicate into _default_ and _tcp_ functions. + Rework Testcase to be a single class with two factories. + Improve suite and testcase naming. Change-Id: I1f835b576c476c1a40c8c52469b1876695f9ae73 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-08-14FIX: Remove eth_avf and portX_vifY interfaces from topo in TC/TS tear downJan Gelety15-15/+15
Change-Id: I90901c4ab14dfa76dc3e1f786a4b986479e0ba47 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-08-14VAT-to-PAPI: Fix HTTP/TCP testsDave Wallace2-60/+116
Change-Id: Ie728bc73eb7429d246e82dd195fc63191c3ac51d Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
2019-08-12Clean: Various librariesPeter Mikus43-83/+125
- Remove translate TC as they have no perf opposite - Remove unused keywords - Merge similar keywords / rename - Move keywords from perf library to categories Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I6433006136e2497ad8fb17193aa20c578d836999
2019-08-09Clean: L2 bridge domainPeter Mikus10-10/+20
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I3721900b91a9c8e9db8766bdcb9771b6bcf95bca
2019-08-08FIX: Various typos in nf_density + missing KWPeter Mikus4-5/+5
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I73878542672ab2dcfa1db046fbca4b7d931e744c
2019-08-07Add: AVF ip4scalePeter Mikus12-9/+916
+ Few corrections + Aligning 3n/2n Change-Id: If0918c0df38c5532899bec9ae7a7019117fff477 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-08-06Add: Dot1Q + L2BD + GBPPeter Mikus2-2/+142
Change-Id: I0050f715011ecfa92b3ee88b301809a56abb7946 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-07-26Move: 100tnl tests to 400tnlPeter Mikus4-56/+56
- Just bcause they wanted. Change-Id: I46a83924d61e9191bb02cf9dcfb761156686d545 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-07-24NF_density dot1qip4udpvxlanPeter Mikus67-159/+1245
+ NF_density compatible + Baseline VM tests compatible + Scalability NxM - 3n variant is missing in VXLAN and DOT1Q due to requests to have it asymmetrical - TODO Change-Id: Ia817d7be00622b594b451bc07756240d1a379e04 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-07-23Add scale ipsec tunnel tests 40K, 60KPeter Mikus8-0/+1212
Change-Id: Iecfd7e69a72c8d5893a703fa93439cde0a3edf5f Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-07-11CSIT-1469: Migrate IPsecUtil library from VAT to PAPIJan Gelety30-30/+44
Change-Id: Iac790bf5755a70697e4c4eff32242b04f8e7f789 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-07-17Refactor VPP Device VM vhost testsjuraj.linkes1-3/+3
* replace the current VM image with kernel img * rework keyword usage to make it consistent with performance tests * remove resources/libraries/robot/shared/qemu.robot as it's not used anywhere anymore Change-Id: Ia5bc19e9e6ed9af031e4d9b5c0c89431fb49fd33 Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>
2019-07-16fix invalid variable name issue of ipsechw test suitesYulong Pei2-2/+2
Change-Id: Ie7bfaaaa2e4cab4b52dab42f71780f581306659b Signed-off-by: Yulong Pei <yulong.pei@intel.com>
2019-07-12VPPD: Cop, iACL, PolicerPeter Mikus10-12/+547
- Alignment with PERF Change-Id: Id7b2cb91c88e44cf9265c3376330f6aa579abf7a Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-07-09Add scale ipsec tunnel tests 20KPeter Mikus40-36/+640
Change-Id: Ib52e1735b6b82ea9fea44c06c379f117068e94c1 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-07-09CSIT-1539 Aligning FUNC/PERF keywords - Phase IIIPeter Mikus101-101/+101
Change-Id: Ibd3e99390bf004173d3d126946b95ffe9ba8f196 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-07-05Remove pkt_trace as global variablePeter Mikus1-2/+0
- Use explicit parameters Change-Id: I21cbc8cf13ec5e455b20c685c4427a53a655f71f Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-07-03Fix typos in IPsec suitesVratko Polak2-2/+2
Change-Id: I566e5e9ded9efb7b8d391fd77c567047f8a017ca Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-07-02fix missing separator issue of crypto ipsec test suitesYulong Pei17-17/+17
Change-Id: Iaec8b496cfd40e9a24c2226c1f7c6f7dde6a3d82 Signed-off-by: Yulong Pei <yulong.pei@intel.com>
2019-06-28Fix missing pipe in ip6 suiteVratko Polak1-1/+1
Change-Id: I905e6e744519bcdd07360376f9552c5cf895c976 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-06-28VAT-to-PAPI: ClassifyTibor Frank1-6/+4
Change-Id: Ic06a0a65429680e6ecdc3f5288d091c2c2630921 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-06-16FIX: IPUtil after vpp api changesJan Gelety3-3/+6
+ do not log all ip_route_add_del api calls to PAPI history in case of scale tests + fix for SRv6 proxy tests + support of more complex structures in api calls/replies in PapiExecutor + update of vpp stable build to version 19.08-rc0~487-gb98dbb1 Change-Id: I9972e126b68ce1cb57f781e3d90ea9b3914de69e Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-06-25Align suite/test teardown/setupPeter Mikus367-2776/+2387
+ Phase II - aligning FUNC/PERF setup. + 2n/3n compatibility of suite setup. + Same structure of testcase for DEV/PERF. + DEVICE tests are now running VPP startup config in same way as PERF. + DEVICE is using COREKEEPER! - DEVICE tests are running topology compute twice for backward compatibility. TODO to remove. - Still phase III needed to align TAGS, LIBRARIES and remove OLD setup phase. Change-Id: Ib6e1b0ebf4abebf3cbe73b4fda5cac953c2a7270 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-06-21Allow 9000b tests for AVFVratko Polak7-0/+84
See https://gerrit.fd.io/r/20148 Change-Id: I22856b14e3608348f2ccecb1d99d87209db2d776 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-06-21Align suite/test teardown/setupPeter Mikus366-925/+731
+ Phase I - aligning FUNC/PERF Change-Id: I46b1e43687ddb29f5ed3c6335fe1baf21ec02822 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-06-21FIX: IPsec TNL test should load pluginsPeter Mikus8-16/+24
Change-Id: I76f643bebec9fd4988478ce0766621fbb6f71fff Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-06-20perf ipsec: test renamingMaciek Konstantynowicz54-918/+918
Change-Id: Ieacefc7d19438d622ef8e23e9504d80e2a34215f Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2019-06-19Add scale ipsec tunnel testsPeter Mikus36-218/+1300
- 5K - 10K Change-Id: Iaa2c77d07c3686e09fe327c663d7d7fc42024034 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-06-09CSIT-1521 Convert NestedVM testcase into KernelVMPeter Mikus24-1121/+239
Change-Id: Ic493253dc29dad4fc7e6541e4b839ca5898a6a40 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-06-05Even more Crypto combinationsPeter Mikus44-304/+2058
Change-Id: I10eeb4ee30a57712824e68176d92d1ecb5f0d1b0 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-05-23FIX: IPsec typoPeter Mikus4-4/+4
Change-Id: Ic565a5caea57b05e6905698f68fcf2146ae14d72 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-05-23CSIT-1507: Rework IPsec base testcasesPeter Mikus17-162/+1404
Change-Id: Ifb65ad8da9c5b1ef10a65a5174b698f86d2dc9d9 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-05-23CSIT-1506: Rework IPsec base testcasesPeter Mikus16-140/+1391
- Add: aes-128-gcm aes-128-gcm aes-256-gcm aes-256-gcm aes-128-cbc hmac-sha-256 aes-256-cbc hmac-sha-512 - Remove: hmac-sha1 - Scale will follow in next patch Change-Id: I789f71cf66cf61b8dbb3c6dbe9b6fdc79866ac33 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-05-20FIX2: VTS cpu listJan Gelety3-3/+3
Change-Id: Ibd0f719585d6482a65ae6cea516a4da017281ef5 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-05-20FIX: VTS cpu listJan Gelety3-9/+9
Change-Id: Ic3ac22642e443f30a46914c18cd9a9b54064286b Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-05-16Tests: Add IPSEC SW scale testsTibor Frank4-0/+648
Change-Id: I4339059a0cf67acce668abe42aab59bbb17916d9 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-05-15Fix teardown keyword for wrk testVratko Polak1-1/+1
Change-Id: Ib0a86cdb250f4eb7a5a08d205c0b17c7bf9fd851 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-05-13Remove CFSRR1 VM testsPeter Mikus6-870/+0
- Per agreed Change-Id: Ie955ebfe19bff8c4a8671a0f62eea5be4407caa5 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-05-09Remove old VPP Restart sequencePeter Mikus1-1/+0
Change-Id: I7f71a9709ad55ce03d73e23cc8a9f5064947ed51 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-05-09Add new higher density NF testsPeter Mikus12-0/+1584
Change-Id: Ib2f3f3f8dc3e202dc1db53c739d9309be2ed8a60 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-05-06CSIT-1493 VPP restart handling codePeter Mikus1-1/+0
Change-Id: Ibe52125089f39e0ff17ec607a3ed00c61d52ab8c Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-04-26NF density tests with dtc=0.5 and dtcr=2Peter Mikus136-3452/+9083
Change-Id: Icff556142280ad0b6261e0a2bfb71672ee6b3807 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-04-24FIX: Crypto testsPeter Mikus6-12/+18
- By adding crypto_ipsecmb.so into the list of loaded plugins Change-Id: I52de9b410441422ad8e337208f40360fbdea264d Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-04-23FIX: VTS pinning issue.Peter Mikus3-6/+6
Change-Id: I12a79605a925c00d9c41b7115bc7cbb7f2cd49c1 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-04-16Add 2n AVF testsPeter Mikus3-0/+350
- Side effect of other troubleshooting, but better to merge then throw away. Change-Id: Idc1a0ca66b35b61c1ffd11242cd7b7133ae4cbd7 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-04-15Remove obsolete QEMU installationPeter Mikus1-3/+0
+Unify QEMU parameter to Contants. Change-Id: I95adfc97dd7008c19e60ba3fa8668818b503bee8 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-04-12Convert existing nf_density testpmd-mac into KernelVMPeter Mikus19-114/+57
Change-Id: I9ec1701d9012de59cc42cc5f9a4744f01695ff9a Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-04-08Upgrade autogen to NICs and search typesVratko Polak841-84215/+7992
+ All perf suites updated, as autogen change is backward incompatible. + Only x710 -ndrpdr suites remain in git repository. + Removed retry feature of run_tests. + Renamed topology_type and traffic_type to traffic_profile. + Renamed framesize to frame_size; nic_model to nic_name. + Reordered Variables table to start with nic_name and overhead. + Fixed wrong overhead value in some cbc-sha1 suites. + Fixed some suite tags. ++ Introduced tags to distinguish suites, such as IPSECINT. + Bound crypto hardware to NIC name. + Implemented NIC limit hiding. + Also search and teardown related arguments are now hidden. + Main measurement keywords updated to new arg handling. + Max rate related keywords moved to performance_limits.robot + Teardowns unified. + Generated tests are archived. ++ Generated directory is .gitignore-d. + Regenerator raises an exception on seeing non-compatible suite. ++ Relatively helpful message should be seen in exception. + Suite and template Documentation has generated parts. +- With short NIC names only. + Autogen checker also upgraded. + Tag expressions replaced with long files to ensure analogous tests. Change-Id: I60e9a999187e7da1f60d0eb4fb02afa14682aa46 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-04-08Remove lbdpdk perf testsPeter Mikus8-1244/+0
- They are not used anywhere and failing all the time. Change-Id: Ib1aec32ffeac51a48f8eda64a1832a87f56d229b Signed-off-by: Peter Mikus <pmikus@cisco.com>