aboutsummaryrefslogtreecommitdiffstats
path: root/tests/vpp/perf
AgeCommit message (Collapse)AuthorFilesLines
2019-07-05Remove pkt_trace as global variablePeter Mikus1-2/+0
- Use explicit parameters Change-Id: I21cbc8cf13ec5e455b20c685c4427a53a655f71f Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-07-03Fix typos in IPsec suitesVratko Polak2-2/+2
Change-Id: I566e5e9ded9efb7b8d391fd77c567047f8a017ca Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-07-02fix missing separator issue of crypto ipsec test suitesYulong Pei17-17/+17
Change-Id: Iaec8b496cfd40e9a24c2226c1f7c6f7dde6a3d82 Signed-off-by: Yulong Pei <yulong.pei@intel.com>
2019-06-28Fix missing pipe in ip6 suiteVratko Polak1-1/+1
Change-Id: I905e6e744519bcdd07360376f9552c5cf895c976 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-06-28VAT-to-PAPI: ClassifyTibor Frank1-6/+4
Change-Id: Ic06a0a65429680e6ecdc3f5288d091c2c2630921 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-06-16FIX: IPUtil after vpp api changesJan Gelety3-3/+6
+ do not log all ip_route_add_del api calls to PAPI history in case of scale tests + fix for SRv6 proxy tests + support of more complex structures in api calls/replies in PapiExecutor + update of vpp stable build to version 19.08-rc0~487-gb98dbb1 Change-Id: I9972e126b68ce1cb57f781e3d90ea9b3914de69e Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-06-25Align suite/test teardown/setupPeter Mikus367-2776/+2387
+ Phase II - aligning FUNC/PERF setup. + 2n/3n compatibility of suite setup. + Same structure of testcase for DEV/PERF. + DEVICE tests are now running VPP startup config in same way as PERF. + DEVICE is using COREKEEPER! - DEVICE tests are running topology compute twice for backward compatibility. TODO to remove. - Still phase III needed to align TAGS, LIBRARIES and remove OLD setup phase. Change-Id: Ib6e1b0ebf4abebf3cbe73b4fda5cac953c2a7270 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-06-21Allow 9000b tests for AVFVratko Polak7-0/+84
See https://gerrit.fd.io/r/20148 Change-Id: I22856b14e3608348f2ccecb1d99d87209db2d776 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-06-21Align suite/test teardown/setupPeter Mikus366-925/+731
+ Phase I - aligning FUNC/PERF Change-Id: I46b1e43687ddb29f5ed3c6335fe1baf21ec02822 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-06-21FIX: IPsec TNL test should load pluginsPeter Mikus8-16/+24
Change-Id: I76f643bebec9fd4988478ce0766621fbb6f71fff Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-06-20perf ipsec: test renamingMaciek Konstantynowicz54-918/+918
Change-Id: Ieacefc7d19438d622ef8e23e9504d80e2a34215f Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2019-06-19Add scale ipsec tunnel testsPeter Mikus36-218/+1300
- 5K - 10K Change-Id: Iaa2c77d07c3686e09fe327c663d7d7fc42024034 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-06-09CSIT-1521 Convert NestedVM testcase into KernelVMPeter Mikus24-1121/+239
Change-Id: Ic493253dc29dad4fc7e6541e4b839ca5898a6a40 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-06-05Even more Crypto combinationsPeter Mikus44-304/+2058
Change-Id: I10eeb4ee30a57712824e68176d92d1ecb5f0d1b0 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-05-23FIX: IPsec typoPeter Mikus4-4/+4
Change-Id: Ic565a5caea57b05e6905698f68fcf2146ae14d72 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-05-23CSIT-1507: Rework IPsec base testcasesPeter Mikus17-162/+1404
Change-Id: Ifb65ad8da9c5b1ef10a65a5174b698f86d2dc9d9 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-05-23CSIT-1506: Rework IPsec base testcasesPeter Mikus16-140/+1391
- Add: aes-128-gcm aes-128-gcm aes-256-gcm aes-256-gcm aes-128-cbc hmac-sha-256 aes-256-cbc hmac-sha-512 - Remove: hmac-sha1 - Scale will follow in next patch Change-Id: I789f71cf66cf61b8dbb3c6dbe9b6fdc79866ac33 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-05-20FIX2: VTS cpu listJan Gelety3-3/+3
Change-Id: Ibd0f719585d6482a65ae6cea516a4da017281ef5 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-05-20FIX: VTS cpu listJan Gelety3-9/+9
Change-Id: Ic3ac22642e443f30a46914c18cd9a9b54064286b Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-05-16Tests: Add IPSEC SW scale testsTibor Frank4-0/+648
Change-Id: I4339059a0cf67acce668abe42aab59bbb17916d9 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-05-15Fix teardown keyword for wrk testVratko Polak1-1/+1
Change-Id: Ib0a86cdb250f4eb7a5a08d205c0b17c7bf9fd851 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-05-13Remove CFSRR1 VM testsPeter Mikus6-870/+0
- Per agreed Change-Id: Ie955ebfe19bff8c4a8671a0f62eea5be4407caa5 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-05-09Remove old VPP Restart sequencePeter Mikus1-1/+0
Change-Id: I7f71a9709ad55ce03d73e23cc8a9f5064947ed51 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-05-09Add new higher density NF testsPeter Mikus12-0/+1584
Change-Id: Ib2f3f3f8dc3e202dc1db53c739d9309be2ed8a60 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-05-06CSIT-1493 VPP restart handling codePeter Mikus1-1/+0
Change-Id: Ibe52125089f39e0ff17ec607a3ed00c61d52ab8c Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-04-26NF density tests with dtc=0.5 and dtcr=2Peter Mikus136-3452/+9083
Change-Id: Icff556142280ad0b6261e0a2bfb71672ee6b3807 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-04-24FIX: Crypto testsPeter Mikus6-12/+18
- By adding crypto_ipsecmb.so into the list of loaded plugins Change-Id: I52de9b410441422ad8e337208f40360fbdea264d Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-04-23FIX: VTS pinning issue.Peter Mikus3-6/+6
Change-Id: I12a79605a925c00d9c41b7115bc7cbb7f2cd49c1 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-04-16Add 2n AVF testsPeter Mikus3-0/+350
- Side effect of other troubleshooting, but better to merge then throw away. Change-Id: Idc1a0ca66b35b61c1ffd11242cd7b7133ae4cbd7 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-04-15Remove obsolete QEMU installationPeter Mikus1-3/+0
+Unify QEMU parameter to Contants. Change-Id: I95adfc97dd7008c19e60ba3fa8668818b503bee8 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-04-12Convert existing nf_density testpmd-mac into KernelVMPeter Mikus19-114/+57
Change-Id: I9ec1701d9012de59cc42cc5f9a4744f01695ff9a Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-04-08Upgrade autogen to NICs and search typesVratko Polak841-84215/+7992
+ All perf suites updated, as autogen change is backward incompatible. + Only x710 -ndrpdr suites remain in git repository. + Removed retry feature of run_tests. + Renamed topology_type and traffic_type to traffic_profile. + Renamed framesize to frame_size; nic_model to nic_name. + Reordered Variables table to start with nic_name and overhead. + Fixed wrong overhead value in some cbc-sha1 suites. + Fixed some suite tags. ++ Introduced tags to distinguish suites, such as IPSECINT. + Bound crypto hardware to NIC name. + Implemented NIC limit hiding. + Also search and teardown related arguments are now hidden. + Main measurement keywords updated to new arg handling. + Max rate related keywords moved to performance_limits.robot + Teardowns unified. + Generated tests are archived. ++ Generated directory is .gitignore-d. + Regenerator raises an exception on seeing non-compatible suite. ++ Relatively helpful message should be seen in exception. + Suite and template Documentation has generated parts. +- With short NIC names only. + Autogen checker also upgraded. + Tag expressions replaced with long files to ensure analogous tests. Change-Id: I60e9a999187e7da1f60d0eb4fb02afa14682aa46 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-04-08Remove lbdpdk perf testsPeter Mikus8-1244/+0
- They are not used anywhere and failing all the time. Change-Id: Ib1aec32ffeac51a48f8eda64a1832a87f56d229b Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-04-06FIX: Operational issuesPeter Mikus43-152/+49
- FIX MSR package installation - FIX VTS - FIX sockets by removing from TCs Change-Id: I043c60f9e3e9c39cbeaee5e09b7a8351965efd35 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-04-05Fixes for Taishan testbedjuraj.linkes44-6021/+0
* rename NICs in Taishan testbed to Intel-X520-DA2 * fix testbed NIC selection * remove unnecessary 82599es tests * blacklist unsupported tests on Taishan testbed * lowercase previously created bash local variables Change-Id: I3b7f59e2edc00929fab2f5a0fce483f236f83075 Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>
2019-03-27FIX: change socket location for vhost-user interfaceJan Gelety36-72/+72
Change-Id: Icce908d274f9fcd92e7eaa731da094b63fd3ee0e Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-03-28Add ipsec crypto test for Denverton platformYulong Pei42-18/+3964
add ipsec cryto test to support Denverton hardware crypto device C3xxx. replace HW_cryptodev keyword to HW_DH895xcc or HW_C3xxx, or add more other hardware crypto device type support in the future. Change-Id: I181bca4095757fde7ca45ab3856273ac5930d902 Signed-off-by: Yulong Pei <yulong.pei@intel.com>
2019-03-26FIX: Do not restart VPP immediately after VPP installationJan Gelety1-0/+1
Change-Id: Ib3ee517c850953fe87f3036702d2924cf41a9998 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-03-20CSIT-1386 KernelVM - Part IIPeter Mikus38-0/+5053
- Implementation of KernelVM (ThinVM) - nf_density tests for KernelVM with VPP as VNF. Change-Id: Ife5c2e1ab419c55cbcd442792f940db3a41da471 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-03-18CSIT-1386 KernelVM - Part IPeter Mikus149-149/+0
- Refactor QemuUtils Full refactor of QemuUtils to prepare for thinner VMs. Change-Id: I171ba11a9e6e9faec582bd58df6819598b0ed0b5 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-03-07FIX: Use correct MRR tagJan Gelety1-1/+1
Change-Id: I2ccb081dd99e13f94fe6e2bfc9cce068a555e12e Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-03-06add vxlan perf test cases for Intel-X553 of Denverton platformYulong Pei2-0/+262
add below vxlan perf test cases for Intel-X553 of Denverton platform, 10ge2p1x553-ethip4vxlan-l2bdbasemaclrn-mrr.robot 10ge2p1x553-ethip4vxlan-l2bdbasemaclrn-ndrpdr.robot Change-Id: Ia0bbdd5d465bd1ac8d9930ac67099c63773a6cef Signed-off-by: Yulong Pei <yulong.pei@intel.com>
2019-03-01Add ARM Taishan testbed33 perftestStanislav Chlebec44-0/+6021
Change-Id: Iaa0e7fbca7de26c7dce8b389cc3494f628a2ecd0 Signed-off-by: Stanislav Chlebec <stanislav.chlebec@pantheon.tech> Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>
2019-02-26FIX: ipsec + vpp stable version updateJan Gelety4-0/+8
- use exec ipsec sa add - use exec ipsec spd add - use exec set ipsec sa Change-Id: I69d59dd230b99d8efc9bcb5e3fbab79a8b11b18a Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-02-19Adapt autogen for SFd testsVratko Polak78-33/+24
+ Make the skipping logic in autogen more flexible. + Do not emit 4c cases when there is too much VMs/containers. + Peter says the second -eth- should be renamed away from suites. + Regenerate suites so test case names match (new) suite names. Change-Id: I95ecc47ca07b8bae6693d5d4330811ff55672fc4 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-02-09Remove VHOST 256qsize tests.Peter Mikus31-4325/+0
As per discussion, tests are not required anymore. From maintaining point of view, removing completely. Change-Id: Ic082fc6831fd46ae14b58140d20eadba8cd8f91f Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-02-08CSIT-845 Capture VPP core-dump from vpp crash on DUTsPeter Mikus1-11/+13
Change-Id: I987dcd5092d8527c9aefbe093e1ed7ae144d191b Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-02-06FIX: Set ipsec backend to dpdk backend when aes-gcm cipher usedJan Gelety12-0/+60
Change-Id: I008b9e0fd62cdc8e29136930762bd7412bd50181 Signed-off-by: Jan Gelety <jgelety@cisco.com> (cherry picked from commit 2230a8ab108fa114752decfc69321ec5a47f36a6)
2019-01-30FIX: SRv6 container testsPeter Mikus6-6/+6
Change-Id: I9ec04608a9b6cf6a99c938b06261e23e58d290be Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-01-30FIX: Hardcode nf_density RXQ count to 1Peter Mikus76-76/+76
Change-Id: I7ca3b2ce4f4c9d8b452d9de63e7466482d15aa50 Signed-off-by: Peter Mikus <pmikus@cisco.com>