aboutsummaryrefslogtreecommitdiffstats
path: root/tests/vpp/perf
AgeCommit message (Collapse)AuthorFilesLines
2019-04-08Upgrade autogen to NICs and search typesVratko Polak841-84215/+7992
+ All perf suites updated, as autogen change is backward incompatible. + Only x710 -ndrpdr suites remain in git repository. + Removed retry feature of run_tests. + Renamed topology_type and traffic_type to traffic_profile. + Renamed framesize to frame_size; nic_model to nic_name. + Reordered Variables table to start with nic_name and overhead. + Fixed wrong overhead value in some cbc-sha1 suites. + Fixed some suite tags. ++ Introduced tags to distinguish suites, such as IPSECINT. + Bound crypto hardware to NIC name. + Implemented NIC limit hiding. + Also search and teardown related arguments are now hidden. + Main measurement keywords updated to new arg handling. + Max rate related keywords moved to performance_limits.robot + Teardowns unified. + Generated tests are archived. ++ Generated directory is .gitignore-d. + Regenerator raises an exception on seeing non-compatible suite. ++ Relatively helpful message should be seen in exception. + Suite and template Documentation has generated parts. +- With short NIC names only. + Autogen checker also upgraded. + Tag expressions replaced with long files to ensure analogous tests. Change-Id: I60e9a999187e7da1f60d0eb4fb02afa14682aa46 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-04-08Remove lbdpdk perf testsPeter Mikus8-1244/+0
- They are not used anywhere and failing all the time. Change-Id: Ib1aec32ffeac51a48f8eda64a1832a87f56d229b Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-04-06FIX: Operational issuesPeter Mikus43-152/+49
- FIX MSR package installation - FIX VTS - FIX sockets by removing from TCs Change-Id: I043c60f9e3e9c39cbeaee5e09b7a8351965efd35 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-04-05Fixes for Taishan testbedjuraj.linkes44-6021/+0
* rename NICs in Taishan testbed to Intel-X520-DA2 * fix testbed NIC selection * remove unnecessary 82599es tests * blacklist unsupported tests on Taishan testbed * lowercase previously created bash local variables Change-Id: I3b7f59e2edc00929fab2f5a0fce483f236f83075 Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>
2019-03-27FIX: change socket location for vhost-user interfaceJan Gelety36-72/+72
Change-Id: Icce908d274f9fcd92e7eaa731da094b63fd3ee0e Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-03-28Add ipsec crypto test for Denverton platformYulong Pei42-18/+3964
add ipsec cryto test to support Denverton hardware crypto device C3xxx. replace HW_cryptodev keyword to HW_DH895xcc or HW_C3xxx, or add more other hardware crypto device type support in the future. Change-Id: I181bca4095757fde7ca45ab3856273ac5930d902 Signed-off-by: Yulong Pei <yulong.pei@intel.com>
2019-03-26FIX: Do not restart VPP immediately after VPP installationJan Gelety1-0/+1
Change-Id: Ib3ee517c850953fe87f3036702d2924cf41a9998 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-03-20CSIT-1386 KernelVM - Part IIPeter Mikus38-0/+5053
- Implementation of KernelVM (ThinVM) - nf_density tests for KernelVM with VPP as VNF. Change-Id: Ife5c2e1ab419c55cbcd442792f940db3a41da471 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-03-18CSIT-1386 KernelVM - Part IPeter Mikus149-149/+0
- Refactor QemuUtils Full refactor of QemuUtils to prepare for thinner VMs. Change-Id: I171ba11a9e6e9faec582bd58df6819598b0ed0b5 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-03-07FIX: Use correct MRR tagJan Gelety1-1/+1
Change-Id: I2ccb081dd99e13f94fe6e2bfc9cce068a555e12e Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-03-06add vxlan perf test cases for Intel-X553 of Denverton platformYulong Pei2-0/+262
add below vxlan perf test cases for Intel-X553 of Denverton platform, 10ge2p1x553-ethip4vxlan-l2bdbasemaclrn-mrr.robot 10ge2p1x553-ethip4vxlan-l2bdbasemaclrn-ndrpdr.robot Change-Id: Ia0bbdd5d465bd1ac8d9930ac67099c63773a6cef Signed-off-by: Yulong Pei <yulong.pei@intel.com>
2019-03-01Add ARM Taishan testbed33 perftestStanislav Chlebec44-0/+6021
Change-Id: Iaa0e7fbca7de26c7dce8b389cc3494f628a2ecd0 Signed-off-by: Stanislav Chlebec <stanislav.chlebec@pantheon.tech> Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>
2019-02-26FIX: ipsec + vpp stable version updateJan Gelety4-0/+8
- use exec ipsec sa add - use exec ipsec spd add - use exec set ipsec sa Change-Id: I69d59dd230b99d8efc9bcb5e3fbab79a8b11b18a Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-02-19Adapt autogen for SFd testsVratko Polak78-33/+24
+ Make the skipping logic in autogen more flexible. + Do not emit 4c cases when there is too much VMs/containers. + Peter says the second -eth- should be renamed away from suites. + Regenerate suites so test case names match (new) suite names. Change-Id: I95ecc47ca07b8bae6693d5d4330811ff55672fc4 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-02-09Remove VHOST 256qsize tests.Peter Mikus31-4325/+0
As per discussion, tests are not required anymore. From maintaining point of view, removing completely. Change-Id: Ic082fc6831fd46ae14b58140d20eadba8cd8f91f Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-02-08CSIT-845 Capture VPP core-dump from vpp crash on DUTsPeter Mikus1-11/+13
Change-Id: I987dcd5092d8527c9aefbe093e1ed7ae144d191b Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-02-06FIX: Set ipsec backend to dpdk backend when aes-gcm cipher usedJan Gelety12-0/+60
Change-Id: I008b9e0fd62cdc8e29136930762bd7412bd50181 Signed-off-by: Jan Gelety <jgelety@cisco.com> (cherry picked from commit 2230a8ab108fa114752decfc69321ec5a47f36a6)
2019-01-30FIX: SRv6 container testsPeter Mikus6-6/+6
Change-Id: I9ec04608a9b6cf6a99c938b06261e23e58d290be Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-01-30FIX: Hardcode nf_density RXQ count to 1Peter Mikus76-76/+76
Change-Id: I7ca3b2ce4f4c9d8b452d9de63e7466482d15aa50 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-01-30Remove non-runable nf_density testsPeter Mikus18-279/+0
Remove tests that cannot run on target machines Change-Id: I2417d491e36afc9164c6981a9f5a3134529df251 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-01-30CSIT-1409 Implement pipeline configuration for l2bd with memif/ip4.Peter Mikus38-0/+5434
Change-Id: I7463d47a9d65069332eb2a288ff44f4499a8a467 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-01-29Add 2n1l-10ge2p1x710-eth-l2xcbase-eth-2vhostvr1024-1vm-soakTibor Frank1-0/+85
Change-Id: I6a045225b0ff3cc4cd9880ee05861fd7bf36c61a Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-01-29PLRsearch: Initial implementation and suitesVratko Polak6-0/+454
Missing bits: - Add up-to-date .rst document (in child Change). - Prepare for releasing to PyPI.org (in child Change): -- Either copy dependencies from MLRsearch, or list in requirements. -- Perhaps move common dependencies to separate package for both search to depend on. -- All the other metadata stuff. Jira: CSIT-1276 Change-Id: I277efdb63dbb90b30e11f4e30a82e2130ac8efc3 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-01-28FIX: CPU util for NFPeter Mikus1-1/+1
- Fix detecting total allocable CPUs for NFs Change-Id: If3345518befb887655d3e162551c49df3163ed92 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-01-28CSIT-1403 Implement multichain configuration for l2bd with memif/ip4.Peter Mikus84-46/+5480
Change-Id: Ia87156b2ba826eb0a9a93d756b9765c7373ca6ce Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-01-24CSIT-1407 FIX vpp install after VPP changesPeter Mikus1-6/+1
Change-Id: I9148f6de75c3100f827eedec48c4c0ccb343bc54 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-01-24FIX: correct call of vpp_add_routeJan Gelety12-60/+60
Change-Id: I63a2b5f484ac627c020e30c9f01a868c57aacf42 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-01-23Fix tag in 2n-10ge2p1x710-eth-l2bd-8vhost-1chain-4vm-l3fwdip4-mrrTibor Frank1-1/+1
Change-Id: Iaa268043c04a994647c5dcd704e4e61f4f83050c Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-01-23NF density: added new TAGs, renamed test suites and test cases per final ↵Maciek Konstantynowicz38-618/+618
agreed scheme. Change-Id: Ia7bbfe5f7027c18a68408cc71445a2839b6b19a8 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2019-01-21CSIT-1390 Implement multichain configuration for l2bd with vhost/l3fwd.Peter Mikus117-343/+5494
Change-Id: I36ab0bc7c9eada4c3f7bb5cb8f53de7d267ff910 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-01-17FIX SRv6 container tests after refactorPeter Mikus6-66/+36
Change-Id: I6b7961c9103587b752c6ffc2a56eb98ed1529edb Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-01-10CSIT-1389 Refactor current keywords for multichaining - CNF (II)Peter Mikus46-368/+276
Change-Id: Ic6af8ebf59589bea66322fc87a33218c7dc0c132 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-01-09CSIT-1389 Refactor current keywords for multichaining - CNFPeter Mikus46-460/+230
- Add ability to create matrix of containers (chains x nodeness) - Change default Docker image to csit-dut - Use new resource mapping function Change-Id: Iaac0f2efc99146fbaef0b33dc71b38770610023d Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-12-11Add missing = to all suite VariablesVratko Polak109-203/+203
Use the following if we ever decide '} =' is better than '}='. $ cd csit/tests $ find . -type f -print0 | xargs -0 sed -i -E 's/^\| \$\{(.*)\}= \|([^|])/\| \$\{\1\} = \|\2/g' FIXME: Add a corresponding check to https://gerrit.fd.io/r/13450 Change-Id: I73c516a0d7e475ff0986fd6515aaae10accd1a3a Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-11-30CSIT-1299: Revise the graphs in TrendingTibor Frank4-4/+4
Change-Id: Ie8cbc7bc8a58aca41c8cb35c14dbd8e80f027f5c Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-11-27CSIT python API introductionJan Gelety1-1/+1
Jira: CSIT-1336 Change-Id: I96d2b0221c5a7466484a82339fc132c5921532d1 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-10-24Remove usage of vpp-ext-deps packageJan Gelety1-1/+1
This package is not needed for csit enymore. Change-Id: Ie32a9c9322873e66554bb69112d4428697c866db Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-10-20update l2bdbasemaclrn-mrr and l2bdbasemaclrn-ndrpdr for x553 NICYulong Pei2-2/+2
update the test suites to call "Initialize L2 bridge domain in circular topology" since "Initialize L2 bridge domain in 2-node circular topology" was replaced by it. Change-Id: I6d5cb0868353228fbcf37b308ffa0b562649c57a Signed-off-by: Yulong Pei <yulong.pei@intel.com>
2018-10-12Tag l2bdscale as L2BDSCALE, not L2BDBASEVratko Polak24-24/+24
Change-Id: I0d2d2f16f7e0b710f432711d7e0eccf70fcfcc8f Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-10-10CSIT-1297: Modify the bootstrap.sh to run only selected mrr suitesTibor Frank10-10/+10
Change-Id: I2f5ac334e09bc35bfaefc112cf0bb7f57290a732 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-10-10Add VXLAN scale perf testsJan Gelety20-60/+2228
Jira: CSIT-1273 Change-Id: Ic2a41661c158384a5aaa7d4e73f30ffca13ddf82 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-10-02CSIT-1325 - FIX: AVF tests failing on unbindPeter Mikus4-4/+4
Currently there is and issue when consecutive AVF suites are trying to initialize AVF and bind VF to vfio-pci driver, there seems to be race condition if VPP has already VFs allocated. This patch should introduce safer contstrain to disable VPP prior AVF init. Change-Id: Id8839200f19d9e7a18d161b660cfb1e43a8ca379 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-10-01CSIT-1327 Migrate from vpp-dkms-dpdk to vpp-ext-depsPeter Mikus1-1/+1
Change-Id: I6fad3303c5c331ad36d163ba735907e35931dea0 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-09-28CSIT-1321 Add IP4base tests using AVF driverPeter Mikus4-0/+484
Change-Id: I960c2b4170efa06597851853cfc15bda1c60fe94 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-09-21Fix autogen regenerator and few suitesVratko Polak12-200/+152
+ "elif" instead of "else if". + Some suites had test cases reordered. + Some suites contained 9000B cases for avf. Change-Id: I3bf8241c317f20dbf66b497a2c8be35ef71307f5 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-09-20FIX: 40Ge2P1Vic1385-Eth-L2Bdbasemaclrn-Mrr typoPeter Mikus1-1/+1
- Per trending. Change-Id: I1e24b20bc774dae91df6fb81e3a9132ff79e3beb Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-09-20Add dot1q-l2bdbase-2memif-[ndrpdr|mrr] perf tests for 2-node topologyJan Gelety8-0/+1242
Jira: CSIT-1289 Change-Id: I9e3f1f4a03e3cac9d8831f3a87e0b1bce27a109e Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-09-20Add dot1q-l2bdbase-2vhost-[ndrpdr|mrr] perf tests for 2-node topologyJan Gelety8-94/+696
Jira: CSIT-1286 Change-Id: Id51c7dbf15d846f1286e6efbc5240a2556ec9652 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-09-20CSIT-1205 Create AVF driver test - Add Tests L2BD L2XCPeter Mikus8-0/+969
Change-Id: Ia74a87346fe2c0a170b881b510f1b0558a538f3c Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-09-20Create basic 2-node topology performance tests for Intel-X553 NICYulong Pei10-0/+1280
Intel-X553 is Denverton (Intel Atom cpu based SOC) integrated NIC, add below basic 2-node topology performance test suites for it, the test suites were changed from the existing Intel-x710 test suites, - eth-l2patch-mrr - eth-l2patch-ndrpdr - eth-l2xcbase-mrr - eth-l2xcbase-ndrpdr - eth-l2bdbasemaclrn-mrr - eth-l2bdbasemaclrn-ndrpdr - ethip4-ip4base-mrr - ethip4-ip4base-ndrpdr - ethip6-ip6base-mrr - ethip6-ip6base-ndrpdr Change-Id: Ib6d3655a6e14ae275c197fd7b39d59e17a233326 Signed-off-by: Yulong Pei <yulong.pei@intel.com>