aboutsummaryrefslogtreecommitdiffstats
path: root/tests/vpp/perf/ip4_tunnels
AgeCommit message (Collapse)AuthorFilesLines
2023-10-26feat(trex): cleanup t-rex profilespmikus30-59/+59
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: Ib93dc1552945fe91ab5346b9b759d56c7468debf
2023-05-24feat(reassembly): add few suites for ip reassemblyVratko Polak1-0/+145
In tunneling scenarios, VPP needs to reassembly packet fragments before decapsulation. Conveniently, VPP also fragments the packets after encapsulation (at least for some encapsulation protocols) if they do not fit into MTU. So this change adds few suites, adapted from existing 3-node ones which additionally lower MTU on DUT1-DUT2 link. The intended packet size is 1518B. 64B packets will fit, and most of IMIX packets will also fit without fragmentation. VPP refuses to reassembly 9000B packets as they have too many fragments. + Add a keyword so suites need only one additional line of code. + Add new test tag REASSEMBLY for the added suites. + Tell autogen the one soak test case for reaseembly should be 1518B. - It is possible to increase fragment limit for 9000B, not done yet. - Ipsec policy suites are added but they should not be used. - VPP does fragmentation twice (before and after encapsulation). - VPP does not perform reassembly (only last fragment is decrypted). - TRex does not realize the packet from VPP is only a fragment. - The result is false pass with unfairly good performance. + Suites still included, to simplify verifying VPP fixes for the above. Change-Id: If33c60d767fea161d9e4ffabb8ded3d81c8f39ed Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2022-11-14CSIT-1879: Enable vxlan plugin in all vxlan test suitesSteven Luong6-12/+12
vxlan is going to a plugin. https://gerrit.fd.io/r/c/vpp/+/37511 Need to add vxlan_plugin.so to all vxlan test cases Signed-off-by: Steven Luong <sluong@cisco.com> Change-Id: Ie7f9c6c61eac4b85aeca769d467ddd0f7d5118f0 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2022-09-30Add VPP wireguard async mode test suiteYulong Pei6-0/+1020
Add VPP wireguard async mode test suite to use QAT device for crypto. Also change keyword ipsechw to cryptohw in suite_setup.robot since currently crypto device is not only used by IPSec. Signed-off-by: Yulong Pei <yulong.pei@intel.com> Signed-off-by: xinfeng zhao <xinfengx.zhao@intel.com> Change-Id: Ibdadb3b09c04b7181415ffd4a248abddc6289075
2022-09-30Add wireguard multiple tunnels test suitesYulong Pei6-4/+849
Signed-off-by: Yulong Pei <yulong.pei@intel.com> Change-Id: I7abd546e67fdbe481b204bb6a1ec7e9c654dcdae
2022-06-30job_specs: add wireguard perf tests to regressionYulong Pei1-1/+1
Signed-off-by: xinfeng zhao <xinfengx.zhao@intel.com> Signed-off-by: Yulong Pei <yulong.pei@intel.com> Change-Id: I9e499df973fd9990ab02fe7008d12e78b2ab089f
2022-06-10fix(wireguard): add missing test teardownVratko Polak1-0/+1
Fixes: 75ef277536c43096e7646430568d97d2cc489238 Change-Id: I94575bee0aa77907cc900b58b186c3612fb18d85 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2022-06-09Add Test Suite for VPP WireGuardCui,Cheng1-0/+168
Signed-off-by: Cui,Cheng <cheng.cui@intel.com> Change-Id: I71e257e5f16a887a40ff83d782a9ebdee9d05c34 Signed-off-by: Cui,Cheng <cheng.cui@intel.com>
2022-05-18Add gtpu flow offload test suiteYulong Pei2-4/+150
The implementation of GTPU offload rx is to use ip4_gtpu flow MARK action of NIC and vpp flow REDIRECT_TO_NODE and BUFFER_ADVANCE fuction to direct received gtpu flow to gtpu4-flow-input graph node, skipped ethernet-input, ip4-input, ip4-lookup, ip4-local, ip4-udp-lookup normal graph node processing. Verified on 3n-clx and Intel E810 NIC environment, single core with 64B packet, performance improve ~33% that compare with pure software way. Signed-off-by: xinfeng zhao <xinfengx.zhao@intel.com> Signed-off-by: Yulong Pei <yulong.pei@intel.com> Change-Id: I2af4589448bdb1729e4ce206a8cf3a1239c61af8 Signed-off-by: Yulong Pei <yulong.pei@intel.com>
2022-03-31fix(geneve): Restore session multiplicationVratko Polak5-10/+10
Previous edit was restoring the correct formatting for bold text in suite documentation by a mass replace of single asterisk to double asterisk. But in geneve suites, one usage of single asterisk was numeric multiplication, which was errorneously replaces with double asterisk (power operation). This restores the multiplication. Fixes: e82ebbd96e2ba73276e2f1b6d7f9c2d8a9442c3f Change-Id: I537ebe59dd8c04768a90a5b61a348c57e3dfd149 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-12-13doc: fixing documentation structureViliam Luc15-323/+411
When building documentation using sphinx we see ~1200 similar warnings [0] [0] - https://s3-logs.fd.io/vex-yul-rot-jenkins-1/csit-verify-tox-master-ubuntu2004-x86_64/3289/doc_verify.log.gz These warning are harmless and can be fixed later Signed-off-by: Viliam Luc <vluc@cisco.com> Change-Id: I1ac1099d38935971d47491dde905715345d3935c
2021-07-15FIX: Typo's in perf suitespmikus8-8/+8
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I770bb2114d92bda4ab2408be9b075263c1cd2223
2021-06-10FIX: Pylint reducepmikus1-1/+1
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I909942dbb920df7f0fe15c0c92cda92c3cd8d8ad
2021-06-10Add gtpu sw performance test casesxinfeng zhao1-0/+138
Signed-off-by: xinfeng zhao <xinfengx.zhao@intel.com> Reviewed-by: Yulong Pei <yulong.pei@intel.com> Change-Id: Ibe4420529192559a3cdbb84e0a67859750a9e0d5
2021-05-26rxq_ratio default value changed to 1viliam.luc6-6/+0
Change-Id: I0c973ceffc13f4f3c5f959d56cb0890b87091a82 Signed-off-by: Viliam Luc <viliam.luc@pantheon.tech>
2021-05-26Perf: Add perfmon_plugin for telemetrypmikus14-22/+22
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I710af90aa5474381a82095c8a11ecf6c01c2483b
2021-01-14perf: GENEVE tunnel test, l3 modeJan Gelety6-0/+930
Jira: CSIT-1768 Change-Id: I888ae1a5754fa07297d4cdf65c2be0e3e49d89a5 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2020-09-22test: lisp moved to pluginJan Gelety2-2/+2
- lisp is moving to plugin: https://gerrit.fd.io/r/c/vpp/+/28972 Jira: CSIT-1597 Change-Id: I362f1931b5fc441da9c8a6dda933a66bfed8c4b8 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2020-08-20Framework: use 'stl' in trex stateless profile namesJan Gelety8-8/+8
Change-Id: I74641cc89d2f25d50b67d51bf2567082b420aabb Signed-off-by: Jan Gelety <jgelety@cisco.com>
2020-06-09Remove leading tc[nn] from test namesJuraj Linkeš8-96/+96
The test names are unique without it and the information doesn't add anything extra. Change-Id: Idc7d6d1d21c8c05691e1757227a0a3787406d370 Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2020-04-28CSIT-1597 API cleanup: lispJan Gelety2-2/+4
- cover API changes in VPP: https://gerrit.fd.io/r/c/vpp/+/24663 - update vpp stable to version 20.05-rc0~637 - remove unused L1 and L2 lisp KWs Change-Id: I2672b6a375ad70c82f331dcc991c145e868108b9 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2020-04-06Improve pf layerPeter Mikus8-12/+28
+ Merge single/double link + Introduce _pf{n}[0] variables so we can access physical function same way as virtual function + Cleanup code by moving complex logic to python + Prepare code for multiple vf functions Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Ic2e74a38bfa146441357de8f0916aeb638941c49
2020-03-10Make RXQs/TXQs configurablePeter Mikus8-0/+24
Change-Id: Ib30bc4697fcba93a6723ee492a59a0523425f623 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2020-02-25FIX: check if t-rex is running at test setup of all perf testsJan Gelety8-16/+16
Change-Id: I9af632035a1415666b2470c62a41d1b6acbf33c8 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2020-01-10Support suite tags in autogenVratko Polak8-0/+8
+ Include a script to add suite tags to many suites at once. + Add suite tags also to device tests (not covered by autogen). Change-Id: I514ee6178e22999b43460028fe2696738b012f04 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2020-01-10Autogen: Generate also NIC drivers.Vratko Polak1-1/+1
+ Disallowed -avf- (or -rdma-) as "template" suites. + GBP suite switched to DPDK driver in repo. + Each NIC has its own list of supported drivers, in Constants. + Updated tag expressions for daily jobs: + Feature, ipsec, memif, scale, srv6, tunnels, vhost and vts are tested only with vfio-pci. + Other (base, dot1q, dot1ad) tested with all drivers. + Setup actions currently depend on driver, generated. - The performance_rdma action is trivial for now. - Several tests fail, to be fixed later, e.g. by performance_rdma. + Reconf tests are also supported. + Added DRV_VFIO_PCI tags missing, mainly in density tests. - Vhost suites (density, reconf) are failing, but suites look good. - TCP suites do not support NIC drivers yet. - DPDK obviously not supported. + Use Python 3 in regenerate scripts. + Fix typos binded => bound. + File open modes set either u"rt" or u"wt" everywhere. + Remove a trailing space in an environment variable name. Change-Id: I290470675dc5c9e88b2eaa5ab6285ecd9ed7827a Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-11-28Python3: resources and librariesJan Gelety9-75/+75
Change-Id: I1392c06b1d64f62b141d24c0d42a8e36913b15e2 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-10-25Introduce pre-initialize driver layerPeter Mikus8-38/+56
+ This will help unify driver base differences between TCs. + Decrease amount of logic needed for suite generator. Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I1e84ba361dc1e829f0612c58a61096e2633ce0c5
2019-10-19Tests: Introduce driver layerPeter Mikus8-8/+24
+ Small bugfixes in various suites Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I051af0a6da7340fe3f617400370c3846ca5241ab
2019-06-25Align suite/test teardown/setupPeter Mikus8-48/+48
+ Phase II - aligning FUNC/PERF setup. + 2n/3n compatibility of suite setup. + Same structure of testcase for DEV/PERF. + DEVICE tests are now running VPP startup config in same way as PERF. + DEVICE is using COREKEEPER! - DEVICE tests are running topology compute twice for backward compatibility. TODO to remove. - Still phase III needed to align TAGS, LIBRARIES and remove OLD setup phase. Change-Id: Ib6e1b0ebf4abebf3cbe73b4fda5cac953c2a7270 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-06-21Align suite/test teardown/setupPeter Mikus8-16/+16
+ Phase I - aligning FUNC/PERF Change-Id: I46b1e43687ddb29f5ed3c6335fe1baf21ec02822 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-04-08Upgrade autogen to NICs and search typesVratko Polak33-3447/+195
+ All perf suites updated, as autogen change is backward incompatible. + Only x710 -ndrpdr suites remain in git repository. + Removed retry feature of run_tests. + Renamed topology_type and traffic_type to traffic_profile. + Renamed framesize to frame_size; nic_model to nic_name. + Reordered Variables table to start with nic_name and overhead. + Fixed wrong overhead value in some cbc-sha1 suites. + Fixed some suite tags. ++ Introduced tags to distinguish suites, such as IPSECINT. + Bound crypto hardware to NIC name. + Implemented NIC limit hiding. + Also search and teardown related arguments are now hidden. + Main measurement keywords updated to new arg handling. + Max rate related keywords moved to performance_limits.robot + Teardowns unified. + Generated tests are archived. ++ Generated directory is .gitignore-d. + Regenerator raises an exception on seeing non-compatible suite. ++ Relatively helpful message should be seen in exception. + Suite and template Documentation has generated parts. +- With short NIC names only. + Autogen checker also upgraded. + Tag expressions replaced with long files to ensure analogous tests. Change-Id: I60e9a999187e7da1f60d0eb4fb02afa14682aa46 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-04-05Fixes for Taishan testbedjuraj.linkes2-271/+0
* rename NICs in Taishan testbed to Intel-X520-DA2 * fix testbed NIC selection * remove unnecessary 82599es tests * blacklist unsupported tests on Taishan testbed * lowercase previously created bash local variables Change-Id: I3b7f59e2edc00929fab2f5a0fce483f236f83075 Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>
2019-03-06add vxlan perf test cases for Intel-X553 of Denverton platformYulong Pei2-0/+262
add below vxlan perf test cases for Intel-X553 of Denverton platform, 10ge2p1x553-ethip4vxlan-l2bdbasemaclrn-mrr.robot 10ge2p1x553-ethip4vxlan-l2bdbasemaclrn-ndrpdr.robot Change-Id: Ia0bbdd5d465bd1ac8d9930ac67099c63773a6cef Signed-off-by: Yulong Pei <yulong.pei@intel.com>
2019-03-01Add ARM Taishan testbed33 perftestStanislav Chlebec2-0/+271
Change-Id: Iaa0e7fbca7de26c7dce8b389cc3494f628a2ecd0 Signed-off-by: Stanislav Chlebec <stanislav.chlebec@pantheon.tech> Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>
2018-10-10Add VXLAN scale perf testsJan Gelety20-60/+2228
Jira: CSIT-1273 Change-Id: Ic2a41661c158384a5aaa7d4e73f30ffca13ddf82 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-07-20CSIT-1097: Migrate ip4_tun to NDRPDR and edit MRRVratko Polak19-2380/+1358
Change-Id: I20fe137cfbbcea1e337fe6295818ea105953d006 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-07-13Refactor perf test casesPeter Mikus10-808/+226
- Refactor Performance TCs due to changes in Hyperthreading and RXQ allocations. - Simplify the structure of suite to avoid large refactors in future. Change-Id: Ifb1b9719391f26745f075a900bd9fb39b6cb809c Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-07-11CSIT-1178: Prepare for bursty MRRVratko Polak6-6/+6
+ All suites and tests still refer to MRR instead of BMRR (or FRMOBL). + API change: Traffic should pass with maximum rate first argument got a default value, thus it needs to be moved towards the end of argument list. + Consequently, the value for it has been deleted from suites. + Test message is now compatible only with BMRR parsing. - Reporting of transmit rate is left as TODO. + Global test __init__ with new way of giving defaults to global variables. + The new keyword is put into robot_enhancements.robot resource. + Number of trials and trial duration are now configurable. - Bootstrap scripts have no support for overriding the defaults yet. Change-Id: I4b108cc9c256730e62c03fbacba0a1c314f8ae88 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-07-09CSIT-1142 Change thread perf test TAGsPeter Mikus10-288/+288
Due to automatization of SMT detection this change is suppose to remove static thread/core tags in favor of dynamic one. Leaving the static tags for number of physical cores to be able to select TCs. Change-Id: I7f99f605821f363e45c333f46d1dea786693521b Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-07-09CSIT-1142 2-node topology - keywordsPeter Mikus10-78/+78
- Clean up of 2-node setup KWs Change-Id: I59fc901fb57544eceb6a041b56b515cda8babf85 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-05-02Remove obsolete NDRPDR checksPeter Mikus7-1480/+0
Change-Id: If495493f4dce8d2eecfb8c06bcd587f315b70b1d Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-04-06CSIT-1020: MRR Day 2 - x710Jan Gelety3-0/+697
- CSIT-1029: x710 MRR tests - IP4 - ip4 -10ge2p1x710-ethip4-ip4base-copwhtlistbase-mrr.robot -10ge2p1x710-ethip4-ip4base-iacldstbase-mrr.robot -10ge2p1x710-ethip4-ip4base-ipolicemarkbase-mrr.robot -10ge2p1x710-ethip4-ip4base-mrr.robot -10ge2p1x710-ethip4-ip4scale200k-mrr.robot -10ge2p1x710-ethip4-ip4scale20k-mrr.robot -10ge2p1x710-ethip4-ip4scale2m-mrr.robot -10ge2p1x710-ethip4udp-ip4base-iacl1sf-10kflows-mrr.robot -10ge2p1x710-ethip4udp-ip4base-iacl1sl-10kflows-mrr.robot -10ge2p1x710-ethip4udp-ip4base-iacl50sf-10kflows-mrr.robot -10ge2p1x710-ethip4udp-ip4base-iacl50sl-10kflows-mrr.robot -10ge2p1x710-ethip4udp-ip4base-nat44-mrr.robot - 10ge2p1x710-ethip4udp-ip4scale1000-udpsrcscale15-nat44-mrr.robot - ip4_tunnels -10ge2p1x710-ethip4lispip4-ip4base-mrr.robot -10ge2p1x710-ethip4vxlan-l2bdbasemaclrn-mrr.robot - 10ge2p1x710-ethip4vxlan-l2xcbase-mrr.robot Change-Id: I141bbd8039f4a5993c77758b1c410dcbd203ab97 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-03-21CSIT-998: MRR testsJan Gelety3-0/+697
- CSIT-1001: MRR tests: IP4 - ip4 - 10ge2p1x520-ethip4-ip4base-copwhtlistbase-mrr.robot - 10ge2p1x520-ethip4-ip4base-iacldstbase-mrr.robot - 10ge2p1x520-ethip4-ip4base-ipolicemarkbase-mrr.robot - 10ge2p1x520-ethip4-ip4scale200k-mrr.robot - 10ge2p1x520-ethip4-ip4scale20k-mrr.robot - 10ge2p1x520-ethip4-ip4scale2m-mrr.robot - 10ge2p1x520-ethip4udp-ip4base-iacl1sf-10kflows-mrr.robot - 10ge2p1x520-ethip4udp-ip4base-iacl1sl-10kflows-mrr.robot - 10ge2p1x520-ethip4udp-ip4base-iacl50sf-10kflows-mrr.robot - 10ge2p1x520-ethip4udp-ip4base-iacl50sl-10kflows-mrr.robot - 10ge2p1x520-ethip4udp-ip4base-nat44-mrr.robot - 10ge2p1x520-ethip4udp-ip4scale1000-udpsrcscale15-nat44-mrr.robot - 40ge2p1xl710-ethip4-ip4base-mrr.robot - ip4_tunnels - 10ge2p1x520-ethip4vxlan-l2bdbasemaclrn-mrr.robot - 10ge2p1x520-ethip4vxlan-l2xcbase-mrr.robot - 10ge2p1x520-ethip4lispip4-ip4base-mrr.robot Change-Id: Ibfd03aea9b97d29a8fa05e2956f6df54603a2208 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-02-09Update the binary steps for perf test cases.Peter Mikus4-120/+120
- Reduce binary step fof: 64B -> 50Kpps 1518B -> 50Kpps 9000B -> 10Kpps IMIX -> 50Kpps Change-Id: Id88bff7b1c37b2a03583dd27ca3db720ec7ae4a2 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-06-29CSIT-687: Directory structure reorganizationTibor Frank11-0/+3590
Change-Id: I772c9e214be2461adf58124998d272e7d795220f Signed-off-by: Tibor Frank <tifrank@cisco.com> Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>