aboutsummaryrefslogtreecommitdiffstats
path: root/tests/vpp/perf/l2
AgeCommit message (Collapse)AuthorFilesLines
2019-06-21Align suite/test teardown/setupPeter Mikus68-136/+136
+ Phase I - aligning FUNC/PERF Change-Id: I46b1e43687ddb29f5ed3c6335fe1baf21ec02822 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-04-16Add 2n AVF testsPeter Mikus3-0/+350
- Side effect of other troubleshooting, but better to merge then throw away. Change-Id: Idc1a0ca66b35b61c1ffd11242cd7b7133ae4cbd7 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-04-08Upgrade autogen to NICs and search typesVratko Polak196-19370/+1977
+ All perf suites updated, as autogen change is backward incompatible. + Only x710 -ndrpdr suites remain in git repository. + Removed retry feature of run_tests. + Renamed topology_type and traffic_type to traffic_profile. + Renamed framesize to frame_size; nic_model to nic_name. + Reordered Variables table to start with nic_name and overhead. + Fixed wrong overhead value in some cbc-sha1 suites. + Fixed some suite tags. ++ Introduced tags to distinguish suites, such as IPSECINT. + Bound crypto hardware to NIC name. + Implemented NIC limit hiding. + Also search and teardown related arguments are now hidden. + Main measurement keywords updated to new arg handling. + Max rate related keywords moved to performance_limits.robot + Teardowns unified. + Generated tests are archived. ++ Generated directory is .gitignore-d. + Regenerator raises an exception on seeing non-compatible suite. ++ Relatively helpful message should be seen in exception. + Suite and template Documentation has generated parts. +- With short NIC names only. + Autogen checker also upgraded. + Tag expressions replaced with long files to ensure analogous tests. Change-Id: I60e9a999187e7da1f60d0eb4fb02afa14682aa46 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-04-05Fixes for Taishan testbedjuraj.linkes20-2744/+0
* rename NICs in Taishan testbed to Intel-X520-DA2 * fix testbed NIC selection * remove unnecessary 82599es tests * blacklist unsupported tests on Taishan testbed * lowercase previously created bash local variables Change-Id: I3b7f59e2edc00929fab2f5a0fce483f236f83075 Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>
2019-03-01Add ARM Taishan testbed33 perftestStanislav Chlebec20-0/+2744
Change-Id: Iaa0e7fbca7de26c7dce8b389cc3494f628a2ecd0 Signed-off-by: Stanislav Chlebec <stanislav.chlebec@pantheon.tech> Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>
2019-01-29PLRsearch: Initial implementation and suitesVratko Polak3-0/+219
Missing bits: - Add up-to-date .rst document (in child Change). - Prepare for releasing to PyPI.org (in child Change): -- Either copy dependencies from MLRsearch, or list in requirements. -- Perhaps move common dependencies to separate package for both search to depend on. -- All the other metadata stuff. Jira: CSIT-1276 Change-Id: I277efdb63dbb90b30e11f4e30a82e2130ac8efc3 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-12-11Add missing = to all suite VariablesVratko Polak32-58/+58
Use the following if we ever decide '} =' is better than '}='. $ cd csit/tests $ find . -type f -print0 | xargs -0 sed -i -E 's/^\| \$\{(.*)\}= \|([^|])/\| \$\{\1\} = \|\2/g' FIXME: Add a corresponding check to https://gerrit.fd.io/r/13450 Change-Id: I73c516a0d7e475ff0986fd6515aaae10accd1a3a Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-10-20update l2bdbasemaclrn-mrr and l2bdbasemaclrn-ndrpdr for x553 NICYulong Pei2-2/+2
update the test suites to call "Initialize L2 bridge domain in circular topology" since "Initialize L2 bridge domain in 2-node circular topology" was replaced by it. Change-Id: I6d5cb0868353228fbcf37b308ffa0b562649c57a Signed-off-by: Yulong Pei <yulong.pei@intel.com>
2018-10-12Tag l2bdscale as L2BDSCALE, not L2BDBASEVratko Polak24-24/+24
Change-Id: I0d2d2f16f7e0b710f432711d7e0eccf70fcfcc8f Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-10-02CSIT-1325 - FIX: AVF tests failing on unbindPeter Mikus4-4/+4
Currently there is and issue when consecutive AVF suites are trying to initialize AVF and bind VF to vfio-pci driver, there seems to be race condition if VPP has already VFs allocated. This patch should introduce safer contstrain to disable VPP prior AVF init. Change-Id: Id8839200f19d9e7a18d161b660cfb1e43a8ca379 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-09-21Fix autogen regenerator and few suitesVratko Polak12-200/+152
+ "elif" instead of "else if". + Some suites had test cases reordered. + Some suites contained 9000B cases for avf. Change-Id: I3bf8241c317f20dbf66b497a2c8be35ef71307f5 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-09-20FIX: 40Ge2P1Vic1385-Eth-L2Bdbasemaclrn-Mrr typoPeter Mikus1-1/+1
- Per trending. Change-Id: I1e24b20bc774dae91df6fb81e3a9132ff79e3beb Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-09-20CSIT-1205 Create AVF driver test - Add Tests L2BD L2XCPeter Mikus8-0/+969
Change-Id: Ia74a87346fe2c0a170b881b510f1b0558a538f3c Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-09-20Create basic 2-node topology performance tests for Intel-X553 NICYulong Pei6-0/+770
Intel-X553 is Denverton (Intel Atom cpu based SOC) integrated NIC, add below basic 2-node topology performance test suites for it, the test suites were changed from the existing Intel-x710 test suites, - eth-l2patch-mrr - eth-l2patch-ndrpdr - eth-l2xcbase-mrr - eth-l2xcbase-ndrpdr - eth-l2bdbasemaclrn-mrr - eth-l2bdbasemaclrn-ndrpdr - ethip4-ip4base-mrr - ethip4-ip4base-ndrpdr - ethip6-ip6base-mrr - ethip6-ip6base-ndrpdr Change-Id: Ib6d3655a6e14ae275c197fd7b39d59e17a233326 Signed-off-by: Yulong Pei <yulong.pei@intel.com>
2018-09-17Add dot1q-l2[bd|xc]base-[ndrpdr|mrr] perf tests for 2-node topologyJan Gelety16-128/+1231
Jira: CSIT-1284 Change-Id: I8ce4ffc76adf55bf9a8423077b8639601c560c87 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-09-14Add dot1q-ip4base-[ndrpdr|mrr] perf tests for 2-node topologyJan Gelety6-13/+14
Jira: CSIT-1278 Change-Id: I3cc929222d7fd58f38e33917e84675e9c0b55bbd Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-09-10Create l2bdscale tests for 2-node topologyJan Gelety38-397/+1983
Jira: CSIT-1268 Change-Id: I13bf2e570a7d7231ba19c2c41db2b44c0b8d215a Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-09-06Fix autogen violationsVratko Polak4-76/+124
Four AVF suites had test cases in different order. Change-Id: I12fbe3508016a79a2153cc004c654a21ee4279bf Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-09-05CSIT-1205 Create AVF driver testPeter Mikus4-0/+482
- Add L1 KWs for SR-IOV handling (init Vfs, remove Vfs, ...) - Cleanup L1 KWs for SR-IOV bind/unbind/pci_get/... - Add L2 KWs for Test Setup/Teardown, L2patch, Create AVF interface - Add sample L2patch test fox x710, xxv710 Change-Id: If17077877455a14043617d8ea0d06cbe47b469e3 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-07-27FIX: Interface up handlingPeter Mikus8-16/+0
- Increase timeout when trying to check interface (this is useful if there are multiple interfaces and dump command take more than TIMEOUT/NR_IF which is happening quite often). - Reverse the order of applying MTU and interface UP to try to prevent API overload during interface initialization phase. Change-Id: I4e8623963d15b3c0d202172b4c58c43a972bb9cb Signed-off-by: Peter Mikus <pmikus@cisco.com> (cherry picked from commit 584345da4f7330f7517e5defd894b4995c2b57b0)
2018-07-25Add MTU handling into perf testsPeter Mikus6-6/+4
- Add ability to configure MTU on interfaces. Put the MTU into configuration keywors for all perf testcases. Change-Id: I364b4bc26b26f2f66f350949c0aaa2a2aa675682 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-07-24CSIT-1097: Migrate L2 to NDRPDR and edit MRRVratko Polak168-7320/+13484
Change-Id: I738d1794f795e1225bc9709ea2ed2cf9b06d1cf4 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-07-18CSIT-1201 Create L2patch perf testsPeter Mikus10-0/+1298
- XL710, XXV710, X710 - 2n, 3n - all pkt.size groups - ndrpdr, mrr Change-Id: Ibb36d734cd70a0a4d07e3d177fa2477bf9bfaacd Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-07-16Add L2xc/L2bd/Ip4/Ip6 2-node tests for x710Peter Mikus8-0/+1056
- CSIT-1161 Add 2-node L2XC tests - CSIT-1160 Add 2-node L2BD tests - CSIT-1157 Add 2-node IP4 tests - CSIT-1153 Add 2-node IP6 KW - CSIT-1158 Add 2-node IP6 tests Change-Id: I7c8fed7018bb355c0de73f6a8bc3a8ec80366972 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-07-13Refactor perf test casesPeter Mikus82-6374/+1484
- Refactor Performance TCs due to changes in Hyperthreading and RXQ allocations. - Simplify the structure of suite to avoid large refactors in future. Change-Id: Ifb1b9719391f26745f075a900bd9fb39b6cb809c Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-07-11CSIT-1178: Prepare for bursty MRRVratko Polak24-24/+24
+ All suites and tests still refer to MRR instead of BMRR (or FRMOBL). + API change: Traffic should pass with maximum rate first argument got a default value, thus it needs to be moved towards the end of argument list. + Consequently, the value for it has been deleted from suites. + Test message is now compatible only with BMRR parsing. - Reporting of transmit rate is left as TODO. + Global test __init__ with new way of giving defaults to global variables. + The new keyword is put into robot_enhancements.robot resource. + Number of trials and trial duration are now configurable. - Bootstrap scripts have no support for overriding the defaults yet. Change-Id: I4b108cc9c256730e62c03fbacba0a1c314f8ae88 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-07-09CSIT-1142 Change thread perf test TAGsPeter Mikus82-1533/+1533
Due to automatization of SMT detection this change is suppose to remove static thread/core tags in favor of dynamic one. Leaving the static tags for number of physical cores to be able to select TCs. Change-Id: I7f99f605821f363e45c333f46d1dea786693521b Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-07-09CSIT-1142 2-node topology - keywordsPeter Mikus82-155/+155
- Clean up of 2-node setup KWs Change-Id: I59fc901fb57544eceb6a041b56b515cda8babf85 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-05-09Report: Fix grepsTibor Frank1-1/+1
Change-Id: I450d5e9fa1cbd4a40caec68f3fc4674f744f1168 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-05-02Remove obsolete NDRPDR checksPeter Mikus6-1297/+0
Change-Id: If495493f4dce8d2eecfb8c06bcd587f315b70b1d Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-04-27FIX: tc12-IMIX-4t4c-eth-l2bdbasemaclrn-mrrJan Gelety1-1/+1
Change-Id: I193411e97f069982fca8408e5e5a42cd577586ed Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-04-06CSIT-1033: MRR Tests: L2, x710Tibor Frank11-2/+2307
─ 10ge2p1x710-dot1q-l2bdbasemaclrn-mrr.robot ─ 10ge2p1x710-dot1q-l2xcbase-mrr.robot ─ 10ge2p1x710-eth-l2bdbasemaclrn-iacl1sf-10kflows-mrr.robot ─ 10ge2p1x710-eth-l2bdbasemaclrn-iacl1sl-10kflows-mrr.robot ─ 10ge2p1x710-eth-l2bdbasemaclrn-iacl50sf-10kflows-mrr.robot ─ 10ge2p1x710-eth-l2bdbasemaclrn-iacl50sl-10kflows-mrr.robot ─ 10ge2p1x710-eth-l2bdscale100kmaclrn-mrr.robot ─ 10ge2p1x710-eth-l2bdscale10kmaclrn-mrr.robot ─ 10ge2p1x710-eth-l2bdscale1mmaclrn-mrr.robot ─ 10ge2p1x710-eth-l2xcbase-mrr.robot Change-Id: Ic5d5cb377eca25daaeb22e8390632a6d6421c2e3 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-04-03PAL Trending: download input filesTibor Frank1-12/+12
Change-Id: I407e3cdeb25547d46fafed702ee608f6c0e03091 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-03-19CSIT-998: MRR testsTibor Frank14-14/+2862
- CSIT-999: MRR tests: L2 - 10ge2p1x520-eth-l2xcbase-mrr.robot - 10ge2p1x520-eth-l2bdbasemaclrn-mrr.robot - 10ge2p1x520-dot1q-l2bdbasemaclrn-mrr.robot - 10ge2p1x520-dot1q-l2xcbase-mrr.robot - 10ge2p1x520-eth-l2bdbasemaclrn-iacl1sf-10kflows-mrr.robot - 10ge2p1x520-eth-l2bdbasemaclrn-iacl1sl-10kflows-mrr.robot - 10ge2p1x520-eth-l2bdbasemaclrn-iacl50sf-10kflows-mrr.robot - 10ge2p1x520-eth-l2bdbasemaclrn-iacl50sl-10kflows-mrr.robot - 10ge2p1x520-eth-l2bdscale100kmaclrn-mrr.robot - 10ge2p1x520-eth-l2bdscale10kmaclrn-mrr.robot - 10ge2p1x520-eth-l2bdscale1mmaclrn-mrr.robot - 10ge2p1x710-eth-l2bdbasemaclrn-ndrpdrdisc.robot - 40ge2p1xl710-eth-l2bdbasemaclrn-mrr.robot - 40ge2p1xl710-eth-l2xcbase-mrr.robot - CSIT-1000: MRR tests: IPv6 ─ 10ge2p1x520-ethip6-ip6base-copwhtlistbase-mrr.robot - 10ge2p1x520-ethip6-ip6base-iacldstbase-mrr.robot ─ 10ge2p1x520-ethip6-ip6scale200k-mrr.robot ─ 10ge2p1x520-ethip6-ip6scale20k-mrr.robot ─ 10ge2p1x520-ethip6-ip6scale2m-mrr.robot ─ 40ge2p1xl710-ethip6-ip6base-mrr.robot Change-Id: Ie42b08151b5da3ba32b972af8b6bedf313c6d29c Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-02-23Raw results chk keywords and initial TCPeter Mikus2-0/+343
- Implementation of Display raw results - Implementation of Traffic should pass with maximum rate - Code optimizations - L2BD, L2XC, IP4, IP6 TC Change-Id: I0b50e995a853ed3c8f88323ccc650e47b8ed2496 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-02-15FIX: 10ge2p1x520-eth-l2bdscale100kmaclrn-ndrpdrdisc.robotJan Gelety1-1/+1
- tc17-9000B-4t4c-eth-l2bdscale100kmaclrn-ndrdisc Change-Id: I605f4903deb07f3a29944348cb32ac0a6747cb09 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-02-12FIX: Missing KW in suite setupPeter Mikus44-0/+44
Change-Id: I278cb8a5381735694bad73031e534b080414305b Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-02-09Disable all plugins except DPDK by defaultJan Gelety45-90/+136
- enable corresponding plugin for ACL, NAT, MEMIF tests Change-Id: Ie8bfdcbf1734283b6412ef3015215a00ce3ebdf6 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-02-09Update the binary steps for perf test cases.Peter Mikus58-915/+870
- Reduce binary step fof: 64B -> 50Kpps 1518B -> 50Kpps 9000B -> 10Kpps IMIX -> 50Kpps Change-Id: Id88bff7b1c37b2a03583dd27ca3db720ec7ae4a2 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-01-15FIX: Naming of test casesPeter Mikus2-2/+3
- Fix naming of VM testcases Change-Id: I1bf78f5f4ee60dd061a63280624ada9d73b34518 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-01-08Update NDRCHK and PDRCHK ratesPeter Mikus6-13/+13
Change-Id: Ia51d29704d35e2c9f93dcbd1bccc355c9cf64419 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-10-20Rename all container based test following name conventionsPeter Mikus3-695/+0
Change-Id: I84f6da2bede47e7ae35e6b4911d425d2402dbd1b Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-10-11CSIT-778: Add mac-ip binding acl l2bd perf testJan Gelety9-0/+1593
Change-Id: Iaced68458b0e4070f861be7854ee428ae8ca4e13 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-10-09CSIT-768: Refactor Python container librariesPeter Mikus3-31/+261
CSIT-769: Implement L2 RF keywords for container orchestration Change-Id: I7637d1ecc3a45111522b8d6c578b3f88369aff6b Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-09-22CSIT-796: l2bd-memif perf testsJan Gelety1-0/+233
Change-Id: Ic714fa7baec49dcba1a8eb6a578183c6771e3493 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-09-04CSIT-786 L2FIB scale testingPeter Mikus4-76/+862
L2FIB scale testing for 10k, 100k, 1m FIB entries ./l2: 10ge2p1x520-eth-l2bdscale10kmaclrn-ndrpdrdisc.robot 10ge2p1x520-eth-l2bdscale100kmaclrn-ndrpdrdisc.robot 10ge2p1x520-eth-l2bdscale1mmaclrn-ndrpdrdisc.robot 10ge2p1x520-eth-l2bdscale10kmaclrn-eth-2vhostvr1024-1vm-cfsrr1-ndrpdrdisc 10ge2p1x520-eth-l2bdscale100kmaclrn-eth-2vhostvr1024-1vm-cfsrr1-ndrpdrdisc 10ge2p1x520-eth-l2bdscale1mmaclrn-eth-2vhostvr1024-1vm-cfsrr1-ndrpdrdisc Change-Id: I7e3884bd5ab5294c289030a3465ec5b6def83cf7 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-08-09CSIT-767: Add acl 64B 4t4c perf testsJan Gelety36-0/+864
Change-Id: Id1b187c195c955d0e533d8d6864fff6a3fa8332e Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-08-07Use 100kpps step for ACL 64B perf testsJan Gelety36-288/+288
ACL 64B tests take a long time. Usage of 100kpps will provide results with adequate accurancy and test exectuion time. Change-Id: I6818963f3ce16b9aaae72cf579294f87d10a24a9 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-08-01CSIT-699: Add l2bd+dot1q perf testsJan Gelety1-0/+316
Change-Id: I3d8cbb235918331b3c60147f7870a4aa90036748 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-07-24FIX: add missing PDRDISC tagJan Gelety4-8/+8
Change-Id: Ide3963cb7d776d94f512009b9f34c6b4b6554253 Signed-off-by: Jan Gelety <jgelety@cisco.com>