aboutsummaryrefslogtreecommitdiffstats
path: root/tests/vpp/perf
AgeCommit message (Collapse)AuthorFilesLines
2018-07-18CSIT-1097: Crypto NDRPDR and missing MRR suitesVratko Polak34-3613/+2873
Change-Id: If40f9283ee889f85e85fad74a490252e812bbe02 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-07-18CSIT-1097: Ip6 NDRPDR and edited MRR suitesVratko Polak38-3775/+2413
Change-Id: I912017c6d1eab5530eecb2326887ffd057916ee8 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-07-18CSIT-1201 Create L2patch perf testsPeter Mikus10-0/+1298
- XL710, XXV710, X710 - 2n, 3n - all pkt.size groups - ndrpdr, mrr Change-Id: Ibb36d734cd70a0a4d07e3d177fa2477bf9bfaacd Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-07-17CSIT-1186: Add MRR and NDRPDR ip6_tunnels testsVratko Polak7-1192/+566
Remove the corresponding NDRPDRdisc tests. Change-Id: Ib46f53e97f703db19bcbcb82c3db0a7f5bb61dbf Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-07-17CSIT-1186: Add srv6 NDRPDR suitesVratko Polak13-620/+616
Delete the corresponding ndrpdrdisc suites. MRR suites are also edited, to make them less different from NDRPDR suites. Now, there is a script to re-generate testcases of selected suites. For that, resources/libraries/python/autogen is created, with Regenerator holding the most of script logic. The script looks at files matching a glob expression, reuses a "prolog", but overwites test cases with the default template and hardcoded set of testcase arguments. Also, handling of overhead size has been simplified, using new keyword Get Max Rate And Jumbo And Handle Multi Seg. Default value for search timeout is increased to 12 minutes to make timeout failures less frequent. Change-Id: I394ad61f262b3078e5ca719034b15ada48987ee0 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-07-16Add L2xc/L2bd/Ip4/Ip6 2-node tests for x710Peter Mikus16-0/+2107
- CSIT-1161 Add 2-node L2XC tests - CSIT-1160 Add 2-node L2BD tests - CSIT-1157 Add 2-node IP4 tests - CSIT-1153 Add 2-node IP6 KW - CSIT-1158 Add 2-node IP6 tests Change-Id: I7c8fed7018bb355c0de73f6a8bc3a8ec80366972 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-07-16FIX: VTS suitePeter Mikus1-24/+24
Change-Id: I1766ac51ac34b63feab80329c1ae2c62fc6d8496 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-07-13Refactor perf test casesPeter Mikus310-29595/+6628
- Refactor Performance TCs due to changes in Hyperthreading and RXQ allocations. - Simplify the structure of suite to avoid large refactors in future. Change-Id: Ifb1b9719391f26745f075a900bd9fb39b6cb809c Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-07-11CSIT-1178: Prepare for bursty MRRVratko Polak127-129/+127
+ All suites and tests still refer to MRR instead of BMRR (or FRMOBL). + API change: Traffic should pass with maximum rate first argument got a default value, thus it needs to be moved towards the end of argument list. + Consequently, the value for it has been deleted from suites. + Test message is now compatible only with BMRR parsing. - Reporting of transmit rate is left as TODO. + Global test __init__ with new way of giving defaults to global variables. + The new keyword is put into robot_enhancements.robot resource. + Number of trials and trial duration are now configurable. - Bootstrap scripts have no support for overriding the defaults yet. Change-Id: I4b108cc9c256730e62c03fbacba0a1c314f8ae88 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-07-10Remove THIS tag and use unix endlinesVratko Polak4-1160/+1160
The THIS tag has sneaked in 10Ge2P1X520-Eth-L2Xcbase-Eth-1Memif-1Dcr-Mrr but usually it is only to be used in draft testing. Not sure about the way non-unix endlines crept in. Is not git supposed to perform endline conversions on text files? Or are .robot, .rst, .yaml and .vat not recognized as text? Change-Id: Ia78cf942c05c3029c340a8639782786f37e57469 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-07-09CSIT-1142 Change thread perf test TAGsPeter Mikus310-7221/+7221
Due to automatization of SMT detection this change is suppose to remove static thread/core tags in favor of dynamic one. Leaving the static tags for number of physical cores to be able to select TCs. Change-Id: I7f99f605821f363e45c333f46d1dea786693521b Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-07-09CSIT-1142 2-node topology - keywordsPeter Mikus307-842/+842
- Clean up of 2-node setup KWs Change-Id: I59fc901fb57544eceb6a041b56b515cda8babf85 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-07-03VTS VXLAN vhost-user with single DUT, TG sends VXLANPeter Ginchev1-0/+329
Change-Id: I63539af2cdbdbd02a67068e48d0fdf2743da3b1e Signed-off-by: Peter Ginchev <pginchev@cisco.com>
2018-07-03CSIT-1046 Make uio driver configurable from topofilesPeter Mikus1-3/+1
Currently we are configuring uio_driver from global variable. This may not be suitable for various topologies where we need different driver per TB. This patch is suppose to put uio_driver into topology files. Change-Id: I56af0697e8b2359ccb126151217976408720c1ba Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-07-02Compatibility fixes with Ubuntu 18.04Peter Mikus1-1/+3
Currently we are using ip:port socket to for VPP to listen for incoming connections. There is only one place in code this socket is used for detection if VPP is responding after restart. This patch is supposed to change ip:port to sock:file which is default preffered way in VPP. This way we can start using vppctl. netcat on the other side with ip:port remains hanged in console for infinite time not returning back. There is also need to check whether uio_module is loaded and eventually load it. As uio_pci_generic is not working there, we will fallback to main igb_uio (uio_pci_generic being only lightweight subset of igb_uio). This patch also add additional verbose output to console during setup to better understand if failure happens during copy/extract/setup. Change-Id: I0b8a3b76dce3316496a3ad928f58718b6e73057d Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-06-29SetupFramework to detect failures, part IIPeter Mikus1-0/+2
- This patch is enforcing evaluation and aligning all __init__.robot files to use the same logic. Change-Id: I9e2bf5e904bb6d22f4e6a153c951c3b3c233e2fb Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-06-15CSIT-1085 eth-l2xcbase-eth-1memif-1dcrPeter Mikus4-0/+1160
Test case definitions Change-Id: I03736ef003d3839859dc450745323362b21aa75e Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-06-13FIX: TAG processingPeter Mikus2-2/+2
- Improve TAG post processing Change-Id: I5a36f5874ea747cbcae2562fc58c9f5abe9bac02 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-06-08CSIT-1081 Container VPP configuration refactorPeter Mikus17-0/+17
Adopt code for various topology configurations. Change-Id: Iaf9d7995ab8cd06da0c56c5e5664d57d19e74d7c Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-06-01VPP link bonding - lacp modeJan Gelety8-0/+2774
CSIT-1072 CSIT-1083 CSIT-1084 Change-Id: Icaf0e09af633d301306a84251f47822e95b411a2 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-05-31DPDK link bonding: xor modeJan Gelety8-0/+2760
CSIT-1073 CSIT-1074 CSIT-1077 Change-Id: I248e079021c30988210fd792b32d5afdca71aadb Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-05-23CSIT-1087: Add SRv6 MRR testsTibor Frank12-16/+1535
Change-Id: Ia90a9bff6791518ba08fa81e6167e96aea7714d5 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-05-14CSIT-1036 Expose option to install DKMS in containerPeter Mikus14-0/+14
Expose DKMS installation as suite variable. This will allow to use DPDK driver for future tests. Change-Id: I38fd014c8cf6f4bf42881af2196cadc679fe53e0 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-05-09Report: Fix grepsTibor Frank1-1/+1
Change-Id: I450d5e9fa1cbd4a40caec68f3fc4674f744f1168 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-05-04CSIT-992: Add two suites using optimized searchVratko Polak2-0/+314
+ Add 10ge2p1x520-ethip4-ip4base-ndrpdr.robot + Add 10ge2p1x520-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-ndrpdr.robot + Make sure both IMIX and 9000B test cases are there. + Document NDRPDR test tag. + Execute some of NDRPDR tests daily. Change-Id: I66427d49cb6b8304fde4e8d91606de33b624186a Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-05-04FIX: TCP perf testsTibor Frank1-2/+2
Change-Id: I59ad8ef70fc2bedce14b52359922a002f960ab7a Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-05-02FIX: Docker container imagePeter Mikus3-3/+3
Change-Id: I127fe11b9095fb24a536dce7d6c26c7e7fd4be4e Signed-off-by: Peter Mikus <pmikus@cisco.com> (cherry picked from commit 64da7d69dfe8d8f89656dc3dba56b0eaef059020)
2018-05-02Remove obsolete NDRPDR checksPeter Mikus38-7886/+0
Change-Id: If495493f4dce8d2eecfb8c06bcd587f315b70b1d Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-04-27FIX: Add api-segment conf to TCP testsTibor Frank1-1/+3
Change-Id: Idf778d8427c8dabf716090cdaeba189e8cccfb98 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-04-27FIX: tc12-IMIX-4t4c-eth-l2bdbasemaclrn-mrrJan Gelety1-1/+1
Change-Id: I193411e97f069982fca8408e5e5a42cd577586ed Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-04-24FIX: TCP perf testsTibor Frank1-1/+1
Change-Id: I6424722641b0cefdf1945b57996bf2c48dc86a3b Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-04-23CSIT-1009: SRv6 proxy testsJan Gelety3-0/+828
- SRv6 with endpoint to SR-unaware Service Function via static proxy - SRv6 with endpoint to SR-unaware Service Function via dynamic proxy - SRv6 with endpoint to SR-unaware Service Function via masquerading proxy Change-Id: I6a6062cb41d810bf9e27dacfd866181bfde4c693 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-04-20FIX: Restart VPP in container before each testPeter Mikus11-11/+33
Change-Id: Iec7045aadc0675e04b8c74cbe28f8b3f193bcf1f Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-04-20FIX: Configure number of memif queus properlyPeter Mikus11-22/+22
Change-Id: I2dcb0300829bc961c80cc30d972d0563aeba9364 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-04-16Make default driver configurablePeter Mikus1-0/+2
- Make UIO driver configurable from global variables. - Prepare code for uio_pci_generic to vfio-pci change Change-Id: I2b49201177a92f51673242a30e2fd8d4f7e59694 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-04-11CSIT-1040: Static content improvementsTibor Frank2-24/+24
Change-Id: I8c9290cc93496794f30275ee23cc013146be94fd Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-04-11Cleanup perf bootstrapPeter Mikus1-1/+3
- Remove the DPDK_TEST variable and replace it by internal global variable - Unify all perf boostrap for merge in future. - Cleanup ligato perf bootstrap. Change-Id: Id47d6614c8dd18a701493e00056ef17d2e37fc5c Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-04-10FIX: Crypto execution orderPeter Mikus18-0/+67
Currently, VAT history looks like this: sw_interface_set_flags sw_if_index 2 admin-up sw_interface_set_flags sw_if_index 1 admin-up sw_interface_dump sw_interface_set_flags sw_if_index 2 admin-up sw_interface_set_flags sw_if_index 1 admin-up sw_interface_add_del_address sw_if_index 2 192.168.10.1/24 sw_interface_add_del_address sw_if_index 1 172.168.1.1/24 ip_neighbor_add_del sw_if_index 2 dst 192.168.10.2 mac 68:05:ca:3a:af:40 ip_neighbor_add_del sw_if_index 1 dst 172.168.1.2 mac 68:05:ca:35:78:e9 ip_add_del_route 10.0.0.0/8 via 192.168.10.2 sw_if_index 2 resolve-attempts 10 count 1 exec exec /tmp/ipsec_create_tunnel_dut1.config It should be like this: sw_interface_add_del_address sw_if_index 2 192.168.10.1/24 sw_interface_add_del_address sw_if_index 1 172.168.1.1/24 ip_neighbor_add_del sw_if_index 2 dst 192.168.10.2 mac 68:05:ca:3a:af:40 ip_neighbor_add_del sw_if_index 1 dst 172.168.1.2 mac 68:05:ca:35:78:e9 ip_add_del_route 10.0.0.0/8 via 192.168.10.2 sw_if_index 2 resolve-attempts 10 count 1 exec exec /tmp/ipsec_create_tunnel_dut1.config sw_interface_set_flags sw_if_index 2 admin-up sw_interface_set_flags sw_if_index 1 admin-up Change-Id: I4e943436dee00166966b4f53d9d0a40440bbf1e4 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-04-06FIX: Remove Niantic from x710 and xl710Tibor Frank1-1/+1
Change-Id: I3e41f30534870c2e4084f7fa81d5a757f08377ea Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-04-06FIX: Jumbo frames are not receivedTibor Frank2-2/+2
- 10ge2p1x710-ethip4-ip4base-eth-2vhostvr256-1vm-mrr.robot - 10ge2p1x710-ethip4-ip4base-eth-2vhostvr256-1vm-mrr.robot Change-Id: I69f6fcb7c7cae46a8061fd75db9be2933154c3f9 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-04-06CSIT-1032: MRR Tests: IPv6, x710Tibor Frank6-0/+1350
─ 10ge2p1x710-ethip6-ip6base-copwhtlistbase-mrr.robot ─ 10ge2p1x710-ethip6-ip6base-iacldstbase-mrr.robot ─ 10ge2p1x710-ethip6-ip6base-mrr.robot ─ 10ge2p1x710-ethip6-ip6scale200k-mrr.robot ─ 10ge2p1x710-ethip6-ip6scale20k-mrr.robot ─ 10ge2p1x710-ethip6-ip6scale2m-mrr.robot Change-Id: I270c1e52e61fd9765f139983d133432a3058c722 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-04-06CSIT-1035: MRR Tests: container_memif, x710Tibor Frank3-0/+668
─ 10ge2p1x710-eth-l2bdbasemaclrn-eth-2memif-1lxc-mrr.robot ─ 10ge2p1x710-eth-l2xcbase-eth-2memif-1dcr-mrr.robot ─ 10ge2p1x710-eth-l2xcbase-eth-2memif-1lxc-mrr.robot Change-Id: I1ad44fc2a7f27edb060953cb301fda4abcffe52b Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-04-06CSIT-1033: MRR Tests: L2, x710Tibor Frank11-2/+2307
─ 10ge2p1x710-dot1q-l2bdbasemaclrn-mrr.robot ─ 10ge2p1x710-dot1q-l2xcbase-mrr.robot ─ 10ge2p1x710-eth-l2bdbasemaclrn-iacl1sf-10kflows-mrr.robot ─ 10ge2p1x710-eth-l2bdbasemaclrn-iacl1sl-10kflows-mrr.robot ─ 10ge2p1x710-eth-l2bdbasemaclrn-iacl50sf-10kflows-mrr.robot ─ 10ge2p1x710-eth-l2bdbasemaclrn-iacl50sl-10kflows-mrr.robot ─ 10ge2p1x710-eth-l2bdscale100kmaclrn-mrr.robot ─ 10ge2p1x710-eth-l2bdscale10kmaclrn-mrr.robot ─ 10ge2p1x710-eth-l2bdscale1mmaclrn-mrr.robot ─ 10ge2p1x710-eth-l2xcbase-mrr.robot Change-Id: Ic5d5cb377eca25daaeb22e8390632a6d6421c2e3 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-04-06CSIT-1030: Add x710 MRR tests - vm_vhostVratko Polak11-0/+2721
+ 10ge2p1x710-dot1q-l2bdbasemaclrn-eth-2vhostvr1024-1vm-mrr.robot + 10ge2p1x710-dot1q-l2xcbase-eth-2vhostvr1024-1vm-mrr.robot + 10ge2p1x710-eth-l2bdbasemaclrn-eth-2vhostvr256-1vm-mrr.robot + 10ge2p1x710-eth-l2bdbasemaclrn-eth-4vhostvr1024-2vm-mrr.robot + 10ge2p1x710-eth-l2xcbase-eth-2vhostvr1024-1vm-mrr.robot + 10ge2p1x710-eth-l2xcbase-eth-2vhostvr256-1vm-mrr.robot + 10ge2p1x710-eth-l2xcbase-eth-4vhostvr1024-2vm-mrr.robot + 10ge2p1x710-ethip4-ip4base-eth-2vhostvr1024-1vm-mrr.robot + 10ge2p1x710-ethip4-ip4base-eth-2vhostvr256-1vm-mrr.robot + 10ge2p1x710-ethip4-ip4base-eth-4vhostvr1024-2vm-mrr.robot + 10ge2p1x710-ethip4vxlan-l2bdbasemaclrn-eth-2vhostvr1024-1vm-mrr.robot Copies of the respective x520 files, with each "X520-DA2" or "X520" replaced by "X710". Occurences of "Niantic" were removed. Change-Id: I15bce75b704072b26a908f868e90a42dc3ea7661 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-04-06CSIT-1020: MRR Day 2 - x710Jan Gelety17-1/+3745
- CSIT-1029: x710 MRR tests - IP4 - ip4 -10ge2p1x710-ethip4-ip4base-copwhtlistbase-mrr.robot -10ge2p1x710-ethip4-ip4base-iacldstbase-mrr.robot -10ge2p1x710-ethip4-ip4base-ipolicemarkbase-mrr.robot -10ge2p1x710-ethip4-ip4base-mrr.robot -10ge2p1x710-ethip4-ip4scale200k-mrr.robot -10ge2p1x710-ethip4-ip4scale20k-mrr.robot -10ge2p1x710-ethip4-ip4scale2m-mrr.robot -10ge2p1x710-ethip4udp-ip4base-iacl1sf-10kflows-mrr.robot -10ge2p1x710-ethip4udp-ip4base-iacl1sl-10kflows-mrr.robot -10ge2p1x710-ethip4udp-ip4base-iacl50sf-10kflows-mrr.robot -10ge2p1x710-ethip4udp-ip4base-iacl50sl-10kflows-mrr.robot -10ge2p1x710-ethip4udp-ip4base-nat44-mrr.robot - 10ge2p1x710-ethip4udp-ip4scale1000-udpsrcscale15-nat44-mrr.robot - ip4_tunnels -10ge2p1x710-ethip4lispip4-ip4base-mrr.robot -10ge2p1x710-ethip4vxlan-l2bdbasemaclrn-mrr.robot - 10ge2p1x710-ethip4vxlan-l2xcbase-mrr.robot Change-Id: I141bbd8039f4a5993c77758b1c410dcbd203ab97 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-04-06CSIT-1008: Fix 9000B VM Vhost performance testsTibor Frank6-2213/+803
Change-Id: I63105e8a4f11d740c38fc6123984005bcefa117b Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-04-05Revert "FIX: Change plugin default behavior for Container tests"Peter Mikus1-1/+1
This reverts commit c754789176b1a3ca00a129d3d207aa5a6bad7c27. Change-Id: Ic1bbe8fac0d98f41aa8b1b57da0c7a147111340b Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-04-05FIX: Change plugin default behavior for Container testsPeter Mikus1-1/+1
Looks like disabling all plugins in container leaving only memif_plugin.so results into issue that could lead into lost of SSH connectivity to TB or in better case to not handling any traffic. This fix is supose to return previous behavior for Container instance of VPP. Change-Id: Ie8b3ce2e35a40c8f3498e490abb6967cd4dd912a Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-04-03PAL Trending: download input filesTibor Frank1-12/+12
Change-Id: I407e3cdeb25547d46fafed702ee608f6c0e03091 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-03-30Change the default plugin behavior in perf testsPeter Mikus1-24/+2
Currently we are selectively disabling plugins by creating list of disabled plugins for performance tests. Thanks to the new API in VPP we can revert the logic to selectivly enable plugins. This is more stable for future onboarding of new plugins into VPP. Change-Id: Ibdd56d6097230d095a304bbb6984b565d9428f51 Signed-off-by: Peter Mikus <pmikus@cisco.com>