aboutsummaryrefslogtreecommitdiffstats
path: root/resources/libraries/robot/performance.robot
AgeCommit message (Collapse)AuthorFilesLines
2017-06-08CSIT-662: KWI - KW renamingTibor Frank1-239/+241
- plus: CSIT-656: Script to rename robot keywords. Change-Id: Ia69917e406a1b346b80e5ea742f6200c1c9e9d21 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-06-05CSIT-614: PDRCHK test for vpp-csit-verify-hw-perf jobTibor Frank1-0/+7
Create PDRCHK test: a. vpp-verify-perf-l2 i. 10Ge2P1X520-Eth-L2Bdbasemaclrn-pdrchk ii. 10Ge2P1X520-Eth-L2Xcbase-pdrchk b. vpp-verify-perf-ip4 i. 10Ge2P1X520-Ethip4-Ip4Base-pdrchk c. vpp-verify-perf-ip6 i. 10Ge2P1X520-Ethip6-Ip6Base-pdrchk ii. 10Ge2P1X520-Ethip6-Ip6Scale2M-pdrchk d. vpp-verify-perf-lisp i. 10Ge2P1X520-Ethip4Lispip4-Ip4Base-pdrchk ii. 10Ge2P1X520-Ethip4Lispip6-Ip4Base-pdrchk iii. 10Ge2P1X520-Ethip6Lispip4-Ip6Base-pdrchk iv. 10Ge2P1X520-Ethip6Lispip6-Ip6Base-pdrchk e. vpp-verify-perf-vxlan i. 10ge2p1x520-ethip4vxlan-l2xcbase-pdrchk Change-Id: If232b0375140b884f1b65c380faf5bd77c5df5c3 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-05-05Use 'Qemu Kill All' in perf test teardownJan Gelety1-3/+3
- replace 'Qemu Kill' KW by 'Qemu Kill All' - use self.qemu_kill_all() in case of qemu_start(self) failure Change-Id: I19d4c64d5daef4f00548344d45f0d4943ca4f7e8 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-04-19Use QEMU virtio queue size 1024 for perf testsJan Gelety1-6/+6
- use Build QEMU KW to apply patch to increase default virtio queue size - remove Set Scheduler Policy Change-Id: I04a7febd6366abd324d42f781645a8a0b520b325 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-04-18CSIT-545: Performance tests for SNATTibor Frank1-0/+37
- High level definition (HLD) - Low level definition (LLD) - Add keywords to set SNAT - Add tests according to HLD, LLD Change-Id: I7bf0b1870ac9c3adb36bb6590be9a3eb4ea8aa9a Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-04-12IPsectptLispGpe performance test suitepmikus1-16/+62
*[Top] Network Topologies:* TG-DUT1-DUT2-TG 3-node circular topology with single links between nodes. *[Enc] Packet Encapsulations:* IPv4-IPSec-LISPGPE-IPv4. *[Cfg] DUT configuration:* Each DUT is configured with LISP and IPsec. IPsec is in transport mode. Tests cases are for IPsec configured both on RLOC interface. Change-Id: I7a95baf0305caac3d9f0702bbedb3feec27f1668 Signed-off-by: pmikus <pmikus@cisco.com>
2017-04-10IPsec Multi-Tunnel performance test suiteKirill Rybalchenko1-6/+45
Change-Id: I4b0ba83960e50089f29cab9a30ab760241c6f566 Signed-off-by: Kirill Rybalchenko <kirill.rybalchenko@intel.com>
2017-04-07CSIT-553 Make QEMU bin configurablepmikus1-6/+12
Add option to set path for QEMU binary and make it configurable in perf testaces as global variable. Change-Id: I95f4b1ab790b576f1eca02ccdb86f7a6ced80630 Signed-off-by: pmikus <pmikus@cisco.com>
2017-04-03Make testpmd txd/rxd/txq/rxq configurable in guestpmikus1-2/+6
- Add option to configure vring qsz for testpmd when running in guest [make 256 as default] - Add option to configure number of queues for testpmd when running in guest [make 1 as default] Change-Id: I4ecd24ba4a24d6d212b10cd6d24f5b016fb63fd9 Signed-off-by: pmikus <pmikus@cisco.com>
2017-04-03CSIT-550: Add x520 L2 x-connect perf test with 2 VMs per DUTJan Gelety1-0/+42
- 10ge2p1x520-eth-l2xcbase-eth-4vhost-2vm-ndrpdrdisc Change-Id: I9dc6888d5b94922835fa0fcae2b0763b3a1fa9a3 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-03-30CSIT-548: Add x520 IP4base perf test with 2 VMs per DUTJan Gelety1-3/+204
- 10ge2p1x520-ethip4-ip4base-eth-4vhost-2vm-ndrpdrdisc Change-Id: I3f978914e11308898f3281183687b1a0f6c74ed2 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-03-27CSIT-547: Add x520 L2BD perf test with 2 VMs per DUTJan Gelety1-9/+101
- 10ge2p1x520-eth-l2bdbasemaclrn-eth-4vhost-2vm-ndrpdrdisc Change-Id: If65a7cf21d1dbff88f39f319877d9ac1fc5d959e Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-03-08CSIT-530: Add common setup and teardown to perf testsTibor Frank1-42/+108
Change-Id: I2e76de710b4b758eac1d24d447a9c5938f937385 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-02-27CSIT-339: Add Keywords for SMTTibor Frank1-194/+324
- modify keywords in CpuUtils.py - add RF keywords Change-Id: I57230b3948254e8f149b2563a8e24e948bc2ec27 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-02-23QemuUtil lib change to work with ubuntu and centosMatej Klotton1-1/+1
- replace nc to socat for comunicating with qemu QGA - change disk type to use virtio driver - add check to bind only network interface for testpmd Change-Id: I19ab16cbd8fec1ec78263ccfb1309a144e5af845 Signed-off-by: Matej Klotton <mklotton@cisco.com>
2017-02-03CSIT-516: Add keywords for 2-node topologyTibor Frank1-21/+107
Change-Id: Ib5a1e207f1dec99747329a755c3c365fef4bd64c Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-01-26Fix: Display of PDR latencypmikus1-3/+7
Fix the string in PDR latency output Change-Id: I7f244e29015da4e71485e88f2988efa73b6f4853 Signed-off-by: pmikus <pmikus@cisco.com>
2017-01-26CSIT-512: Add x710, xl710 l2bd vhost testsTibor Frank1-24/+51
- 10ge2p1x710-eth-l2bdbasemaclrn-eth-2vhost-1vm-ndrdisc - 40ge2p1xl710-eth-l2bdbasemaclrn-eth-2vhost-1vm-ndrdisc Change-Id: I99a70c8fcdfc0fffda96606033ba8752d6c07952 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-01-24CSIT-509: Add perf tests for vlan + l2 + vhostTibor Frank1-2/+82
Change-Id: I65e716b51dd35092c10574ac4580ee4b8bd3b24b Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-01-19Add unified latency output for PDRDISC and NDRDISCpmikus1-5/+7
Add same latency formatting for PDR as for NDR search results. This will help us to parse the data in same way. Change-Id: I3be79cc7623f8c9d39fd44babd252ceec58c114b Signed-off-by: pmikus <pmikus@cisco.com>
2017-01-11 Add the DPDK l2fwd performance test cases.Fangyin Hu1-9/+88
Change-Id: I996847a4871ed994cd9b5edb459fb079ff39c86d Signed-off-by: Fangyin Hu <fangyinx.hu@intel.com>
2017-01-10CSIT-499: Perf Tests - VXLAN + L2BD + vhostTibor Frank1-0/+44
- Packet throughput L2BD test cases with VXLANoIPv4 and vhost Change-Id: I6373ef232e5ce7155f8dec80ffa576a6a6b69b81 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-01-04CSIT-498: Packet throughput L2BD with VXLANoIPv4Tibor Frank1-0/+23
- Add performance tests for packet throughput L2BD with VXLANoIPv4 Change-Id: Id0872e1847f5a0e0eb37ba352bf75f56c51c7a45 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2016-12-14vhost perf testing with Qemu 5t5pcpmikus1-12/+10
Currently we were using 3t3pc for Qemu (2t2pc testpmd). This is not enough anymore as we are testing VPP with 4t4pc. This patch is supposed to increase the number of core used by testpmd. Change-Id: Id58634c050b51943679a1f7cb74c624a98d81a27 Signed-off-by: pmikus <pmikus@cisco.com>
2016-11-16CSIT-470 Add option to configure CFS scheduler priority for QEMUpmikus1-0/+3
Add option to configure CFS scheduler priority for QEMU Change-Id: I76da7f536e70a23a57cf5215ab60002f95532b19 Signed-off-by: pmikus <pmikus@cisco.com>
2016-11-15Switch to nested image 1.5 in perfpmikus1-1/+1
Change-Id: I9116eac4a5377258b73b62214ca876161d9ef171 Signed-off-by: pmikus <pmikus@cisco.com>
2016-11-04CSIT-458 Use node aware config in all perf TCspmikus1-2/+2
- Use node aware config in all perf TCs Change-Id: Icbf92bf232efef49d07c1324c64ae55125e90fb2 Signed-off-by: pmikus <pmikus@cisco.com>
2016-10-25CSIT-453: Switch Nested VM to 1.4 in perfpmikus1-6/+2
Currently in performance testing we are using Nested VM v1.3 with DPDK16.07. This patch will change the Nested VM to version 1.4 which includes DPDK16.09. Change-Id: I7cf2edda09f677ad9ddd3cc882000b9537bcc74c Signed-off-by: pmikus <pmikus@cisco.com>
2016-10-17FIX: LISP performance 6o4 failingpmikus1-2/+2
Change-Id: I08cecbe8310fd21356287ffbb33c3be58b721f10 Signed-off-by: pmikus <pmikus@cisco.com>
2016-10-10Ipv6 TEST fixesMiroslav Miklus1-2/+2
- Increase interactive terminal timeout - ip6 heapsize - performance lib fix Change-Id: Iac6beb041200c4b0c5cf29dceb5113df64c6c9b0 Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2016-10-03CSIT-416: Remove performance rate variablespmikus1-164/+0
Change-Id: I15ee953990f2ac11be361f3d0954bc12b3a9351d Signed-off-by: pmikus <pmikus@cisco.com>
2016-09-21Measure latency returns -1 if rate<=10kppsMiroslav Miklus1-16/+17
Change-Id: I25dca3e6ce7da1304211d87f1af72fceda6dc23b Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2016-09-15CSIT-408 sub-NDR latency measurementsMiroslav Miklus1-7/+63
- measure latency at 10% and 50% of found NDR. - fix the accuracy reported by T-REX (round to usec) Change-Id: I9fe2b5f942cb816db6fd0bb4262b48b8da6dac2f Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2016-09-15CSIT-404 Adjust DPDK testpmd startup parameterspmikus1-8/+8
Change-Id: If0f58e725e15aa01b61bc43b222c6254af9cd07e Signed-off-by: pmikus <pmikus@cisco.com>
2016-09-08CSIT-390 Replace rate calculation Ipmikus1-0/+1
- Replace static max rate variables by calculation of max rate based on nic limits Change-Id: I0f7f7e46c6f46f87dfa5f34b9b9fdb4610513081 Signed-off-by: pmikus <pmikus@cisco.com>
2016-08-25CSIT-275 IPv4 DP - QoS - performancepmikus1-0/+30
- Add libraries for DUT setup - Add test cases with various packet size and DUT startup setup Change-Id: I52a19f8e398f515cc231bb7190cd98299ca989ce Signed-off-by: pmikus <pmikus@cisco.com>
2016-08-25CSIT-323 L2dp - Cross-connect - baseline vhost-userpmikus1-0/+26
- Add test cases for vhost-user testing with NIC(X520)-to-VM(testpmd,virtio) Change-Id: Ie810ea06622ed8a37d3552f7bb8e38ebe9f04c2a Signed-off-by: pmikus <pmikus@cisco.com>
2016-08-23CSIT-218 L2XC VXLANoIPv4 - performancepmikus1-0/+42
- Add libraries for DUT setup - Add test cases with various packet size and DUT startup setup Change-Id: I4839cdf37481975f9bd7cf22c806c061882066a3 Signed-off-by: pmikus <pmikus@cisco.com>
2016-08-22CSIT-324 L2dp - Bridge domain - baseline vhost-userpmikus1-0/+33
- Add test cases for vhost-user testing with NIC(X520)-to-VM(testpmd,virtio) Change-Id: Id0e508d50288d89b39bc5c321eeab0c908f3e2ba Signed-off-by: pmikus <pmikus@cisco.com>
2016-08-22CSIT-366 IPv4dp - baseline vhost-userpmikus1-0/+172
- Add test cases for vhost-user testing with NIC(X520)-to-VM(testpmd,virtio) Change-Id: I598e70221b939b2b08aa324d2c98059eee8b6857 Signed-off-by: pmikus <pmikus@cisco.com>
2016-08-18CSIT-200: Lisp performance testAndrej Kozemcak1-0/+250
Change-Id: I8a54b79ee03c2f5defc4eeba486086d793484668 Signed-off-by: Andrej Kozemcak <akozemca@cisco.com> Signed-off-by: pmikus <pmikus@cisco.com>
2016-08-17CSIT-312 VPP vhost-user - VPP vhost-user driver, virtio in VMpmikus1-0/+125
- Add libraries and keywords to control Qemu VM and VMapp Change-Id: Iaaedfe240afe394f507ccaf0cf7a77c8b863acd3 Signed-off-by: pmikus <pmikus@cisco.com>
2016-08-10CSIT-321 L2 Cross-connect - baseline - NIC-to-NIC(XL710)Miroslav Miklus1-46/+22
Change-Id: I0c78d17242eedbfa573f1e2c20dc491a71b8dd4a Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2016-08-03CSIT-213 IPv6 iACL - performancepmikus1-0/+20
- create topology with Classify iACL white-list applied on interfaces using IPv6 in 3-node topology - create ipv6_iacl test cases (78B, 1518B, 9000B) Change-Id: Idae635e6a45b52086515fea33a38112209975e8a Signed-off-by: pmikus <pmikus@cisco.com>
2016-08-01CSIT-179 IPv6 Scale - performancepmikus1-0/+40
- Add libraries for ipv6 scale setup - Add test cases for testing 10k/100k/1M fib entries - Add t-rex profiles for large scale testing Change-Id: I4260405c960afe659db7e0764a68a87b9e8de0b2 Signed-off-by: pmikus <pmikus@cisco.com>
2016-07-28CSIT-169 IPv4 Scale - performancepmikus1-0/+42
- Add libraries for ipv4 scale setup - Add test cases for testing 10k/100k/1M fib entries - Add t-rex profiles for large scale testing Change-Id: If085e0d834e5ffe5538ba76756e8b9d0e8255cb2 Signed-off-by: pmikus <pmikus@cisco.com>
2016-07-28CSIT-136 IMIX T-REX driverMiroslav Miklus1-0/+22
Change-Id: Ife7c543d07bcac4bad82894eea0f4e0e5a8db4bb Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2016-07-26CSIT-106 Vpp config - use only test-related interfacesMiroslav Miklus1-4/+8
Current behaviour is to add all interfaces from topology, we only want to add interfaces from computed path. Change-Id: I9c5d4e765dbe399ee06dd13f0d25c48d3d8e5127 Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2016-07-22PATCH: Fix add ip neigbour in IPV6 librariespmikus1-8/+4
- fix vrf key error for IPv6 performance library Change-Id: I3b80d350b3a524bcdea76012c717edbecff9c154 Signed-off-by: pmikus <pmikus@cisco.com>
2016-07-20CSIT-215 Improve documentation - performancepmikus1-1/+0
- Improve documentation in performance libraries Change-Id: Idf3d8e5f0107de78776c955259b31f0e41e04585 Signed-off-by: pmikus <pmikus@cisco.com>