aboutsummaryrefslogtreecommitdiffstats
path: root/resources/libraries/robot/performance.robot
AgeCommit message (Collapse)AuthorFilesLines
2016-10-25CSIT-453: Switch Nested VM to 1.4 in perfpmikus1-6/+2
Currently in performance testing we are using Nested VM v1.3 with DPDK16.07. This patch will change the Nested VM to version 1.4 which includes DPDK16.09. Change-Id: I7cf2edda09f677ad9ddd3cc882000b9537bcc74c Signed-off-by: pmikus <pmikus@cisco.com>
2016-10-17FIX: LISP performance 6o4 failingpmikus1-2/+2
Change-Id: I08cecbe8310fd21356287ffbb33c3be58b721f10 Signed-off-by: pmikus <pmikus@cisco.com>
2016-10-10Ipv6 TEST fixesMiroslav Miklus1-2/+2
- Increase interactive terminal timeout - ip6 heapsize - performance lib fix Change-Id: Iac6beb041200c4b0c5cf29dceb5113df64c6c9b0 Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2016-10-03CSIT-416: Remove performance rate variablespmikus1-164/+0
Change-Id: I15ee953990f2ac11be361f3d0954bc12b3a9351d Signed-off-by: pmikus <pmikus@cisco.com>
2016-09-21Measure latency returns -1 if rate<=10kppsMiroslav Miklus1-16/+17
Change-Id: I25dca3e6ce7da1304211d87f1af72fceda6dc23b Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2016-09-15CSIT-408 sub-NDR latency measurementsMiroslav Miklus1-7/+63
- measure latency at 10% and 50% of found NDR. - fix the accuracy reported by T-REX (round to usec) Change-Id: I9fe2b5f942cb816db6fd0bb4262b48b8da6dac2f Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2016-09-15CSIT-404 Adjust DPDK testpmd startup parameterspmikus1-8/+8
Change-Id: If0f58e725e15aa01b61bc43b222c6254af9cd07e Signed-off-by: pmikus <pmikus@cisco.com>
2016-09-08CSIT-390 Replace rate calculation Ipmikus1-0/+1
- Replace static max rate variables by calculation of max rate based on nic limits Change-Id: I0f7f7e46c6f46f87dfa5f34b9b9fdb4610513081 Signed-off-by: pmikus <pmikus@cisco.com>
2016-08-25CSIT-275 IPv4 DP - QoS - performancepmikus1-0/+30
- Add libraries for DUT setup - Add test cases with various packet size and DUT startup setup Change-Id: I52a19f8e398f515cc231bb7190cd98299ca989ce Signed-off-by: pmikus <pmikus@cisco.com>
2016-08-25CSIT-323 L2dp - Cross-connect - baseline vhost-userpmikus1-0/+26
- Add test cases for vhost-user testing with NIC(X520)-to-VM(testpmd,virtio) Change-Id: Ie810ea06622ed8a37d3552f7bb8e38ebe9f04c2a Signed-off-by: pmikus <pmikus@cisco.com>
2016-08-23CSIT-218 L2XC VXLANoIPv4 - performancepmikus1-0/+42
- Add libraries for DUT setup - Add test cases with various packet size and DUT startup setup Change-Id: I4839cdf37481975f9bd7cf22c806c061882066a3 Signed-off-by: pmikus <pmikus@cisco.com>
2016-08-22CSIT-324 L2dp - Bridge domain - baseline vhost-userpmikus1-0/+33
- Add test cases for vhost-user testing with NIC(X520)-to-VM(testpmd,virtio) Change-Id: Id0e508d50288d89b39bc5c321eeab0c908f3e2ba Signed-off-by: pmikus <pmikus@cisco.com>
2016-08-22CSIT-366 IPv4dp - baseline vhost-userpmikus1-0/+172
- Add test cases for vhost-user testing with NIC(X520)-to-VM(testpmd,virtio) Change-Id: I598e70221b939b2b08aa324d2c98059eee8b6857 Signed-off-by: pmikus <pmikus@cisco.com>
2016-08-18CSIT-200: Lisp performance testAndrej Kozemcak1-0/+250
Change-Id: I8a54b79ee03c2f5defc4eeba486086d793484668 Signed-off-by: Andrej Kozemcak <akozemca@cisco.com> Signed-off-by: pmikus <pmikus@cisco.com>
2016-08-17CSIT-312 VPP vhost-user - VPP vhost-user driver, virtio in VMpmikus1-0/+125
- Add libraries and keywords to control Qemu VM and VMapp Change-Id: Iaaedfe240afe394f507ccaf0cf7a77c8b863acd3 Signed-off-by: pmikus <pmikus@cisco.com>
2016-08-10CSIT-321 L2 Cross-connect - baseline - NIC-to-NIC(XL710)Miroslav Miklus1-46/+22
Change-Id: I0c78d17242eedbfa573f1e2c20dc491a71b8dd4a Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2016-08-03CSIT-213 IPv6 iACL - performancepmikus1-0/+20
- create topology with Classify iACL white-list applied on interfaces using IPv6 in 3-node topology - create ipv6_iacl test cases (78B, 1518B, 9000B) Change-Id: Idae635e6a45b52086515fea33a38112209975e8a Signed-off-by: pmikus <pmikus@cisco.com>
2016-08-01CSIT-179 IPv6 Scale - performancepmikus1-0/+40
- Add libraries for ipv6 scale setup - Add test cases for testing 10k/100k/1M fib entries - Add t-rex profiles for large scale testing Change-Id: I4260405c960afe659db7e0764a68a87b9e8de0b2 Signed-off-by: pmikus <pmikus@cisco.com>
2016-07-28CSIT-169 IPv4 Scale - performancepmikus1-0/+42
- Add libraries for ipv4 scale setup - Add test cases for testing 10k/100k/1M fib entries - Add t-rex profiles for large scale testing Change-Id: If085e0d834e5ffe5538ba76756e8b9d0e8255cb2 Signed-off-by: pmikus <pmikus@cisco.com>
2016-07-28CSIT-136 IMIX T-REX driverMiroslav Miklus1-0/+22
Change-Id: Ife7c543d07bcac4bad82894eea0f4e0e5a8db4bb Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2016-07-26CSIT-106 Vpp config - use only test-related interfacesMiroslav Miklus1-4/+8
Current behaviour is to add all interfaces from topology, we only want to add interfaces from computed path. Change-Id: I9c5d4e765dbe399ee06dd13f0d25c48d3d8e5127 Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2016-07-22PATCH: Fix add ip neigbour in IPV6 librariespmikus1-8/+4
- fix vrf key error for IPv6 performance library Change-Id: I3b80d350b3a524bcdea76012c717edbecff9c154 Signed-off-by: pmikus <pmikus@cisco.com>
2016-07-20CSIT-215 Improve documentation - performancepmikus1-1/+0
- Improve documentation in performance libraries Change-Id: Idf3d8e5f0107de78776c955259b31f0e41e04585 Signed-off-by: pmikus <pmikus@cisco.com>
2016-07-19CSIT-215 Improve documentation - performancepmikus1-131/+275
- Improve documentation in performance libraries Change-Id: I66e5b0782497c5759c737556f207cf2fd3383923 Signed-off-by: pmikus <pmikus@cisco.com>
2016-07-19CSIT-102: Add latency measurement to performance testingPeter Mikus1-10/+27
- Add latency stream as a background stream in both directions - Latency background stream is not using the VM transformation engine. Raw stream with single packet is created. - Latency background stream has 1kpps rate with packet of same size as traffic stream. - Display latency values (min/avg/max) in results of TC and reporting remaining data including histogram and jitter inside of the search/pass keyword. Change-Id: I78ce4659b57caab08d5729f51a1e14d518fd3273 Signed-off-by: Peter Mikus <pmikus@cisco.com> Signed-off-by: pmikus <pmikus@cisco.com>
2016-07-13CSIT-60: Create l2-vlan-dot1ad libraries for perf testingPeter Mikus1-52/+69
- create topology with VLAN dot1ad sub-interfaces inter-connected using L2 cross connect in 3-node topology - create keywords to be used in test cases - create l2-vlan-dot1ad test cases (64B, 1514B, 9000B) Change-Id: Ib25d5e8f09fb83d80596982608e93b1e511e8b8e Signed-off-by: Peter Mikus <pmikus@cisco.com> Signed-off-by: pmikus <pmikus@cisco.com>
2016-07-11TB2 XL710 topology filesMiroslav Miklus1-0/+15
JIRA: CSIT-106 Change-Id: If3e76d971c7196da3f83a8daacd1308c6374c786 Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2016-06-302-node topology keywordsMiroslav Miklus1-1/+70
JIRA: CSIT-182 Change-Id: I593c2d6b0e7a1ee344b879f7b54bb9443ab8c516 Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2016-06-28TG init changes for n-node topologyMiroslav Miklus1-4/+4
JIRA: CSIT-182 For TG node we only need to know the interfaces on TG node and the adjecent nodes interfaces for any n-node topology. Change-Id: I0129b9513356df976364b58e6749dfab3ca5e2ae Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2016-06-28PATCH: Fix MAC address variables in perf librariespmikus1-4/+2
Change-Id: I0f7b51349d2323bd501f6d6ae75474cc225e94bb Signed-off-by: pmikus <pmikus@cisco.com>
2016-06-14CSIT-163: Add show vpp version verbosepmikus1-0/+2
- Add output of vpp version verbose Change-Id: Ia74b97be4636d55b115246d495a5d6eea0a94bb7 Signed-off-by: pmikus <pmikus@cisco.com>
2016-05-26Find PDR using binary searchPeter Mikus1-4/+292
- JIRA: CSIT-72 - modify libraries for PDR search evaluation - write robot framework keywords for PDR search - write Performance Test Cases using PDR Change-Id: Id06a2a7f78fe8626c221afe4178c5c30cc599762 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2016-05-24Patch: Set duration of performance long tests to 10sPeter Mikus1-3/+3
- JIRA: CSIT-77 Decrease duration time from 60 second to 10 second for all long performance tests. This patch is preparation for replacement of linear search for binary search. Change-Id: I61fbec1dcaca73ba383690e695c3030d182a90f9 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2016-05-24Replace linear search with binary searchPeter Mikus1-0/+36
- JIRA: CSIT-97 - Replace linear search with binary search for long performance testing Change-Id: I19cbcf3d9f7f5e6ec5128287b58a2ea3aceff00c Signed-off-by: Peter Mikus <pmikus@cisco.com>
2016-05-24Add test cases with "dpdk no-multi-seg" in vpp startup configPeter Mikus1-2/+2
- JIRA: CSIT-73 - Add ability to configure no-multi-seg parameter in VPP startup configuration - Add keywords to selectively configure parameters in startup configuration - Modify testcases Change-Id: I3c5c0a1cc2b1156d5a87ff36628b50793dd9ac5f Signed-off-by: Peter Mikus <pmikus@cisco.com>
2016-05-23Capture VPP stats for Long and Short testsMiroslav Miklus1-12/+18
JIRA: CSIT-71 - remove warmup for short runs - clear and collect stats for short run - run short test with no failure for long test with NDR/PDR rate Change-Id: I1b8879c3b891165072822207d0781687d8159336 Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2016-05-23Performance l2-vlan-dot1q library and short/long test casespmikus1-0/+10
- JIRA: CSIT-59 - create topology with VLAN dot1q sub-interfaces inter-connected using L2 cross connect in 3-node topology - create keywords to be used in test cases - create l2-vlan-dot1q test cases (64B, 1518B, 9000B) Change-Id: Ic5f31b4451965bb7f5d3d5b7061c6600f63da898 Signed-off-by: pmikus <pmikus@cisco.com> Signed-off-by: Peter Mikus <pmikus@cisco.com>
2016-05-18T-REX stl traffic send improvement for async callsMiroslav Miklus1-6/+25
JIRA: CSIT-68 - show runtime statistics with running traffic - T-REX driver async. driver Change-Id: Ie5eb7021f610fb58383b033dda5b1b867f7d3d2c Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2016-05-11Performance IPv6 library and short/long test casespmikus1-4/+32
- JIRA: CSIT-2 - Create IPv6 test cases for long/short/singlethread/multithread performance testing - Create robot KWs for IPv6 performance testing - Add T-Rex IPv6 profile Change-Id: I306d5c894d9b9287bf91929764aeb1c7083d802c Signed-off-by: pmikus <pmikus@cisco.com> Signed-off-by: Peter Mikus <pmikus@cisco.com>
2016-05-03Patch to reset default VPP configuration in perf.pmikus1-1/+5
- JIRA: CSIT-57 - fix situation when vpp startup configuration is replaced by default with no interface configuration Change-Id: Iea23dcc0707bc96627b99d4500268a8e01bfda39 Signed-off-by: pmikus <pmikus@cisco.com>
2016-04-26Extend host topology with NIC type filteringMiroslav Miklus1-0/+37
JIRA: CSIT-1 Changes to allow filtering based on NIC model. Switched xconnect perf test to use filtered topology. Change-Id: Id526f47dc28f92bf26d070e54819ad29bccc0440 Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2016-04-22Reformat python libraries.Matej Klotton1-1/+1
PEP8 reformat fix typos docstrings reformat Change-Id: Ic48ba4e06490630808b8e2ab1ab0b046ec7eeed7 Signed-off-by: Matej Klotton <mklotton@cisco.com>
2016-04-15Change the performance result messagepmikus1-6/+21
- change the result message of performance search to more verbose level (rate per stream, rate total, throughput in Gbps) Change-Id: I7562d6d33c525654131c75ebcc776cba438f68f4 Signed-off-by: pmikus <pmikus@cisco.com>
2016-04-11Combined DropRateSearchpmikus1-0/+24
- combined search algorithm using linear and binary search - add KWs into performance library for binary and combined search - remove short_bridge_domain_binary.robot as binary and combined search KWs are in library for optional use - PEP8 fixes Change-Id: I4a6c3c07c82db4f855fb93214b0532ee0c783e0a Signed-off-by: pmikus <pmikus@cisco.com>
2016-04-01Long perf testspmikus1-0/+72
- added new long tests for ipv4 and xconnect - modified long bridge domain test - added 64B, 1518B and 9000B frame sizes Change-Id: I88f75c375345f2d708df3fd24dd50d77bc63c495 Signed-off-by: pmikus <pmikus@cisco.com>
2016-03-07Performance suite reorg, v4 testsMiroslav Miklus1-0/+37
- perf suite splitted to 1.xconnect 2.bridge-domain 3.IPv4 - IPv4 perf tests implemented - renamed perf tests prefix 2core -> 1core Change-Id: I9ef2dbdfcfdcb36e8865989e6255d69ced33269c Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>