aboutsummaryrefslogtreecommitdiffstats
path: root/resources/libraries/robot
AgeCommit message (Collapse)AuthorFilesLines
2016-11-07CSIT-465: Common test setup and teardownTibor Frank1-0/+38
This test setup and teardown is aimed to be used with all functional tests. It does not include functionality to manipulate VMs (qemu). Test setup includes: - Setup all DUTs before test - Save VPP PIDs - Setup all TGs before traffic script - Update All Interface Data On All Nodes Test teardown includes: - Show Packet Trace on All DUTs - Show vpp trace dump on all DUTs - Vpp Show Errors On All DUTs - Check VPP PID in Teardown Change-Id: Ifee0bd58b7865442c5b510852908fd8363e3c543 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2016-11-04CSIT-458 Use node aware config in all perf TCspmikus2-27/+3
- Use node aware config in all perf TCs Change-Id: Icbf92bf232efef49d07c1324c64ae55125e90fb2 Signed-off-by: pmikus <pmikus@cisco.com>
2016-11-04CSIT-457: Address Honeycomb test failuresselias5-93/+91
- tag all not-implemented features with EXPECTED_FAILING - add workarounds for known issues with VAT dump commands - replace hardcoded test data with parametrized - separate IP neighbor and IP address into two test cases - support unordered lists with compare_data_structures keyword Change-Id: I2c683162325cee720ba496489787fa50e9c72b8c Signed-off-by: selias <samelias@cisco.com>
2016-11-03CSIT-245: IPv6 - ip4-lispgpe-ip6Zdeno Olsovsky1-6/+14
Change-Id: Ie88cadfc2eab31cd1f411b9648b1a3515e4baa89 Signed-off-by: Zdeno Olsovsky <zolsovsk@cisco.com> Signed-off-by: Matej Klotton <mklotton@cisco.com>
2016-10-31CSIT-385 CSIT-386 IPv4/IPv6 IPsec testsPatrik Hrnciar1-2/+26
- encryption/integrity key update tests Change-Id: Iddbe35e2f421b5048e60663bff2b0bf1968a9782 Signed-off-by: Patrik Hrnciar <phrnciar@cisco.com> Signed-off-by: Matej Klotton <mklotton@cisco.com>
2016-10-27Revert "Use 3 tries to prepare DUT for testing"Dave Wallace1-3/+1
This reverts commit d551ef4b72448c3ccb493559826b976a2d3d8649. Change-Id: Icff3a98b96298385a2e4789d40ef60d70f440492 Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
2016-10-26Use 3 tries to prepare DUT for testingJan Gelety1-1/+3
- workaround to deal with occasional vpp restart issue Change-Id: I74a9148045bf4f80c9ba943e9c74338e08b2a72e Signed-off-by: Jan Gelety <jgelety@cisco.com>
2016-10-25CSIT-453: Switch Nested VM to 1.4 in perfpmikus1-6/+2
Currently in performance testing we are using Nested VM v1.3 with DPDK16.07. This patch will change the Nested VM to version 1.4 which includes DPDK16.09. Change-Id: I7cf2edda09f677ad9ddd3cc882000b9537bcc74c Signed-off-by: pmikus <pmikus@cisco.com>
2016-10-24Use only Qemu Kill on the teardown of double qemu setupJan Gelety1-7/+1
- do not use Qemu System Powerdown or Qemu Quit in the teardown of double qemu setup - use just Qemu Kill there Change-Id: I8dd1e4055e0adb5d306e3a9904090a271d17c3e5 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2016-10-20CSIT-427: Honeycomb ietf-ACL tests - L4 and misc.selias1-1/+1
- add test cases for: L4 port range ACLs multiple classify rules L2 ACL on egress interface - add L4 configuration to mixed ACL test - add test variables for new test cases - update HTTPRequests to treat code 201 as a positive response Change-Id: If43007545fec174af12dab594f8a1b15b2e4a536 Signed-off-by: selias <samelias@cisco.com>
2016-10-20CSIT-427: Honeycomb ietf-ACL tests - mixed layersselias1-2/+2
- add test cases for mixing L2 and L3 rules - update methods with mixed-acl functionality - update test variables Change-Id: I2aaa3033eede609627f751ea896e098548ffae98 Signed-off-by: selias <samelias@cisco.com>
2016-10-20CSIT-427: Honeycomb ietf-ACL tests - L2selias3-4/+96
- add keywords for accessing Honeycomb's ietf-acl node - add variable file with ietf-acl test data - add ietf-acl traffic test suite - modify bridge domain teardown keyword to unassign interfaces from the bridge domain before delete Change-Id: I6df1771f2fb9b42f30b5af8f54a384c6714f5949 Signed-off-by: selias <samelias@cisco.com>
2016-10-17FIX: LISP performance 6o4 failingpmikus1-2/+2
Change-Id: I08cecbe8310fd21356287ffbb33c3be58b721f10 Signed-off-by: pmikus <pmikus@cisco.com>
2016-10-14CSIT-351: Testing Ubuntu 16.04.1 changespmikus1-4/+1
- Update the repository to get xenial packages - Update phy topology files with new pass - Update bootstrap to use new VIRL image - Update framework to reflect 16.04 dependencies - CSIT-116: Modify VIRL username/password Change-Id: I4de44755170fd0481acef34c7c2d9c299bc300da Signed-off-by: pmikus <pmikus@cisco.com>
2016-10-10Ipv6 TEST fixesMiroslav Miklus1-2/+2
- Increase interactive terminal timeout - ip6 heapsize - performance lib fix Change-Id: Iac6beb041200c4b0c5cf29dceb5113df64c6c9b0 Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2016-10-07CSIT-257: L2enc - l2-eth-lispgpe-ip4 - L2BDZdeno Olsovsky1-0/+77
Change-Id: I0ee68f707c4175940538654f3a4bbd7d1a91bef1 Signed-off-by: Zdeno Olsovsky <zolsovsk@cisco.com>
2016-10-05IPv4 2M scale tests - adjust heapsize to 3GMiroslav Miklus1-0/+10
Change-Id: I78e700e2137fd35d79c9b6b5ba27bb21adc3f6fa Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2016-10-04CSIT-227, CSIT-240 IPv4/IPv6 Multipath routing testsPatrik Hrnciar1-0/+43
- add IPv4 Equal-cost multipath routing test - add IPv6 Equal-cost multipath routing test Change-Id: I62eaf9983b7767e124f80af7d8c8652ffc460cf8 Signed-off-by: Patrik Hrnciar <phrnciar@cisco.com>
2016-10-03CSIT-231: ip4-ipsec-lispgpe-ip4Tibor Frank1-0/+75
- main fib, - vrf, - phy2lisp Change-Id: I9fd97462f0b290dab860ac601fbb37b4cecfb909 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2016-10-03CSIT-235: Switched Port Analyzer mirroring (SPAN) - IPv4selias2-1/+57
- add library for SPAN setup - add telemetry traffic script and a keyword to run it - add "telemetry" folders for python and robot libraries - move IPFIX libraries to these new folders - add first SPAN test case, mirroring IPv4 ICMP packets Change-Id: Ibca35f724c13662bf80dce2d7e2649d1a0b8676a Signed-off-by: selias <samelias@cisco.com>
2016-10-03INMARSAT-54 Honeycomb configures PBBpmikus1-0/+118
- CRUD tests usinf Honeycomb REST API Change-Id: I4885cd0feb26f8ef56beb0d8848772ea2d42cb3a Signed-off-by: Tibor Frank <tifrank@cisco.com>
2016-10-03CSIT-405: Honeycomb test update and cleanupselias4-7/+40
- update suite setup and constants to allow test runs again - cleanup basic interface keywords - cleanup L2-fib test data - add "continue on failure" keyword to some partially failing tests - add teardown to all suites, restarts honeycomb if suite had test failures - fix minor PEP-8 violations in Topology.py Change-Id: Ic5b434af71f77855f81461b280299b8318932c5a Signed-off-by: selias <samelias@cisco.com>
2016-10-03LISP - implement changes done in VPP-376Tibor Frank1-8/+15
Change-Id: Ia9f7913522421b6fd9ecba18eb4d68bc0f3b3271 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2016-10-03CSIT-416: Remove performance rate variablespmikus1-164/+0
Change-Id: I15ee953990f2ac11be361f3d0954bc12b3a9351d Signed-off-by: pmikus <pmikus@cisco.com>
2016-09-22CSIT-411 Show Vhost Userpmikus1-0/+6
- Add keyword to show vhost user Change-Id: Ia844bbcb8507b8c7cbf6b7bb1a7dc8d10148d6f4 Signed-off-by: pmikus <pmikus@cisco.com>
2016-09-21Measure latency returns -1 if rate<=10kppsMiroslav Miklus1-16/+17
Change-Id: I25dca3e6ce7da1304211d87f1af72fceda6dc23b Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2016-09-20Documentation fix - show statsMiroslav Miklus1-1/+1
Change-Id: Ib5f3dc697d1da6a86b70c5ba7d8ea8711a2fc492 Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2016-09-15CSIT-408 sub-NDR latency measurementsMiroslav Miklus1-7/+63
- measure latency at 10% and 50% of found NDR. - fix the accuracy reported by T-REX (round to usec) Change-Id: I9fe2b5f942cb816db6fd0bb4262b48b8da6dac2f Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2016-09-15CSIT-404 Adjust DPDK testpmd startup parameterspmikus1-8/+8
Change-Id: If0f58e725e15aa01b61bc43b222c6254af9cd07e Signed-off-by: pmikus <pmikus@cisco.com>
2016-09-14CSIT-241: IPv6 Router Advertisementselias1-5/+44
- add traffic script to verify Router Solicitation response - add keyword to execute traffic script - add test case 02: retransmit RA message after set interval - add test case 03: respond to RS request Change-Id: I83d742713ae42d0a1baacf460c29c06d32669b9a Signed-off-by: selias <samelias@cisco.com>
2016-09-12CSIT-384: IPSEC IPv6 negative test casesJan Gelety1-1/+1
- use integrity and/or encryption key(s) different from integrity and encryption keys stored on VPP node to create tx packet on TG Change-Id: I0f02523ec7649b8a1555869bdc4b7090b7585cac Signed-off-by: Jan Gelety <jgelety@cisco.com>
2016-09-12CSIT-383: IPSEC IPv4 negative test casesJan Gelety1-0/+7
- use integrity and/or encryption key(s) different from integrity and encryption keys stored on VPP node to create tx packet on TG Change-Id: I38bf7e1dd6f488e605bad991c7a7f4d1ff226e8c Signed-off-by: Jan Gelety <jgelety@cisco.com>
2016-09-12Fix of Qemu issuesJan Gelety1-0/+2
- use path to IPUtil where KWs "Setup Network Namespace" and "Set Linux Interface IP" are used Change-Id: I012cb7df4b871353aa68c10ca7069de7a2ab5d3b Signed-off-by: Jan Gelety <jgelety@cisco.com>
2016-09-08CSIT-390 Replace rate calculation Ipmikus1-0/+1
- Replace static max rate variables by calculation of max rate based on nic limits Change-Id: I0f7f7e46c6f46f87dfa5f34b9b9fdb4610513081 Signed-off-by: pmikus <pmikus@cisco.com>
2016-09-06CSIT-353: MAP-T FIX: Add tx src mac to traffic scriptMatej Klotton1-3/+4
Change-Id: I011231c68dc470590323933dbdb3f33c3026559b Signed-off-by: Matej Klotton <mklotton@cisco.com>
2016-09-05CSIT-229: ip4-lispgpe-ip4Tibor Frank2-2/+151
- main fib, - vrf, - phy2lisp Change-Id: Ic9bacef4574dc07b25041c4cd0653825a65c94fb Signed-off-by: Tibor Frank <tifrank@cisco.com>
2016-08-26CSIT-124: IPv4 encapsulations - IP4-GRE-IP4Matej Klotton1-42/+97
- add gre test with multiple tunnel configured - configure tunnel source as a loopback - route from tunnel to tunnel - check droping unknown tunnel destination Change-Id: Ib522d158d9de5c66f556c6734ceadc994eea02d4 Signed-off-by: Matej Klotton <mklotton@cisco.com>
2016-08-25CSIT-234 IPFIX - ipv4 functional scaleselias1-0/+44
- add traffic script for classify session scale test - add keyword for classify session scale test - add packet scale and session scale test to IPFIX IPv4 suite Change-Id: I3abd07dbf705fe664b723916ce1d82cd9649a2ae Signed-off-by: selias <samelias@cisco.com>
2016-08-25CSIT-353: Add basic map-t testsMatej Klotton1-0/+93
Change-Id: I78075e445cdd61e0e3cf9353bddeaf6e6bc978fa Signed-off-by: Matej Klotton <mklotton@cisco.com>
2016-08-25CSIT-233 IPv4 IPFIX - baseline testsselias1-0/+67
- add scapy classes for parsing IPFIX packets - add vat scripts and keywords for settings up IPFIX - add IPv4 IPFIX test suite Change-Id: I80ab76ca361c7920a01a46ad720b1c04acd0d147 Signed-off-by: selias <samelias@cisco.com>
2016-08-25CSIT-31 DHCPv6 Proxy testPatrik Hrnciar1-1/+43
Change-Id: Ie06980f6e42af3676d8f1ee42c9b9733428365af Signed-off-by: Patrik Hrnciar <phrnciar@cisco.com>
2016-08-25CSIT-275 IPv4 DP - QoS - performancepmikus1-0/+30
- Add libraries for DUT setup - Add test cases with various packet size and DUT startup setup Change-Id: I52a19f8e398f515cc231bb7190cd98299ca989ce Signed-off-by: pmikus <pmikus@cisco.com>
2016-08-25CSIT-323 L2dp - Cross-connect - baseline vhost-userpmikus1-0/+26
- Add test cases for vhost-user testing with NIC(X520)-to-VM(testpmd,virtio) Change-Id: Ie810ea06622ed8a37d3552f7bb8e38ebe9f04c2a Signed-off-by: pmikus <pmikus@cisco.com>
2016-08-23CSIT-218 L2XC VXLANoIPv4 - performancepmikus1-0/+42
- Add libraries for DUT setup - Add test cases with various packet size and DUT startup setup Change-Id: I4839cdf37481975f9bd7cf22c806c061882066a3 Signed-off-by: pmikus <pmikus@cisco.com>
2016-08-23Small fixies in IPSEC resourcesJan Gelety1-1/+1
Change-Id: I06e4000d93a86d885200ef1d0dd9b00e520ba77f Signed-off-by: Jan Gelety <jgelety@cisco.com>
2016-08-23CSIT-369 Update Honeycomb persistence data locationselias1-70/+0
- update persistence cleanup method with new file path - remove unnecessary test case for bvi in multiple bridge domains - remove unused bridge domain keywords Change-Id: Ib5378f47af4a03ec5663a79db4c0dc1bf054c557 Signed-off-by: selias <samelias@cisco.com>
2016-08-22CSIT-324 L2dp - Bridge domain - baseline vhost-userpmikus1-0/+33
- Add test cases for vhost-user testing with NIC(X520)-to-VM(testpmd,virtio) Change-Id: Id0e508d50288d89b39bc5c321eeab0c908f3e2ba Signed-off-by: pmikus <pmikus@cisco.com>
2016-08-22CSIT-366 IPv4dp - baseline vhost-userpmikus1-0/+172
- Add test cases for vhost-user testing with NIC(X520)-to-VM(testpmd,virtio) Change-Id: I598e70221b939b2b08aa324d2c98059eee8b6857 Signed-off-by: pmikus <pmikus@cisco.com>
2016-08-18CSIT-171 CSIT-172 Policer tests initial commitMatus Fabian1-0/+99
policer python library, traffic script and IPv4/IPv6 example tests Change-Id: I6470c86ce1acdcaaff9fdcf81510126836f1135e Signed-off-by: Matus Fabian <matfabia@cisco.com>
2016-08-18CSIT-200: Lisp performance testAndrej Kozemcak1-0/+250
Change-Id: I8a54b79ee03c2f5defc4eeba486086d793484668 Signed-off-by: Andrej Kozemcak <akozemca@cisco.com> Signed-off-by: pmikus <pmikus@cisco.com>