aboutsummaryrefslogtreecommitdiffstats
path: root/resources/libraries/robot
AgeCommit message (Collapse)AuthorFilesLines
2016-12-12CSIT-484: HC Test: Add scripts for new hc2vpp jobsselias1-1/+1
- add package download script that also installs jvpp .jar to maven local repo - add bootstrap scripts for the new jobs Related ci-management commit: https://gerrit.fd.io/r/4171 Change-Id: I11ec3d93d3b6f6d84c0c1c5e54f166dab96a05ee Signed-off-by: selias <samelias@cisco.com>
2016-12-01CSIT-481: HC Test: Port mirroring (SPAN)selias1-0/+128
- add port mirroring test suite - add relevant keywords Change-Id: I4ff398dd2ab4323e2a53af2812bf07cbb7043252 Signed-off-by: selias <samelias@cisco.com>
2016-11-28CSIT-460: HC Test: Rework existing PBB testsselias1-11/+10
Rework PBB tests to account for changes in: https://gerrit.fd.io/r/2520 https://gerrit.fd.io/r/1833 Change-Id: Id18027c23e57180b76c8478b010a4e3a69a75e43 Signed-off-by: selias <samelias@cisco.com>
2016-11-25CSIT-425: HC Test: NSH-SFC test suiteselias1-0/+161
- add keyword to enable optional modules in Honeycomb (including NSH) - update honeycomb __init__.robot with the new keyword - add python and robot libraries for NSH tests - add NSH test suite (CRUD operations) Change-Id: I869069a138a51d56d25522163c3a6deefb316f46 Signed-off-by: selias <samelias@cisco.com>
2016-11-25CSIT-457: HC Test: Document expected test failuresselias1-39/+13
- add EXPECTED_FAILING tag to all known test failures - document every use of EXPECTED_FAILING tag ,include Jira issue ID - minor fixes to interface, sub-interface and ACL test suites Change-Id: If6a535bdacc297c03e8cfade8896cdec23498bc2 Signed-off-by: selias <samelias@cisco.com>
2016-11-21CSIT:454 - HC Test: Increase timeout for Honeycomb startupselias1-1/+1
Change-Id: I44288ecd8664e75b9acfbd2d0e03d9712f4010b1 Signed-off-by: selias <samelias@cisco.com>
2016-11-16CSIT-470 Add option to configure CFS scheduler priority for QEMUpmikus1-0/+3
Add option to configure CFS scheduler priority for QEMU Change-Id: I76da7f536e70a23a57cf5215ab60002f95532b19 Signed-off-by: pmikus <pmikus@cisco.com>
2016-11-16CSIT-454: HC Test: Improve logging on test failureselias2-1/+3
- set Honeycomb log level to TRACE before running Honeycomb tests - on a failed restconf request, print the last few lines of the log - show saved configuration during persistence suite restarts Change-Id: I07ee37a5403cfca946fd7ef25a42861273248fbe Signed-off-by: selias <samelias@cisco.com>
2016-11-15Switch to nested image 1.5 in perfpmikus1-1/+1
Change-Id: I9116eac4a5377258b73b62214ca876161d9ef171 Signed-off-by: pmikus <pmikus@cisco.com>
2016-11-08CSIT-423: HC Test: delete VxLAN interfaceselias1-0/+47
Modify VxLAN test cases to account for changes in Honeycomb. Change-Id: If2db55548b5472350d128bdfbb5bdd5289e1deef Signed-off-by: selias <samelias@cisco.com>
2016-11-07CSIT-465: Common test setup and teardownTibor Frank1-0/+38
This test setup and teardown is aimed to be used with all functional tests. It does not include functionality to manipulate VMs (qemu). Test setup includes: - Setup all DUTs before test - Save VPP PIDs - Setup all TGs before traffic script - Update All Interface Data On All Nodes Test teardown includes: - Show Packet Trace on All DUTs - Show vpp trace dump on all DUTs - Vpp Show Errors On All DUTs - Check VPP PID in Teardown Change-Id: Ifee0bd58b7865442c5b510852908fd8363e3c543 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2016-11-04CSIT-458 Use node aware config in all perf TCspmikus2-27/+3
- Use node aware config in all perf TCs Change-Id: Icbf92bf232efef49d07c1324c64ae55125e90fb2 Signed-off-by: pmikus <pmikus@cisco.com>
2016-11-04CSIT-457: Address Honeycomb test failuresselias5-93/+91
- tag all not-implemented features with EXPECTED_FAILING - add workarounds for known issues with VAT dump commands - replace hardcoded test data with parametrized - separate IP neighbor and IP address into two test cases - support unordered lists with compare_data_structures keyword Change-Id: I2c683162325cee720ba496489787fa50e9c72b8c Signed-off-by: selias <samelias@cisco.com>
2016-11-03CSIT-245: IPv6 - ip4-lispgpe-ip6Zdeno Olsovsky1-6/+14
Change-Id: Ie88cadfc2eab31cd1f411b9648b1a3515e4baa89 Signed-off-by: Zdeno Olsovsky <zolsovsk@cisco.com> Signed-off-by: Matej Klotton <mklotton@cisco.com>
2016-10-31CSIT-385 CSIT-386 IPv4/IPv6 IPsec testsPatrik Hrnciar1-2/+26
- encryption/integrity key update tests Change-Id: Iddbe35e2f421b5048e60663bff2b0bf1968a9782 Signed-off-by: Patrik Hrnciar <phrnciar@cisco.com> Signed-off-by: Matej Klotton <mklotton@cisco.com>
2016-10-27Revert "Use 3 tries to prepare DUT for testing"Dave Wallace1-3/+1
This reverts commit d551ef4b72448c3ccb493559826b976a2d3d8649. Change-Id: Icff3a98b96298385a2e4789d40ef60d70f440492 Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
2016-10-26Use 3 tries to prepare DUT for testingJan Gelety1-1/+3
- workaround to deal with occasional vpp restart issue Change-Id: I74a9148045bf4f80c9ba943e9c74338e08b2a72e Signed-off-by: Jan Gelety <jgelety@cisco.com>
2016-10-25CSIT-453: Switch Nested VM to 1.4 in perfpmikus1-6/+2
Currently in performance testing we are using Nested VM v1.3 with DPDK16.07. This patch will change the Nested VM to version 1.4 which includes DPDK16.09. Change-Id: I7cf2edda09f677ad9ddd3cc882000b9537bcc74c Signed-off-by: pmikus <pmikus@cisco.com>
2016-10-24Use only Qemu Kill on the teardown of double qemu setupJan Gelety1-7/+1
- do not use Qemu System Powerdown or Qemu Quit in the teardown of double qemu setup - use just Qemu Kill there Change-Id: I8dd1e4055e0adb5d306e3a9904090a271d17c3e5 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2016-10-20CSIT-427: Honeycomb ietf-ACL tests - L4 and misc.selias1-1/+1
- add test cases for: L4 port range ACLs multiple classify rules L2 ACL on egress interface - add L4 configuration to mixed ACL test - add test variables for new test cases - update HTTPRequests to treat code 201 as a positive response Change-Id: If43007545fec174af12dab594f8a1b15b2e4a536 Signed-off-by: selias <samelias@cisco.com>
2016-10-20CSIT-427: Honeycomb ietf-ACL tests - mixed layersselias1-2/+2
- add test cases for mixing L2 and L3 rules - update methods with mixed-acl functionality - update test variables Change-Id: I2aaa3033eede609627f751ea896e098548ffae98 Signed-off-by: selias <samelias@cisco.com>
2016-10-20CSIT-427: Honeycomb ietf-ACL tests - L2selias3-4/+96
- add keywords for accessing Honeycomb's ietf-acl node - add variable file with ietf-acl test data - add ietf-acl traffic test suite - modify bridge domain teardown keyword to unassign interfaces from the bridge domain before delete Change-Id: I6df1771f2fb9b42f30b5af8f54a384c6714f5949 Signed-off-by: selias <samelias@cisco.com>
2016-10-17FIX: LISP performance 6o4 failingpmikus1-2/+2
Change-Id: I08cecbe8310fd21356287ffbb33c3be58b721f10 Signed-off-by: pmikus <pmikus@cisco.com>
2016-10-14CSIT-351: Testing Ubuntu 16.04.1 changespmikus1-4/+1
- Update the repository to get xenial packages - Update phy topology files with new pass - Update bootstrap to use new VIRL image - Update framework to reflect 16.04 dependencies - CSIT-116: Modify VIRL username/password Change-Id: I4de44755170fd0481acef34c7c2d9c299bc300da Signed-off-by: pmikus <pmikus@cisco.com>
2016-10-10Ipv6 TEST fixesMiroslav Miklus1-2/+2
- Increase interactive terminal timeout - ip6 heapsize - performance lib fix Change-Id: Iac6beb041200c4b0c5cf29dceb5113df64c6c9b0 Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2016-10-07CSIT-257: L2enc - l2-eth-lispgpe-ip4 - L2BDZdeno Olsovsky1-0/+77
Change-Id: I0ee68f707c4175940538654f3a4bbd7d1a91bef1 Signed-off-by: Zdeno Olsovsky <zolsovsk@cisco.com>
2016-10-05IPv4 2M scale tests - adjust heapsize to 3GMiroslav Miklus1-0/+10
Change-Id: I78e700e2137fd35d79c9b6b5ba27bb21adc3f6fa Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2016-10-04CSIT-227, CSIT-240 IPv4/IPv6 Multipath routing testsPatrik Hrnciar1-0/+43
- add IPv4 Equal-cost multipath routing test - add IPv6 Equal-cost multipath routing test Change-Id: I62eaf9983b7767e124f80af7d8c8652ffc460cf8 Signed-off-by: Patrik Hrnciar <phrnciar@cisco.com>
2016-10-03CSIT-231: ip4-ipsec-lispgpe-ip4Tibor Frank1-0/+75
- main fib, - vrf, - phy2lisp Change-Id: I9fd97462f0b290dab860ac601fbb37b4cecfb909 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2016-10-03CSIT-235: Switched Port Analyzer mirroring (SPAN) - IPv4selias2-1/+57
- add library for SPAN setup - add telemetry traffic script and a keyword to run it - add "telemetry" folders for python and robot libraries - move IPFIX libraries to these new folders - add first SPAN test case, mirroring IPv4 ICMP packets Change-Id: Ibca35f724c13662bf80dce2d7e2649d1a0b8676a Signed-off-by: selias <samelias@cisco.com>
2016-10-03INMARSAT-54 Honeycomb configures PBBpmikus1-0/+118
- CRUD tests usinf Honeycomb REST API Change-Id: I4885cd0feb26f8ef56beb0d8848772ea2d42cb3a Signed-off-by: Tibor Frank <tifrank@cisco.com>
2016-10-03CSIT-405: Honeycomb test update and cleanupselias4-7/+40
- update suite setup and constants to allow test runs again - cleanup basic interface keywords - cleanup L2-fib test data - add "continue on failure" keyword to some partially failing tests - add teardown to all suites, restarts honeycomb if suite had test failures - fix minor PEP-8 violations in Topology.py Change-Id: Ic5b434af71f77855f81461b280299b8318932c5a Signed-off-by: selias <samelias@cisco.com>
2016-10-03LISP - implement changes done in VPP-376Tibor Frank1-8/+15
Change-Id: Ia9f7913522421b6fd9ecba18eb4d68bc0f3b3271 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2016-10-03CSIT-416: Remove performance rate variablespmikus1-164/+0
Change-Id: I15ee953990f2ac11be361f3d0954bc12b3a9351d Signed-off-by: pmikus <pmikus@cisco.com>
2016-09-22CSIT-411 Show Vhost Userpmikus1-0/+6
- Add keyword to show vhost user Change-Id: Ia844bbcb8507b8c7cbf6b7bb1a7dc8d10148d6f4 Signed-off-by: pmikus <pmikus@cisco.com>
2016-09-21Measure latency returns -1 if rate<=10kppsMiroslav Miklus1-16/+17
Change-Id: I25dca3e6ce7da1304211d87f1af72fceda6dc23b Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2016-09-20Documentation fix - show statsMiroslav Miklus1-1/+1
Change-Id: Ib5f3dc697d1da6a86b70c5ba7d8ea8711a2fc492 Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2016-09-15CSIT-408 sub-NDR latency measurementsMiroslav Miklus1-7/+63
- measure latency at 10% and 50% of found NDR. - fix the accuracy reported by T-REX (round to usec) Change-Id: I9fe2b5f942cb816db6fd0bb4262b48b8da6dac2f Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2016-09-15CSIT-404 Adjust DPDK testpmd startup parameterspmikus1-8/+8
Change-Id: If0f58e725e15aa01b61bc43b222c6254af9cd07e Signed-off-by: pmikus <pmikus@cisco.com>
2016-09-14CSIT-241: IPv6 Router Advertisementselias1-5/+44
- add traffic script to verify Router Solicitation response - add keyword to execute traffic script - add test case 02: retransmit RA message after set interval - add test case 03: respond to RS request Change-Id: I83d742713ae42d0a1baacf460c29c06d32669b9a Signed-off-by: selias <samelias@cisco.com>
2016-09-12CSIT-384: IPSEC IPv6 negative test casesJan Gelety1-1/+1
- use integrity and/or encryption key(s) different from integrity and encryption keys stored on VPP node to create tx packet on TG Change-Id: I0f02523ec7649b8a1555869bdc4b7090b7585cac Signed-off-by: Jan Gelety <jgelety@cisco.com>
2016-09-12CSIT-383: IPSEC IPv4 negative test casesJan Gelety1-0/+7
- use integrity and/or encryption key(s) different from integrity and encryption keys stored on VPP node to create tx packet on TG Change-Id: I38bf7e1dd6f488e605bad991c7a7f4d1ff226e8c Signed-off-by: Jan Gelety <jgelety@cisco.com>
2016-09-12Fix of Qemu issuesJan Gelety1-0/+2
- use path to IPUtil where KWs "Setup Network Namespace" and "Set Linux Interface IP" are used Change-Id: I012cb7df4b871353aa68c10ca7069de7a2ab5d3b Signed-off-by: Jan Gelety <jgelety@cisco.com>
2016-09-08CSIT-390 Replace rate calculation Ipmikus1-0/+1
- Replace static max rate variables by calculation of max rate based on nic limits Change-Id: I0f7f7e46c6f46f87dfa5f34b9b9fdb4610513081 Signed-off-by: pmikus <pmikus@cisco.com>
2016-09-06CSIT-353: MAP-T FIX: Add tx src mac to traffic scriptMatej Klotton1-3/+4
Change-Id: I011231c68dc470590323933dbdb3f33c3026559b Signed-off-by: Matej Klotton <mklotton@cisco.com>
2016-09-05CSIT-229: ip4-lispgpe-ip4Tibor Frank2-2/+151
- main fib, - vrf, - phy2lisp Change-Id: Ic9bacef4574dc07b25041c4cd0653825a65c94fb Signed-off-by: Tibor Frank <tifrank@cisco.com>
2016-08-26CSIT-124: IPv4 encapsulations - IP4-GRE-IP4Matej Klotton1-42/+97
- add gre test with multiple tunnel configured - configure tunnel source as a loopback - route from tunnel to tunnel - check droping unknown tunnel destination Change-Id: Ib522d158d9de5c66f556c6734ceadc994eea02d4 Signed-off-by: Matej Klotton <mklotton@cisco.com>
2016-08-25CSIT-234 IPFIX - ipv4 functional scaleselias1-0/+44
- add traffic script for classify session scale test - add keyword for classify session scale test - add packet scale and session scale test to IPFIX IPv4 suite Change-Id: I3abd07dbf705fe664b723916ce1d82cd9649a2ae Signed-off-by: selias <samelias@cisco.com>
2016-08-25CSIT-353: Add basic map-t testsMatej Klotton1-0/+93
Change-Id: I78075e445cdd61e0e3cf9353bddeaf6e6bc978fa Signed-off-by: Matej Klotton <mklotton@cisco.com>
2016-08-25CSIT-233 IPv4 IPFIX - baseline testsselias1-0/+67
- add scapy classes for parsing IPFIX packets - add vat scripts and keywords for settings up IPFIX - add IPv4 IPFIX test suite Change-Id: I80ab76ca361c7920a01a46ad720b1c04acd0d147 Signed-off-by: selias <samelias@cisco.com>