aboutsummaryrefslogtreecommitdiffstats
path: root/resources/libraries/robot
AgeCommit message (Collapse)AuthorFilesLines
2016-12-16CSIT-424: HC Test: JSON comparison function reworkselias3-5/+3
When comparing multi-level JSON trees, the exceptions raised carry more useful information. Keys and values not present in reference data are ignored. No longer puts chunks of honeycomb's log file into robot report. The entire log file will be archived after https://gerrit.fd.io/r/4171 Change-Id: Ib597080fa3d9b2c43463c76ee0d52f317ea072e7 Signed-off-by: selias <samelias@cisco.com>
2016-12-16Pylint fixesTibor Frank1-1/+1
- Fix PyLint errors - Fix comments in touched python modules Change-Id: I26db2d292a41969cf38b9b0bdd49c4fb15349102 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2016-12-15HC Test: fix archiving artifacts in csit-hc2vpp jobsselias1-1/+13
Change-Id: I392eac7404d5e1793a7de9d7a44b9defb89e7b9d Signed-off-by: selias <samelias@cisco.com>
2016-12-14vhost perf testing with Qemu 5t5pcpmikus1-12/+10
Currently we were using 3t3pc for Qemu (2t2pc testpmd). This is not enough anymore as we are testing VPP with 4t4pc. This patch is supposed to increase the number of core used by testpmd. Change-Id: Id58634c050b51943679a1f7cb74c624a98d81a27 Signed-off-by: pmikus <pmikus@cisco.com>
2016-12-13CSIT-470 Add option to configure CFS scheduler priority for VPPpmikus1-8/+16
Add option to configure CFS scheduler priority for VPP Change-Id: Id358ebe41d7e868fd412d554d886567f81894b86 Signed-off-by: pmikus <pmikus@cisco.com>
2016-12-12CSIT-484: HC Test: Add scripts for new hc2vpp jobsselias1-1/+1
- add package download script that also installs jvpp .jar to maven local repo - add bootstrap scripts for the new jobs Related ci-management commit: https://gerrit.fd.io/r/4171 Change-Id: I11ec3d93d3b6f6d84c0c1c5e54f166dab96a05ee Signed-off-by: selias <samelias@cisco.com>
2016-12-01CSIT-481: HC Test: Port mirroring (SPAN)selias1-0/+128
- add port mirroring test suite - add relevant keywords Change-Id: I4ff398dd2ab4323e2a53af2812bf07cbb7043252 Signed-off-by: selias <samelias@cisco.com>
2016-11-28CSIT-460: HC Test: Rework existing PBB testsselias1-11/+10
Rework PBB tests to account for changes in: https://gerrit.fd.io/r/2520 https://gerrit.fd.io/r/1833 Change-Id: Id18027c23e57180b76c8478b010a4e3a69a75e43 Signed-off-by: selias <samelias@cisco.com>
2016-11-25CSIT-425: HC Test: NSH-SFC test suiteselias1-0/+161
- add keyword to enable optional modules in Honeycomb (including NSH) - update honeycomb __init__.robot with the new keyword - add python and robot libraries for NSH tests - add NSH test suite (CRUD operations) Change-Id: I869069a138a51d56d25522163c3a6deefb316f46 Signed-off-by: selias <samelias@cisco.com>
2016-11-25CSIT-457: HC Test: Document expected test failuresselias1-39/+13
- add EXPECTED_FAILING tag to all known test failures - document every use of EXPECTED_FAILING tag ,include Jira issue ID - minor fixes to interface, sub-interface and ACL test suites Change-Id: If6a535bdacc297c03e8cfade8896cdec23498bc2 Signed-off-by: selias <samelias@cisco.com>
2016-11-21CSIT:454 - HC Test: Increase timeout for Honeycomb startupselias1-1/+1
Change-Id: I44288ecd8664e75b9acfbd2d0e03d9712f4010b1 Signed-off-by: selias <samelias@cisco.com>
2016-11-16CSIT-470 Add option to configure CFS scheduler priority for QEMUpmikus1-0/+3
Add option to configure CFS scheduler priority for QEMU Change-Id: I76da7f536e70a23a57cf5215ab60002f95532b19 Signed-off-by: pmikus <pmikus@cisco.com>
2016-11-16CSIT-454: HC Test: Improve logging on test failureselias2-1/+3
- set Honeycomb log level to TRACE before running Honeycomb tests - on a failed restconf request, print the last few lines of the log - show saved configuration during persistence suite restarts Change-Id: I07ee37a5403cfca946fd7ef25a42861273248fbe Signed-off-by: selias <samelias@cisco.com>
2016-11-15Switch to nested image 1.5 in perfpmikus1-1/+1
Change-Id: I9116eac4a5377258b73b62214ca876161d9ef171 Signed-off-by: pmikus <pmikus@cisco.com>
2016-11-08CSIT-423: HC Test: delete VxLAN interfaceselias1-0/+47
Modify VxLAN test cases to account for changes in Honeycomb. Change-Id: If2db55548b5472350d128bdfbb5bdd5289e1deef Signed-off-by: selias <samelias@cisco.com>
2016-11-07CSIT-465: Common test setup and teardownTibor Frank1-0/+38
This test setup and teardown is aimed to be used with all functional tests. It does not include functionality to manipulate VMs (qemu). Test setup includes: - Setup all DUTs before test - Save VPP PIDs - Setup all TGs before traffic script - Update All Interface Data On All Nodes Test teardown includes: - Show Packet Trace on All DUTs - Show vpp trace dump on all DUTs - Vpp Show Errors On All DUTs - Check VPP PID in Teardown Change-Id: Ifee0bd58b7865442c5b510852908fd8363e3c543 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2016-11-04CSIT-458 Use node aware config in all perf TCspmikus2-27/+3
- Use node aware config in all perf TCs Change-Id: Icbf92bf232efef49d07c1324c64ae55125e90fb2 Signed-off-by: pmikus <pmikus@cisco.com>
2016-11-04CSIT-457: Address Honeycomb test failuresselias5-93/+91
- tag all not-implemented features with EXPECTED_FAILING - add workarounds for known issues with VAT dump commands - replace hardcoded test data with parametrized - separate IP neighbor and IP address into two test cases - support unordered lists with compare_data_structures keyword Change-Id: I2c683162325cee720ba496489787fa50e9c72b8c Signed-off-by: selias <samelias@cisco.com>
2016-11-03CSIT-245: IPv6 - ip4-lispgpe-ip6Zdeno Olsovsky1-6/+14
Change-Id: Ie88cadfc2eab31cd1f411b9648b1a3515e4baa89 Signed-off-by: Zdeno Olsovsky <zolsovsk@cisco.com> Signed-off-by: Matej Klotton <mklotton@cisco.com>
2016-10-31CSIT-385 CSIT-386 IPv4/IPv6 IPsec testsPatrik Hrnciar1-2/+26
- encryption/integrity key update tests Change-Id: Iddbe35e2f421b5048e60663bff2b0bf1968a9782 Signed-off-by: Patrik Hrnciar <phrnciar@cisco.com> Signed-off-by: Matej Klotton <mklotton@cisco.com>
2016-10-27Revert "Use 3 tries to prepare DUT for testing"Dave Wallace1-3/+1
This reverts commit d551ef4b72448c3ccb493559826b976a2d3d8649. Change-Id: Icff3a98b96298385a2e4789d40ef60d70f440492 Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
2016-10-26Use 3 tries to prepare DUT for testingJan Gelety1-1/+3
- workaround to deal with occasional vpp restart issue Change-Id: I74a9148045bf4f80c9ba943e9c74338e08b2a72e Signed-off-by: Jan Gelety <jgelety@cisco.com>
2016-10-25CSIT-453: Switch Nested VM to 1.4 in perfpmikus1-6/+2
Currently in performance testing we are using Nested VM v1.3 with DPDK16.07. This patch will change the Nested VM to version 1.4 which includes DPDK16.09. Change-Id: I7cf2edda09f677ad9ddd3cc882000b9537bcc74c Signed-off-by: pmikus <pmikus@cisco.com>
2016-10-24Use only Qemu Kill on the teardown of double qemu setupJan Gelety1-7/+1
- do not use Qemu System Powerdown or Qemu Quit in the teardown of double qemu setup - use just Qemu Kill there Change-Id: I8dd1e4055e0adb5d306e3a9904090a271d17c3e5 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2016-10-20CSIT-427: Honeycomb ietf-ACL tests - L4 and misc.selias1-1/+1
- add test cases for: L4 port range ACLs multiple classify rules L2 ACL on egress interface - add L4 configuration to mixed ACL test - add test variables for new test cases - update HTTPRequests to treat code 201 as a positive response Change-Id: If43007545fec174af12dab594f8a1b15b2e4a536 Signed-off-by: selias <samelias@cisco.com>
2016-10-20CSIT-427: Honeycomb ietf-ACL tests - mixed layersselias1-2/+2
- add test cases for mixing L2 and L3 rules - update methods with mixed-acl functionality - update test variables Change-Id: I2aaa3033eede609627f751ea896e098548ffae98 Signed-off-by: selias <samelias@cisco.com>
2016-10-20CSIT-427: Honeycomb ietf-ACL tests - L2selias3-4/+96
- add keywords for accessing Honeycomb's ietf-acl node - add variable file with ietf-acl test data - add ietf-acl traffic test suite - modify bridge domain teardown keyword to unassign interfaces from the bridge domain before delete Change-Id: I6df1771f2fb9b42f30b5af8f54a384c6714f5949 Signed-off-by: selias <samelias@cisco.com>
2016-10-17FIX: LISP performance 6o4 failingpmikus1-2/+2
Change-Id: I08cecbe8310fd21356287ffbb33c3be58b721f10 Signed-off-by: pmikus <pmikus@cisco.com>
2016-10-14CSIT-351: Testing Ubuntu 16.04.1 changespmikus1-4/+1
- Update the repository to get xenial packages - Update phy topology files with new pass - Update bootstrap to use new VIRL image - Update framework to reflect 16.04 dependencies - CSIT-116: Modify VIRL username/password Change-Id: I4de44755170fd0481acef34c7c2d9c299bc300da Signed-off-by: pmikus <pmikus@cisco.com>
2016-10-10Ipv6 TEST fixesMiroslav Miklus1-2/+2
- Increase interactive terminal timeout - ip6 heapsize - performance lib fix Change-Id: Iac6beb041200c4b0c5cf29dceb5113df64c6c9b0 Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2016-10-07CSIT-257: L2enc - l2-eth-lispgpe-ip4 - L2BDZdeno Olsovsky1-0/+77
Change-Id: I0ee68f707c4175940538654f3a4bbd7d1a91bef1 Signed-off-by: Zdeno Olsovsky <zolsovsk@cisco.com>
2016-10-05IPv4 2M scale tests - adjust heapsize to 3GMiroslav Miklus1-0/+10
Change-Id: I78e700e2137fd35d79c9b6b5ba27bb21adc3f6fa Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2016-10-04CSIT-227, CSIT-240 IPv4/IPv6 Multipath routing testsPatrik Hrnciar1-0/+43
- add IPv4 Equal-cost multipath routing test - add IPv6 Equal-cost multipath routing test Change-Id: I62eaf9983b7767e124f80af7d8c8652ffc460cf8 Signed-off-by: Patrik Hrnciar <phrnciar@cisco.com>
2016-10-03CSIT-231: ip4-ipsec-lispgpe-ip4Tibor Frank1-0/+75
- main fib, - vrf, - phy2lisp Change-Id: I9fd97462f0b290dab860ac601fbb37b4cecfb909 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2016-10-03CSIT-235: Switched Port Analyzer mirroring (SPAN) - IPv4selias2-1/+57
- add library for SPAN setup - add telemetry traffic script and a keyword to run it - add "telemetry" folders for python and robot libraries - move IPFIX libraries to these new folders - add first SPAN test case, mirroring IPv4 ICMP packets Change-Id: Ibca35f724c13662bf80dce2d7e2649d1a0b8676a Signed-off-by: selias <samelias@cisco.com>
2016-10-03INMARSAT-54 Honeycomb configures PBBpmikus1-0/+118
- CRUD tests usinf Honeycomb REST API Change-Id: I4885cd0feb26f8ef56beb0d8848772ea2d42cb3a Signed-off-by: Tibor Frank <tifrank@cisco.com>
2016-10-03CSIT-405: Honeycomb test update and cleanupselias4-7/+40
- update suite setup and constants to allow test runs again - cleanup basic interface keywords - cleanup L2-fib test data - add "continue on failure" keyword to some partially failing tests - add teardown to all suites, restarts honeycomb if suite had test failures - fix minor PEP-8 violations in Topology.py Change-Id: Ic5b434af71f77855f81461b280299b8318932c5a Signed-off-by: selias <samelias@cisco.com>
2016-10-03LISP - implement changes done in VPP-376Tibor Frank1-8/+15
Change-Id: Ia9f7913522421b6fd9ecba18eb4d68bc0f3b3271 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2016-10-03CSIT-416: Remove performance rate variablespmikus1-164/+0
Change-Id: I15ee953990f2ac11be361f3d0954bc12b3a9351d Signed-off-by: pmikus <pmikus@cisco.com>
2016-09-22CSIT-411 Show Vhost Userpmikus1-0/+6
- Add keyword to show vhost user Change-Id: Ia844bbcb8507b8c7cbf6b7bb1a7dc8d10148d6f4 Signed-off-by: pmikus <pmikus@cisco.com>
2016-09-21Measure latency returns -1 if rate<=10kppsMiroslav Miklus1-16/+17
Change-Id: I25dca3e6ce7da1304211d87f1af72fceda6dc23b Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2016-09-20Documentation fix - show statsMiroslav Miklus1-1/+1
Change-Id: Ib5f3dc697d1da6a86b70c5ba7d8ea8711a2fc492 Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2016-09-15CSIT-408 sub-NDR latency measurementsMiroslav Miklus1-7/+63
- measure latency at 10% and 50% of found NDR. - fix the accuracy reported by T-REX (round to usec) Change-Id: I9fe2b5f942cb816db6fd0bb4262b48b8da6dac2f Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2016-09-15CSIT-404 Adjust DPDK testpmd startup parameterspmikus1-8/+8
Change-Id: If0f58e725e15aa01b61bc43b222c6254af9cd07e Signed-off-by: pmikus <pmikus@cisco.com>
2016-09-14CSIT-241: IPv6 Router Advertisementselias1-5/+44
- add traffic script to verify Router Solicitation response - add keyword to execute traffic script - add test case 02: retransmit RA message after set interval - add test case 03: respond to RS request Change-Id: I83d742713ae42d0a1baacf460c29c06d32669b9a Signed-off-by: selias <samelias@cisco.com>
2016-09-12CSIT-384: IPSEC IPv6 negative test casesJan Gelety1-1/+1
- use integrity and/or encryption key(s) different from integrity and encryption keys stored on VPP node to create tx packet on TG Change-Id: I0f02523ec7649b8a1555869bdc4b7090b7585cac Signed-off-by: Jan Gelety <jgelety@cisco.com>
2016-09-12CSIT-383: IPSEC IPv4 negative test casesJan Gelety1-0/+7
- use integrity and/or encryption key(s) different from integrity and encryption keys stored on VPP node to create tx packet on TG Change-Id: I38bf7e1dd6f488e605bad991c7a7f4d1ff226e8c Signed-off-by: Jan Gelety <jgelety@cisco.com>
2016-09-12Fix of Qemu issuesJan Gelety1-0/+2
- use path to IPUtil where KWs "Setup Network Namespace" and "Set Linux Interface IP" are used Change-Id: I012cb7df4b871353aa68c10ca7069de7a2ab5d3b Signed-off-by: Jan Gelety <jgelety@cisco.com>
2016-09-08CSIT-390 Replace rate calculation Ipmikus1-0/+1
- Replace static max rate variables by calculation of max rate based on nic limits Change-Id: I0f7f7e46c6f46f87dfa5f34b9b9fdb4610513081 Signed-off-by: pmikus <pmikus@cisco.com>
2016-09-06CSIT-353: MAP-T FIX: Add tx src mac to traffic scriptMatej Klotton1-3/+4
Change-Id: I011231c68dc470590323933dbdb3f33c3026559b Signed-off-by: Matej Klotton <mklotton@cisco.com>