aboutsummaryrefslogtreecommitdiffstats
path: root/resources/libraries/robot
AgeCommit message (Collapse)AuthorFilesLines
2017-02-24CSIT-522 HC Test: tests for secondary IP addressselias1-22/+327
- fix and update ipv4 and ipv6 tests - add tests for ipv6 neighbor and vrf-id - add tests for secondary IP address on ipv4, ipv6 Change-Id: I1e422e61108493a63a65ad91f649e69dfff0842f Signed-off-by: selias <samelias@cisco.com>
2017-02-23Add pypcap python requirementMatej Klotton2-6/+10
Using pypcap's L2listen instead of standard AF_PACKET scapy can see received Dot1Q tag. Change-Id: Icb3dcb272a9611158a26a83fede7550bba3f367e Signed-off-by: Matej Klotton <mklotton@cisco.com>
2017-02-23QemuUtil lib change to work with ubuntu and centosMatej Klotton1-1/+1
- replace nc to socat for comunicating with qemu QGA - change disk type to use virtio driver - add check to bind only network interface for testpmd Change-Id: I19ab16cbd8fec1ec78263ccfb1309a144e5af845 Signed-off-by: Matej Klotton <mklotton@cisco.com>
2017-02-15HC Test: ACL updatesselias1-28/+78
- update low level ACL based on yang model changes - remove ietf-ACL test suite and test data and keywords - add ACL-plugin test suite, test data and keywords The ietf model of ACLs is no longer supported in Honeycomb. It has been replaced by the ACL plugin. Change-Id: Ic2c2a3e11c9717d1d3885275f6b868a0098343f9 Signed-off-by: selias <samelias@cisco.com>
2017-02-13Introduce simple VAT history per test caseJan Gelety1-1/+4
- print list of VAT commands executed per DUT node during the test case in the func test teardown Change-Id: I18a750ebfb7560eff9f5c4f0826ef84c3f64b4a8 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-02-10CSIT-518: Add testpmd numa awarenessTibor Frank1-33/+19
Change-Id: I982834de1fbe71cf5303808ea58d4b58e530ffcb Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-02-03CSIT-516: Add keywords for 2-node topologyTibor Frank2-21/+130
Change-Id: Ib5a1e207f1dec99747329a755c3c365fef4bd64c Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-01-27CSIT-506: HC Test- Update and cleanup all suitesselias3-19/+16
- remove EXPECTED_FAILING tag from IPv4 neighbor, IPv6 address, MTU - fix bridge domain removal with interfaces assigned, it should fail - fix teardown of L2 FIB suite (bridge domain removal, see above) - disable vhost-user "server" test cases (VPP bug) - fix keyword verifying sub-interface state - update ACL test data (yang model changes) - remove EXPECTED_FAILING tag from ACL table removal test - update Jira IDs and comments in failing Lisp test case - remove EXPECTED_FAILING tag from Lisp removal test case - use vhost-user "client" instead of "server" in persistence tests Change-Id: I32eafb6013b4512090c0d9365e10c61029179d49 Signed-off-by: selias <samelias@cisco.com>
2017-01-26Fix: Display of PDR latencypmikus1-3/+7
Fix the string in PDR latency output Change-Id: I7f244e29015da4e71485e88f2988efa73b6f4853 Signed-off-by: pmikus <pmikus@cisco.com>
2017-01-26CSIT-512: Add x710, xl710 l2bd vhost testsTibor Frank1-24/+51
- 10ge2p1x710-eth-l2bdbasemaclrn-eth-2vhost-1vm-ndrdisc - 40ge2p1xl710-eth-l2bdbasemaclrn-eth-2vhost-1vm-ndrdisc Change-Id: I99a70c8fcdfc0fffda96606033ba8752d6c07952 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-01-24CSIT-509: Add perf tests for vlan + l2 + vhostTibor Frank1-2/+82
Change-Id: I65e716b51dd35092c10574ac4580ee4b8bd3b24b Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-01-19Add unified latency output for PDRDISC and NDRDISCpmikus1-5/+7
Add same latency formatting for PDR as for NDR search results. This will help us to parse the data in same way. Change-Id: I3be79cc7623f8c9d39fd44babd252ceec58c114b Signed-off-by: pmikus <pmikus@cisco.com>
2017-01-17VIRL test: Replace IP probe for VXLAN testMatej Klotton1-2/+5
Change-Id: Ic16f91beabdc2ac2e19ccc65c04790d36c15d477 Signed-off-by: Matej Klotton <mklotton@cisco.com>
2017-01-13VIRL test: VXLAN-L2BD-vhos_user test (CSIT-500)Jan Gelety2-19/+44
- Create test cases to test VXLAN+L2BD+vhost_user IPv4 and IPv6 scenarios Change-Id: I46d27f22ec2e2e35fd5067ba7eeda9a2ccff9f84 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-01-11 Add the DPDK l2fwd performance test cases.Fangyin Hu2-9/+146
Change-Id: I996847a4871ed994cd9b5edb459fb079ff39c86d Signed-off-by: Fangyin Hu <fangyinx.hu@intel.com>
2017-01-10CSIT-482: HC Test - NATselias1-0/+174
- add NAT test suite - add keywords and methods for configuring and reading NAT settings - add test data used in NAT suite Change-Id: Iaa2ac1eb156bc9bcff41ec242318f6a973210d38 Signed-off-by: selias <samelias@cisco.com>
2017-01-10CSIT-499: Perf Tests - VXLAN + L2BD + vhostTibor Frank1-0/+44
- Packet throughput L2BD test cases with VXLANoIPv4 and vhost Change-Id: I6373ef232e5ce7155f8dec80ffa576a6a6b69b81 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-01-04CSIT-498: Packet throughput L2BD with VXLANoIPv4Tibor Frank1-0/+23
- Add performance tests for packet throughput L2BD with VXLANoIPv4 Change-Id: Id0872e1847f5a0e0eb37ba352bf75f56c51c7a45 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2016-12-16CSIT-484: HC Test: Lispselias1-0/+324
- add Lisp test suite - add Lisp test data - add keywords and methods used in Lisp tests Change-Id: Ie7819e20cf48e7dac106d60cce316ce69ab75786 Signed-off-by: selias <samelias@cisco.com>
2016-12-16CSIT-424: HC Test: JSON comparison function reworkselias3-5/+3
When comparing multi-level JSON trees, the exceptions raised carry more useful information. Keys and values not present in reference data are ignored. No longer puts chunks of honeycomb's log file into robot report. The entire log file will be archived after https://gerrit.fd.io/r/4171 Change-Id: Ib597080fa3d9b2c43463c76ee0d52f317ea072e7 Signed-off-by: selias <samelias@cisco.com>
2016-12-16Pylint fixesTibor Frank1-1/+1
- Fix PyLint errors - Fix comments in touched python modules Change-Id: I26db2d292a41969cf38b9b0bdd49c4fb15349102 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2016-12-15HC Test: fix archiving artifacts in csit-hc2vpp jobsselias1-1/+13
Change-Id: I392eac7404d5e1793a7de9d7a44b9defb89e7b9d Signed-off-by: selias <samelias@cisco.com>
2016-12-14vhost perf testing with Qemu 5t5pcpmikus1-12/+10
Currently we were using 3t3pc for Qemu (2t2pc testpmd). This is not enough anymore as we are testing VPP with 4t4pc. This patch is supposed to increase the number of core used by testpmd. Change-Id: Id58634c050b51943679a1f7cb74c624a98d81a27 Signed-off-by: pmikus <pmikus@cisco.com>
2016-12-13CSIT-470 Add option to configure CFS scheduler priority for VPPpmikus1-8/+16
Add option to configure CFS scheduler priority for VPP Change-Id: Id358ebe41d7e868fd412d554d886567f81894b86 Signed-off-by: pmikus <pmikus@cisco.com>
2016-12-12CSIT-484: HC Test: Add scripts for new hc2vpp jobsselias1-1/+1
- add package download script that also installs jvpp .jar to maven local repo - add bootstrap scripts for the new jobs Related ci-management commit: https://gerrit.fd.io/r/4171 Change-Id: I11ec3d93d3b6f6d84c0c1c5e54f166dab96a05ee Signed-off-by: selias <samelias@cisco.com>
2016-12-01CSIT-481: HC Test: Port mirroring (SPAN)selias1-0/+128
- add port mirroring test suite - add relevant keywords Change-Id: I4ff398dd2ab4323e2a53af2812bf07cbb7043252 Signed-off-by: selias <samelias@cisco.com>
2016-11-28CSIT-460: HC Test: Rework existing PBB testsselias1-11/+10
Rework PBB tests to account for changes in: https://gerrit.fd.io/r/2520 https://gerrit.fd.io/r/1833 Change-Id: Id18027c23e57180b76c8478b010a4e3a69a75e43 Signed-off-by: selias <samelias@cisco.com>
2016-11-25CSIT-425: HC Test: NSH-SFC test suiteselias1-0/+161
- add keyword to enable optional modules in Honeycomb (including NSH) - update honeycomb __init__.robot with the new keyword - add python and robot libraries for NSH tests - add NSH test suite (CRUD operations) Change-Id: I869069a138a51d56d25522163c3a6deefb316f46 Signed-off-by: selias <samelias@cisco.com>
2016-11-25CSIT-457: HC Test: Document expected test failuresselias1-39/+13
- add EXPECTED_FAILING tag to all known test failures - document every use of EXPECTED_FAILING tag ,include Jira issue ID - minor fixes to interface, sub-interface and ACL test suites Change-Id: If6a535bdacc297c03e8cfade8896cdec23498bc2 Signed-off-by: selias <samelias@cisco.com>
2016-11-21CSIT:454 - HC Test: Increase timeout for Honeycomb startupselias1-1/+1
Change-Id: I44288ecd8664e75b9acfbd2d0e03d9712f4010b1 Signed-off-by: selias <samelias@cisco.com>
2016-11-16CSIT-470 Add option to configure CFS scheduler priority for QEMUpmikus1-0/+3
Add option to configure CFS scheduler priority for QEMU Change-Id: I76da7f536e70a23a57cf5215ab60002f95532b19 Signed-off-by: pmikus <pmikus@cisco.com>
2016-11-16CSIT-454: HC Test: Improve logging on test failureselias2-1/+3
- set Honeycomb log level to TRACE before running Honeycomb tests - on a failed restconf request, print the last few lines of the log - show saved configuration during persistence suite restarts Change-Id: I07ee37a5403cfca946fd7ef25a42861273248fbe Signed-off-by: selias <samelias@cisco.com>
2016-11-15Switch to nested image 1.5 in perfpmikus1-1/+1
Change-Id: I9116eac4a5377258b73b62214ca876161d9ef171 Signed-off-by: pmikus <pmikus@cisco.com>
2016-11-08CSIT-423: HC Test: delete VxLAN interfaceselias1-0/+47
Modify VxLAN test cases to account for changes in Honeycomb. Change-Id: If2db55548b5472350d128bdfbb5bdd5289e1deef Signed-off-by: selias <samelias@cisco.com>
2016-11-07CSIT-465: Common test setup and teardownTibor Frank1-0/+38
This test setup and teardown is aimed to be used with all functional tests. It does not include functionality to manipulate VMs (qemu). Test setup includes: - Setup all DUTs before test - Save VPP PIDs - Setup all TGs before traffic script - Update All Interface Data On All Nodes Test teardown includes: - Show Packet Trace on All DUTs - Show vpp trace dump on all DUTs - Vpp Show Errors On All DUTs - Check VPP PID in Teardown Change-Id: Ifee0bd58b7865442c5b510852908fd8363e3c543 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2016-11-04CSIT-458 Use node aware config in all perf TCspmikus2-27/+3
- Use node aware config in all perf TCs Change-Id: Icbf92bf232efef49d07c1324c64ae55125e90fb2 Signed-off-by: pmikus <pmikus@cisco.com>
2016-11-04CSIT-457: Address Honeycomb test failuresselias5-93/+91
- tag all not-implemented features with EXPECTED_FAILING - add workarounds for known issues with VAT dump commands - replace hardcoded test data with parametrized - separate IP neighbor and IP address into two test cases - support unordered lists with compare_data_structures keyword Change-Id: I2c683162325cee720ba496489787fa50e9c72b8c Signed-off-by: selias <samelias@cisco.com>
2016-11-03CSIT-245: IPv6 - ip4-lispgpe-ip6Zdeno Olsovsky1-6/+14
Change-Id: Ie88cadfc2eab31cd1f411b9648b1a3515e4baa89 Signed-off-by: Zdeno Olsovsky <zolsovsk@cisco.com> Signed-off-by: Matej Klotton <mklotton@cisco.com>
2016-10-31CSIT-385 CSIT-386 IPv4/IPv6 IPsec testsPatrik Hrnciar1-2/+26
- encryption/integrity key update tests Change-Id: Iddbe35e2f421b5048e60663bff2b0bf1968a9782 Signed-off-by: Patrik Hrnciar <phrnciar@cisco.com> Signed-off-by: Matej Klotton <mklotton@cisco.com>
2016-10-27Revert "Use 3 tries to prepare DUT for testing"Dave Wallace1-3/+1
This reverts commit d551ef4b72448c3ccb493559826b976a2d3d8649. Change-Id: Icff3a98b96298385a2e4789d40ef60d70f440492 Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
2016-10-26Use 3 tries to prepare DUT for testingJan Gelety1-1/+3
- workaround to deal with occasional vpp restart issue Change-Id: I74a9148045bf4f80c9ba943e9c74338e08b2a72e Signed-off-by: Jan Gelety <jgelety@cisco.com>
2016-10-25CSIT-453: Switch Nested VM to 1.4 in perfpmikus1-6/+2
Currently in performance testing we are using Nested VM v1.3 with DPDK16.07. This patch will change the Nested VM to version 1.4 which includes DPDK16.09. Change-Id: I7cf2edda09f677ad9ddd3cc882000b9537bcc74c Signed-off-by: pmikus <pmikus@cisco.com>
2016-10-24Use only Qemu Kill on the teardown of double qemu setupJan Gelety1-7/+1
- do not use Qemu System Powerdown or Qemu Quit in the teardown of double qemu setup - use just Qemu Kill there Change-Id: I8dd1e4055e0adb5d306e3a9904090a271d17c3e5 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2016-10-20CSIT-427: Honeycomb ietf-ACL tests - L4 and misc.selias1-1/+1
- add test cases for: L4 port range ACLs multiple classify rules L2 ACL on egress interface - add L4 configuration to mixed ACL test - add test variables for new test cases - update HTTPRequests to treat code 201 as a positive response Change-Id: If43007545fec174af12dab594f8a1b15b2e4a536 Signed-off-by: selias <samelias@cisco.com>
2016-10-20CSIT-427: Honeycomb ietf-ACL tests - mixed layersselias1-2/+2
- add test cases for mixing L2 and L3 rules - update methods with mixed-acl functionality - update test variables Change-Id: I2aaa3033eede609627f751ea896e098548ffae98 Signed-off-by: selias <samelias@cisco.com>
2016-10-20CSIT-427: Honeycomb ietf-ACL tests - L2selias3-4/+96
- add keywords for accessing Honeycomb's ietf-acl node - add variable file with ietf-acl test data - add ietf-acl traffic test suite - modify bridge domain teardown keyword to unassign interfaces from the bridge domain before delete Change-Id: I6df1771f2fb9b42f30b5af8f54a384c6714f5949 Signed-off-by: selias <samelias@cisco.com>
2016-10-17FIX: LISP performance 6o4 failingpmikus1-2/+2
Change-Id: I08cecbe8310fd21356287ffbb33c3be58b721f10 Signed-off-by: pmikus <pmikus@cisco.com>
2016-10-14CSIT-351: Testing Ubuntu 16.04.1 changespmikus1-4/+1
- Update the repository to get xenial packages - Update phy topology files with new pass - Update bootstrap to use new VIRL image - Update framework to reflect 16.04 dependencies - CSIT-116: Modify VIRL username/password Change-Id: I4de44755170fd0481acef34c7c2d9c299bc300da Signed-off-by: pmikus <pmikus@cisco.com>
2016-10-10Ipv6 TEST fixesMiroslav Miklus1-2/+2
- Increase interactive terminal timeout - ip6 heapsize - performance lib fix Change-Id: Iac6beb041200c4b0c5cf29dceb5113df64c6c9b0 Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2016-10-07CSIT-257: L2enc - l2-eth-lispgpe-ip4 - L2BDZdeno Olsovsky1-0/+77
Change-Id: I0ee68f707c4175940538654f3a4bbd7d1a91bef1 Signed-off-by: Zdeno Olsovsky <zolsovsk@cisco.com>