aboutsummaryrefslogtreecommitdiffstats
path: root/resources/libraries/robot/honeycomb
AgeCommit message (Collapse)AuthorFilesLines
2017-02-15HC Test: ACL updatesselias1-28/+78
- update low level ACL based on yang model changes - remove ietf-ACL test suite and test data and keywords - add ACL-plugin test suite, test data and keywords The ietf model of ACLs is no longer supported in Honeycomb. It has been replaced by the ACL plugin. Change-Id: Ic2c2a3e11c9717d1d3885275f6b868a0098343f9 Signed-off-by: selias <samelias@cisco.com>
2017-01-27CSIT-506: HC Test- Update and cleanup all suitesselias3-19/+16
- remove EXPECTED_FAILING tag from IPv4 neighbor, IPv6 address, MTU - fix bridge domain removal with interfaces assigned, it should fail - fix teardown of L2 FIB suite (bridge domain removal, see above) - disable vhost-user "server" test cases (VPP bug) - fix keyword verifying sub-interface state - update ACL test data (yang model changes) - remove EXPECTED_FAILING tag from ACL table removal test - update Jira IDs and comments in failing Lisp test case - remove EXPECTED_FAILING tag from Lisp removal test case - use vhost-user "client" instead of "server" in persistence tests Change-Id: I32eafb6013b4512090c0d9365e10c61029179d49 Signed-off-by: selias <samelias@cisco.com>
2017-01-10CSIT-482: HC Test - NATselias1-0/+174
- add NAT test suite - add keywords and methods for configuring and reading NAT settings - add test data used in NAT suite Change-Id: Iaa2ac1eb156bc9bcff41ec242318f6a973210d38 Signed-off-by: selias <samelias@cisco.com>
2016-12-16CSIT-484: HC Test: Lispselias1-0/+324
- add Lisp test suite - add Lisp test data - add keywords and methods used in Lisp tests Change-Id: Ie7819e20cf48e7dac106d60cce316ce69ab75786 Signed-off-by: selias <samelias@cisco.com>
2016-12-16CSIT-424: HC Test: JSON comparison function reworkselias3-5/+3
When comparing multi-level JSON trees, the exceptions raised carry more useful information. Keys and values not present in reference data are ignored. No longer puts chunks of honeycomb's log file into robot report. The entire log file will be archived after https://gerrit.fd.io/r/4171 Change-Id: Ib597080fa3d9b2c43463c76ee0d52f317ea072e7 Signed-off-by: selias <samelias@cisco.com>
2016-12-15HC Test: fix archiving artifacts in csit-hc2vpp jobsselias1-1/+13
Change-Id: I392eac7404d5e1793a7de9d7a44b9defb89e7b9d Signed-off-by: selias <samelias@cisco.com>
2016-12-12CSIT-484: HC Test: Add scripts for new hc2vpp jobsselias1-1/+1
- add package download script that also installs jvpp .jar to maven local repo - add bootstrap scripts for the new jobs Related ci-management commit: https://gerrit.fd.io/r/4171 Change-Id: I11ec3d93d3b6f6d84c0c1c5e54f166dab96a05ee Signed-off-by: selias <samelias@cisco.com>
2016-12-01CSIT-481: HC Test: Port mirroring (SPAN)selias1-0/+128
- add port mirroring test suite - add relevant keywords Change-Id: I4ff398dd2ab4323e2a53af2812bf07cbb7043252 Signed-off-by: selias <samelias@cisco.com>
2016-11-28CSIT-460: HC Test: Rework existing PBB testsselias1-11/+10
Rework PBB tests to account for changes in: https://gerrit.fd.io/r/2520 https://gerrit.fd.io/r/1833 Change-Id: Id18027c23e57180b76c8478b010a4e3a69a75e43 Signed-off-by: selias <samelias@cisco.com>
2016-11-25CSIT-425: HC Test: NSH-SFC test suiteselias1-0/+161
- add keyword to enable optional modules in Honeycomb (including NSH) - update honeycomb __init__.robot with the new keyword - add python and robot libraries for NSH tests - add NSH test suite (CRUD operations) Change-Id: I869069a138a51d56d25522163c3a6deefb316f46 Signed-off-by: selias <samelias@cisco.com>
2016-11-25CSIT-457: HC Test: Document expected test failuresselias1-39/+13
- add EXPECTED_FAILING tag to all known test failures - document every use of EXPECTED_FAILING tag ,include Jira issue ID - minor fixes to interface, sub-interface and ACL test suites Change-Id: If6a535bdacc297c03e8cfade8896cdec23498bc2 Signed-off-by: selias <samelias@cisco.com>
2016-11-21CSIT:454 - HC Test: Increase timeout for Honeycomb startupselias1-1/+1
Change-Id: I44288ecd8664e75b9acfbd2d0e03d9712f4010b1 Signed-off-by: selias <samelias@cisco.com>
2016-11-16CSIT-454: HC Test: Improve logging on test failureselias2-1/+3
- set Honeycomb log level to TRACE before running Honeycomb tests - on a failed restconf request, print the last few lines of the log - show saved configuration during persistence suite restarts Change-Id: I07ee37a5403cfca946fd7ef25a42861273248fbe Signed-off-by: selias <samelias@cisco.com>
2016-11-08CSIT-423: HC Test: delete VxLAN interfaceselias1-0/+47
Modify VxLAN test cases to account for changes in Honeycomb. Change-Id: If2db55548b5472350d128bdfbb5bdd5289e1deef Signed-off-by: selias <samelias@cisco.com>
2016-11-04CSIT-457: Address Honeycomb test failuresselias5-93/+91
- tag all not-implemented features with EXPECTED_FAILING - add workarounds for known issues with VAT dump commands - replace hardcoded test data with parametrized - separate IP neighbor and IP address into two test cases - support unordered lists with compare_data_structures keyword Change-Id: I2c683162325cee720ba496489787fa50e9c72b8c Signed-off-by: selias <samelias@cisco.com>
2016-10-20CSIT-427: Honeycomb ietf-ACL tests - L4 and misc.selias1-1/+1
- add test cases for: L4 port range ACLs multiple classify rules L2 ACL on egress interface - add L4 configuration to mixed ACL test - add test variables for new test cases - update HTTPRequests to treat code 201 as a positive response Change-Id: If43007545fec174af12dab594f8a1b15b2e4a536 Signed-off-by: selias <samelias@cisco.com>
2016-10-20CSIT-427: Honeycomb ietf-ACL tests - mixed layersselias1-2/+2
- add test cases for mixing L2 and L3 rules - update methods with mixed-acl functionality - update test variables Change-Id: I2aaa3033eede609627f751ea896e098548ffae98 Signed-off-by: selias <samelias@cisco.com>
2016-10-20CSIT-427: Honeycomb ietf-ACL tests - L2selias3-4/+96
- add keywords for accessing Honeycomb's ietf-acl node - add variable file with ietf-acl test data - add ietf-acl traffic test suite - modify bridge domain teardown keyword to unassign interfaces from the bridge domain before delete Change-Id: I6df1771f2fb9b42f30b5af8f54a384c6714f5949 Signed-off-by: selias <samelias@cisco.com>
2016-10-03INMARSAT-54 Honeycomb configures PBBpmikus1-0/+118
- CRUD tests usinf Honeycomb REST API Change-Id: I4885cd0feb26f8ef56beb0d8848772ea2d42cb3a Signed-off-by: Tibor Frank <tifrank@cisco.com>
2016-10-03CSIT-405: Honeycomb test update and cleanupselias4-7/+40
- update suite setup and constants to allow test runs again - cleanup basic interface keywords - cleanup L2-fib test data - add "continue on failure" keyword to some partially failing tests - add teardown to all suites, restarts honeycomb if suite had test failures - fix minor PEP-8 violations in Topology.py Change-Id: Ic5b434af71f77855f81461b280299b8318932c5a Signed-off-by: selias <samelias@cisco.com>
2016-08-23CSIT-369 Update Honeycomb persistence data locationselias1-70/+0
- update persistence cleanup method with new file path - remove unnecessary test case for bvi in multiple bridge domains - remove unused bridge domain keywords Change-Id: Ib5378f47af4a03ec5663a79db4c0dc1bf054c557 Signed-off-by: selias <samelias@cisco.com>
2016-08-08Update Honeycomb directory locationselias1-1/+2
- update "REMOTE_HC_DIR" constant - update location of "MTU" setting in interface operational data Change-Id: Id455ec4f3f03107f628913356801f4c21c5704b3 Signed-off-by: selias <samelias@cisco.com>
2016-07-22CSIT-219: Realocate resources for Honeycomb testsTibor Frank3-4/+4
- move the resources to resources/test_data/honeycomb Change-Id: I77c1bd5707f557799a7a189a9c695c50e5471621 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2016-07-21CSIT-49: HC Test: Policy - security groupsselias1-0/+339
- add test suite for ACLs - add keywords used in tests - add resource file with variables used in ACL tests - add methods and VAT templates for reading VPP ACL data Change-Id: I98c78bfbce67309ae33ebb05c04640f5029bf4e2 Signed-off-by: selias <samelias@cisco.com>
2016-07-20CSIT-190 Add honeycomb interface management testselias2-17/+62
- add test for specific issue with interface management through netconf - add keywords used in test - update methods that manage Netconf communication - update notifications tests to reuse more code Change-Id: I11788e18f05c4965160f247c3811d270d2c91170 Signed-off-by: selias <samelias@cisco.com>
2016-07-11CSIT-184: Add Honeycomb sub-interface ipv4 testsselias1-0/+119
- add tests for sub-interface ipv4 support - add keywords and methods used in tests Change-Id: I98af193a4c4f0d3822eb9637f01acead37accb8c Signed-off-by: selias <samelias@cisco.com>
2016-06-30Rename Honeycomb test suitesselias2-5/+8
- update test suite numbering to be future-proof - reorder suite execution: - persistence suite should always run last - l2_fib suite follows after l2 - VxLAN gpe suite follows after VxLAN - fix issue with interface name vs. index introduced in change #1032 - change ${node} variable to global scope, set in _init_.robot Change-Id: Ib4ca7265586026faab219da9923e7ca312ef2c79 Signed-off-by: selias <samelias@cisco.com>
2016-06-28Update Honeycomb testsselias2-14/+153
- add new negative test for bridged-virtual-interface setting - modify variables in original bd tests to use bvi=False - separate interface ipv4 test case into netmask and prefix - replace per-testcase tag definitions with per-suite forced tags - add separate tag for persistence suite, due to it's long execution time Change-Id: I79ae699125d4838ed8b394dc80a028e08b4de684 Signed-off-by: selias <samelias@cisco.com>
2016-06-28Add Honeycomb notifications testsselias2-1/+77
JIRA: CSIT-164 - add test cases for implemented notifications - add keywords used to receive and read notifications Change-Id: I3359aa83dca49ca362bf4406520ded1d36b67bda Signed-off-by: selias <samelias@cisco.com>
2016-06-27Add Vlan tag rewrite to Honeycomb persistence testsselias1-0/+6
JIRA: CSIT-137 - add Vlan tag rewrite to persisted configuration Change-Id: I2f98d89c6ada0eec5a7ba0121332201dbe2c01e0 Signed-off-by: selias <samelias@cisco.com>
2016-06-27Modify tests and keywords for sub-interfaces.Tibor Frank1-0/+72
JIRA: CSIT-175 - modify tests and keywords for sub-interfaces to reflect the last changes introduced by https://gerrit.fd.io/r/#/c/1700/ - fix typos Change-Id: I0839fe9f17149fa8c39ac31004bb2096d79c469f Signed-off-by: Tibor Frank <tifrank@cisco.com>
2016-06-24Update Honeycomb persistence tests with new Vlanselias1-30/+34
JIRA: CSIT-140 - add new vlan configuration to persistence Change-Id: I984f39986f74168b31d82143c353c7ef1bd7d650 Signed-off-by: selias <samelias@cisco.com>
2016-06-23Add tests for Honeycomb L2 FIB supportTibor Frank2-27/+295
JIRA: CSIT-168 - add tests for Honeycomb L2 FIB support - add keywords for Honeycomb L2 FIB support - fix typos Change-Id: I81292c10e26e7ad05725034c1db1db0a81d29283 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2016-06-20Modify tests for Honeycomb sub-interfacesTibor Frank3-244/+268
JIRA: CSIT-139 - modify tests for Honeycomb sub-interfaces to reflect the last changes in the model - modify existing keywords to work with latest changes in Honyecomb and VPP Change-Id: Idc88fbac7e743e6125d5c865d9d144448657dd20 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2016-06-08Add Tests for Honeycomb VxLAN GPE supportTibor Frank3-34/+224
JIRA: CSIT-131 - add tests for Honeycomb VxLAN GPE support - add keywords needed for tests Change-Id: I460ecd30835bb95140958b20946b1d41ac6d9abc Signed-off-by: Tibor Frank <tifrank@cisco.com>
2016-06-07Add Honeycomb persistence testsselias2-0/+238
JIRA: CSIT-121 - add honeycomb persistence test suite - add keywords used by persistence tests - add methods for working with Honeycomb persistence files - make suite setup clear persisted data before Honeycomb startup Change-Id: Ief61c12b730d58a456566c4683c0091e08a09b56 Signed-off-by: selias <samelias@cisco.com>
2016-06-01Add Honeycomb sub-interface and VLAN testsTibor Frank2-1/+413
JIRA: CSIT-94 JIRA: CSIT-48 - add Honeycomb sub-interface tests - add Honeycomb VLAN tests - add keywords for sub-interface tests - add keywords for VLAN tests Change-Id: I89cd3b41dd9c60bfd946e24567d0ff93e5ea9fff Signed-off-by: Tibor Frank <tifrank@cisco.com>
2016-05-30Update Honeycomb testsselias4-13/+15
- add new test cases based on reported bugs - minor fixes Change-Id: I8b7464bc1f4e786e3a0ef67ba64d81e1c25ae5cf Signed-off-by: selias <samelias@cisco.com>
2016-05-20Add Honeycomb TAP interface testselias2-1/+147
JIRA: CSIT-75 - add test suite for TAP interface management through Honeycomb - add keywords required for TAP interface tests - move Honeycomb suite setup and teardown to new __init__ file - cleanup unused imports in Honeycomb test case files - modify "...should be empty" keywords to allow more reuse Change-Id: Ie3dc9069678b60c359f69c5a216e452e856a0107 Signed-off-by: selias <samelias@cisco.com>
2016-05-20Tests for vhost-user interface configurationTibor Frank1-0/+182
JIRA: CSIT-76 - add tests for vhost-user interface manipulation: - create, modify, delete - add negative tests: - wrong interface type - wrong configuration Change-Id: I09239ef099a6f9672895f9540762e5044123f7ec Signed-off-by: Tibor Frank <tifrank@cisco.com>
2016-05-16Add Honeycomb VxLAN test suiteselias2-66/+172
JIRA: CSIT-47 - add test suite for VxLAN management through Honeycomb - add keywords required for VxLAN management tests - add resource file with additional variables for testing - increment bridge domain test suite index Change-Id: Ica0d7ae15f5b7058832a944d5ca0c72026ba299c Signed-off-by: selias <samelias@cisco.com>
2016-05-16Update Honeycomb bridge domain testsselias1-10/+20
- fix interface assignment verification through VAT - add verification of split horizon group setting through VAT - clean up documentation of high level bridge domain keywords Change-Id: I7552494d68c6bbc86d3e5ddea4e29c6a7444d50c Signed-off-by: selias <samelias@cisco.com>
2016-05-12Update Honeycomb interface IPv4 testselias1-0/+18
- add verification of ipv4 subnet prefix support - modify keywords to allow setting ipv4 address with network prefix - fix variable definitions to evaluate numbers as ints, not strings - add exception to ipv4 netmask/prefix conversion method Change-Id: I9343ceb35856ddb33674d7067f1def6d40e99acc Signed-off-by: selias <samelias@cisco.com>
2016-05-11Move Honeycomb libraries to honeycomb subdirectory.Tibor Frank3-10/+9
- move all Honeycomb related libraries written in python to new directory resources/libraries/python/honeycomb - update all related includes in all source files Change-Id: Ifa96b8f670b456b14421929d6020ddf8e02d9cbc Signed-off-by: Tibor Frank <tifrank@cisco.com>
2016-05-09Add Honeycomb bridge domain management testsselias1-0/+202
JIRA: CSIT-41, CSIT-42, CSIT-43 - add test cases for Honecomb bridge domain management - add keywords used by these tests - prefix the names of Honeycomb test suites with numbers, so that they execute in a specific order - moved suite teardown with "Stop Honeycomb service" to bridge domain suite Note: Due to time constraints, the Honeycomb service cannot be restarted between executions of individual Honeycomb test suites. Therefore Honeycomb will be setup in the first test suite and shut down after the last one. Change-Id: I36b7f8335e5ba54985da5bd83730cf856d5ab48b Signed-off-by: selias <samelias@cisco.com>
2016-05-09Interface VxLAN testTibor Frank1-0/+65
JIRA: CSIT-45 - add test: Honeycomb modifies interface configuration - VxLAN - add keywords used in these tests to set and verify configuration - add method and vat template for dumping an interface's configured VxLAN - fixed requirements.txt Change-Id: I6d6c360a4d478a0e40eecf7c0235969e7c06f7a9 Signed-off-by: Tibor Frank <tifrank@cisco.com> Signed-off-by: C.J. Collier <cjcollier@linuxfoundation.org>
2016-05-06Add Honeycomb interface management tests (ipv4, ipv6, ethernet, routing)selias2-33/+281
- add test cases for managing ipv4, ipv6, ethernet and routing configuration on VPP interface - add keywords used in these tests to set and verify configuration - add method and vat template for dumping an interface's configured IP addresses - add method for converting between ipv4 netmasks and network prefixes - clean up documentation of older Honeycomb keywords Note: Test cases are tagged with a placeholder tag to allow manual test runs locally. It should be replaced with the appropriate environment tags once Honeycomb service is deployed on virl. Change-Id: I99ce1e72c8550f520f8c35ef4a93eaebb530db78 Signed-off-by: selias <samelias@cisco.com> Signed-off-by: Matej Klotton <mklotton@cisco.com>
2016-04-26Honeycomb interface state management testselias2-0/+135
- add simple test for interface management through Honeycomb API - add status code 500 to honeycomb startup check whitelist, due to Honeycomb changes in https://gerrit.fd.io/r/772 - increase timeout value for Honeycomb startup check - modify Honeycomb setup keywords to allow starting Honeycomb on individual nodes - remove sanity test suite, tests now sorted by functional areas such as interfaces, bridge domains, VXlan,... Change-Id: I87f9cf69577706f3b00e24a8d2c01df52fc707c6 Signed-off-by: selias <samuel.elias@pantheon.tech>