aboutsummaryrefslogtreecommitdiffstats
path: root/tests/func/honeycomb
AgeCommit message (Collapse)AuthorFilesLines
2017-05-17CSIT-576 HC Test: Improve SPAN test coverageselias2-34/+172
- add test for multiple destination interfaces using one source interface - duplicate all existing cases using a sub-interface as the destination Change-Id: Ifabf78bca258247a19624b2b2a0474d21d1229d3 Signed-off-by: selias <samelias@cisco.com>
2017-05-17CSIT-577 HC Test: Scripts for test jobs using ODL clientselias1-5/+12
ODL client can be used to translate Restconf requests into Netconf. This way Honeycomb's Netconf interface can be tested using existing test cases. - add bootstrap scripts for verify and integration job - update __init__.robot to handle new {HC_ODL} variable Change-Id: I7e156dab3d5434dff246bfd02090f3c6bea81b86 Signed-off-by: selias <samelias@cisco.com>
2017-05-17CSIT-562 HC Test: Persistence suite rework, part1selias24-286/+346
- rename keywords that check operational data, to distinguish from keywords that check configuration data - modify existing persistence cases so that they don't affect each other - add feature-specific persistence tests for: Interface Management, L2 bridge - move Interface Management variables to separate file so they can be reused - add new tag HC_PERSIST to execute persistence tests separately - update existing Honeycomb tags to comply with CSIT conventions More feature-specific tests to be added in part2. Change-Id: I8657da4bb9e9a3d5261c04f5f1999b2572f605ef Signed-off-by: selias <samelias@cisco.com>
2017-05-17CSIT-563: HC Test: improved Lisp test coveragejan.hradil1-14/+60
added TC09-TC14 with following features: Map Resolver Map Server PETR configuration RLOC Probing Map Register Map Request mode Change-Id: I0e8a573e9a0f7ef3c688a014ff879e2b3d6b9b1e Signed-off-by: jan.hradil <jan.hradil@pantheon.tech> Signed-off-by: selias <samelias@cisco.com>
2017-05-03HC Test: Update honeycomb suite setupselias1-1/+1
- remove workaround for jVPP version mismatch - increase Java API command timeout Change-Id: Ic6a61ff029cc7cdfec1f75890e18599e3b05f019 Signed-off-by: selias <samelias@cisco.com>
2017-04-25CSIT-534 HC Test: policer testsjan.hradil2-1/+129
Added empty lines where needed Repaired Phrasese "Given" --> "And" where necessary in mgmt-cfg-policer-apihc-func.robot Corrected English in mgmt-cfg-policer-apihc-func.robot - in TC07 Documentation Change-Id: Id99d7fd04d8f2dcae1820baa208ce338fad3a290 Signed-off-by: jan.hradil <jan.hradil@pantheon.tech>
2017-04-21HC Test: update plugin-ACL test suiteselias1-74/+56
- fix variables in routed icmpv6 test case - remove EXPECTED_FAILING tag from IPv6 and ICMPv6 cases - create and use keywords for test teardown Change-Id: I91792b5900015827bc2bcfd138192f972f92df28 Signed-off-by: selias <samelias@cisco.com>
2017-04-18HC Test: update persistence suiteselias1-4/+7
- fix "enable persistence" is suite setup - update Jira links to persistence bug - log content of persistence file before each restart Change-Id: I68ad759ded5d6bee277cf946953c11f19628a9e7 Signed-off-by: selias <samelias@cisco.com>
2017-04-12HC Test: update URL paths with ODL mountpointselias2-2/+2
other minor fixes: - update teardown keyword in proxyARP suite - increase timeout for SLAAC traffic test Change-Id: Ia16d096c54ceac501a24d5d910dd18e33d900d2a Signed-off-by: selias <samelias@cisco.com>
2017-04-11CSIT-529 HC Test: SLAACjan.hradil1-0/+119
Change-Id: I14525a36d614372b7b418f1c10f95c371b7b8545 Signed-off-by: jan.hradil <jan.hradil@pantheon.tech>
2017-04-10HC Test: Fix proxyARP test teardownselias1-2/+0
- interface assignment is removed automatically with proxyARP settings Change-Id: Id0c7e8fd9cbb263e547ac5e2534f3e650115cb81 Signed-off-by: selias <samelias@cisco.com>
2017-04-07HC Test: update ACL-plugil test suiteselias1-4/+12
- add EXPECTED_FAILING tags to IPv6 cases, next-header 17 (UDP) does not hit the classify node - fix MAC address mixup in reflexive cases Change-Id: I3d2a6c73835e23b6755b033ac3a0cc3f28d932df Signed-off-by: selias <samelias@cisco.com>
2017-04-03HC Test: revert to using restconf over httpselias1-1/+1
- use http instead of https for restconf connection - add missing import to proxyARP robot library - use VAT interface dump to identify interfaces in VAT ip address dump Change-Id: Ic381ff3f9b56a6c633382450559134f5389956c2 Signed-off-by: selias <samelias@cisco.com>
2017-03-30HC Test: SPAN Port Mirroring Suitejan.hradil1-35/+76
Change-Id: Ideaae09aa0d062460f5dfb3e3732dee67d6a5aea Signed-off-by: jan.hradil <jan.hradil@pantheon.tech>
2017-03-30HC Test: address and cleanup test failuresselias6-64/+37
Change-Id: If3c570dbc5036915fdc68ade7a9ccc45ad21299e Signed-off-by: selias <samelias@cisco.com>
2017-03-30CSIT-532 HC Test: IPv6 Neighbor Discovery proxyselias2-1/+109
Change-Id: I6495726a814e116191f7a183be71c661466e7053 Signed-off-by: selias <samelias@cisco.com>
2017-03-30HC Test: support testing using ipv6 management interface and httpsselias2-2/+2
Change-Id: Ia38388a87171ad3bec7307f9ca74eaa99adc2624 Signed-off-by: selias <samelias@cisco.com>
2017-03-30CSIT-526 HC test: DHCP relayselias1-0/+119
Change-Id: I00d841bee1e5139a4530ce97d8bda17780caa0f1 Signed-off-by: selias <samelias@cisco.com>
2017-03-21CSIT-536 HC Test: support testing with ODL clientselias19-42/+53
Reuses existing restconf test cases to test Honeycomb's netconf interface. When seding the requests to ODL's Honeycomb mountpoint, ODL translates these requests to netconf RPCs. Add new tag "honeycomb_odl" that excludes incompatible test cases. Change-Id: Ie293449da0129b02db85e30aa4f3266928d7d9f6 Signed-off-by: selias <samelias@cisco.com>
2017-03-17CSIT-528 HC Test: proxyARP test suiteselias1-0/+80
Change-Id: I1f99d38aadee22a7354a1f89e9d7f395a401c96c Signed-off-by: selias <samelias@cisco.com>
2017-03-15CSIT-523 HC Test: routingselias1-0/+211
- add routing test suite, variables and keywords Change-Id: I57e180350c30221befe8d1fc4e3b146d394c4f5d Signed-off-by: selias <samelias@cisco.com>
2017-03-13HC Test: add test for vlan sub-interface ipv6 addressselias2-6/+65
Change-Id: I93e0e4caf9b8ed1be824c7f75f348c30e567b75f Signed-off-by: selias <samelias@cisco.com>
2017-03-13HC Test: add test for vlan sub-interface exact tag matchselias1-3/+20
Change-Id: Ie5feb1ac6c46f447a20d388680fc19854f2c7ef6 Signed-off-by: selias <samelias@cisco.com>
2017-03-13HC Test: create Vlan sub-interface using netconfselias1-0/+8
- add netconf test for specific issue HC2VPP-60 Change-Id: I8fc64bce40f1e43d93e7e92c952e564151bc8232 Signed-off-by: selias <samelias@cisco.com>
2017-02-27HC Test: update plugin-ACL testsselias1-20/+29
- improve packet trace logging after each test - suppress IPv6RA on VPP because it interfered with ipv6 test cases - do not use fictional destination MAC address, doesn't work in VIRL - ignore errors when logging configuration - should not fail the test Change-Id: I16a3321670d4c2fa8f6434dc4badd243b7e4f9fc Signed-off-by: selias <samelias@cisco.com>
2017-02-24CSIT-522 HC Test: tests for secondary IP addressselias1-14/+126
- fix and update ipv4 and ipv6 tests - add tests for ipv6 neighbor and vrf-id - add tests for secondary IP address on ipv4, ipv6 Change-Id: I1e422e61108493a63a65ad91f649e69dfff0842f Signed-off-by: selias <samelias@cisco.com>
2017-02-16HC Test: address job failuresselias3-3/+5
- make HC package download script correctly use the OS variable - force HC restart after netconf suite, to clean up leftover interfaces - remove EXPECTED_FAILING tag from vhost-user suite, VPP bug was fixed - add EXPECTED_FAILING tag to reflexive test case of plugin-acl suite Change-Id: Id56eb52a5e22718de31aa5bef27159a5a531b244 Signed-off-by: selias <samelias@cisco.com>
2017-02-15HC Test: ACL updatesselias2-375/+700
- update low level ACL based on yang model changes - remove ietf-ACL test suite and test data and keywords - add ACL-plugin test suite, test data and keywords The ietf model of ACLs is no longer supported in Honeycomb. It has been replaced by the ACL plugin. Change-Id: Ic2c2a3e11c9717d1d3885275f6b868a0098343f9 Signed-off-by: selias <samelias@cisco.com>
2017-01-27CSIT-506: HC Test- Update and cleanup all suitesselias15-82/+59
- remove EXPECTED_FAILING tag from IPv4 neighbor, IPv6 address, MTU - fix bridge domain removal with interfaces assigned, it should fail - fix teardown of L2 FIB suite (bridge domain removal, see above) - disable vhost-user "server" test cases (VPP bug) - fix keyword verifying sub-interface state - update ACL test data (yang model changes) - remove EXPECTED_FAILING tag from ACL table removal test - update Jira IDs and comments in failing Lisp test case - remove EXPECTED_FAILING tag from Lisp removal test case - use vhost-user "client" instead of "server" in persistence tests Change-Id: I32eafb6013b4512090c0d9365e10c61029179d49 Signed-off-by: selias <samelias@cisco.com>
2017-01-27HC Test: Workaround for 17.04 jvpp version mismatchselias2-1/+3
- add workaround for mismatched jvpp versions in deb packages - disable NSH_SFC madule and test suite, it depends on outdated jvpp - cleanup package download script used in hc2vpp-csit-verify job Change-Id: I98526baa4de08bbbab2339c9e81f49cd189b57ac Signed-off-by: selias <samelias@cisco.com>
2017-01-26csit-func-hc naming changeselias18-86/+86
- change test suite filenames - add numbering to all test cases more details at https://wiki.fd.io/view/CSIT/csit-perf-tc-naming-change Change-Id: I58e6c60f750c07e99c6949d8fe2510780fa9007a Signed-off-by: selias <samelias@cisco.com>
2017-01-10CSIT-482: HC Test - NATselias1-0/+104
- add NAT test suite - add keywords and methods for configuring and reading NAT settings - add test data used in NAT suite Change-Id: Iaa2ac1eb156bc9bcff41ec242318f6a973210d38 Signed-off-by: selias <samelias@cisco.com>
2016-12-16HC Test: Add EXPECTED_FAILING tag to expected test faluresselias3-3/+6
Change-Id: Ic197001f2bb5ad5be9246025502d49e90e0c44aa Signed-off-by: selias <samelias@cisco.com>
2016-12-16CSIT-484: HC Test: Lispselias1-0/+159
- add Lisp test suite - add Lisp test data - add keywords and methods used in Lisp tests Change-Id: Ie7819e20cf48e7dac106d60cce316ce69ab75786 Signed-off-by: selias <samelias@cisco.com>
2016-12-15HC Test: fix archiving artifacts in csit-hc2vpp jobsselias1-1/+3
Change-Id: I392eac7404d5e1793a7de9d7a44b9defb89e7b9d Signed-off-by: selias <samelias@cisco.com>
2016-12-01CSIT-481: HC Test: Port mirroring (SPAN)selias1-0/+64
- add port mirroring test suite - add relevant keywords Change-Id: I4ff398dd2ab4323e2a53af2812bf07cbb7043252 Signed-off-by: selias <samelias@cisco.com>
2016-11-28CSIT-460: HC Test: Rework existing PBB testsselias1-73/+22
Rework PBB tests to account for changes in: https://gerrit.fd.io/r/2520 https://gerrit.fd.io/r/1833 Change-Id: Id18027c23e57180b76c8478b010a4e3a69a75e43 Signed-off-by: selias <samelias@cisco.com>
2016-11-25CSIT-425: HC Test: NSH-SFC test suiteselias2-0/+128
- add keyword to enable optional modules in Honeycomb (including NSH) - update honeycomb __init__.robot with the new keyword - add python and robot libraries for NSH tests - add NSH test suite (CRUD operations) Change-Id: I869069a138a51d56d25522163c3a6deefb316f46 Signed-off-by: selias <samelias@cisco.com>
2016-11-25CSIT-457: HC Test: Document expected test failuresselias5-42/+63
- add EXPECTED_FAILING tag to all known test failures - document every use of EXPECTED_FAILING tag ,include Jira issue ID - minor fixes to interface, sub-interface and ACL test suites Change-Id: If6a535bdacc297c03e8cfade8896cdec23498bc2 Signed-off-by: selias <samelias@cisco.com>
2016-11-24CSIT-426: HC Test: Netconf transaction revertselias1-0/+27
- add test cases for reverting Netconf transactions - minor fixes to existing Netconf test case Change-Id: Id6e5d26f815b14da29194181bf333e845f5b623c Signed-off-by: selias <samelias@cisco.com>
2016-11-16CSIT-454: HC Test: Improve logging on test failureselias1-0/+1
- set Honeycomb log level to TRACE before running Honeycomb tests - on a failed restconf request, print the last few lines of the log - show saved configuration during persistence suite restarts Change-Id: I07ee37a5403cfca946fd7ef25a42861273248fbe Signed-off-by: selias <samelias@cisco.com>
2016-11-08CSIT-423: HC Test: delete VxLAN interfaceselias1-1/+12
Modify VxLAN test cases to account for changes in Honeycomb. Change-Id: If2db55548b5472350d128bdfbb5bdd5289e1deef Signed-off-by: selias <samelias@cisco.com>
2016-11-04CSIT-457: Address Honeycomb test failuresselias4-76/+65
- tag all not-implemented features with EXPECTED_FAILING - add workarounds for known issues with VAT dump commands - replace hardcoded test data with parametrized - separate IP neighbor and IP address into two test cases - support unordered lists with compare_data_structures keyword Change-Id: I2c683162325cee720ba496489787fa50e9c72b8c Signed-off-by: selias <samelias@cisco.com>
2016-10-20CSIT-427: Honeycomb ietf-ACL tests - L4 and misc.selias1-68/+158
- add test cases for: L4 port range ACLs multiple classify rules L2 ACL on egress interface - add L4 configuration to mixed ACL test - add test variables for new test cases - update HTTPRequests to treat code 201 as a positive response Change-Id: If43007545fec174af12dab594f8a1b15b2e4a536 Signed-off-by: selias <samelias@cisco.com>
2016-10-20CSIT-427: Honeycomb ietf-ACL tests - mixed layersselias1-6/+81
- add test cases for mixing L2 and L3 rules - update methods with mixed-acl functionality - update test variables Change-Id: I2aaa3033eede609627f751ea896e098548ffae98 Signed-off-by: selias <samelias@cisco.com>
2016-10-20CSIT-427: Honeycomb ietf-ACL tests - L3selias1-10/+137
- add test cases for layer 3 ACL - IPv4, IPv6, protocol/next-header - update methods with L3 functionality - update test variables Change-Id: Ia7ec03268845191021366621040dc411da0a2a93 Signed-off-by: selias <samelias@cisco.com>
2016-10-20CSIT-427: Honeycomb ietf-ACL tests - L2selias3-2/+87
- add keywords for accessing Honeycomb's ietf-acl node - add variable file with ietf-acl test data - add ietf-acl traffic test suite - modify bridge domain teardown keyword to unassign interfaces from the bridge domain before delete Change-Id: I6df1771f2fb9b42f30b5af8f54a384c6714f5949 Signed-off-by: selias <samelias@cisco.com>
2016-10-03INMARSAT-54 Honeycomb configures PBBpmikus1-0/+133
- CRUD tests usinf Honeycomb REST API Change-Id: I4885cd0feb26f8ef56beb0d8848772ea2d42cb3a Signed-off-by: Tibor Frank <tifrank@cisco.com>
2016-10-03CSIT-405: Honeycomb test update and cleanupselias13-76/+101
- update suite setup and constants to allow test runs again - cleanup basic interface keywords - cleanup L2-fib test data - add "continue on failure" keyword to some partially failing tests - add teardown to all suites, restarts honeycomb if suite had test failures - fix minor PEP-8 violations in Topology.py Change-Id: Ic5b434af71f77855f81461b280299b8318932c5a Signed-off-by: selias <samelias@cisco.com>
2016-08-23CSIT-369 Update Honeycomb persistence data locationselias1-13/+0
- update persistence cleanup method with new file path - remove unnecessary test case for bvi in multiple bridge domains - remove unused bridge domain keywords Change-Id: Ib5378f47af4a03ec5663a79db4c0dc1bf054c557 Signed-off-by: selias <samelias@cisco.com>