aboutsummaryrefslogtreecommitdiffstats
path: root/tests/func/honeycomb
AgeCommit message (Collapse)AuthorFilesLines
2017-06-29CSIT-687: Directory structure reorganizationTibor Frank25-4722/+0
Change-Id: I772c9e214be2461adf58124998d272e7d795220f Signed-off-by: Tibor Frank <tifrank@cisco.com> Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2017-06-26HC Test: improve functional suite setup and teardownselias25-151/+186
Restart the whole stack (VPP+Honeycomb+-ODL) in between test suites. Add generic suite setup and suite teardown keywords for all func suites Re-enable NSH_SFC suite, cleanup test failures Change-Id: I71025b4ed3a7c4912dcd7b62aedef6082357990c Signed-off-by: selias <samelias@cisco.com>
2017-06-22HC Test: update ACL plugin test dataselias1-1/+1
Reflexive ACL name changed in https://gerrit.fd.io/r/7153 Change-Id: I59afa91a1e170eb05d643ae41d46d757f047bacb Signed-off-by: selias <samelias@cisco.com>
2017-06-13CSIT-664: Refactor setups and teardownsTibor Frank25-61/+359
- Add suite setup for performance IPSec tests - Add test teardown for performance SNAT tests - Add setups and teardowns for functional tests - Clean up the code Change-Id: Ia456e9f3ff0f0f2bb9a03f692f27c7f9a2817621 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-06-08CSIT-662: KWI - KW renamingTibor Frank17-278/+278
- plus: CSIT-656: Script to rename robot keywords. Change-Id: Ia69917e406a1b346b80e5ea742f6200c1c9e9d21 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-06-05CSIT-610 HC Test: add test cases for unnumbered interfaceselias3-4/+122
- add interface and sub-interface tests with unnumbered config - modify interface IPv4 address assignment to handle custom interfaces and sub-interfaces - pylint and style fixes Change-Id: Ic39df1655b4d44f0025a2acef9f7f968929aeff5 Signed-off-by: selias <samelias@cisco.com>
2017-05-23HC Test: update proxyARP test caseselias1-6/+8
- update to better reflect test in CSIT-functional Change-Id: I7412bfea34c867cd14ee95b857f30d6923998ff2 Signed-off-by: selias <samelias@cisco.com>
2017-05-17CSIT-576 HC Test: Improve SPAN test coverageselias2-34/+172
- add test for multiple destination interfaces using one source interface - duplicate all existing cases using a sub-interface as the destination Change-Id: Ifabf78bca258247a19624b2b2a0474d21d1229d3 Signed-off-by: selias <samelias@cisco.com>
2017-05-17CSIT-577 HC Test: Scripts for test jobs using ODL clientselias1-5/+12
ODL client can be used to translate Restconf requests into Netconf. This way Honeycomb's Netconf interface can be tested using existing test cases. - add bootstrap scripts for verify and integration job - update __init__.robot to handle new {HC_ODL} variable Change-Id: I7e156dab3d5434dff246bfd02090f3c6bea81b86 Signed-off-by: selias <samelias@cisco.com>
2017-05-17CSIT-562 HC Test: Persistence suite rework, part1selias24-286/+346
- rename keywords that check operational data, to distinguish from keywords that check configuration data - modify existing persistence cases so that they don't affect each other - add feature-specific persistence tests for: Interface Management, L2 bridge - move Interface Management variables to separate file so they can be reused - add new tag HC_PERSIST to execute persistence tests separately - update existing Honeycomb tags to comply with CSIT conventions More feature-specific tests to be added in part2. Change-Id: I8657da4bb9e9a3d5261c04f5f1999b2572f605ef Signed-off-by: selias <samelias@cisco.com>
2017-05-17CSIT-563: HC Test: improved Lisp test coveragejan.hradil1-14/+60
added TC09-TC14 with following features: Map Resolver Map Server PETR configuration RLOC Probing Map Register Map Request mode Change-Id: I0e8a573e9a0f7ef3c688a014ff879e2b3d6b9b1e Signed-off-by: jan.hradil <jan.hradil@pantheon.tech> Signed-off-by: selias <samelias@cisco.com>
2017-05-03HC Test: Update honeycomb suite setupselias1-1/+1
- remove workaround for jVPP version mismatch - increase Java API command timeout Change-Id: Ic6a61ff029cc7cdfec1f75890e18599e3b05f019 Signed-off-by: selias <samelias@cisco.com>
2017-04-25CSIT-534 HC Test: policer testsjan.hradil2-1/+129
Added empty lines where needed Repaired Phrasese "Given" --> "And" where necessary in mgmt-cfg-policer-apihc-func.robot Corrected English in mgmt-cfg-policer-apihc-func.robot - in TC07 Documentation Change-Id: Id99d7fd04d8f2dcae1820baa208ce338fad3a290 Signed-off-by: jan.hradil <jan.hradil@pantheon.tech>
2017-04-21HC Test: update plugin-ACL test suiteselias1-74/+56
- fix variables in routed icmpv6 test case - remove EXPECTED_FAILING tag from IPv6 and ICMPv6 cases - create and use keywords for test teardown Change-Id: I91792b5900015827bc2bcfd138192f972f92df28 Signed-off-by: selias <samelias@cisco.com>
2017-04-18HC Test: update persistence suiteselias1-4/+7
- fix "enable persistence" is suite setup - update Jira links to persistence bug - log content of persistence file before each restart Change-Id: I68ad759ded5d6bee277cf946953c11f19628a9e7 Signed-off-by: selias <samelias@cisco.com>
2017-04-12HC Test: update URL paths with ODL mountpointselias2-2/+2
other minor fixes: - update teardown keyword in proxyARP suite - increase timeout for SLAAC traffic test Change-Id: Ia16d096c54ceac501a24d5d910dd18e33d900d2a Signed-off-by: selias <samelias@cisco.com>
2017-04-11CSIT-529 HC Test: SLAACjan.hradil1-0/+119
Change-Id: I14525a36d614372b7b418f1c10f95c371b7b8545 Signed-off-by: jan.hradil <jan.hradil@pantheon.tech>
2017-04-10HC Test: Fix proxyARP test teardownselias1-2/+0
- interface assignment is removed automatically with proxyARP settings Change-Id: Id0c7e8fd9cbb263e547ac5e2534f3e650115cb81 Signed-off-by: selias <samelias@cisco.com>
2017-04-07HC Test: update ACL-plugil test suiteselias1-4/+12
- add EXPECTED_FAILING tags to IPv6 cases, next-header 17 (UDP) does not hit the classify node - fix MAC address mixup in reflexive cases Change-Id: I3d2a6c73835e23b6755b033ac3a0cc3f28d932df Signed-off-by: selias <samelias@cisco.com>
2017-04-03HC Test: revert to using restconf over httpselias1-1/+1
- use http instead of https for restconf connection - add missing import to proxyARP robot library - use VAT interface dump to identify interfaces in VAT ip address dump Change-Id: Ic381ff3f9b56a6c633382450559134f5389956c2 Signed-off-by: selias <samelias@cisco.com>
2017-03-30HC Test: SPAN Port Mirroring Suitejan.hradil1-35/+76
Change-Id: Ideaae09aa0d062460f5dfb3e3732dee67d6a5aea Signed-off-by: jan.hradil <jan.hradil@pantheon.tech>
2017-03-30HC Test: address and cleanup test failuresselias6-64/+37
Change-Id: If3c570dbc5036915fdc68ade7a9ccc45ad21299e Signed-off-by: selias <samelias@cisco.com>
2017-03-30CSIT-532 HC Test: IPv6 Neighbor Discovery proxyselias2-1/+109
Change-Id: I6495726a814e116191f7a183be71c661466e7053 Signed-off-by: selias <samelias@cisco.com>
2017-03-30HC Test: support testing using ipv6 management interface and httpsselias2-2/+2
Change-Id: Ia38388a87171ad3bec7307f9ca74eaa99adc2624 Signed-off-by: selias <samelias@cisco.com>
2017-03-30CSIT-526 HC test: DHCP relayselias1-0/+119
Change-Id: I00d841bee1e5139a4530ce97d8bda17780caa0f1 Signed-off-by: selias <samelias@cisco.com>
2017-03-21CSIT-536 HC Test: support testing with ODL clientselias19-42/+53
Reuses existing restconf test cases to test Honeycomb's netconf interface. When seding the requests to ODL's Honeycomb mountpoint, ODL translates these requests to netconf RPCs. Add new tag "honeycomb_odl" that excludes incompatible test cases. Change-Id: Ie293449da0129b02db85e30aa4f3266928d7d9f6 Signed-off-by: selias <samelias@cisco.com>
2017-03-17CSIT-528 HC Test: proxyARP test suiteselias1-0/+80
Change-Id: I1f99d38aadee22a7354a1f89e9d7f395a401c96c Signed-off-by: selias <samelias@cisco.com>
2017-03-15CSIT-523 HC Test: routingselias1-0/+211
- add routing test suite, variables and keywords Change-Id: I57e180350c30221befe8d1fc4e3b146d394c4f5d Signed-off-by: selias <samelias@cisco.com>
2017-03-13HC Test: add test for vlan sub-interface ipv6 addressselias2-6/+65
Change-Id: I93e0e4caf9b8ed1be824c7f75f348c30e567b75f Signed-off-by: selias <samelias@cisco.com>
2017-03-13HC Test: add test for vlan sub-interface exact tag matchselias1-3/+20
Change-Id: Ie5feb1ac6c46f447a20d388680fc19854f2c7ef6 Signed-off-by: selias <samelias@cisco.com>
2017-03-13HC Test: create Vlan sub-interface using netconfselias1-0/+8
- add netconf test for specific issue HC2VPP-60 Change-Id: I8fc64bce40f1e43d93e7e92c952e564151bc8232 Signed-off-by: selias <samelias@cisco.com>
2017-02-27HC Test: update plugin-ACL testsselias1-20/+29
- improve packet trace logging after each test - suppress IPv6RA on VPP because it interfered with ipv6 test cases - do not use fictional destination MAC address, doesn't work in VIRL - ignore errors when logging configuration - should not fail the test Change-Id: I16a3321670d4c2fa8f6434dc4badd243b7e4f9fc Signed-off-by: selias <samelias@cisco.com>
2017-02-24CSIT-522 HC Test: tests for secondary IP addressselias1-14/+126
- fix and update ipv4 and ipv6 tests - add tests for ipv6 neighbor and vrf-id - add tests for secondary IP address on ipv4, ipv6 Change-Id: I1e422e61108493a63a65ad91f649e69dfff0842f Signed-off-by: selias <samelias@cisco.com>
2017-02-16HC Test: address job failuresselias3-3/+5
- make HC package download script correctly use the OS variable - force HC restart after netconf suite, to clean up leftover interfaces - remove EXPECTED_FAILING tag from vhost-user suite, VPP bug was fixed - add EXPECTED_FAILING tag to reflexive test case of plugin-acl suite Change-Id: Id56eb52a5e22718de31aa5bef27159a5a531b244 Signed-off-by: selias <samelias@cisco.com>
2017-02-15HC Test: ACL updatesselias2-375/+700
- update low level ACL based on yang model changes - remove ietf-ACL test suite and test data and keywords - add ACL-plugin test suite, test data and keywords The ietf model of ACLs is no longer supported in Honeycomb. It has been replaced by the ACL plugin. Change-Id: Ic2c2a3e11c9717d1d3885275f6b868a0098343f9 Signed-off-by: selias <samelias@cisco.com>
2017-01-27CSIT-506: HC Test- Update and cleanup all suitesselias15-82/+59
- remove EXPECTED_FAILING tag from IPv4 neighbor, IPv6 address, MTU - fix bridge domain removal with interfaces assigned, it should fail - fix teardown of L2 FIB suite (bridge domain removal, see above) - disable vhost-user "server" test cases (VPP bug) - fix keyword verifying sub-interface state - update ACL test data (yang model changes) - remove EXPECTED_FAILING tag from ACL table removal test - update Jira IDs and comments in failing Lisp test case - remove EXPECTED_FAILING tag from Lisp removal test case - use vhost-user "client" instead of "server" in persistence tests Change-Id: I32eafb6013b4512090c0d9365e10c61029179d49 Signed-off-by: selias <samelias@cisco.com>
2017-01-27HC Test: Workaround for 17.04 jvpp version mismatchselias2-1/+3
- add workaround for mismatched jvpp versions in deb packages - disable NSH_SFC madule and test suite, it depends on outdated jvpp - cleanup package download script used in hc2vpp-csit-verify job Change-Id: I98526baa4de08bbbab2339c9e81f49cd189b57ac Signed-off-by: selias <samelias@cisco.com>
2017-01-26csit-func-hc naming changeselias18-86/+86
- change test suite filenames - add numbering to all test cases more details at https://wiki.fd.io/view/CSIT/csit-perf-tc-naming-change Change-Id: I58e6c60f750c07e99c6949d8fe2510780fa9007a Signed-off-by: selias <samelias@cisco.com>
2017-01-10CSIT-482: HC Test - NATselias1-0/+104
- add NAT test suite - add keywords and methods for configuring and reading NAT settings - add test data used in NAT suite Change-Id: Iaa2ac1eb156bc9bcff41ec242318f6a973210d38 Signed-off-by: selias <samelias@cisco.com>
2016-12-16HC Test: Add EXPECTED_FAILING tag to expected test faluresselias3-3/+6
Change-Id: Ic197001f2bb5ad5be9246025502d49e90e0c44aa Signed-off-by: selias <samelias@cisco.com>
2016-12-16CSIT-484: HC Test: Lispselias1-0/+159
- add Lisp test suite - add Lisp test data - add keywords and methods used in Lisp tests Change-Id: Ie7819e20cf48e7dac106d60cce316ce69ab75786 Signed-off-by: selias <samelias@cisco.com>
2016-12-15HC Test: fix archiving artifacts in csit-hc2vpp jobsselias1-1/+3
Change-Id: I392eac7404d5e1793a7de9d7a44b9defb89e7b9d Signed-off-by: selias <samelias@cisco.com>
2016-12-01CSIT-481: HC Test: Port mirroring (SPAN)selias1-0/+64
- add port mirroring test suite - add relevant keywords Change-Id: I4ff398dd2ab4323e2a53af2812bf07cbb7043252 Signed-off-by: selias <samelias@cisco.com>
2016-11-28CSIT-460: HC Test: Rework existing PBB testsselias1-73/+22
Rework PBB tests to account for changes in: https://gerrit.fd.io/r/2520 https://gerrit.fd.io/r/1833 Change-Id: Id18027c23e57180b76c8478b010a4e3a69a75e43 Signed-off-by: selias <samelias@cisco.com>
2016-11-25CSIT-425: HC Test: NSH-SFC test suiteselias2-0/+128
- add keyword to enable optional modules in Honeycomb (including NSH) - update honeycomb __init__.robot with the new keyword - add python and robot libraries for NSH tests - add NSH test suite (CRUD operations) Change-Id: I869069a138a51d56d25522163c3a6deefb316f46 Signed-off-by: selias <samelias@cisco.com>
2016-11-25CSIT-457: HC Test: Document expected test failuresselias5-42/+63
- add EXPECTED_FAILING tag to all known test failures - document every use of EXPECTED_FAILING tag ,include Jira issue ID - minor fixes to interface, sub-interface and ACL test suites Change-Id: If6a535bdacc297c03e8cfade8896cdec23498bc2 Signed-off-by: selias <samelias@cisco.com>
2016-11-24CSIT-426: HC Test: Netconf transaction revertselias1-0/+27
- add test cases for reverting Netconf transactions - minor fixes to existing Netconf test case Change-Id: Id6e5d26f815b14da29194181bf333e845f5b623c Signed-off-by: selias <samelias@cisco.com>
2016-11-16CSIT-454: HC Test: Improve logging on test failureselias1-0/+1
- set Honeycomb log level to TRACE before running Honeycomb tests - on a failed restconf request, print the last few lines of the log - show saved configuration during persistence suite restarts Change-Id: I07ee37a5403cfca946fd7ef25a42861273248fbe Signed-off-by: selias <samelias@cisco.com>
2016-11-08CSIT-423: HC Test: delete VxLAN interfaceselias1-1/+12
Modify VxLAN test cases to account for changes in Honeycomb. Change-Id: If2db55548b5472350d128bdfbb5bdd5289e1deef Signed-off-by: selias <samelias@cisco.com>
2016-11-04CSIT-457: Address Honeycomb test failuresselias4-76/+65
- tag all not-implemented features with EXPECTED_FAILING - add workarounds for known issues with VAT dump commands - replace hardcoded test data with parametrized - separate IP neighbor and IP address into two test cases - support unordered lists with compare_data_structures keyword Change-Id: I2c683162325cee720ba496489787fa50e9c72b8c Signed-off-by: selias <samelias@cisco.com>