Age | Commit message (Collapse) | Author | Files | Lines |
|
Restart the whole stack (VPP+Honeycomb+-ODL) in between test suites.
Add generic suite setup and suite teardown keywords for all func suites
Re-enable NSH_SFC suite, cleanup test failures
Change-Id: I71025b4ed3a7c4912dcd7b62aedef6082357990c
Signed-off-by: selias <samelias@cisco.com>
|
|
- plus: CSIT-656: Script to rename robot keywords.
Change-Id: Ia69917e406a1b346b80e5ea742f6200c1c9e9d21
Signed-off-by: Tibor Frank <tifrank@cisco.com>
|
|
- add interface and sub-interface tests with unnumbered config
- modify interface IPv4 address assignment to handle custom interfaces
and sub-interfaces
- pylint and style fixes
Change-Id: Ic39df1655b4d44f0025a2acef9f7f968929aeff5
Signed-off-by: selias <samelias@cisco.com>
|
|
- rename keywords that check operational data, to distinguish from keywords
that check configuration data
- modify existing persistence cases so that they don't affect each other
- add feature-specific persistence tests for: Interface Management, L2 bridge
- move Interface Management variables to separate file so they can be reused
- add new tag HC_PERSIST to execute persistence tests separately
- update existing Honeycomb tags to comply with CSIT conventions
More feature-specific tests to be added in part2.
Change-Id: I8657da4bb9e9a3d5261c04f5f1999b2572f605ef
Signed-off-by: selias <samelias@cisco.com>
|
|
Change-Id: I93e0e4caf9b8ed1be824c7f75f348c30e567b75f
Signed-off-by: selias <samelias@cisco.com>
|
|
- fix and update ipv4 and ipv6 tests
- add tests for ipv6 neighbor and vrf-id
- add tests for secondary IP address on ipv4, ipv6
Change-Id: I1e422e61108493a63a65ad91f649e69dfff0842f
Signed-off-by: selias <samelias@cisco.com>
|
|
- remove EXPECTED_FAILING tag from IPv4 neighbor, IPv6 address, MTU
- fix bridge domain removal with interfaces assigned, it should fail
- fix teardown of L2 FIB suite (bridge domain removal, see above)
- disable vhost-user "server" test cases (VPP bug)
- fix keyword verifying sub-interface state
- update ACL test data (yang model changes)
- remove EXPECTED_FAILING tag from ACL table removal test
- update Jira IDs and comments in failing Lisp test case
- remove EXPECTED_FAILING tag from Lisp removal test case
- use vhost-user "client" instead of "server" in persistence tests
Change-Id: I32eafb6013b4512090c0d9365e10c61029179d49
Signed-off-by: selias <samelias@cisco.com>
|
|
When comparing multi-level JSON trees, the exceptions raised
carry more useful information.
Keys and values not present in reference data are ignored.
No longer puts chunks of honeycomb's log file into robot report. The
entire log file will be archived after https://gerrit.fd.io/r/4171
Change-Id: Ib597080fa3d9b2c43463c76ee0d52f317ea072e7
Signed-off-by: selias <samelias@cisco.com>
|
|
- add EXPECTED_FAILING tag to all known test failures
- document every use of EXPECTED_FAILING tag ,include Jira issue ID
- minor fixes to interface, sub-interface and ACL test suites
Change-Id: If6a535bdacc297c03e8cfade8896cdec23498bc2
Signed-off-by: selias <samelias@cisco.com>
|
|
- set Honeycomb log level to TRACE before running Honeycomb tests
- on a failed restconf request, print the last few lines of the log
- show saved configuration during persistence suite restarts
Change-Id: I07ee37a5403cfca946fd7ef25a42861273248fbe
Signed-off-by: selias <samelias@cisco.com>
|
|
Modify VxLAN test cases to account for changes in Honeycomb.
Change-Id: If2db55548b5472350d128bdfbb5bdd5289e1deef
Signed-off-by: selias <samelias@cisco.com>
|
|
- tag all not-implemented features with EXPECTED_FAILING
- add workarounds for known issues with VAT dump commands
- replace hardcoded test data with parametrized
- separate IP neighbor and IP address into two test cases
- support unordered lists with compare_data_structures keyword
Change-Id: I2c683162325cee720ba496489787fa50e9c72b8c
Signed-off-by: selias <samelias@cisco.com>
|
|
- add keywords for accessing Honeycomb's ietf-acl node
- add variable file with ietf-acl test data
- add ietf-acl traffic test suite
- modify bridge domain teardown keyword to unassign interfaces
from the bridge domain before delete
Change-Id: I6df1771f2fb9b42f30b5af8f54a384c6714f5949
Signed-off-by: selias <samelias@cisco.com>
|
|
- update suite setup and constants to allow test runs again
- cleanup basic interface keywords
- cleanup L2-fib test data
- add "continue on failure" keyword to some partially failing tests
- add teardown to all suites, restarts honeycomb if suite had test failures
- fix minor PEP-8 violations in Topology.py
Change-Id: Ic5b434af71f77855f81461b280299b8318932c5a
Signed-off-by: selias <samelias@cisco.com>
|
|
- update "REMOTE_HC_DIR" constant
- update location of "MTU" setting in interface operational data
Change-Id: Id455ec4f3f03107f628913356801f4c21c5704b3
Signed-off-by: selias <samelias@cisco.com>
|
|
- update test suite numbering to be future-proof
- reorder suite execution:
- persistence suite should always run last
- l2_fib suite follows after l2
- VxLAN gpe suite follows after VxLAN
- fix issue with interface name vs. index introduced in change #1032
- change ${node} variable to global scope, set in _init_.robot
Change-Id: Ib4ca7265586026faab219da9923e7ca312ef2c79
Signed-off-by: selias <samelias@cisco.com>
|
|
- add new negative test for bridged-virtual-interface setting
- modify variables in original bd tests to use bvi=False
- separate interface ipv4 test case into netmask and prefix
- replace per-testcase tag definitions with per-suite forced tags
- add separate tag for persistence suite, due to it's long execution time
Change-Id: I79ae699125d4838ed8b394dc80a028e08b4de684
Signed-off-by: selias <samelias@cisco.com>
|
|
JIRA: CSIT-139
- modify tests for Honeycomb sub-interfaces to reflect the last changes
in the model
- modify existing keywords to work with latest changes in Honyecomb and VPP
Change-Id: Idc88fbac7e743e6125d5c865d9d144448657dd20
Signed-off-by: Tibor Frank <tifrank@cisco.com>
|
|
JIRA: CSIT-131
- add tests for Honeycomb VxLAN GPE support
- add keywords needed for tests
Change-Id: I460ecd30835bb95140958b20946b1d41ac6d9abc
Signed-off-by: Tibor Frank <tifrank@cisco.com>
|
|
- add new test cases based on reported bugs
- minor fixes
Change-Id: I8b7464bc1f4e786e3a0ef67ba64d81e1c25ae5cf
Signed-off-by: selias <samelias@cisco.com>
|
|
JIRA: CSIT-47
- add test suite for VxLAN management through Honeycomb
- add keywords required for VxLAN management tests
- add resource file with additional variables for testing
- increment bridge domain test suite index
Change-Id: Ica0d7ae15f5b7058832a944d5ca0c72026ba299c
Signed-off-by: selias <samelias@cisco.com>
|
|
- add verification of ipv4 subnet prefix support
- modify keywords to allow setting ipv4 address with network prefix
- fix variable definitions to evaluate numbers as ints, not strings
- add exception to ipv4 netmask/prefix conversion method
Change-Id: I9343ceb35856ddb33674d7067f1def6d40e99acc
Signed-off-by: selias <samelias@cisco.com>
|
|
- move all Honeycomb related libraries written in python to new
directory resources/libraries/python/honeycomb
- update all related includes in all source files
Change-Id: Ifa96b8f670b456b14421929d6020ddf8e02d9cbc
Signed-off-by: Tibor Frank <tifrank@cisco.com>
|
|
JIRA: CSIT-45
- add test: Honeycomb modifies interface configuration - VxLAN
- add keywords used in these tests to set and verify configuration
- add method and vat template for dumping an interface's configured VxLAN
- fixed requirements.txt
Change-Id: I6d6c360a4d478a0e40eecf7c0235969e7c06f7a9
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Signed-off-by: C.J. Collier <cjcollier@linuxfoundation.org>
|
|
- add test cases for managing ipv4, ipv6, ethernet and routing
configuration on VPP interface
- add keywords used in these tests to set and verify configuration
- add method and vat template for dumping an interface's
configured IP addresses
- add method for converting between ipv4 netmasks and
network prefixes
- clean up documentation of older Honeycomb keywords
Note: Test cases are tagged with a placeholder tag to allow manual
test runs locally. It should be replaced with the appropriate
environment tags once Honeycomb service is deployed on virl.
Change-Id: I99ce1e72c8550f520f8c35ef4a93eaebb530db78
Signed-off-by: selias <samelias@cisco.com>
Signed-off-by: Matej Klotton <mklotton@cisco.com>
|
|
- add simple test for interface management through Honeycomb API
- add status code 500 to honeycomb startup check whitelist,
due to Honeycomb changes in https://gerrit.fd.io/r/772
- increase timeout value for Honeycomb startup check
- modify Honeycomb setup keywords to allow starting Honeycomb
on individual nodes
- remove sanity test suite, tests now sorted by functional areas
such as interfaces, bridge domains, VXlan,...
Change-Id: I87f9cf69577706f3b00e24a8d2c01df52fc707c6
Signed-off-by: selias <samuel.elias@pantheon.tech>
|