aboutsummaryrefslogtreecommitdiffstats
path: root/resources/libraries/robot/honeycomb
AgeCommit message (Collapse)AuthorFilesLines
2019-08-09Clean: L2 bridge domainPeter Mikus1-2/+2
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I3721900b91a9c8e9db8766bdcb9771b6bcf95bca
2019-07-17Use PapiSocketProvider for most PAPI callsVratko Polak1-0/+1
Ticket: CSIT-1541 Ticket: VPP-1722 Ticket: CSIT-1546 + Increase timeout to hide x520 slownes of show hardware detail. - Install sshpass and update ssh client in virl bootstrap. + Added TODOs to remove when CSIT-1546 is fixed. + Enable default socksvr on any startup conf. + Improve OptionString init and repr. - The non-socket executor still kept for stats. + Remove everything unrelated to stats from non-socket executor. - Remove some debug-loooking calls to avoid failures. TODO: Introduce proper parsing to the affected keywords. + Reduce logging from PAPI code to level INFO. - Needs https://gerrit.fd.io/r/20660 to fully work. + Change default values for LocalExecution.run() + Return code check enabled by default. Code is more readable when rc!=0 is allowed explicitly, and the test code will now detect unexpected failures. + Logging disabled by default. Output XML is large already. Important logging can be enabled explicitly. + Restore alphabetical order in common.sh functions. Change-Id: I05882cb6b620ad14638f7404b5ad38c7a5de9e6c Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-06-28VAT-to-PAPI: ClassifyTibor Frank1-17/+13
Change-Id: Ic06a0a65429680e6ecdc3f5288d091c2c2630921 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-06-25Align suite/test teardown/setupPeter Mikus1-2/+2
+ Phase II - aligning FUNC/PERF setup. + 2n/3n compatibility of suite setup. + Same structure of testcase for DEV/PERF. + DEVICE tests are now running VPP startup config in same way as PERF. + DEVICE is using COREKEEPER! - DEVICE tests are running topology compute twice for backward compatibility. TODO to remove. - Still phase III needed to align TAGS, LIBRARIES and remove OLD setup phase. Change-Id: Ib6e1b0ebf4abebf3cbe73b4fda5cac953c2a7270 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-06-18CSIT-1459: Migrate IP libraries from VAT to PAPIJan Gelety4-7/+8
Change-Id: Id84cf9c3afd53260b5bbf658a6a3870aa0c91333 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-06-04fix Honeycomb failing testsMichal Cmarada7-27/+32
- due to VAT to PAPI migration some tests need to be updated - fixed HC tests: ACL, Interfaces/SubInterfaces, Tap Vhost, Vxlan, Vxlan-gpe Change-Id: I9adad041a619b48057bdda388becd53dde484483 Signed-off-by: Michal Cmarada <mcmarada@cisco.com>
2019-05-27HC2VPP-411: migrate interfaces-state to interfacesMichal Cmarada2-4/+4
- new ietf-interfaces makes interfaces-state obsolete - updates honeycomb tests to latest ietf-interfaces model Change-Id: I5502a5ab23661429caca9498407d7121d423a1a3 Signed-off-by: Michal Cmarada <mcmarada@cisco.com>
2019-05-15FIX: Honeycomb restart sequencePeter Mikus1-1/+3
Change-Id: I31acda10c4bd8de6f0094e697ef1219e77c5fbb1 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-05-15FIX: Remove old restart sequence - HoneycombPeter Mikus2-10/+18
Change-Id: I12865ea4f48c1902e80e67463fff4cf481a2e24c Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-04-16Remove unused parameter in HoneycombSetupMichal Cmarada1-1/+1
Change-Id: Ief75fcdc2c3ab77b708d1c7e7aecf312ea852898 Signed-off-by: Michal Cmarada <mcmarada@cisco.com>
2019-04-09update tests after ODL bump to NeonMichal Cmarada1-1/+21
Change-Id: Ia733ad304c51b28f2a945e570120821254077189 Signed-off-by: Michal Cmarada <mcmarada@cisco.com>
2019-04-09Fix l2 Honeycomb testsMichal Cmarada4-20/+22
Change-Id: Ic75a9279fffe3a5d11211f4e57fc635d7d33ee5f Signed-off-by: Michal Cmarada <mcmarada@cisco.com>
2019-04-01CSIT-1337: Migrate L2Util library from VAT to PAPIJan Gelety2-5/+58
Change-Id: I22879c7bdd100d00216b9528663bf17406169826 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-03-28Fix Tap failing testsMichal Cmarada2-15/+17
Due to migration to Tap-v2 the old Tap API was removed. This fixes failing tests where Tap interface was used. Change-Id: I2f90177d2d8ee914e3ddcd3e10f212f9d72b9ac2 Signed-off-by: Michal Cmarada <mcmarada@cisco.com>
2019-01-23Fix PyLint errorsTibor Frank1-10/+11
Change-Id: I5a369f4b9f9b478375fda4a634bf57cc9623e972 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-10-04Fix failing tests after Fluorine bump in HC (HONEYCOMB-433)Michal Cmarada1-1/+1
- this fixes failing tests after bumping ODL dependencies in Honeycomb and HC2VPP projects. - increased timeout for installing ODL feautres, sometimes it takes longer to install them. Change-Id: Ib3ae8106ae0c1122410e9bd7924d0b49ed6059c7 Signed-off-by: Michal Cmarada <michal.cmarada@pantheon.tech>
2018-06-21HC2VPP-331: Fix Honeycomb fails to assign VRF to interfaceMichal Cmarada1-0/+67
- add configuration for FIB table management to test suite - fix routing test suite HC2VPP-331 bugs - fix intip4-intip6 test suite HC2VPP-331 bugs Change-Id: I0b1e9ed787d9fb68e76a6d61c1eea2519a36a6c4 Signed-off-by: Michal Cmarada <michal.cmarada@pantheon.tech>
2018-05-17HC tests: fix 'Archive Honeycomb logs' KW docsMarek Gradzki1-1/+1
Change-Id: I10851345579ee751b0b79b807fed140e4614685f Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
2018-05-16HC Tests: adapt NAT tests to ietf-nat@2018-02-23.yang (CSIT-1086)Marek Gradzki1-1/+1
Requires: https://gerrit.fd.io/r/#/c/12516/ Change-Id: Ie0a3452f51fb89914a6a0c53aa4136279a3dfb47 Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
2018-05-16HC tests: archive ODL logs (CSIT-1031)Marek Gradzki1-2/+20
Change-Id: I444a5d6cd32cb9ee68575dfdb5a208de2c4eb72a Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
2018-04-05HC Tests: fix authentication for ODL Oxygen jobsMarek Gradzki1-1/+1
Change-Id: I05dcb5f35ae1bc2abc7ce5c34eaced218e0ebd35 Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
2017-11-08CSIT-811 HC Test: BGP functional testsselias1-1/+85
Added traffic tests for Honeycomb's BGP feature. Change-Id: I5fa99908ab61d8bc9d2975e451917b98571b6aca Signed-off-by: selias <samelias@cisco.com>
2017-10-27HC Test: Fix missing import in performance job setupselias1-0/+1
Change-Id: Ib125fbaf38e2a10892d2bbaf4cd68121dd2247ce Signed-off-by: selias <samelias@cisco.com>
2017-10-19HC Test: Fix expected error when ACL table should be emptyselias1-1/+1
Due to VATExecutor changes in https://gerrit.fd.io/r/8679 Change-Id: Iaecf6ff7b2562ff111a3afbce0ecbb2df00c62a9 Signed-off-by: selias <samelias@cisco.com>
2017-10-11CSIT-811 HC Test: BGP tests - IPv4 CRUDselias1-0/+173
Tests configure BGP neighbor peers and simple routes for these peers. Change-Id: I5102986d710551a451e838d934cc9650bcd38a60 Signed-off-by: selias <samelias@cisco.com>
2017-10-09CSIT-775 HC Test: CRUD over IPv6 control-plane interfaceselias2-13/+44
Adds new test suite which accesses Honeycomb's Restconf and Netconf northbound over IPv6. This is done by sending the requests to TG where an IPv4 to IPv6 tunnel is configured to the Honeycomb DUT. Change-Id: I3b7467d8108b0da9756e632851215c66ed41bb61 Signed-off-by: selias <samelias@cisco.com>
2017-10-05HC Test: remove log check from HC startupselias1-0/+1
- remove log check from "Check Honeycomb Startup State" keyword - fix workaround for ODL startup issue - change log level for HttpRequestError so it doesn't clutter log.html output - update EXPECTED_FAILING tags for plugin-acl and routing suites Change-Id: I7380d24801a6535bdf77505edada39ea2412e833 Signed-off-by: selias <samelias@cisco.com>
2017-09-28HC Test: Fix intermittent failures of HC startupselias2-15/+30
- rework "check Honeycomb startup state" keyword - increase timeout value for startup - add separators to Honeycomb log file between test suites - other minor fixes: - remove usused import from NAT suite - fix loop in ICMPv6 ND proxy traffic script - add teardown to LISP cases - update prerequisites for sub-interface SPAN test Change-Id: I2f714ffc1d2e8435d3abe690d8bd15099e071c9a Signed-off-by: selias <samelias@cisco.com>
2017-09-27HC Test: update ODL startup in hc2vpp jobsselias1-1/+22
- mountpoint configuration through controller-config is deprecated. Use the new method through odl-netconf-topology feature. Change-Id: I1297622db7ab6a3853b3c97ab7f59c31b4269b6d Signed-off-by: selias <samelias@cisco.com>
2017-08-09CSIT-611: HC Test: Lisp suite updates + LispGPEselias2-75/+378
- added LispGPE test suite - added IPv6 tests to Lisp suite - added traffic tests to Lisp suite Change-Id: I3b699149cd73ebf5856072d3f26e98a370dbfc4b Signed-off-by: selias <samelias@cisco.com>
2017-07-20HC Test: bugfixes for hc2vpp ODL jobsselias1-0/+5
- add shutdown check for ODL client in teardown - stop VPP in teardown - add delay after HC startup HC features load asynchronously, no way to check if they're all running. Change-Id: I9d2c51b68ba51284d2d409a77d6cd9fd478e1725 Signed-off-by: selias <samelias@cisco.com>
2017-06-30CSIT-619 HC Test: Honeycomb performance testing - initial commitselias2-4/+202
- keywords and scripts for HC performance testing setup - basic performance suite: operational data read - traffic script and keywords used in tests Change-Id: Ic0290be73a7c925ea2561f8cd2524c5cb83fcda2 Signed-off-by: selias <samelias@cisco.com>
2017-06-30HC Test: bugfix for SLAAC and ODL testsselias2-4/+3
Change-Id: I0a09482e8dc9ef2f9e6cd54a26c8d8492409f68c Signed-off-by: selias <samelias@cisco.com>
2017-06-29CSIT-687: Directory structure reorganizationTibor Frank1-1/+1
Change-Id: I772c9e214be2461adf58124998d272e7d795220f Signed-off-by: Tibor Frank <tifrank@cisco.com> Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2017-06-26HC Test: improve functional suite setup and teardownselias16-150/+245
Restart the whole stack (VPP+Honeycomb+-ODL) in between test suites. Add generic suite setup and suite teardown keywords for all func suites Re-enable NSH_SFC suite, cleanup test failures Change-Id: I71025b4ed3a7c4912dcd7b62aedef6082357990c Signed-off-by: selias <samelias@cisco.com>
2017-06-13CSIT-664: Refactor setups and teardownsTibor Frank2-4/+4
- Add suite setup for performance IPSec tests - Add test teardown for performance SNAT tests - Add setups and teardowns for functional tests - Clean up the code Change-Id: Ia456e9f3ff0f0f2bb9a03f692f27c7f9a2817621 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-06-09CSIT-663: Remove unused keywordsTibor Frank5-136/+0
Change-Id: Ib3f0edb0c3a48a760040886e5aedce81c9baeac2 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-06-08CSIT-662: KWI - KW renamingTibor Frank13-124/+125
- plus: CSIT-656: Script to rename robot keywords. Change-Id: Ia69917e406a1b346b80e5ea742f6200c1c9e9d21 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-06-05CSIT-610 HC Test: add test cases for unnumbered interfaceselias3-6/+40
- add interface and sub-interface tests with unnumbered config - modify interface IPv4 address assignment to handle custom interfaces and sub-interfaces - pylint and style fixes Change-Id: Ic39df1655b4d44f0025a2acef9f7f968929aeff5 Signed-off-by: selias <samelias@cisco.com>
2017-05-17CSIT-576 HC Test: Improve SPAN test coverageselias1-5/+110
- add test for multiple destination interfaces using one source interface - duplicate all existing cases using a sub-interface as the destination Change-Id: Ifabf78bca258247a19624b2b2a0474d21d1229d3 Signed-off-by: selias <samelias@cisco.com>
2017-05-17CSIT-577 HC Test: Scripts for test jobs using ODL clientselias1-10/+6
ODL client can be used to translate Restconf requests into Netconf. This way Honeycomb's Netconf interface can be tested using existing test cases. - add bootstrap scripts for verify and integration job - update __init__.robot to handle new {HC_ODL} variable Change-Id: I7e156dab3d5434dff246bfd02090f3c6bea81b86 Signed-off-by: selias <samelias@cisco.com>
2017-05-17CSIT-562 HC Test: Persistence suite rework, part1selias15-135/+200
- rename keywords that check operational data, to distinguish from keywords that check configuration data - modify existing persistence cases so that they don't affect each other - add feature-specific persistence tests for: Interface Management, L2 bridge - move Interface Management variables to separate file so they can be reused - add new tag HC_PERSIST to execute persistence tests separately - update existing Honeycomb tags to comply with CSIT conventions More feature-specific tests to be added in part2. Change-Id: I8657da4bb9e9a3d5261c04f5f1999b2572f605ef Signed-off-by: selias <samelias@cisco.com>
2017-05-17CSIT-563: HC Test: improved Lisp test coveragejan.hradil1-4/+350
added TC09-TC14 with following features: Map Resolver Map Server PETR configuration RLOC Probing Map Register Map Request mode Change-Id: I0e8a573e9a0f7ef3c688a014ff879e2b3d6b9b1e Signed-off-by: jan.hradil <jan.hradil@pantheon.tech> Signed-off-by: selias <samelias@cisco.com>
2017-05-03HC Test: Update honeycomb suite setupselias1-6/+6
- remove workaround for jVPP version mismatch - increase Java API command timeout Change-Id: Ic6a61ff029cc7cdfec1f75890e18599e3b05f019 Signed-off-by: selias <samelias@cisco.com>
2017-04-25CSIT-534 HC Test: policer testsjan.hradil1-0/+163
Added empty lines where needed Repaired Phrasese "Given" --> "And" where necessary in mgmt-cfg-policer-apihc-func.robot Corrected English in mgmt-cfg-policer-apihc-func.robot - in TC07 Documentation Change-Id: Id99d7fd04d8f2dcae1820baa208ce338fad3a290 Signed-off-by: jan.hradil <jan.hradil@pantheon.tech>
2017-04-18HC Test: update persistence suiteselias1-1/+23
- fix "enable persistence" is suite setup - update Jira links to persistence bug - log content of persistence file before each restart Change-Id: I68ad759ded5d6bee277cf946953c11f19628a9e7 Signed-off-by: selias <samelias@cisco.com>
2017-04-11CSIT-529 HC Test: SLAACjan.hradil1-0/+106
Change-Id: I14525a36d614372b7b418f1c10f95c371b7b8545 Signed-off-by: jan.hradil <jan.hradil@pantheon.tech>
2017-04-03HC Test: revert to using restconf over httpselias1-0/+1
- use http instead of https for restconf connection - add missing import to proxyARP robot library - use VAT interface dump to identify interfaces in VAT ip address dump Change-Id: Ic381ff3f9b56a6c633382450559134f5389956c2 Signed-off-by: selias <samelias@cisco.com>
2017-03-30HC Test: SPAN Port Mirroring Suitejan.hradil1-5/+28
Change-Id: Ideaae09aa0d062460f5dfb3e3732dee67d6a5aea Signed-off-by: jan.hradil <jan.hradil@pantheon.tech>
2017-03-30HC Test: address and cleanup test failuresselias2-6/+3
Change-Id: If3c570dbc5036915fdc68ade7a9ccc45ad21299e Signed-off-by: selias <samelias@cisco.com>