Age | Commit message (Collapse) | Author | Files | Lines |
|
When comparing multi-level JSON trees, the exceptions raised
carry more useful information.
Keys and values not present in reference data are ignored.
No longer puts chunks of honeycomb's log file into robot report. The
entire log file will be archived after https://gerrit.fd.io/r/4171
Change-Id: Ib597080fa3d9b2c43463c76ee0d52f317ea072e7
Signed-off-by: selias <samelias@cisco.com>
|
|
- Fix PyLint errors
- Fix comments in touched python modules
Change-Id: I26db2d292a41969cf38b9b0bdd49c4fb15349102
Signed-off-by: Tibor Frank <tifrank@cisco.com>
|
|
Change-Id: I392eac7404d5e1793a7de9d7a44b9defb89e7b9d
Signed-off-by: selias <samelias@cisco.com>
|
|
There is an issue that booting Nested VM is successful but
QGA guest-ping returns partial response. This fix suppose to
do checking until an error or timeout occurs. In case of QGA
returns correct response it is success. In case of partial
response it will log an error and continue in checking.
Change-Id: I8a2469287abaa9398a9206988e579912840f20c4
Signed-off-by: pmikus <pmikus@cisco.com>
|
|
Add option to configure CFS scheduler priority for VPP
Change-Id: Id358ebe41d7e868fd412d554d886567f81894b86
Signed-off-by: pmikus <pmikus@cisco.com>
|
|
Add multi-queue support when starting qemu. Full implementation
will be following in near future.
Change-Id: I743bbde67254b26a4e4e98072bad57dde728845a
Signed-off-by: pmikus <pmikus@cisco.com>
|
|
Reading information from sysfs or proc files is randomly failing
returning empty string without any error.
This fix suppose to add the retries to read the hugepages
information multiple times and raise exception if reading failed.
Change-Id: I7c88504765c39b11c81f7a8e77e5b0e32b7225fe
Signed-off-by: pmikus <pmikus@cisco.com>
|
|
- add port mirroring test suite
- add relevant keywords
Change-Id: I4ff398dd2ab4323e2a53af2812bf07cbb7043252
Signed-off-by: selias <samelias@cisco.com>
|
|
- outdated due to HC project change - split to honeycomb and hc2vpp
Change-Id: If9e3c9baf7787067eff6a759be1ad9aa386c6e0f
Signed-off-by: selias <samelias@cisco.com>
|
|
Rework PBB tests to account for changes in:
https://gerrit.fd.io/r/2520
https://gerrit.fd.io/r/1833
Change-Id: Id18027c23e57180b76c8478b010a4e3a69a75e43
Signed-off-by: selias <samelias@cisco.com>
|
|
- See resources/tools/doc_gen/README.rst for details
Change-Id: Ie5704c93a41e456d65fcd6df2d9d8c96987deebb
Signed-off-by: Tibor Frank <tifrank@cisco.com>
|
|
- add keyword to enable optional modules in Honeycomb (including NSH)
- update honeycomb __init__.robot with the new keyword
- add python and robot libraries for NSH tests
- add NSH test suite (CRUD operations)
Change-Id: I869069a138a51d56d25522163c3a6deefb316f46
Signed-off-by: selias <samelias@cisco.com>
|
|
- Fix documentation to be comliant with sphinx
- Fix pylint errors
Change-Id: I64acaa6c330c5a3b2975efc4120260813a2b3a92
Signed-off-by: pmikus <pmikus@cisco.com>
|
|
Change-Id: I6ea568e15e5c5b3ec6d3fd1977fb5d4a5ce17484
Signed-off-by: pmikus <pmikus@cisco.com>
|
|
As of change https://gerrit.fd.io/r/3816, ip_address_dump returns
IP addresses properly.
Change-Id: If3b4a32e5166bd517beaa2ddb35262c406b1dcea
Signed-off-by: selias <samelias@cisco.com>
|
|
Add option to configure CFS scheduler priority for QEMU
Change-Id: I76da7f536e70a23a57cf5215ab60002f95532b19
Signed-off-by: pmikus <pmikus@cisco.com>
|
|
- set Honeycomb log level to TRACE before running Honeycomb tests
- on a failed restconf request, print the last few lines of the log
- show saved configuration during persistence suite restarts
Change-Id: I07ee37a5403cfca946fd7ef25a42861273248fbe
Signed-off-by: selias <samelias@cisco.com>
|
|
Modify VxLAN test cases to account for changes in Honeycomb.
Change-Id: If2db55548b5472350d128bdfbb5bdd5289e1deef
Signed-off-by: selias <samelias@cisco.com>
|
|
This test setup and teardown is aimed to be used with all functional
tests.
It does not include functionality to manipulate VMs (qemu).
Test setup includes:
- Setup all DUTs before test
- Save VPP PIDs
- Setup all TGs before traffic script
- Update All Interface Data On All Nodes
Test teardown includes:
- Show Packet Trace on All DUTs
- Show vpp trace dump on all DUTs
- Vpp Show Errors On All DUTs
- Check VPP PID in Teardown
Change-Id: Ifee0bd58b7865442c5b510852908fd8363e3c543
Signed-off-by: Tibor Frank <tifrank@cisco.com>
|
|
Issue retrieving numa node of NIC
Change-Id: Ia6f826c100a012b23e046e48fe1e505ed0c4c8e8
Signed-off-by: pmikus <pmikus@cisco.com>
|
|
- tag all not-implemented features with EXPECTED_FAILING
- add workarounds for known issues with VAT dump commands
- replace hardcoded test data with parametrized
- separate IP neighbor and IP address into two test cases
- support unordered lists with compare_data_structures keyword
Change-Id: I2c683162325cee720ba496489787fa50e9c72b8c
Signed-off-by: selias <samelias@cisco.com>
|
|
- encryption/integrity key update tests
Change-Id: Iddbe35e2f421b5048e60663bff2b0bf1968a9782
Signed-off-by: Patrik Hrnciar <phrnciar@cisco.com>
Signed-off-by: Matej Klotton <mklotton@cisco.com>
|
|
Systemd first send SIGTERM and wait 90s (default value)
to send SIGKILL to terminate the vpp service.
Change-Id: Ia582cfdc4bebc5d3530e82692856fe733d0b001e
Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
|
|
- Update TRex to v2.09
Change-Id: I53221aff346840e0438dd1385cedd1db57ca5f3b
Signed-off-by: pmikus <pmikus@cisco.com>
|
|
- Switch Qemu binary to default path and remove building qemu in performance jobs
Change-Id: I5e8bb510beb672d034699192a7c454c56f2d2581
Signed-off-by: pmikus <pmikus@cisco.com>
|
|
- add test cases for:
L4 port range ACLs
multiple classify rules
L2 ACL on egress interface
- add L4 configuration to mixed ACL test
- add test variables for new test cases
- update HTTPRequests to treat code 201 as a positive response
Change-Id: If43007545fec174af12dab594f8a1b15b2e4a536
Signed-off-by: selias <samelias@cisco.com>
|
|
- add test cases for mixing L2 and L3 rules
- update methods with mixed-acl functionality
- update test variables
Change-Id: I2aaa3033eede609627f751ea896e098548ffae98
Signed-off-by: selias <samelias@cisco.com>
|
|
- add test cases for layer 3 ACL - IPv4, IPv6, protocol/next-header
- update methods with L3 functionality
- update test variables
Change-Id: Ia7ec03268845191021366621040dc411da0a2a93
Signed-off-by: selias <samelias@cisco.com>
|
|
- add keywords for accessing Honeycomb's ietf-acl node
- add variable file with ietf-acl test data
- add ietf-acl traffic test suite
- modify bridge domain teardown keyword to unassign interfaces
from the bridge domain before delete
Change-Id: I6df1771f2fb9b42f30b5af8f54a384c6714f5949
Signed-off-by: selias <samelias@cisco.com>
|
|
- add "convert_interface_reference" to topology.py
This is a convenience method, mainly intended for Honeycomb tests
which often require conversions between interface key, name
and sw_if_index.
Change-Id: I427736111f2a1dc07a581c9ccc25e181065bb6fd
Signed-off-by: selias <samelias@cisco.com>
|
|
This can be usefull for variables like http_proxy.
Change-Id: I31128d2a57c961c6d888b6693b68fb57bde11436
Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
|
|
- Update the repository to get xenial packages
- Update phy topology files with new pass
- Update bootstrap to use new VIRL image
- Update framework to reflect 16.04 dependencies
- CSIT-116: Modify VIRL username/password
Change-Id: I4de44755170fd0481acef34c7c2d9c299bc300da
Signed-off-by: pmikus <pmikus@cisco.com>
|
|
- Increase interactive terminal timeout
- ip6 heapsize
- performance lib fix
Change-Id: Iac6beb041200c4b0c5cf29dceb5113df64c6c9b0
Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
|
|
- ip4-lispgpe-ip4 - main fib, vrf, virt2lisp
Change-Id: I28c81e91689021693ce76352878fa21e953a4ef6
Signed-off-by: Tibor Frank <tifrank@cisco.com>
|
|
Change-Id: I039e14b7c227318c70826068368430978f8f0a51
Signed-off-by: Zdeno Olsovsky <zolsovsk@cisco.com>
|
|
Change-Id: I0ee68f707c4175940538654f3a4bbd7d1a91bef1
Signed-off-by: Zdeno Olsovsky <zolsovsk@cisco.com>
|
|
Change-Id: Iba291d6781238c0e880534195ff65a7b3c4bede1
Signed-off-by: pmikus <pmikus@cisco.com>
|
|
- add IPv4 Equal-cost multipath routing test
- add IPv6 Equal-cost multipath routing test
Change-Id: I62eaf9983b7767e124f80af7d8c8652ffc460cf8
Signed-off-by: Patrik Hrnciar <phrnciar@cisco.com>
|
|
- no functional changes
- fixes 80+ PEP-8 violations
Change-Id: Icf414778ec40d5cb44364fa69a876f9a1870c3c7
Signed-off-by: selias <samelias@cisco.com>
|
|
- remember if execution timed out and do not try to send "quit" on close
- increase timeout of vat command execution from 10s to 60s
Change-Id: I2b96a6dce1220eff45002276d1fe8a771fca2205
Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
|
|
- add library for SPAN setup
- add telemetry traffic script and a keyword to run it
- add "telemetry" folders for python and robot libraries
- move IPFIX libraries to these new folders
- add first SPAN test case, mirroring IPv4 ICMP packets
Change-Id: Ibca35f724c13662bf80dce2d7e2649d1a0b8676a
Signed-off-by: selias <samelias@cisco.com>
|
|
- CRUD tests usinf Honeycomb REST API
Change-Id: I4885cd0feb26f8ef56beb0d8848772ea2d42cb3a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
|
|
- update suite setup and constants to allow test runs again
- cleanup basic interface keywords
- cleanup L2-fib test data
- add "continue on failure" keyword to some partially failing tests
- add teardown to all suites, restarts honeycomb if suite had test failures
- fix minor PEP-8 violations in Topology.py
Change-Id: Ic5b434af71f77855f81461b280299b8318932c5a
Signed-off-by: selias <samelias@cisco.com>
|
|
Change-Id: Ia9f7913522421b6fd9ecba18eb4d68bc0f3b3271
Signed-off-by: Tibor Frank <tifrank@cisco.com>
|
|
Change-Id: I1e46ad76f033d239ad29d3b6fe00011a4444453d
Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
|
|
JIRA: CSIT-56
- create bootstrap_vpp_honeycomb.sh script which deploys VPP and Honeycomb
on DUTs
- Modify start-testcase script
Change-Id: I88511479cb8681168675c934f4fccbea83fa34bc
Signed-off-by: Tibor Frank <tifrank@cisco.com>
|
|
Change-Id: Ie98ab1095dedb4c24dbd44f64d3781934f664561
Signed-off-by: Stefano Chiesa <ssuryant@cisco.com>
|
|
- store log files in tmp directory and exclude all files in this
directory from archiving when creating tarballs
Change-Id: Ie3e11670c9d466c5fcf41d03ccd0a7bbb04ffeb0
Signed-off-by: Jan Gelety <jgelety@cisco.com>
|
|
Change-Id: Id6373d3bbfcc42e315976b59aa86c6cadee411f1
Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
|
|
- Add keyword to show vhost user
Change-Id: Ia844bbcb8507b8c7cbf6b7bb1a7dc8d10148d6f4
Signed-off-by: pmikus <pmikus@cisco.com>
|