Age | Commit message (Collapse) | Author | Files | Lines |
|
JIRA: CSIT-41, CSIT-42, CSIT-43
- add test cases for Honecomb bridge domain management
- add keywords used by these tests
- prefix the names of Honeycomb test suites with numbers, so that they
execute in a specific order
- moved suite teardown with "Stop Honeycomb service" to bridge domain
suite
Note: Due to time constraints, the Honeycomb service cannot be restarted
between executions of individual Honeycomb test suites. Therefore
Honeycomb will be setup in the first test suite and shut down after the
last one.
Change-Id: I36b7f8335e5ba54985da5bd83730cf856d5ab48b
Signed-off-by: selias <samelias@cisco.com>
|
|
JIRA: CSIT-62
Change-Id: I0affda16af8f983895c50fbc306f45f30fbb69cd
Signed-off-by: Matus Fabian <matfabia@cisco.com>
|
|
JIRA: CSIT-45
- add test: Honeycomb modifies interface configuration - VxLAN
- add keywords used in these tests to set and verify configuration
- add method and vat template for dumping an interface's configured VxLAN
- fixed requirements.txt
Change-Id: I6d6c360a4d478a0e40eecf7c0235969e7c06f7a9
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Signed-off-by: C.J. Collier <cjcollier@linuxfoundation.org>
|
|
Change-Id: I7c465a057640782219a8eb3b4c131d2d8edfcadc
Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
|
|
- add test cases for managing ipv4, ipv6, ethernet and routing
configuration on VPP interface
- add keywords used in these tests to set and verify configuration
- add method and vat template for dumping an interface's
configured IP addresses
- add method for converting between ipv4 netmasks and
network prefixes
- clean up documentation of older Honeycomb keywords
Note: Test cases are tagged with a placeholder tag to allow manual
test runs locally. It should be replaced with the appropriate
environment tags once Honeycomb service is deployed on virl.
Change-Id: I99ce1e72c8550f520f8c35ef4a93eaebb530db78
Signed-off-by: selias <samelias@cisco.com>
Signed-off-by: Matej Klotton <mklotton@cisco.com>
|
|
- add keywords to manipulate data using Honeycomb REST API to configure
interfaces and bridge domains
- remove "add_vpp_to_honeycomb_network_topology" method from
HoneycombSetup.py
- remove "parse_json_response" from HoneycombUtil.py
- add methods to manipulate data from Honeycomb REST API
Change-Id: I5e6f87097fe9bfccffa3d4aae21f63281353cf29
Signed-off-by: Tibor Frank <tifrank@cisco.com>
|
|
- Add "show error" debug output into VPP show stats as verbose
subcommand is not parsed correctly in output of vpp_api_test
Change-Id: I924c54bb86375e43770fd449b8d6aaa7a3413bcb
Signed-off-by: Peter Mikus <pmikus@cisco.com>
|
|
Change-Id: If35705c1934dfb10f117f03ebbba111854f34360
Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
|
|
- vpp build 437
Change-Id: I75cd51aaa721ada40e7e206a3d4637d238849ae6
Signed-off-by: Jan Gelety <jgelety@cisco.com>
|
|
- JIRA: CSIT-14
- Update T-rex version to v2.00 with latest API
- Compatibility fixes of affected libraries and robot files
- T-rex performance tuning
Change-Id: I3a90553032d6d82e6e03df7e0b52e205d3f6ba4e
Signed-off-by: pmikus <pmikus@cisco.com>
|
|
- JIRA: CSIT-57
- fix situation when vpp startup configuration is replaced by default
with no interface configuration
Change-Id: Iea23dcc0707bc96627b99d4500268a8e01bfda39
Signed-off-by: pmikus <pmikus@cisco.com>
|
|
-more logging
-use single SSH instance
-dpkg --force-all
-update referece vpp version and reference short test threshold
Change-Id: Ie67633755f451dba9d6a3ee1fc431d2c3f3b506f
Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
|
|
Change-Id: If934d7ec28f86b070a0cafa0ee56d0bcf4e2ac6d
Signed-off-by: Matus Fabian <matfabia@cisco.com>
|
|
JIRA: CSIT-5
- vpp installation for csit-vpp-verify-* jobs
- use single bootstrap for all verify-perf jobs
Change-Id: Ifb30a360daecc90446f53d20440e2723b01c6050
Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
|
|
- vpp version changed to 1.0.0-377
Change-Id: I776fc49a1af15824a4c55071eecfc80fb4824295
Signed-off-by: Jan Gelety <jgelety@cisco.com>
|
|
Change-Id: Ia20f5959dab41290bf60490ead830f0e37ecff0d
Signed-off-by: Patrik Hrnciar <phrnciar@cisco.com>
|
|
JIRA: CSIT-20
Change-Id: Id22102519cdc8afef63c0e727fb47e2a2f1d769b
Signed-off-by: Matus Fabian <matfabia@cisco.com>
|
|
JIRA: CSIT-1
Changes to allow filtering based on NIC model.
Switched xconnect perf test to use filtered topology.
Change-Id: Id526f47dc28f92bf26d070e54819ad29bccc0440
Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
|
|
- add simple test for interface management through Honeycomb API
- add status code 500 to honeycomb startup check whitelist,
due to Honeycomb changes in https://gerrit.fd.io/r/772
- increase timeout value for Honeycomb startup check
- modify Honeycomb setup keywords to allow starting Honeycomb
on individual nodes
- remove sanity test suite, tests now sorted by functional areas
such as interfaces, bridge domains, VXlan,...
Change-Id: I87f9cf69577706f3b00e24a8d2c01df52fc707c6
Signed-off-by: selias <samuel.elias@pantheon.tech>
|
|
Change-Id: I92e890e0c42da34e1e72a442f7a3bbe12fe9aef1
Signed-off-by: Matus Fabian <matfabia@cisco.com>
|
|
JIRA: CSIT-28
Change-Id: I9513f14a9920bfbdaf34c5cc5d4619d16a383ca2
Signed-off-by: Matus Fabian <matfabia@cisco.com>
|
|
- VIRL image switched to double-ring-nested topology
- removed exclusion of 3_NODE_DOUBLE_LINK_TOPO test cases
- included test cases with tags:
- VM_ENV and 3_NODE_SINGLE_LINK_TOPO
- VM_ENV and 3_NODE_DOUBLE_LINK_TOPO
Change-Id: I99084b57c1fdd4aefb028cb144822a645baf9321
Signed-off-by: Jan Gelety <jgelety@cisco.com>
|
|
- add keywords to get, put post and delete configuration data using Honeycomb
REST API
- add keywords to get operational data using Honeycomb REST API
Change-Id: If75221777e0e83a809c834addf82e95bbd540e21
Signed-off-by: Tibor Frank <tifrank@cisco.com>
|
|
PEP8 reformat
fix typos
docstrings reformat
Change-Id: Ic48ba4e06490630808b8e2ab1ab0b046ec7eeed7
Signed-off-by: Matej Klotton <mklotton@cisco.com>
|
|
- BD tests changed to behavior-driven-test style
- added documentation to BD tests
- added documentation and examples to BD user KWs
Change-Id: Ifad45df3ef0bb55f5295363a264fe5f4e54f5762
Signed-off-by: Jan Gelety <jgelety@cisco.com>
|
|
Strip non-JSON data from VAT terminal output
Add method for VAT command retval verification
Change-Id: Ibe68020393cb1a700ad048dc78078f71064707b4
Signed-off-by: Matus Fabian <matfabia@cisco.com>
|
|
- JIRA: CSIT-10
- Add 1518B and 9000B test for multicore tests
- Fine tune threshold for short tests based on previous benchmarks
- Fix SI units
Change-Id: I5c4657dfd881a24b2e40c91ea80a979003754258
Signed-off-by: pmikus <pmikus@cisco.com>
|
|
- fix Honeycomb part of the topology schema
- add topology file checking using pykwalify before tests are started
Change-Id: I907d41b66f5660a2ab4de8857312e9277052bae6
Signed-off-by: Tibor Frank <tifrank@cisco.com>
|
|
Change-Id: I51e5616cb45b3c67e82153cc4c0f42ec9c5d75d7
Signed-off-by: mackonstan <mkonstan@cisco.com>
|
|
- include tags to CSIT performance boostrap script
- allows future expansion of selective test execution
Change-Id: I3870f52d86ff39234eb724500d3871fed0cbdb30
Signed-off-by: pmikus <pmikus@cisco.com>
|
|
Change-Id: I0d41aad3fc1f96b58b83c6f0aa5a0e7606868ee4
Signed-off-by: Stefan Kobza <skobza@cisco.com>
|
|
- there's a race condition between VPP service restart and vpp_api_test
execution; this patch addresses it with (for now) sleep after service
vpp restart
- above is just a workaround until VPP provides us with a notification
of readiness..
Change-Id: I1f92c1d86e4f90c9432ea57c1747629f619f003e
Signed-off-by: Stefan Kobza <skobza@cisco.com>
|
|
- add multithread TAGS documentation
- add methods to VppConfigGenerator for RSS configuration
- create KW for multithread setup
- create sample test case using multithread vpp setup
- add Documentation into TCs
Change-Id: Id40862490d49380dc76d1d3ce39314603f983fd3
Signed-off-by: pmikus <pmikus@cisco.com>
|
|
Incorporated changes from nested VM on VIRL.
Change-Id: I76ceeb2dde635c2cf0d3a53d29bf24fed72a5437
Signed-off-by: Matus Fabian <matfabia@cisco.com>
|
|
- change the result message of performance search to more verbose level
(rate per stream, rate total, throughput in Gbps)
Change-Id: I7562d6d33c525654131c75ebcc776cba438f68f4
Signed-off-by: pmikus <pmikus@cisco.com>
|
|
- updated vpp build version
- VIRL image switched to double-ring-nested topology
- removed exclusion of 3_NODE_DOUBLE_LINK_TOPO test cases
- included test cases with tags:
- VM_ENV and 3_NODE_SINGLE_LINK_TOPO
- VM_ENV and 3_NODE_DOUBLE_LINK_TOPO
- added missing tags to TC VPP reports interfaces in Bridge
Domain test suite
Change-Id: Ia6a7a54ef9ad6245835b2762c303935fe39f4079
Signed-off-by: Jan Gelety <jgelety@cisco.com>
|
|
Change-Id: I3dbd12983736e338d757c580570d91680aedd83f
Signed-off-by: Matej Klotton <mklotton@cisco.com>
|
|
Change-Id: I2612a9466095b3d79a4a9d938fcdbf9f93133f69
Signed-off-by: Matej Klotton <mklotton@cisco.com>
|
|
- re-implement HTTPCodes as IntEnum rather then dictionary
- add methods to manipulate data using honeycomb - get, set, delete
- change the name of url file from vpp_version.url to oper_vpp_version.url
- improve checking of startup and shutdown state of honeycomb
- PEP8 fixes
- add docstrings in all modules and classes
- move logging to the lowest possible level
- improve logging in exceptions
- add method exec_command_sudo_log to resources.libraries.python.ssh module
Change-Id: I54e0c6b45313e3a3c11bafa475488ae2b1e605c2
Signed-off-by: Tibor Frank <tifrank@cisco.com>
|
|
Generate testdoc by using:
python -m robot.testdoc long_xconnect.robot perf_long_xconnect.html
Change-Id: I12d83de4abb1af4d94e6fd78d05c46018ee5d7d7
Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
|
|
-add interface dump and bridge-domain dump to Vat command templates
-add low level keywords to implement vat dump commands
The resulting data dumps will be used in Honeycomb testing,
to verify data retrieved through Honeycomb API.
Change-Id: I2a913eaf23aa13d7223576220681821007672812
Signed-off-by: selias <samuel.elias@pantheon.tech>
|
|
- Boostrap verify installation directory removal
Change-Id: I091240f8a3f7e5074cdc2f069837963e4c8bd192
Signed-off-by: pmikus <pmikus@cisco.com>
|
|
- Bootstrap verify performance fix
Change-Id: I8f77c26aef805f5223d03e2a0bc4a97f88195ed8
Signed-off-by: pmikus <pmikus@cisco.com>
|
|
- fix installation directory create and remove
Change-Id: I0acd47b886e869958a2075889af3bbe166d7808e
Signed-off-by: pmikus <pmikus@cisco.com>
|
|
- fix test tags to lowercase
Change-Id: I6e01a677f15843105106300097b4d0b23e2cba5d
Signed-off-by: pmikus <pmikus@cisco.com>
|
|
- deb package path fix
Change-Id: I94065581886c4d5b9f15ced18857ddfcde442153
Signed-off-by: pmikus <pmikus@cisco.com>
|
|
Fix cosmetic issues in VIRL topologies:
- Replace double whitespace by single whitespace in XML
- Remove reserved but unused IP address allocations from VIRL config
- Modify "start-testcase" script to handle links without IP address
Change-Id: Ie447bd91172df61b30ebb8650b56bdfca0f25fd4
Signed-off-by: Carsten Koester <ckoester@cisco.com>
|
|
Change-Id: Idcf173b1711076a5d7e4af8fe46e302b9eae4ff6
Signed-off-by: Carsten Koester <ckoester@cisco.com>
|
|
- combined search algorithm using linear and binary search
- add KWs into performance library for binary and combined search
- remove short_bridge_domain_binary.robot as binary and combined search
KWs are in library for optional use
- PEP8 fixes
Change-Id: I4a6c3c07c82db4f855fb93214b0532ee0c783e0a
Signed-off-by: pmikus <pmikus@cisco.com>
|
|
Vagrantfile contains 3 VMs as of now, 2 DUTs 1 TG, with these notes:
- login is csit/csit
- by default provision script installs all deb packages from the dir
where Vagrantfile is
- developed for, and only tested on vbox (someone can pick up vmware)
- All nodes have 1 shared mgmt network: 192.168.255.0/24
- hosts have these IP addresses in host-only network
TG : 192.168.255.100
DUT1 : 192.168.255.101
DUT2 : 192.168.255.102
- script created to download MAC address information
- PCI addresses are always the same for vbox (not sure about vmware)
HOWTO (will create a wiki page once one is created for CSIT project):
- copy Vagrantfile to separate dir on host
- vagrant up --parallel
sit-back-and-relax
- from VM that has access to the same host-only network (192.168.255.0 above)
- copy your ssh-key to csit@192.168.255.{101,102,250} using
ssh-copy-id
- cd ${csit_dir}
- virtualenv & pip as in README
- export PYTHONPATH=${csit_dir}
- resources/tools/topology/update_topology.py -v -f
-o topologies/available/vagrant_pci.yaml \
topologies/available/vagrant.yaml
- pybot -L TRACE \
-v TOPOLOGY_PATH:topologies/available/vagrant_pci.yaml -s \
"ipv4" tests
- see tests results
Change-Id: Ic27626605a9c820bca977b38f4e8ca37d1504ff5
Signed-off-by: Stefan Kobza <skobza@cisco.com>
|