aboutsummaryrefslogtreecommitdiffstats
path: root/resources
AgeCommit message (Collapse)AuthorFilesLines
2016-05-09CSIT-9: COP Whitelist/blacklistZdeno10-3/+408
- Included are also IPv6 tests - JIRA: CSIT-17 Change-Id: I89ae6c38cdc6742a597c0dc24ed1c033c1b5d155 Signed-off-by: Zdeno <zolsovsk@cisco.com>
2016-05-09CSIT-19: MAC split-horizon groupJan Gelety2-3/+77
- test case to test MAC split-horizon group functionality Change-Id: Iadee707f3670e5fc9c209bd8b072a65ea1af27cd Signed-off-by: Jan Gelety <jgelety@cisco.com>
2016-05-09Add Honeycomb bridge domain management testsselias1-0/+202
JIRA: CSIT-41, CSIT-42, CSIT-43 - add test cases for Honecomb bridge domain management - add keywords used by these tests - prefix the names of Honeycomb test suites with numbers, so that they execute in a specific order - moved suite teardown with "Stop Honeycomb service" to bridge domain suite Note: Due to time constraints, the Honeycomb service cannot be restarted between executions of individual Honeycomb test suites. Therefore Honeycomb will be setup in the first test suite and shut down after the last one. Change-Id: I36b7f8335e5ba54985da5bd83730cf856d5ab48b Signed-off-by: selias <samelias@cisco.com>
2016-05-09QEMU VM guest-ping fixMatus Fabian1-1/+4
JIRA: CSIT-62 Change-Id: I0affda16af8f983895c50fbc306f45f30fbb69cd Signed-off-by: Matus Fabian <matfabia@cisco.com>
2016-05-09Interface VxLAN testTibor Frank3-0/+92
JIRA: CSIT-45 - add test: Honeycomb modifies interface configuration - VxLAN - add keywords used in these tests to set and verify configuration - add method and vat template for dumping an interface's configured VxLAN - fixed requirements.txt Change-Id: I6d6c360a4d478a0e40eecf7c0235969e7c06f7a9 Signed-off-by: Tibor Frank <tifrank@cisco.com> Signed-off-by: C.J. Collier <cjcollier@linuxfoundation.org>
2016-05-06Add Honeycomb interface management tests (ipv4, ipv6, ethernet, routing)selias5-33/+332
- add test cases for managing ipv4, ipv6, ethernet and routing configuration on VPP interface - add keywords used in these tests to set and verify configuration - add method and vat template for dumping an interface's configured IP addresses - add method for converting between ipv4 netmasks and network prefixes - clean up documentation of older Honeycomb keywords Note: Test cases are tagged with a placeholder tag to allow manual test runs locally. It should be replaced with the appropriate environment tags once Honeycomb service is deployed on virl. Change-Id: I99ce1e72c8550f520f8c35ef4a93eaebb530db78 Signed-off-by: selias <samelias@cisco.com> Signed-off-by: Matej Klotton <mklotton@cisco.com>
2016-05-06Honeycomb API keywords - interface, bridge domainTibor Frank5-673/+1186
- add keywords to manipulate data using Honeycomb REST API to configure interfaces and bridge domains - remove "add_vpp_to_honeycomb_network_topology" method from HoneycombSetup.py - remove "parse_json_response" from HoneycombUtil.py - add methods to manipulate data from Honeycomb REST API Change-Id: I5e6f87097fe9bfccffa3d4aae21f63281353cf29 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2016-05-06Add "show error" output into vpp statsPeter Mikus3-0/+12
- Add "show error" debug output into VPP show stats as verbose subcommand is not parsed correctly in output of vpp_api_test Change-Id: I924c54bb86375e43770fd449b8d6aaa7a3413bcb Signed-off-by: Peter Mikus <pmikus@cisco.com>
2016-05-04Update T-rex version to v2.00pmikus3-95/+143
- JIRA: CSIT-14 - Update T-rex version to v2.00 with latest API - Compatibility fixes of affected libraries and robot files - T-rex performance tuning Change-Id: I3a90553032d6d82e6e03df7e0b52e205d3f6ba4e Signed-off-by: pmikus <pmikus@cisco.com>
2016-05-03Patch to reset default VPP configuration in perf.pmikus1-1/+5
- JIRA: CSIT-57 - fix situation when vpp startup configuration is replaced by default with no interface configuration Change-Id: Iea23dcc0707bc96627b99d4500268a8e01bfda39 Signed-off-by: pmikus <pmikus@cisco.com>
2016-05-02Topo installation script fixMiroslav Miklus2-14/+40
-more logging -use single SSH instance -dpkg --force-all -update referece vpp version and reference short test threshold Change-Id: Ie67633755f451dba9d6a3ee1fc431d2c3f3b506f Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2016-05-02Add vpp_create_loopbackMatus Fabian2-0/+17
Change-Id: If934d7ec28f86b070a0cafa0ee56d0bcf4e2ac6d Signed-off-by: Matus Fabian <matfabia@cisco.com>
2016-04-26Add qinq through xconnect tests.Patrik Hrnciar5-0/+211
Change-Id: Ia20f5959dab41290bf60490ead830f0e37ecff0d Signed-off-by: Patrik Hrnciar <phrnciar@cisco.com>
2016-04-26Add BD vpp-vm-vpp testsMatus Fabian1-0/+54
JIRA: CSIT-20 Change-Id: Id22102519cdc8afef63c0e727fb47e2a2f1d769b Signed-off-by: Matus Fabian <matfabia@cisco.com>
2016-04-26Extend host topology with NIC type filteringMiroslav Miklus5-8/+98
JIRA: CSIT-1 Changes to allow filtering based on NIC model. Switched xconnect perf test to use filtered topology. Change-Id: Id526f47dc28f92bf26d070e54819ad29bccc0440 Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2016-04-26Honeycomb interface state management testselias4-58/+125
- add simple test for interface management through Honeycomb API - add status code 500 to honeycomb startup check whitelist, due to Honeycomb changes in https://gerrit.fd.io/r/772 - increase timeout value for Honeycomb startup check - modify Honeycomb setup keywords to allow starting Honeycomb on individual nodes - remove sanity test suite, tests now sorted by functional areas such as interfaces, bridge domains, VXlan,... Change-Id: I87f9cf69577706f3b00e24a8d2c01df52fc707c6 Signed-off-by: selias <samuel.elias@pantheon.tech>
2016-04-26Add optional args to traffic script arg parserMatus Fabian1-2/+10
Change-Id: I92e890e0c42da34e1e72a442f7a3bbe12fe9aef1 Signed-off-by: Matus Fabian <matfabia@cisco.com>
2016-04-26Add IPsec utilities python libraryMatus Fabian6-0/+367
JIRA: CSIT-28 Change-Id: I9513f14a9920bfbdaf34c5cc5d4619d16a383ca2 Signed-off-by: Matus Fabian <matfabia@cisco.com>
2016-04-25Honeycomb API keywordsTibor Frank9-26/+625
- add keywords to get, put post and delete configuration data using Honeycomb REST API - add keywords to get operational data using Honeycomb REST API Change-Id: If75221777e0e83a809c834addf82e95bbd540e21 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2016-04-22Reformat python libraries.Matej Klotton33-683/+722
PEP8 reformat fix typos docstrings reformat Change-Id: Ic48ba4e06490630808b8e2ab1ab0b046ec7eeed7 Signed-off-by: Matej Klotton <mklotton@cisco.com>
2016-04-22Bridge domain tests and user keywords refactor.Jan Gelety2-10/+170
- BD tests changed to behavior-driven-test style - added documentation to BD tests - added documentation and examples to BD user KWs Change-Id: Ifad45df3ef0bb55f5295363a264fe5f4e54f5762 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2016-04-22VatExecutor updateMatus Fabian2-0/+38
Strip non-JSON data from VAT terminal output Add method for VAT command retval verification Change-Id: Ibe68020393cb1a700ad048dc78078f71064707b4 Signed-off-by: Matus Fabian <matfabia@cisco.com>
2016-04-21Topology schemaTibor Frank1-2/+4
- fix Honeycomb part of the topology schema - add topology file checking using pykwalify before tests are started Change-Id: I907d41b66f5660a2ab4de8857312e9277052bae6 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2016-04-20Remove horizontal whitespace (a line) before [Command_start_exec] tag.mkonstan1-1/+0
Change-Id: I51e5616cb45b3c67e82153cc4c0f42ec9c5d75d7 Signed-off-by: mackonstan <mkonstan@cisco.com>
2016-04-19Make dut_setup.sh verbose; add sleep after vpp restart.Stefan Kobza1-40/+31
- there's a race condition between VPP service restart and vpp_api_test execution; this patch addresses it with (for now) sleep after service vpp restart - above is just a workaround until VPP provides us with a notification of readiness.. Change-Id: I1f92c1d86e4f90c9432ea57c1747629f619f003e Signed-off-by: Stefan Kobza <skobza@cisco.com>
2016-04-17Multicore VPP setup for performance testingpmikus2-3/+98
- add multithread TAGS documentation - add methods to VppConfigGenerator for RSS configuration - create KW for multithread setup - create sample test case using multithread vpp setup - add Documentation into TCs Change-Id: Id40862490d49380dc76d1d3ce39314603f983fd3 Signed-off-by: pmikus <pmikus@cisco.com>
2016-04-15Update Qemu libraryMatus Fabian2-12/+61
Incorporated changes from nested VM on VIRL. Change-Id: I76ceeb2dde635c2cf0d3a53d29bf24fed72a5437 Signed-off-by: Matus Fabian <matfabia@cisco.com>
2016-04-15Change the performance result messagepmikus1-6/+21
- change the result message of performance search to more verbose level (rate per stream, rate total, throughput in Gbps) Change-Id: I7562d6d33c525654131c75ebcc776cba438f68f4 Signed-off-by: pmikus <pmikus@cisco.com>
2016-04-13VXLAN test with dot1q tagging.Matej Klotton6-59/+165
Change-Id: I3dbd12983736e338d757c580570d91680aedd83f Signed-off-by: Matej Klotton <mklotton@cisco.com>
2016-04-13Move methods from topology.py to more appropriate place.Matej Klotton8-423/+345
Change-Id: I2612a9466095b3d79a4a9d938fcdbf9f93133f69 Signed-off-by: Matej Klotton <mklotton@cisco.com>
2016-04-13Honeycomb setup and utilsTibor4-242/+390
- re-implement HTTPCodes as IntEnum rather then dictionary - add methods to manipulate data using honeycomb - get, set, delete - change the name of url file from vpp_version.url to oper_vpp_version.url - improve checking of startup and shutdown state of honeycomb - PEP8 fixes - add docstrings in all modules and classes - move logging to the lowest possible level - improve logging in exceptions - add method exec_command_sudo_log to resources.libraries.python.ssh module Change-Id: I54e0c6b45313e3a3c11bafa475488ae2b1e605c2 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2016-04-13Add keywords for Honeycomb testsselias4-20/+80
-add interface dump and bridge-domain dump to Vat command templates -add low level keywords to implement vat dump commands The resulting data dumps will be used in Honeycomb testing, to verify data retrieved through Honeycomb API. Change-Id: I2a913eaf23aa13d7223576220681821007672812 Signed-off-by: selias <samuel.elias@pantheon.tech>
2016-04-12Bootstrap verify performance fixpmikus1-1/+1
- Bootstrap verify performance fix Change-Id: I8f77c26aef805f5223d03e2a0bc4a97f88195ed8 Signed-off-by: pmikus <pmikus@cisco.com>
2016-04-12Bootstrap verify performance fixpmikus1-10/+24
- fix installation directory create and remove Change-Id: I0acd47b886e869958a2075889af3bbe166d7808e Signed-off-by: pmikus <pmikus@cisco.com>
2016-04-12Update of topo_installation filepmikus1-1/+1
- deb package path fix Change-Id: I94065581886c4d5b9f15ced18857ddfcde442153 Signed-off-by: pmikus <pmikus@cisco.com>
2016-04-11Fix cosmetic issues in VIRL topologiesCarsten Koester3-22/+17
Fix cosmetic issues in VIRL topologies: - Replace double whitespace by single whitespace in XML - Remove reserved but unused IP address allocations from VIRL config - Modify "start-testcase" script to handle links without IP address Change-Id: Ie447bd91172df61b30ebb8650b56bdfca0f25fd4 Signed-off-by: Carsten Koester <ckoester@cisco.com>
2016-04-11Add VIRL double-ring (load-balancing) topology with nested VM supportCarsten Koester2-0/+393
Change-Id: Idcf173b1711076a5d7e4af8fe46e302b9eae4ff6 Signed-off-by: Carsten Koester <ckoester@cisco.com>
2016-04-11Combined DropRateSearchpmikus2-82/+179
- combined search algorithm using linear and binary search - add KWs into performance library for binary and combined search - remove short_bridge_domain_binary.robot as binary and combined search KWs are in library for optional use - PEP8 fixes Change-Id: I4a6c3c07c82db4f855fb93214b0532ee0c783e0a Signed-off-by: pmikus <pmikus@cisco.com>
2016-04-08Add Vagrantfile for local testing.Stefan Kobza5-17/+364
Vagrantfile contains 3 VMs as of now, 2 DUTs 1 TG, with these notes: - login is csit/csit - by default provision script installs all deb packages from the dir where Vagrantfile is - developed for, and only tested on vbox (someone can pick up vmware) - All nodes have 1 shared mgmt network: 192.168.255.0/24 - hosts have these IP addresses in host-only network TG : 192.168.255.100 DUT1 : 192.168.255.101 DUT2 : 192.168.255.102 - script created to download MAC address information - PCI addresses are always the same for vbox (not sure about vmware) HOWTO (will create a wiki page once one is created for CSIT project): - copy Vagrantfile to separate dir on host - vagrant up --parallel sit-back-and-relax - from VM that has access to the same host-only network (192.168.255.0 above) - copy your ssh-key to csit@192.168.255.{101,102,250} using ssh-copy-id - cd ${csit_dir} - virtualenv & pip as in README - export PYTHONPATH=${csit_dir} - resources/tools/topology/update_topology.py -v -f -o topologies/available/vagrant_pci.yaml \ topologies/available/vagrant.yaml - pybot -L TRACE \ -v TOPOLOGY_PATH:topologies/available/vagrant_pci.yaml -s \ "ipv4" tests - see tests results Change-Id: Ic27626605a9c820bca977b38f4e8ca37d1504ff5 Signed-off-by: Stefan Kobza <skobza@cisco.com>
2016-04-05Add tag support to boostrap-verify-perfpmikus1-3/+6
- support tags in vpp-verify-perfomance-* jenkins jobs Change-Id: I7e3abfe9e552a3f2fa9ebf95df9b48bcbae3561a Signed-off-by: pmikus <pmikus@cisco.com>
2016-04-05Add "Stop and Clear QEMU" KWMatus Fabian1-1/+14
Change-Id: Ib1b3907cd30c20c89283bd20e84ed8b829540ca4 Signed-off-by: Matus Fabian <matfabia@cisco.com>
2016-04-05Setup and check honeycomb on all DUTsselias10-2/+769
- methods implementing HTTP requests (PUT,GET,POST,DELETE) - methods for parsing HTTP responses - methods for honeycomb setup on DUT - updated constants.py - keywords for honeycomb setup and communication - simple honeycomb sanity test (not enabled for jenkins job runs) Change-Id: I589f0ca56cc01072b92fe9363aed16a4098aee40 Signed-off-by: selias <samuel.elias@pantheon.tech>
2016-04-05Add VIRL topology files and template for nested virtualisationCarsten Koester2-0/+359
Change-Id: I57dbe4f179b3cfd3f51c9dec503ca45a5c0521fd Signed-off-by: Carsten Koester <ckoester@cisco.com>
2016-04-04Change send_ip_icmp recv timeout to 2secMatus Fabian1-1/+1
Traffic script send_ip_icmp recv timeout 10 sec is too long and execution rather end with ssh timeout. Change-Id: Id4df679799191fd03e2987f068f3ea9e7bf12fdf Signed-off-by: Matus Fabian <matfabia@cisco.com>
2016-04-01Add get_vhost_user_if_name_by_sockMatus Fabian1-0/+16
Change-Id: I1d7f2cdfcf29763ce94417c98d363021f1fb27a1 Signed-off-by: Matus Fabian <matfabia@cisco.com>
2016-04-01Long perf testspmikus2-0/+80
- added new long tests for ipv4 and xconnect - modified long bridge domain test - added 64B, 1518B and 9000B frame sizes Change-Id: I88f75c375345f2d708df3fd24dd50d77bc63c495 Signed-off-by: pmikus <pmikus@cisco.com>
2016-04-01Bootstrap to test perf of proposed patch vpp-csit-hw-perfpmikus1-0/+57
- Based on #570 Lab reservation tool - Get the latest build of VPP - Make reservation on testbed by using existing topology files - Copy and install VPP image on all DUTs - Run performance tests Change-Id: I8034fd9c284cbe9a68e0c9116d0826965464b5f9 Signed-off-by: pmikus <pmikus@cisco.com>
2016-03-30Add linux_add/del_bridge and modify vpp_add_l2fib_entryMatus Fabian1-4/+39
linux_add_bridge - bridge two interfaces on linux node linux_del_bridge - delete bridge from linux node vpp_add_l2fib_entry - param interface should be interface name or sw_if_index Change-Id: Ia8030e24a0afe088df0dcb6c65a85ed341224206 Signed-off-by: Matus Fabian <matfabia@cisco.com>
2016-03-30BestN/WorstN DropRateSearchpmikus1-29/+132
- implementation of Best-of-N/Worst-of-N result evaluation with max attempts per one rate step Change-Id: Ice1d6e93807d90761462c4df601cbe068011159a Signed-off-by: pmikus <pmikus@cisco.com>
2016-03-29Bootstrap to test csit-master against VPP release.Jan Gelety1-4/+11
- get the version of the latest VPP build - download and install the latest VPP build on nodes - run three times all test suites to check if the VPP build can be used for csit development and current csit master can be pushed to master-verified branch (see patch https://gerrit.fd.io/r/590) Change-Id: I0ad2e9fe1620cc18ccc11dce2d107177cf97ff27 Signed-off-by: Jan Gelety <jgelety@cisco.com>