aboutsummaryrefslogtreecommitdiffstats
path: root/resources
AgeCommit message (Collapse)AuthorFilesLines
2016-05-09QEMU VM guest-ping fixMatus Fabian1-1/+4
JIRA: CSIT-62 Change-Id: I0affda16af8f983895c50fbc306f45f30fbb69cd Signed-off-by: Matus Fabian <matfabia@cisco.com>
2016-05-09Interface VxLAN testTibor Frank3-0/+92
JIRA: CSIT-45 - add test: Honeycomb modifies interface configuration - VxLAN - add keywords used in these tests to set and verify configuration - add method and vat template for dumping an interface's configured VxLAN - fixed requirements.txt Change-Id: I6d6c360a4d478a0e40eecf7c0235969e7c06f7a9 Signed-off-by: Tibor Frank <tifrank@cisco.com> Signed-off-by: C.J. Collier <cjcollier@linuxfoundation.org>
2016-05-06Add Honeycomb interface management tests (ipv4, ipv6, ethernet, routing)selias5-33/+332
- add test cases for managing ipv4, ipv6, ethernet and routing configuration on VPP interface - add keywords used in these tests to set and verify configuration - add method and vat template for dumping an interface's configured IP addresses - add method for converting between ipv4 netmasks and network prefixes - clean up documentation of older Honeycomb keywords Note: Test cases are tagged with a placeholder tag to allow manual test runs locally. It should be replaced with the appropriate environment tags once Honeycomb service is deployed on virl. Change-Id: I99ce1e72c8550f520f8c35ef4a93eaebb530db78 Signed-off-by: selias <samelias@cisco.com> Signed-off-by: Matej Klotton <mklotton@cisco.com>
2016-05-06Honeycomb API keywords - interface, bridge domainTibor Frank5-673/+1186
- add keywords to manipulate data using Honeycomb REST API to configure interfaces and bridge domains - remove "add_vpp_to_honeycomb_network_topology" method from HoneycombSetup.py - remove "parse_json_response" from HoneycombUtil.py - add methods to manipulate data from Honeycomb REST API Change-Id: I5e6f87097fe9bfccffa3d4aae21f63281353cf29 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2016-05-06Add "show error" output into vpp statsPeter Mikus3-0/+12
- Add "show error" debug output into VPP show stats as verbose subcommand is not parsed correctly in output of vpp_api_test Change-Id: I924c54bb86375e43770fd449b8d6aaa7a3413bcb Signed-off-by: Peter Mikus <pmikus@cisco.com>
2016-05-04Update T-rex version to v2.00pmikus3-95/+143
- JIRA: CSIT-14 - Update T-rex version to v2.00 with latest API - Compatibility fixes of affected libraries and robot files - T-rex performance tuning Change-Id: I3a90553032d6d82e6e03df7e0b52e205d3f6ba4e Signed-off-by: pmikus <pmikus@cisco.com>
2016-05-03Patch to reset default VPP configuration in perf.pmikus1-1/+5
- JIRA: CSIT-57 - fix situation when vpp startup configuration is replaced by default with no interface configuration Change-Id: Iea23dcc0707bc96627b99d4500268a8e01bfda39 Signed-off-by: pmikus <pmikus@cisco.com>
2016-05-02Topo installation script fixMiroslav Miklus2-14/+40
-more logging -use single SSH instance -dpkg --force-all -update referece vpp version and reference short test threshold Change-Id: Ie67633755f451dba9d6a3ee1fc431d2c3f3b506f Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2016-05-02Add vpp_create_loopbackMatus Fabian2-0/+17
Change-Id: If934d7ec28f86b070a0cafa0ee56d0bcf4e2ac6d Signed-off-by: Matus Fabian <matfabia@cisco.com>
2016-04-26Add qinq through xconnect tests.Patrik Hrnciar5-0/+211
Change-Id: Ia20f5959dab41290bf60490ead830f0e37ecff0d Signed-off-by: Patrik Hrnciar <phrnciar@cisco.com>
2016-04-26Add BD vpp-vm-vpp testsMatus Fabian1-0/+54
JIRA: CSIT-20 Change-Id: Id22102519cdc8afef63c0e727fb47e2a2f1d769b Signed-off-by: Matus Fabian <matfabia@cisco.com>
2016-04-26Extend host topology with NIC type filteringMiroslav Miklus5-8/+98
JIRA: CSIT-1 Changes to allow filtering based on NIC model. Switched xconnect perf test to use filtered topology. Change-Id: Id526f47dc28f92bf26d070e54819ad29bccc0440 Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2016-04-26Honeycomb interface state management testselias4-58/+125
- add simple test for interface management through Honeycomb API - add status code 500 to honeycomb startup check whitelist, due to Honeycomb changes in https://gerrit.fd.io/r/772 - increase timeout value for Honeycomb startup check - modify Honeycomb setup keywords to allow starting Honeycomb on individual nodes - remove sanity test suite, tests now sorted by functional areas such as interfaces, bridge domains, VXlan,... Change-Id: I87f9cf69577706f3b00e24a8d2c01df52fc707c6 Signed-off-by: selias <samuel.elias@pantheon.tech>
2016-04-26Add optional args to traffic script arg parserMatus Fabian1-2/+10
Change-Id: I92e890e0c42da34e1e72a442f7a3bbe12fe9aef1 Signed-off-by: Matus Fabian <matfabia@cisco.com>
2016-04-26Add IPsec utilities python libraryMatus Fabian6-0/+367
JIRA: CSIT-28 Change-Id: I9513f14a9920bfbdaf34c5cc5d4619d16a383ca2 Signed-off-by: Matus Fabian <matfabia@cisco.com>
2016-04-25Honeycomb API keywordsTibor Frank9-26/+625
- add keywords to get, put post and delete configuration data using Honeycomb REST API - add keywords to get operational data using Honeycomb REST API Change-Id: If75221777e0e83a809c834addf82e95bbd540e21 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2016-04-22Reformat python libraries.Matej Klotton33-683/+722
PEP8 reformat fix typos docstrings reformat Change-Id: Ic48ba4e06490630808b8e2ab1ab0b046ec7eeed7 Signed-off-by: Matej Klotton <mklotton@cisco.com>
2016-04-22Bridge domain tests and user keywords refactor.Jan Gelety2-10/+170
- BD tests changed to behavior-driven-test style - added documentation to BD tests - added documentation and examples to BD user KWs Change-Id: Ifad45df3ef0bb55f5295363a264fe5f4e54f5762 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2016-04-22VatExecutor updateMatus Fabian2-0/+38
Strip non-JSON data from VAT terminal output Add method for VAT command retval verification Change-Id: Ibe68020393cb1a700ad048dc78078f71064707b4 Signed-off-by: Matus Fabian <matfabia@cisco.com>
2016-04-21Topology schemaTibor Frank1-2/+4
- fix Honeycomb part of the topology schema - add topology file checking using pykwalify before tests are started Change-Id: I907d41b66f5660a2ab4de8857312e9277052bae6 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2016-04-20Remove horizontal whitespace (a line) before [Command_start_exec] tag.mkonstan1-1/+0
Change-Id: I51e5616cb45b3c67e82153cc4c0f42ec9c5d75d7 Signed-off-by: mackonstan <mkonstan@cisco.com>
2016-04-19Make dut_setup.sh verbose; add sleep after vpp restart.Stefan Kobza1-40/+31
- there's a race condition between VPP service restart and vpp_api_test execution; this patch addresses it with (for now) sleep after service vpp restart - above is just a workaround until VPP provides us with a notification of readiness.. Change-Id: I1f92c1d86e4f90c9432ea57c1747629f619f003e Signed-off-by: Stefan Kobza <skobza@cisco.com>
2016-04-17Multicore VPP setup for performance testingpmikus2-3/+98
- add multithread TAGS documentation - add methods to VppConfigGenerator for RSS configuration - create KW for multithread setup - create sample test case using multithread vpp setup - add Documentation into TCs Change-Id: Id40862490d49380dc76d1d3ce39314603f983fd3 Signed-off-by: pmikus <pmikus@cisco.com>
2016-04-15Update Qemu libraryMatus Fabian2-12/+61
Incorporated changes from nested VM on VIRL. Change-Id: I76ceeb2dde635c2cf0d3a53d29bf24fed72a5437 Signed-off-by: Matus Fabian <matfabia@cisco.com>
2016-04-15Change the performance result messagepmikus1-6/+21
- change the result message of performance search to more verbose level (rate per stream, rate total, throughput in Gbps) Change-Id: I7562d6d33c525654131c75ebcc776cba438f68f4 Signed-off-by: pmikus <pmikus@cisco.com>
2016-04-13VXLAN test with dot1q tagging.Matej Klotton6-59/+165
Change-Id: I3dbd12983736e338d757c580570d91680aedd83f Signed-off-by: Matej Klotton <mklotton@cisco.com>
2016-04-13Move methods from topology.py to more appropriate place.Matej Klotton8-423/+345
Change-Id: I2612a9466095b3d79a4a9d938fcdbf9f93133f69 Signed-off-by: Matej Klotton <mklotton@cisco.com>
2016-04-13Honeycomb setup and utilsTibor4-242/+390
- re-implement HTTPCodes as IntEnum rather then dictionary - add methods to manipulate data using honeycomb - get, set, delete - change the name of url file from vpp_version.url to oper_vpp_version.url - improve checking of startup and shutdown state of honeycomb - PEP8 fixes - add docstrings in all modules and classes - move logging to the lowest possible level - improve logging in exceptions - add method exec_command_sudo_log to resources.libraries.python.ssh module Change-Id: I54e0c6b45313e3a3c11bafa475488ae2b1e605c2 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2016-04-13Add keywords for Honeycomb testsselias4-20/+80
-add interface dump and bridge-domain dump to Vat command templates -add low level keywords to implement vat dump commands The resulting data dumps will be used in Honeycomb testing, to verify data retrieved through Honeycomb API. Change-Id: I2a913eaf23aa13d7223576220681821007672812 Signed-off-by: selias <samuel.elias@pantheon.tech>
2016-04-12Bootstrap verify performance fixpmikus1-1/+1
- Bootstrap verify performance fix Change-Id: I8f77c26aef805f5223d03e2a0bc4a97f88195ed8 Signed-off-by: pmikus <pmikus@cisco.com>
2016-04-12Bootstrap verify performance fixpmikus1-10/+24
- fix installation directory create and remove Change-Id: I0acd47b886e869958a2075889af3bbe166d7808e Signed-off-by: pmikus <pmikus@cisco.com>
2016-04-12Update of topo_installation filepmikus1-1/+1
- deb package path fix Change-Id: I94065581886c4d5b9f15ced18857ddfcde442153 Signed-off-by: pmikus <pmikus@cisco.com>
2016-04-11Fix cosmetic issues in VIRL topologiesCarsten Koester3-22/+17
Fix cosmetic issues in VIRL topologies: - Replace double whitespace by single whitespace in XML - Remove reserved but unused IP address allocations from VIRL config - Modify "start-testcase" script to handle links without IP address Change-Id: Ie447bd91172df61b30ebb8650b56bdfca0f25fd4 Signed-off-by: Carsten Koester <ckoester@cisco.com>
2016-04-11Add VIRL double-ring (load-balancing) topology with nested VM supportCarsten Koester2-0/+393
Change-Id: Idcf173b1711076a5d7e4af8fe46e302b9eae4ff6 Signed-off-by: Carsten Koester <ckoester@cisco.com>
2016-04-11Combined DropRateSearchpmikus2-82/+179
- combined search algorithm using linear and binary search - add KWs into performance library for binary and combined search - remove short_bridge_domain_binary.robot as binary and combined search KWs are in library for optional use - PEP8 fixes Change-Id: I4a6c3c07c82db4f855fb93214b0532ee0c783e0a Signed-off-by: pmikus <pmikus@cisco.com>
2016-04-08Add Vagrantfile for local testing.Stefan Kobza5-17/+364
Vagrantfile contains 3 VMs as of now, 2 DUTs 1 TG, with these notes: - login is csit/csit - by default provision script installs all deb packages from the dir where Vagrantfile is - developed for, and only tested on vbox (someone can pick up vmware) - All nodes have 1 shared mgmt network: 192.168.255.0/24 - hosts have these IP addresses in host-only network TG : 192.168.255.100 DUT1 : 192.168.255.101 DUT2 : 192.168.255.102 - script created to download MAC address information - PCI addresses are always the same for vbox (not sure about vmware) HOWTO (will create a wiki page once one is created for CSIT project): - copy Vagrantfile to separate dir on host - vagrant up --parallel sit-back-and-relax - from VM that has access to the same host-only network (192.168.255.0 above) - copy your ssh-key to csit@192.168.255.{101,102,250} using ssh-copy-id - cd ${csit_dir} - virtualenv & pip as in README - export PYTHONPATH=${csit_dir} - resources/tools/topology/update_topology.py -v -f -o topologies/available/vagrant_pci.yaml \ topologies/available/vagrant.yaml - pybot -L TRACE \ -v TOPOLOGY_PATH:topologies/available/vagrant_pci.yaml -s \ "ipv4" tests - see tests results Change-Id: Ic27626605a9c820bca977b38f4e8ca37d1504ff5 Signed-off-by: Stefan Kobza <skobza@cisco.com>
2016-04-05Add tag support to boostrap-verify-perfpmikus1-3/+6
- support tags in vpp-verify-perfomance-* jenkins jobs Change-Id: I7e3abfe9e552a3f2fa9ebf95df9b48bcbae3561a Signed-off-by: pmikus <pmikus@cisco.com>
2016-04-05Add "Stop and Clear QEMU" KWMatus Fabian1-1/+14
Change-Id: Ib1b3907cd30c20c89283bd20e84ed8b829540ca4 Signed-off-by: Matus Fabian <matfabia@cisco.com>
2016-04-05Setup and check honeycomb on all DUTsselias10-2/+769
- methods implementing HTTP requests (PUT,GET,POST,DELETE) - methods for parsing HTTP responses - methods for honeycomb setup on DUT - updated constants.py - keywords for honeycomb setup and communication - simple honeycomb sanity test (not enabled for jenkins job runs) Change-Id: I589f0ca56cc01072b92fe9363aed16a4098aee40 Signed-off-by: selias <samuel.elias@pantheon.tech>
2016-04-05Add VIRL topology files and template for nested virtualisationCarsten Koester2-0/+359
Change-Id: I57dbe4f179b3cfd3f51c9dec503ca45a5c0521fd Signed-off-by: Carsten Koester <ckoester@cisco.com>
2016-04-04Change send_ip_icmp recv timeout to 2secMatus Fabian1-1/+1
Traffic script send_ip_icmp recv timeout 10 sec is too long and execution rather end with ssh timeout. Change-Id: Id4df679799191fd03e2987f068f3ea9e7bf12fdf Signed-off-by: Matus Fabian <matfabia@cisco.com>
2016-04-01Add get_vhost_user_if_name_by_sockMatus Fabian1-0/+16
Change-Id: I1d7f2cdfcf29763ce94417c98d363021f1fb27a1 Signed-off-by: Matus Fabian <matfabia@cisco.com>
2016-04-01Long perf testspmikus2-0/+80
- added new long tests for ipv4 and xconnect - modified long bridge domain test - added 64B, 1518B and 9000B frame sizes Change-Id: I88f75c375345f2d708df3fd24dd50d77bc63c495 Signed-off-by: pmikus <pmikus@cisco.com>
2016-04-01Bootstrap to test perf of proposed patch vpp-csit-hw-perfpmikus1-0/+57
- Based on #570 Lab reservation tool - Get the latest build of VPP - Make reservation on testbed by using existing topology files - Copy and install VPP image on all DUTs - Run performance tests Change-Id: I8034fd9c284cbe9a68e0c9116d0826965464b5f9 Signed-off-by: pmikus <pmikus@cisco.com>
2016-03-30Add linux_add/del_bridge and modify vpp_add_l2fib_entryMatus Fabian1-4/+39
linux_add_bridge - bridge two interfaces on linux node linux_del_bridge - delete bridge from linux node vpp_add_l2fib_entry - param interface should be interface name or sw_if_index Change-Id: Ia8030e24a0afe088df0dcb6c65a85ed341224206 Signed-off-by: Matus Fabian <matfabia@cisco.com>
2016-03-30BestN/WorstN DropRateSearchpmikus1-29/+132
- implementation of Best-of-N/Worst-of-N result evaluation with max attempts per one rate step Change-Id: Ice1d6e93807d90761462c4df601cbe068011159a Signed-off-by: pmikus <pmikus@cisco.com>
2016-03-29Bootstrap to test csit-master against VPP release.Jan Gelety1-4/+11
- get the version of the latest VPP build - download and install the latest VPP build on nodes - run three times all test suites to check if the VPP build can be used for csit development and current csit master can be pushed to master-verified branch (see patch https://gerrit.fd.io/r/590) Change-Id: I0ad2e9fe1620cc18ccc11dce2d107177cf97ff27 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2016-03-24Setup and run QEMU VMMatus Fabian1-2/+358
Change-Id: I22640caa9f13be09d2a837c6332d7b86cef77efc Signed-off-by: Matus Fabian <matfabia@cisco.com>
2016-03-24Add node type VM to set_interface_stateMatus Fabian1-1/+1
Change-Id: Ib70de73eec7c015f328f877fa34ead15e27eb254 Signed-off-by: Matus Fabian <matfabia@cisco.com>
2016-03-24Binary DropRateSearchpmikus1-4/+69
- binary search - short perf bridge_domain with binary Change-Id: I50538738b356cc8fef4cfcb4974c43c5123827d1 Signed-off-by: pmikus <pmikus@cisco.com>