aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2016-05-13Add keyword to manipulate interface TAP parametersTibor Frank1-0/+67
JIRA: CSIT-69 - add a keyword to be able to: - configure all TAP parameters at once - configure TAP parameters one by one - remove a TAP parameter - remove all TAP parameters at once - add a keyword which adds a new TAP interface Change-Id: I5620adc3f777f7a337bbd737e685891b425d4e09 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2016-05-13Add possibility to create a VxLAN interface.Tibor Frank3-13/+86
JIRA: CSIT-51 - add a keyword which adds a new VxLAN interface - change InterfaceUtil.vxlan_dump to be able to return info about all VxLAN interfaces. Change-Id: I8ad3dc1d414924e74ea1ecea1f316ca5c648e2d0 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2016-05-12Add possibility to change VxLAN parameters at onceTibor Frank1-12/+20
JIRA: CSIT-51 - modify existing keyword "configure_interface_vxlan" to be able to: - configure all VxLAN parameters at once - configure VxLAN parameters one by one - remove a parameter - remove all parameters at once Change-Id: I50551fbc3ae5c6aa147d531fc66b583af36bb541 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2016-05-12Update of vpp build for perf testsMiroslav Miklus1-1/+1
build: 1.0.0-437~g8f15e92_amd64 Change-Id: Ie0d0f693bcae0d0e56472c25b6353890d07e85d9 Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2016-05-12Update Honeycomb interface IPv4 testselias4-28/+69
- add verification of ipv4 subnet prefix support - modify keywords to allow setting ipv4 address with network prefix - fix variable definitions to evaluate numbers as ints, not strings - add exception to ipv4 netmask/prefix conversion method Change-Id: I9343ceb35856ddb33674d7067f1def6d40e99acc Signed-off-by: selias <samelias@cisco.com>
2016-05-12Add functions to get interface name or index from JSON interface dump.Matej Klotton2-0/+76
Change-Id: I4778c9fa72e418f6fea427f88fd9aa1ea579ac99 Signed-off-by: Matej Klotton <mklotton@cisco.com>
2016-05-11Add library for set path variables for testing.Matej Klotton16-622/+483
Change-Id: Icb243bacc9329c4bf3bc28098fced473b4e3c991 Signed-off-by: Matej Klotton <mklotton@cisco.com>
2016-05-11Performance IPv6 library and short/long test casespmikus8-14/+539
- JIRA: CSIT-2 - Create IPv6 test cases for long/short/singlethread/multithread performance testing - Create robot KWs for IPv6 performance testing - Add T-Rex IPv6 profile Change-Id: I306d5c894d9b9287bf91929764aeb1c7083d802c Signed-off-by: pmikus <pmikus@cisco.com> Signed-off-by: Peter Mikus <pmikus@cisco.com>
2016-05-11Extend ranges of binary search in ipv4 perf testingPeter Mikus1-5/+5
- Extend ranges of binary search in Long IPv4 testing to reflect the performance variability Change-Id: I7632bbda361cb278be0776ec31461554297fe852 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2016-05-11Move Honeycomb libraries to honeycomb subdirectory.Tibor Frank8-22/+40
- move all Honeycomb related libraries written in python to new directory resources/libraries/python/honeycomb - update all related includes in all source files Change-Id: Ifa96b8f670b456b14421929d6020ddf8e02d9cbc Signed-off-by: Tibor Frank <tifrank@cisco.com>
2016-05-11Add iACL IPv4/IPv6 tests.Patrik Hrnciar11-2/+523
- IPv4: CSIT-15 - IPv6: CSIT-16 Change-Id: I6e66aa853dfaebf1388f1191dbb63f5216820325 Signed-off-by: Patrik Hrnciar <phrnciar@cisco.com>
2016-05-11Add Max TX Queues configuration to VppConfigGeneratorpmikus1-1/+44
- Add ability to configure max-tx-queus parameter in VPP startup configuration Change-Id: Iaf857ed037c934fbda46eda6bfe1be4ef7faba15 Signed-off-by: pmikus <pmikus@cisco.com>
2016-05-09CSIT-9: COP Whitelist/blacklistZdeno12-3/+633
- Included are also IPv6 tests - JIRA: CSIT-17 Change-Id: I89ae6c38cdc6742a597c0dc24ed1c033c1b5d155 Signed-off-by: Zdeno <zolsovsk@cisco.com>
2016-05-09CSIT-19: MAC split-horizon groupJan Gelety3-4/+126
- test case to test MAC split-horizon group functionality Change-Id: Iadee707f3670e5fc9c209bd8b072a65ea1af27cd Signed-off-by: Jan Gelety <jgelety@cisco.com>
2016-05-09Add Honeycomb bridge domain management testsselias3-1/+285
JIRA: CSIT-41, CSIT-42, CSIT-43 - add test cases for Honecomb bridge domain management - add keywords used by these tests - prefix the names of Honeycomb test suites with numbers, so that they execute in a specific order - moved suite teardown with "Stop Honeycomb service" to bridge domain suite Note: Due to time constraints, the Honeycomb service cannot be restarted between executions of individual Honeycomb test suites. Therefore Honeycomb will be setup in the first test suite and shut down after the last one. Change-Id: I36b7f8335e5ba54985da5bd83730cf856d5ab48b Signed-off-by: selias <samelias@cisco.com>
2016-05-09QEMU VM guest-ping fixMatus Fabian1-1/+4
JIRA: CSIT-62 Change-Id: I0affda16af8f983895c50fbc306f45f30fbb69cd Signed-off-by: Matus Fabian <matfabia@cisco.com>
2016-05-09Interface VxLAN testTibor Frank4-0/+105
JIRA: CSIT-45 - add test: Honeycomb modifies interface configuration - VxLAN - add keywords used in these tests to set and verify configuration - add method and vat template for dumping an interface's configured VxLAN - fixed requirements.txt Change-Id: I6d6c360a4d478a0e40eecf7c0235969e7c06f7a9 Signed-off-by: Tibor Frank <tifrank@cisco.com> Signed-off-by: C.J. Collier <cjcollier@linuxfoundation.org>
2016-05-08LF2 testbed topology fileMiroslav Miklus1-10/+182
Change-Id: I7c465a057640782219a8eb3b4c131d2d8edfcadc Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2016-05-06Add Honeycomb interface management tests (ipv4, ipv6, ethernet, routing)selias6-35/+380
- add test cases for managing ipv4, ipv6, ethernet and routing configuration on VPP interface - add keywords used in these tests to set and verify configuration - add method and vat template for dumping an interface's configured IP addresses - add method for converting between ipv4 netmasks and network prefixes - clean up documentation of older Honeycomb keywords Note: Test cases are tagged with a placeholder tag to allow manual test runs locally. It should be replaced with the appropriate environment tags once Honeycomb service is deployed on virl. Change-Id: I99ce1e72c8550f520f8c35ef4a93eaebb530db78 Signed-off-by: selias <samelias@cisco.com> Signed-off-by: Matej Klotton <mklotton@cisco.com>
2016-05-06Honeycomb API keywords - interface, bridge domainTibor Frank5-673/+1186
- add keywords to manipulate data using Honeycomb REST API to configure interfaces and bridge domains - remove "add_vpp_to_honeycomb_network_topology" method from HoneycombSetup.py - remove "parse_json_response" from HoneycombUtil.py - add methods to manipulate data from Honeycomb REST API Change-Id: I5e6f87097fe9bfccffa3d4aae21f63281353cf29 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2016-05-06Add "show error" output into vpp statsPeter Mikus3-0/+12
- Add "show error" debug output into VPP show stats as verbose subcommand is not parsed correctly in output of vpp_api_test Change-Id: I924c54bb86375e43770fd449b8d6aaa7a3413bcb Signed-off-by: Peter Mikus <pmikus@cisco.com>
2016-05-06Extend testbed reservation wait timeMiroslav Miklus1-2/+2
Change-Id: If35705c1934dfb10f117f03ebbba111854f34360 Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2016-05-05VPP build update for lisp testsJan Gelety1-1/+1
- vpp build 437 Change-Id: I75cd51aaa721ada40e7e206a3d4637d238849ae6 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2016-05-04Update T-rex version to v2.00pmikus6-155/+203
- JIRA: CSIT-14 - Update T-rex version to v2.00 with latest API - Compatibility fixes of affected libraries and robot files - T-rex performance tuning Change-Id: I3a90553032d6d82e6e03df7e0b52e205d3f6ba4e Signed-off-by: pmikus <pmikus@cisco.com>
2016-05-03Patch to reset default VPP configuration in perf.pmikus7-13/+11
- JIRA: CSIT-57 - fix situation when vpp startup configuration is replaced by default with no interface configuration Change-Id: Iea23dcc0707bc96627b99d4500268a8e01bfda39 Signed-off-by: pmikus <pmikus@cisco.com>
2016-05-02Topo installation script fixMiroslav Miklus5-25/+51
-more logging -use single SSH instance -dpkg --force-all -update referece vpp version and reference short test threshold Change-Id: Ie67633755f451dba9d6a3ee1fc431d2c3f3b506f Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2016-05-02Add vpp_create_loopbackMatus Fabian2-0/+17
Change-Id: If934d7ec28f86b070a0cafa0ee56d0bcf4e2ac6d Signed-off-by: Matus Fabian <matfabia@cisco.com>
2016-04-27Installation of stable vpp version for csit-vpp-perf-hw-all jenkins jobMiroslav Miklus2-98/+84
JIRA: CSIT-5 - vpp installation for csit-vpp-verify-* jobs - use single bootstrap for all verify-perf jobs Change-Id: Ifb30a360daecc90446f53d20440e2723b01c6050 Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2016-04-27Update vpp version in bootstrap.shJan Gelety1-6/+8
- vpp version changed to 1.0.0-377 Change-Id: I776fc49a1af15824a4c55071eecfc80fb4824295 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2016-04-26Add qinq through xconnect tests.Patrik Hrnciar6-0/+260
Change-Id: Ia20f5959dab41290bf60490ead830f0e37ecff0d Signed-off-by: Patrik Hrnciar <phrnciar@cisco.com>
2016-04-26Add BD vpp-vm-vpp testsMatus Fabian2-2/+136
JIRA: CSIT-20 Change-Id: Id22102519cdc8afef63c0e727fb47e2a2f1d769b Signed-off-by: Matus Fabian <matfabia@cisco.com>
2016-04-26Extend host topology with NIC type filteringMiroslav Miklus8-9/+113
JIRA: CSIT-1 Changes to allow filtering based on NIC model. Switched xconnect perf test to use filtered topology. Change-Id: Id526f47dc28f92bf26d070e54819ad29bccc0440 Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2016-04-26Honeycomb interface state management testselias6-95/+167
- add simple test for interface management through Honeycomb API - add status code 500 to honeycomb startup check whitelist, due to Honeycomb changes in https://gerrit.fd.io/r/772 - increase timeout value for Honeycomb startup check - modify Honeycomb setup keywords to allow starting Honeycomb on individual nodes - remove sanity test suite, tests now sorted by functional areas such as interfaces, bridge domains, VXlan,... Change-Id: I87f9cf69577706f3b00e24a8d2c01df52fc707c6 Signed-off-by: selias <samuel.elias@pantheon.tech>
2016-04-26Add optional args to traffic script arg parserMatus Fabian1-2/+10
Change-Id: I92e890e0c42da34e1e72a442f7a3bbe12fe9aef1 Signed-off-by: Matus Fabian <matfabia@cisco.com>
2016-04-26Add IPsec utilities python libraryMatus Fabian6-0/+367
JIRA: CSIT-28 Change-Id: I9513f14a9920bfbdaf34c5cc5d4619d16a383ca2 Signed-off-by: Matus Fabian <matfabia@cisco.com>
2016-04-25Update of bootstrap-verify-master.sh file.Jan Gelety1-3/+3
- VIRL image switched to double-ring-nested topology - removed exclusion of 3_NODE_DOUBLE_LINK_TOPO test cases - included test cases with tags: - VM_ENV and 3_NODE_SINGLE_LINK_TOPO - VM_ENV and 3_NODE_DOUBLE_LINK_TOPO Change-Id: I99084b57c1fdd4aefb028cb144822a645baf9321 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2016-04-25Honeycomb API keywordsTibor Frank9-26/+625
- add keywords to get, put post and delete configuration data using Honeycomb REST API - add keywords to get operational data using Honeycomb REST API Change-Id: If75221777e0e83a809c834addf82e95bbd540e21 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2016-04-22Reformat python libraries.Matej Klotton34-684/+723
PEP8 reformat fix typos docstrings reformat Change-Id: Ic48ba4e06490630808b8e2ab1ab0b046ec7eeed7 Signed-off-by: Matej Klotton <mklotton@cisco.com>
2016-04-22Bridge domain tests and user keywords refactor.Jan Gelety4-81/+290
- BD tests changed to behavior-driven-test style - added documentation to BD tests - added documentation and examples to BD user KWs Change-Id: Ifad45df3ef0bb55f5295363a264fe5f4e54f5762 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2016-04-22VatExecutor updateMatus Fabian2-0/+38
Strip non-JSON data from VAT terminal output Add method for VAT command retval verification Change-Id: Ibe68020393cb1a700ad048dc78078f71064707b4 Signed-off-by: Matus Fabian <matfabia@cisco.com>
2016-04-22Performance test casespmikus6-127/+443
- JIRA: CSIT-10 - Add 1518B and 9000B test for multicore tests - Fine tune threshold for short tests based on previous benchmarks - Fix SI units Change-Id: I5c4657dfd881a24b2e40c91ea80a979003754258 Signed-off-by: pmikus <pmikus@cisco.com>
2016-04-21Topology schemaTibor Frank2-2/+15
- fix Honeycomb part of the topology schema - add topology file checking using pykwalify before tests are started Change-Id: I907d41b66f5660a2ab4de8857312e9277052bae6 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2016-04-20Remove horizontal whitespace (a line) before [Command_start_exec] tag.mkonstan1-1/+0
Change-Id: I51e5616cb45b3c67e82153cc4c0f42ec9c5d75d7 Signed-off-by: mackonstan <mkonstan@cisco.com>
2016-04-20Include tags to CSIT performance boostrap scriptpmikus1-8/+44
- include tags to CSIT performance boostrap script - allows future expansion of selective test execution Change-Id: I3870f52d86ff39234eb724500d3871fed0cbdb30 Signed-off-by: pmikus <pmikus@cisco.com>
2016-04-19Make VXLAN test dot1Q as noncritical for now.Stefan Kobza1-0/+1
Change-Id: I0d41aad3fc1f96b58b83c6f0aa5a0e7606868ee4 Signed-off-by: Stefan Kobza <skobza@cisco.com>
2016-04-19Make dut_setup.sh verbose; add sleep after vpp restart.Stefan Kobza1-40/+31
- there's a race condition between VPP service restart and vpp_api_test execution; this patch addresses it with (for now) sleep after service vpp restart - above is just a workaround until VPP provides us with a notification of readiness.. Change-Id: I1f92c1d86e4f90c9432ea57c1747629f619f003e Signed-off-by: Stefan Kobza <skobza@cisco.com>
2016-04-17Multicore VPP setup for performance testingpmikus9-77/+596
- add multithread TAGS documentation - add methods to VppConfigGenerator for RSS configuration - create KW for multithread setup - create sample test case using multithread vpp setup - add Documentation into TCs Change-Id: Id40862490d49380dc76d1d3ce39314603f983fd3 Signed-off-by: pmikus <pmikus@cisco.com>
2016-04-15Update Qemu libraryMatus Fabian3-12/+110
Incorporated changes from nested VM on VIRL. Change-Id: I76ceeb2dde635c2cf0d3a53d29bf24fed72a5437 Signed-off-by: Matus Fabian <matfabia@cisco.com>
2016-04-15Change the performance result messagepmikus1-6/+21
- change the result message of performance search to more verbose level (rate per stream, rate total, throughput in Gbps) Change-Id: I7562d6d33c525654131c75ebcc776cba438f68f4 Signed-off-by: pmikus <pmikus@cisco.com>
2016-04-15Update of bootstrap.sh file.Jan Gelety2-9/+10
- updated vpp build version - VIRL image switched to double-ring-nested topology - removed exclusion of 3_NODE_DOUBLE_LINK_TOPO test cases - included test cases with tags: - VM_ENV and 3_NODE_SINGLE_LINK_TOPO - VM_ENV and 3_NODE_DOUBLE_LINK_TOPO - added missing tags to TC VPP reports interfaces in Bridge Domain test suite Change-Id: Ia6a7a54ef9ad6245835b2762c303935fe39f4079 Signed-off-by: Jan Gelety <jgelety@cisco.com>