aboutsummaryrefslogtreecommitdiffstats
path: root/resources/tools
AgeCommit message (Collapse)AuthorFilesLines
2016-07-25CSIT-221 Robot parser updatepmikus1-7/+56
- update performance plot data robot parser to better support test cases hierarchy changes Change-Id: I148e9a13bc696a4b7857a91d4a52379860f03771 Signed-off-by: pmikus <pmikus@cisco.com>
2016-07-19CSIT-102: Add latency measurement to performance testingPeter Mikus1-43/+107
- Add latency stream as a background stream in both directions - Latency background stream is not using the VM transformation engine. Raw stream with single packet is created. - Latency background stream has 1kpps rate with packet of same size as traffic stream. - Display latency values (min/avg/max) in results of TC and reporting remaining data including histogram and jitter inside of the search/pass keyword. Change-Id: I78ce4659b57caab08d5729f51a1e14d518fd3273 Signed-off-by: Peter Mikus <pmikus@cisco.com> Signed-off-by: pmikus <pmikus@cisco.com>
2016-07-08CSIT-174: Include cgroup support packages on hardware SUT and TG hostsCarsten Koester1-0/+2
Change-Id: I50628ce6ae0afb012491f4d6f66e7e13331bf3e1 Signed-off-by: Carsten Koester <ckoester@cisco.com>
2016-07-01CSIT-186: Add multilink to Vagrant fileMatej Klotton1-22/+31
Change-Id: I8ecc2be5771f46b46d4ac31880861db2482c2b1c Signed-off-by: Matej Klotton <mklotton@cisco.com>
2016-06-22CSIT-170 Parse output of robot framework into HTML tablepmikus1-0/+204
Change-Id: I17c0a8cb82a0501ef9838dc1e17559d31ca66ecd Signed-off-by: pmikus <pmikus@cisco.com>
2016-06-21Update2 of GROUP for master.ubuntu.trusty.main REPOJan Gelety1-1/+1
- updated GROUP back to io.fd.vpp string Change-Id: I3a04c04745edd06e3276a13b24274d037e38d56a Signed-off-by: Jan Gelety <jgelety@cisco.com>
2016-06-20Update of GROUP for master.ubuntu.trusty.main REPOJan Gelety1-1/+1
- updated GROUP string in download_install_vpp_pkgs.sh Change-Id: Iaa0540998ffaf16d9dffd8eef432d17e58a4b897 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2016-06-19CSIT-154: Fetch superseded Ubuntu packages using Launchpad APICarsten Koester1-2/+10
Change-Id: I0db121d7f2b227e62240941b026b58fcd233a129 Signed-off-by: Carsten Koester <ckoester@cisco.com>
2016-06-19CSIT-155: Create empty Nested VM build directory if neededCarsten Koester2-1/+3
Change-Id: I760fee3ce1c86ae443930b7763727328fecd8250 Signed-off-by: Carsten Koester <ckoester@cisco.com>
2016-06-12CSIT-152: Detect if the T-rex is responding to API after startpmikus1-0/+76
Change-Id: I99c8dcbd210175fa5d1af193371249e525dc0102 Signed-off-by: pmikus <pmikus@cisco.com>
2016-06-11Process output of robot to XML file for Plot pluginpmikus1-93/+53
- JIRA: CSIT-135 - Process output of robot output.xml to XML file for Plot plugin Change-Id: I5e077d81f4c93f66eb208ecc2a38a9f6ca2fe307 Signed-off-by: pmikus <pmikus@cisco.com>
2016-06-09CSIT-138: Cleanup of vpp packages.Miroslav Miklus1-2/+18
Change-Id: I489762a156f5860f40809c9e62b0603353adf934 Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2016-06-09Fix Vagrant config for multi-user environmentAurélien Degeorges1-4/+9
Add support for an environment variable "VPP_VAGRANT_NET_PREFIX" to add a prefix before the name of vbox internal networks. Otherwise two users trying to do "vargrant up" on the same server will face conflicts with the name of vbox internal networks. Change-Id: I5ba7c06fe111944fcac3da25276d018d281aef4f Signed-off-by: Aurélien Degeorges <aurelien.degeorges@6wind.com>
2016-06-08Update T-rex to v2.03 part IIpmikus3-3/+3
- JIRA: CSIT-132 - Update Trex via autoinstall script Change-Id: I65753b35287d9322ef230642ea0dd3596f1da5c9 Signed-off-by: pmikus <pmikus@cisco.com>
2016-06-03PATCH: Revert to T-rex version to v2.00pmikus3-3/+3
- Revert T-rex version to v2.00 without installation from robot Change-Id: I8d0c5fb57f01febc970d9fc9363965acd2e57ed4 Signed-off-by: pmikus <pmikus@cisco.com>
2016-06-03Update T-rex version to v2.03 with installation from robotpmikus3-4/+4
- JIRA: CSIT-132 - Update T-rex version to v2.03 with installation from robot Change-Id: I7e222a61f88b1313273e6866dfc78d62b4d8ac93 Signed-off-by: pmikus <pmikus@cisco.com>
2016-06-02Add documentation and files related to initial host setupCarsten Koester33-0/+1369
Change-Id: I73deeb79e57ac7eca208faa49d04be37c7034163 Signed-off-by: Carsten Koester <ckoester@cisco.com>
2016-06-02Update T-rex version to v2.02Peter Mikus3-3/+3
- JIRA: CSIT-99 - Update T-rex version to v2.02 with stability fixed and to be able to measure latency Change-Id: Ic014c81c5889dbb738f1f3f279138a73dffb01f3 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2016-06-02CSIT-117: CSIT Vagrant+Virtualbox dev environment inoperative on UbuntuDave Wallace2-27/+19
Change-Id: I10d7a1cb194e8116324524e2ce6dff909620d077 Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
2016-06-02CSIT-117: CSIT Vagrant+Virtualbox dev environment inoperative on UbuntuDave Wallace2-11/+24
Change-Id: I05ea675a2eb6d0b240008efa0d27166616c6e741 Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
2016-06-02CSIT-111: Add Packer based framework to auto-generate disk imagesCarsten Koester42-722/+5350
Change-Id: Ia18ea34a6288aec0f12f176f4cc264d0f215d1fd Signed-off-by: Carsten Koester <ckoester@cisco.com>
2016-05-31CIMANAGE-7: Bootstrap for csit-vpp-master-verify-semiweekly jobJan Gelety1-1/+1
- run func and perf_long tests in three test loops - updated REPO in /resources/tools/download_install_vpp_pkgs.sh Change-Id: Iff459b7719380404a242c80821806a9450271adf Signed-off-by: Jan Gelety <jgelety@cisco.com>
2016-05-19Parse robot output.xml for performance reportingpmikus1-0/+161
- JIRA: CSIT-58 - parse robot framework output.xml file - find performance related data - write formatted json to specified file - copy archive artifact to directory Change-Id: I47e45bcb68c06044a23192cb1fca46f43782941e Signed-off-by: pmikus <pmikus@cisco.com> Signed-off-by: Peter Mikus <pmikus@cisco.com>
2016-05-18T-REX stl traffic send improvement for async callsMiroslav Miklus2-86/+185
JIRA: CSIT-68 - show runtime statistics with running traffic - T-REX driver async. driver Change-Id: Ie5eb7021f610fb58383b033dda5b1b867f7d3d2c Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2016-05-11Performance IPv6 library and short/long test casespmikus1-9/+114
- JIRA: CSIT-2 - Create IPv6 test cases for long/short/singlethread/multithread performance testing - Create robot KWs for IPv6 performance testing - Add T-Rex IPv6 profile Change-Id: I306d5c894d9b9287bf91929764aeb1c7083d802c Signed-off-by: pmikus <pmikus@cisco.com> Signed-off-by: Peter Mikus <pmikus@cisco.com>
2016-05-04Update T-rex version to v2.00pmikus2-86/+130
- JIRA: CSIT-14 - Update T-rex version to v2.00 with latest API - Compatibility fixes of affected libraries and robot files - T-rex performance tuning Change-Id: I3a90553032d6d82e6e03df7e0b52e205d3f6ba4e Signed-off-by: pmikus <pmikus@cisco.com>
2016-05-02Topo installation script fixMiroslav Miklus2-14/+40
-more logging -use single SSH instance -dpkg --force-all -update referece vpp version and reference short test threshold Change-Id: Ie67633755f451dba9d6a3ee1fc431d2c3f3b506f Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2016-04-22Reformat python libraries.Matej Klotton1-19/+22
PEP8 reformat fix typos docstrings reformat Change-Id: Ic48ba4e06490630808b8e2ab1ab0b046ec7eeed7 Signed-off-by: Matej Klotton <mklotton@cisco.com>
2016-04-12Bootstrap verify performance fixpmikus1-1/+1
- Bootstrap verify performance fix Change-Id: I8f77c26aef805f5223d03e2a0bc4a97f88195ed8 Signed-off-by: pmikus <pmikus@cisco.com>
2016-04-12Bootstrap verify performance fixpmikus1-10/+24
- fix installation directory create and remove Change-Id: I0acd47b886e869958a2075889af3bbe166d7808e Signed-off-by: pmikus <pmikus@cisco.com>
2016-04-12Update of topo_installation filepmikus1-1/+1
- deb package path fix Change-Id: I94065581886c4d5b9f15ced18857ddfcde442153 Signed-off-by: pmikus <pmikus@cisco.com>
2016-04-11Fix cosmetic issues in VIRL topologiesCarsten Koester3-22/+17
Fix cosmetic issues in VIRL topologies: - Replace double whitespace by single whitespace in XML - Remove reserved but unused IP address allocations from VIRL config - Modify "start-testcase" script to handle links without IP address Change-Id: Ie447bd91172df61b30ebb8650b56bdfca0f25fd4 Signed-off-by: Carsten Koester <ckoester@cisco.com>
2016-04-11Add VIRL double-ring (load-balancing) topology with nested VM supportCarsten Koester2-0/+393
Change-Id: Idcf173b1711076a5d7e4af8fe46e302b9eae4ff6 Signed-off-by: Carsten Koester <ckoester@cisco.com>
2016-04-08Add Vagrantfile for local testing.Stefan Kobza3-0/+299
Vagrantfile contains 3 VMs as of now, 2 DUTs 1 TG, with these notes: - login is csit/csit - by default provision script installs all deb packages from the dir where Vagrantfile is - developed for, and only tested on vbox (someone can pick up vmware) - All nodes have 1 shared mgmt network: 192.168.255.0/24 - hosts have these IP addresses in host-only network TG : 192.168.255.100 DUT1 : 192.168.255.101 DUT2 : 192.168.255.102 - script created to download MAC address information - PCI addresses are always the same for vbox (not sure about vmware) HOWTO (will create a wiki page once one is created for CSIT project): - copy Vagrantfile to separate dir on host - vagrant up --parallel sit-back-and-relax - from VM that has access to the same host-only network (192.168.255.0 above) - copy your ssh-key to csit@192.168.255.{101,102,250} using ssh-copy-id - cd ${csit_dir} - virtualenv & pip as in README - export PYTHONPATH=${csit_dir} - resources/tools/topology/update_topology.py -v -f -o topologies/available/vagrant_pci.yaml \ topologies/available/vagrant.yaml - pybot -L TRACE \ -v TOPOLOGY_PATH:topologies/available/vagrant_pci.yaml -s \ "ipv4" tests - see tests results Change-Id: Ic27626605a9c820bca977b38f4e8ca37d1504ff5 Signed-off-by: Stefan Kobza <skobza@cisco.com>
2016-04-05Add tag support to boostrap-verify-perfpmikus1-3/+6
- support tags in vpp-verify-perfomance-* jenkins jobs Change-Id: I7e3abfe9e552a3f2fa9ebf95df9b48bcbae3561a Signed-off-by: pmikus <pmikus@cisco.com>
2016-04-05Add VIRL topology files and template for nested virtualisationCarsten Koester2-0/+359
Change-Id: I57dbe4f179b3cfd3f51c9dec503ca45a5c0521fd Signed-off-by: Carsten Koester <ckoester@cisco.com>
2016-04-01Bootstrap to test perf of proposed patch vpp-csit-hw-perfpmikus1-0/+57
- Based on #570 Lab reservation tool - Get the latest build of VPP - Make reservation on testbed by using existing topology files - Copy and install VPP image on all DUTs - Run performance tests Change-Id: I8034fd9c284cbe9a68e0c9116d0826965464b5f9 Signed-off-by: pmikus <pmikus@cisco.com>
2016-03-29Bootstrap to test csit-master against VPP release.Jan Gelety1-4/+11
- get the version of the latest VPP build - download and install the latest VPP build on nodes - run three times all test suites to check if the VPP build can be used for csit development and current csit master can be pushed to master-verified branch (see patch https://gerrit.fd.io/r/590) Change-Id: I0ad2e9fe1620cc18ccc11dce2d107177cf97ff27 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2016-03-21Lab reservation toolMiroslav Miklus1-0/+65
This tool provide client-based reservation system of tesbeds by using existing topology files. Change-Id: Ic0be944c77c9d6aa28e3fa7fa69e31d19861416f Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2016-03-17DropRateSearch libraryMiroslav Miklus1-1/+1
- linear search - t-rex DropRateSearch implementation - long perf bridge_domain test - introduced PERFORMANCE_SHORT, PERFORMANCE_LONG test tags Change-Id: I497b72f3e6d58a67ca5a386403d1e84dcf433ec4 Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2016-03-14tools: vpp download and installation scriptMiroslav Miklus1-0/+40
Download and install 'RELEASE' version of vpp packages Dependecies: curl, dpkg, md5sum Change-Id: I894c8181125b84df3057afc092ed01c0a837321a Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2016-03-08Add VIRL server-side framework and topology templates.Carsten Koester6-0/+791
Change-Id: I02e7f85e3259dc0a5b2c7d0098747921a75fa5ea Signed-off-by: Carsten Koester <ckoester@cisco.com>
2016-03-07Performance suite reorg, v4 testsMiroslav Miklus1-3/+3
- perf suite splitted to 1.xconnect 2.bridge-domain 3.IPv4 - IPv4 perf tests implemented - renamed perf tests prefix 2core -> 1core Change-Id: I9ef2dbdfcfdcb36e8865989e6255d69ced33269c Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2016-02-26T-REX: startup config generationMiroslav Miklus3-294/+0
- T-rex startup config generated based on computed path - move t-rex tooling to t-rex directory Change-Id: I3ac698f41f98934bcce4af35dc3a755a8948e887 Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2016-02-22performance tests: 2core, test teardown, remove UDP headerMiroslav Miklus1-2/+2
- testing on 2 core VPP - show statistics only if test fails - remove UDP header from packet Change-Id: I5b47330a0bbc4602e8e8eb19fcc481a7635bd2a5 Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2016-02-17T-REX fixesMiroslav Miklus1-1/+1
- ssh session hang with bash as /bin/sh - trex-cfg to handle initial configuration Change-Id: Ibcbde2d17f0e10ce126dc5db6bf9654185b0bb75 Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2016-02-17LF testbed2 topology, T-REX upgrade, vpe->vpp renameMiroslav Miklus3-77/+371
Testing testbed2 infrastructure T-REX upgrade 1.88 -> 1.91 Rename "vpe" to "vpp" Change-Id: Ia03c363e2b3c77a4e469509460b25028e5e1814f Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2016-02-12Last bulk update of CSIT.Stefan Kobza2-0/+299
Change-Id: I815e4d54e74a49fd19a9927554ce5c37a2719f7e Signed-off-by: Stefan Kobza <skobza@cisco.com>