aboutsummaryrefslogtreecommitdiffstats
path: root/resources
AgeCommit message (Collapse)AuthorFilesLines
2017-06-14CSIT-597: spot fixes for crudini, interface differencesEd Kern8-109/+135
Change-Id: I7c11a365aa7b0ed673e0ec9a7e6078129d3c63fa Signed-off-by: Ed Kern <ejk@cisco.com>
2017-06-13CSIT-664: Refactor setups and teardownsTibor Frank6-31/+230
- Add suite setup for performance IPSec tests - Add test teardown for performance SNAT tests - Add setups and teardowns for functional tests - Clean up the code Change-Id: Ia456e9f3ff0f0f2bb9a03f692f27c7f9a2817621 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-06-12CSIT-646 Refactor VPPConfigGenerator scriptPeter Mikus3-569/+249
Currently the VPPConfigGenerator script is not modular enough for creating all combinations of VPP startup configuration. This patch is supposed to implement unified structured way to create all configuration options. Change-Id: If3f9cf5dc838fe0a698ea1c601abff6c4c0468b5 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-06-09CSIT-663: Remove unused keywordsTibor Frank9-187/+10
Change-Id: Ib3f0edb0c3a48a760040886e5aedce81c9baeac2 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-06-09 Add the NSH SFC functional test cases.Fangyin Hu11-0/+1081
1. Proxy Inbound test with 152/256/512/1024/1280/1518 Bytes VxLAN-GPE + NSH packet 2. Proxy Outbound test with 128/256/512/1024/1280/1518 Bytes VxLAN packet 3. SFC SFF test with 152/256/512/1024/1280/1518 Bytes VxLAN-GPE + NSH packet Separate the functional test bootstrap file to another code review. Change-Id: I05cf6ab1d01c1b41c1c61044d6d31fd6219b86af Signed-off-by: Fangyin Hu <fangyinx.hu@intel.com>
2017-06-08CSIT-662: KWI - KW renamingTibor Frank40-645/+891
- plus: CSIT-656: Script to rename robot keywords. Change-Id: Ia69917e406a1b346b80e5ea742f6200c1c9e9d21 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-06-07 TLDK udwfwd test case:Qun Wan6-0/+592
- ip fragement for ipv4 - ip reassemble for ipv4 - ip checksum for ipv4 - ip checksum for ipv6 - ip fragment for ipv6 added the genpcap.py script to generate the pcap files and corresponding test scripts Change-Id: I01329dbb0ecd3c3a5dd7a63ef1dea01b2e717da5 Signed-off-by: qun wan <qun.wan@intel.com>
2017-06-06VIRL lspci fixPeter Mikus1-19/+27
Change-Id: I884b56c5cc2e0d5f40c0e9d0b5fb7356dc3b4028 Signed-off-by: pmikus <pmikus@cisco.com>
2017-06-05CSIT-607 Optimize VIRL job scheduling algorithmPeter Mikus2-9/+95
Optimize VIRL job scheduling algorithm based on available VIRL host capacity. Add IP pool availability pre-checks. - add quota based on max. allowe IPs and max. allowe VMs per virl - use one common bootstrap file instead of two separate files (one for ubutnut, another for centos) Change-Id: Ic40122a084624ff9c5eafa9f372b0451e857e29a Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-06-05CSIT-614: PDRCHK test for vpp-csit-verify-hw-perf jobTibor Frank1-0/+7
Create PDRCHK test: a. vpp-verify-perf-l2 i. 10Ge2P1X520-Eth-L2Bdbasemaclrn-pdrchk ii. 10Ge2P1X520-Eth-L2Xcbase-pdrchk b. vpp-verify-perf-ip4 i. 10Ge2P1X520-Ethip4-Ip4Base-pdrchk c. vpp-verify-perf-ip6 i. 10Ge2P1X520-Ethip6-Ip6Base-pdrchk ii. 10Ge2P1X520-Ethip6-Ip6Scale2M-pdrchk d. vpp-verify-perf-lisp i. 10Ge2P1X520-Ethip4Lispip4-Ip4Base-pdrchk ii. 10Ge2P1X520-Ethip4Lispip6-Ip4Base-pdrchk iii. 10Ge2P1X520-Ethip6Lispip4-Ip6Base-pdrchk iv. 10Ge2P1X520-Ethip6Lispip6-Ip6Base-pdrchk e. vpp-verify-perf-vxlan i. 10ge2p1x520-ethip4vxlan-l2xcbase-pdrchk Change-Id: If232b0375140b884f1b65c380faf5bd77c5df5c3 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-06-05CSIT-610 HC Test: add test cases for unnumbered interfaceselias7-22/+133
- add interface and sub-interface tests with unnumbered config - modify interface IPv4 address assignment to handle custom interfaces and sub-interfaces - pylint and style fixes Change-Id: Ic39df1655b4d44f0025a2acef9f7f968929aeff5 Signed-off-by: selias <samelias@cisco.com>
2017-06-05CSIT-524: Traffic generator using python profilesTibor Frank27-1095/+2650
Profile name structure: [trex|ixia]-[sl|sf]-[topo]-[packet structure]-[scale] - Traffic generator - T-rex (trex) or Ixia (ixia) - Stateless (sl) or statefull (sf) - Topology - 2-node topology (2n) or 3-node topology (3n) - Packet structure - eth | ip4/6 | udp - Scale - e.g. ip4dst1, ip6dst10000, 4000u15p Traffic types changed to stream profiles: - From: 2-node-bridge To: trex-sl-2n-ethip4-ip4src253 - From: 3-node-bridge To: trex-sl-3n-ethip4-ip4src254 - From: 3-node-IPv4-dst-1000000 To: trex-sl-3n-ethip4-ip4dst1000000 - From: 3-node-IPv4-dst-100000 To: trex-sl-3n-ethip4-ip4dst100000 - From: 3-node-IPv4-dst-10000 To: trex-sl-3n-ethip4-ip4dst10000 - From: 3-node-IPv4-dst-1000 To: trex-sl-3n-ethip4-ip4dst1000 - From: 3-node-IPv4-dst-100 To: trex-sl-3n-ethip4-ip4dst100 - From: 3-node-IPv4-dst-1 To: trex-sl-3n-ethip4-ip4dst1 - From: 3-node-IPv4 To: trex-sl-3n-ethip4-ip4src253 - From: 3-node-IPv6-dst-1000000 To: trex-sl-3n-ethip6-ip6dst1000000 - From: 3-node-IPv6-dst-100000 To: trex-sl-3n-ethip6-ip6dst100000 - From: 3-node-IPv6-dst-10000 To: trex-sl-3n-ethip6-ip6dst10000 - From: 3-node-IPv6 To: trex-sl-3n-ethip6-ip6src253 - From: 3-node-xconnect To: trex-sl-3n-ethip4-ip4src254 - From: 3-node-IPv4-SNAT-1000u-15p To: trex-sl-3n-ethip4udp-1000u15p - From: 3-node-IPv4-SNAT-100u-15p To: trex-sl-3n-ethip4udp-100u15p - From: 3-node-IPv4-SNAT-10u-15p To: trex-sl-3n-ethip4udp-10u15p - From: 3-node-IPv4-SNAT-1u-15p To: trex-sl-3n-ethip4udp-1u15p - From: 3-node-IPv4-SNAT-1u-1p To: trex-sl-3n-ethip4udp-1u1p - From: 3-node-IPv4-SNAT-2000u-15p To: trex-sl-3n-ethip4udp-2000u15p - From: 3-node-IPv4-SNAT-4000u-15p To: trex-sl-3n-ethip4udp-4000u15p Change-Id: If6a3cf204c93ff9f2cdccc5fd395e26b05483b58 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-06-02CSIT-572: Add script for data collection for reportTibor Frank1-0/+331
- Add script which picks required data from RF output.xml and saves it in JSON format. - Run this script automatically when the output.xml is generated. - Archive the output. Change-Id: I89589369975e14fc8d8e4afa88abfa34260c09cf Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-05-30CSIT-648 Installation of lxc on physical hostsPeter Mikus1-0/+2
Add lxc package to ansible 01-host-setup file to install package and its dependencies on all SUTs Change-Id: I3a7cef1a5acec16f603ffad7ee6ca7c85969e385 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-05-30Do not fail test case when no vpp pid detected in the tear downJan Gelety2-5/+17
- currently when no pid (or more pids) detected in the test case tear down of successfully run test case not only the WARN message is logged but the whole test case is failed - to change this behaviour but keep test case failure if no vpp pid (or more vpp pids) detected in test case setup the low level KW "Get VPP PID" behaviour has been changed to return one or more pids or None w/o raising an error and check has been moved to higher level KW "Save VPP PIDs" - there was added suite name and test case name to WARN message when no pid or more pids detected in the test case tear down Change-Id: I04f8d81c1ca48a1e4a45bd0e58f00d36d51c6933 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-05-28 Add the DPDK l3fwd performance test case.Fangyin Hu3-1/+164
fix some code style issue and rebase the code. change the DPDK l3fwd test case name and rebase the code. fix the pylint errors. change the DPDK version to 17.05 Rebase the code. Fix the l3fwd test code like the l2fwd. Fix the run l3fwd script issues. Rebase the code and review. Fix the l3fwd script issues. verify-perf-dpdk-long Change-Id: I5c5625ebcd5ff16f47fbee361789be3fece1ddbc Signed-off-by: Fangyin Hu <fangyinx.hu@intel.com>
2017-05-25CSIT-597: added additional variables needed for virl host construction.Ed Kern2-20/+19
Also converted ansible_hosts file to utf-8 because the dos format it was in was pissing me off. Change-Id: Ie436f5abc6b397d406efec6e49e0845d915f2310 Signed-off-by: Ed Kern <ejk@cisco.com>
2017-05-25CSIT-612 Report: Minimization of hand-crafted content.Peter Mikus1-5/+27
- replace dynamic text content and links by variables. Change-Id: I1a7ec371fc80af3c9dd416bf91dd2c639097cf1e Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-05-25CSIT-613 Update VIRL ansible filesselias1-8/+4
Update VIRL ansible files Change-Id: Ie64ddb1238888518e9384711669a028097d816af Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-05-25CSIT-597: quotas to default user, use command crudini over ini for : vs = ↵Ed Kern3-101/+108
sep and alternate salt master altered virl.ini for eth0 being on flat port Change-Id: I12dacc32ca3f542f18d4569947123e49d07d74ef Signed-off-by: Ed Kern <ejk@cisco.com>
2017-05-24CSIT-597: revert to old style interface namingEd Kern2-2/+9
Change-Id: I0ae5295fe0bd046e643df2d2abf2b88f76f3179f Signed-off-by: Ed Kern <ejk@cisco.com>
2017-05-23Modify garbage cleaning on VIRLPeter Mikus1-1/+1
Decrease the threshold of old session directories and add cleaning of non-empty directories Change-Id: I77950065e5e09aaaf38cf2d9cb3f4c3f8cdcf58c Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-05-23Upgrade T-rex to version 2.25Peter Mikus5-13/+6
- Upgrade T-rex to v2.25 with multiple bug fixes. Change-Id: Idc422172ce98c37ace7bbbf054a2b024c313bbf7 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-05-22HC Test: Improve logging of Honeycomb and VPP restartselias1-4/+10
Change-Id: I69d73ba3f672af88563715d17c94c73d8d5e7ff2 Signed-off-by: selias <samelias@cisco.com>
2017-05-17CSIT-580: IPSec tests - modifications related to the latest changesTibor Frank1-3/+3
- The startup option 'enable-cryptodev' has been removed and unless not enough cryptodevs are found, DPDK cryptodev will be enabled by default. Change-Id: I19a483435256d8cf4101dc9f10a7c95ed5594e75 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-05-17CSIT-557 HC Test: Fix ODL setup in Honeycomb-odl jobsselias1-2/+2
Change-Id: I917f3bfd9cea043e1bc820536db07697e0d41040 Signed-off-by: selias <samelias@cisco.com>
2017-05-17Fix start-testcase script on VIRLPeter Mikus1-67/+171
- Fix pylint errors - Add expiry option to set expiration of simulation - Add more sanitization of exceptions - Fix printing of debug messages to stderr Change-Id: Iecc1fe042b6da104a164fb5701e665b6f3aa298b Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-05-17CSIT-576 HC Test: Improve SPAN test coverageselias3-17/+179
- add test for multiple destination interfaces using one source interface - duplicate all existing cases using a sub-interface as the destination Change-Id: Ifabf78bca258247a19624b2b2a0474d21d1229d3 Signed-off-by: selias <samelias@cisco.com>
2017-05-17CSIT-577 HC Test: Scripts for test jobs using ODL clientselias3-33/+28
ODL client can be used to translate Restconf requests into Netconf. This way Honeycomb's Netconf interface can be tested using existing test cases. - add bootstrap scripts for verify and integration job - update __init__.robot to handle new {HC_ODL} variable Change-Id: I7e156dab3d5434dff246bfd02090f3c6bea81b86 Signed-off-by: selias <samelias@cisco.com>
2017-05-17CSIT-562 HC Test: Persistence suite rework, part1selias16-135/+234
- rename keywords that check operational data, to distinguish from keywords that check configuration data - modify existing persistence cases so that they don't affect each other - add feature-specific persistence tests for: Interface Management, L2 bridge - move Interface Management variables to separate file so they can be reused - add new tag HC_PERSIST to execute persistence tests separately - update existing Honeycomb tags to comply with CSIT conventions More feature-specific tests to be added in part2. Change-Id: I8657da4bb9e9a3d5261c04f5f1999b2572f605ef Signed-off-by: selias <samelias@cisco.com>
2017-05-17CSIT-563: HC Test: improved Lisp test coveragejan.hradil8-10/+625
added TC09-TC14 with following features: Map Resolver Map Server PETR configuration RLOC Probing Map Register Map Request mode Change-Id: I0e8a573e9a0f7ef3c688a014ff879e2b3d6b9b1e Signed-off-by: jan.hradil <jan.hradil@pantheon.tech> Signed-off-by: selias <samelias@cisco.com>
2017-05-17Fix: use pci/rescan to avoid occasional bind issue on Centos7Jan Gelety1-1/+7
- rarelly binding of one of TG interfaces fails with "No such device" error; usage of rescan should avoid such situations Change-Id: Icbeb48ea6f8adb863e6517d4a35d6aca4238309a Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-05-16Add Garbage Cleanning to VIRLPeter Mikus1-0/+20
- add cleaning of old VPP builds (deb|rpm) - add cleaning of old session dirs - add cleaning of old QEMU logs Change-Id: Ib2849cc3969de75525f13d80dc87b32fb82865af Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-05-12Fix: SetupFramework sparse file handlingPeter Mikus1-1/+2
- Fix the issue during packing of the framework when source directory contains sparse files. By default tar is throwing warning resulting in return code other then 0. Change-Id: I39a9c1956685158e2e0fd9ef9545f90e3ef2a89f Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-05-05HC Test: update routing test keyword due to namespace changesselias1-1/+1
- changed in https://gerrit.fd.io/r/6303 Change-Id: If5fdfcf21c757f9199f168bfd044c7fefce87bef Signed-off-by: selias <samelias@cisco.com>
2017-05-05Use 'Qemu Kill All' in perf test teardownJan Gelety2-4/+4
- replace 'Qemu Kill' KW by 'Qemu Kill All' - use self.qemu_kill_all() in case of qemu_start(self) failure Change-Id: I19d4c64d5daef4f00548344d45f0d4943ca4f7e8 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-05-03HC Test: Update honeycomb suite setupselias3-12/+36
- remove workaround for jVPP version mismatch - increase Java API command timeout Change-Id: Ic6a61ff029cc7cdfec1f75890e18599e3b05f019 Signed-off-by: selias <samelias@cisco.com>
2017-05-03Fix Honeycomb source data path for report.Peter Mikus1-1/+1
Change-Id: Ifcae7625dd2325461f70382439a52d9091d7121c Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-05-03Update links with source data for rls reportPeter Mikus1-65/+65
Change-Id: Ic105fb63f5314da2a30aa1c562e4b98a1bb67788 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-05-03Update data points for rls1704 reportPeter Mikus1-3/+3
Change-Id: Iae8b0833d88d0331f0b8296c79f5267e3a32f53c Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-05-02csit-validate-pylint-master/3731 for build 3731jan.hradil8-36/+29
pylint repairs deleted duplicated method from HcPersistence.py Change-Id: I426e6c15957c995ea10bd11ae2deac75b1cab922 Signed-off-by: jan.hradil <jan.hradil@pantheon.tech>
2017-04-28Update ansible playbooks VIRL setupMatej Klotton2-1/+21
Change-Id: I704991c65dc5fc9ce40ade932cab104fa468696c Signed-off-by: Matej Klotton <mklotton@cisco.com>
2017-04-28csit rls1704: updates to /testpmd_performance_tests/packet_*_graphs files.Maciek Konstantynowicz1-1/+1
Change-Id: I7c9fefd93e768368ac1093ffd4589dcf63a6375c Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2017-04-27Report-gen updatePeter Mikus1-11/+11
- fix header in IPsec sections - fix IP4 regexp to include SNAT - update source data for perf trending - fix rendering of Trex section Change-Id: I20660eb997a33cdca89490f2ef1cd1dcd339ff15 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-04-26Fix: Report table layout in RTD SphinxPeter Mikus1-1/+1
Change-Id: Ibdac46c7ec6d8381da89ea9bb7e407b91c5029df Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-04-26CSIT rls1704 report - small updatesJan Gelety1-1/+1
Change-Id: I80b5aaf2bab77a6131fca8cf4e903ef6aecd1195 Signed-off-by: Jan Gelety <jgelety@cisco.com> Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2017-04-26CSIT doc gen: Use html <pre> tag for data from teardown.Jan Gelety1-6/+16
Change-Id: Ie8d856d0a7b90eeecffcb38cd8e8b0647a534d8d Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-04-26Update run_report.sh script for generating reportPeter Mikus1-89/+103
Change-Id: I8ba216fd90285ffef34d255b7a672a4d944caff3 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-04-26Update: report source data linksPeter Mikus1-3/+3
Change-Id: I74b9b1070380dcc5f721d695989f3bd676b6df91 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-04-25rls1704 report - updated sections:Maciek Konstantynowicz1-1/+1
- vpp_performance_tests/overview.rst - vpp_performance_tests/csit_release_notes - vpp_performance_tests/test_environment - honeycomb_functional_tests/csit_release_notes Change-Id: I047c4934f0de18b3adb5e8ae4b6eb1a270b75cc7 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>