aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2017-06-05CSIT-524: Traffic generator using python profilesTibor Frank113-7676/+8650
Profile name structure: [trex|ixia]-[sl|sf]-[topo]-[packet structure]-[scale] - Traffic generator - T-rex (trex) or Ixia (ixia) - Stateless (sl) or statefull (sf) - Topology - 2-node topology (2n) or 3-node topology (3n) - Packet structure - eth | ip4/6 | udp - Scale - e.g. ip4dst1, ip6dst10000, 4000u15p Traffic types changed to stream profiles: - From: 2-node-bridge To: trex-sl-2n-ethip4-ip4src253 - From: 3-node-bridge To: trex-sl-3n-ethip4-ip4src254 - From: 3-node-IPv4-dst-1000000 To: trex-sl-3n-ethip4-ip4dst1000000 - From: 3-node-IPv4-dst-100000 To: trex-sl-3n-ethip4-ip4dst100000 - From: 3-node-IPv4-dst-10000 To: trex-sl-3n-ethip4-ip4dst10000 - From: 3-node-IPv4-dst-1000 To: trex-sl-3n-ethip4-ip4dst1000 - From: 3-node-IPv4-dst-100 To: trex-sl-3n-ethip4-ip4dst100 - From: 3-node-IPv4-dst-1 To: trex-sl-3n-ethip4-ip4dst1 - From: 3-node-IPv4 To: trex-sl-3n-ethip4-ip4src253 - From: 3-node-IPv6-dst-1000000 To: trex-sl-3n-ethip6-ip6dst1000000 - From: 3-node-IPv6-dst-100000 To: trex-sl-3n-ethip6-ip6dst100000 - From: 3-node-IPv6-dst-10000 To: trex-sl-3n-ethip6-ip6dst10000 - From: 3-node-IPv6 To: trex-sl-3n-ethip6-ip6src253 - From: 3-node-xconnect To: trex-sl-3n-ethip4-ip4src254 - From: 3-node-IPv4-SNAT-1000u-15p To: trex-sl-3n-ethip4udp-1000u15p - From: 3-node-IPv4-SNAT-100u-15p To: trex-sl-3n-ethip4udp-100u15p - From: 3-node-IPv4-SNAT-10u-15p To: trex-sl-3n-ethip4udp-10u15p - From: 3-node-IPv4-SNAT-1u-15p To: trex-sl-3n-ethip4udp-1u15p - From: 3-node-IPv4-SNAT-1u-1p To: trex-sl-3n-ethip4udp-1u1p - From: 3-node-IPv4-SNAT-2000u-15p To: trex-sl-3n-ethip4udp-2000u15p - From: 3-node-IPv4-SNAT-4000u-15p To: trex-sl-3n-ethip4udp-4000u15p Change-Id: If6a3cf204c93ff9f2cdccc5fd395e26b05483b58 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-06-02CSIT-572: Add script for data collection for reportTibor Frank2-1/+340
- Add script which picks required data from RF output.xml and saves it in JSON format. - Run this script automatically when the output.xml is generated. - Archive the output. Change-Id: I89589369975e14fc8d8e4afa88abfa34260c09cf Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-06-01 Bootstrap file for the nsh_sfc functional test cases toqun wan1-0/+235
support the jenkins job scheduling. Change-Id: I8969c563ae712a82c9ff875ea4c55c6504acd44e Signed-off-by: qun wan <qun.wan@intel.com>
2017-05-30CSIT-648 Installation of lxc on physical hostsPeter Mikus1-0/+2
Add lxc package to ansible 01-host-setup file to install package and its dependencies on all SUTs Change-Id: I3a7cef1a5acec16f603ffad7ee6ca7c85969e385 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-05-30Do not fail test case when no vpp pid detected in the tear downJan Gelety2-5/+17
- currently when no pid (or more pids) detected in the test case tear down of successfully run test case not only the WARN message is logged but the whole test case is failed - to change this behaviour but keep test case failure if no vpp pid (or more vpp pids) detected in test case setup the low level KW "Get VPP PID" behaviour has been changed to return one or more pids or None w/o raising an error and check has been moved to higher level KW "Save VPP PIDs" - there was added suite name and test case name to WARN message when no pid or more pids detected in the test case tear down Change-Id: I04f8d81c1ca48a1e4a45bd0e58f00d36d51c6933 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-05-29Update of VPP_STABLE_VER filesJan Gelety2-2/+2
- use new vpp ref build - ubuntu 16.04: 17.07-rc0~305-g6af1c04~b2410_amd64 - use new vpp ref build - centos7: 17.07-rc0~305_g6af1c04~b2408.x86_64 - builds tested by semiweekly jobs: https://jenkins.fd.io/view/csit/job/csit-vpp-verify-master-ubuntu1604-semiweekly/41/ https://jenkins.fd.io/view/csit/job/csit-vpp-verify-master-centos7-semiweekly/41/ Change-Id: I187a49d922a5aa916d52d820350e9631f174221d Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-05-28 Add the DPDK l3fwd performance test case.Fangyin Hu7-1/+714
fix some code style issue and rebase the code. change the DPDK l3fwd test case name and rebase the code. fix the pylint errors. change the DPDK version to 17.05 Rebase the code. Fix the l3fwd test code like the l2fwd. Fix the run l3fwd script issues. Rebase the code and review. Fix the l3fwd script issues. verify-perf-dpdk-long Change-Id: I5c5625ebcd5ff16f47fbee361789be3fece1ddbc Signed-off-by: Fangyin Hu <fangyinx.hu@intel.com>
2017-05-25CSIT-597: added additional variables needed for virl host construction.Ed Kern2-20/+19
Also converted ansible_hosts file to utf-8 because the dos format it was in was pissing me off. Change-Id: Ie436f5abc6b397d406efec6e49e0845d915f2310 Signed-off-by: Ed Kern <ejk@cisco.com>
2017-05-25CSIT-612 Report: Minimization of hand-crafted content.Peter Mikus23-123/+142
- replace dynamic text content and links by variables. Change-Id: I1a7ec371fc80af3c9dd416bf91dd2c639097cf1e Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-05-25CSIT-613 Update VIRL ansible filesselias1-8/+4
Update VIRL ansible files Change-Id: Ie64ddb1238888518e9384711669a028097d816af Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-05-25CSIT-597: quotas to default user, use command crudini over ini for : vs = ↵Ed Kern3-101/+108
sep and alternate salt master altered virl.ini for eth0 being on flat port Change-Id: I12dacc32ca3f542f18d4569947123e49d07d74ef Signed-off-by: Ed Kern <ejk@cisco.com>
2017-05-24CSIT-597: revert to old style interface namingEd Kern2-2/+9
Change-Id: I0ae5295fe0bd046e643df2d2abf2b88f76f3179f Signed-off-by: Ed Kern <ejk@cisco.com>
2017-05-23HC Test: update proxyARP test caseselias1-6/+8
- update to better reflect test in CSIT-functional Change-Id: I7412bfea34c867cd14ee95b857f30d6923998ff2 Signed-off-by: selias <samelias@cisco.com>
2017-05-23Modify garbage cleaning on VIRLPeter Mikus1-1/+1
Decrease the threshold of old session directories and add cleaning of non-empty directories Change-Id: I77950065e5e09aaaf38cf2d9cb3f4c3f8cdcf58c Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-05-23Upgrade T-rex to version 2.25Peter Mikus5-13/+6
- Upgrade T-rex to v2.25 with multiple bug fixes. Change-Id: Idc422172ce98c37ace7bbbf054a2b024c313bbf7 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-05-22Update of VPP_STABLE_VER files and DPDK_STABLE_VER fileJan Gelety3-3/+3
- use new vpp ref build - ubuntu 16.04: 17.07-rc0~144-g36c1308~b2247_amd64 - use new vpp ref build - centos7: 17.07-rc0~268-gc7409dc~b2371_amd64 - use new DPDK version: 17.05-vpp3 - builds tested by semiweekly jobs: https://jenkins.fd.io/view/csit/job/csit-vpp-verify-master-ubuntu1604-semiweekly/39/ https://jenkins.fd.io/view/csit/job/csit-vpp-verify-master-centos7-semiweekly/39/ Change-Id: I7ed3e1011ae6b1e9fa9a6a3fd98fc5ebcb8bfdf9 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-05-22HC Test: Improve logging of Honeycomb and VPP restartselias1-4/+10
Change-Id: I69d73ba3f672af88563715d17c94c73d8d5e7ff2 Signed-off-by: selias <samelias@cisco.com>
2017-05-19Update: Topology file for TB1Peter Mikus1-10/+11
- Update topology file for TB1 after card replacement Change-Id: Id346b747bb600b6796a447a23b1a4e37961a8c7e Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-05-18 TLDK Bootstrap.sh file to support the jenkins job scheduling.qun wan1-25/+4
Change-Id: Ia89e5a32fdc963a1c20345da1310b7958cd34c48 Signed-off-by: qun wan <qun.wan@intel.com>
2017-05-17CSIT-580: IPSec tests - modifications related to the latest changesTibor Frank1-3/+3
- The startup option 'enable-cryptodev' has been removed and unless not enough cryptodevs are found, DPDK cryptodev will be enabled by default. Change-Id: I19a483435256d8cf4101dc9f10a7c95ed5594e75 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-05-17CSIT-557 HC Test: Fix ODL setup in Honeycomb-odl jobsselias1-2/+2
Change-Id: I917f3bfd9cea043e1bc820536db07697e0d41040 Signed-off-by: selias <samelias@cisco.com>
2017-05-17Fix start-testcase script on VIRLPeter Mikus5-71/+183
- Fix pylint errors - Add expiry option to set expiration of simulation - Add more sanitization of exceptions - Fix printing of debug messages to stderr Change-Id: Iecc1fe042b6da104a164fb5701e665b6f3aa298b Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-05-17Func test reorg - decrease exec time per vpp patchJan Gelety43-63/+74
- remove tests covered by make test - remove some negative tests Change-Id: I35d641562ee85888f7d1dd60dd892689b1e9c52d Signed-off-by: Jan Gelety <jgelety@cisco.com> Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2017-05-17CSIT-576 HC Test: Improve SPAN test coverageselias5-51/+351
- add test for multiple destination interfaces using one source interface - duplicate all existing cases using a sub-interface as the destination Change-Id: Ifabf78bca258247a19624b2b2a0474d21d1229d3 Signed-off-by: selias <samelias@cisco.com>
2017-05-17CSIT-577 HC Test: Scripts for test jobs using ODL clientselias6-38/+511
ODL client can be used to translate Restconf requests into Netconf. This way Honeycomb's Netconf interface can be tested using existing test cases. - add bootstrap scripts for verify and integration job - update __init__.robot to handle new {HC_ODL} variable Change-Id: I7e156dab3d5434dff246bfd02090f3c6bea81b86 Signed-off-by: selias <samelias@cisco.com>
2017-05-17CSIT-562 HC Test: Persistence suite rework, part1selias43-423/+599
- rename keywords that check operational data, to distinguish from keywords that check configuration data - modify existing persistence cases so that they don't affect each other - add feature-specific persistence tests for: Interface Management, L2 bridge - move Interface Management variables to separate file so they can be reused - add new tag HC_PERSIST to execute persistence tests separately - update existing Honeycomb tags to comply with CSIT conventions More feature-specific tests to be added in part2. Change-Id: I8657da4bb9e9a3d5261c04f5f1999b2572f605ef Signed-off-by: selias <samelias@cisco.com>
2017-05-17CSIT-563: HC Test: improved Lisp test coveragejan.hradil9-24/+685
added TC09-TC14 with following features: Map Resolver Map Server PETR configuration RLOC Probing Map Register Map Request mode Change-Id: I0e8a573e9a0f7ef3c688a014ff879e2b3d6b9b1e Signed-off-by: jan.hradil <jan.hradil@pantheon.tech> Signed-off-by: selias <samelias@cisco.com>
2017-05-17Fix: use pci/rescan to avoid occasional bind issue on Centos7Jan Gelety1-1/+7
- rarelly binding of one of TG interfaces fails with "No such device" error; usage of rescan should avoid such situations Change-Id: Icbeb48ea6f8adb863e6517d4a35d6aca4238309a Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-05-16Add RA suppress to IPv6 Equal-cost multipath routing test caseJan Gelety1-0/+1
Change-Id: I9aa7220db01016d553cd389ad4827a3f86da9310 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-05-16Fix typo in weekly bootstrap fileJan Gelety1-1/+1
Change-Id: I2dc221c433ba87d0f98082c0c3aef2df838cd750 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-05-16Add Garbage Cleanning to VIRLPeter Mikus1-0/+20
- add cleaning of old VPP builds (deb|rpm) - add cleaning of old session dirs - add cleaning of old QEMU logs Change-Id: Ib2849cc3969de75525f13d80dc87b32fb82865af Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-05-15Bump to DPDK 1705 vpp2Neale Ranns1-1/+1
Change-Id: I6cc48962433e105c10384faa192d91a2c390011c Signed-off-by: Neale Ranns <nranns@cisco.com>
2017-05-14DPDK version bumpNeale Ranns5-6/+6
Change-Id: Ia89d64a2c985ff949969c406f0e6cea03cc8c170 Signed-off-by: Neale Ranns <nranns@cisco.com>
2017-05-12Fix: SetupFramework sparse file handlingPeter Mikus1-1/+2
- Fix the issue during packing of the framework when source directory contains sparse files. By default tar is throwing warning resulting in return code other then 0. Change-Id: I39a9c1956685158e2e0fd9ef9545f90e3ef2a89f Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-05-11CSIT-574: IPSec Scale File Splitsjan.hradil9-1164/+1452
split file into two separate files based on number of tunnels values 1 or 1000 corrected name errors - scale -> base Change-Id: I7114c777f3cc3d7f4951a1f59e54f3a7bbe404ec Signed-off-by: jan.hradil <jan.hradil@pantheon.tech>
2017-05-10CSIT-573: Split SNAT scale tests to multiple filesjan.hradil8-919/+1269
split file with many test cases into mutliple files based on users and ports added SRC_USER tags removed empty lines at EOF Change-Id: I19c79cdf8d7de4147c98bc061559af1fde10ab8c Signed-off-by: jan.hradil <jan.hradil@pantheon.tech>
2017-05-09csit report - fixed table format in vpp_performance_tests/csit_release_notes.rstMaciek Konstantynowicz1-1/+1
Change-Id: Ie9d4a9ba373c0e6131f0a2d3e49f20a315da3b9a Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2017-05-05HC Test: update routing test keyword due to namespace changesselias1-1/+1
- changed in https://gerrit.fd.io/r/6303 Change-Id: If5fdfcf21c757f9199f168bfd044c7fefce87bef Signed-off-by: selias <samelias@cisco.com>
2017-05-05Use 'Qemu Kill All' in perf test teardownJan Gelety2-4/+4
- replace 'Qemu Kill' KW by 'Qemu Kill All' - use self.qemu_kill_all() in case of qemu_start(self) failure Change-Id: I19d4c64d5daef4f00548344d45f0d4943ca4f7e8 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-05-03HC Test: Update honeycomb suite setupselias4-13/+37
- remove workaround for jVPP version mismatch - increase Java API command timeout Change-Id: Ic6a61ff029cc7cdfec1f75890e18599e3b05f019 Signed-off-by: selias <samelias@cisco.com>
2017-05-03CSIT-566: Use RA suppress in LISP and VXLAN IPv6 related test casesJan Gelety19-0/+25
Change-Id: I788bf465242f5894c65b58f14d2355d29755eda5 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-05-03Update to csit rls1704 report - perf changes tables - based on increased ↵Maciek Konstantynowicz1-12/+12
number of test job executions. Change-Id: I659f7f3da2464081be540c80cb2d71c107455a5e Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2017-05-03Updates to csit rls1704 report related to increased number of test job ↵Maciek Konstantynowicz21-395/+134
executions. Change-Id: If16e312eeb377cabc96fe1a671d9bdfedf5e87b0 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2017-05-03Fix Honeycomb source data path for report.Peter Mikus1-1/+1
Change-Id: Ifcae7625dd2325461f70382439a52d9091d7121c Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-05-03Update links with source data for rls reportPeter Mikus1-65/+65
Change-Id: Ic105fb63f5314da2a30aa1c562e4b98a1bb67788 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-05-03Update data points for rls1704 reportPeter Mikus1-3/+3
Change-Id: Iae8b0833d88d0331f0b8296c79f5267e3a32f53c Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-05-02csit-validate-pylint-master/3731 for build 3731jan.hradil8-36/+29
pylint repairs deleted duplicated method from HcPersistence.py Change-Id: I426e6c15957c995ea10bd11ae2deac75b1cab922 Signed-off-by: jan.hradil <jan.hradil@pantheon.tech>
2017-04-28Fix: VAT timeout in IPv6 scale 2MPeter Mikus2-0/+27
- Fix VAT timeout issue in IPv6 scale testing with 2M FIB entries by increasing heapsize to 3G Change-Id: Ie81619085fbd5a2a86848513d139932a12babf67 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-04-28Update ansible playbooks VIRL setupMatej Klotton2-1/+21
Change-Id: I704991c65dc5fc9ce40ade932cab104fa468696c Signed-off-by: Matej Klotton <mklotton@cisco.com>
2017-04-28csit rls1704: updates to /testpmd_performance_tests/packet_*_graphs files.Maciek Konstantynowicz4-15/+21
Change-Id: I7c9fefd93e768368ac1093ffd4589dcf63a6375c Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>