aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2018-04-09FIX: Download from nexusTibor Frank1-1/+1
Change-Id: Ia6df570da214ff7af67550335f2c1c8b26a17bce Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-04-06Add .gitignore for files created by run_doc.shVratko Polak1-0/+2
This is to prevent people who verify documentation locally from accidentally contributing the generated files into gerrit. Change-Id: I16d9993b9f7fd2652ea53661dd431c499b58db8e Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-04-06CSIT-1034: Add all x710 testsTibor Frank8-219/+1053
Change-Id: Id96a3441a1f16ee4ca0a52e7dac1726884d6685d Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-04-06FIX: Remove Niantic from x710 and xl710Tibor Frank3-3/+3
Change-Id: I3e41f30534870c2e4084f7fa81d5a757f08377ea Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-04-06FIX: Jumbo frames are not receivedTibor Frank2-2/+2
- 10ge2p1x710-ethip4-ip4base-eth-2vhostvr256-1vm-mrr.robot - 10ge2p1x710-ethip4-ip4base-eth-2vhostvr256-1vm-mrr.robot Change-Id: I69f6fcb7c7cae46a8061fd75db9be2933154c3f9 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-04-06CSIT-1032: MRR Tests: IPv6, x710Tibor Frank6-0/+1350
─ 10ge2p1x710-ethip6-ip6base-copwhtlistbase-mrr.robot ─ 10ge2p1x710-ethip6-ip6base-iacldstbase-mrr.robot ─ 10ge2p1x710-ethip6-ip6base-mrr.robot ─ 10ge2p1x710-ethip6-ip6scale200k-mrr.robot ─ 10ge2p1x710-ethip6-ip6scale20k-mrr.robot ─ 10ge2p1x710-ethip6-ip6scale2m-mrr.robot Change-Id: I270c1e52e61fd9765f139983d133432a3058c722 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-04-06CSIT-1035: MRR Tests: container_memif, x710Tibor Frank3-0/+668
─ 10ge2p1x710-eth-l2bdbasemaclrn-eth-2memif-1lxc-mrr.robot ─ 10ge2p1x710-eth-l2xcbase-eth-2memif-1dcr-mrr.robot ─ 10ge2p1x710-eth-l2xcbase-eth-2memif-1lxc-mrr.robot Change-Id: I1ad44fc2a7f27edb060953cb301fda4abcffe52b Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-04-06CSIT-1033: MRR Tests: L2, x710Tibor Frank11-2/+2307
─ 10ge2p1x710-dot1q-l2bdbasemaclrn-mrr.robot ─ 10ge2p1x710-dot1q-l2xcbase-mrr.robot ─ 10ge2p1x710-eth-l2bdbasemaclrn-iacl1sf-10kflows-mrr.robot ─ 10ge2p1x710-eth-l2bdbasemaclrn-iacl1sl-10kflows-mrr.robot ─ 10ge2p1x710-eth-l2bdbasemaclrn-iacl50sf-10kflows-mrr.robot ─ 10ge2p1x710-eth-l2bdbasemaclrn-iacl50sl-10kflows-mrr.robot ─ 10ge2p1x710-eth-l2bdscale100kmaclrn-mrr.robot ─ 10ge2p1x710-eth-l2bdscale10kmaclrn-mrr.robot ─ 10ge2p1x710-eth-l2bdscale1mmaclrn-mrr.robot ─ 10ge2p1x710-eth-l2xcbase-mrr.robot Change-Id: Ic5d5cb377eca25daaeb22e8390632a6d6421c2e3 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-04-06CSIT-1030: Add x710 MRR tests - vm_vhostVratko Polak11-0/+2721
+ 10ge2p1x710-dot1q-l2bdbasemaclrn-eth-2vhostvr1024-1vm-mrr.robot + 10ge2p1x710-dot1q-l2xcbase-eth-2vhostvr1024-1vm-mrr.robot + 10ge2p1x710-eth-l2bdbasemaclrn-eth-2vhostvr256-1vm-mrr.robot + 10ge2p1x710-eth-l2bdbasemaclrn-eth-4vhostvr1024-2vm-mrr.robot + 10ge2p1x710-eth-l2xcbase-eth-2vhostvr1024-1vm-mrr.robot + 10ge2p1x710-eth-l2xcbase-eth-2vhostvr256-1vm-mrr.robot + 10ge2p1x710-eth-l2xcbase-eth-4vhostvr1024-2vm-mrr.robot + 10ge2p1x710-ethip4-ip4base-eth-2vhostvr1024-1vm-mrr.robot + 10ge2p1x710-ethip4-ip4base-eth-2vhostvr256-1vm-mrr.robot + 10ge2p1x710-ethip4-ip4base-eth-4vhostvr1024-2vm-mrr.robot + 10ge2p1x710-ethip4vxlan-l2bdbasemaclrn-eth-2vhostvr1024-1vm-mrr.robot Copies of the respective x520 files, with each "X520-DA2" or "X520" replaced by "X710". Occurences of "Niantic" were removed. Change-Id: I15bce75b704072b26a908f868e90a42dc3ea7661 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-04-06FIX: VAT SSH timeoutPeter Mikus4-61/+56
Currently when VAT cannot connect to VPP via direct API call, there is inner timeout of ~100s until it quits and returns RC. In our code we are setting outer timeout to 10/15s to detect if VAT is not responding. If VAT does not respond quickly enough due to e.g VPP crash, we are incorrectly reporting SSHTimout exception. This fix is suppose to set correct timeout values and also to set some of the calls like show run|hard|err / clear to detect whether they were successfull or not. + Various small library cleanup. Change-Id: I787c4baecd7e086705a4076643e255a875ea8438 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-04-06CSIT-1020: MRR Day 2 - x710Jan Gelety17-1/+3745
- CSIT-1029: x710 MRR tests - IP4 - ip4 -10ge2p1x710-ethip4-ip4base-copwhtlistbase-mrr.robot -10ge2p1x710-ethip4-ip4base-iacldstbase-mrr.robot -10ge2p1x710-ethip4-ip4base-ipolicemarkbase-mrr.robot -10ge2p1x710-ethip4-ip4base-mrr.robot -10ge2p1x710-ethip4-ip4scale200k-mrr.robot -10ge2p1x710-ethip4-ip4scale20k-mrr.robot -10ge2p1x710-ethip4-ip4scale2m-mrr.robot -10ge2p1x710-ethip4udp-ip4base-iacl1sf-10kflows-mrr.robot -10ge2p1x710-ethip4udp-ip4base-iacl1sl-10kflows-mrr.robot -10ge2p1x710-ethip4udp-ip4base-iacl50sf-10kflows-mrr.robot -10ge2p1x710-ethip4udp-ip4base-iacl50sl-10kflows-mrr.robot -10ge2p1x710-ethip4udp-ip4base-nat44-mrr.robot - 10ge2p1x710-ethip4udp-ip4scale1000-udpsrcscale15-nat44-mrr.robot - ip4_tunnels -10ge2p1x710-ethip4lispip4-ip4base-mrr.robot -10ge2p1x710-ethip4vxlan-l2bdbasemaclrn-mrr.robot - 10ge2p1x710-ethip4vxlan-l2xcbase-mrr.robot Change-Id: I141bbd8039f4a5993c77758b1c410dcbd203ab97 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-04-06CSIT-1008: Fix 9000B VM Vhost performance testsTibor Frank6-2213/+803
Change-Id: I63105e8a4f11d740c38fc6123984005bcefa117b Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-04-05HC Tests: adapt hc2vpp tests to oxygen bump(HONEYCOMB-424)Marek Gradzki1-16/+16
Requires https://gerrit.fd.io/r/#/c/10376/ and https://gerrit.fd.io/r/#/c/10643/ Change-Id: I32c81ddf4377f598c359bff278b34a76b9309a28 Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
2018-04-05FIX: Change plugin default behavior for Container tests Peter Mikus1-2/+1
Looks like disabling all plugins in container leaving only memif_plugin.so results into issue that could lead into lost of SSH connectivity to TB or in better case to not handling any traffic. This fix is supose to return previous behavior for Container instance of VPP. vpp_config.add_plugin('disable', 'dpdk_plugin.so') Change-Id: I7bca6c73c0f5aaf30d423b90ff7c2d2c38d54700 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-04-05Revert "FIX: Change plugin default behavior for Container tests"Peter Mikus3-4/+6
This reverts commit c754789176b1a3ca00a129d3d207aa5a6bad7c27. Change-Id: Ic1bbe8fac0d98f41aa8b1b57da0c7a147111340b Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-04-05FIX: Change plugin default behavior for Container testsPeter Mikus3-6/+4
Looks like disabling all plugins in container leaving only memif_plugin.so results into issue that could lead into lost of SSH connectivity to TB or in better case to not handling any traffic. This fix is supose to return previous behavior for Container instance of VPP. Change-Id: Ie8b3ce2e35a40c8f3498e490abb6967cd4dd912a Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-04-05HC Tests: fix authentication for ODL Oxygen jobsMarek Gradzki2-4/+10
Change-Id: I05dcb5f35ae1bc2abc7ce5c34eaced218e0ebd35 Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
2018-04-05Put Centos 7.4-1711 1.9 image into productionThomas F Herbert1-1/+1
The patch to create this image is gerrit patch 11245 CSIT-566 CSIT-688 CSIT-681 CSIT-682 CSIT-688 CSIT-683 7.4-1711 1.9 images have been installed on VIRL1, VIRL2 and VIRL3 The 7.4-1711_1.9 image has been tested locally on VIRL3 with a local patch modifying bootstrap.sh. A pass of verify should force a check on VIRL2 and VIRL1 to verify that the image works OK. A merge of this patch will put the new image into production so review this patch plus 11245 above carefully before merging. Change-Id: I74a0b23d75120fdc3934bfe3c6e96f8fb10784db Signed-off-by: Thomas F Herbert <therbert@redhat.com>
2018-04-04CSIT-1027: Add IndexTibor Frank8-351/+352
Change-Id: I2928aee8665ba80f6a36643331db410d55683b38 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-04-04Update to Centos image 7.4-1711Thomas F Herbert14-71/+581
Add qemu-ev version 2.9.0-16 Changes required for vpp 18.04: Add selinux policy rpms at required version. Add mbedtls JIRA: CSIT-566 JIRA: CSIT-680 JIRA: CSIT-681 JIRA: CSIT-602 JIRA: CSIT-608 JIRA: CSIT-603 Update Centos image version 1.8: Point to Vault repo specific to for 7.3-1611 for consistent control of package versions and releases. Fix for pypcap import problem. JIRA: CSIT-991 This fix forces the downloads of the complete package for all the pip python packages to be installed on Centos regardless of the Python metadata on the host. Change-Id: Id651dd113eec41db738ac1e10c92d1074e89b1de Signed-off-by: Thomas F Herbert <therbert@redhat.com>
2018-04-04CSIT-1027: Add IndexTibor Frank9-165/+185
Change-Id: If92bf076e4a55fff8f740b20a1f3aa5019c66091 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-04-04CSIT Trending: Static contentTibor Frank5-26/+121
Change-Id: Icc5ad530cf7f80eae08a6cb7ce0f49b65015f6a5 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-04-03CSIT Trending: Add x710, IMIXTibor Frank4-48/+841
- L2 - container memif - VM vhost Change-Id: I74a720dad12e1709fd99f76f022c863c80969611 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-04-03CSIT Trending: input filesTibor Frank1-9/+6
Change-Id: I1570e55186c54718aa388c8ec24bd8d8ed67e0ac Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-04-03CSIT Trending: Input filesTibor Frank2-7/+2
Change-Id: I4cfaaff8a372dbf807715ec47647fbe8760dbe6b Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-04-03CSIT Trending: Input filesTibor Frank1-1/+9
Change-Id: I93728caccec332e05af30858dc83e85ab2af91fc Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-04-03CSIT Trending: input filesTibor Frank3-10/+6
Change-Id: I15d987cd57272c29d463c711fb7049b33b1e0084 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-04-03PAL Trending: download input filesTibor Frank4-18/+25
Change-Id: I407e3cdeb25547d46fafed702ee608f6c0e03091 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-03-30Change the default plugin behavior in perf testsPeter Mikus6-61/+21
Currently we are selectively disabling plugins by creating list of disabled plugins for performance tests. Thanks to the new API in VPP we can revert the logic to selectivly enable plugins. This is more stable for future onboarding of new plugins into VPP. Change-Id: Ibdd56d6097230d095a304bbb6984b565d9428f51 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-03-29Add IPSEC MRR tests to VPP verify jobsPeter Mikus1-0/+4
- Add IPSEC MRR tests to VPP verify jobs on IPSEC trigger Change-Id: I39f79fab266e86fbc8d15859b1aaa26e15f26cbd Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-03-29Add IMIX for Vhost and Memif into MRR trendingPeter Mikus1-0/+6
- Add IMIX for Vhost and Memif into MRR trending Change-Id: Ifab55b14a97f742e801ddc6f15388f3a134db799 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-03-28PAL Trending: Data in txt table in MppsTibor Frank2-3/+3
Change-Id: I3b27f95c899e2a904fe806de24f7a0d5440cb4ff Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-03-28PAL Trending: Data in txt table in MppsTibor Frank1-2/+10
Change-Id: I5427e14479b4403319b817e75d83b95b64bcddb6 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-03-28PAL Trending: Static contentTibor Frank13-551/+110
Change-Id: I4c46a0b06c5d726f7bfb5705d153f101eb46796f Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-03-28Perf bootstrap cleanupPeter Mikus3-135/+101
- Add archiving of all artifacts to logs.fd.io - Remove obsolete test tags - Sync all bootstrap and prepare for future merge-into-single bootstrap. Change-Id: I023df6964bb049df3ccffdffa31a93b667e1587a Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-03-27Trending: Set the start build number to 15.Tibor Frank1-2/+2
Change-Id: If1603fb8d39c339caf9c49015a63e2910f98e292 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-03-27PAL trending: Trending lineTibor Frank1-3/+4
Change-Id: I46309f53365b9335fc93bcecdf293bca07a0e51d Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-03-26FIX: Catch exeption in start-testcasePeter Mikus1-3/+3
Catch all exceptions by default if removing scratch directory is not successful. This prevents further confusion about NFS permissions as this is not the root cause of script failure. Change-Id: I0f775bb38e98cf69b4ce277b6e0dda4dad0a8732 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-03-26Report: Fix packet_throughput_graphs/ip4Tibor Frank3-11/+34
Change-Id: I3943d02dcca95ed31baaa104648589c42ef479a7 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-03-26Report: Detect outliers for the comparative tablesTibor Frank3-45/+46
Change-Id: Ia1be590a720df71ff51e8a7ca910ed27a4642209 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-03-26Report: Detect outliers for the comparative tablesTibor Frank2-45/+41
Change-Id: I2bbb2c4e18f456da9b8d62b6654d7e23fe36ee58 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-03-26Report: Detect outliers for the comparative tablesTibor Frank1-13/+9
Change-Id: I87f7f239560544261e21d36d020c56dda0e601fd Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-03-26Add IPSec testsTibor Frank4-84/+105
Change-Id: Ie1ddc6189a68a299207fe9158d1be8409ec2bc6a Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-03-26Optimize Qemu installation to speed up vhost testsPeter Mikus52-521/+203
Currently Qemu is being installed if there is a change of qsz parameter between tests/suites. Qemu is installed always into the same directory. This patch changes the default behavior to install qemu over and install pathced version to separate directory. It also disables force install. Change-Id: I0d7493a02b026a6ae4a5ea8bacf54656de9db567 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-03-26CSIT-919: Jenkins jobTibor Frank3-14/+10
Change-Id: I8ed4a8e135ebbebc7799a633872a50293eb410af Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-03-26Add lastCompletedBuild option to the specTibor Frank3-47/+86
Change-Id: I4432e626a7bc81be2cede56da6a3660450f09c01 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-03-26CSIT-919: Jenkons jobTibor Frank1-5/+3
- return correct return value Change-Id: I761593b90336ef3926e157c068982713ea3fe71f Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-03-23CSIT-1004: Generate csv and txt tables with trending and statistical dataTibor Frank6-8/+56
Change-Id: I50ba76c06621a9a293a5327b5b7709e4df6a4756 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-03-23CSIT-949: Data modelsTibor Frank7-16/+269
Change-Id: I07d0b122632c15fa07a5871dc268d654f410ef4f Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-03-22CSIT-1005: Add ipsec MRR testsVratko Polak20-180/+1569
+ 40ge2p1xl710-ethip4ipsecbasetnl-ip4base-int-aes-gcm-mrr.robot + 40ge2p1xl710-ethip4ipsecbasetnl-ip4base-int-cbc-sha1-mrr.robot + 40ge2p1xl710-ethip4ipsecbasetnlsw-ip4base-int-aes-gcm-mrr.robot + 40ge2p1xl710-ethip4ipsecbasetnlsw-ip4base-int-cbc-sha1-mrr.robot + 40ge2p1xl710-ethip4ipsecscale1000tnl-ip4base-int-aes-gcm-mrr.robot + 40ge2p1xl710-ethip4ipsecscale1000tnl-ip4base-int-cbc-sha1-mrr.robot Do not add test cases for 9000B framesize yet. Improve other suites to keep the style consistent. Change-Id: I03a58e8d6745083e267b9d53bb3b85efcb2ea827 Signed-off-by: Vratko Polak <vrpolak@cisco.com>