aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2018-03-20Update the list of disabled plugginsTibor Frank2-8/+46
Change-Id: I089416953f5c3292358e443c806987dddce1c0d3 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-03-19No overlapping subnets between DUT/TG and DUT/VMNeale Ranns5-6/+6
Change-Id: Ib6a2921070f3524b001ecea2467b28264288fee3 Signed-off-by: Neale Ranns <nranns@cisco.com>
2018-03-19CSIT-935: Add mrr 9000B and 4t4c testsTibor Frank20-330/+1250
CSIT-1002: container_memif - 10ge2p1x520-eth-l2bdbasemaclrn-eth-2memif-1lxc-mrr.robot - 10ge2p1x520-eth-l2xcbase-eth-2memif-1dcr-mrr.robot - 10ge2p1x520-eth-l2xcbase-eth-2memif-1lxc-mrr.robot - 40ge2p1xl710-eth-l2bdbasemaclrn-eth-2memif-1lxc-mrr.robot - 40ge2p1xl710-eth-l2xcbase-eth-2memif-1lxc-mrr.robot CSIT-1003: vm vhost - 10ge2p1x520-dot1q-l2bdbasemaclrn-eth-2vhostvr1024-1vm-mrr.robot - 10ge2p1x520-dot1q-l2xcbase-eth-2vhostvr1024-1vm-mrr.robot - 10ge2p1x520-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-mrr.robot - 10ge2p1x520-eth-l2bdbasemaclrn-eth-2vhostvr256-1vm-mrr.robot - 10ge2p1x520-eth-l2bdbasemaclrn-eth-4vhostvr1024-2vm-mrr.robot - 10ge2p1x520-eth-l2xcbase-eth-2vhostvr1024-1vm-mrr.robot - 10ge2p1x520-eth-l2xcbase-eth-2vhostvr256-1vm-mrr.robot - 10ge2p1x520-eth-l2xcbase-eth-4vhostvr1024-2vm-mrr.robot - 10ge2p1x520-ethip4-ip4base-eth-2vhostvr1024-1vm-mrr.robot - 10ge2p1x520-ethip4-ip4base-eth-2vhostvr256-1vm-mrr.robot - 10ge2p1x520-ethip4-ip4base-eth-4vhostvr1024-2vm-mrr.robot - 10ge2p1x520-ethip4vxlan-l2bdbasemaclrn-eth-2vhostvr1024-1vm-mrr.robot - 40ge2p1x710-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-mrr.robot - 40ge2p1xl710-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-mrr.robot - 40ge2p1xl710-eth-l2bdbasemaclrn-eth-4vhostvr1024-2vm-mrr.robot Change-Id: Idd049db6134179f0f9ed603569ec8512faca1ab9 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-03-19FIX: remove all vpp packages installedJan Gelety1-10/+10
Change-Id: I1a2e51fada2f16fb236499a5cbff735f5e08aae2 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-03-19Update of VPP_STABLE_VER filesJan Gelety2-2/+2
- use new vpp ref build - ubuntu 16.04: 18.04-rc0~425-g039cbfe~b3921_amd64 - use new vpp ref build - centos7: 18.04-rc0~425_g039cbfe~b3910.x86_64 Change-Id: Id8c7e767b67b9dc8ad7c5ae129279df5d13f6466 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-03-19CSIT-998: MRR testsTibor Frank21-20/+4273
- CSIT-999: MRR tests: L2 - 10ge2p1x520-eth-l2xcbase-mrr.robot - 10ge2p1x520-eth-l2bdbasemaclrn-mrr.robot - 10ge2p1x520-dot1q-l2bdbasemaclrn-mrr.robot - 10ge2p1x520-dot1q-l2xcbase-mrr.robot - 10ge2p1x520-eth-l2bdbasemaclrn-iacl1sf-10kflows-mrr.robot - 10ge2p1x520-eth-l2bdbasemaclrn-iacl1sl-10kflows-mrr.robot - 10ge2p1x520-eth-l2bdbasemaclrn-iacl50sf-10kflows-mrr.robot - 10ge2p1x520-eth-l2bdbasemaclrn-iacl50sl-10kflows-mrr.robot - 10ge2p1x520-eth-l2bdscale100kmaclrn-mrr.robot - 10ge2p1x520-eth-l2bdscale10kmaclrn-mrr.robot - 10ge2p1x520-eth-l2bdscale1mmaclrn-mrr.robot - 10ge2p1x710-eth-l2bdbasemaclrn-ndrpdrdisc.robot - 40ge2p1xl710-eth-l2bdbasemaclrn-mrr.robot - 40ge2p1xl710-eth-l2xcbase-mrr.robot - CSIT-1000: MRR tests: IPv6 ─ 10ge2p1x520-ethip6-ip6base-copwhtlistbase-mrr.robot - 10ge2p1x520-ethip6-ip6base-iacldstbase-mrr.robot ─ 10ge2p1x520-ethip6-ip6scale200k-mrr.robot ─ 10ge2p1x520-ethip6-ip6scale20k-mrr.robot ─ 10ge2p1x520-ethip6-ip6scale2m-mrr.robot ─ 40ge2p1xl710-ethip6-ip6base-mrr.robot Change-Id: Ie42b08151b5da3ba32b972af8b6bedf313c6d29c Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-03-16Add vhost and memif MRR suitePeter Mikus21-8/+3438
Change-Id: Iaded13af82383955c2ff093ddc96e09682d95776 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-03-16VPP install and verify in __init__.robotAndrej Kilvady5-53/+212
Move VPP installation to separate test in test suite setup phase to clearly indicate any issue with VPP installation. Added test to check VPP responsiveness after installation. Change-Id: Idc2c78152e23aa7301bb5dbf9b1b6f4b639c3e84 Signed-off-by: Andrej Kilvady <andrej.kilvady@pantheon.tech>
2018-03-14Robot logs archiving for trending jobsPeter Mikus2-8/+15
- Add output.xml auto-archiving to logs.fd.io. - Cleanup from obsolete code. Change-Id: Iafa9ef802264d2ad36ca0f556cb14d2b3ca0f179 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-03-13HC Tests: disable NSH pluginMarek Gradzki6-16/+26
NSH artifacts in Nexus are outdated and crash VPP. Reenable NSH after it is fixed (CSIT-994). Change-Id: I3a0367682d62d5ccdbf008336ed682e7ab9032a0 Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
2018-03-12Optimize VPP restart after startup.conf changePeter Mikus1-7/+4
Change-Id: Iabe7de5d598f904bd7e691c3ffed1d07ed0c7f68 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-03-12Update of VPP_STABLE_VER files and DPDK_STABLE_VER fileJan Gelety3-3/+3
- use new vpp ref build - ubuntu 16.04: 18.04-rc0~377-g03f47f1~b3869_amd64 - use new vpp ref build - centos7: 18.04-rc0~377_g03f47f1~b3862.x86_64 - use new dpdk version: 18.02-vpp1 Change-Id: Ic2bf4850caec109f7d588afedb8eec0c76ab8d3a Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-03-08CSIT-989 Fix: Reflect latest memif API changesPeter Mikus13-471/+533
Change-Id: I0c9cb073a42a8b4b7e573023e784ab9e72d0ad55 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-03-08CSIT-988: Add libmbedcrypto0 as a new vpp dependencyPeter Mikus4-3/+13
Add libmbedcrypto0 to the list of installed packages on Physical testbeds + VIRL images Change-Id: Ied68b79a36d0b6c8619aa22effeac30e5f3c0cf6 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-03-07FIX: Bootstrap.sh for functional VIRL jobsPeter Mikus1-5/+3
- Fix the path of temporary result files to workspace instead of /run/shm Change-Id: I4819ef5d6371412a91b6736aa36b223df38eacac Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-03-07CSIT-988: Fix functional bootstrapPeter Mikus2-3/+7
Change-Id: I6fb16e799e991ce01e9f997a05c4be72a26ce3af Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-03-07FIX: MRR IPv6 tagsPeter Mikus1-3/+3
Change-Id: I2ca83b4405cd537671bf16fc57500be91455eadc Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-03-06Fix: Remove api-segment from default startup configPeter Mikus1-2/+0
Remove api-segment from default startup.conf for performance tests. Change-Id: I8f126faf3d923d36b1be2f2e0e676b07c072f1f3 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-03-05Convert behavior-driven to data-driven IPv4Peter Mikus9-2071/+577
- Align test cases to data driven style for IPv4 Change-Id: Ie8fafaf7ba585e89feee417af96aa95d7ba4b4f9 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-03-05Performance KW optimizations IIPeter Mikus2-23/+29
Currently Binary Search is using TRex warmup time for every lookup trial. This patch is suppose to optimize Binary Search to not use warmup time for each trial apart from first one. Change-Id: I9b914cfac3ce558557133c266335c1f550c0b52a Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-03-01PAL: Clean the codeTibor Frank2-3/+6
Change-Id: I7aa196cdc7bf4d34c1313f8f811ab3f6dd8f10f2 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-02-28Update of VPP_STABLE_VER files + fix Centos dep listPeter Mikus6-6/+6
Change-Id: Icd149927c6b2893f8f716df29d8de475e809be49 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-02-27Performance KW optimizationsPeter Mikus2-6/+0
- Reducing test time by removing redundant KW. Change-Id: I03eeb0332cb88a11eff06df6f5e79d905df317a2 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-02-23Adapt hc2vpp-csit bootstrap scripts to HC2VPP-285/CIMANAGE-22Marek Gradzki1-5/+11
Since https://gerrit.fd.io/r/#/c/10668/ and https://gerrit.fd.io/r/#/c/10669/ honeycomb packages from stable branches no longer depend on single VPP version. This patch updates download_hc_pkgs.hc script, used by hc2vpp-csit jobs, to use the latest honeycomb package in such case. Change-Id: If5b006e72caa8cc905137b1bf02af7d9e927e37a Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
2018-02-23FIX: LXC/DOCKER exclusive CPUPeter Mikus1-0/+17
By default the cpuset cgroup is using exclusive CPU/MEM. When Docker container is initialized a new cgroup /docker or /lxc is created under cpuset parent tree. This newly created cgroup is inheriting parent setting for cpu/mem exclusive parameter and thus cannot be overriden within /docker or /lxc cgroup. This patch is supposed to set cpu/mem exclusive parameter for both parent and subgroup. Change-Id: I14b44db3f77c842756ec78aa60df7aca508d9545 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-02-23Raw results chk keywords and initial TCPeter Mikus9-77/+831
- Implementation of Display raw results - Implementation of Traffic should pass with maximum rate - Code optimizations - L2BD, L2XC, IP4, IP6 TC Change-Id: I0b50e995a853ed3c8f88323ccc650e47b8ed2496 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-02-23FIX: Qemu path overridePeter Mikus3-16/+19
Currently there is bug that Qemu path is not correctly composed and cannot be properly overriden due to race condition in code. This patch is fixing functions to properly work with path. Change-Id: I276458d2d23c7a14441a4de4a56eff6431242ab9 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-02-21CSIT-891: Add data sources for 1801 reportTibor Frank1-15/+8
Change-Id: I0379d0e62e4ae3065fc8181e6d7140bd81858d7d Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-02-21CSIT-891: Add data sources for 1801 reportTibor Frank1-0/+4
Change-Id: I75fc2e4497d9cc57417c9205768c11d19403c9c9 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-02-21CSIT-891: Add data sources for 1801 reportTibor Frank2-1/+9
Change-Id: I1f5f7e931cdbd4eb9ede9b2cc527d975c63684ad Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-02-21CSIT-891: Add data sources for 1801 reportTibor Frank2-37/+35
Change-Id: Id178e852e4c94b1e093d72901689a7f7820c2c3d Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-02-21CSIT-891: Add data sources for 1801 reportTibor Frank2-8/+24
Change-Id: I4c22c9e82bb746917198e345409eea3e0e322bbe Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-02-20CSIT-891: Add data sources for 1801 reportTibor Frank1-20/+18
Change-Id: Ia798986b14330c7e70d65d6123292a7eed6e3d7b Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-02-20rls1801: updated known issues in rls notes for vpp performance.Maciek Konstantynowicz1-1/+17
Change-Id: I8f4a08933dc27db8f4f2134cdd9ddadbcd790577 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2018-02-20CSIT-891: Add data sources for 1801 reportTibor Frank12-2145/+2226
Change-Id: Ifd1bcbf376e9eff9afbb578d88df377ba301cafa Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-02-20HC CSIT Report: post 1801 release cleanupMarek Gradzki1-3/+1
This reverts https://gerrit.fd.io/r/#/c/10391/ (commit 076ad4996ca921a0fb675a8a79d1248c6fccc452). CSIT 1801 report was published, so there is no need to keep master and rls1801 in sync. Change-Id: Ib2887dced4de013a459d08b5dcc2c39410e92718 Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
2018-02-20CSIT-891: Add data sources for 1801 reportTibor Frank1-1/+11
Change-Id: I86f5bcbe4c5cd12ddccba5ae6f4df73c139a359c Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-02-19Update report section with VPP startup confPeter Mikus1-4/+58
Change-Id: I074b557cb8dcd6013c388eed7548e170644a89d0 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-02-19CSIT-891: Add data sources for 1801 reportTibor Frank1-0/+4
Change-Id: Id8a90708bf51e5c1df7bc91d3947e023d23b842a Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-02-19rls1801 report: edits to static content for vpp and dpdk perf sections.Maciek Konstantynowicz3-95/+143
Change-Id: I22a38d2704b3a414798823c1846ff12f8f69d7b7 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2018-02-19CSIT-891: Add data sources for 1801 reportTibor Frank2-4/+15
Change-Id: Ia1a1187c468d0fb57ee6160e633adb38512f0ad7 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-02-19CSIT-891: Add data sources for 1801 reportTibor Frank4-45/+48
Change-Id: I507878dba5eea9eff70336143cdcdd735b631898 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-02-19CSIT-891: Add data sources for 1801 reportTibor Frank4-21/+18
Change-Id: I632af9dafbadd12091c9063b098bb2db742780ec Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-02-19FIX: Ligato testsPeter Mikus13-242/+247
- update binary search - update VPP agent ver Change-Id: If93346f43fabc8afac28b1dcfa5c44433d53a1a4 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-02-19CSIT-891: Add data sources for 1801 reportTibor Frank1-0/+15
Change-Id: I2fd8fff455f419ef32a3562e77202278094482b6 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-02-16CSIT-932: Remove outliers form statistical calculationsTibor Frank3-149/+32
Change-Id: Ibd90931bdc3dd8615fe2c975935c8a54fe85e6c3 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-02-16CSIT-932: Remove outliers form statistical calculationsTibor Frank1-0/+1
Change-Id: If9b8eaa4d997ad3516c27befb4a868a948567482 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-02-16CSIT-932: Remove outliers form statistical calculationsTibor Frank1-0/+4
Change-Id: I95934c92b2ebc77e5e3e7696d318ee8416f848e9 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-02-16CSIT-932: Remove outliers form statistical calculationsTibor Frank1-4/+4
Change-Id: I80d412e01eef364dfd76c1961a754e787f6ca7f3 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-02-16CSIT-891: Add data sources for 1801 reportTibor Frank1-9/+17
Change-Id: Icda3dd888016a7074902ec6690cc7e874f46df2c Signed-off-by: Tibor Frank <tifrank@cisco.com>