aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2018-03-28CSIT-1005: Add ipsec MRR testsVratko Polak20-180/+1569
+ 40ge2p1xl710-ethip4ipsecbasetnl-ip4base-int-aes-gcm-mrr.robot + 40ge2p1xl710-ethip4ipsecbasetnl-ip4base-int-cbc-sha1-mrr.robot + 40ge2p1xl710-ethip4ipsecbasetnlsw-ip4base-int-aes-gcm-mrr.robot + 40ge2p1xl710-ethip4ipsecbasetnlsw-ip4base-int-cbc-sha1-mrr.robot + 40ge2p1xl710-ethip4ipsecscale1000tnl-ip4base-int-aes-gcm-mrr.robot + 40ge2p1xl710-ethip4ipsecscale1000tnl-ip4base-int-cbc-sha1-mrr.robot Do not add test cases for 9000B framesize yet. Improve other suites to keep the style consistent. Change-Id: I03a58e8d6745083e267b9d53bb3b85efcb2ea827 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-03-28Optimize Qemu installation to speed up vhost testsPeter Mikus52-597/+309
Currently Qemu is being installed if there is a change of qsz parameter between tests/suites. Qemu is installed always into the same directory. This patch changes the default behavior to install qemu over and install pathced version to separate directory. It also disables force install. Change-Id: I0d7493a02b026a6ae4a5ea8bacf54656de9db567 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-03-28Add 78B tests to MRR trending dailyTibor Frank1-1/+6
Change-Id: I73b9c505dcd28361978a075bc81db3112e308b9c Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit a1826160461e864060705202646cfc50f2e24015)
2018-03-28CSIT-998: MRR testsJan Gelety18-21/+3811
- CSIT-1001: MRR tests: IP4 - ip4 - 10ge2p1x520-ethip4-ip4base-copwhtlistbase-mrr.robot - 10ge2p1x520-ethip4-ip4base-iacldstbase-mrr.robot - 10ge2p1x520-ethip4-ip4base-ipolicemarkbase-mrr.robot - 10ge2p1x520-ethip4-ip4scale200k-mrr.robot - 10ge2p1x520-ethip4-ip4scale20k-mrr.robot - 10ge2p1x520-ethip4-ip4scale2m-mrr.robot - 10ge2p1x520-ethip4udp-ip4base-iacl1sf-10kflows-mrr.robot - 10ge2p1x520-ethip4udp-ip4base-iacl1sl-10kflows-mrr.robot - 10ge2p1x520-ethip4udp-ip4base-iacl50sf-10kflows-mrr.robot - 10ge2p1x520-ethip4udp-ip4base-iacl50sl-10kflows-mrr.robot - 10ge2p1x520-ethip4udp-ip4base-nat44-mrr.robot - 10ge2p1x520-ethip4udp-ip4scale1000-udpsrcscale15-nat44-mrr.robot - 40ge2p1xl710-ethip4-ip4base-mrr.robot - ip4_tunnels - 10ge2p1x520-ethip4vxlan-l2bdbasemaclrn-mrr.robot - 10ge2p1x520-ethip4vxlan-l2xcbase-mrr.robot - 10ge2p1x520-ethip4lispip4-ip4base-mrr.robot Change-Id: Ibfd03aea9b97d29a8fa05e2956f6df54603a2208 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-03-28CSIT-935: Add mrr 9000B and 4t4c testsTibor Frank20-330/+1250
CSIT-1002: container_memif - 10ge2p1x520-eth-l2bdbasemaclrn-eth-2memif-1lxc-mrr.robot - 10ge2p1x520-eth-l2xcbase-eth-2memif-1dcr-mrr.robot - 10ge2p1x520-eth-l2xcbase-eth-2memif-1lxc-mrr.robot - 40ge2p1xl710-eth-l2bdbasemaclrn-eth-2memif-1lxc-mrr.robot - 40ge2p1xl710-eth-l2xcbase-eth-2memif-1lxc-mrr.robot CSIT-1003: vm vhost - 10ge2p1x520-dot1q-l2bdbasemaclrn-eth-2vhostvr1024-1vm-mrr.robot - 10ge2p1x520-dot1q-l2xcbase-eth-2vhostvr1024-1vm-mrr.robot - 10ge2p1x520-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-mrr.robot - 10ge2p1x520-eth-l2bdbasemaclrn-eth-2vhostvr256-1vm-mrr.robot - 10ge2p1x520-eth-l2bdbasemaclrn-eth-4vhostvr1024-2vm-mrr.robot - 10ge2p1x520-eth-l2xcbase-eth-2vhostvr1024-1vm-mrr.robot - 10ge2p1x520-eth-l2xcbase-eth-2vhostvr256-1vm-mrr.robot - 10ge2p1x520-eth-l2xcbase-eth-4vhostvr1024-2vm-mrr.robot - 10ge2p1x520-ethip4-ip4base-eth-2vhostvr1024-1vm-mrr.robot - 10ge2p1x520-ethip4-ip4base-eth-2vhostvr256-1vm-mrr.robot - 10ge2p1x520-ethip4-ip4base-eth-4vhostvr1024-2vm-mrr.robot - 10ge2p1x520-ethip4vxlan-l2bdbasemaclrn-eth-2vhostvr1024-1vm-mrr.robot - 40ge2p1x710-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-mrr.robot - 40ge2p1xl710-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-mrr.robot - 40ge2p1xl710-eth-l2bdbasemaclrn-eth-4vhostvr1024-2vm-mrr.robot Change-Id: Idd049db6134179f0f9ed603569ec8512faca1ab9 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit c9c2cb7ee2dfc00a280b25dcfd855a39ccfdc158) (cherry picked from commit 88579f641831cbe365038f146c588cd5cd8d6b2a)
2018-03-28Add vhost and memif MRR suitePeter Mikus21-0/+3900
Change-Id: Iaded13af82383955c2ff093ddc96e09682d95776 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-03-28CSIT-998: MRR testsTibor Frank21-20/+4273
- CSIT-999: MRR tests: L2 - 10ge2p1x520-eth-l2xcbase-mrr.robot - 10ge2p1x520-eth-l2bdbasemaclrn-mrr.robot - 10ge2p1x520-dot1q-l2bdbasemaclrn-mrr.robot - 10ge2p1x520-dot1q-l2xcbase-mrr.robot - 10ge2p1x520-eth-l2bdbasemaclrn-iacl1sf-10kflows-mrr.robot - 10ge2p1x520-eth-l2bdbasemaclrn-iacl1sl-10kflows-mrr.robot - 10ge2p1x520-eth-l2bdbasemaclrn-iacl50sf-10kflows-mrr.robot - 10ge2p1x520-eth-l2bdbasemaclrn-iacl50sl-10kflows-mrr.robot - 10ge2p1x520-eth-l2bdscale100kmaclrn-mrr.robot - 10ge2p1x520-eth-l2bdscale10kmaclrn-mrr.robot - 10ge2p1x520-eth-l2bdscale1mmaclrn-mrr.robot - 10ge2p1x710-eth-l2bdbasemaclrn-ndrpdrdisc.robot - 40ge2p1xl710-eth-l2bdbasemaclrn-mrr.robot - 40ge2p1xl710-eth-l2xcbase-mrr.robot - CSIT-1000: MRR tests: IPv6 ─ 10ge2p1x520-ethip6-ip6base-copwhtlistbase-mrr.robot - 10ge2p1x520-ethip6-ip6base-iacldstbase-mrr.robot ─ 10ge2p1x520-ethip6-ip6scale200k-mrr.robot ─ 10ge2p1x520-ethip6-ip6scale20k-mrr.robot ─ 10ge2p1x520-ethip6-ip6scale2m-mrr.robot ─ 40ge2p1xl710-ethip6-ip6base-mrr.robot Change-Id: Ie42b08151b5da3ba32b972af8b6bedf313c6d29c Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit aefed05ca7fa9bdbbd2dbc5f2a179912db67cfd4) (cherry picked from commit 2859297d100f90ab60092468d05d5a00d4c2e262)
2018-03-28FIX: MRR IPv6 tagsPeter Mikus1-3/+3
Change-Id: I2ca83b4405cd537671bf16fc57500be91455eadc Signed-off-by: Peter Mikus <pmikus@cisco.com> (cherry picked from commit a4845b4c0419aa8785926b50d8d6c28f2e015e09) (cherry picked from commit c1d1f59a15b066a3ddcf80bba33ad69b1fcef430)
2018-03-28Raw results chk keywords and initial TCPeter Mikus9-77/+831
- Implementation of Display raw results - Implementation of Traffic should pass with maximum rate - Code optimizations - L2BD, L2XC, IP4, IP6 TC Change-Id: I0b50e995a853ed3c8f88323ccc650e47b8ed2496 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-03-26Report: Fix packet_throughput_graphs/ip4Tibor Frank3-20/+150
Change-Id: I3943d02dcca95ed31baaa104648589c42ef479a7 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-02-22Adapt hc2vpp-csit bootstrap scripts to HC2VPP-285/CIMANAGE-22Marek Gradzki1-5/+11
Since https://gerrit.fd.io/r/#/c/10668/ and https://gerrit.fd.io/r/#/c/10669/ honeycomb packages from stable branches no longer depend on single VPP version. This patch updates download_hc_pkgs.hc script, used by hc2vpp-csit jobs, to use the latest honeycomb package in such case. Change-Id: If5b006e72caa8cc905137b1bf02af7d9e927e37a Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
2018-02-21CSIT-891: Add data sources for 1801 reportTibor Frank1-15/+8
Change-Id: I0379d0e62e4ae3065fc8181e6d7140bd81858d7d Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 1ef49b2e3ab7a08cbe17ae89f3e3e48fd14aee27)
2018-02-21CSIT-891: Add data sources for 1801 reportTibor Frank1-0/+4
Change-Id: I75fc2e4497d9cc57417c9205768c11d19403c9c9 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit dac9e69ccffb7ba77808ab8cf733524f93855f40)
2018-02-21CSIT-891: Add data sources for 1801 reportTibor Frank2-1/+9
Change-Id: I1f5f7e931cdbd4eb9ede9b2cc527d975c63684ad Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 394659ca1c7cac87627347bc850477448d0743c7)
2018-02-21CSIT-891: Add data sources for 1801 reportTibor Frank2-37/+35
Change-Id: Id178e852e4c94b1e093d72901689a7f7820c2c3d Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 55f514061b2da3dd71e13e0a0c5a89797a2773ec)
2018-02-21CSIT-891: Add data sources for 1801 reportTibor Frank2-8/+24
Change-Id: I4c22c9e82bb746917198e345409eea3e0e322bbe Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit a576a8096e610a56c098355a567e1a669692d056)
2018-02-20CSIT-891: Add data sources for 1801 reportTibor Frank1-20/+18
Change-Id: Ia798986b14330c7e70d65d6123292a7eed6e3d7b Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit e26807800bb2e5aa2bcbdc2b6f7acfa31e19b24d)
2018-02-20rls1801: updated known issues in rls notes for vpp performance.Maciek Konstantynowicz1-1/+17
Change-Id: I8f4a08933dc27db8f4f2134cdd9ddadbcd790577 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> (cherry picked from commit 5ad08ca51034048ab1965f993b2dde966ef934c8)
2018-02-20CSIT-891: Add data sources for 1801 reportTibor Frank12-2145/+2226
Change-Id: Ifd1bcbf376e9eff9afbb578d88df377ba301cafa Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 3c5428b13bdf28774922b3abe370f23e3ccc5ead)
2018-02-20CSIT-891: Add data sources for 1801 reportTibor Frank1-1/+11
Change-Id: I86f5bcbe4c5cd12ddccba5ae6f4df73c139a359c Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit c9d1aec367e6a6aa8cb0105d24eb828e4c9929b8)
2018-02-19Update report section with VPP startup confPeter Mikus1-4/+58
Change-Id: I074b557cb8dcd6013c388eed7548e170644a89d0 Signed-off-by: Peter Mikus <pmikus@cisco.com> (cherry picked from commit 2af84e23b731d99231949cfef3b3d496fdb69522)
2018-02-19CSIT-891: Add data sources for 1801 reportTibor Frank1-0/+4
Change-Id: Id8a90708bf51e5c1df7bc91d3947e023d23b842a Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 65ad0cb3bc0b2430628b2b250d51c41a8dc594c6)
2018-02-19rls1801 report: edits to static content for vpp and dpdk perf sections.Maciek Konstantynowicz3-95/+143
Change-Id: I22a38d2704b3a414798823c1846ff12f8f69d7b7 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> (cherry picked from commit cddac498bafc7a6092dade5e183e5c7a95cff64d)
2018-02-19CSIT-891: Add data sources for 1801 reportTibor Frank2-4/+15
Change-Id: Ia1a1187c468d0fb57ee6160e633adb38512f0ad7 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit ec52d31c064fff2a6bf9c1e0716efa881bcf106e)
2018-02-19CSIT-891: Add data sources for 1801 reportTibor Frank4-45/+48
Change-Id: I507878dba5eea9eff70336143cdcdd735b631898 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit e15553412cfcc2b14ee3be0e30d1ca3bd146b32a)
2018-02-19CSIT-891: Add data sources for 1801 reportTibor Frank4-21/+18
Change-Id: I632af9dafbadd12091c9063b098bb2db742780ec Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit d23edad8b0f9a2463f5817a52766eebfdc5aa572)
2018-02-19CSIT-891: Add data sources for 1801 reportTibor Frank1-0/+15
Change-Id: I2fd8fff455f419ef32a3562e77202278094482b6 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit f1583b9230d23cae435baed107aed6f94c9095b6)
2018-02-16FIX: Ligato testsPeter Mikus13-243/+248
- update binary search - update VPP agent ver Change-Id: If93346f43fabc8afac28b1dcfa5c44433d53a1a4 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-02-16CSIT-932: Remove outliers form statistical calculationsTibor Frank3-149/+32
Change-Id: Ibd90931bdc3dd8615fe2c975935c8a54fe85e6c3 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 3cb49d761fa32c84ea7b6b9ba9d6c874dff2921a)
2018-02-16CSIT-932: Remove outliers form statistical calculationsTibor Frank1-0/+1
Change-Id: If9b8eaa4d997ad3516c27befb4a868a948567482 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 79bcdf2e3321ca46c07e6b49a77ce1cf5b513956)
2018-02-16CSIT-932: Remove outliers form statistical calculationsTibor Frank1-0/+4
Change-Id: I95934c92b2ebc77e5e3e7696d318ee8416f848e9 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit a0918a2c7112621563f14ba06a7aee3eaa3ac711)
2018-02-16CSIT-932: Remove outliers form statistical calculationsTibor Frank1-4/+4
Change-Id: I80d412e01eef364dfd76c1961a754e787f6ca7f3 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 2036f500644bf34aebfd3456278d0efd0b9ab79f)
2018-02-16CSIT-891: Add data sources for 1801 reportTibor Frank1-9/+17
Change-Id: Icda3dd888016a7074902ec6690cc7e874f46df2c Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 1eb21dcbe8251be7c6633f67a2747abc62a46472)
2018-02-15CSIT-891: Add data sources for 1801 reportTibor Frank2-9/+34
Change-Id: Iaf362be95b882b23fdaf478260e058b0495bbf5d Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit cfa3d9b1808826d1855bcf6c556cd26190e6f43a)
2018-02-15CSIT-891: Add data sources for 1801 reportTibor Frank1-6/+6
Change-Id: I30b48ea252d11677d74daba2516a9ffbcd39bd94 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 555d383a9e92572483c8a27a0b580c09e7fa607f)
2018-02-15Fix typo in container doc ref labelDave Wallace2-3/+3
Change-Id: I0cd7ad0a1cc4d990d739a80bd3e611ec92d8166e Signed-off-by: Dave Wallace <dwallacelf@gmail.com> (cherry picked from commit 968b6ce89e79b9b29d30a4ab361ec277668ab888)
2018-02-15CSIT-891: Add data sources for 1801 reportTibor Frank1-4/+4
Change-Id: I293e0df53a03fd18905ba59258fa66afa1299058 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 47f365e68a4392d6aed7b245e0c5c4b77270473f)
2018-02-15CSIT-891: Add data sources for 1801 reportTibor Frank1-1/+1
Change-Id: Icd9a1c7bf821c54d0297ad52dabdfb345730ddc6 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 4185e3a96ea805ed7d2b287c21eb160bff6ef856)
2018-02-15CSIT-891: Add data sources for 1801 reportCSIT-891: Add data sources for ↵Tibor Frank1-8/+8
1801 reportCSIT-891: Add data sources for 1801 reportCSIT-891: Add data sources for 1801 report Change-Id: I6334705f14c3515c0907b28abf468eef517a7dfa Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 90211327a520e31b31785870fe00badb0301d00e)
2018-02-15FIX: 10ge2p1x520-eth-l2bdscale100kmaclrn-ndrpdrdisc.robotJan Gelety1-1/+1
- tc17-9000B-4t4c-eth-l2bdscale100kmaclrn-ndrdisc Change-Id: I605f4903deb07f3a29944348cb32ac0a6747cb09 Signed-off-by: Jan Gelety <jgelety@cisco.com> (cherry picked from commit 350ae2fee52b9d1963d4456564e73d22ce9c4cd5)
2018-02-15CSIT-891: Add data sources for 1801 reportTibor Frank1-4/+4
Change-Id: I3a7ec5d40756b2179426cf031e88a0e01c2833cf Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 0da2c5e0d0bd852d50d4f9c4ecdd13d0c4effb5a)
2018-02-15CSIT-891: Add data sources for 1801 reportTibor Frank1-0/+2
Change-Id: Ib5d2fce665fbc421affde4fe1500ca8cf02613f7 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit d9bafbe42e9ca8e3b16bdab2be1583a0d81ba63c)
2018-02-14CSIT-891: Add data sources for 1801 reportTibor Frank1-1/+1
Change-Id: I1403ec2e72f2369c39033cbf3e54070d3e854bae Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 289ba96be9ecf33495e669cf09e1bd9eda8dd7cb)
2018-02-14CSIT-891: Add data sources for 1801 reportTibor Frank1-15/+274
Change-Id: I239a95dddcf2946a289fc4e91071fdbd6cc6573c Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 5ff648bac50bb669bd6f483f9515dbe78cdd42a7)
2018-02-14CSIT-891: Add data sources for 1801 reportTibor Frank1-6/+6
Change-Id: Ie47f696401ec4286ff875d7dc291251e505d0a46 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 699e20c6f043c39cf1d2ab215aae18d961de8bbe)
2018-02-14CSIT-891: Add data sources for 1801 reportTibor Frank2-26/+26
Change-Id: I269a26c67b9e567007909438c221c58312458e61 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 3cca71c6377e2c2405510127fc05c28a16e1d8d0)
2018-02-13Use vpp 18.01.1 release buildsJan Gelety2-2/+2
Change-Id: I9616a92b9386048243e0326dcccfc37bf2d03433 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-02-13CSIT-891: Add data sources for 1801 reportTibor Frank1-6/+6
Change-Id: I208ac7a2637181a0e8594845901037d31c09e602 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 0a128f671f04b19b0cad453597fec82288a657b2)
2018-02-13CSIT-891: Add data sources for 1801 reportTibor Frank1-3/+3
Change-Id: Id7b5bfef12be00dab4434a1c999c7382985b0d57 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 52eabb71d784978afa48f7ac2f5d53a228b256ec)
2018-02-13CSIT-891: Add data sources for 1801 reportTibor Frank2-21/+21
Change-Id: Ic54ad8fc093ee37d3f972fd220d63e3b20915e28 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 3b4e1e9b779fd3865714681cc224226b5804c546)