aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2017-10-17FIX: Log MACIP ACL settings only if test failedJan Gelety1-1/+2
Change-Id: I6d51c662d8b23789adcd9c3d1b1e8736f71d5279 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-10-17CSIT-841 Optimize cheking k8s POD statePeter Mikus2-15/+30
Change-Id: Ie1725c0017b78945e431f493743f9a01a66e83c2 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-10-16CSIT-828: Fix the output of failed VAT executionJan Gelety2-53/+181
Change-Id: Id387bd685142dcfaa17f0236e930e40e6c0bce5a Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-10-16CSIT-841 Optimize creating of vnf-agent docker image Part IPeter Mikus7-15/+114
- Optimize building of prod_vpp_agent docker image by using dev_vpp_agent docker image pulled from dockerhub/ligato instead of building on slave. - Add detailed logs from every POD deployed in namespace. - Hardening condition for considering PODs Running. Change-Id: I9f771d6365d38fef2ec2e00ab642853e6a44ad03 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-10-12CSIT-748 vnf-agent integrationPeter Mikus23-106/+2573
CSIT-773 Implement RF keywords for k8s - Implementation of Test Suite Setup for Ligato vnf-agent testing - Implementation of KubernetesUtil for controlling kubectl - Yaml templates for L2XC topology with 1cswitch and 1cnf - Yaml templates for L2BD topology with 1cswitch and 1cnf - ligato bootstrap script for creating vnf-agent image Change-Id: Iebefde0eb984a27a0afcdf29fe549ca4edf8a61e Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-10-12FIX: Robotframework version.Peter Mikus1-1/+1
Change-Id: I7fa8fb91bb3db6b62a4215a966bef74b7ec5be84 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-10-11CSIT-811 HC Test: BGP tests - IPv4 CRUDselias9-17/+855
Tests configure BGP neighbor peers and simple routes for these peers. Change-Id: I5102986d710551a451e838d934cc9650bcd38a60 Signed-off-by: selias <samelias@cisco.com>
2017-10-11CSIT-778: Add mac-ip binding acl l2bd perf testJan Gelety16-58/+2042
Change-Id: Iaced68458b0e4070f861be7854ee428ae8ca4e13 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-10-11CSIT-672: SNAT44 multi-thread multi-core perf testsTibor Frank8-667/+1614
- re-write existing tests using templates - add 2t2c, 4t4c tests Change-Id: I7061f4cfe2304d625de6afcb85cad30695fe6faa Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-10-11CSIT-755: Presentation and analytics layerTibor Frank44-109/+11037
- CSIT-760: Configuration - real example - CSIT-774: Implementation - parse configuration - CSIT-779: Implementation - set environment - CSIT-780: Implementation - download data - CSIT-783: Implementation - debug mode - CSIT-761: Implementation - Data pre-processing - parse input files - CSIT-784: Implementation - Data pre-processing - store the data, access to data - CSIT-789: Implementation - Data pre-processing - extract Documentation of the suite - CSIT-757: Low Level Design - CSIT-788: Implementation - Data pre-processing - extract VAT history and show runtime - CSIT-785: Implementation - Data filtering - CSIT-763: Presentation - tables - CSIT-804: Presentation - files - CSIT-762: Presentation - plots - LLD: API + functional diagram - CSIT-807: Element's models - CSIT-813: Process static content - CSIT-812: Report generation - CSIT-764: Integration to CSIT - CSIT-822: Archiving - CSIT-790: Documentation - configuration od the Input data is the same as for 17.07 report Change-Id: I6fd1eb1df4af99eaf91925282cdee1c892698c59 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-10-09HC Test: mark NSH tests as expected_failingselias1-2/+2
NSH packages are not yet available in the stable.17.10 repositories Change-Id: I660dcf667e1fcf42823a08345f4b0ec3d4cba7b1 Signed-off-by: selias <samelias@cisco.com>
2017-10-09CSIT-775 HC Test: CRUD over IPv6 control-plane interfaceselias10-31/+433
Adds new test suite which accesses Honeycomb's Restconf and Netconf northbound over IPv6. This is done by sending the requests to TG where an IPv4 to IPv6 tunnel is configured to the Honeycomb DUT. Change-Id: I3b7467d8108b0da9756e632851215c66ed41bb61 Signed-off-by: selias <samelias@cisco.com>
2017-10-09FIB table add/deleteNeale Ranns21-33/+65
Change-Id: Icadb4884a1c08a2230fd4692df69310ce382ec94 Signed-off-by: Neale Ranns <nranns@cisco.com>
2017-10-09CSIT-768: Refactor Python container librariesPeter Mikus12-387/+1184
CSIT-769: Implement L2 RF keywords for container orchestration Change-Id: I7637d1ecc3a45111522b8d6c578b3f88369aff6b Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-10-05HC Test: remove log check from HC startupselias5-33/+17
- remove log check from "Check Honeycomb Startup State" keyword - fix workaround for ODL startup issue - change log level for HttpRequestError so it doesn't clutter log.html output - update EXPECTED_FAILING tags for plugin-acl and routing suites Change-Id: I7380d24801a6535bdf77505edada39ea2412e833 Signed-off-by: selias <samelias@cisco.com>
2017-10-04CSIT-830: Add framesize tags to DPDK perf testsTibor Frank4-72/+108
Change-Id: I4ba3b5bac27a95b4529b3501a24a1f2d1ba27ed6 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-10-03HC Test: increase timeout for archiving HC log fileselias3-4/+7
- add timeout parameter to ssh.scp method - increase timeout in "Archive Honeycomb Log" keyword - increase timeout for copying ODL client in setup Change-Id: I9e914d5f439fd14471b10b611efdbb6afada4c6e Signed-off-by: selias <samelias@cisco.com>
2017-09-28HC Test: Fix intermittent failures of HC startupselias14-166/+222
- rework "check Honeycomb startup state" keyword - increase timeout value for startup - add separators to Honeycomb log file between test suites - other minor fixes: - remove usused import from NAT suite - fix loop in ICMPv6 ND proxy traffic script - add teardown to LISP cases - update prerequisites for sub-interface SPAN test Change-Id: I2f714ffc1d2e8435d3abe690d8bd15099e071c9a Signed-off-by: selias <samelias@cisco.com>
2017-09-28FIX: Vhost tests waiting for VirtualEthernet UPPeter Mikus1-6/+0
Due to the change in VPP #8472 When changing the admin state of a vhost-user interface, do not put it in link-up mode if the interface is not actually ready. We have to remove "All Vpp Interfaces Ready Wait" for VirtualEthernet interfaces. Change-Id: I70d60b9f54a75b18b179f3315b636b763962acdd Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-09-27HC Test: update ODL startup in hc2vpp jobsselias5-46/+65
- mountpoint configuration through controller-config is deprecated. Use the new method through odl-netconf-topology feature. Change-Id: I1297622db7ab6a3853b3c97ab7f59c31b4269b6d Signed-off-by: selias <samelias@cisco.com>
2017-09-25Add memif to TEST_TAG casesJan Gelety1-0/+17
- implement possibility to manually triger memif perf tests in case of csit as well as vpp patch Change-Id: I6bec350a496ba138bcb8ffb8da01c81672187bac Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-09-22CSIT-796: l2bd-memif perf testsJan Gelety3-5/+285
Change-Id: Ic714fa7baec49dcba1a8eb6a578183c6771e3493 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-09-22Update of VPP_STABLE_VER filesJan Gelety2-2/+2
- we need to use the latest vpp build were vpp runs correctly in lxc/docker with dpdk plugin disabled in CSIT - use new vpp ref build - ubuntu 16.04: 17.10-rc0~334-gce41a5c~b2870_amd64 - use new vpp ref build - centos7: 17.10-rc0~334_gce41a5c~b2867.x86_64 Change-Id: I87f306d0d7f6e78db8670a1969ae1a8e66b92c8a Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-09-18Ignore unexpected ICMPv6 Neighbor Discovery - Neighbor Solicitation packetsJan Gelety22-424/+631
We need to adapt all functional traffic scripts related to functional IPv6 tests to ingore receiving of unexpected ICMPv6ND_NS (ICMPv6 Neighbor Discovery - Neighbor Solicitation) packets that are sent automatically and we cannot avoid to receive them. The reason is to prevent false negative test results in case of csit functional tests that could block creation of new operational branch (csit weekly jobs), usage of new vpp builds (csit semiweekly jobs) and merging patches - csit as well as vpp. Change-Id: I43c90e7c766762fa769a81661338759a11b401a1 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-09-18Update of VPP_STABLE_VER files and DPDK_STABLE_VER fileJan Gelety3-3/+3
- use new vpp ref build - ubuntu 16.04: 17.10-rc0~337-g2f9b0c0~b2873_amd64 - use new vpp ref build - centos7: 17.10-rc0~337_g2f9b0c0~b2870.x86_64 - use new dpdk version> 17.08-vpp1 - builds tested by semiweekly jobs: https://jenkins.fd.io/view/csit/job/csit-vpp-verify-master-ubuntu1604-semiweekly/73/ https://jenkins.fd.io/view/csit/job/csit-vpp-verify-master-centos7-semiweekly/73/ Change-Id: I20245e50f5acf93af5d2f2bfae0307f7774f0c3b Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-09-08CSIT-665: Re-write L1 robot keywords in pythonDasa Simkova8-108/+148
Change-Id: Iddd823375ddd17b9abd5f02ee3aea3bfcb625149 Signed-off-by: Dasa Simkova <dspropagacie@gmail.com>
2017-09-06HC Test: re-enable NSH tests, minor fixesselias9-61/+43
NSH plugin was fixed in https://gerrit.fd.io/r/8218 - updated lispGPE test data - added missing teardown to multi-IP traffic test - marked L2-fib update revert case as failing Change-Id: I5cf8c718e808d5d8cb69e2f769c829c868bf9924 Signed-off-by: selias <samelias@cisco.com>
2017-09-04Update of VPP_STABLE_VER filesJan Gelety2-2/+2
- use new vpp ref build - ubuntu 16.04: 17.10-rc0~263-gedfa2fd~b2799_amd64 - use new vpp ref build - centos7: 17.10-rc0~263_gedfa2fd~b2796.x86_64 - builds tested by semiweekly jobs: https://jenkins.fd.io/view/csit/job/csit-vpp-verify-master-ubuntu1604-semiweekly/69/ https://jenkins.fd.io/view/csit/job/csit-vpp-verify-master-centos7-semiweekly/69/ Change-Id: I510d288a4a5444f980769d7fd13ab1ff46d227a5 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-09-04CSIT-786 L2FIB scale testingPeter Mikus11-76/+2320
L2FIB scale testing for 10k, 100k, 1m FIB entries ./l2: 10ge2p1x520-eth-l2bdscale10kmaclrn-ndrpdrdisc.robot 10ge2p1x520-eth-l2bdscale100kmaclrn-ndrpdrdisc.robot 10ge2p1x520-eth-l2bdscale1mmaclrn-ndrpdrdisc.robot 10ge2p1x520-eth-l2bdscale10kmaclrn-eth-2vhostvr1024-1vm-cfsrr1-ndrpdrdisc 10ge2p1x520-eth-l2bdscale100kmaclrn-eth-2vhostvr1024-1vm-cfsrr1-ndrpdrdisc 10ge2p1x520-eth-l2bdscale1mmaclrn-eth-2vhostvr1024-1vm-cfsrr1-ndrpdrdisc Change-Id: I7e3884bd5ab5294c289030a3465ec5b6def83cf7 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-09-03Update T-rex to v2.29Peter Mikus5-5/+5
Change-Id: Id60525182cbe5870f40aebf165e8bd86c101d267 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-08-28FIX: SNAT -> NAT renaming of APIPeter Mikus31-479/+459
- Based on https://gerrit.fd.io/r/#/c/8146/ Change-Id: I774483c7e2b419a9b9b6be78812ecf53a5c91eab Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-08-28Fix: Do not validate LXC imagePeter Mikus1-2/+3
Change-Id: I476f463ad7dd91f1d80a1e4b537a2cb3dd4ddee5 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-08-28Update of VPP_STABLE_VER filesPeter Mikus2-2/+2
- use new vpp ref build - ubuntu 16.04: vpp-17.10-rc0~206-g5f22f4d~b2740_amd64-deb - build tested by semiweekly job: https://jenkins.fd.io/view/csit/job/csit-vpp-verify-master-ubuntu1604-semiweekly/???/ NOTE: centos7 build not updated because of issue with deletion of tap interface Change-Id: I1df4c10f40d983952c1dad4a94f2dcdb2534c00e Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-08-25Update T-rex to v2.28Peter Mikus5-5/+5
Change-Id: I506589c3785eec3a2eaa9fdb32bfc3375388d6f4 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-08-25HC Test: Disable NSH plugin installation and testsselias3-11/+15
- VPP refuses to start with vpp-nsh-plugin installed Change-Id: If1ca45295c63094d2542fc829b8eae7dc0e4977c Signed-off-by: selias <samelias@cisco.com>
2017-08-16CSIT-777: L2 keywords for MACIP ACL testsJan Gelety3-10/+187
Change-Id: I678d87770405105555ccc30ce0003f704d7ca82e Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-08-16CSIT-770 Installation of prerequisites on physical hostsPeter Mikus3-5/+46
- Update ansible to install kubernetes and docker Change-Id: Ibf57d4fa697f7c9b58f2e4925387b0c4e8b67274 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-08-15HC Test: cleanup test failuresselias5-33/+49
- have unnumbered interface cases use a real interface instead of local0 - add EXPECTED_FAILING tag and Jira link to known failing test cases Change-Id: I8bc0f4a74ea1949289a3f12dd54168acdf9edc39 Signed-off-by: selias <samelias@cisco.com>
2017-08-14CSIT-777: L1 keywords for MACIP ACL testsJan Gelety6-5/+143
Change-Id: I90eb824cbabaaece6798812268177ad9bd4eff65 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-08-14Update of VPP_STABLE_VER filesJan Gelety1-1/+1
- use new vpp ref build - ubuntu 16.04: 17.10-rc0~154-gb2215d6~b2690_amd64 - build tested by semiweekly job: https://jenkins.fd.io/view/csit/job/csit-vpp-verify-master-ubuntu1604-semiweekly/63/ NOTE: centos7 build not updated because of issue with deletion of tap interface Change-Id: I937ea3d106f7e62ccd977bcd3114b17326912e82 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-08-10Fix: Memif API changePeter Mikus1-4/+4
Due to changes in API in latest VPP, Memif/LXC test are failing. This patch is supposed to change Memif config in LXC. Change-Id: I5c3844fd7559eba948bcb5619c8969611eb200c2 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-08-09CSIT-767: Add acl 64B 4t4c perf testsJan Gelety72-0/+1728
Change-Id: Id1b187c195c955d0e533d8d6864fff6a3fa8332e Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-08-09CSIT-611: HC Test: Lisp suite updates + LispGPEselias14-144/+1678
- added LispGPE test suite - added IPv6 tests to Lisp suite - added traffic tests to Lisp suite Change-Id: I3b699149cd73ebf5856072d3f26e98a370dbfc4b Signed-off-by: selias <samelias@cisco.com>
2017-08-08HC Test: re-enable VxLAN GPE test suiteselias1-3/+9
VPP crash partially fixed in https://gerrit.fd.io/r/7267 Still occuring in IPv6 case. Change-Id: Iff6cd99098c6273fc56940b475e5262889076775 Signed-off-by: selias <samelias@cisco.com>
2017-08-07HC Test: test data updates for HC bump to ODL-Carbon dependenciesselias3-4/+4
related Honeycomb change: https://gerrit.fd.io/r/6924 Change-Id: I290a65428c8d64304be6e35dad5d21755a925f86 Signed-off-by: selias <samelias@cisco.com>
2017-08-07Update of VPP_STABLE_VER filesJan Gelety2-2/+2
- use new vpp ref build - ubuntu 16.04: 17.10-rc0~121-g63a46fc~b2656_amd64 - use new vpp ref build - centos7: 17.10-rc0~121_g63a46fc~b2653.x86_64 - builds tested by semiweekly jobs: https://jenkins.fd.io/view/csit/job/csit-vpp-verify-master-ubuntu1604-semiweekly/61/ https://jenkins.fd.io/view/csit/job/csit-vpp-verify-master-centos7-semiweekly/61/ Change-Id: Ifea4b98550c28619289a170508a20e496aaa30b9 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-08-07Use 100kpps step for ACL 64B perf testsJan Gelety72-576/+576
ACL 64B tests take a long time. Usage of 100kpps will provide results with adequate accurancy and test exectuion time. Change-Id: I6818963f3ce16b9aaae72cf579294f87d10a24a9 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-08-02Fix: Release report PDF generation bugPeter Mikus1-5/+3
QXcbConnection: Could not connect to display Change-Id: Ie6e99f7dc3a0372768955c28f32c90c542e0be78 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-08-02CSIT-744 Update report content for proper parsingPeter Mikus22-2930/+341
Follow the good practices for formatting. Update the content of release report RST files to use the proper directives like :cite:, :footnote:, :abbr:, :captions: etc.With these markings we will be able to format output in proper way and style it in various sphinx output builders. Change-Id: Ibbb538d43c3bd364a6acdcc990097a477f49de00 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-08-02CSIT-742: Add manual trigger for ACL perf testsJan Gelety1-0/+9
Impelmenting needed change in bootstrap-verify-perf.sh file to provide manual trigger that will allow to run 1T1C (1 core, 1 thread) and 2T2C (2 core, 2 threads) ACL tests per VPP patch when required. Change-Id: I3d9cc403ca8ea90da23aca524c4b4ddbf26eb217 Signed-off-by: Jan Gelety <jgelety@cisco.com>