aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2017-10-23Add vpp perf jobs to reportTibor Frank1-3362/+3418
Change-Id: Ieb041b31dc18b03a865c7128db1f32a2c5db2c0b Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit ab1a1e7e8f7023b9e75a9e036cf8629a8ec817b1)
2017-10-23Report: CSIT Framework DocumentationTibor Frank11-971/+2860
Change-Id: I2eba1183a5acdd1fb34efab16fc5c89e38dedb14 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 5d31c77092fd784e21cd50d604be30924ec9a7c5)
2017-10-23FIX: use correct IF name in Vpp Route Add in case of multi-VMs configJan Gelety1-4/+4
Change-Id: Iab5a6db1eac11798e2a3ec56f7d68043f6c8c2ab Signed-off-by: Jan Gelety <jgelety@cisco.com> (cherry picked from commit 04f2c49d50e242ac13aca9938c5a90a2ec012b7f)
2017-10-23FIX: IPSec tunnel interfaceJan Gelety6-100/+136
- add following line per interface tunnel: set int unnum <ipsec> use <interface> Change-Id: I28c033a48b6c7d84bc8afc14170ad28cbe62f6c3 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-10-23CSIT-806 Container Orchestration in CSIT - Low Level DesignPeter Mikus2-0/+569
Change-Id: I993f1a4d0ae6332d2c7f9b170277bc726a1826cf Signed-off-by: Peter Mikus <pmikus@cisco.com> Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> (cherry picked from commit b52c43bd354ee658d4f955995a08073a1338e898)
2017-10-20Rename all container based test following name conventionsPeter Mikus14-94/+127
Change-Id: I84f6da2bede47e7ae35e6b4911d425d2402dbd1b Signed-off-by: Peter Mikus <pmikus@cisco.com> (cherry picked from commit fd1b55aaeecc2e68b0855a389bd7c14671648c7a)
2017-10-20Fix: PDF - Add dpdk plotsTibor Frank1-1/+3
Change-Id: I0c76bfda6e84db4aee62b097282b9cf46fe51270 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 7cfeed26cbc486a4e6898dc7696e0bd8300b3a04)
2017-10-20Add csit-dpdk-perf-1710-all/2, 3 to testing dataTibor Frank1-760/+764
Change-Id: I5e8cce83f179729df61afd506932310aba44e898 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 2785bf138509da1957714fd97e20be0a9a082e5e)
2017-10-20Generate pdfTibor Frank1-2/+2
Change-Id: I47ff419c8b9309cc73238c79acb3b395144929cd Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit f71a7f99e8ba0111ae2d1bf9cfadb1afdeb79e4c)
2017-10-19Update of VPP_STABLE_VER and DPDK_STABLE_VER filesJan Gelety3-3/+3
- use new vpp ref build - ubuntu 16.04: 17.10-rc2~12-gc47652c~b42_amd64 - use new vpp ref build - centos7: 17.10-rc2~12_gc47652c~b42.x86_64 - use new dpdk version: 17.08-vpp2 They are needed to successfully run IPSec perf tests. Change-Id: I3207b711404625d742c745932968e2eb68a76baf Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-10-19Update the dpdk version to 17.08Peter Mikus8-10/+12
Change-Id: Idcf705d40f45c10c3c4dee694a80202d576b8026 Signed-off-by: Peter Mikus <pmikus@cisco.com> (cherry picked from commit 117d3c4991b412a0756daadeee0a68edb0c4cf26)
2017-10-19PAL: do not generate pdfTibor Frank2-35/+35
Change-Id: Iab192d78491db9f8909ea708cf5dd588030f0b30 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 6f1348b3bcc125407d1ea03e73525c599385203d)
2017-10-19PAL test runsTibor Frank2-4778/+4190
Change-Id: I8232b998fd00b5a09e7f9b72d4acb0f1140aade6 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit bfd8d30a8a6928a431594837823686bd982f147c)
2017-10-19HC Test: Fix expected error when ACL table should be emptyselias1-1/+1
Due to VATExecutor changes in https://gerrit.fd.io/r/8679 Change-Id: Iaecf6ff7b2562ff111a3afbce0ecbb2df00c62a9 Signed-off-by: selias <samelias@cisco.com>
2017-10-19FIX: apply changes implemented for FIB settingsJan Gelety5-160/+281
Change-Id: I00c3407f4324e282c438cb8fcd44470c331089c5 Signed-off-by: Jan Gelety <jgelety@cisco.com> (cherry picked from commit 9d62c4fa8023daaf4aa6426b9648279df51dad03)
2017-10-18CSIT-834: Add HLD pictureTibor Frank3-1116/+1560
Change-Id: Ie64874c5555794ee70276f2a65d436337102b465 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit fec161451268791e57e5dfe76dbaedd897e99aae)
2017-10-18CSIT-836: PDF format: Improvements in pdf layoutTibor Frank7-38/+148
CSIT-837: Scope of pdf version Change-Id: Idfc9c04274c6635fbef14f87147665d31cfd7352 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 9a89069be33f11879f8307e5b774c6e1e7afa398)
2017-10-18CSIT-748 Add K8S 2memif-2vnf topologiesPeter Mikus7-16/+1179
Change-Id: I23e118bf9fc9cfd638ac3ec0589f2ced14cc240c Signed-off-by: Peter Mikus <pmikus@cisco.com> (cherry picked from commit 59eb880b002cc73cc6e8834814c2da34b2ddfd54)
2017-10-18FIX: Log MACIP ACL settings only if test failedJan Gelety1-1/+2
Change-Id: I6d51c662d8b23789adcd9c3d1b1e8736f71d5279 Signed-off-by: Jan Gelety <jgelety@cisco.com> (cherry picked from commit f3e80e15bfa2292e635c4ab8f5496d5eab46a350)
2017-10-17CSIT-841 Optimize cheking k8s POD statePeter Mikus2-15/+30
Change-Id: Ie1725c0017b78945e431f493743f9a01a66e83c2 Signed-off-by: Peter Mikus <pmikus@cisco.com> (cherry picked from commit b015ecf08aba9659d0261dfa6eb0da9ab4950b92)
2017-10-16CSIT-828: Fix the output of failed VAT executionJan Gelety2-53/+181
Change-Id: Id387bd685142dcfaa17f0236e930e40e6c0bce5a Signed-off-by: Jan Gelety <jgelety@cisco.com> (cherry picked from commit 4d2e646f21659a6540312779190b03aed91395d5)
2017-10-16Update of VPP_STABLE_VER filesJan Gelety2-2/+2
- use new vpp ref build - ubuntu 16.04: 17.10-rc2~2-g5e62e58~b32_amd64 - use new vpp ref build - centos7: 17.10-rc2~2_g5e62e58~b32.x86_64 - builds tested by semiweekly jobs: https://jenkins.fd.io/view/csit/job/csit-vpp-verify-1710-ubuntu1604-semiweekly/1/ https://jenkins.fd.io/view/csit/job/csit-vpp-verify-1710-centos7-semiweekly/1/ Change-Id: I7be08d71e93281496ba31d9b08c73c52bcf28d36 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-10-16CSIT-841 Optimize creating of vnf-agent docker image Part IPeter Mikus7-15/+114
- Optimize building of prod_vpp_agent docker image by using dev_vpp_agent docker image pulled from dockerhub/ligato instead of building on slave. - Add detailed logs from every POD deployed in namespace. - Hardening condition for considering PODs Running. Change-Id: I9f771d6365d38fef2ec2e00ab642853e6a44ad03 Signed-off-by: Peter Mikus <pmikus@cisco.com> (cherry picked from commit fcaf06abdd27a3a6ef18de14ce3d1dab2c75a8c9)
2017-10-12CSIT-748 vnf-agent integrationPeter Mikus23-106/+2573
CSIT-773 Implement RF keywords for k8s - Implementation of Test Suite Setup for Ligato vnf-agent testing - Implementation of KubernetesUtil for controlling kubectl - Yaml templates for L2XC topology with 1cswitch and 1cnf - Yaml templates for L2BD topology with 1cswitch and 1cnf - ligato bootstrap script for creating vnf-agent image Change-Id: Iebefde0eb984a27a0afcdf29fe549ca4edf8a61e Signed-off-by: Peter Mikus <pmikus@cisco.com> (cherry picked from commit 9a261ea61549fc6a5c23369d2e236b002dc35038)
2017-10-12Set correct paths to vpp stable/1710 and use vpp stable/1710 buildsJan Gelety10-10/+10
- do not use vpp-debuginfo rpm package as it is not available on Nexus for vpp stable/1710 Change-Id: I756bb238fc2ee568c1bc2d8700f904e6b6a6ca6d Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-10-12FIX: Robotframework version.Peter Mikus1-1/+1
Change-Id: I7fa8fb91bb3db6b62a4215a966bef74b7ec5be84 Signed-off-by: Peter Mikus <pmikus@cisco.com> (cherry picked from commit f2573eccd38609fbc3d44f1fb9c706d08e50d49c)
2017-10-11CSIT-811 HC Test: BGP tests - IPv4 CRUDselias9-17/+855
Tests configure BGP neighbor peers and simple routes for these peers. Change-Id: I5102986d710551a451e838d934cc9650bcd38a60 Signed-off-by: selias <samelias@cisco.com>
2017-10-11CSIT-778: Add mac-ip binding acl l2bd perf testJan Gelety16-58/+2042
Change-Id: Iaced68458b0e4070f861be7854ee428ae8ca4e13 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-10-11CSIT-672: SNAT44 multi-thread multi-core perf testsTibor Frank8-667/+1614
- re-write existing tests using templates - add 2t2c, 4t4c tests Change-Id: I7061f4cfe2304d625de6afcb85cad30695fe6faa Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-10-11CSIT-755: Presentation and analytics layerTibor Frank44-109/+11037
- CSIT-760: Configuration - real example - CSIT-774: Implementation - parse configuration - CSIT-779: Implementation - set environment - CSIT-780: Implementation - download data - CSIT-783: Implementation - debug mode - CSIT-761: Implementation - Data pre-processing - parse input files - CSIT-784: Implementation - Data pre-processing - store the data, access to data - CSIT-789: Implementation - Data pre-processing - extract Documentation of the suite - CSIT-757: Low Level Design - CSIT-788: Implementation - Data pre-processing - extract VAT history and show runtime - CSIT-785: Implementation - Data filtering - CSIT-763: Presentation - tables - CSIT-804: Presentation - files - CSIT-762: Presentation - plots - LLD: API + functional diagram - CSIT-807: Element's models - CSIT-813: Process static content - CSIT-812: Report generation - CSIT-764: Integration to CSIT - CSIT-822: Archiving - CSIT-790: Documentation - configuration od the Input data is the same as for 17.07 report Change-Id: I6fd1eb1df4af99eaf91925282cdee1c892698c59 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-10-09HC Test: mark NSH tests as expected_failingselias1-2/+2
NSH packages are not yet available in the stable.17.10 repositories Change-Id: I660dcf667e1fcf42823a08345f4b0ec3d4cba7b1 Signed-off-by: selias <samelias@cisco.com>
2017-10-09CSIT-775 HC Test: CRUD over IPv6 control-plane interfaceselias10-31/+433
Adds new test suite which accesses Honeycomb's Restconf and Netconf northbound over IPv6. This is done by sending the requests to TG where an IPv4 to IPv6 tunnel is configured to the Honeycomb DUT. Change-Id: I3b7467d8108b0da9756e632851215c66ed41bb61 Signed-off-by: selias <samelias@cisco.com>
2017-10-09FIB table add/deleteNeale Ranns21-33/+65
Change-Id: Icadb4884a1c08a2230fd4692df69310ce382ec94 Signed-off-by: Neale Ranns <nranns@cisco.com>
2017-10-09CSIT-768: Refactor Python container librariesPeter Mikus12-387/+1184
CSIT-769: Implement L2 RF keywords for container orchestration Change-Id: I7637d1ecc3a45111522b8d6c578b3f88369aff6b Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-10-05HC Test: remove log check from HC startupselias5-33/+17
- remove log check from "Check Honeycomb Startup State" keyword - fix workaround for ODL startup issue - change log level for HttpRequestError so it doesn't clutter log.html output - update EXPECTED_FAILING tags for plugin-acl and routing suites Change-Id: I7380d24801a6535bdf77505edada39ea2412e833 Signed-off-by: selias <samelias@cisco.com>
2017-10-04CSIT-830: Add framesize tags to DPDK perf testsTibor Frank4-72/+108
Change-Id: I4ba3b5bac27a95b4529b3501a24a1f2d1ba27ed6 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-10-03HC Test: increase timeout for archiving HC log fileselias3-4/+7
- add timeout parameter to ssh.scp method - increase timeout in "Archive Honeycomb Log" keyword - increase timeout for copying ODL client in setup Change-Id: I9e914d5f439fd14471b10b611efdbb6afada4c6e Signed-off-by: selias <samelias@cisco.com>
2017-09-28HC Test: Fix intermittent failures of HC startupselias14-166/+222
- rework "check Honeycomb startup state" keyword - increase timeout value for startup - add separators to Honeycomb log file between test suites - other minor fixes: - remove usused import from NAT suite - fix loop in ICMPv6 ND proxy traffic script - add teardown to LISP cases - update prerequisites for sub-interface SPAN test Change-Id: I2f714ffc1d2e8435d3abe690d8bd15099e071c9a Signed-off-by: selias <samelias@cisco.com>
2017-09-28FIX: Vhost tests waiting for VirtualEthernet UPPeter Mikus1-6/+0
Due to the change in VPP #8472 When changing the admin state of a vhost-user interface, do not put it in link-up mode if the interface is not actually ready. We have to remove "All Vpp Interfaces Ready Wait" for VirtualEthernet interfaces. Change-Id: I70d60b9f54a75b18b179f3315b636b763962acdd Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-09-27HC Test: update ODL startup in hc2vpp jobsselias5-46/+65
- mountpoint configuration through controller-config is deprecated. Use the new method through odl-netconf-topology feature. Change-Id: I1297622db7ab6a3853b3c97ab7f59c31b4269b6d Signed-off-by: selias <samelias@cisco.com>
2017-09-25Add memif to TEST_TAG casesJan Gelety1-0/+17
- implement possibility to manually triger memif perf tests in case of csit as well as vpp patch Change-Id: I6bec350a496ba138bcb8ffb8da01c81672187bac Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-09-22CSIT-796: l2bd-memif perf testsJan Gelety3-5/+285
Change-Id: Ic714fa7baec49dcba1a8eb6a578183c6771e3493 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-09-22Update of VPP_STABLE_VER filesJan Gelety2-2/+2
- we need to use the latest vpp build were vpp runs correctly in lxc/docker with dpdk plugin disabled in CSIT - use new vpp ref build - ubuntu 16.04: 17.10-rc0~334-gce41a5c~b2870_amd64 - use new vpp ref build - centos7: 17.10-rc0~334_gce41a5c~b2867.x86_64 Change-Id: I87f306d0d7f6e78db8670a1969ae1a8e66b92c8a Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-09-18Ignore unexpected ICMPv6 Neighbor Discovery - Neighbor Solicitation packetsJan Gelety22-424/+631
We need to adapt all functional traffic scripts related to functional IPv6 tests to ingore receiving of unexpected ICMPv6ND_NS (ICMPv6 Neighbor Discovery - Neighbor Solicitation) packets that are sent automatically and we cannot avoid to receive them. The reason is to prevent false negative test results in case of csit functional tests that could block creation of new operational branch (csit weekly jobs), usage of new vpp builds (csit semiweekly jobs) and merging patches - csit as well as vpp. Change-Id: I43c90e7c766762fa769a81661338759a11b401a1 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-09-18Update of VPP_STABLE_VER files and DPDK_STABLE_VER fileJan Gelety3-3/+3
- use new vpp ref build - ubuntu 16.04: 17.10-rc0~337-g2f9b0c0~b2873_amd64 - use new vpp ref build - centos7: 17.10-rc0~337_g2f9b0c0~b2870.x86_64 - use new dpdk version> 17.08-vpp1 - builds tested by semiweekly jobs: https://jenkins.fd.io/view/csit/job/csit-vpp-verify-master-ubuntu1604-semiweekly/73/ https://jenkins.fd.io/view/csit/job/csit-vpp-verify-master-centos7-semiweekly/73/ Change-Id: I20245e50f5acf93af5d2f2bfae0307f7774f0c3b Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-09-08CSIT-665: Re-write L1 robot keywords in pythonDasa Simkova8-108/+148
Change-Id: Iddd823375ddd17b9abd5f02ee3aea3bfcb625149 Signed-off-by: Dasa Simkova <dspropagacie@gmail.com>
2017-09-06HC Test: re-enable NSH tests, minor fixesselias9-61/+43
NSH plugin was fixed in https://gerrit.fd.io/r/8218 - updated lispGPE test data - added missing teardown to multi-IP traffic test - marked L2-fib update revert case as failing Change-Id: I5cf8c718e808d5d8cb69e2f769c829c868bf9924 Signed-off-by: selias <samelias@cisco.com>
2017-09-04Update of VPP_STABLE_VER filesJan Gelety2-2/+2
- use new vpp ref build - ubuntu 16.04: 17.10-rc0~263-gedfa2fd~b2799_amd64 - use new vpp ref build - centos7: 17.10-rc0~263_gedfa2fd~b2796.x86_64 - builds tested by semiweekly jobs: https://jenkins.fd.io/view/csit/job/csit-vpp-verify-master-ubuntu1604-semiweekly/69/ https://jenkins.fd.io/view/csit/job/csit-vpp-verify-master-centos7-semiweekly/69/ Change-Id: I510d288a4a5444f980769d7fd13ab1ff46d227a5 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-09-04CSIT-786 L2FIB scale testingPeter Mikus11-76/+2320
L2FIB scale testing for 10k, 100k, 1m FIB entries ./l2: 10ge2p1x520-eth-l2bdscale10kmaclrn-ndrpdrdisc.robot 10ge2p1x520-eth-l2bdscale100kmaclrn-ndrpdrdisc.robot 10ge2p1x520-eth-l2bdscale1mmaclrn-ndrpdrdisc.robot 10ge2p1x520-eth-l2bdscale10kmaclrn-eth-2vhostvr1024-1vm-cfsrr1-ndrpdrdisc 10ge2p1x520-eth-l2bdscale100kmaclrn-eth-2vhostvr1024-1vm-cfsrr1-ndrpdrdisc 10ge2p1x520-eth-l2bdscale1mmaclrn-eth-2vhostvr1024-1vm-cfsrr1-ndrpdrdisc Change-Id: I7e3884bd5ab5294c289030a3465ec5b6def83cf7 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-09-03Update T-rex to v2.29Peter Mikus5-5/+5
Change-Id: Id60525182cbe5870f40aebf165e8bd86c101d267 Signed-off-by: Peter Mikus <pmikus@cisco.com>