aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2018-07-26rls1807 report: fixing cross-references to tested_logical_ and ↵Maciek Konstantynowicz3-7/+9
tested_physical_topologies. Change-Id: I3273d9867abad193da361513791da2a915b9d76d Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2018-07-26CSIT-1203: Add parsing of NDRPDR testTibor Frank21-1252/+1599
Change-Id: I55be02df7f8979ad4c10b79d87f5065452a3e6e6 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-07-26rls1807 report: added section physical_testbeds.rst.Maciek Konstantynowicz5-0/+7213
Change-Id: Ic3a5a598b27614dda8f464d3fdfddb2ad0e6a163 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2018-07-26CSIT-1065 High failure rate with K8s/Ligato orchestrationPeter Mikus46-6320/+3596
- Update Ligato Bootstrap for latest changes - Update Ligato Test cases for latest vpp-agent changes - Convert TC to new format - Add Hyperthreading support Change-Id: Id7c8513b01c66ee6c652b6294ddc50bc10be8f7d Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-07-25HC Tests: do not install vpp-dev in hc2vpp-csit-verifyMarek Gradzki1-3/+3
The download_hc_build_pkgs.sh is used by hc2vpp-csit-verify and hc2vpp-csit-verify-odl jobs. These jobs download latest VPP packages and unlike other HC CSIT jobs, build hc2vpp. This patch removes vpp-dev/vpp-devel packages from the list of installed VPP packages to unify the environment with the other HC CSIT jobs. Change-Id: I28742afda05cd85675619a92fbc10f4565bdb321 Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
2018-07-25rls1807 report: moved and updated performance methodology section.Maciek Konstantynowicz4-294/+396
Change-Id: Ie67822c6c26cd42f548de542ef8a96d0a2d97f1e Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2018-07-25rls1807 report: moved and renamed s/mdr_search/mlr_search/.Maciek Konstantynowicz4-155/+25
Change-Id: Ifb97cb74c7f16592aa82dc2b1601407720985bc8 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2018-07-25Add MTU handling into perf testsPeter Mikus49-139/+134
- Add ability to configure MTU on interfaces. Put the MTU into configuration keywors for all perf testcases. Change-Id: I364b4bc26b26f2f66f350949c0aaa2a2aa675682 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-07-25rls1807 report: added section logical topologies in ↵Maciek Konstantynowicz7-221/+4687
../vpp_performance_tests/overview.rst. Change-Id: Ied5a5caf95baddf8210b773002a8a3e5dc971a2d Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2018-07-25Fail bootstrap immediately if no topology foundVratko Polak3-0/+12
Zero topologies might be found if testbeds of some type are all unavailable, or when purposedly restricted Change is verified with a wrong trigger incantation. The previous behavior enters an infinite cycle instead. Change-Id: I9764a79ed4df57c6c99746438431bf1162b7f7ea Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-07-24CSIT-1097: Migrate L2 to NDRPDR and edit MRRVratko Polak171-7331/+13511
Change-Id: I738d1794f795e1225bc9709ea2ed2cf9b06d1cf4 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-07-24CSIT-1202: Unify min_rateVratko Polak3-3/+3
20000 is the bi-directional value, suites should use 10000. Change-Id: I61d6e83f4f6b8f1f9b3dc9457896997f686a2b66 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-07-24CSIT-1097: Unify max NIC bandwidth in ip4Peter Mikus4-15/+12
Also, minor fix in ip6. Change-Id: I3a23e49d2162e34a1d2a8671ae9f7e74b832315c Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-07-24WORKAROUND: Remove broken SKX-TB out of poolPeter Mikus2-4/+0
Currently T22 and T23 are faulty Tracked in [FD.io Helpdesk #58059] Change-Id: Ib8d474400a7e109a87573e33ca73946208bbb5de Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-07-24initial CSIT-DMM test scriptssharath reddy10-0/+1144
Change-Id: I77a965751010b85d21335932baa5345a095dc4f3 Signed-off-by: sharath reddy <sharathkumarboyanapally@gmail.com> Signed-off-by: sharath <sharathkumarboyanapally@gmail.com>
2018-07-24CSIT-1097: Migrate Vts suite to NDRPDRVratko Polak15-291/+1108
Change-Id: Iaac913bb4b15d743a2e9d565e25d31c089cee3e8 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-07-24CSIT-1097: Migrate ip4 to NDRPDR and edit MRRVratko Polak154-6879/+12493
Change-Id: I9e3b2973c14f818247658a2ae34456c9fc2bae4e Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-07-24Update of VPP_STABLE_VER filesJan Gelety2-2/+2
- use new vpp ref build - ubuntu 16.04: 18.10-rc0~50-g2a03efe~b4710 - use new vpp ref build - centos7: 18.10-rc0~50_g2a03efe~b4619 Change-Id: I1effbb587c6d1bf2566501f70b8342b1b5260e8a Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-07-24CSIT-1097: Edit dpdk suites for new rate and jumboVratko Polak27-951/+876
Change-Id: If2fceb47639dc1add32184271c1e911f7920a51a Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-07-24CSIT-1097: Migrate vm_vhost to NDRPDR and edit MRRVratko Polak127-11852/+10062
Change-Id: Id5eb8fe46b219426803d3e7d135319ce5117738c Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-07-23HC Tests: remove vpp-dpdk-dkms dependencyMarek Gradzki2-12/+3
The vpp-dpdk-dkms is not needed for current VPP versions. Change-Id: I9c1a79fb940b2ba0f332792d4fc088f49f9ee191 Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
2018-07-23HC Tests: disable NSH pluginMarek Gradzki6-16/+26
Change-Id: Ic382b625e5e7201ecc2a2937c15646806c594c61 Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
2018-07-23CSIT-1204: Make new TC names backward compatible (trending)Tibor Frank4-40/+14
Change-Id: I48976a21ed022f0f8d840903db4d2415be9365cd Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-07-20CSIT-1097: Migrate ip4_tun to NDRPDR and edit MRRVratko Polak19-2380/+1358
Change-Id: I20fe137cfbbcea1e337fe6295818ea105953d006 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-07-20CSIT-1097: Migrate memif to NDRPDR and edit MRRVratko Polak26-1325/+1849
Change-Id: I22db20ec688f1a879e82549aa7aa68dafdc71b6c Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-07-19CSIT-1196: Add hsw/skx and 2n/3n to the report structureTibor Frank70-2615/+29103
Change-Id: I3a0cc2792b931798e466250e30bc30ad8a32b84e Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-07-19FIX: Increase timeout for VAT for longer API calls.Peter Mikus1-1/+1
Change-Id: Idab5e8d62a42513ddef97025625962b510c3a625 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-07-19DRAFT: FD.io CSIT high-level development plan in .txt format.Maciek Konstantynowicz1-0/+84
Provided for reviews and reference, not for tracking. Jira continuous to be used for CSIT work tracking. Change-Id: I0945f0ab910f85f41d16ae402368430ef8351ee3 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2018-07-18CSIT-1097: Crypto NDRPDR and missing MRR suitesVratko Polak34-3613/+2873
Change-Id: If40f9283ee889f85e85fad74a490252e812bbe02 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-07-18CSIT-1097: Ip6 NDRPDR and edited MRR suitesVratko Polak39-3776/+2421
Change-Id: I912017c6d1eab5530eecb2326887ffd057916ee8 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-07-18CSIT-1201 Create L2patch perf testsPeter Mikus14-0/+1364
- XL710, XXV710, X710 - 2n, 3n - all pkt.size groups - ndrpdr, mrr Change-Id: Ibb36d734cd70a0a4d07e3d177fa2477bf9bfaacd Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-07-17CSIT-1186: Add MRR and NDRPDR ip6_tunnels testsVratko Polak7-1192/+566
Remove the corresponding NDRPDRdisc tests. Change-Id: Ib46f53e97f703db19bcbcb82c3db0a7f5bb61dbf Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-07-17CSIT-1165 Create DPDK tests for 2-node topologyPeter Mikus8-0/+978
Create DPDK tests for 2-node topology - x710, xxv710 only - l3fwd, testpmd - standard pkt.size group Change-Id: I2fbf6c38a427775da9b289faaa8fe1b8c03d5527 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-07-17CSIT-1186: Add srv6 NDRPDR suitesVratko Polak20-639/+976
Delete the corresponding ndrpdrdisc suites. MRR suites are also edited, to make them less different from NDRPDR suites. Now, there is a script to re-generate testcases of selected suites. For that, resources/libraries/python/autogen is created, with Regenerator holding the most of script logic. The script looks at files matching a glob expression, reuses a "prolog", but overwites test cases with the default template and hardcoded set of testcase arguments. Also, handling of overhead size has been simplified, using new keyword Get Max Rate And Jumbo And Handle Multi Seg. Default value for search timeout is increased to 12 minutes to make timeout failures less frequent. Change-Id: I394ad61f262b3078e5ca719034b15ada48987ee0 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-07-17Update of VPP_STABLE_VER and DPDK_STABLE_VER filesJan Gelety3-3/+3
- use new vpp ref build - ubuntu 16.04: 18.07-rc0~517-g635ec3b~b4653 - use new vpp ref build - centos7: 18.07-rc0~517_g635ec3b~b4569 - use new dpdk version: 18.05-vpp2 Change-Id: I5fe34ea3603de136f8fe28fb8313533349257801 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-07-17Refactor DPDK testcases to new structurePeter Mikus29-2183/+1687
+ RXQ refactor Change-Id: Ic03a2e208b9fe5d324a5ed75a603af4cff1854a9 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-07-17CSIT-1094: Change menu styleTibor Frank22-1417/+179
Change-Id: Idff59bc73d3444700937fc473681760a947f0f41 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-07-16CSIT-1190: Update report configuration for 18.07Tibor Frank2-8/+8
Change-Id: Ie7644fe3069ad37c15754a07e049f479903ca59a Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-07-16Add L2xc/L2bd/Ip4/Ip6 2-node tests for x710Peter Mikus21-3/+2329
- CSIT-1161 Add 2-node L2XC tests - CSIT-1160 Add 2-node L2BD tests - CSIT-1157 Add 2-node IP4 tests - CSIT-1153 Add 2-node IP6 KW - CSIT-1158 Add 2-node IP6 tests Change-Id: I7c8fed7018bb355c0de73f6a8bc3a8ec80366972 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-07-16FIX: VTS suitePeter Mikus1-24/+24
Change-Id: I1766ac51ac34b63feab80329c1ae2c62fc6d8496 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-07-13Refactor perf test casesPeter Mikus312-29633/+6697
- Refactor Performance TCs due to changes in Hyperthreading and RXQ allocations. - Simplify the structure of suite to avoid large refactors in future. Change-Id: Ifb1b9719391f26745f075a900bd9fb39b6cb809c Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-07-13Add stats segment heapsize to default configPeter Mikus2-0/+10
- Scale tests (ip4, ip6) are failing due to low amount of stats segment heapsize. Change-Id: Id9b3e84d5a5c63014c17041c08c00ef6188afa5f Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-07-13Update skylake tesbed inventoryPeter Mikus12-37/+265
- Add missing topology files - Add missing topologies to bootstrap - Small fixes in ansible Change-Id: I3b9ad60a0adfae9e93e5e700279f7ade81174471 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-07-12CSIT-1168 Create bootstrap for 2-node topologyPeter Mikus2-116/+149
Update existing bootstrap to recognize 2node/3node topologies Change-Id: I2f81f9d69d824f7eea608413eac35a1598fad8c6 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-07-12FIX: PAL: input data processingTibor Frank1-0/+3
Change-Id: I295ca0a991dea8104e9794d7013be908f5461ea2 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-07-12Update Ligato to latest dev branchPeter Mikus2-37/+21
- Due to heavy modifications on vpp-agent docker images we need to change build mechanics. Change-Id: I26fb82ed1b2538335f7dc3dbb7f46ed2bb846583 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-07-12CSIT-1186: Consume MLRsearch in agreed upon wayVratko Polak16-809/+4
+ Rename search to MLRsearch in resources/libraries/python/. + Make PyPI/MLRsearch/MLRsearch a symlink to the renamed directory. + TrafficGenerator.py to import from the renamed directory/module. - No change to MLRsearch code. - Version stays at 0.1.1 to point to the latest released code. Change-Id: I4a38b0b7f8f083fbb1a93b25522560144b4ef556 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-07-11CSIT-1178: Prepare for bursty MRRVratko Polak137-182/+253
+ All suites and tests still refer to MRR instead of BMRR (or FRMOBL). + API change: Traffic should pass with maximum rate first argument got a default value, thus it needs to be moved towards the end of argument list. + Consequently, the value for it has been deleted from suites. + Test message is now compatible only with BMRR parsing. - Reporting of transmit rate is left as TODO. + Global test __init__ with new way of giving defaults to global variables. + The new keyword is put into robot_enhancements.robot resource. + Number of trials and trial duration are now configurable. - Bootstrap scripts have no support for overriding the defaults yet. Change-Id: I4b108cc9c256730e62c03fbacba0a1c314f8ae88 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-07-11CSIT-1183: Process the new and the old TC namesTibor Frank2-2/+28
Change-Id: I7fcecd7e23494e8fb0e70e7af00408eed16733e4 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-07-11Add .gitattributes to make endlines automaticVratko Polak1-0/+16
Change-Id: I9d58a5b0623c1b9d218e805fa619b324765f97a5 Signed-off-by: Vratko Polak <vrpolak@cisco.com>