aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2018-07-27FIX: Interface up handlingPeter Mikus19-72/+64
- Increase timeout when trying to check interface (this is useful if there are multiple interfaces and dump command take more than TIMEOUT/NR_IF which is happening quite often). - Reverse the order of applying MTU and interface UP to try to prevent API overload during interface initialization phase. Change-Id: I4e8623963d15b3c0d202172b4c58c43a972bb9cb Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-07-27CSIT-1213: Add 2n/3n-skx to Test Oper DataTibor Frank22-166/+229
Change-Id: I217cc8dc6691c2a443460bd4e51ea96c4ec82806 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit c7b2541ae5ff737691547daef2e4b25f9d232eba)
2018-07-27CSIT-1212: Add 2n/3n-skx to Test ConfigurationTibor Frank15-59/+226
Change-Id: I4be3e2072dbc1f1f27b840de1c04a2374944f724 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit dd1a88208be79852a99dc673411fe1ab0760a051)
2018-07-27CSIT-1211: Add 2n/3n-skx to detailed resultsTibor Frank23-325/+737
Change-Id: Ibfe838b355fa15d0f89ea3122f2d042af989b51d Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 16ee14dd9116563422d379c18c9a2ca8e64a07a8)
2018-07-26rls1807 report: fixing cross-references to tested_logical_ and ↵Maciek Konstantynowicz3-7/+9
tested_physical_topologies. Change-Id: I3273d9867abad193da361513791da2a915b9d76d Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> (cherry picked from commit 2610ac288d0bbcd30d3a28c92068fb647034172b)
2018-07-26CSIT-1097: Edit dpdk suites for new rate and jumboVratko Polak27-951/+876
Change-Id: If2fceb47639dc1add32184271c1e911f7920a51a Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit 11abbc5f27ec2d2036a36e0e427afb9e2d5ffe59)
2018-07-26CSIT-1203: Add parsing of NDRPDR testTibor Frank21-1252/+1599
Change-Id: I55be02df7f8979ad4c10b79d87f5065452a3e6e6 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit eb5271b56cb94711420a1eb7372b0f4d5f275a40)
2018-07-26rls1807 report: added section physical_testbeds.rst.Maciek Konstantynowicz5-0/+7213
Change-Id: Ic3a5a598b27614dda8f464d3fdfddb2ad0e6a163 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> (cherry picked from commit be3c126b04b89c1cacdfda2d82bad6e002d5135d)
2018-07-26CSIT-1065 High failure rate with K8s/Ligato orchestrationPeter Mikus46-6320/+3596
- Update Ligato Bootstrap for latest changes - Update Ligato Test cases for latest vpp-agent changes - Convert TC to new format - Add Hyperthreading support Change-Id: Id7c8513b01c66ee6c652b6294ddc50bc10be8f7d Signed-off-by: Peter Mikus <pmikus@cisco.com> (cherry picked from commit 1bb5beef46104f8b5bfb844ace3633ed40fc3915)
2018-07-25HC Tests: remove vpp-dpdk-dkms dependencyMarek Gradzki2-12/+3
The vpp-dpdk-dkms is not needed for current VPP versions. Change-Id: I9c1a79fb940b2ba0f332792d4fc088f49f9ee191 Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
2018-07-25rls1807 report: moved and updated performance methodology section.Maciek Konstantynowicz4-294/+396
Change-Id: Ie67822c6c26cd42f548de542ef8a96d0a2d97f1e Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> (cherry picked from commit 064f852eeab1b0341c374586a847729c6980ffbc)
2018-07-25rls1807 report: moved and renamed s/mdr_search/mlr_search/.Maciek Konstantynowicz4-155/+25
Change-Id: Ifb97cb74c7f16592aa82dc2b1601407720985bc8 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> (cherry picked from commit dab4b820603978813ab931ac91cf1bee9d8b20a7)
2018-07-25Add MTU handling into perf testsPeter Mikus49-139/+134
- Add ability to configure MTU on interfaces. Put the MTU into configuration keywors for all perf testcases. Change-Id: I364b4bc26b26f2f66f350949c0aaa2a2aa675682 Signed-off-by: Peter Mikus <pmikus@cisco.com> (cherry picked from commit cdf557ef070d004617ede4fc5a47dd6064d1c946)
2018-07-25rls1807 report: added section logical topologies in ↵Maciek Konstantynowicz7-221/+4687
../vpp_performance_tests/overview.rst. Change-Id: Ied5a5caf95baddf8210b773002a8a3e5dc971a2d Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> (cherry picked from commit 974d52d1976f802c99738712bbfe56e16d56d650)
2018-07-25Fail bootstrap immediately if no topology foundVratko Polak3-0/+12
Zero topologies might be found if testbeds of some type are all unavailable, or when purposedly restricted Change is verified with a wrong trigger incantation. The previous behavior enters an infinite cycle instead. Change-Id: I9764a79ed4df57c6c99746438431bf1162b7f7ea Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit faadf83599b8640c9235c38a4ab57c7adfb9eb96)
2018-07-25Update VPP paths and versionsJan Gelety4-4/+4
Change-Id: I8c5dae13beb58e15600f89719dcc1ec60a9e3601 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-07-25CSIT-1097: Migrate L2 to NDRPDR and edit MRRVratko Polak171-7331/+13511
Change-Id: I738d1794f795e1225bc9709ea2ed2cf9b06d1cf4 Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit 5d6479beed22bb3d14a39e9c130946959c13f03e)
2018-07-24CSIT-1202: Unify min_rateVratko Polak3-3/+3
20000 is the bi-directional value, suites should use 10000. Change-Id: I61d6e83f4f6b8f1f9b3dc9457896997f686a2b66 Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit c557187e2bcb86e610382726c5c7c00bf7a0217c)
2018-07-24CSIT-1097: Unify max NIC bandwidth in ip4Peter Mikus4-15/+12
Also, minor fix in ip6. Change-Id: I3a23e49d2162e34a1d2a8671ae9f7e74b832315c Signed-off-by: Vratko Polak <vrpolak@cisco.com> Signed-off-by: Peter Mikus <pmikus@cisco.com> (cherry picked from commit 491fea98425d47eb02a5581666815557c57ef935)
2018-07-24WORKAROUND: Remove broken SKX-TB out of poolPeter Mikus2-4/+0
Currently T22 and T23 are faulty Tracked in [FD.io Helpdesk #58059] Change-Id: Ib8d474400a7e109a87573e33ca73946208bbb5de Signed-off-by: Peter Mikus <pmikus@cisco.com> (cherry picked from commit 83bba1edaebd4a9a9b9c752bc75db318660a117e)
2018-07-24initial CSIT-DMM test scriptssharath reddy10-0/+1144
Change-Id: I77a965751010b85d21335932baa5345a095dc4f3 Signed-off-by: sharath reddy <sharathkumarboyanapally@gmail.com> Signed-off-by: sharath <sharathkumarboyanapally@gmail.com> (cherry picked from commit 374b35938abf48e742fb3438ae8ed1e9b47d84ce)
2018-07-24CSIT-1097: Migrate Vts suite to NDRPDRVratko Polak15-291/+1108
Change-Id: Iaac913bb4b15d743a2e9d565e25d31c089cee3e8 Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit 298d0a61d75cded31fc0f09d408e7b3e3f9ee4f7)
2018-07-24CSIT-1097: Migrate ip4 to NDRPDR and edit MRRVratko Polak154-6879/+12493
Change-Id: I9e3b2973c14f818247658a2ae34456c9fc2bae4e Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit 74771ecb4e2742efd3ab40bb8dd9cf9ac1bb40c8)
2018-07-24CSIT-1097: Migrate vm_vhost to NDRPDR and edit MRRVratko Polak127-11852/+10062
Change-Id: Id5eb8fe46b219426803d3e7d135319ce5117738c Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit 1e2e2be1c90c83a6b9b4283f285bc89a5ece64ec)
2018-07-23CSIT-1204: Make new TC names backward compatible (trending)Tibor Frank4-40/+14
Change-Id: I48976a21ed022f0f8d840903db4d2415be9365cd Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit eb9e73f37019420ff8387c204b6621e73195fd97)
2018-07-20CSIT-1097: Migrate ip4_tun to NDRPDR and edit MRRVratko Polak19-2380/+1358
Change-Id: I20fe137cfbbcea1e337fe6295818ea105953d006 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-07-20CSIT-1097: Migrate memif to NDRPDR and edit MRRVratko Polak26-1325/+1849
Change-Id: I22db20ec688f1a879e82549aa7aa68dafdc71b6c Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-07-19CSIT-1196: Add hsw/skx and 2n/3n to the report structureTibor Frank70-2615/+29103
Change-Id: I3a0cc2792b931798e466250e30bc30ad8a32b84e Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-07-19FIX: Increase timeout for VAT for longer API calls.Peter Mikus1-1/+1
Change-Id: Idab5e8d62a42513ddef97025625962b510c3a625 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-07-19DRAFT: FD.io CSIT high-level development plan in .txt format.Maciek Konstantynowicz1-0/+84
Provided for reviews and reference, not for tracking. Jira continuous to be used for CSIT work tracking. Change-Id: I0945f0ab910f85f41d16ae402368430ef8351ee3 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2018-07-18CSIT-1097: Crypto NDRPDR and missing MRR suitesVratko Polak34-3613/+2873
Change-Id: If40f9283ee889f85e85fad74a490252e812bbe02 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-07-18CSIT-1097: Ip6 NDRPDR and edited MRR suitesVratko Polak39-3776/+2421
Change-Id: I912017c6d1eab5530eecb2326887ffd057916ee8 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-07-18CSIT-1201 Create L2patch perf testsPeter Mikus14-0/+1364
- XL710, XXV710, X710 - 2n, 3n - all pkt.size groups - ndrpdr, mrr Change-Id: Ibb36d734cd70a0a4d07e3d177fa2477bf9bfaacd Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-07-17CSIT-1186: Add MRR and NDRPDR ip6_tunnels testsVratko Polak7-1192/+566
Remove the corresponding NDRPDRdisc tests. Change-Id: Ib46f53e97f703db19bcbcb82c3db0a7f5bb61dbf Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-07-17CSIT-1165 Create DPDK tests for 2-node topologyPeter Mikus8-0/+978
Create DPDK tests for 2-node topology - x710, xxv710 only - l3fwd, testpmd - standard pkt.size group Change-Id: I2fbf6c38a427775da9b289faaa8fe1b8c03d5527 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-07-17CSIT-1186: Add srv6 NDRPDR suitesVratko Polak20-639/+976
Delete the corresponding ndrpdrdisc suites. MRR suites are also edited, to make them less different from NDRPDR suites. Now, there is a script to re-generate testcases of selected suites. For that, resources/libraries/python/autogen is created, with Regenerator holding the most of script logic. The script looks at files matching a glob expression, reuses a "prolog", but overwites test cases with the default template and hardcoded set of testcase arguments. Also, handling of overhead size has been simplified, using new keyword Get Max Rate And Jumbo And Handle Multi Seg. Default value for search timeout is increased to 12 minutes to make timeout failures less frequent. Change-Id: I394ad61f262b3078e5ca719034b15ada48987ee0 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-07-17Update of VPP_STABLE_VER and DPDK_STABLE_VER filesJan Gelety3-3/+3
- use new vpp ref build - ubuntu 16.04: 18.07-rc0~517-g635ec3b~b4653 - use new vpp ref build - centos7: 18.07-rc0~517_g635ec3b~b4569 - use new dpdk version: 18.05-vpp2 Change-Id: I5fe34ea3603de136f8fe28fb8313533349257801 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-07-17Refactor DPDK testcases to new structurePeter Mikus29-2183/+1687
+ RXQ refactor Change-Id: Ic03a2e208b9fe5d324a5ed75a603af4cff1854a9 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-07-17CSIT-1094: Change menu styleTibor Frank22-1417/+179
Change-Id: Idff59bc73d3444700937fc473681760a947f0f41 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-07-16CSIT-1190: Update report configuration for 18.07Tibor Frank2-8/+8
Change-Id: Ie7644fe3069ad37c15754a07e049f479903ca59a Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-07-16Add L2xc/L2bd/Ip4/Ip6 2-node tests for x710Peter Mikus21-3/+2329
- CSIT-1161 Add 2-node L2XC tests - CSIT-1160 Add 2-node L2BD tests - CSIT-1157 Add 2-node IP4 tests - CSIT-1153 Add 2-node IP6 KW - CSIT-1158 Add 2-node IP6 tests Change-Id: I7c8fed7018bb355c0de73f6a8bc3a8ec80366972 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-07-16FIX: VTS suitePeter Mikus1-24/+24
Change-Id: I1766ac51ac34b63feab80329c1ae2c62fc6d8496 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-07-13Refactor perf test casesPeter Mikus312-29633/+6697
- Refactor Performance TCs due to changes in Hyperthreading and RXQ allocations. - Simplify the structure of suite to avoid large refactors in future. Change-Id: Ifb1b9719391f26745f075a900bd9fb39b6cb809c Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-07-13Add stats segment heapsize to default configPeter Mikus2-0/+10
- Scale tests (ip4, ip6) are failing due to low amount of stats segment heapsize. Change-Id: Id9b3e84d5a5c63014c17041c08c00ef6188afa5f Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-07-13Update skylake tesbed inventoryPeter Mikus12-37/+265
- Add missing topology files - Add missing topologies to bootstrap - Small fixes in ansible Change-Id: I3b9ad60a0adfae9e93e5e700279f7ade81174471 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-07-12CSIT-1168 Create bootstrap for 2-node topologyPeter Mikus2-116/+149
Update existing bootstrap to recognize 2node/3node topologies Change-Id: I2f81f9d69d824f7eea608413eac35a1598fad8c6 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-07-12FIX: PAL: input data processingTibor Frank1-0/+3
Change-Id: I295ca0a991dea8104e9794d7013be908f5461ea2 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-07-12Update Ligato to latest dev branchPeter Mikus2-37/+21
- Due to heavy modifications on vpp-agent docker images we need to change build mechanics. Change-Id: I26fb82ed1b2538335f7dc3dbb7f46ed2bb846583 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-07-12CSIT-1186: Consume MLRsearch in agreed upon wayVratko Polak16-809/+4
+ Rename search to MLRsearch in resources/libraries/python/. + Make PyPI/MLRsearch/MLRsearch a symlink to the renamed directory. + TrafficGenerator.py to import from the renamed directory/module. - No change to MLRsearch code. - Version stays at 0.1.1 to point to the latest released code. Change-Id: I4a38b0b7f8f083fbb1a93b25522560144b4ef556 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-07-11CSIT-1178: Prepare for bursty MRRVratko Polak137-182/+253
+ All suites and tests still refer to MRR instead of BMRR (or FRMOBL). + API change: Traffic should pass with maximum rate first argument got a default value, thus it needs to be moved towards the end of argument list. + Consequently, the value for it has been deleted from suites. + Test message is now compatible only with BMRR parsing. - Reporting of transmit rate is left as TODO. + Global test __init__ with new way of giving defaults to global variables. + The new keyword is put into robot_enhancements.robot resource. + Number of trials and trial duration are now configurable. - Bootstrap scripts have no support for overriding the defaults yet. Change-Id: I4b108cc9c256730e62c03fbacba0a1c314f8ae88 Signed-off-by: Vratko Polak <vrpolak@cisco.com>