aboutsummaryrefslogtreecommitdiffstats
path: root/resources
AgeCommit message (Collapse)AuthorFilesLines
2018-08-01CSIT-1208: Add new data to 1807 reportTibor Frank1-625/+604
Change-Id: I514de6e4ac321900090a7f7ce9af60d23acd43ab Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-08-01FIX: check IF up state after setting MTU, not beforeJan Gelety1-1/+1
Change-Id: Ic7a78af96a371e49993f6cbac01267e4bbe0dc46 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-08-01FIX: Set MTU before configuring l2patchVratko Polak1-2/+2
This should reduce number of "link down" failures dramatically. The exact mechanism is not clear, but l2xc suites do not fail that much. Change-Id: Ie102d90a58561121695c9938679ce0d3ee6a874f Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-07-31FIX: Report - plotsTibor Frank1-462/+462
Change-Id: Ia791d310e5942e10d62011cb879101828dfe7454 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-07-31FIX: Revert l3fwd patchingPeter Mikus1-1/+0
For now this solution does not work on Haswells, need to find permanent fix. Change-Id: Id5323a078db3a8f14c009d6f66ee393c89d851ef Signed-off-by: Peter Mikus <pmikus@cisco.com> (cherry picked from commit 5f634b8c486f7a404c9cd33b60cc92a6907e7c64)
2018-07-31Update report doc for rls1807Peter Mikus1-91/+101
Change-Id: I713fe9b4a1a2830d6267c1dfc9b0442bf08b8ab4 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-07-30CSIT-1197: Add Comparison Across Testbeds to the ReportTibor Frank3-1126/+759
Change-Id: Ibf0c880926b87e781830d7b39438b5145144ef5b Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-07-30HC Tests: remove trusty from download_hc_*.sh scriptsMarek Gradzki2-16/+4
Ubuntu 14.04 packages are not being published since 1710. Change-Id: I1372fe0eb4eab3c6c3e0f3a7ee435104f3c6f0fb Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
2018-07-30HC Tests: do not use vpp-dbg in CSIT testsMarek Gradzki2-6/+6
Honeycomb package does not require VPP debug symbols and typical HC user does not have them installed. Change-Id: I2cae502cad3216304d6f7ee44913f30c97fb5a20 Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
2018-07-30CSIT-1219: Update job definitions in conf.pyTibor Frank3-6/+30
Change-Id: Ib7e76f43a8ef2d4729962ff5856c987747b0b953 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-07-28FIX: LXC container creation on Ubuntu BionicPeter Mikus1-1/+2
Do not mount whole /dev into container as it can steal the PTS (tty). Currently mounting only /dev/bus for pci devices and /dev/vfio Change-Id: Ie829d35db81317bcd081257453ede7cbec2a302e Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-07-28Revert MTU sequence to apply oafter interface UPPeter Mikus1-2/+4
Change-Id: I8820350809ab63787a9e4a48b2db2c85320e7b11 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-07-27FIX: Interface up handlingPeter Mikus5-16/+24
- Increase timeout when trying to check interface (this is useful if there are multiple interfaces and dump command take more than TIMEOUT/NR_IF which is happening quite often). - Reverse the order of applying MTU and interface UP to try to prevent API overload during interface initialization phase. Change-Id: I4e8623963d15b3c0d202172b4c58c43a972bb9cb Signed-off-by: Peter Mikus <pmikus@cisco.com> (cherry picked from commit 584345da4f7330f7517e5defd894b4995c2b57b0)
2018-07-27CSIT-1213: Add 2n/3n-skx to Test Oper DataTibor Frank2-109/+166
Change-Id: I217cc8dc6691c2a443460bd4e51ea96c4ec82806 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-07-27CSIT-1212: Add 2n/3n-skx to Test ConfigurationTibor Frank2-31/+128
Change-Id: I4be3e2072dbc1f1f27b840de1c04a2374944f724 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-07-27CSIT-1211: Add 2n/3n-skx to detailed resultsTibor Frank2-284/+562
Change-Id: Ibfe838b355fa15d0f89ea3122f2d042af989b51d Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-07-26CSIT-1203: Add parsing of NDRPDR testTibor Frank5-740/+1087
Change-Id: I55be02df7f8979ad4c10b79d87f5065452a3e6e6 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-07-26CSIT-1065 High failure rate with K8s/Ligato orchestrationPeter Mikus5-15/+102
- Update Ligato Bootstrap for latest changes - Update Ligato Test cases for latest vpp-agent changes - Convert TC to new format - Add Hyperthreading support Change-Id: Id7c8513b01c66ee6c652b6294ddc50bc10be8f7d Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-07-25HC Tests: do not install vpp-dev in hc2vpp-csit-verifyMarek Gradzki1-3/+3
The download_hc_build_pkgs.sh is used by hc2vpp-csit-verify and hc2vpp-csit-verify-odl jobs. These jobs download latest VPP packages and unlike other HC CSIT jobs, build hc2vpp. This patch removes vpp-dev/vpp-devel packages from the list of installed VPP packages to unify the environment with the other HC CSIT jobs. Change-Id: I28742afda05cd85675619a92fbc10f4565bdb321 Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
2018-07-25Add MTU handling into perf testsPeter Mikus4-94/+123
- Add ability to configure MTU on interfaces. Put the MTU into configuration keywors for all perf testcases. Change-Id: I364b4bc26b26f2f66f350949c0aaa2a2aa675682 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-07-24CSIT-1097: Migrate L2 to NDRPDR and edit MRRVratko Polak3-11/+27
Change-Id: I738d1794f795e1225bc9709ea2ed2cf9b06d1cf4 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-07-24initial CSIT-DMM test scriptssharath reddy5-0/+404
Change-Id: I77a965751010b85d21335932baa5345a095dc4f3 Signed-off-by: sharath reddy <sharathkumarboyanapally@gmail.com> Signed-off-by: sharath <sharathkumarboyanapally@gmail.com>
2018-07-24CSIT-1097: Migrate Vts suite to NDRPDRVratko Polak4-4/+88
Change-Id: Iaac913bb4b15d743a2e9d565e25d31c089cee3e8 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-07-24CSIT-1097: Migrate ip4 to NDRPDR and edit MRRVratko Polak2-4/+33
Change-Id: I9e3b2973c14f818247658a2ae34456c9fc2bae4e Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-07-24CSIT-1097: Edit dpdk suites for new rate and jumboVratko Polak1-2/+5
Change-Id: If2fceb47639dc1add32184271c1e911f7920a51a Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-07-24CSIT-1097: Migrate vm_vhost to NDRPDR and edit MRRVratko Polak1-0/+4
Change-Id: Id5eb8fe46b219426803d3e7d135319ce5117738c Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-07-23HC Tests: remove vpp-dpdk-dkms dependencyMarek Gradzki2-12/+3
The vpp-dpdk-dkms is not needed for current VPP versions. Change-Id: I9c1a79fb940b2ba0f332792d4fc088f49f9ee191 Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
2018-07-23HC Tests: disable NSH pluginMarek Gradzki2-14/+18
Change-Id: Ic382b625e5e7201ecc2a2937c15646806c594c61 Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
2018-07-23CSIT-1204: Make new TC names backward compatible (trending)Tibor Frank3-6/+11
Change-Id: I48976a21ed022f0f8d840903db4d2415be9365cd Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-07-19CSIT-1196: Add hsw/skx and 2n/3n to the report structureTibor Frank4-1279/+14732
Change-Id: I3a0cc2792b931798e466250e30bc30ad8a32b84e Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-07-19FIX: Increase timeout for VAT for longer API calls.Peter Mikus1-1/+1
Change-Id: Idab5e8d62a42513ddef97025625962b510c3a625 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-07-18CSIT-1097: Ip6 NDRPDR and edited MRR suitesVratko Polak1-1/+8
Change-Id: I912017c6d1eab5530eecb2326887ffd057916ee8 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-07-18CSIT-1201 Create L2patch perf testsPeter Mikus4-0/+66
- XL710, XXV710, X710 - 2n, 3n - all pkt.size groups - ndrpdr, mrr Change-Id: Ibb36d734cd70a0a4d07e3d177fa2477bf9bfaacd Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-07-17CSIT-1186: Add srv6 NDRPDR suitesVratko Polak7-19/+360
Delete the corresponding ndrpdrdisc suites. MRR suites are also edited, to make them less different from NDRPDR suites. Now, there is a script to re-generate testcases of selected suites. For that, resources/libraries/python/autogen is created, with Regenerator holding the most of script logic. The script looks at files matching a glob expression, reuses a "prolog", but overwites test cases with the default template and hardcoded set of testcase arguments. Also, handling of overhead size has been simplified, using new keyword Get Max Rate And Jumbo And Handle Multi Seg. Default value for search timeout is increased to 12 minutes to make timeout failures less frequent. Change-Id: I394ad61f262b3078e5ca719034b15ada48987ee0 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-07-17Refactor DPDK testcases to new structurePeter Mikus3-21/+79
+ RXQ refactor Change-Id: Ic03a2e208b9fe5d324a5ed75a603af4cff1854a9 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-07-17CSIT-1094: Change menu styleTibor Frank4-10/+67
Change-Id: Idff59bc73d3444700937fc473681760a947f0f41 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-07-16CSIT-1190: Update report configuration for 18.07Tibor Frank1-7/+7
Change-Id: Ie7644fe3069ad37c15754a07e049f479903ca59a Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-07-16Add L2xc/L2bd/Ip4/Ip6 2-node tests for x710Peter Mikus5-3/+222
- CSIT-1161 Add 2-node L2XC tests - CSIT-1160 Add 2-node L2BD tests - CSIT-1157 Add 2-node IP4 tests - CSIT-1153 Add 2-node IP6 KW - CSIT-1158 Add 2-node IP6 tests Change-Id: I7c8fed7018bb355c0de73f6a8bc3a8ec80366972 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-07-13Refactor perf test casesPeter Mikus2-38/+69
- Refactor Performance TCs due to changes in Hyperthreading and RXQ allocations. - Simplify the structure of suite to avoid large refactors in future. Change-Id: Ifb1b9719391f26745f075a900bd9fb39b6cb809c Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-07-13Add stats segment heapsize to default configPeter Mikus2-0/+10
- Scale tests (ip4, ip6) are failing due to low amount of stats segment heapsize. Change-Id: Id9b3e84d5a5c63014c17041c08c00ef6188afa5f Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-07-13Update skylake tesbed inventoryPeter Mikus4-25/+25
- Add missing topology files - Add missing topologies to bootstrap - Small fixes in ansible Change-Id: I3b9ad60a0adfae9e93e5e700279f7ade81174471 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-07-12FIX: PAL: input data processingTibor Frank1-0/+3
Change-Id: I295ca0a991dea8104e9794d7013be908f5461ea2 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-07-12CSIT-1186: Consume MLRsearch in agreed upon wayVratko Polak8-3/+3
+ Rename search to MLRsearch in resources/libraries/python/. + Make PyPI/MLRsearch/MLRsearch a symlink to the renamed directory. + TrafficGenerator.py to import from the renamed directory/module. - No change to MLRsearch code. - Version stays at 0.1.1 to point to the latest released code. Change-Id: I4a38b0b7f8f083fbb1a93b25522560144b4ef556 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-07-11CSIT-1178: Prepare for bursty MRRVratko Polak3-43/+89
+ All suites and tests still refer to MRR instead of BMRR (or FRMOBL). + API change: Traffic should pass with maximum rate first argument got a default value, thus it needs to be moved towards the end of argument list. + Consequently, the value for it has been deleted from suites. + Test message is now compatible only with BMRR parsing. - Reporting of transmit rate is left as TODO. + Global test __init__ with new way of giving defaults to global variables. + The new keyword is put into robot_enhancements.robot resource. + Number of trials and trial duration are now configurable. - Bootstrap scripts have no support for overriding the defaults yet. Change-Id: I4b108cc9c256730e62c03fbacba0a1c314f8ae88 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-07-11CSIT-1183: Process the new and the old TC namesTibor Frank2-2/+28
Change-Id: I7fcecd7e23494e8fb0e70e7af00408eed16733e4 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-07-10CSIT-1189: Add suite setup to source code documentationTibor Frank2-12/+33
Change-Id: I0cc435ecacaeb5f9e8fd5c67f495166a1abd2e91 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-07-10PAL: Treat the new and the old TC namesTibor Frank1-0/+6
Signed-off-by: Tibor Frank <tifrank@cisco.com> Change-Id: If5999de81b4e062d38ce44871f0c4d4fa794b55c Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-07-10Remove THIS tag and use unix endlinesVratko Polak23-616/+616
The THIS tag has sneaked in 10Ge2P1X520-Eth-L2Xcbase-Eth-1Memif-1Dcr-Mrr but usually it is only to be used in draft testing. Not sure about the way non-unix endlines crept in. Is not git supposed to perform endline conversions on text files? Or are .robot, .rst, .yaml and .vat not recognized as text? Change-Id: Ia78cf942c05c3029c340a8639782786f37e57469 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-07-10CSIT-1142 2-node topology - keywords DPDKPeter Mikus1-82/+50
Change-Id: Ia2676a7b846bd574aa86703fce6b0e3218f98776 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-07-09FIX: Implement changes required by Plot.ly 3.0.0Tibor Frank3-17/+6
- Scatter.xaxix.autotick - Scatter.yaxis.range[] Change-Id: I171e0c4a796f713985b69fae23bfb768590274b4 Signed-off-by: Tibor Frank <tifrank@cisco.com>