aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2022-06-30job-spec: Reduce number of iterative tests for 2n-clxTibor Frank2-16/+0
- For e810cq remove dpdk-vfio-pci L2 100k and 1M scale tests Change-Id: Icded4fdca2720fad7f51cd072ed72fc4a1b4742d Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 339628cdb5be2e4e488579a95c9f0c3eb3268bc4)
2022-06-30feat(methodology): add methodology for autogenVratko Polak2-0/+140
Change-Id: I416c4120f2d7e05582a1f4fc529dfc86a09a7788 Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit 44ff812b59a8cdcb3ac97cbda528e84e74b3547f)
2022-06-30feat(doc): update ASTF related methodologyVratko Polak4-121/+159
Also added some TODOs for future methodology improvements. Some of them will addressed in subsequent changes soon, but not sure yet which ones exactly. Change-Id: Ib827371b7d7a598c5fa6ab41fb7e48c73185844f Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit 2db1998c0432569702738524e66c9d4e3f553b20)
2022-06-30job_specs: add wireguard perf tests to regressionYulong Pei3-1/+9
Signed-off-by: xinfeng zhao <xinfengx.zhao@intel.com> Signed-off-by: Yulong Pei <yulong.pei@intel.com> Change-Id: I9e499df973fd9990ab02fe7008d12e78b2ab089f (cherry picked from commit 325cef50672aed697e277405fe9bb9b797d02701)
2022-06-30Add Test Suite for VPP WireGuardCui,Cheng5-1/+513
Signed-off-by: Cui,Cheng <cheng.cui@intel.com> Change-Id: I71e257e5f16a887a40ff83d782a9ebdee9d05c34 Signed-off-by: Cui,Cheng <cheng.cui@intel.com> (cherry picked from commit 75ef277536c43096e7646430568d97d2cc489238)
2022-06-30Update VPP_STABLE_VER filesTibor Frank2-2/+2
Change-Id: Ia2b760ca18758eaec048cfb1c6206af1ba224c59 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-06-30job_specs: add IPsec perf tests and GTPU perf tests to regressionYulong Pei3-0/+114
Signed-off-by: xinfeng zhao <xinfengx.zhao@intel.com> Signed-off-by: Yulong Pei <yulong.pei@intel.com> Change-Id: If70f910003d8208e08d4dc101ac70b33e7e4162b (cherry picked from commit d0099eacdcbaeb7fcc80592daf350e4f0e7b3936)
2022-06-30job-spec: Reduce number of iterative tests for 2n-clxTibor Frank2-42/+2
- For e810cq use the same dpdk-vfio-pci tests as for xxv710 Change-Id: I5857332fa8f2256b293efd610902d30a015e716d Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit f323eea4adbddff526ee49f0752d9dbc5396091e)
2022-06-29feat(telemetry): print executed command in vppctlVratko Polak1-0/+1
The vpp bundle does that, so this will make the outputs more similar. Change-Id: Iadad9b683d90b7bdd672ed3f51bce9f57f652eaa Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit 71d84bb6f1f493ce589499a6de149cfa3222e006)
2022-06-29Report: Add rc2, re-test dataTibor Frank1-0/+4
Change-Id: I3fe5d3a1b5fcb8ab182442d6af85719b16e52fe0 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 30badc023cb58f7ae4ddcf747c28f49c39b1dca6)
2022-06-28Report: Add rc2 dataTibor Frank2-1/+6
Change-Id: Ie5df83a47c352ef84486c2d62be91365ad005409 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 8335a5a3f8935e6f1ab760986ac715c22839ca7a)
2022-06-28feat(telemetry): ReworkPeter Mikus92-159/+1698
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I0a84ce88b318c488ba2d519b20237c88b9f9f1e6 (cherry picked from commit b33b1461fe815b1a09267118644538a5b9351c60)
2022-06-28Report: Add normalized comp tabels - static contentTibor Frank16-1/+471
Change-Id: I0a9782248fee91f3db2fb5db00c800c7e5447f32 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit e076cc8c47e7c10a48d0c5410967cd0269b98723)
2022-06-28Report: Add normalized comparison tablesTibor Frank4-160/+987
Change-Id: Ief631c4b8924885642435669a151be9f9c9e585f Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 9748f8e1b20bc528fb0143a08f111f48426ada3e)
2022-06-28Report: Add rc2 dataTibor Frank1-0/+5
Change-Id: Ia5c242d8904b2f8b7e774ce4cec421e58b84a2ed Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 050e8699a96175ecda2dc696dbe63dbafc783812)
2022-06-27Trending: Add names of new ICX TBsTibor Frank1-0/+4
Change-Id: Ic5b708a935272fda935398fe7f0ab53de72c5eba Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 75a332d56cfbcf9e824e4c3bfa3ff87893d9033a)
2022-06-27fix(ansible): ICX rulesPeter Mikus1-1/+2
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I4b9fdeac0e4ec85cf0def7cfeefbf2ce4e7b0bd9 (cherry picked from commit d428ea995298bc82237b3309609c4abab9cf04e2)
2022-06-27fix(infra): Topology 3n-icxPeter Mikus1-1/+1
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Ibdf60c87dd56282d7c10eb94efd0914aa5944bbd (cherry picked from commit f99fee38be3f0a15bdc52f7672a35c21fc9d89de)
2022-06-27Report: Add VSAP testsTibor Frank3-58/+285
Change-Id: If0ebb92ded94bf2b0cf8ad0d17ac2b0bd6d165a3 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 7fd5509ba966027c118d3930e7b20d5c080faa9a)
2022-06-27Report: Add rc2 dataTibor Frank1-0/+25
Change-Id: I8b69a5029a200c327e7276675c847809af367908 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 0f3f40e1c2857daff628a9e2280a2de00c6f9331)
2022-06-24Report: Add rc2 dataTibor Frank1-0/+7
Change-Id: Iad3cb32e346bf6c7e0754275e5ccba6cb19b731a Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 7909919cf42d6835d284dc6fbe9dfb3498784c20)
2022-06-24Report: Add rc2 dataTibor Frank1-3/+16
Change-Id: Ifaecbf2f1788cc0da44b4ef64abc63b531f161c8 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 7f99e1ae98fc222b35f94445921ce656206e6689)
2022-06-23fix(infra): Topology filePeter Mikus1-1/+1
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I47cc26d500e088154ffe88aceb384128a78b70ee (cherry picked from commit 50053fbdc3de57026b940242a445ed39b4be49f8)
2022-06-23feat(infra): Add ICXPeter Mikus5-25/+766
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I609e039026bf5cd71a06549caa0ba917579e525c (cherry picked from commit d8449a2d2b64566b4e3d30879305119d1c500d59)
2022-06-23Report: Add rc2 dataTibor Frank5-98/+141
Change-Id: Ia8a81135cb0dbd3b2f8877de66a5d9ed3f6e8309 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit bb734f5c497c9329d6cd28d0fbb0bff3ba1992cc)
2022-06-22fix: 3n-alt missing in regressions and progressionsViliam Luc1-0/+13
Signed-off-by: Viliam Luc <vluc@cisco.com> Change-Id: I8b2cdf6f8dc45cae9a921c1ecbd2e952ef30bfbe (cherry picked from commit a28b496bafd3c7a951e4732b4bd42182d8ab2d69)
2022-06-22feat(ansible): Add ICXPeter Mikus15-17/+324
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I3a62dc7048102381598b3e0dfc16f82fad834d7b (cherry picked from commit 99a0ec18cb9117e9c22b4416c97d603215e3fa8b)
2022-06-22Report: Add 2n-clx-e810cq latencyTibor Frank15-21/+1077
Change-Id: I5674d40362ea958c34845c22c1b5fd090d08be83 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 0fa376d390b3de02c75e4611c1e9d134e49b5b9d)
2022-06-22feat(doc): Infra updatesPeter Mikus78-77/+80
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I208fc73382754d3182f6f7eedc1a46ae72ef6aa2 (cherry picked from commit ce081da3605b234cf257db52a083e15022f06de4)
2022-06-21fix(hoststack): distinguish two tcp tag typesVratko Polak5-12/+16
Previous change did not consider TCP_PPS and TCP_CPS robot tags are used by two different suite types (hoststack or ASTF). This fixes the unintended impact on hoststack. + Add HOSTSTACK tag to VSAP suites. - They could also get VSAP tag, but not needed for this Change. Fixes: 1daa6fdc0bae284dee1b61f34534e59b60b7526a Change-Id: Ic583b5ae336c9b74794706fefc232f221a243c87 Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit f3a55b00e3f9e3418426c295cc6f9810a6eb137e)
2022-06-21Report: ComparisonsTibor Frank13-32/+291
Change-Id: Icbb4709c84b66251438b73d109606977527c6c88 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit d0a30297017d1e947c3540ca81b00599ea77825e)
2022-06-21Report: Add 2n-clx-e810cqTibor Frank21-1/+1352
Change-Id: I4c7f37d77a9b8bda17eb3fb0b9a5bf468f1fd853 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 0807c16320ff5c864dd77168e2b8a36556a941d4)
2022-06-21feat(pxe): Add ICXPeter Mikus30-18/+810
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I4e3ec03a87f356c0e588011b848f8dd4ab7f30aa (cherry picked from commit 5fc677579d18ec73390fa5ec86dc9168da3245f6)
2022-06-21Trending: Add 2n-clx-e810cq - fixesTibor Frank3-5/+5
Change-Id: I9789e459c3db272e8f76c25df1ced266c9f5213f Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 4e6de308248a9aadd54f0183740bbe807cf9e985)
2022-06-21Trending: Add 2n-clx-e810cqTibor Frank31-0/+1140
Change-Id: Iefcd777f2e51038c4efc13ff68c777efb7ed78c9 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 6a559c656f42c2122458338125ba5da68f8cdcad)
2022-06-17fix: testpmd and l3fwd check stateViliam Luc7-7/+229
+ print testpmd and l3fwd pid after start Testpmd and l3fwd utility can be started but link might not be ready yet. This fix start the utility on all DUTs and do the check later. Signed-off-by: Viliam Luc <vluc@cisco.com> Change-Id: If476e22f206d9a6a0dd399879a88eafedca92bb6 (cherry picked from commit 5c4c05c8ea9f1b07862c09c8d971a3dae3b16adf)
2022-06-17Add ipsec policy test suites with flow director or rss acceleratedYulong Pei6-63/+670
The test scenario is about two private networks which communication was protected by ipsec. The test suites are to show performance impovement about ipsec esp flow lookup that offloaded by NIC flow director and rss. Verified on 3n-clx and Intel E810 NIC environment, with 64B ipsec packet flow, performance improved ~31% with 1C2T, ~110% with 2C4T, ~250% with 4C8T. Signed-off-by: xinfeng zhao <xinfengx.zhao@intel.com> Signed-off-by: Yulong Pei <yulong.pei@intel.com> Change-Id: I30aec8c5115e5a6fbef88c11d1bef2624029d1b9 (cherry picked from commit f7ee014dee09b4089924342b0fe5654b2fe91e90)
2022-06-17doc(infra): ICX onboardingPeter Mikus4-158/+227
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I542a16dcc1f00b0cc2a9f1bce873b0e67d60b69e (cherry picked from commit 7f1c5531d5f2b04b43ba84964a82f72e74469a59)
2022-06-16Update VPP_STABLE_VER filesTibor Frank1-1/+1
Change-Id: Ib6247374f12b5a25432407870bf9135c6196c725 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-06-16feat(jobspec): Avoid tests affected by CSIT-1830Vratko Polak15-144/+228
+ Replace TCP TPUT 100b tests on xxv710 NICs with 1518b ones. + Keep UDP TPUT tests at 100b for now. + Add both 100b and 1518b TCP TPUT tests to Denverton. + Its x553 NIC is not affected. + That gives us some comparison on how packet size affects performance. Ticket: CSIT-1830 Change-Id: I5544f7ba84d4813148bcad2f9d64634939492647 Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit 5d412da6bf08a042765eabfea91e9484a8daba11)
2022-06-16feat(tests): Remove PPS tests.Vratko Polak29-1859/+200
+ Delete nat44 pps suites. + Rename ip4base suites, testcases, suite tags (also tg) to -tput. + Also robot tags like UDP_PPS and TCP_PPS. - Keep traffic types and traffic profile names with pps. + They can be renamed in a different change if needed. + Update job specs. - Do not update methodology yet (avoid conflict with another Change). Ticket: CSIT-1829 Change-Id: Ic0dac441f6e8253edce88e057ab7fad1d3814c24 Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit 158f54ff4d416c9bd282ffd0b8e812ec4e8214f4)
2022-06-15feat(infra): SnowRidge docsPeter Mikus3-50/+126
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Ie53e1e7474542547d73bdfe2a234e6e838bdd454 (cherry picked from commit 9f9e8be234eb422f189a6b3bc008963be7f1b213)
2022-06-14doc(report): Update test environmentPeter Mikus3-3/+14
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I9987cac1493ea75eb097a0f2123768eec1ca3d73 (cherry picked from commit 1b97d7088f4db702b05c0fd4cbc02a52c97e4529)
2022-06-14fix(infra): Topopology link swapPeter Mikus1-2/+2
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I20fc441cb46b70b2c315a2c865c3d11e3c341212 (cherry picked from commit 04288f6c4806fad01710225e4c4b789704e399d7)
2022-06-14trending: fix 3n-alt missing in dashboardViliam Luc2-4/+4
Signed-off-by: Viliam Luc <vluc@cisco.com> Change-Id: I356998c521d47f085a78bf2577574ea0d489e02d (cherry picked from commit a08e07a8f6c614899b85f891efd45d5e4e93f7f4)
2022-06-13feat(dpdk): Bump the version within VMPeter Mikus1-1/+1
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Ie358593f9977d04aca9e50a14e0d14158e1b0cf1 (cherry picked from commit 7e88ea8b9a31713be65587672f4fe22bccb5f386)
2022-06-13doc(infra): Fix firmware versionsPeter Mikus2-9/+9
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I755043bc10b2bc419daf007f023742e814c3c63b (cherry picked from commit e483990fff726fca8ec6a70fe202ab790517eddd)
2022-06-13Update VPP_STABLE_VER filesTibor Frank1-1/+1
Change-Id: I1ed61d9d807d2b8e66555deb26456017597cb9ae Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-06-09fix(core): T-Rex initializationPeter Mikus1-11/+30
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I53226ff6a345ac99c1e2e110712b2ff6197efe95
2022-06-09Report: Add retest dataTibor Frank1-1/+2
Change-Id: Ic42a15b44e0395c194cdeddef6d91635fd0f9b10 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 400205b1f838b88e72236559308d9c4b3ee61aa4)