aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2022-06-30job-spec: Reduce number of iterative tests for 2n-clxTibor Frank2-16/+0
- For e810cq remove dpdk-vfio-pci L2 100k and 1M scale tests Change-Id: Icded4fdca2720fad7f51cd072ed72fc4a1b4742d Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-06-30feat(doc): update ASTF related methodologyVratko Polak4-121/+159
Also added some TODOs for future methodology improvements. Some of them will addressed in subsequent changes soon, but not sure yet which ones exactly. Change-Id: Ib827371b7d7a598c5fa6ab41fb7e48c73185844f Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2022-06-30feat(methodology): add methodology for autogenVratko Polak2-0/+140
Change-Id: I416c4120f2d7e05582a1f4fc529dfc86a09a7788 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2022-06-30style(tox): prepare for fixer scriptsVratko Polak10-28/+38
The previous code assumes each tox script is a checker. We want to add fixer scripts (not voting but editing) soon. This is the less interesting part of the process, renaming things and updating comments. Includes some basic descriptions of how fixers differ from checkers. Change-Id: I1ca1572a328acd02b41dcf4e70d7cb3746a03b03 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2022-06-30job_specs: add wireguard perf tests to regressionYulong Pei3-1/+9
Signed-off-by: xinfeng zhao <xinfengx.zhao@intel.com> Signed-off-by: Yulong Pei <yulong.pei@intel.com> Change-Id: I9e499df973fd9990ab02fe7008d12e78b2ab089f
2022-06-30job_specs: add IPsec perf tests and GTPU perf tests to regressionYulong Pei3-0/+114
Signed-off-by: xinfeng zhao <xinfengx.zhao@intel.com> Signed-off-by: Yulong Pei <yulong.pei@intel.com> Change-Id: If70f910003d8208e08d4dc101ac70b33e7e4162b
2022-06-29job-spec: Reduce number of iterative tests for 2n-clxTibor Frank2-42/+2
- For e810cq use the same dpdk-vfio-pci tests as for xxv710 Change-Id: I5857332fa8f2256b293efd610902d30a015e716d Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-06-29UTI: Add comments and clean the code.Tibor Frank6-145/+254
Change-Id: I6fba9aac20ed22c2ae1450161edc8c11ffa1e24d Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-06-29UTI: Colors in iteraive graphsTibor Frank1-0/+1
Change-Id: I060668104a20235711a3a72eca83e446919d4ce2 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-06-29feat(telemetry): print executed command in vppctlVratko Polak1-0/+1
The vpp bundle does that, so this will make the outputs more similar. Change-Id: Iadad9b683d90b7bdd672ed3f51bce9f57f652eaa Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2022-06-29Report: Add rc2, re-test dataTibor Frank1-0/+4
Change-Id: I3fe5d3a1b5fcb8ab182442d6af85719b16e52fe0 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-06-28Report: Add rc2 dataTibor Frank2-1/+6
Change-Id: Ie5df83a47c352ef84486c2d62be91365ad005409 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-06-28feat(telemetry): ReworkPeter Mikus92-159/+1698
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I0a84ce88b318c488ba2d519b20237c88b9f9f1e6
2022-06-28Report: Add normalized comp tabels - static contentTibor Frank16-1/+471
Change-Id: I0a9782248fee91f3db2fb5db00c800c7e5447f32 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-06-28Report: Add normalized comparison tablesTibor Frank4-160/+987
Change-Id: Ief631c4b8924885642435669a151be9f9c9e585f Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-06-28Report: Add rc2 dataTibor Frank1-0/+5
Change-Id: Ia5c242d8904b2f8b7e774ce4cec421e58b84a2ed Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-06-27Trending: Add names of new ICX TBsTibor Frank1-0/+4
Change-Id: Ic5b708a935272fda935398fe7f0ab53de72c5eba Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-06-27fix(ansible): ICX rulesPeter Mikus1-1/+2
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I4b9fdeac0e4ec85cf0def7cfeefbf2ce4e7b0bd9
2022-06-27fix(infra): Topology 3n-icxPeter Mikus1-1/+1
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Ibdf60c87dd56282d7c10eb94efd0914aa5944bbd
2022-06-27Report: Add VSAP testsTibor Frank3-58/+285
Change-Id: If0ebb92ded94bf2b0cf8ad0d17ac2b0bd6d165a3 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-06-27Report: Add rc2 dataTibor Frank1-0/+25
Change-Id: I8b69a5029a200c327e7276675c847809af367908 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-06-24Report: Add rc2 dataTibor Frank1-0/+7
Change-Id: Iad3cb32e346bf6c7e0754275e5ccba6cb19b731a Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-06-24Report: Add rc2 dataTibor Frank1-3/+16
Change-Id: Ifaecbf2f1788cc0da44b4ef64abc63b531f161c8 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-06-23fix(infra): Topology filePeter Mikus1-1/+1
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I47cc26d500e088154ffe88aceb384128a78b70ee
2022-06-23feat(infra): Add ICXPeter Mikus5-25/+766
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I609e039026bf5cd71a06549caa0ba917579e525c
2022-06-23chore(mtu): delete some unused keywords related to mtuVratko Polak1-25/+0
Change-Id: Id80b5611bb9a5d4398d4b2d00e92cda469949607 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2022-06-23Report: Add rc2 dataTibor Frank5-98/+141
Change-Id: Ia8a81135cb0dbd3b2f8877de66a5d9ed3f6e8309 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-06-22fix: 3n-alt missing in regressions and progressionsViliam Luc1-0/+13
Signed-off-by: Viliam Luc <vluc@cisco.com> Change-Id: I8b2cdf6f8dc45cae9a921c1ecbd2e952ef30bfbe
2022-06-22feat(ansible): Add ICXPeter Mikus15-17/+324
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I3a62dc7048102381598b3e0dfc16f82fad834d7b
2022-06-22Report: Add 2n-clx-e810cq latencyTibor Frank15-21/+1077
Change-Id: I5674d40362ea958c34845c22c1b5fd090d08be83 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-06-22feat(doc): Infra updatesPeter Mikus78-77/+80
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I208fc73382754d3182f6f7eedc1a46ae72ef6aa2
2022-06-21Report: ComparisonsTibor Frank13-32/+291
Change-Id: Icbb4709c84b66251438b73d109606977527c6c88 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-06-21Report: Add 2n-clx-e810cqTibor Frank21-1/+1352
Change-Id: I4c7f37d77a9b8bda17eb3fb0b9a5bf468f1fd853 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-06-21Update VPP_STABLE_VER filesTibor Frank1-1/+1
Change-Id: Iea2b40aa5df6a96fd26f1d85f23dd6d304a7ca8e Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-06-21feat(pxe): Add ICXPeter Mikus30-18/+810
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I4e3ec03a87f356c0e588011b848f8dd4ab7f30aa
2022-06-21Trending: Add 2n-clx-e810cq - fixesTibor Frank3-5/+5
Change-Id: I9789e459c3db272e8f76c25df1ced266c9f5213f Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-06-21Trending: Add 2n-clx-e810cqTibor Frank31-0/+1140
Change-Id: Iefcd777f2e51038c4efc13ff68c777efb7ed78c9 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-06-20fix(uti): export correct units in cps ndrpdrVratko Polak1-1/+1
Compute Bandwidth keyword returns value in Gbps, as that is convenient for test messages. Export Search Bound keyword expects value in bps, as that is convenient for JSON export. While the conversion was present in Display Single PPS Bound keyword, it was missing from Display Single CPS Bound keyword. Now added. Change-Id: I5bb5934beeecfa2ee1b77dd1b1bfc788d034c845 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2022-06-20style(robot): capitalize two keywords properlyVratko Polak1-6/+6
This is just to make the subsequent fix more readable. Change-Id: I7cebcaed3f658cd026f05713ea2f94dce60786c0 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2022-06-17fix: testpmd and l3fwd check stateViliam Luc7-7/+229
+ print testpmd and l3fwd pid after start Testpmd and l3fwd utility can be started but link might not be ready yet. This fix start the utility on all DUTs and do the check later. Signed-off-by: Viliam Luc <vluc@cisco.com> Change-Id: If476e22f206d9a6a0dd399879a88eafedca92bb6
2022-06-17Add ipsec policy test suites with flow director or rss acceleratedYulong Pei6-63/+670
The test scenario is about two private networks which communication was protected by ipsec. The test suites are to show performance impovement about ipsec esp flow lookup that offloaded by NIC flow director and rss. Verified on 3n-clx and Intel E810 NIC environment, with 64B ipsec packet flow, performance improved ~31% with 1C2T, ~110% with 2C4T, ~250% with 4C8T. Signed-off-by: xinfeng zhao <xinfengx.zhao@intel.com> Signed-off-by: Yulong Pei <yulong.pei@intel.com> Change-Id: I30aec8c5115e5a6fbef88c11d1bef2624029d1b9
2022-06-17doc(infra): ICX onboardingPeter Mikus4-158/+227
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I542a16dcc1f00b0cc2a9f1bce873b0e67d60b69e
2022-06-15feat(jobspec): Avoid tests affected by CSIT-1830Vratko Polak15-144/+228
+ Replace TCP TPUT 100b tests on xxv710 NICs with 1518b ones. + Keep UDP TPUT tests at 100b for now. + Add both 100b and 1518b TCP TPUT tests to Denverton. + Its x553 NIC is not affected. + That gives us some comparison on how packet size affects performance. Ticket: CSIT-1830 Change-Id: I5544f7ba84d4813148bcad2f9d64634939492647 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2022-06-15feat(tests): Remove PPS tests.Vratko Polak29-1859/+200
+ Delete nat44 pps suites. + Rename ip4base suites, testcases, suite tags (also tg) to -tput. + Also robot tags like UDP_PPS and TCP_PPS. - Keep traffic types and traffic profile names with pps. + They can be renamed in a different change if needed. + Update job specs. - Do not update methodology yet (avoid conflict with another Change). Ticket: CSIT-1829 Change-Id: Ic0dac441f6e8253edce88e057ab7fad1d3814c24 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2022-06-15Feat(uti): Last failed testsTibor Frank12-91/+687
Change-Id: Ifac36b3f2c886a78cb8a7922f98a760287d631ef Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-06-15feat(infra): SnowRidge docsPeter Mikus3-50/+126
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Ie53e1e7474542547d73bdfe2a234e6e838bdd454
2022-06-14fix(vlan): do not apply strip offloadVratko Polak3-37/+1
Some tests (bonding) are failing as VPP refuses startup.conf. That is because the config parameter support has been removed: https://gerrit.fd.io/r/c/vpp/+/34822 That is VPP commit 8c8531c15c9195c2c82695eff6e70887de67fd88. According to commit message, it was just a workaround for Cisco ENIC cards, which are no longer tested in CSIT. + Delete 1 robot and 1 python keyword as they become unused. Change-Id: If53e324a27cfbd4659e49ab8bcd03253642dde96 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2022-06-14fix(stl_traffic): track both ports on unidirVratko Polak2-146/+130
Even if the suite asks for unidirectional stateless traffic, in some circumstances (e.g. reconf tests) stats from both ports are needed to determine overall loss. Enabling both ports unconditionally fixes that without any negative consequences. Latency info is still gathered only for one direction in unidir tests. Change-Id: Ifec6603d6103c9981fc0af02a81b0db215ccb77c Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2022-06-14doc(report): Update test environmentPeter Mikus3-3/+14
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I9987cac1493ea75eb097a0f2123768eec1ca3d73
2022-06-14fix(infra): Topopology link swapPeter Mikus1-2/+2
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I20fc441cb46b70b2c315a2c865c3d11e3c341212