aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2024-03-21feat(tests): Remove unsupported suitesVratko Polak8-1364/+0
The new suites were added in [1] and the VPP functionality was removed in [2]. [1] https://gerrit.fd.io/r/c/csit/+/28508 [2] https://gerrit.fd.io/r/c/vpp/+/31443 Change-Id: Id3fa984bf9f61a1dd831d637695ac6844c86ffc8 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-03-20fix(report): Two more issues found so farVratko Polak1-1/+4
Change-Id: Ie3b8bf1a0068f0c085806526c97d964b8488b777 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-03-20job-spec: Add DMA testsTibor Frank4-0/+62
Change-Id: I6530519eaab2d09a187dddd803815888606ff17d Signed-off-by: Tibor Frank <tifrank@cisco.com>
2024-03-18Update VPP_STABLE_VER filesTibor Frank1-1/+1
Change-Id: If6157519e738f47b2d284bb02592bb25380cc17a Signed-off-by: Tibor Frank <tifrank@cisco.com>
2024-03-14feat(tests): Fix scaling of 6p3nicoper-240318pmikus25-87/+317
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: I84d9cf2892423e62b116b07982d3e87120b66271
2024-03-13feat(report): Add currently known issuesVratko Polak2-5/+42
Analysis is not finished yet, some updates may arrive next week. Change-Id: I7a51e279fbb2807ee4064affda8ad445bbd01b02 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-03-12C-Dash: Add tooltipsTibor Frank8-101/+201
Change-Id: I00cf78e2e777fa96754f7b06aab02a8bf8682da5 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2024-03-11C-Dash: add "download row data" feature to comparison tablesTibor Frank2-28/+87
Change-Id: Iaf5a57402e954453c237fb1e082da6c620cff59f Signed-off-by: Tibor Frank <tifrank@cisco.com>
2024-03-11C-Docs: Add a procedure to "Search tests".Tibor Frank2-1/+12
Change-Id: I2b00894c6690cc1ae69d202f90fd9624c271832b Signed-off-by: Tibor Frank <tifrank@cisco.com>
2024-03-11Update VPP_STABLE_VER filesTibor Frank1-1/+1
Change-Id: I70dcb89767587e225bf2585349211953e6ac8713 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2024-03-07C-Dash: Add possiblity to remove outliers from comparison dataTibor Frank3-26/+100
- extreme outliers only for now Change-Id: I2be7c291dd207d5a557947415a960fa6d0067c64 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2024-03-06C-Docs: Update release informationTibor Frank2-4/+82
Change-Id: I77dbc422f502d0c342177598d30b3bcca7ea5e06 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2024-03-05feat(ietf): MLRsearch draft-06Vratko Polak3-1462/+1638
Change-Id: Ia9e22ba1eca74a32ae7141b1bd111bdb9baaddf3 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-03-04feat(device): cx6 update of 1n-alt device jobspecJuraj Linkeš2-70/+126
Update the jobspec according to the current Arm policy: 1. Run most of the tests on cx6, crypto coverage being the most important, 2. Match the cx6 ipv4 crypto coverage with x710 with the DPDK driver, 3. Run basic ipv4 and l2 tests with x710 with borh DPDK and native (avf) drivers. The above is the policy used in performance testing where time is a major constraint. The same is true for functional testing to some extent, so it makes sense to apply the same logic for choosing the tests. There are 10 tests which are failing on cx6 without an identified reason. They are disabled until we find the root cause and address it. In the meantime, the tests are enabled for x710 with the DPDK driver: ethip4-l2xcbase-eth-2memif-1dcr ethip4-l2bdbasemaclrn-eth-2memif-1dcr ethip4-l2bdbasemaclrn-eth-2tap ethip4-l2bdbasemaclrn ethip4-l2bdbasemaclrn-iacl1sf ethip4-l2bdbasemaclrn-iacl1sl ethip4-l2bdbasemaclrn-oacl1sf ethip4-l2bdbasemaclrn-oacl1sl ethip4-l2patch ethip4-l2xcbase When the cx6 issue has been resolved, these should be enabled for cx6 and disabled for x710, with the exception of ethip4-l2bdbasemaclrn, which should be running on both. Change-Id: Id48f450063e405b1faca57431676f91d62e829b9 Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2024-03-04Update VPP_STABLE_VER filesTibor Frank1-1/+1
Change-Id: Ib84e4f147583c25c3fccff27a493dc07b37f7d9d Signed-off-by: Tibor Frank <tifrank@cisco.com>
2024-02-28C-Dash: Add search in testsoper-240304Tibor Frank44-557/+1909
Change-Id: Ia250c4b4e299d48bc68cf01e65fe37a281047060 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2024-02-28job-spec: add more ip4scale tests to 2n-spr and 3na-sprTibor Frank4-0/+40
Change-Id: I9c9a6ecd6698cb58e7114543de54eb01549d4af0 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2024-02-26Update VPP_STABLE_VER filesTibor Frank1-1/+1
Change-Id: I9d6047a698c485e664f67bb4ea8847f683d0f688 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2024-02-19Update VPP_STABLE_VER filesoper-240226Tibor Frank1-1/+1
Change-Id: I84c7886a6181d24460665cd82ced2f83ced6f415 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2024-02-16feat(device): 1n-alt ansible improvementoper-240219Juraj Linkeš2-11/+21
We're seeing extra IGMP traffic which interferes with tests which must be disabled. This is done by disabling the setting by default on all interfaces. The default setting is also adopted for other traffic-related configuration: Default sets the configuration when the interface is created. For hardware interfaces, that is at boot time. For VF interfaces, when we create them with the csit-initialize-vfs.sh script and for virtual interfaces when they're created. On the other hand, the all configuration option doesn't set the configuration. It uses the current configuration value along with the passed configuration value to produce a new value, which could be expressed as: f(old_value, value_from_all) -> new_value Where f is a function specific to each configuration option. Using all thus requires us to know the function and the old value which is less reliable than just using default everywhere. Also fix the 1n-alt VF init script. Change-Id: I3da15abfb5a1e76769076edd95d20e2168b6f71f Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2024-02-16feat(device): add cx6 to 1n-alt ansibleJuraj Linkeš2-36/+37
Also update 1n-alt hardware with info from dmidecode and port names to match the rules in Testbed Naming Convention. Change-Id: Ib654adaec5667f0e79a3cb86edfbf4578f5c3d5f Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2024-02-15fix(core): daily jobs should not do prefixingpmikus1-5/+7
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I131cc9957b288f4e02e9d02394a1681dbb539d83
2024-02-15fix(bootstrap): typopmikus1-1/+1
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: Ib2a1ceb9145ef5495c76954ac70cedc5af6fa297
2024-02-14fix(core): Lower amount of TREX cores for externalpmikus1-1/+1
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: Ic27f46876a93cc01d5f14bbefe0dccd84ab41027
2024-02-13feat(bootstrap): Add ability to load external NODE_FLAVORpmikus11-1/+537
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: Ia6e07111af543280b2365840bced02f94cf91e75
2024-02-13feat(core): QAT RXQ allocationpmikus1-4/+8
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: I78501f08b29a202c0e1129b79af6a63299e8ee36
2024-02-12Update VPP_STABLE_VER filesTibor Frank1-1/+1
Change-Id: I27030c7fed6afc0b7ea975f4a6a87d29571d48cd Signed-off-by: Tibor Frank <tifrank@cisco.com>
2024-02-07fix(bootstrap): skip suites for virtual NICVratko Polak2-2/+16
As the skipping logic looks at available topologies, fix skipping by adding virtual to vagrant.yaml Change-Id: I5e7bf1dc2f4f4787917f1f989a974255cf2591a9 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-02-06Add memif with DMA test suitesxinfengx11-4/+944
Change-Id: I8c27b5956c0c26bb2de48321675e285ed961412f Signed-off-by: xinfengx <xinfengx.zhao@intel.com>
2024-02-05Update VPP_STABLE_VER filesTibor Frank1-1/+1
Change-Id: Ic982380b831d0092597136812def84e0a8b7dde5 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2024-02-01Update VPP_STABLE_VER filesoper-240205Tibor Frank1-1/+1
Change-Id: I46a2f6669247b904570c7301854ec25fbb61cecf Signed-off-by: Tibor Frank <tifrank@cisco.com>
2024-01-31feat(job_specs): 2n-c7gnpmikus11-42/+196
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: Idca0738320b56196e98aeec3050312111a90609a
2024-01-31feat(terraform): 2n-c7gnpmikus6-33/+13
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: I7a1f9744c4ca8abbd4814ab6cccba388ef466f50
2024-01-31fix(autogen): Do not set nic_code from nic_nameVratko Polak1-8/+1
This should fix some suites wrongly using nic_pfs=6. Change-Id: Ifb7bd24b9a2d1764634eea4a43b4509f16e03da2 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-01-29feat(infra): SSH keyspmikus2-3/+3
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: Ia992a02b84450cd463b2fdce1d860d9133df6a55
2024-01-29Add ssh key for csit nomad host accessNaveen Joy18-0/+19
Change-Id: I71f0139fb5dc2be7f32124e287929ceb0091fc9a Signed-off-by: Naveen Joy <najoy@cisco.com>
2024-01-29Update VPP_STABLE_VER filesTibor Frank1-1/+1
Change-Id: Iaa49c676d7b952a15eda428749d30aa47b7600c6 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2024-01-26C-Dash: Add bandwidth to MRR iterativeTibor Frank3-7/+6
Change-Id: I86e4322796a47c952b3b248419b01a7fa2da12c7 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2024-01-25feat(terraform): Migrating old structurespmikus21-763/+226
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: Ib953739b4d34a7f803bff54cec92a2130fcbbc66
2024-01-25C-Dash: Add 2402 dataoper-rls2402-240125Tibor Frank7-48/+70
Change-Id: I5b5dba1525070e9d45322b453e441239a6069a03 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2024-01-24fix(PLRsearch): handle unsent packets as lossVratko Polak1-5/+20
Change-Id: Icaa88523ede0b1fad6e6cb667a8f307ea5f4a12d Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-01-24fix(PLRsearch): fix some pylint violationsVratko Polak3-6/+6
- Complexity and logging would require a larger change. Change-Id: I69f8e47b1806c880cd626bc5a8f5ae6290246093 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-01-24style(PLRsearch): format according to blackVratko Polak4-99/+157
Change-Id: I26e0ce172740f7f440469578294f8c13fec5850b Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-01-24feat(PyPI): update metadata for jumpavg 0.4.2Vratko Polak7-85/+128
+ Convert readme to .rst + Add Usage including a basic example. - Detailed description points to C-DASH methodology. + That page is updated for new defaults and better description. + Unify readme layout and origins with MLRsearch metadata. - Not releasing new MLRsearch version just for readme improvements. + Update the TODO file. Change-Id: I76ac22b7f283f01349bf9a50459dc841e13b21ad Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-01-24Update VPP_STABLE_VER filesoper-240124Tibor Frank1-1/+1
Change-Id: I2ef48078c9fbcec2113417e4e9db3103596c45f1 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2024-01-23feat(infra): 1n-altpmikus2-1/+11
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: Iea69bcd730f641504428f1400e5c6eb6d6b755dd
2024-01-23docs(infra): 1n-altpmikus4-36/+41
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: I1770a3f49e19d337d4ed6760fb062ba4d445574d
2024-01-23feat(device): Add 1n-alt vpp devicepmikus9-119/+125
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch> Change-Id: I3d2bb0408f15fd14989d1179d7f08710a3d86e67
2024-01-22fix(jumpavg): Tolerate zero sized runsVratko Polak1-1/+3
Change-Id: I7c2426fe47ca9ee44338423597be90a71aaa3653 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2024-01-22feat(bisect): Tolerate zero testsVratko Polak1-8/+10
Needed when the anomaly causes failure in the global suite setup. Also needs a jumpavg fix, in the subsequent change. Change-Id: Ifa8f8fcfc0b25416afa064e606a59b79aa279b61 Signed-off-by: Vratko Polak <vrpolak@cisco.com>