aboutsummaryrefslogtreecommitdiffstats
path: root/resources/libraries/bash/function/common.sh
AgeCommit message (Collapse)AuthorFilesLines
2023-09-08feat(infra): Add 1n_sprpmikus1-3/+7
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I20e720302561f5f7d1f7a80a83548077a88025af
2023-08-17Add ability to parse more kinds of test resultsVratko Polak1-8/+6
Previously, only BMRR results were recongnized. Now also lower bounds for PDR (optionally NDR) and soak are recongnized. This code expects all tests are of the same type, e.g. when both MRR and NDRPDR tests are run, only MRR result will get parsed. If test or parsing fails, generate fake data based on overall pass or fail, so at least passrate of unknown tests can be compared in theory. Currently affects only per-patch job (vpp-csit-verify-perf-*), but is useful mainly for the upcoming bisect job. + Do not force MRR test type in vpp-csit jobs. - Some test results are still not recognized (e.g. hoststack). + Do not exit per-patch job early on robot failure. + Only changes that introduce a failure (not present in parent) get -1. + The same is true also for introducing unrecognized test results. - The fake values from passrate can be misleading. + Add default nic tag only if NIC tag is missing. + In all jobs, not only in vpp-csit ones. + Do not add NIC tags for device jobs. - No job supports NDR parsing yet. + Can be enabled in future from ci-management side. Change-Id: Iee904116d1ffed69aec7e31821c67d8447f49ebe Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2023-07-14feat(aws): Add new flavorspmikus1-2/+103
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: Ie63b3d6c7ff376d808587e7c96f386946c939a81
2023-07-07fix(core): Remove output_info.xml processingoper-230710pmikus1-41/+19
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I1528d7760228d50a4d89c0e413ad86aa882088ed
2023-06-12feat(infra): Add Mellanox CX6 to 3n-icxpmikus1-1/+1
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: Ic13b8cd3f2976c66d8956f0cee0784c3bae12a65
2023-06-09feat(infra): CX6 for 3n-altoper-rls2306-230612pmikus1-0/+1
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: Iea4c536a6e421efdaf493fb3cba0dde5abad162d
2023-06-06fix(core): Trap for AWSpmikus1-1/+1
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I14975b21e7f480c3bca5ba6a04514008af219039
2023-05-25fix(core): Missing linkpmikus1-3/+0
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: Iccbe5f0cabe6fdd5274126cf970549673edd4f1c
2023-05-16fix(infra): Bootstrap scriptspmikus1-0/+8
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I4e19d8fe38802652b25e6a1c577e816328cebd2d
2023-05-09feat(job_specs): Add 3nab-sprpmikus1-4/+17
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I2e0feccef5c5b15b035490dfaf521c8c9a1795f8
2023-03-28feat(core): Add 2n-spr topologypmikus1-0/+1
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I3f7efcbfc82f683e7afc986d00fa71ae7413d93d
2023-03-20feat(bootstrap): CDash CIpmikus1-1/+9
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: Ia9f5b1c9036b9f09c4d9bb041a41e9b49d2ead7f
2023-03-13feat(docs): Move job_specs to resourcespmikus1-1/+1
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: Iee0ded1f2fb43a09a7a1d61f593f4e92ead3dbb3
2023-02-23fix(core): SPR includepmikus1-0/+4
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I3308f12046dfeed7db872a3a901806acf81cdb15
2023-02-09feat(infra): Introduce 2n-spr 3n-sprpmikus1-6/+24
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: Ied301e8fcca22af8420364f2e158dfdd49bdc58d
2023-02-02fix(job_spec): Naming conventionspmikus1-1/+7
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: Iccaa4f8945e5eb48272737338a52c9edbf1cb58b
2023-01-25fix(core): common.shpmikus1-0/+1
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: Iab5e8c21e4defb92e257459a64101a6f19609917
2023-01-11fix(core): Remove some Focal leftoverspmikus1-7/+2
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I1c7df34cfb78cf767081acea435dc205b3f44a15
2022-12-15feat(core): DNV decommissionpmikus1-34/+0
- Static content will be removed separately Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I0992e941e1c24552837eaf7e8d3f6564b3cb21c8
2022-12-06feat(model): Cleanup and introduce telemetrypmikus1-18/+0
- Due to divergence from original design path the RAW was never consumed. It adds too much code complexity and requires processing on both storage and compute. Removing entirely to make modeling efficient. - log (apparently SSH) section will never be consumed in the way it is coded in model. This section is also not part of model schema itself due to the point above. - Introducing telemetry section that is going to carry telemetry items required for CDash. Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I7e0256c6c9715de8ee559eed29dce96329aac97d
2022-08-25fix(core): Ubuntu Jammy VIIPeter Mikus1-0/+5
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I2a7e35bc3671cafaf696e5200d22e531e251b1ba
2022-08-23feat(infra): Remove 2n-skx/3n-snx leftoversPeter Mikus1-17/+1
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Ic646f555855b1a13a86711ce4ce01ddfc2b44b1f
2022-08-22fix(core): 3n-snr codePeter Mikus1-1/+1
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I1ff6ce2eeaf074773f27ce0d4d414c4963a7a2de
2022-08-22fix(core): 3n-snr codePeter Mikus1-1/+5
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Id4b8f033c5a6e30ed0d64d3306858d0f06991017
2022-08-08feat(pip): UpgradePeter Mikus1-2/+1
Due to some integration changes with upcoming Ubuntu 22.04 (and mainly python) bump, upgrading the full pip package list to latest version. Keyword 'BuiltIn.Run Keyword Unless' is deprecated - will be part of subsequent change Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Ie3bdc424c7c0efb4fe4f1fa7c73137b916c17116
2022-07-14feat(core): Add 3n-snrPeter Mikus1-0/+9
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I2ff6393aa885f03ba52a2cf79d49dac1815e2a86
2022-05-17feat(perf): T-Rex core usage 2n-zn2Peter Mikus1-2/+5
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Ife55633c620a3c762f4d939013a7f6fafb640aa6
2022-05-16Core: T-rex 2.97pmikus1-1/+1
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: Id4d84aa7268080843b099fd7ab9851234612968b
2022-04-04feat(core): update 3n-altJuraj Linkeš1-2/+10
Update ansible, topologies, bash scripts and job specs. Change-Id: I834b991f281e0b29b4af9dc37fe8028460298d83 Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2022-03-30feat(terraform): 1n_aws_c5nPeter Mikus1-16/+26
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I12d2d58de01693b18628cd73b5d8c36467506f32
2022-03-30refactor(terraform): 2n_aws_c5nPeter Mikus1-2/+2
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I5f68fd84a9ea034c5d8ff175807033aa0b60d5a2
2022-01-24feat(core): Add ICXPeter Mikus1-4/+31
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Ic676d00bd7d3d5d8c244bfd0eb7b10bc74498505
2022-01-12fix(uti): Fixing broken code part IVPeter Mikus1-2/+2
Part of fixing chain Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Ie423ccf5a51751e605d906dd1214f5174bb364ac
2022-01-07fix(uti): Fixing broken code part IIIpmikus1-8/+7
Part of fixing chain after early merge. Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I06e19def003575993bc3d97c0dc7fbedd3e5ff7a
2021-12-22fix(uti): Fixing broken code part IIpmikus1-33/+40
Part of fixing chain after early merge. Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I983b3036a388656bbad91aba71cf14b503f875bd
2021-12-22add 2-node ipsec hwasync casesxinfeng zhao1-1/+0
Signed-off-by: xinfeng zhao <xinfengx.zhao@intel.com> Change-Id: I1590d438216e4c886aae03f83364837153623dbc
2021-12-15UTI: Export resultsVratko Polak1-1/+28
+ Model version 1.0.0. - Only some result types are exported. + MRR, NDRPDR and SOAK. - Other result types to be added later. + In contrast, all test types are detected. + Convert custom classes to JSON-serializable equivalents. + Sort dict keys before converting to JSON. + Override the order for some known keys. + Export sets as sorted arrays. + Convert to info content from serialized raw content. + Also export outputs for suite setups and teardowns. + Info files for setup/teardown exist only temporarily. + The data is merged into suite.info.json file. + This simplifies presentation of total suite duration. + Define model via JSON schema: - Just test case, suite setup/teardown/suite to be added later. - Just info, raw to be added later. + Proper descriptions. + Json is generated from yaml. + This is a convenience for maintainers. + The officially used schema is the .json one. + TODOs written into a separate .txt file. + Validate exported instance against the schema. + Include format checking. + Update CSIT requirements for validation dependencies. + This needs python-dateutil==2.8.2, only a patch bump. + Compute bandwidth also for soak tests. + This unifies with NDRPDR to simplify schema definition. - PAL may need an update for parsing soak test message. + Include SSH log items, raw output only. + Generate all outputs in a single filesystem tree. + Move raw outputs into test_output_raw.tar.xz. + Rename existing tar with suites to generated_robot_files.tar.xz. Change-Id: I69ff7b330ed1a14dc435fd0ef008e753c0d7f78c Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-10-20fix(Terraform): Change AWS AZpmikus1-0/+1
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I19c160e40e01bd7f69c08188f61d2bcbc3fd4bcb (cherry picked from commit 8be983ad917cd47fa8da4256fa8ada14ecfcd425)
2021-10-08Add flow test suitesxinfeng zhao1-0/+4
The comms DDP package needs to be installed to support all flow protocols Signed-off-by: xinfeng zhao <xinfengx.zhao@intel.com> Change-Id: I6ab1bd8beb9edb8c9889a0ed9a999080ca3cef3d
2021-10-06Bash: Process job-specs without cores and driversTibor Frank1-1/+3
- job-spec for trex tests modified Change-Id: Id04d76648f30baacfa027b182a838d2f681afcec Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-09-07Terraform: Add job name as VPC IDpmikus1-0/+3
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I82819c924012c966ba91fdf39ffba500ee0ce6b0
2021-08-24Fix vpp-csit device jobVratko Polak1-7/+9
It uses different bootstrap than csit-vpp. Just cherry-pick the edits from https://gerrit.fd.io/r/c/csit/+/33513/15/resources/libraries/bash/entry/bootstrap_vpp_device.sh + Match just *device* when reading testplan. + Do not prepend MRR for vpp device jobs. Change-Id: I13e171551ebc87af0ac3e3a1a1bcfae7cad8326c Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-08-19vpp_device: Multiple NICs (suitegen)pmikus1-62/+11
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I81958fbf6ef240d53a0fb8708ca882baf02f606c
2021-08-19vpp_device: Multiple NICs (infra)pmikus1-0/+2
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: Ie8662b6a485374b5df68dec9c82065cf59f28c8f
2021-08-06Verify tags: Use suite tagsVratko Polak1-5/+5
When I make a typo in GERRIT_EVENT, old code starts many ASTF tests. Change-Id: Iac1c2cc620919d33b0e77bd28b145f3fd38d28ff Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-07-19Report: Add rls dataTibor Frank1-0/+1
Change-Id: I9c81563c904b02c5ca6ede5dc3d0922851c11ae4 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-07-13job-spec: Add hoststack and vsapTibor Frank1-0/+1
+ hoststack + vsap (cps, rps) + add e810cq to common.sh Change-Id: I2e897597d13e488f7324a7b91826ca32fd93c84f Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-07-08Infra: AWS Jenkins Integrationpmikus1-30/+38
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I5910ce0701f865403aa772c7ad5d8eb126c6ec2c
2021-06-16Line length: Fix recent mergesVratko Polak1-1/+2
Not fixing .rst, .md, .yaml, conf.py, .vat, and so on. Change-Id: Icc585d6dbebc8eb5c483b10326302571e94c614d Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-04-27Infra: AWS - add CSIT parameters to bootstrapTomas Alexy1-0/+25
Signed-off-by: Tomas Alexy <tomas.alexy@pantheon.tech> Change-Id: I41b5905bcaab303a74d9985283e469922e5fba94