aboutsummaryrefslogtreecommitdiffstats
path: root/resources/libraries/bash/entry
AgeCommit message (Collapse)AuthorFilesLines
2023-08-17Add ability to parse more kinds of test resultsVratko Polak1-2/+0
Previously, only BMRR results were recongnized. Now also lower bounds for PDR (optionally NDR) and soak are recongnized. This code expects all tests are of the same type, e.g. when both MRR and NDRPDR tests are run, only MRR result will get parsed. If test or parsing fails, generate fake data based on overall pass or fail, so at least passrate of unknown tests can be compared in theory. Currently affects only per-patch job (vpp-csit-verify-perf-*), but is useful mainly for the upcoming bisect job. + Do not force MRR test type in vpp-csit jobs. - Some test results are still not recognized (e.g. hoststack). + Do not exit per-patch job early on robot failure. + Only changes that introduce a failure (not present in parent) get -1. + The same is true also for introducing unrecognized test results. - The fake values from passrate can be misleading. + Add default nic tag only if NIC tag is missing. + In all jobs, not only in vpp-csit ones. + Do not add NIC tags for device jobs. - No job supports NDR parsing yet. + Can be enabled in future from ci-management side. Change-Id: Iee904116d1ffed69aec7e31821c67d8447f49ebe Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2023-07-07fix(core): Remove output_info.xml processingoper-230710pmikus4-17/+17
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I1528d7760228d50a4d89c0e413ad86aa882088ed
2023-05-30fix(dpdk): Flip routespmikus1-1/+1
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I4c192210e1aef1275e8a9b56eab7956798aca15d
2023-05-29feat(tox): Cleanup docspmikus1-51/+0
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: Ia13e920ef11d364893a51957778e60084f4ac0f9
2023-03-24fix(bootstrap): EB deploypmikus1-1/+1
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I44fd0fd94ba91758cfa37b11cba44955a0b24f72
2023-03-20feat(bootstrap): CDash CIpmikus3-13/+13
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: Ia9f5b1c9036b9f09c4d9bb041a41e9b49d2ead7f
2023-02-16fix(bootstrap): per-patch perf: apply zn2 trex fixVratko Polak1-1/+2
+ per_patch_device does not need that call (yet). Change-Id: I4c85a038962a2cfea3fa91bb4a3c37a8348132ca Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2023-01-17feat(model): Simplify logicpmikus1-65/+0
Signed-off-by: pmikus <peter.mikus@protonmail.ch> Change-Id: I461899d72e92e5c5db9f64261206ec0e6704e0c8
2022-06-30style(tox): prepare for fixer scriptsVratko Polak9-13/+23
The previous code assumes each tox script is a checker. We want to add fixer scripts (not voting but editing) soon. This is the less interesting part of the process, renaming things and updating comments. Includes some basic descriptions of how fixers differ from checkers. Change-Id: I1ca1572a328acd02b41dcf4e70d7cb3746a03b03 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2022-06-17fix: testpmd and l3fwd check stateViliam Luc2-0/+78
+ print testpmd and l3fwd pid after start Testpmd and l3fwd utility can be started but link might not be ready yet. This fix start the utility on all DUTs and do the check later. Signed-off-by: Viliam Luc <vluc@cisco.com> Change-Id: If476e22f206d9a6a0dd399879a88eafedca92bb6
2022-01-25fix(core): Remove unused stuffPeter Mikus1-60/+0
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I0cfc9d9fbb1a82a308231a5d2c0b12cb632c469b
2022-01-17fix(uti): Fixing broken code part VPeter Mikus1-2/+2
- UTI export breaks local execution - disabling useless tox rules Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I2f610b08f06f437e4482f291fa7b47cbb7b92984
2021-12-15Tox: Add checker for CSIT model versionVratko Polak1-0/+65
+ Implementation stub so checker can check already. + Also add documentation stub for the implemented model. + Checker checks also for bumps in documentation version. - Not comparing implementation and documentation version yet. Change-Id: I4d19c00315a1c171de325c4494c28f5210635f32 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-11-10Fix autogen.sh checkerVratko Polak1-2/+2
Previously, the FAIL message was not printed. Change-Id: Id3fc6c126edd42b55cec73294696a0426a73d634 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-08-24Fix vpp-csit device jobVratko Polak1-2/+3
It uses different bootstrap than csit-vpp. Just cherry-pick the edits from https://gerrit.fd.io/r/c/csit/+/33513/15/resources/libraries/bash/entry/bootstrap_vpp_device.sh + Match just *device* when reading testplan. + Do not prepend MRR for vpp device jobs. Change-Id: I13e171551ebc87af0ac3e3a1a1bcfae7cad8326c Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-08-23FIX: Docs generationpmikus1-12/+6
+ Tests will be fixed with renamed hoststack tests. + Tox is at least working Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: Ibee30cd54c78b67d2ef907cdd14a71ae197be59e
2021-08-23DPDK build: fix l3fwd build and update Meson optsJuraj Linkeš1-2/+2
Fix l3fwd patch which broke because the code got moved. Rework two Meson options: * RTE_LIBRTE_I40E_16BYTE_RX_DESC using Meson option c_args instead of CFLAGS. According to Meson docs, using c_args is the proper way to pass C compiler arguments and the support for CFLAGS is there for legacy reasons and not guaranteed to work. * Add platform=generic which mirrors VPP configuration. This removes the need to hack Arm CPU and NUMA values as the generic build uses high enough values. Change-Id: Ibcb17879bdf26329881819c332c1782b9c713182 Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2021-08-20Move tc_naming to generic placepmikus1-140/+0
+ Mental excercise Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I40ca8e4ded9c898b9435bf00b8b16983143ed7c9
2021-08-20Tox: Remove obsolete checkerspmikus1-100/+0
+ coverage is not used + naming is now covered fully by suitegen which can be improved to do detections of packet encapsulations Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I9631988e144d3878a6b146214e3aea75694ebf3f
2021-08-19vpp_device: Multiple NICs (suitegen)pmikus2-4/+5
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I81958fbf6ef240d53a0fb8708ca882baf02f606c
2021-08-19Migrate report/trending/docs to bash frameworkpmikus3-0/+96
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: Idf8462f15a2dd76b42dcaea9df6a0fc15a45503f
2021-07-12Tox: Move logs to archive also on -1Vratko Polak1-3/+4
Change-Id: Id29925da9c8e0bc0a28a9f4d38c332852c687317 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-07-09CI-MAN: Unify backupspmikus1-0/+6
+ tox must follow the $WORKSPACE/archives rule Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I717afded894c3a5468bbf5013b242be5e1a9cb6e
2021-07-08Infra: AWS Jenkins Integrationpmikus1-1/+3
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I5910ce0701f865403aa772c7ad5d8eb126c6ec2c
2021-06-16Line length: Fix recent mergesVratko Polak1-1/+2
Not fixing .rst, .md, .yaml, conf.py, .vat, and so on. Change-Id: Icc585d6dbebc8eb5c483b10326302571e94c614d Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-06-10FIX: Pylint reducepmikus20-20/+20
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I909942dbb920df7f0fe15c0c92cda92c3cd8d8ad
2021-06-01Tox: Run pylint also for GPLVratko Polak1-2/+2
Change-Id: Ic6c5d35dc602638b06962fcad30d8517c9553552 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2021-05-20perf: add TCP Nginx+LDPRELOAD suitesxizhanx2-3/+41
1. Suite steup add download nginx 2. Add nginx-1.14.2/1.15.0 ldp test suite 3. Add NginxUtils,NginxConfigGenerator method 4. Taskset the PID of nginx to the unused cores in VPP and these cores are under NIC's NUMA ID 5. cleanup add Kill Processes - nohup Signed-off-by: xizhanx <xix.zhang@intel.com> Change-Id: Idbf0e4ec3bf63e88281a8e3e34f52e00a6801c85 Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
2021-04-27Infra: AWS - add CSIT parameters to bootstrapTomas Alexy2-2/+4
Signed-off-by: Tomas Alexy <tomas.alexy@pantheon.tech> Change-Id: I41b5905bcaab303a74d9985283e469922e5fba94
2021-04-20tox: Add job-spec checkerTibor Frank1-0/+60
Change-Id: I2bbdc28431b6271d1950ec0e74bf708cae841146 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2021-03-20Tox: Increase verbosityVratko Polak1-2/+3
CSIT is becoming stricter in avoiding downloads during run, as everything should be pre-cached in executor image. This change makes it easier for human to detect downloads. Change-Id: If7085f96ef1033f7f9405a86232a3d39a239d3e1 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2020-12-09Tox: Add GPL license checkerVratko Polak2-1/+74
A common mistage is to add a file into GPL directory, with Apache license only. This adds a tox checker to vote -1 on such changes, gpl_license.log contains the list of affected files. There are TODOs related to unlicensed files or unconventional GPL licenses. Change-Id: I267e4fb98afd199d5acc7d211068b28c97b31dc9 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2020-12-07Fix vpp-csit device scriptVratko Polak1-1/+0
In Gerrit 30041 that was not tested properly. Change-Id: I42f57f1933b0e7d029030f4ec502f7268780827b Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2020-12-02Avoid ci-management archiving files twiceVratko Polak4-13/+9
This is a follow-up to https://gerrit.fd.io/r/c/csit/+/20394 https://gerrit.fd.io/r/20119 has changed the way archival works, everything should now go to logs.fd.io (instead of appearing on run page in jenkins.fd.io). The glob pattern for archiving is quite eager, doing recursive search. That is good, as it can find also misplaced useful outputs. But it also means our usage of copy_archives function creates two copies of archived directtories, usually archives/ and archives/archive/. This change renames copy_archives to move_archives, with few workarounds to support multiple calls. I also renamed ARCHIVE_DIR value from $CSIT_DIR/archive to $CSIT_DIR/archives to make "move" operation look natural. Finally, download_builds function is being removed, as after recent improvements to VPP compilation speed nobody seems to be using it. Change-Id: I19a429e1dfdfaab7fcf32a9609963b1aebd33c6c Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2020-06-09Remove leading tc[nn] from test namesJuraj Linkeš1-7/+5
The test names are unique without it and the information doesn't add anything extra. Change-Id: Idc7d6d1d21c8c05691e1757227a0a3787406d370 Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2020-05-26FIX: do not fail when skipping patch for l3fwdJan Gelety1-1/+1
Change-Id: I1159fb29d43f61628922cdbd51313f710aa72f4a Signed-off-by: Jan Gelety <jgelety@cisco.com>
2020-05-12FIX: L3fwd properlypmikus1-4/+4
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: Ibdfc0350a101c4815f25456176e25bb1d90fd881
2020-04-23Performance: DPDK refactorPeter Mikus7-0/+249
+ Rework BASH scripts (more code to python). + Move BASH into libraries. + Allows RDMA usage. + Fix 9000B tests. + Rename confusing l2fwd -> testpmd. + Fix suite setup. + Fix PCI whitelist to not accidentally pickup wrong interface. + Fix deprecated DPDK cli arguments. - MLX5 jumbo are disabled on NIC (i will increase separately). https://jenkins.fd.io/job/csit-dpdk-perf-verify-master-2n-clx/6/console (l3fwd still broken) - MLX5 IMIX seems to be some TRex issue with IMIX for mlx5 (i will handle separately) Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I31d1b67305fa247cb5e1f57e739d3ef30dc1a04b
2020-02-21Tox: Add copyright year tox checkerVratko Polak2-2/+72
Only added/edited files already containing copyright notice are checked for the correct year (and only if in first 3 lines). Change-Id: I22c057431847fda3a7dfd4577f8346fadfe4c4f6 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2020-02-18Perpatch: Fix bash ansible callsVratko Polak1-2/+2
The function ansible_hosts got renamed to ansible_playbook in https://gerrit.fd.io/r/c/csit/+/24511 Change-Id: Ife4e7b13f634fcdda95f80c18bc86cfded139b5d Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2020-02-04Ansible: Cleanup and speedupPeter Mikus1-1/+0
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Ia2ce482798204ad426f93f334c97e28eb51139fd
2020-01-17perf: add TCP Iperf3+LDPRELOAD test suiteDave Wallace1-3/+3
Change-Id: Icff49fb31cce342a2a4ae799e844ec91f9e5e366 Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
2019-12-02FIX: Perpatch PY3Peter Mikus1-1/+1
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Iae97cf4490fea38f5f03bdaa120ee7ae48b941ab
2019-11-11Remove the leftovers of the old testbed cleanupVratko Polak1-2/+2
Change-Id: I464db6fb6c220f23f2fe69df2c793175975d7b72 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-11-07Source ansible.sh for entry scripts using cleanupVratko Polak1-0/+2
Change-Id: Iee02577ee0c054feb61edee807182c6808f235b0 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-10-18Autogen checker: Fix difference reporting branchVratko Polak1-2/+3
Change-Id: I85da5ec38643524fa1af7ed7628025a4a52463f5 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-08-23Introduce reconfig suites, for dot1q+ip4+vxlanVratko Polak1-2/+2
Ticket: CSIT-1551 + Config copied from other suites. + Layer keywords prepared for additional chains. + Renamed "create" argument to "vlan_per_chain". + TrafficGenerator result extraction improvements. + Also unified TG type and subtype checking. + Throughput estimated as PDR for zero PLR. + Actual Qemu start is skipped. + Parse xstats instead of stats in trex stop scipt. - Because stats are unconditionally cleared on each script connect. + Remember start values to get better ReceiveMeasurementResult at stop. + Expose loss count and time as appropriate test message. + Autogen support. + Multiple chain amounts and core densities. - Only 1 additional chain. + Proper TAGs. Documented. + Clarified min framesize tags are for TG-DUT. + Added a TODO concerning overhead values. + Added 118B tag. + Robot performance keywords improvements. + Added missing return value documentation. + Frame size as required test variable, not an explicit argument. + MLRsearch keyword to store result (not into test message). - TODO: De-duplicate: main keyword to measure, minor to set test message. - But implementation uses the fact default arguments are different. + Keywords for starting and stopping background traffic. - No checks whether start-stop pair is complete. + Multiple minor indentation and logging improvements. - Missing / TODOs: - Support also vlan_per_chain=True? - Support dot1q without vxlan? - Support also deletion? - How to package config steps so -reconf can be generated from -ndrpdr? Change-Id: If0270697f9ffa837c34ef802917220a53f156703 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-08-19VPP perf per patch: Reverse the order of testsVratko Polak1-4/+5
If current VPP is broken, we want to fail early. If there is API change, we are more interested in current results, even if parent is likely to fail. Change-Id: I552485bbb9fe0053bae39de7939f94a5971bb63b Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-08-15TOX: DOC verifyPeter Mikus1-0/+59
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Ifa4de8e60742f5c4cf4c2f377692313e23f9983b
2019-08-14VAT-to-PAPI: Fix HTTP/TCP testsDave Wallace1-2/+2
Change-Id: Ie728bc73eb7429d246e82dd195fc63191c3ac51d Signed-off-by: Dave Wallace <dwallacelf@gmail.com>