aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2021-08-02Report: Add Latency comparison tablesTibor Frank3-8/+781
Change-Id: I6774383eef9839352ed3924e7482177fd85b34e6 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit f615617a46a21107a9a827a13035997e91bf6d3f)
2021-07-28PAL: Add s3-logspmikus4-0/+24
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: Ia8cc2c59a84a61263b2cf88af16f6fd7bad637a8 (cherry picked from commit d102788108352fd5271b139ef3ef1a1c718389a1)
2021-07-28CSIT-1782: 4c AVF tests are failingpmikus1-2/+13
+ Implement temporary ugly workaround as I cannot do driver upgrade now after discussions with PTL. Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I400e3b61bd831b9c9820b1fab8852118f2d48f0e (cherry picked from commit 9e86d195050fcd75c20d59f78d6f5a5e379a6a86)
2021-07-28Report: Add rls dataTibor Frank1-5/+10
Change-Id: I2ad71d35bb2503adbe10cf3e7982e883339a4fee Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit cf63723c2758fb5561bd1810a2725b1e187f9c1f)
2021-07-27FIX: Executable bit for ansible pluginpmikus1-3/+5
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I2416a9682710441d098acfff50e943ac3f788500 (cherry picked from commit f7c3f3918646a7bb157e648ed96beb9bb5c232ea)
2021-07-27Report: Add rls dataTibor Frank1-1/+2
Change-Id: Ia101a6d412473d957a81d794f34f1c1d2ad58abb Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 0d9bed4128719f3de748af108dc6259927efde29)
2021-07-26Infra: Terraform add ansible plugin initpmikus1-0/+113
+ Manual override Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: If296d28dc3eaa023c935a0887a14ac10e83076ba (cherry picked from commit b27f2c7cbfe08712a00959c8cc6a2f618a25b3e7)
2021-07-26Trending: Save latency data in csv filesTibor Frank5-18/+69
Change-Id: I397dc1711f52324c158c775522cfef3044724ad7 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit a4fe771848907ee4a551cf06432f1ec6da496608)
2021-07-26Report: configure rls2106.30Tibor Frank3-3/+10
Change-Id: If1af4d7c5865a7466eda5c2de18d07ff9491d458 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 53e6c3440afd81d1504db75e7fa8d09229641079)
2021-07-26Report: Add af-xdp dataTibor Frank12-56/+1254
Change-Id: I8beef5f0072e0c52476a8053f26640c537422a63 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit e8b47c3df7529a6c087fb7639684f180dad8c03d)
2021-07-23Trending: Add exception handling for anomalies classificationTibor Frank2-1/+9
Change-Id: I6f2ee7552c513ccf2fa453f143dd52ea880bd412 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 1da19da813655f643bc3c6e4d03bed987f076f07)
2021-07-22Report: Add rls dataTibor Frank1-0/+1
Change-Id: Id234d16ebbca84b663f23d295accddaf8c045417 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit a8d0c4410095c6b87f81bd541ca7ec91e6d62b70)
2021-07-22Report: Add af-xdpTibor Frank48-306/+1864
- elements(tput, speed-up) - static content (tput, speedup) - data - Latency Change-Id: I793fd4e6e6b189d93a267635b8bf07baad19accd Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit c5b94383d2eb8ea33413296a3295759b84915546)
2021-07-22Report: IPsec udir methodologyJuraj Linkeš1-11/+34
Update IPsec uni-directional tests methodology. Remove Deep SPD Policy section as these tests are not in the report. Change-Id: Idca538a03a05e12130c7d786c098b218fa88f7ef Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech> (cherry picked from commit dea4d7ff2a1b662cde1587b3a8d6c3d832f4920e)
2021-07-22Trending: Add graph with statisticsTibor Frank10-228/+678
- x-axis: time [MM-DD] - y-axis: nr of passed/failed tests - y-axis: build duration Change-Id: I269af5a728a32d02ffcdecc7e25138ad1a183c4b Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit d8fc1521b8def68adc8f4a390aa2d25db806ea4f)
2021-07-21Perf: Enable af_xdp for Intel x500 seriespmikus1-2/+3
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: If45e592aeade12fe643791b431adc860a745be3d (cherry picked from commit fe9072ce82a91c5d6de30d07756d5a12b80f9c74)
2021-07-21Perf: Enable af_xdp for Intel x500 seriespmikus1-2/+2
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I331fe9134c62594189ca231349ab4c5ba43b51e5 (cherry picked from commit 813375246758d1695be4e577ba9cd3f0791ea9e3)
2021-07-21job_specs: 2n-tx2 add af_xdp tests to report_iterative, daily and weekly jobsMaciek Konstantynowicz2-5/+123
- Testbeds covered: 2-node ThunderX2 testbeds. - NICs covered: xl710. Change-Id: Ibff19986168a2da87398709b8ec19b4b1f777fe7 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> (cherry picked from commit 44a77d78e272d95e055b6d596c122f4825a9072a)
2021-07-21job_specs: 2n-skx add af_xdp tests to report_iterative, daily and weekly jobsMaciek Konstantynowicz2-4/+200
- Testbeds covered: 2-node Skylake testbeds. - NICs covered: x710, xxv710. Change-Id: I7747b5680cef05dad92788652c55f180fd93a5d1 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> (cherry picked from commit f5ba2f7100d73e009252782492fef289f2fc4947)
2021-07-21job_specs: 2n-zn2 add af_xdp tests to report_iterative, daily and weekly jobsMaciek Konstantynowicz2-5/+200
- Testbeds covered: 2-node Zen2 testbeds. - NICs covered: x710, xxv710. Change-Id: Ie5cd2374dd81bc2fa59400bb8af91dcbf6efb9bf Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> (cherry picked from commit b9ad36b5f2090a60177d8e38a091dacb7a00e953)
2021-07-21FIX: Testbed driver and firmware versionspmikus3-24/+23
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I2bb08a3cd7f2138ab98b3c4dacdd1dc46ac8b523 (cherry picked from commit 9479510935a273730ace23481f19706cefbce437)
2021-07-20FIX: Mellanoxpmikus1-5/+6
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I6aba0123c1f79e5c2acbac07503f74fc0050f472 (cherry picked from commit 3725984899ab67d69ad89e5f79d3334ba2fdc780)
2021-07-19job-spec: Fix af-xdp mlr iterative job specTibor Frank1-69/+69
Change-Id: I012d504309eea97edac7f11bd22935bb8325f988 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit f71dd880aa5f5cd2ffc5bab83bd9307b17a6af6c)
2021-07-19Report: Add rls dataTibor Frank2-0/+20
Change-Id: I9c81563c904b02c5ca6ede5dc3d0922851c11ae4 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 39957a024d1fff87403aacc34aaaa5a922b6639f)
2021-07-16job_specs: 2n-clx add af_xdp tests to report_iterative, daily and weekly jobsMaciek Konstantynowicz2-7/+201
- Testbeds covered: 2-node Cascadelake testbeds only. - NICs covered: x710, xxv710 only. Change-Id: I3548990a27e5a47b1749bf235da526b3fe2b4353 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> (cherry picked from commit 5576796f38aeab2016ed6a01a859f2df6737677c)
2021-07-15Report: Remove missing latency graphsTibor Frank12-401/+418
- they were not generated as the tests failed - Fixed legend in dpdk comparison tables Change-Id: Idd57c1702c883d4f6ece470310e823f5885a9bce Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 8c4e9c508d9bf53eb5c6cc8bc531215825c800e1)
2021-07-15Report: Configure rls2106.29, add dataTibor Frank4-2/+25
Change-Id: Ib51ee05d67a5a6506367b9f194441be50f360d38 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 149b1109affae3e54157e3c38db97f376d27328b)
2021-07-14Report: Add rls dataTibor Frank1-0/+1
Change-Id: I013515f98c3aaa4b347d61dd2c815f2ac67d56f0 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 8a1e62de051d4952b7e4e3e42f103f3f068d1a6c)
2021-07-14Report: Add per thread resources allocation methodologypmikus2-0/+103
Per thread resources include: - pcores and lcores. - RxQs. - TxQs. Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I64b418a99673bf05b37a9e97be4aaa80e4ffb835 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> (cherry picked from commit 8cd8790583b4d56985c486489327c92e6a9464a0)
2021-07-14report: update to rls notes and add methodology sections TODO placeholdersMaciek Konstantynowicz4-25/+86
- Update VPP and DPDK rls notes. - Added methodology sections TODO placeholders - IPsec with Async Crypto Feature Workers - IPsec Uni-Directional Tests - IPsec Deep SPD Policy Tests - GTPU Tunnels Change-Id: Ibfb937f193cce3a6576ac64cf00ad2e1b4bc3868 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> (cherry picked from commit d9bb63c2d9f126800f69bd53fca5d42fd2beb739)
2021-07-14Report: Add data, set archiving and pdf versionTibor Frank2-3/+5
Change-Id: Iaa1ef8bd12f536723d6894fbf86acfe280929ade Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit da7ec9bf7aff31d18325043891aa19cda2b063ec)
2021-07-14Report: Add rls dataTibor Frank2-9/+25
Change-Id: I6a133fd2fe99ec851d2eb0c5b5cc52a5169522c3 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit a47cc2dbd97aee82deebec9bd750d661aaca6942)
2021-07-13Report: Fix links to graphs in hoststack sectionTibor Frank2-2/+2
Change-Id: If75297ecb4c55b2a1c40dffbe354d77c537e905f Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit a841b190f7e448e8c30883e43eb3e6bcecc7788a)
2021-07-13Report: Add rls dataTibor Frank2-4/+10
Change-Id: I0167c72751aa5deae576335bbf91f62557ea8526 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit ec79cd31fd974372fd6cd02be6a504dff6d50e8e)
2021-07-13Hoststack report contentDave Wallace7-23/+138
- Methodology section - Align dynamic content structure with methodology section Signed-off-by: Dave Wallace <dwallacelf@gmail.com> Change-Id: I852c0f8147947dd8418de5fc2fdbd16a1c1e2057 (cherry picked from commit c77930b44bd1a35786a4b843bb75a9cbc8741b4b)
2021-07-13job-spec: Add hoststack and vsapTibor Frank4-2/+128
+ hoststack + vsap (cps, rps) + add e810cq to common.sh Change-Id: I2e897597d13e488f7324a7b91826ca32fd93c84f Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit e77fa027ad2a541e53d92743d8477d3aecf944e2)
2021-07-13report: add 2n-icx and 3n-icx testbed documentationMaciek Konstantynowicz5-9/+4829
Add: - Physical testbeds description in Introduction. - Add physical topology diagrams. - VPP pre-release 21.06 version used in Intel labs for CSIT tests. Change-Id: I3c17402de8c657f66ea840c9d8692212cbf0501a Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> (cherry picked from commit f85930d7b1e3cda191a2e60cbc4e64d93c5fd139)
2021-07-12Report: Add rls dataTibor Frank1-18/+75
Change-Id: Id69117a538294622a9c24efc9fb41aa70d61fedd Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 7692bfcfbe9d93a24a3840472fbaccabbefe747c)
2021-07-09Report: Add rls dataTibor Frank1-1/+24
Change-Id: I950a9b3ba9066d1552649cbd4031a2ba1cf14ccd Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 7ebf93a4ed4f046f3685db87165a75772aa0557e)
2021-07-08PAL: Process sh run from telemetryTibor Frank1-11/+25
Change-Id: I62ef60362f2921122c2f71e4f90c10cdc7185e1f Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 9789d21f6be4959e9eecc870cf46478960957463)
2021-07-08job_specs: 3n-tsh reduce number of report coverage testsMaciek Konstantynowicz18-480/+31
Remove: - All vts tests, obsolete use cases. - dot1q tests apart from dot1q-l2bd, superfluous combinations. - -100flows, -100kflows in all acl tests. Change-Id: Ib359c08366768f362c70c184707ab9fde46e1930 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> (cherry picked from commit 43f0eca4e9581f26180dfee360554157b56e484f)
2021-07-08job_specs: 3n-dnv reduce number of report coverage testsMaciek Konstantynowicz10-59/+9
Remove: - All vts tests, obsolete use cases. - dot1q tests apart from dot1q-l2bd, superfluous combinations. Change-Id: Icd9aa0b0807b16efc26fc94d6633ab61a6c47d9a Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> (cherry picked from commit 7a551264705ea0d069fe18345c90d89b44a59def)
2021-07-08job_specs: 2n-zn2 reduce number of report coverage testsMaciek Konstantynowicz17-336/+15
Remove: - All vts tests, obsolete use cases. - dot1q tests apart from dot1q-l2bd, superfluous combinations. - nat44 -pps tests, replaced by -tput tests. - nat44 h1-p1-s1 single session tests, unessential combination. - nat44 h4096-p63-s258048 tests, non-essential scale combination. Change-Id: Ia67492b2fd132a64f05a1e8de4cfc136a015fef3 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> (cherry picked from commit 58edde117f1c2bd758cb77a6b19fb1e275bcbfe6)
2021-07-08job_specs: 3n-skx reduce number of report coverage testsMaciek Konstantynowicz37-1686/+60
Remove: - All vts tests, obsolete use cases. - dot1q tests apart from dot1q-l2bd, superfluous combinations. - -100flows, -100kflows in all acl tests. Change-Id: I3525987726c347be5ffca03dbb82c2b1cf675c2b Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> (cherry picked from commit e9786cb012939d822ef1fc5c59e4763fc8cbee42)
2021-07-08job_specs: 2n-tx2 reduce number of report coverage testsMaciek Konstantynowicz14-311/+49
Remove: - All vts tests, obsolete use cases. - dot1q tests apart from dot1q-l2bd, superfluous combinations. - nat44 -pps tests, replaced by -tput tests. - nat44 h1-p1-s1 single session tests, unessential combination. - nat44 h4096-p63-s258048 tests, non-essential scale combination. Change-Id: Ia2187fa0ba9c8836840aa2fb7d0c335a3b0d91b1 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> (cherry picked from commit 2d994d6853ecf9675152a725333ce7e52eb6ad3a)
2021-07-08job_specs: 2n-skx reduce number of report coverage testsMaciek Konstantynowicz19-766/+89
Remove: - All vts tests, obsolete use cases. - dot1q tests apart from dot1q-l2bd, superfluous combinations. - nat44 -pps tests, replaced by -tput tests. - nat44 h1-p1-s1 single session tests, unessential combination. - nat44 h4096-p63-s258048 tests, non-essential scale combination. Change-Id: Iae8612bd09980350b0cf5eb90ea4833296c73fc8 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> (cherry picked from commit 9182f99fe55e8009836c77df11cb3e3b58fefacc)
2021-07-08job_specs: 2n-dnv reduce number of report coverage testsMaciek Konstantynowicz6-39/+6
Remove: - All vts tests, obsolete use cases. - dot1q tests apart from dot1q-l2bd, superfluous combinations. Change-Id: Ifb7d256ea0ff4afe18f80baf1e9058d3775e85d4 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> (cherry picked from commit cd3392cf61fd23b333581dc111fe040fd72de77f)
2021-07-08job_specs: reduce number of report coverage tests for ipsecMaciek Konstantynowicz8-597/+23
Remove: - ipsec tests - ethip4ipsectptlispgpe. - policy-aes128gcm. - policy-aes128cbc-hmac256sha. - policy-aes128cbc-hmac512sha. - int-aes128cbc-hmac256sha. - scale of - 400tnlsw. - 5000tnlsw. - 20000tnlsw. - 60000tnlsw. Change-Id: I1443f35b7bf852fd665e8856d05bf04b9827913f Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> (cherry picked from commit e75e2f7a9b2fa73718f8a4a5a31fbe56b234f820)
2021-07-08Report: Add rls dataTibor Frank1-8/+29
Change-Id: I336d3d291be38dbc6483386945e0edcdca4a9fae Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 26f1ebf5e85d569018e0a4a1ac188ae59b78b833)
2021-07-07Report: Add rls dataTibor Frank2-1/+6
Change-Id: I82522a17b1b3b919adc6de28772d4323c57b0b2c Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 3c88629c05256b8f5b1e435a8e94d488eb769224)