aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2022-01-17Revert "Report: Temporarily change report specs"rls2106Tibor Frank2-0/+13792
This reverts commit 455cbb5c2427444510536a377b320724df6132cf. Reason for revert: Not needed. Change-Id: Idc391d965958b3d1675b5312fedb8305f508f35b Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-01-17Report: Temporarily change report specsTibor Frank2-13792/+0
Change-Id: Ic99dc97e89ff72ebc02e04929d7ad1d2f234e14d Signed-off-by: Tibor Frank <tifrank@cisco.com>
2022-01-17PAL: Fix sh-runTibor Frank2-25/+11
- do not post-process telemetry data Signed-off-by: Tibor Frank <tifrank@cisco.com> Change-Id: Ia381964ae0a1a36f30a8aee62fe3e12a72e51df1
2021-11-08vpp_device: bind to vfio-pci before running testsJuraj Linkeš3-19/+111
In rare cases, binding the whole /dev/vfio folder will result in unusable VFs: notice dpdk EAL: Cannot open /dev/vfio/151: Device or resource busy [0], section 4.3.1. provides some clues as to what's going on and how to avoid the failure. Mounting /dev/vfio reset the file descriptors of all devices under /dev/vfio. Vfio-pci creates a device when an interface is bound to it. The rare failure then occurs when /dev/vfio is mounted while a process is using the file descriptors result in that process using invalid file descriptors (or file descriptors belonging to a different VF). Fix the issue by binding i40e and ice VFs to vfio-pci before containers are created and make sure that the VFs are not unbound later in testing. Only bind DUT VFs since the TG uses the kernel driver. [0]: https://connect.redhat.com/sites/default/files/2021-03/Cloud Native Network Function Requirements.pdf Ticket: CSIT-1794 Change-Id: I83db91b29d16669fb034b141ad247f6f796fdf64 Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2021-08-19Migrate report/trending/docs to bash frameworkpmikus7-202/+349
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: Idf8462f15a2dd76b42dcaea9df6a0fc15a45503f (cherry picked from commit 8079ed2ff7e2fdd41474d286b98cd9be19481f7a)
2021-08-18Report: Add tables with builds durationsTibor Frank6-3/+627
Change-Id: I6e5d72b336ab68c9ffd74f9ab20d7cb0ed4b5fb3 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 6353e5b063a146fe4bd66437ef09f540b9f87514)
2021-08-16Trending: Fix links in alerting emailTibor Frank1-2/+0
Change-Id: I2ce48ac826ab347365f38ef1dbfdfa4cae8f3fd3 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit ece79f53197aa36aa356f7fa1ce1dfe0b582ae86)
2021-08-16Report: configure rls2106.33Tibor Frank6-5/+13
Change-Id: Ic7d1a776817dda52007bcebd663388cc4bd1fa66 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit e32b39d83fb01c33dfc9ae540ff2b55c11b707cf)
2021-08-13Tox: Move logs to archive also on -1Vratko Polak1-3/+4
Change-Id: Id29925da9c8e0bc0a28a9f4d38c332852c687317 Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit 8f9290d1594d35eb838c0c4c9d754b80a35e4a3a)
2021-08-13CI-MAN: Unify backupspmikus1-0/+6
+ tox must follow the $WORKSPACE/archives rule Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I717afded894c3a5468bbf5013b242be5e1a9cb6e (cherry picked from commit 88483ff0a6b4b5ff5b0390d8ff2adeb9a857c1c3)
2021-08-13Report: Add icx rls dataTibor Frank2-9/+7
Change-Id: I3f16f058b257f2f4ccb48bd5ff725c9161d1176f Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit cab67f5de29b46776a689423188c121f997cc321)
2021-08-11Infra: AWS self terminationpmikus6-47/+74
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I9ecd85d1086f6be1bbaf6a6925da362cc4c1a9ad (cherry picked from commit 44784f12e7a1cfe42927bd301b90015ffa72b7d7) (cherry picked from commit 56b334fb5044d0f29b6e8f91e16f067533196b50)
2021-08-11Infra: Add terraform no-color output.pmikus1-2/+2
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I851e979c9b0db41c83facb92010c1b16885ee5a0 (cherry picked from commit 6de5c7fc4524c5121ed00dc2fa3ab34301d45215) (cherry picked from commit 29d8ac190da8ff0a975614e3aad2f56ebe1b5efd)
2021-08-11report: indexed error message added to report emailsViliam Luc3-44/+119
Report emails will contain error message index now. Index assigned to error message is described at the end of report. sample: avf-dot1q-l2bdbasemaclrn-eth-2memif-1dcr 25ge2p1xxv710 64b 2t1c[0] 4t2c[0] 8t4c[0] Legend: [0] - Failed to run 'cli_inband clear runtime' PAPI command on host xxx.xxx.xxx.xxx Signed-off-by: Viliam Luc <vluc@cisco.com> Change-Id: I6c71eb8a8767827e18f88a9a1142b899158a190c (cherry picked from commit 03bf0dd6ea67ef2b1386733d0b2ce3489c6a7f3e)
2021-08-11RCA: Add CSIT-1791Vratko Polak1-0/+3
Change-Id: Ibe9d8265ed1dc8a9c4d480211b3292ebae986e65 Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit 476faa27d66a604df8b72d9339668485c0430b3e)
2021-08-11Report: Improve RCAVratko Polak1-1/+1
First comment at VPP-1972 clarifies this is not a 2101 issue. Change-Id: I0b9a7398c44fd8a69304f0931f245c746664c413 Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit 21f4ed750e8fbee7ecb5b4aa7dfa1090bdbf36a9)
2021-08-09FIX: Terraform installationpmikus1-2/+4
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I2963520237c0bcc30836df3722a945060bd438d3 (cherry picked from commit 2674845e28c3f36e6290c78bd73c0a43b0ecca15) (cherry picked from commit 0e5b90cc8dad50365de53fa80db9817066ac3f82)
2021-08-09FIX: Terraform installpmikus1-0/+2
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I1bc29338bf677c5777474ea07954df4ca0ed0a31 (cherry picked from commit 13f4ec1dc98710d2cf226de3643dc5a0a6c5ac67) (cherry picked from commit dbace27a91928d386f79943a2faa13411d14ff63)
2021-08-09Infra: Install terraformpmikus1-1/+3
+ Unless docker images gets updated Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I9d09b24ca7bef71dad5774ae2b5e2e67e7b8f285 (cherry picked from commit ddd2cc047694396928086482339588966a858fba) (cherry picked from commit 62420b659ffa75edbfe7c8ac4f480dff5b01c27e)
2021-08-09Infra: Vaultpmikus21-25/+616
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: Ia6e728f98d20144c3771405b32933a77fe15b19b (cherry picked from commit 73440ab332c51eb11405767d320bc496d9ebdbe7) (cherry picked from commit bb2af29c186f681dcbbc3c26a5f091af6c7415d3)
2021-08-09Report: Configure rls2106.32Tibor Frank5-11/+12
Change-Id: Ia4e7a2436e038cebaaa080dd7c86f6de1b39b018 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit b4d1e09227919dfc966c10c0054c97f0620c2963)
2021-08-05Trending: Fix broken graphsTibor Frank6-108/+0
Change-Id: I73b9446e9e76811f88d6b0fa2ee657e7ae0ceab3 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 13dfbc0ae758164c025b310136f78faf7160805f)
2021-08-05FIX: init_interface driver and sr-iovJuraj Linkeš2-49/+28
Add checks for not unbinding a driver that is not bound and not trying to remove VFs from interfaces not supporting SR-IOV. Change-Id: Iae7ce37aabeadbb541fe9eac8b83b4ee18d028e6 Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech> (cherry picked from commit 7d849ba64e10b8a7678845ee1dcc091e125dd124)
2021-08-04Docs: issues added to csit_release_notesViliam Luc1-0/+9
Change-Id: I2e47e1c494a3d83d005c605b4a9214e8561b1b1d Signed-off-by: Viliam Luc <vluc@cisco.com> (cherry picked from commit bb5f2a46e7acd6e85408610b09a15ca3f5bd3647)
2021-08-04report: add nic and drivers section to physical testbeds descriptionMaciek Konstantynowicz1-31/+55
Change-Id: I75fd902e32b290e62f7eb9fcd8b2b5b7a4b713e6 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> (cherry picked from commit 61d020ed404923283dcd87424a7845dcd84bd66a)
2021-08-04Trending: Set y-axis for stats to zeroTibor Frank2-3/+5
Change-Id: I5235d734d37709367c56878fffd3243aaba3f0b8 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 8e1dfc4ab336302999f91ea0386093b0bc879974)
2021-08-04Report: add gtpu tunnel description to methodologyxinfeng zhao1-5/+1
Signed-off-by: xinfeng zhao <xinfengx.zhao@intel.com> Change-Id: I4c066713bb37e35d25b5ab1225a361e05b7a1146 (cherry picked from commit ab095362b4beedbf2b3ec63ec9d277d3f651da0e)
2021-08-04report: update vpp rls notes with trex latency measurement issue for FVL NICsMaciek Konstantynowicz1-1/+10
Change-Id: Ia6de51914f7d31194796538cdd81183c7a16e1d7 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> (cherry picked from commit b3734284f7cdf49cb04b142c00087c10369a48e7)
2021-08-04Methodology: Update MLRsearch descriptionsVratko Polak2-15/+13
Change-Id: Icdcb7210835fa90a6f5f1688b815a6edf07a4b39 Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit ad8442c642f5dd4a6630e1e66c980cb86c5039bb)
2021-08-04Trending: Add Latency trendingTibor Frank52-161/+1616
Change-Id: I28c1f1cf113d2537f3e564cdca0fd61ef57737a9 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 2e021b4853ced07e820a933ca9062d9c325a8a7f)
2021-08-04Report: configure rls2106.31Tibor Frank2-4/+3
Change-Id: I9d5da2d71525b53096e9c77e9d338243b16f05c1 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 913ddff5d85c822b8eb974def458a5022246ef53)
2021-08-04FIX: init interfaces for rdma-core driverJuraj Linkeš1-0/+4
We're only initializing interfaces for avf and af_xdp VPP drivers. This causes issues for the rdma-core driver when the underlying mlnx kernel driver is not bound. Fix this so that all interfaces are properly bound to the kernel driver required by rdma-core. Change-Id: I204309a9bb61b56b96497a287178f0b1efe2f362 Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech> (cherry picked from commit 324f01417f17a5347c102179f3d2277a77b116ce)
2021-08-03RCA: Add CSIT-1789 as a known issueVratko Polak1-0/+4
Change-Id: Ia01eddc69f64d7f4360cda7a612b5b8fae2c41b4 Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit 68f32506b32feddae4f9674a7a32cd3d0ea61fb7)
2021-08-03Report: latency comparisonTibor Frank2-10/+11
Change-Id: Ic47209e1911317b6f42a7f8257309607d3a21e04 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit c9ddd355f7cab79d6a3f337a658f7c377e099661)
2021-08-03Report: Configure 2106.31, fix latencyTibor Frank6-71/+88
Change-Id: I6f9e3cc3b79be84acb6b5619016a9aa7d4296e02 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 7902281ee08456a4d90bb5829ba42da2c71a6379)
2021-08-02Report: Add Latency comparison tablesTibor Frank3-8/+781
Change-Id: I6774383eef9839352ed3924e7482177fd85b34e6 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit f615617a46a21107a9a827a13035997e91bf6d3f)
2021-07-28PAL: Add s3-logspmikus4-0/+24
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: Ia8cc2c59a84a61263b2cf88af16f6fd7bad637a8 (cherry picked from commit d102788108352fd5271b139ef3ef1a1c718389a1)
2021-07-28CSIT-1782: 4c AVF tests are failingpmikus1-2/+13
+ Implement temporary ugly workaround as I cannot do driver upgrade now after discussions with PTL. Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I400e3b61bd831b9c9820b1fab8852118f2d48f0e (cherry picked from commit 9e86d195050fcd75c20d59f78d6f5a5e379a6a86)
2021-07-28Report: Add rls dataTibor Frank1-5/+10
Change-Id: I2ad71d35bb2503adbe10cf3e7982e883339a4fee Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit cf63723c2758fb5561bd1810a2725b1e187f9c1f)
2021-07-27FIX: Executable bit for ansible pluginpmikus1-3/+5
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I2416a9682710441d098acfff50e943ac3f788500 (cherry picked from commit f7c3f3918646a7bb157e648ed96beb9bb5c232ea)
2021-07-27Report: Add rls dataTibor Frank1-1/+2
Change-Id: Ia101a6d412473d957a81d794f34f1c1d2ad58abb Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 0d9bed4128719f3de748af108dc6259927efde29)
2021-07-26Infra: Terraform add ansible plugin initpmikus1-0/+113
+ Manual override Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: If296d28dc3eaa023c935a0887a14ac10e83076ba (cherry picked from commit b27f2c7cbfe08712a00959c8cc6a2f618a25b3e7)
2021-07-26Trending: Save latency data in csv filesTibor Frank5-18/+69
Change-Id: I397dc1711f52324c158c775522cfef3044724ad7 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit a4fe771848907ee4a551cf06432f1ec6da496608)
2021-07-26Report: configure rls2106.30Tibor Frank3-3/+10
Change-Id: If1af4d7c5865a7466eda5c2de18d07ff9491d458 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 53e6c3440afd81d1504db75e7fa8d09229641079)
2021-07-26Report: Add af-xdp dataTibor Frank12-56/+1254
Change-Id: I8beef5f0072e0c52476a8053f26640c537422a63 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit e8b47c3df7529a6c087fb7639684f180dad8c03d)
2021-07-23Trending: Add exception handling for anomalies classificationTibor Frank2-1/+9
Change-Id: I6f2ee7552c513ccf2fa453f143dd52ea880bd412 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 1da19da813655f643bc3c6e4d03bed987f076f07)
2021-07-22Report: Add rls dataTibor Frank1-0/+1
Change-Id: Id234d16ebbca84b663f23d295accddaf8c045417 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit a8d0c4410095c6b87f81bd541ca7ec91e6d62b70)
2021-07-22Report: Add af-xdpTibor Frank48-306/+1864
- elements(tput, speed-up) - static content (tput, speedup) - data - Latency Change-Id: I793fd4e6e6b189d93a267635b8bf07baad19accd Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit c5b94383d2eb8ea33413296a3295759b84915546)
2021-07-22Report: IPsec udir methodologyJuraj Linkeš1-11/+34
Update IPsec uni-directional tests methodology. Remove Deep SPD Policy section as these tests are not in the report. Change-Id: Idca538a03a05e12130c7d786c098b218fa88f7ef Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech> (cherry picked from commit dea4d7ff2a1b662cde1587b3a8d6c3d832f4920e)
2021-07-22Trending: Add graph with statisticsTibor Frank10-228/+678
- x-axis: time [MM-DD] - y-axis: nr of passed/failed tests - y-axis: build duration Change-Id: I269af5a728a32d02ffcdecc7e25138ad1a183c4b Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit d8fc1521b8def68adc8f4a390aa2d25db806ea4f)