aboutsummaryrefslogtreecommitdiffstats
path: root/resources
AgeCommit message (Collapse)AuthorFilesLines
2020-10-05Report: Add rls dataTibor Frank3-394/+314
Change-Id: I903075db92a71964f792d2de42a69ca93103e11d Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 6d2573c5cfa89389817eb672e7023c7b3b20d26f)
2020-09-12Test: Add ramp-up phase to nat44ed-udir testsJan Gelety2-3/+61
Change-Id: I3aa50ec1ef9b0445014daa31e767323060f4a03f Signed-off-by: Jan Gelety <jgelety@cisco.com> (cherry picked from commit d68be735d882bafcb672ebb27a66efbcabbeb02d) Change-Id: Iad67c8445e18b22eccbea25d75b91827b398775f Signed-off-by: Jan Gelety <jgelety@cisco.com>
2020-10-01Report: Add 2005 dataTibor Frank1-0/+4
Change-Id: I1a7546d399a7527a46a77629e5f6e2c258c562df Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 2444fb95f7f1e9b19506c198080317431d4f8739)
2020-09-12Framework: Add possibility to send ramp-up trafficJan Gelety2-22/+43
Change-Id: Ie24184ca4ac2d6c7abc32f0f103e10bc402ad93b Signed-off-by: Jan Gelety <jgelety@cisco.com> (cherry picked from commit 61044d391d6e8d6b47d0d4f156071bd61cd278df) Change-Id: I50e2a674784688e6eeea566fc2bc4d45a8ecfb8b Signed-off-by: Jan Gelety <jgelety@cisco.com>
2020-09-30Report: Add dataTibor Frank1-0/+4
Change-Id: I827efd0850dde4d5d2c2b6e839973278ec8ec0a6 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit bacb1d9fb56a0c8ea011cafe18d078f89088a8de)
2020-09-30test: compute max_translations_per_thread based on worker threads numberJan Gelety1-0/+16
Change-Id: I1c638aef886bf37a9feb4a29e4949c7c8f19b717 Signed-off-by: Jan Gelety <jgelety@cisco.com> (cherry picked from commit d99951620507d354c4803eb1ee26609d992b70b3) Change-Id: Iaf5b4dffe603b0cf5cf0430fc6ca20acb7a01fda Signed-off-by: Jan Gelety <jgelety@cisco.com>
2020-09-30Report: Add dataTibor Frank1-2/+4
Change-Id: Ice3945d471a5597a3d81152bee38eac1f1d91d1c Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 655064008428d185b219fcae8c9065c88be4f0e5)
2020-09-30Report: Fix specification fileTibor Frank1-12/+12
Change-Id: I9a2664d73c0bdc99773fb24394aa59a399ae7a54 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit ba9ef5fc29e02a99ab48acb92f720bcdea43bd97)
2020-09-30Report: Add dataTibor Frank1-524/+603
Change-Id: Id55530bb4e9118e73f3630103333b902d07510f6 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit e173b080cec3ca8e2be5c485e337c93b36095c31)
2020-09-29Constants: Lower Mellanox pps limitVratko Polak1-1/+7
The previous 60 Mpps stil leads to ~30% duration stretching. + Add comment on why 36 Mpps was chosen as the new limit. Change-Id: Ic11e8ece03939bdc8680cd7bc4122373583a2f17 Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit 34dadfe8d168b72340b497469ee6550349689f1a)
2020-09-29Report: Hide DNV in specTibor Frank1-1567/+1567
Change-Id: I72a6b07e9785ef6eda05eef43cfee0577ffa7ba6 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 2f6b6ee9553b9ae0d81e00d225c811e683b01c80)
2020-09-29Report: Add vpp 2n-clx-cx556a, add dpdk 3n-tshTibor Frank1-2/+2
Change-Id: Ia5b0a70f430a4a26f07c1fa6b7506b839f3813bc Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 1df0b73ad1ef5dc8d8187142902a67703de93a0a)
2020-09-29Report: Add vpp2005-env5 dataTibor Frank1-116/+351
Change-Id: I23241c399411dfc947f2be524dbe25a3094d03e2 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 6683da8920bfacf2e360c41dad9aeea65c2a79e8)
2020-09-29Report: Add RC2 dataTibor Frank1-1/+12
Change-Id: I52666cd0e5c9ebdf8ad12c3b609acf5f58e976ad Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit dc373500b723dcdf45559e21f18a639e44da8035)
2020-09-29Report: Edit the configurationTibor Frank1-17/+17
Change-Id: I3a3317903ee6e22fa0fe7fff9bf7d0208b19c8ae Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit c4229710f97c1cc155a44d0c8d9cc3682900f6e2)
2020-09-28PAL: Fix processing of device testsTibor Frank1-3/+3
Change-Id: Ia0417eba8853112f405572189a5ef7bc034c10ce Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit e15746adc0c6b54dc74ea40fc86e794f90ecabf9)
2020-09-28Report: Add RC2 dataTibor Frank3-133/+338
Change-Id: I6c4ae6b428571a392586f5b817c5392a0de8c727 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 6f8a69729c108b5efc7f36bc2daf5d71afd25196)
2020-09-25FIX: Workaround AVF interface down until VPP-1934pmikus1-1/+7
- Follow up https://jira.fd.io/browse/VPP-1934 Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: Id0a26c5f67f229480332530a8531401d954f4422
2020-09-11test: nat44det - add session number checkJan Gelety3-4/+69
- some tests need to reduce rate for ramp-up phase - some tests need to extend trail duration in ramp-up phase - removed 2n1l-10ge2p1x710-ethip4udp-nat44det-h1-p63-s63 suite as nat out ports are randomly selected from available port range so T-Rex stateless is not able to provide required out2in traffic Change-Id: I1145496610d202f81d911e68aa819844d7600918 Signed-off-by: Jan Gelety <jgelety@cisco.com> (cherry picked from commit 3b408b7ea702dd3817442186035121fe862cbf7f) Change-Id: I53da8c086373d06e0842e5563964d9287c0fa403 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2020-09-24Trending: Replace snat by natTibor Frank3-152/+157
Change-Id: Ifcb1311d46b7134502b142933fd1574eb94cc230 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 7bcc61b0ab7fb4dd46fd38e361df6ef8aa8e181b)
2020-09-23FIX: Race conditionpmikus2-0/+14
avf tests works, but vfio-pci tests are following, the interfaces must be in down state (ideally unbind, as vpp cannot pick them). Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I77af85ec4239059a5455ef68683ca129548bd7bd
2020-09-22Framework: AVFpmikus1-0/+22
Fix 1/3: Explicitly put PF interface up (this patch) Fix 2/3: Done on TB Fix 3/3: VPP bug displaying VF up if underlying PF is not up Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I45d66986ec76e6e14eebaad6828ef72724c626ab
2020-09-21PAL: Fix show runtimeTibor Frank4-5/+6
Change-Id: Id42f087b2e3874a362f17596740feab6af8029d9 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 0df92678006f857a1ed051d9077868270ec1f543)
2020-09-21Report: Add data for RC1 detailed test resultsTibor Frank1-217/+11
Change-Id: Idb15e437beed058133ca9938d45a80caf94ebd73 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 0e3903c0ebdf1cb8e95b096012539cb7925ea6d0)
2020-09-21FIX: Unknown trigger filespmikus1-5/+5
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I8d6108af943d729fecbcfe4867ea820a69b4eb1e
2020-09-21PAL: Dislpay job name in err msgTibor Frank1-2/+3
Change-Id: I008d14bf1f72bcdc9b6bcb478ae851de03a176e0 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 28b09d77b497685553d28ad7b0a98f08e89b7f7f)
2020-09-21PAL: Dislpay job name in err msgTibor Frank1-1/+1
Change-Id: Id7509bd11ac32cc3f72e71c8826ccacdf1fe95a0 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit aec0a24a1a2bfb677a3cda5865e4b9c8e2011b68)
2020-09-18Report: Replace 2009.0-4 by 2009.0-5Tibor Frank1-206/+207
Change-Id: I87ed119665094d60b9a5452ea222f63fd45dd52c Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit a8ac75302d82a69667611ba1c2e654cf545eb277)
2020-09-18Report: Fix plot_perf_box_nameTibor Frank1-8/+10
Change-Id: I660819b881b1109f6f6bf250b66ba025e9278f56 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit ee1c6ce7dd157e141b1911dd1332aac754b0ad8f)
2020-09-18Report: Compare NICsTibor Frank1-91/+91
Change-Id: I4a4dd9f12e0a3904c0e21b434af38f9fa974e361 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 3b0487f89bca5796c1703659f8a4a423e3aa5f86)
2020-09-18Report: Add RC1 dataTibor Frank1-489/+157
Change-Id: Ied3df918c0798df546b447b8ffb8d77938a3b904 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit d1eb688ec2097322842c9be6864dc3538c61752a)
2020-09-16Report: Add snat44det tests to graphsTibor Frank1-0/+64
Change-Id: I65b6b210d500c0f5aedd39e6c70c3c48b8654dfd Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 00d6027bc4219d7a8c65c202c32c94809303cd5d)
2020-09-16Trending: Add snat44det tests to trending graphsTibor Frank1-0/+62
Change-Id: I7fe24c05a4f7f17355c3bf5c4f635f412656d52f Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit a06adaf1ebfd3297d0f7a3d7beee0e3971de0ca8)
2020-09-16Report: Fix units in speedup graphsTibor Frank1-23/+26
Change-Id: I6e0dc888d00df03e3fbd8cac62d6db19ef6507cf Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit b61bb756579eaa22c35f54d3b2f8d0dffc682bbe)
2020-09-11Add ipsec async mode performance test casesYulong Pei3-0/+29
In VPP 20.05, vpp added async crypto engine that support to use QAT hardware to do encryption and decryption, vnet/ipsec enabled async mode to use async crypto engine. Current async crypto engine also use dpdk_cryptodev as async handlers, in the future it may add other native QAT driver as async handlers. Note that async crypto engine is to support vnet/ipsec, it is different with current existing dpdk backend which itself has ESP implementation in plugins/dpdk/ipsec. Change-Id: I4e6eaa7ca1eddb8b1c45212de0684fb26907119b Signed-off-by: Yulong Pei <yulong.pei@intel.com> (cherry picked from commit d12f510caf3bb83695488684eb07de79b3e753b9)
2020-09-10Report: Configure rls2009 ReportTibor Frank3-1973/+962
Change-Id: I63c058e5fda100cce8e1b83acb8dfe988f1fd904 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit d3763454526d2886ce8d0210b788c1d90540e9aa)
2020-09-07VPP-DEV API COV: Add NAT44-ED testsJan Gelety3-21/+74
Jira: CSIT-1755 Change-Id: I34baa22a49f44da3fa80d91fa2f4132c982fe610 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2020-09-04Fix local CSIT deploymentTomas Alexy3-29/+53
Change-Id: I6ccf3cc11b4343ebcf02f30a01eddb9204ba53ee Signed-off-by: Tomas Alexy <tomas.alexy@pantheon.tech>
2020-09-03Trending, Report: use test tag ethip4udp-snat44det-h1-p1-s1Tibor Frank2-76/+46
- use test tag ethip4udp-snat44det-h1-p1-s1 not ethip4udp-ip4base-nat44 Change-Id: Ie4897430c3b3074fdf3440d56cc1794a4c3046dd Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-09-03Framework: Code aligmentspmikus17-84/+373
+ Unifying code structures - To easily plug another DUT + New PCI PassThrough templates + Improved perf stat on cores allocated in test. Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I325f17b977314f93cb91818feddfddf3e607eb8a
2020-09-03Framework: Bump DPDK 20.08pmikus8-99/+43
+ DPDK 20.08 + Migrate make -> meson + Fix all trending issues Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I31dcb22627c0f8d17ec63c5b138a2da958b006f4
2020-08-09job_specs: use test tag ethip4udp-snat44det-h1-p1-s1 not ethip4udp-ip4base-nat44Jan Gelety1-1/+1
Change-Id: Idb7b415995f0a3474e379b0c023f64a96e886a55 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2020-09-01Ansible: fix the wrong module and mode for vpp_device.yaml in cleanup roleJieqiang Wang1-2/+2
The src field for ansible template module used in vpp_device.yaml of cleanup role should be jinja2 format and the mode for script to be transfered to the remote host should be executable for the file owner. Fix this error by replacing the ansible template module with ansible copy module and setting the file permission to be 744. Change-Id: Ibf80b0c5bec77a13509122795a5b12b6faba2f8e Signed-off-by: Jieqiang Wang <jieqiang.wang@arm.com>
2020-08-28Trending: Add DPDK version to alertsTibor Frank2-10/+13
Change-Id: I2f1a16ecfa0336e9c5a52a2efcbfcb2caddee089 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-08-28Trending: Add identification of DUT to alerting emailTibor Frank2-34/+34
Change-Id: I2e63f16aef48e68b0e86e913431bed7df01f1b70 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-08-28Ansible: Add arm nomads into poolpmikus1-2/+2
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I99a33a15e7e87fe6f56deb1ab0e4ce3091508244
2020-08-27Trending: Add DPDK tests to list of failed testsTibor Frank1-0/+72
Change-Id: I25e805125528d67a5eea277df6d88549f129d137 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-08-27Trending, Report: nat44-deterministc test names changeTibor Frank2-46/+46
Change-Id: I1956ccaff625f287995765a4c2b0b46cb00d0d65 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-08-24T-Rex: 2.82, core pin, 8 workerspmikus4-4/+5
+ Bump T-Rex version. We need new features for ASTF test. + Apply core pining. Results in a more stable performance. + Tweak the number of T-Rex workers. + We need an even value to achieve ymmetric performance with pinning. + Value 8 was selected as a best compromise. This is a combination of 3 commits. This is the 1st commit message: T-Rex: 2.82 This is the commit message #2: Change Trex to CORE_MASK_PIN mode to improve performance https://trex-tgn.cisco.com/trex/doc/trex_stateless.html#_core_masking_per_interface Above link have below explaination, "When the profile is symmetric, performance can be improved by pinning half of the cores to port 0, and half of the cores to port 1, thus avoiding cache trashing and bouncing." The reason to change this is that to run CSIT with 100G NIC often failed with "TRex stateless runtime error timeout", it caused by Trex can not send enough traffic within the fixed duration. by change to CORE_MASK_PIN mode fix the issue. Not editing ASTF, as that supports different options. This is the commit message #3: Experiment: Vary number of TRex workers With CORE_MASK_PIN, we can get more predictable time distribution. Decided to use 8 workers, that gives good results both for high end (RDMA-core l2patch) and low end (vhost) tests. Change-Id: I5c61127799e0624464e960fcb980ad1c4058e744 Signed-off-by: pmikus <pmikus@cisco.com> Signed-off-by: Yulong Pei <yulong.pei@intel.com> Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2020-08-24Framework: Qemu alignmentspmikus2-17/+28
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I2781e85f44acffb4f8d7f02326ba2ca668dad0c5