aboutsummaryrefslogtreecommitdiffstats
path: root/resources
AgeCommit message (Collapse)AuthorFilesLines
2020-09-21Report: Add data for RC1 detailed test resultsTibor Frank1-217/+11
Change-Id: Idb15e437beed058133ca9938d45a80caf94ebd73 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-09-21FIX: Unknown trigger filespmikus1-5/+5
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I8d6108af943d729fecbcfe4867ea820a69b4eb1e
2020-09-21Trending: Fix the name of csit-dpdk-perf-mrr-weekly-master-3n-tshTibor Frank1-1/+1
Change-Id: I98731ba17d5fbfc10e1b1b91ff3f4afc52566b8d Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-09-21PAL: Dislpay job name in err msgTibor Frank1-2/+3
Change-Id: I008d14bf1f72bcdc9b6bcb478ae851de03a176e0 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-09-21PAL: Dislpay job name in err msgTibor Frank1-1/+1
Change-Id: Id7509bd11ac32cc3f72e71c8826ccacdf1fe95a0 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-09-18Report: Replace 2009.0-4 by 2009.0-5Tibor Frank1-206/+207
Change-Id: I87ed119665094d60b9a5452ea222f63fd45dd52c Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-09-18Report: Fix plot_perf_box_nameTibor Frank1-8/+10
Change-Id: I660819b881b1109f6f6bf250b66ba025e9278f56 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-09-18Trending: Add csit-dpdk-perf-mrr-weekly-master-3n-tshTibor Frank1-0/+28
- alerting only - todo: Graphs Change-Id: I369d5c1bbcd634b1b4ebfeb4c08c9ac4a5c058ab Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-09-18Report: Compare NICsTibor Frank1-91/+91
Change-Id: I4a4dd9f12e0a3904c0e21b434af38f9fa974e361 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-09-18Ansible: Add EPYCpmikus3-0/+36
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: Ic84b7cbcbcd269a5fe548b59d478cd6dfa57a952
2020-09-18Report: Add RC1 dataTibor Frank1-489/+157
Change-Id: Ied3df918c0798df546b447b8ffb8d77938a3b904 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-09-16Report: Add snat44det tests to graphsTibor Frank1-0/+64
Change-Id: I65b6b210d500c0f5aedd39e6c70c3c48b8654dfd Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-09-16Trending: Add snat44det tests to trending graphsTibor Frank1-0/+62
Change-Id: I7fe24c05a4f7f17355c3bf5c4f635f412656d52f Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-09-16Report: Fix units in speedup graphsTibor Frank1-23/+26
Change-Id: I6e0dc888d00df03e3fbd8cac62d6db19ef6507cf Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-09-11Add ipsec async mode performance test casesYulong Pei3-0/+29
In VPP 20.05, vpp added async crypto engine that support to use QAT hardware to do encryption and decryption, vnet/ipsec enabled async mode to use async crypto engine. Current async crypto engine also use dpdk_cryptodev as async handlers, in the future it may add other native QAT driver as async handlers. Note that async crypto engine is to support vnet/ipsec, it is different with current existing dpdk backend which itself has ESP implementation in plugins/dpdk/ipsec. Change-Id: I4e6eaa7ca1eddb8b1c45212de0684fb26907119b Signed-off-by: Yulong Pei <yulong.pei@intel.com>
2020-09-10Report: Configure rls2009 ReportTibor Frank3-1973/+962
Change-Id: I63c058e5fda100cce8e1b83acb8dfe988f1fd904 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-09-07VPP-DEV API COV: Add NAT44-ED testsJan Gelety3-21/+74
Jira: CSIT-1755 Change-Id: I34baa22a49f44da3fa80d91fa2f4132c982fe610 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2020-09-04Fix local CSIT deploymentTomas Alexy3-29/+53
Change-Id: I6ccf3cc11b4343ebcf02f30a01eddb9204ba53ee Signed-off-by: Tomas Alexy <tomas.alexy@pantheon.tech>
2020-09-03Trending, Report: use test tag ethip4udp-snat44det-h1-p1-s1Tibor Frank2-76/+46
- use test tag ethip4udp-snat44det-h1-p1-s1 not ethip4udp-ip4base-nat44 Change-Id: Ie4897430c3b3074fdf3440d56cc1794a4c3046dd Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-09-03Framework: Code aligmentspmikus17-84/+373
+ Unifying code structures - To easily plug another DUT + New PCI PassThrough templates + Improved perf stat on cores allocated in test. Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I325f17b977314f93cb91818feddfddf3e607eb8a
2020-09-03Framework: Bump DPDK 20.08pmikus8-99/+43
+ DPDK 20.08 + Migrate make -> meson + Fix all trending issues Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I31dcb22627c0f8d17ec63c5b138a2da958b006f4
2020-08-09job_specs: use test tag ethip4udp-snat44det-h1-p1-s1 not ethip4udp-ip4base-nat44Jan Gelety1-1/+1
Change-Id: Idb7b415995f0a3474e379b0c023f64a96e886a55 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2020-09-01Ansible: fix the wrong module and mode for vpp_device.yaml in cleanup roleJieqiang Wang1-2/+2
The src field for ansible template module used in vpp_device.yaml of cleanup role should be jinja2 format and the mode for script to be transfered to the remote host should be executable for the file owner. Fix this error by replacing the ansible template module with ansible copy module and setting the file permission to be 744. Change-Id: Ibf80b0c5bec77a13509122795a5b12b6faba2f8e Signed-off-by: Jieqiang Wang <jieqiang.wang@arm.com>
2020-08-28Trending: Add DPDK version to alertsTibor Frank2-10/+13
Change-Id: I2f1a16ecfa0336e9c5a52a2efcbfcb2caddee089 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-08-28Trending: Add identification of DUT to alerting emailTibor Frank2-34/+34
Change-Id: I2e63f16aef48e68b0e86e913431bed7df01f1b70 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-08-28Ansible: Add arm nomads into poolpmikus1-2/+2
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I99a33a15e7e87fe6f56deb1ab0e4ce3091508244
2020-08-27Trending: Add DPDK tests to list of failed testsTibor Frank1-0/+72
Change-Id: I25e805125528d67a5eea277df6d88549f129d137 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-08-27Trending, Report: nat44-deterministc test names changeTibor Frank2-46/+46
Change-Id: I1956ccaff625f287995765a4c2b0b46cb00d0d65 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-08-24T-Rex: 2.82, core pin, 8 workerspmikus4-4/+5
+ Bump T-Rex version. We need new features for ASTF test. + Apply core pining. Results in a more stable performance. + Tweak the number of T-Rex workers. + We need an even value to achieve ymmetric performance with pinning. + Value 8 was selected as a best compromise. This is a combination of 3 commits. This is the 1st commit message: T-Rex: 2.82 This is the commit message #2: Change Trex to CORE_MASK_PIN mode to improve performance https://trex-tgn.cisco.com/trex/doc/trex_stateless.html#_core_masking_per_interface Above link have below explaination, "When the profile is symmetric, performance can be improved by pinning half of the cores to port 0, and half of the cores to port 1, thus avoiding cache trashing and bouncing." The reason to change this is that to run CSIT with 100G NIC often failed with "TRex stateless runtime error timeout", it caused by Trex can not send enough traffic within the fixed duration. by change to CORE_MASK_PIN mode fix the issue. Not editing ASTF, as that supports different options. This is the commit message #3: Experiment: Vary number of TRex workers With CORE_MASK_PIN, we can get more predictable time distribution. Decided to use 8 workers, that gives good results both for high end (RDMA-core l2patch) and low end (vhost) tests. Change-Id: I5c61127799e0624464e960fcb980ad1c4058e744 Signed-off-by: pmikus <pmikus@cisco.com> Signed-off-by: Yulong Pei <yulong.pei@intel.com> Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2020-08-24Framework: Qemu alignmentspmikus2-17/+28
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I2781e85f44acffb4f8d7f02326ba2ca668dad0c5
2020-08-08Fix: NAT44 deterministic moved to separate det44 pluginJan Gelety4-93/+195
- align CSIT code with VPP code changes for NAT44 deterministic (DET44) feature - align test names according to snat44ed tests - remove obsolete 3-node nat tests - remove 2n1l-10ge2p1x710-ethip4udp-snat44det-h1048576-p63-s66060288 tests (not enough memory for such high number of sessions) Change-Id: I9a22b99b4cfa56d18e9c7ef9c58296e202567d42 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2020-08-20Fix: Use new-style interface variablesVratko Polak2-6/+6
The old-style variables contain None in some places, mainly in SRv6 proxy tests. Change-Id: If3887a7dba051454c504b345a6a316d5d69d0139 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2020-08-20Framework: use 'stl' in trex stateless profile namesJan Gelety1-3/+2
Change-Id: I74641cc89d2f25d50b67d51bf2567082b420aabb Signed-off-by: Jan Gelety <jgelety@cisco.com>
2020-08-20PAL: Add processing of throughput in GbpsTibor Frank2-98/+171
Change-Id: I264e329fa94cddf6a759f14bf567c56a50d1895d Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-08-19Add Intel E810CQ 100G NIC configurationYulong Pei2-2/+7
for Intel E810CQ 100G NIC, kernel driver of PF is ice, kernel driver of VF is iavf, its VF hardware support VPP native avf driver. Signed-off-by: Yulong Pei <yulong.pei@intel.com> Change-Id: Ic8d86e5ee00057bbbcd09df619a38bd1371c8fd7
2020-08-07Perf: NAT44 endpoint-dependent mode - udp, part IJan Gelety12-235/+541
- continuation of https://gerrit.fd.io/r/c/csit/+/26898 as there was reached limit of changes (1000) Jira: CSIT-1711 - udp synthetic profiles w/o data packets - udp cps perf tests, phase I (no special "search cps" KW) Part I means that we are using MRR tests to collect traffic data until there is ready new CPS test type with corresponding algorithm. Change-Id: I0d30feb9ecf1d0bff937152656f8eb422f831378 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2020-08-18Framework: Qemu alignmentspmikus10-8/+180
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I20098fca8fb513accef3edc9a72bfd3c56bf9be2
2020-08-18Framework: Alignmentspmikus1-2/+2
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I1b535ea61ab68f6e37989ffc942979cdfd24f55e
2020-08-17Framework: Profiles loadpmikus4-140/+264
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: Iab84aff31a23bb9d8e1165f5314004803fd8a501
2020-08-17Measure latency only in special casesVratko Polak2-7/+15
+ Measure latency in 90/50/10/0% PDR loads in ndrpdr tests. + Do not measure latency anywhere else. - Needs manual editing to re-enable in soak tests. Change-Id: I69fa11bfcf71012f683061c5effea52a1be91620 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2020-08-17Trending: Fixes after reviewTibor Frank1-26/+48
Change-Id: Ia2fdd4d222c723c063f267a20e1a4f18b4e03d69 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-08-13Trending: NFV TestsTibor Frank2-32/+301
- 2n-skx - 2n-clx Change-Id: I6dd55ed167dc4267b2a4e4c52ec0874ad0e4a4b6 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-08-12Trending: NFV TestsTibor Frank1-0/+3
Change-Id: I882c0af852a9e556df3c748164360cdbc336d654 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-08-06Limit user triggers: no ORVratko Polak1-0/+7
To avoid runs such as: https://jenkins.fd.io/job/vpp-csit-verify-perf-master-3n-hsw/340/ Change-Id: I1b30d5f440ddf8ff32b11265b2ac2176f4b9a665 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2020-08-05Report 2005: Add data, configure rls2005.32Tibor Frank3-2/+14
Change-Id: I79129cac48c60a959e4dc1ebfc9d63b9b230e933 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-08-04Trending: Set longer time periodTibor Frank1-21/+38
- daily: up to 180 sets, max 180 days - weekly: up to 26 sets, max 180 days Change-Id: I59c550e5728fcb83f247b0c958f21209d927ee98 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-08-04Trending: Implement the latest changes in job specsTibor Frank1-2199/+1018
Graphs: - MRR - 2n-clx - 2n-skx - 3n-skx - 3n-hsw - 3n-tsh - NDRPDR - 2n-skx - 3n-skx - 3n-hsw - 2n-clx Change-Id: Ieab26ba1d2ee56e66c5c8598c4dba240a14e53e9 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-07-23T-Rex: Add advanced stateful modeJan Gelety5-178/+383
- provide base routines to run T-Rex in advanced stateful mode Change-Id: Ib0dc5f2919c370753335f6446860683dc4b12d93 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2020-07-31Framework: Perf stat capturingPeter Mikus4-10/+84
Change-Id: I3bbe1fe0073ddeead5219993675f24955e8c3dfd Signed-off-by: Peter Mikus <pmikus@cisco.com>
2020-07-30Introduce per DUT configurable statspmikus2-17/+68
- test/suite/global - binary logic is not working Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: Ia3d81cbf2c5f04d1093a0a408c84a9ffc6f3eef0