aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2020-08-28Trending: Add identification of DUT to alerting emailTibor Frank2-34/+34
Change-Id: I2e63f16aef48e68b0e86e913431bed7df01f1b70 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-08-28Ansible: Add arm nomads into poolpmikus1-2/+2
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I99a33a15e7e87fe6f56deb1ab0e4ce3091508244
2020-08-27Trending: Add DPDK tests to list of failed testsTibor Frank1-0/+72
Change-Id: I25e805125528d67a5eea277df6d88549f129d137 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-08-27Trending, Report: nat44-deterministc test names changeTibor Frank2-46/+46
Change-Id: I1956ccaff625f287995765a4c2b0b46cb00d0d65 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-08-26job-specs: remove ip4-08.md from 3n-hsw and 3n-skxTibor Frank2-79/+0
- They duplicate specification which is in ip4-01.md files Change-Id: I818e1c165415b1f7d53ed28ffb345f07e6ac0576 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-08-25Job-specs: Fix the runs durationsTibor Frank4-12/+12
Change-Id: Ifeb5455140e911b804df55b4ceeda26575ae9da9 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-08-25job-specs: nat44-deterministc test names changeTibor Frank10-240/+93
Change-Id: I3ff3f10c4c9795dc4d95b3a7d04f73f618e4a2d3 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-08-24T-Rex: 2.82, core pin, 8 workerspmikus11-13/+18
+ Bump T-Rex version. We need new features for ASTF test. + Apply core pining. Results in a more stable performance. + Tweak the number of T-Rex workers. + We need an even value to achieve ymmetric performance with pinning. + Value 8 was selected as a best compromise. This is a combination of 3 commits. This is the 1st commit message: T-Rex: 2.82 This is the commit message #2: Change Trex to CORE_MASK_PIN mode to improve performance https://trex-tgn.cisco.com/trex/doc/trex_stateless.html#_core_masking_per_interface Above link have below explaination, "When the profile is symmetric, performance can be improved by pinning half of the cores to port 0, and half of the cores to port 1, thus avoiding cache trashing and bouncing." The reason to change this is that to run CSIT with 100G NIC often failed with "TRex stateless runtime error timeout", it caused by Trex can not send enough traffic within the fixed duration. by change to CORE_MASK_PIN mode fix the issue. Not editing ASTF, as that supports different options. This is the commit message #3: Experiment: Vary number of TRex workers With CORE_MASK_PIN, we can get more predictable time distribution. Decided to use 8 workers, that gives good results both for high end (RDMA-core l2patch) and low end (vhost) tests. Change-Id: I5c61127799e0624464e960fcb980ad1c4058e744 Signed-off-by: pmikus <pmikus@cisco.com> Signed-off-by: Yulong Pei <yulong.pei@intel.com> Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2020-08-24Framework: Qemu alignmentspmikus2-17/+28
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I2781e85f44acffb4f8d7f02326ba2ca668dad0c5
2020-08-08Fix: NAT44 deterministic moved to separate det44 pluginJan Gelety27-2625/+300
- align CSIT code with VPP code changes for NAT44 deterministic (DET44) feature - align test names according to snat44ed tests - remove obsolete 3-node nat tests - remove 2n1l-10ge2p1x710-ethip4udp-snat44det-h1048576-p63-s66060288 tests (not enough memory for such high number of sessions) Change-Id: I9a22b99b4cfa56d18e9c7ef9c58296e202567d42 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2020-08-20Fix: Use new-style interface variablesVratko Polak2-6/+6
The old-style variables contain None in some places, mainly in SRv6 proxy tests. Change-Id: If3887a7dba051454c504b345a6a316d5d69d0139 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2020-08-20Framework: use 'stl' in trex stateless profile namesJan Gelety661-526/+525
Change-Id: I74641cc89d2f25d50b67d51bf2567082b420aabb Signed-off-by: Jan Gelety <jgelety@cisco.com>
2020-08-20PAL: Add processing of throughput in GbpsTibor Frank2-98/+171
Change-Id: I264e329fa94cddf6a759f14bf567c56a50d1895d Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-08-19Add Intel E810CQ 100G NIC configurationYulong Pei3-3/+28
for Intel E810CQ 100G NIC, kernel driver of PF is ice, kernel driver of VF is iavf, its VF hardware support VPP native avf driver. Signed-off-by: Yulong Pei <yulong.pei@intel.com> Change-Id: Ic8d86e5ee00057bbbcd09df619a38bd1371c8fd7
2020-08-19Sign off on relicensing of scapy related files for IntelRay Kinsella1-0/+8
Signed-off-by: Ray Kinsella <mdr@ashroe.eu> Change-Id: I5f328b702ff7faffd432d08925cf1c247de1d680
2020-08-19Sign off on relicensing of scapy related files for Cisco.Ed Warnicke1-0/+18
Change-Id: Ia27726d8bed649a55ac93ea3464b8bf278fe9d8f Signed-off-by: Ed Warnicke <hagbard@gmail.com>
2020-08-19Perf: NAT44 endpoint-dependent mode - tcp, part IJan Gelety20-0/+2265
Jira: CSIT-1736 - tcp synthetic profiles w/o data packets - tcp cps perf tests, phase I (no special "search cps" KW) Change-Id: I52be34b0fdd51d7a33c8c5de9b46d7064c48f7fa Signed-off-by: Jan Gelety <jgelety@cisco.com>
2020-08-07Perf: NAT44 endpoint-dependent mode - udp, part IJan Gelety42-585/+2998
- continuation of https://gerrit.fd.io/r/c/csit/+/26898 as there was reached limit of changes (1000) Jira: CSIT-1711 - udp synthetic profiles w/o data packets - udp cps perf tests, phase I (no special "search cps" KW) Part I means that we are using MRR tests to collect traffic data until there is ready new CPS test type with corresponding algorithm. Change-Id: I0d30feb9ecf1d0bff937152656f8eb422f831378 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2020-08-18Framework: Qemu alignmentspmikus10-8/+180
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I20098fca8fb513accef3edc9a72bfd3c56bf9be2
2020-08-18Framework: Alignmentspmikus1-2/+2
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I1b535ea61ab68f6e37989ffc942979cdfd24f55e
2020-08-17Framework: Profiles loadpmikus4-140/+264
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: Iab84aff31a23bb9d8e1165f5314004803fd8a501
2020-08-17Measure latency only in special casesVratko Polak2-7/+15
+ Measure latency in 90/50/10/0% PDR loads in ndrpdr tests. + Do not measure latency anywhere else. - Needs manual editing to re-enable in soak tests. Change-Id: I69fa11bfcf71012f683061c5effea52a1be91620 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2020-08-17Update of VPP_STABLE_VER filesJan Gelety2-2/+2
- use new vpp ref build - ubuntu 18.04: 20.09-rc0~296-g17ec577f7 - use new vpp ref build - centos7: 20.09-rc0~296_g17ec577~b9779 Change-Id: I4b66014a4c39adc3c1e22fb29ef000474e1ac099 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2020-08-17Trending: Fixes after reviewTibor Frank4-44/+66
Change-Id: Ia2fdd4d222c723c063f267a20e1a4f18b4e03d69 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-08-13Trending: NFV TestsTibor Frank15-131/+541
- 2n-skx - 2n-clx Change-Id: I6dd55ed167dc4267b2a4e4c52ec0874ad0e4a4b6 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-08-12Trending: NFV TestsTibor Frank1-0/+3
Change-Id: I882c0af852a9e556df3c748164360cdbc336d654 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-08-05Update of VPP_STABLE_VER filesJan Gelety2-2/+2
- use new vpp ref build - ubuntu 18.04: 20.09-rc0~277-g6042d2815 - use new vpp ref build - centos7: 20.09-rc0~277_g6042d28~b9760 Change-Id: I1da941f54a6338846a3478923dbb5988ffbf842a Signed-off-by: Jan Gelety <jgelety@cisco.com>
2020-08-06Limit user triggers: no ORVratko Polak1-0/+7
To avoid runs such as: https://jenkins.fd.io/job/vpp-csit-verify-perf-master-3n-hsw/340/ Change-Id: I1b30d5f440ddf8ff32b11265b2ac2176f4b9a665 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2020-08-06job-specs: align mrr-weekly NFV tests with report-iterTibor Frank2-1085/+2
- 2n-skx - 2n-clx Change-Id: I8e96d335be2c26ffb03e210f6f658fba1825c597 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-08-05Add Denverton testbeds BIOS configuration docYulong Pei1-0/+351
Signed-off-by: Xinfeng Zhao <xinfengx.zhao@intel.com> Signed-off-by: Yulong Pei <yulong.pei@intel.com> Change-Id: I531b380277a885f45af0749d048f44ba12285dd2
2020-08-05Report 2005: Add data, configure rls2005.32Tibor Frank4-2/+21
Change-Id: I79129cac48c60a959e4dc1ebfc9d63b9b230e933 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-08-04Trending: Set longer time periodTibor Frank1-21/+38
- daily: up to 180 sets, max 180 days - weekly: up to 26 sets, max 180 days Change-Id: I59c550e5728fcb83f247b0c958f21209d927ee98 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-08-04Trending: Implement the latest changes in job specsTibor Frank77-4596/+2352
Graphs: - MRR - 2n-clx - 2n-skx - 3n-skx - 3n-hsw - 3n-tsh - NDRPDR - 2n-skx - 3n-skx - 3n-hsw - 2n-clx Change-Id: Ieab26ba1d2ee56e66c5c8598c4dba240a14e53e9 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-07-23Update of VPP_STABLE_VER filesJan Gelety2-2/+2
- use new vpp ref build - ubuntu 18.04: 20.09-rc0~266-ge6c3e8f0e - use new vpp ref build - centos7: 20.09-rc0~266_ge6c3e8f~b9748 Change-Id: I3d173d9b67657b238f7a65e24d81f0ac8f9d0093 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2020-07-23T-Rex: Add advanced stateful modeJan Gelety66-255/+1306
- provide base routines to run T-Rex in advanced stateful mode Change-Id: Ib0dc5f2919c370753335f6446860683dc4b12d93 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2020-07-31Framework: Perf stat capturingPeter Mikus6-12/+86
Change-Id: I3bbe1fe0073ddeead5219993675f24955e8c3dfd Signed-off-by: Peter Mikus <pmikus@cisco.com>
2020-07-30Introduce per DUT configurable statspmikus5-26/+113
- test/suite/global - binary logic is not working Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: Ia3d81cbf2c5f04d1093a0a408c84a9ffc6f3eef0
2020-07-30TRex stateless: Fix unidirectional testsVratko Polak1-1/+1
Change-Id: I5e101f012ae4a4383e61b274499817d146479993 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2020-07-30Update RCA files with new findingsVratko Polak4-28/+37
Change-Id: I0db4d513cdc84c6f8c1e2dffa46cd41e13df5b21 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2020-07-29Ansible: Nomad 0.12.0 upgradepmikus6-2/+13
+ random fixes Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: Icb320d1ba4bbe3b5f99956cf8e89c2a29e114e41
2020-07-28Soak: Avoid a possible deadlock.Vratko Polak1-3/+5
Change-Id: I31c2d7744b5cd3021132fb188480b8edec74986c Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2020-07-28vsap: install ab using ansibleXiaolong Jiang3-0/+28
Signed-off-by: Xiaolong Jiang <xiaolongx.jiang@intel.com> Change-Id: I275ad9dccc02e6b1f1c791fabf8896fb03acb3fb
2020-07-28Docs testing_in_vagrant: add header sections and make command line codes ↵Martin Balaz1-26/+65
more readable Signed-off-by: Martin Balaz <martin.balaz@pantheon.tech> Change-Id: I0b8fdaad1e68e41e4a436d9f2fc566d8896adbd6 Signed-off-by: Martin Balaz <martin.balaz@pantheon.tech>
2020-07-28Doc: Update durations of test runsTibor Frank169-621/+638
Change-Id: I0652f4483a83954096649fbd92af1fecc4bf0a7d Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-07-21Update of VPP_STABLE_VER filesJan Gelety2-2/+2
- use new vpp ref build - ubuntu 18.04: 20.09-rc0~243-gc72995dd7 - use new vpp ref build - centos7: 20.09-rc0~243_gc72995d~b9727 Change-Id: Ib37d4a51bee9782077c537531d67e91ac52a358d Signed-off-by: Jan Gelety <jgelety@cisco.com>
2020-07-24NDRPDR: Allow smaller min_rate, 9001 ppsVratko Polak1-12/+16
+ Latency measurements need more than 9000 pps. - Previously 0% measurement used 9500 pps. Change-Id: Ic0841de096dfa8a61329f98aa1ba6d3f0ce60c66 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2020-07-24job-specs: Fix tag l2bdsbasemaclrn --> l2bdbasemaclrnTibor Frank5-162/+162
Change-Id: Icfecc2b9576d1be32c78f6b0019b64d6f401745e Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-07-24Report 2005: Add dataTibor Frank2-0/+7
Change-Id: Id91ac52634fbf4c6b931a61946eb7a9d8019dd76 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-07-23ansible nomad: install htopDave Wallace1-0/+1
Signed-off-by: Dave Wallace <dwallacelf@gmail.com> Change-Id: I0549e9b5ac6769e3fc760ab2047d89a188baa36a
2020-07-23FIX: Log required cli_cmd not "cli_inband"Jan Gelety1-2/+2
Change-Id: If0975b1d54882390c5be418927e2961d0f4c8429 Signed-off-by: Jan Gelety <jgelety@cisco.com> Signed-off-by: Vratko Polak <vrpolak@cisco.com>