aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2020-08-17Measure latency only in special casesVratko Polak2-7/+15
+ Measure latency in 90/50/10/0% PDR loads in ndrpdr tests. + Do not measure latency anywhere else. - Needs manual editing to re-enable in soak tests. Change-Id: I69fa11bfcf71012f683061c5effea52a1be91620 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2020-08-17Update of VPP_STABLE_VER filesJan Gelety2-2/+2
- use new vpp ref build - ubuntu 18.04: 20.09-rc0~296-g17ec577f7 - use new vpp ref build - centos7: 20.09-rc0~296_g17ec577~b9779 Change-Id: I4b66014a4c39adc3c1e22fb29ef000474e1ac099 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2020-08-17Trending: Fixes after reviewTibor Frank4-44/+66
Change-Id: Ia2fdd4d222c723c063f267a20e1a4f18b4e03d69 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-08-13Trending: NFV TestsTibor Frank15-131/+541
- 2n-skx - 2n-clx Change-Id: I6dd55ed167dc4267b2a4e4c52ec0874ad0e4a4b6 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-08-12Trending: NFV TestsTibor Frank1-0/+3
Change-Id: I882c0af852a9e556df3c748164360cdbc336d654 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-08-05Update of VPP_STABLE_VER filesJan Gelety2-2/+2
- use new vpp ref build - ubuntu 18.04: 20.09-rc0~277-g6042d2815 - use new vpp ref build - centos7: 20.09-rc0~277_g6042d28~b9760 Change-Id: I1da941f54a6338846a3478923dbb5988ffbf842a Signed-off-by: Jan Gelety <jgelety@cisco.com>
2020-08-06Limit user triggers: no ORVratko Polak1-0/+7
To avoid runs such as: https://jenkins.fd.io/job/vpp-csit-verify-perf-master-3n-hsw/340/ Change-Id: I1b30d5f440ddf8ff32b11265b2ac2176f4b9a665 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2020-08-06job-specs: align mrr-weekly NFV tests with report-iterTibor Frank2-1085/+2
- 2n-skx - 2n-clx Change-Id: I8e96d335be2c26ffb03e210f6f658fba1825c597 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-08-05Add Denverton testbeds BIOS configuration docYulong Pei1-0/+351
Signed-off-by: Xinfeng Zhao <xinfengx.zhao@intel.com> Signed-off-by: Yulong Pei <yulong.pei@intel.com> Change-Id: I531b380277a885f45af0749d048f44ba12285dd2
2020-08-05Report 2005: Add data, configure rls2005.32Tibor Frank4-2/+21
Change-Id: I79129cac48c60a959e4dc1ebfc9d63b9b230e933 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-08-04Trending: Set longer time periodTibor Frank1-21/+38
- daily: up to 180 sets, max 180 days - weekly: up to 26 sets, max 180 days Change-Id: I59c550e5728fcb83f247b0c958f21209d927ee98 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-08-04Trending: Implement the latest changes in job specsTibor Frank77-4596/+2352
Graphs: - MRR - 2n-clx - 2n-skx - 3n-skx - 3n-hsw - 3n-tsh - NDRPDR - 2n-skx - 3n-skx - 3n-hsw - 2n-clx Change-Id: Ieab26ba1d2ee56e66c5c8598c4dba240a14e53e9 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-07-23Update of VPP_STABLE_VER filesJan Gelety2-2/+2
- use new vpp ref build - ubuntu 18.04: 20.09-rc0~266-ge6c3e8f0e - use new vpp ref build - centos7: 20.09-rc0~266_ge6c3e8f~b9748 Change-Id: I3d173d9b67657b238f7a65e24d81f0ac8f9d0093 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2020-07-23T-Rex: Add advanced stateful modeJan Gelety66-255/+1306
- provide base routines to run T-Rex in advanced stateful mode Change-Id: Ib0dc5f2919c370753335f6446860683dc4b12d93 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2020-07-31Framework: Perf stat capturingPeter Mikus6-12/+86
Change-Id: I3bbe1fe0073ddeead5219993675f24955e8c3dfd Signed-off-by: Peter Mikus <pmikus@cisco.com>
2020-07-30Introduce per DUT configurable statspmikus5-26/+113
- test/suite/global - binary logic is not working Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: Ia3d81cbf2c5f04d1093a0a408c84a9ffc6f3eef0
2020-07-30TRex stateless: Fix unidirectional testsVratko Polak1-1/+1
Change-Id: I5e101f012ae4a4383e61b274499817d146479993 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2020-07-30Update RCA files with new findingsVratko Polak4-28/+37
Change-Id: I0db4d513cdc84c6f8c1e2dffa46cd41e13df5b21 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2020-07-29Ansible: Nomad 0.12.0 upgradepmikus6-2/+13
+ random fixes Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: Icb320d1ba4bbe3b5f99956cf8e89c2a29e114e41
2020-07-28Soak: Avoid a possible deadlock.Vratko Polak1-3/+5
Change-Id: I31c2d7744b5cd3021132fb188480b8edec74986c Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2020-07-28vsap: install ab using ansibleXiaolong Jiang3-0/+28
Signed-off-by: Xiaolong Jiang <xiaolongx.jiang@intel.com> Change-Id: I275ad9dccc02e6b1f1c791fabf8896fb03acb3fb
2020-07-28Docs testing_in_vagrant: add header sections and make command line codes ↵Martin Balaz1-26/+65
more readable Signed-off-by: Martin Balaz <martin.balaz@pantheon.tech> Change-Id: I0b8fdaad1e68e41e4a436d9f2fc566d8896adbd6 Signed-off-by: Martin Balaz <martin.balaz@pantheon.tech>
2020-07-28Doc: Update durations of test runsTibor Frank169-621/+638
Change-Id: I0652f4483a83954096649fbd92af1fecc4bf0a7d Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-07-21Update of VPP_STABLE_VER filesJan Gelety2-2/+2
- use new vpp ref build - ubuntu 18.04: 20.09-rc0~243-gc72995dd7 - use new vpp ref build - centos7: 20.09-rc0~243_gc72995d~b9727 Change-Id: Ib37d4a51bee9782077c537531d67e91ac52a358d Signed-off-by: Jan Gelety <jgelety@cisco.com>
2020-07-24NDRPDR: Allow smaller min_rate, 9001 ppsVratko Polak1-12/+16
+ Latency measurements need more than 9000 pps. - Previously 0% measurement used 9500 pps. Change-Id: Ic0841de096dfa8a61329f98aa1ba6d3f0ce60c66 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2020-07-24job-specs: Fix tag l2bdsbasemaclrn --> l2bdbasemaclrnTibor Frank5-162/+162
Change-Id: Icfecc2b9576d1be32c78f6b0019b64d6f401745e Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-07-24Report 2005: Add dataTibor Frank2-0/+7
Change-Id: Id91ac52634fbf4c6b931a61946eb7a9d8019dd76 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-07-23ansible nomad: install htopDave Wallace1-0/+1
Signed-off-by: Dave Wallace <dwallacelf@gmail.com> Change-Id: I0549e9b5ac6769e3fc760ab2047d89a188baa36a
2020-07-23FIX: Log required cli_cmd not "cli_inband"Jan Gelety1-2/+2
Change-Id: If0975b1d54882390c5be418927e2961d0f4c8429 Signed-off-by: Jan Gelety <jgelety@cisco.com> Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2020-07-23perpatch: Echo MAKE_PARALLEL_* var before buildJuraj Linkeš1-1/+15
VPP uses MAKE_PARALLEL_FLAGS or MAKE_PARALLEL_JOBS to limit the number of cpus to use during build, so emit a line on stdout if it's used. Change-Id: I669398d474d172abb6c848a45f24f1bdd56990d8 Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2020-07-23Report 2005: Configure rls2005.31, add dataTibor Frank4-2/+12
Change-Id: I87e07e334783e10dc863194f240e5dbcbf141915 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-07-22Report 2005: Add dataTibor Frank1-0/+11
Change-Id: Ic6574e2bb24ce4004ed8c917d9deeff9a45b37ab Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-07-20Update of VPP_STABLE_VER filesJan Gelety2-2/+2
- use new vpp ref build - ubuntu 18.04: 20.09-rc0~223-g459d17bb7 - use new vpp ref build - centos7: 20.09-rc0~223_g459d17b~b9700 Change-Id: I369f708dc4423f6897562e2597d6296a473f77b1 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2020-07-21Report 2005: Add dataTibor Frank2-0/+10
Change-Id: I677f2aa67bcd51a31509aefacbe9c428578beec5 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-07-20Report 2005: Add dataTibor Frank2-3/+5
Change-Id: I312d707aeb5feccacb393009e6cd02959ced4145 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-07-19Report 2005: Add dataTibor Frank2-0/+86
Change-Id: I4c674a7821a83b523a9406515849d10341a0d2ec Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-07-17job-specs: Align 2n-skx nfv tests with 2n-clxTibor Frank2-368/+4
Change-Id: I6c828ee146bab8ebdb24be6b03369f6e772d25c8 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-07-17Report 2005: Add dataTibor Frank1-0/+19
Change-Id: I1d1b802481449c29056e541752228c47a6e3ea72 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-07-16Remove remains of WRK testsTibor Frank25-1721/+2
Change-Id: If61783fb717757c6189f06924412bd079e15a08f Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-07-16FIX: CSIT annoyances IIpmikus1-1/+0
- useless code Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I65dd0f4e1744e4ff84661cd38a67d4490c9733e7
2020-07-16FIX: CSIT annoyances I.pmikus1-2/+2
- As time flies Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: If4cc9575b3fa828ad598b524c8cbf943c623b485
2020-07-16Add ADL plugin to cop testsVratko Polak8-8/+8
The following VPP change renames and moves COP functionality into a brand new plugin: https://gerrit.fd.io/r/c/vpp/+/27916 In a subsequent change we should rename tests and start using the new API messages. This change is just a minimal edit to avoid test failures. Change-Id: I1c4b81060dd533ef447f3cc44443b71c5e524d59 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2020-07-16Report 2005: Add dataTibor Frank2-8/+12
Change-Id: I24215fa78d3ee9affb301d22c655b925dbb5bc14 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-07-16Report 2005: Configure 2005.30, add dataTibor Frank4-138/+120
Change-Id: I33908f6967e89e894560fd5f63c57a76c110e9ab Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-07-15Report 2005: Add pdf versionTibor Frank2-4/+8
Change-Id: I020559c4782b98700dfe5606a80695a1cfecbdcf Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-07-14report: 2n-clx, 2n-skx, 3n-skx RCA edits in comparison tablesMaciek Konstantynowicz4-102/+92
Change-Id: I9810b0b33355d880b606d7402564a3150d12397c Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2020-07-14report: Updated vpp performance tests release notesMaciek Konstantynowicz2-47/+55
Change-Id: I1028f4fc9d0f38d70ba8b838a66f74274e534a40 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2020-07-14Report 2005: Fix legend in comparison tablesTibor Frank1-54/+54
Change-Id: I79265bb14c6daf75944ed596c21b9929f8524333 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-07-14Report 2005: Add soak testsTibor Frank3-62/+44
Change-Id: Ib56215e906afba34d52b390ebc5a2d58bab4bf71 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-07-14Report 2005: Add NFV testsTibor Frank3-26/+33
- 2n-skx - ndrpdr, mrr - 2n-clx - ndrpdr, mrr Change-Id: I75f78a3986b17bb03187a4cc91260c4a60a7d515 Signed-off-by: Tibor Frank <tifrank@cisco.com>