aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2020-08-04Trending: Implement the latest changes in job specsTibor Frank77-4596/+2352
Graphs: - MRR - 2n-clx - 2n-skx - 3n-skx - 3n-hsw - 3n-tsh - NDRPDR - 2n-skx - 3n-skx - 3n-hsw - 2n-clx Change-Id: Ieab26ba1d2ee56e66c5c8598c4dba240a14e53e9 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-07-23Update of VPP_STABLE_VER filesJan Gelety2-2/+2
- use new vpp ref build - ubuntu 18.04: 20.09-rc0~266-ge6c3e8f0e - use new vpp ref build - centos7: 20.09-rc0~266_ge6c3e8f~b9748 Change-Id: I3d173d9b67657b238f7a65e24d81f0ac8f9d0093 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2020-07-23T-Rex: Add advanced stateful modeJan Gelety66-255/+1306
- provide base routines to run T-Rex in advanced stateful mode Change-Id: Ib0dc5f2919c370753335f6446860683dc4b12d93 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2020-07-31Framework: Perf stat capturingPeter Mikus6-12/+86
Change-Id: I3bbe1fe0073ddeead5219993675f24955e8c3dfd Signed-off-by: Peter Mikus <pmikus@cisco.com>
2020-07-30Introduce per DUT configurable statspmikus5-26/+113
- test/suite/global - binary logic is not working Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: Ia3d81cbf2c5f04d1093a0a408c84a9ffc6f3eef0
2020-07-30TRex stateless: Fix unidirectional testsVratko Polak1-1/+1
Change-Id: I5e101f012ae4a4383e61b274499817d146479993 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2020-07-30Update RCA files with new findingsVratko Polak4-28/+37
Change-Id: I0db4d513cdc84c6f8c1e2dffa46cd41e13df5b21 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2020-07-29Ansible: Nomad 0.12.0 upgradepmikus6-2/+13
+ random fixes Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: Icb320d1ba4bbe3b5f99956cf8e89c2a29e114e41
2020-07-28Soak: Avoid a possible deadlock.Vratko Polak1-3/+5
Change-Id: I31c2d7744b5cd3021132fb188480b8edec74986c Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2020-07-28vsap: install ab using ansibleXiaolong Jiang3-0/+28
Signed-off-by: Xiaolong Jiang <xiaolongx.jiang@intel.com> Change-Id: I275ad9dccc02e6b1f1c791fabf8896fb03acb3fb
2020-07-28Docs testing_in_vagrant: add header sections and make command line codes ↵Martin Balaz1-26/+65
more readable Signed-off-by: Martin Balaz <martin.balaz@pantheon.tech> Change-Id: I0b8fdaad1e68e41e4a436d9f2fc566d8896adbd6 Signed-off-by: Martin Balaz <martin.balaz@pantheon.tech>
2020-07-28Doc: Update durations of test runsTibor Frank169-621/+638
Change-Id: I0652f4483a83954096649fbd92af1fecc4bf0a7d Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-07-21Update of VPP_STABLE_VER filesJan Gelety2-2/+2
- use new vpp ref build - ubuntu 18.04: 20.09-rc0~243-gc72995dd7 - use new vpp ref build - centos7: 20.09-rc0~243_gc72995d~b9727 Change-Id: Ib37d4a51bee9782077c537531d67e91ac52a358d Signed-off-by: Jan Gelety <jgelety@cisco.com>
2020-07-24NDRPDR: Allow smaller min_rate, 9001 ppsVratko Polak1-12/+16
+ Latency measurements need more than 9000 pps. - Previously 0% measurement used 9500 pps. Change-Id: Ic0841de096dfa8a61329f98aa1ba6d3f0ce60c66 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2020-07-24job-specs: Fix tag l2bdsbasemaclrn --> l2bdbasemaclrnTibor Frank5-162/+162
Change-Id: Icfecc2b9576d1be32c78f6b0019b64d6f401745e Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-07-24Report 2005: Add dataTibor Frank2-0/+7
Change-Id: Id91ac52634fbf4c6b931a61946eb7a9d8019dd76 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-07-23ansible nomad: install htopDave Wallace1-0/+1
Signed-off-by: Dave Wallace <dwallacelf@gmail.com> Change-Id: I0549e9b5ac6769e3fc760ab2047d89a188baa36a
2020-07-23FIX: Log required cli_cmd not "cli_inband"Jan Gelety1-2/+2
Change-Id: If0975b1d54882390c5be418927e2961d0f4c8429 Signed-off-by: Jan Gelety <jgelety@cisco.com> Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2020-07-23perpatch: Echo MAKE_PARALLEL_* var before buildJuraj Linkeš1-1/+15
VPP uses MAKE_PARALLEL_FLAGS or MAKE_PARALLEL_JOBS to limit the number of cpus to use during build, so emit a line on stdout if it's used. Change-Id: I669398d474d172abb6c848a45f24f1bdd56990d8 Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2020-07-23Report 2005: Configure rls2005.31, add dataTibor Frank4-2/+12
Change-Id: I87e07e334783e10dc863194f240e5dbcbf141915 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-07-22Report 2005: Add dataTibor Frank1-0/+11
Change-Id: Ic6574e2bb24ce4004ed8c917d9deeff9a45b37ab Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-07-20Update of VPP_STABLE_VER filesJan Gelety2-2/+2
- use new vpp ref build - ubuntu 18.04: 20.09-rc0~223-g459d17bb7 - use new vpp ref build - centos7: 20.09-rc0~223_g459d17b~b9700 Change-Id: I369f708dc4423f6897562e2597d6296a473f77b1 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2020-07-21Report 2005: Add dataTibor Frank2-0/+10
Change-Id: I677f2aa67bcd51a31509aefacbe9c428578beec5 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-07-20Report 2005: Add dataTibor Frank2-3/+5
Change-Id: I312d707aeb5feccacb393009e6cd02959ced4145 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-07-19Report 2005: Add dataTibor Frank2-0/+86
Change-Id: I4c674a7821a83b523a9406515849d10341a0d2ec Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-07-17job-specs: Align 2n-skx nfv tests with 2n-clxTibor Frank2-368/+4
Change-Id: I6c828ee146bab8ebdb24be6b03369f6e772d25c8 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-07-17Report 2005: Add dataTibor Frank1-0/+19
Change-Id: I1d1b802481449c29056e541752228c47a6e3ea72 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-07-16Remove remains of WRK testsTibor Frank25-1721/+2
Change-Id: If61783fb717757c6189f06924412bd079e15a08f Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-07-16FIX: CSIT annoyances IIpmikus1-1/+0
- useless code Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: I65dd0f4e1744e4ff84661cd38a67d4490c9733e7
2020-07-16FIX: CSIT annoyances I.pmikus1-2/+2
- As time flies Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: If4cc9575b3fa828ad598b524c8cbf943c623b485
2020-07-16Add ADL plugin to cop testsVratko Polak8-8/+8
The following VPP change renames and moves COP functionality into a brand new plugin: https://gerrit.fd.io/r/c/vpp/+/27916 In a subsequent change we should rename tests and start using the new API messages. This change is just a minimal edit to avoid test failures. Change-Id: I1c4b81060dd533ef447f3cc44443b71c5e524d59 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2020-07-16Report 2005: Add dataTibor Frank2-8/+12
Change-Id: I24215fa78d3ee9affb301d22c655b925dbb5bc14 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-07-16Report 2005: Configure 2005.30, add dataTibor Frank4-138/+120
Change-Id: I33908f6967e89e894560fd5f63c57a76c110e9ab Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-07-15Report 2005: Add pdf versionTibor Frank2-4/+8
Change-Id: I020559c4782b98700dfe5606a80695a1cfecbdcf Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-07-14report: 2n-clx, 2n-skx, 3n-skx RCA edits in comparison tablesMaciek Konstantynowicz4-102/+92
Change-Id: I9810b0b33355d880b606d7402564a3150d12397c Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2020-07-14report: Updated vpp performance tests release notesMaciek Konstantynowicz2-47/+55
Change-Id: I1028f4fc9d0f38d70ba8b838a66f74274e534a40 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2020-07-14Report 2005: Fix legend in comparison tablesTibor Frank1-54/+54
Change-Id: I79265bb14c6daf75944ed596c21b9929f8524333 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-07-14Report 2005: Add soak testsTibor Frank3-62/+44
Change-Id: Ib56215e906afba34d52b390ebc5a2d58bab4bf71 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-07-14Report 2005: Add NFV testsTibor Frank3-26/+33
- 2n-skx - ndrpdr, mrr - 2n-clx - ndrpdr, mrr Change-Id: I75f78a3986b17bb03187a4cc91260c4a60a7d515 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-07-13Report: remove wrk testsTibor Frank8-1330/+1
Change-Id: Ie3f6ad2e4b5542e915f310c7b9ebeddf88b6fd8a Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-07-13report: updated environment versioning sectionMaciek Konstantynowicz1-23/+49
Change-Id: I95adc8730d379286511398754042ad88b8c7d681 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2020-07-13Report: Improve vnf_service_chains_reconf.rstVratko Polak1-8/+9
+ Use the quantity name from methodology (not from test implementation). Change-Id: Ic46f0447af840b392fe5dbbfec2bd11a847b06ca Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2020-07-13Report: vpp_performance_tests/overview.rstVratko Polak2-7/+8
Change-Id: I1c5c1a26574861e22485e7b40e19304bb635bc4a Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2020-07-13Docs: Update TRex informationVratko Polak2-10/+10
The previous was describing CSIT version 3. + Stateless profile is now under GPL directory. Change-Id: I9810ca224159053386557493eaf90b4aa682710e Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2020-07-13RCA 2005: Update status in RCA filesVratko Polak4-16/+21
CSIT-1738, CSIT-1740 and CSIT-1741 are now DONE. Change-Id: Id9b93ace9464a7e6af64f7860ad1a15c7a287a53 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2020-07-13RCA: Improve footnotes for ACL VPP.Vratko Polak3-15/+12
+ Stateful ends with single l. Change-Id: I7be89b3f536d05ed9b21ba8849a4eef33259d312 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2020-07-13Soak: Do not allow negative lossVratko Polak2-2/+11
Change-Id: I6da359d25edc415e44263d3f85f166369e564987 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2020-07-13Report 2005: Add reconf testsTibor Frank3-42/+38
Change-Id: Ic9466d4c0e6fb757e7d7c01d1aa83a59c1389371 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-07-13Soak: Fix worker exception passingVratko Polak1-2/+10
Change-Id: I636f020e97df1b37ac8b6a30af511eebe611b56f Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2020-07-13Soak: Fix failure conditionVratko Polak1-3/+3
Previously, number of directions was not taken into account. Also, ideally PLRsearch never reports value under the hard minimum, so successful results are now required to be more than 10% better. Change-Id: I8622726b97bd1da3e139c8044a2932837fc268b7 Signed-off-by: Vratko Polak <vrpolak@cisco.com>