aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2020-07-13Report 2005: Add reconf testsTibor Frank3-42/+38
Change-Id: Ic9466d4c0e6fb757e7d7c01d1aa83a59c1389371 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-07-13Soak: Fix worker exception passingVratko Polak1-2/+10
Change-Id: I636f020e97df1b37ac8b6a30af511eebe611b56f Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2020-07-13Soak: Fix failure conditionVratko Polak1-3/+3
Previously, number of directions was not taken into account. Also, ideally PLRsearch never reports value under the hard minimum, so successful results are now required to be more than 10% better. Change-Id: I8622726b97bd1da3e139c8044a2932837fc268b7 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2020-07-13Update of VPP_STABLE_VER filesJan Gelety2-2/+2
- use new vpp ref build - ubuntu 18.04: 20.09-rc0~194-g52e9aaf0b - use new vpp ref build - centos7: 20.09-rc0~193_gea7e708~b9670 (build 20.09-rc0~197 not uploaded to packagecloud.io) Change-Id: I3a6e284daf67e826eda184aa7a9af1dd3b7a6043 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2020-07-13Report 2005: Fix titles in test envTibor Frank5-6/+6
Change-Id: I55e7a596d5fa23531e68d7ace9364411c3c372fc Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-07-13Report 2005: Add dataTibor Frank1-75/+74
- perf-iter-3n-tsh - 1 run - perf-cov-3n-hsw - 35 runs Change-Id: I9951cd2aa1883efa944b5c16b3b736761c1ff64f Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-07-13Report 2005: Configure rls2005.39Tibor Frank3-3/+3
Change-Id: I7ea2e004b79d47420f6a1e0beb88731529b03706 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-07-13report: fixed misplaced environment versioning sectionMaciek Konstantynowicz2-42/+43
Change-Id: Id0da363b376e12dac583f95624ed6525b24290eb Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2020-07-10Docs: job-specs: dpdk and nfv-density test setsTibor Frank17-362/+487
+ synchronize iter dpdk test sets with coverage dpdk test sets + add iter nfv-density-mrr test sets Change-Id: I759025b6acf860aca9828f9fc1d82ab3a37ec98f Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-07-10RCA 2005: Update RCA files.Vratko Polak10-239/+390
+ Current state. + Covers skx (also 3n) and clx. + Specific Jira sub-tasks, even for VPP progressions. - Only 2n-skx data for NDR. Change-Id: I56cf870aedc1319891b7188268ff6cf7bc744ff8 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2020-07-10report: added versioning sub-section to VPP Test Environment sectionMaciek Konstantynowicz1-0/+40
Change-Id: I59a93c0594ab5e5f0e267cacdf03d1f345e02b29 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2020-07-10Report 2005: Add dataTibor Frank1-0/+5
Change-Id: I56b805eec6e5d606a954ba749b16ce72ce6047fa Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-07-09Framework: Allow change of MRR settingspmikus1-24/+39
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: Ie88f0df239725a4de62d727e1923cdb3ad040809
2020-07-09Report 2005: Add data, review graphsTibor Frank28-669/+681
Change-Id: I2913ed579369a26a1226cfbe958432d1b3e11789 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-07-08Report 2005: Add data, hide dnv, soak, reconf, nfvTibor Frank18-826/+774
Change-Id: Iff1b1db3e31d2e1f19f8309ba28f1f88e0538f6c Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-07-08PAL: Improve comparison tablesTibor Frank8-724/+439
- place RCAs to the columns with diffs CSIT-1737 Change-Id: I3ccf5ee510796684e3e09dbdc6264b05f391f633 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-07-07Report: 2005: Add data, configure rls2005.28Tibor Frank4-3/+7
Change-Id: I686102fd7d17ad287ae890f1170ef7c78ff74a0d Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-07-06Update TODOs for toxVratko Polak1-1/+2
Change-Id: I9368557aed7508d9401628c0ddfda475da42bc99 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2020-07-05Report 2005: Add dataTibor Frank1-0/+32
Change-Id: Icc4ea692adcafef542dfa61e0fa594c85db6898e Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-07-03Report 2005: Add dataTibor Frank1-0/+2
Change-Id: I8c0be475c73aa5c9c3d04780851faf25f1156aed Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-07-03Report 2005: Add data, change legend in comp tablesTibor Frank1-440/+443
Change-Id: I538751d928a547b9c168798f853903dd56887f47 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-07-02Trending and report alignmentTibor Frank29-4046/+17
- use test sets defined in report-iterative also for mrr tests and for mrr_daily and mlr_weekly Change-Id: I47fba2997cddaca934bdebd5fca6936e25332afc Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-07-02Infra: add jlinkes ssh key to ARM nomad serversJuraj Linkeš8-0/+16
Change-Id: Ie304118e6b1ecb06704e35bbbeccf7cc0f649e8b Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2020-07-02Report 2005: Fix data src for VPP Perf Changes 2n-clx-xxv710Tibor Frank1-52/+36
Change-Id: I8e8a7e88475a789f04767893866db2502ec5f8ed Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-07-02Report 2005: Add dataTibor Frank1-166/+1102
Change-Id: I65e1a386a29faa9c890a526b8d264f4eabcbf382 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-07-01docs: added mrr tests for vpp and dpdk to job_specs/report_iterativeMaciek Konstantynowicz14-0/+2202
Change-Id: Ie8fca17baa114fcdf5916e65311716a86e791709 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2020-07-01Infra: Update ansible ARM dev serverJuraj Linkeš4-21/+21
Remove nomad installation from the ARM dev server and add a generic vppdev user to it. Add ansible role dev for this. Change-Id: Icb967ff18cbe939464ddb3d8dbce5101747e739f Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2020-07-01Infra: Update Ansible ARM NomadJuraj Linkeš9-9/+177
- Add three new ThunderX servers - Mark two existing ThunderX servers as out of order, since they're inaccessible - Fix microarchitecture of ARM build servers Change-Id: I57f5f3f8436a9082a264eb4e0fa4faac77ad53be Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2020-07-01Report 2005: Add dataTibor Frank1-65/+193
+ 2001.0-4 vs 2001.0-2 for 3n-hsw Change-Id: Ice05011ea79681ede74825ed8ae6be849ea06b8f Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-06-30make graph node variant can be configured from gerrit triggerYulong Pei4-1/+33
for example, below will trigger VPP with default code path test in CSIT, "csit-2n-clx-perftest mrrAND64bANDnic_intel-xxv710ANDeth-l2bdbasemaclrnNOTdrv_avf" and below will trigger VPP with avx512 code path test in CSIT, "csit-2n-clx-perftest icl mrrAND64bANDnic_intel-xxv710ANDeth-l2bdbasemaclrnNOTdrv_avf" Change-Id: Id3abf932203ce00f34f8643c5bc4d5fc4d3e6efb Signed-off-by: Yulong Pei <yulong.pei@intel.com>
2020-06-30Report 2005: Add 3n-skx mrr env 4 dataTibor Frank1-21/+70
Change-Id: I44f05050c8e0c528c4980ac767232c497d058d9f Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-06-30Report: Improve containers.rstVratko Polak1-40/+40
Change-Id: I2280b3f8c1977b47b222fa5ce3d47f90dc9b7e87 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2020-06-30Report 2005: Add 2n-clx and 3n-hsw mrr env 4 dataTibor Frank1-45/+144
Change-Id: I431215d96699381385199b61e9e5f37a581d91f4 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-06-29Report 2005: Replace data in thput graphs by env 4Tibor Frank1-46/+78
Change-Id: I6bd871d85c7ca2ed9748a96b0568f8f3dab82008 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-06-29Report 2005: Configure rls2005.27, add dataTibor Frank4-3/+17
Change-Id: I6a9911b500d40708e2570be9d83cdd860c677977 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-06-26Report 2005: Fix comparison table hdr, add dataTibor Frank12-230/+268
Change-Id: I3ef6dfb1b3da4f91c77841536a840a439816e61f Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-06-26Report 2005: Add data, fix sorting in comp tablesTibor Frank2-8/+11
Change-Id: Ib0c42f5b9fbd9b9f9ebf0bff437ef9d145e6ddda Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-06-26Report 2005: Add dataTibor Frank1-16/+18
Change-Id: I7ffbe353739c3077bbfc03f25f4b6e03b2fdcccd Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-06-25Reporet 2005: Add data, Fix comparison columnsTibor Frank1-100/+115
Change-Id: I83bd99c7afd63bd9ef0e432562c76cbe4ac8cb9d Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-06-25Report 2005: Add dataTibor Frank2-2/+25
Change-Id: I35803563351aa5419726a8a469f23557b49189f2 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-06-25Report 2005: Add 3n-skx comp tablesTibor Frank1-143/+143
Change-Id: Ic3237d165fdc9b7ca95498f724e0173f1cd29dad Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-06-25Report 2005: Add dataTibor Frank1-257/+145
Change-Id: I11c238327de71e75ca1ad099455f8daeb1ce996b Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-06-25report: updated rls notes for vpp performance sectionMaciek Konstantynowicz1-89/+13
Change-Id: I114c7d64c24210df4273086757ef33735baffe94 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2020-06-25Report: Improve soak_tests/index.rstVratko Polak1-10/+5
- The -iterative- jobs should be used in future, but for 2005 the results still come from -verify- jobs. Change-Id: Ief6651a17543f27a3ccfaf2861aa6f511d80127e Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2020-06-25Report 2005: Add data, improve comp tables descTibor Frank1-133/+130
Change-Id: I7d3afd5c3f6322cb76668b7ecfa288e9b64c6cc3 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-06-24Report 2005: Add dataTibor Frank1-297/+289
Change-Id: Iffffa9dc7f87d0838cb674ffae01ca2407939dbe Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-06-24Report 2005: Update comp tables, add dataTibor Frank1-253/+349
Change-Id: Ifcbf9e1f382ea33d0601f0bf52ad08b5f5f123a4 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-06-24Report 2005: Add env 2 data, update 3n-hsw comp tablesTibor Frank1-150/+84
Change-Id: Ibaab929900abec2321a36ed1251d936d4327c927 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-06-23Revert "Tweak TRex cores and RDMA pps limit"Vratko Polak1-6/+2
This reverts commit 925c5bfcffb2bc6b833a8e64b7f3a06bbca52197. It was affecting 2005 performance, confusing comparisons. The revert includes the RDMA limit. Change-Id: I9c31b061ee59bc5cb14d623ac98a65763ef75f1c Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2020-06-22Report 2005: Add data, remove obsolete graphsTibor Frank5-1747/+5
Change-Id: Id8b4d2d52bc35527cce0067cffa9ffb865ddfcce Signed-off-by: Tibor Frank <tifrank@cisco.com>