aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2020-07-13Report 2005: Fix titles in test envTibor Frank5-6/+6
Change-Id: I55e7a596d5fa23531e68d7ace9364411c3c372fc Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit d6aed8b19c60ff81cad100c9c3a6931ce1686f38)
2020-07-13Report 2005: Add dataTibor Frank1-75/+74
- perf-iter-3n-tsh - 1 run - perf-cov-3n-hsw - 35 runs Change-Id: I9951cd2aa1883efa944b5c16b3b736761c1ff64f Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit b9056e2936fa92ae0ec514db2eed482ce33679a0)
2020-07-13Report 2005: Configure rls2005.39Tibor Frank3-3/+3
Change-Id: I7ea2e004b79d47420f6a1e0beb88731529b03706 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit f2606a6a0826cf95fd9fe0b0ff0eb43bffd8e8b7)
2020-07-13report: fixed misplaced environment versioning sectionMaciek Konstantynowicz2-42/+43
Change-Id: Id0da363b376e12dac583f95624ed6525b24290eb Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> (cherry picked from commit 30a988b35c6d66a11b5ec2f2c77c741dc942594e)
2020-07-10Docs: job-specs: dpdk and nfv-density test setsTibor Frank17-374/+487
+ synchronize iter dpdk test sets with coverage dpdk test sets + add iter nfv-density-mrr test sets Change-Id: I759025b6acf860aca9828f9fc1d82ab3a37ec98f Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit bc42880dfa7c5d4c9abe8e6957e44752db10918e)
2020-07-10RCA 2005: Update RCA files.Vratko Polak10-239/+390
+ Current state. + Covers skx (also 3n) and clx. + Specific Jira sub-tasks, even for VPP progressions. - Only 2n-skx data for NDR. Change-Id: I56cf870aedc1319891b7188268ff6cf7bc744ff8 Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit 713e795d22717f69edf298d9dc4a16859206335f)
2020-07-10report: added versioning sub-section to VPP Test Environment sectionMaciek Konstantynowicz1-0/+40
Change-Id: I59a93c0594ab5e5f0e267cacdf03d1f345e02b29 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> (cherry picked from commit 6c03d82f93fd0a4f0f7a7c750e18246260e11dd4)
2020-07-10Report 2005: Add dataTibor Frank1-0/+5
Change-Id: I56b805eec6e5d606a954ba749b16ce72ce6047fa Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit d3612b6d641dbfc8013ac3e4d8f2a33b123742f3)
2020-07-09Report 2005: Add data, review graphsTibor Frank28-669/+681
Change-Id: I2913ed579369a26a1226cfbe958432d1b3e11789 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 12c3608c3464add7664e3b8f41b07b9b8fd03f1c)
2020-07-08Report 2005: Add data, hide dnv, soak, reconf, nfvTibor Frank18-826/+774
Change-Id: Iff1b1db3e31d2e1f19f8309ba28f1f88e0538f6c Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit d0f1e8778dac3549a1f1e403541de9f3ee88ec8d)
2020-07-08PAL: Improve comparison tablesTibor Frank8-724/+439
- place RCAs to the columns with diffs CSIT-1737 Change-Id: I3ccf5ee510796684e3e09dbdc6264b05f391f633 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit ff8c8cf6083f64fd337115fec20501f7b247540e)
2020-07-07Report: 2005: Add data, configure rls2005.28Tibor Frank4-3/+7
Change-Id: I686102fd7d17ad287ae890f1170ef7c78ff74a0d Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 9439b30ba91e3532c66548c34bade4469fdfab37)
2020-07-05Report 2005: Add dataTibor Frank1-0/+32
Change-Id: Icc4ea692adcafef542dfa61e0fa594c85db6898e Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 921a1c6556b0d8a20a8e7ba2a48b887b41a30e60)
2020-07-03Report 2005: Add dataTibor Frank1-0/+2
Change-Id: I8c0be475c73aa5c9c3d04780851faf25f1156aed Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 617bf7e282e2eec5aaa9e33f98b0d65e6ac1874b)
2020-07-03Report 2005: Add data, change legend in comp tablesTibor Frank1-440/+443
Change-Id: I538751d928a547b9c168798f853903dd56887f47 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit f8f439e49ef481ceebac6cea76194bda83583927)
2020-07-02Trending and report alignmentTibor Frank29-4046/+17
- use test sets defined in report-iterative also for mrr tests and for mrr_daily and mlr_weekly Change-Id: I47fba2997cddaca934bdebd5fca6936e25332afc Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit ea77fd004ce6dfbfe48d861743a9d14f99a620a4)
2020-07-02Report 2005: Fix data src for VPP Perf Changes 2n-clx-xxv710Tibor Frank1-52/+36
Change-Id: I8e8a7e88475a789f04767893866db2502ec5f8ed Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 75afcbc8614c69755c008e0d63eaf6ac79cb3184)
2020-07-02Report 2005: Add dataTibor Frank1-166/+1102
Change-Id: I65e1a386a29faa9c890a526b8d264f4eabcbf382 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 9e06ee18ddcd7287162afd6848121e9a094fee57)
2020-07-01docs: added mrr tests for vpp and dpdk to job_specs/report_iterativeMaciek Konstantynowicz14-0/+2202
Change-Id: Ie8fca17baa114fcdf5916e65311716a86e791709 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> (cherry picked from commit f4a8cf0ceadf483938ce10cce93942c0d7000a1e)
2020-07-01Report 2005: Add dataTibor Frank1-65/+193
+ 2001.0-4 vs 2001.0-2 for 3n-hsw Change-Id: Ice05011ea79681ede74825ed8ae6be849ea06b8f Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 87940fb88ea6a32037fc0ee084fc9e423daa79a1)
2020-06-30Report 2005: Add 3n-skx mrr env 4 dataTibor Frank1-21/+70
Change-Id: I44f05050c8e0c528c4980ac767232c497d058d9f Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 4cbb1b7c9aa616e377b73b9d22ed2b5ac1735b65)
2020-06-30Report 2005: Add 2n-clx and 3n-hsw mrr env 4 dataTibor Frank1-45/+144
Change-Id: I431215d96699381385199b61e9e5f37a581d91f4 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 3a97223e49e848614fcd3881ded46d147d36af82)
2020-06-29Report 2005: Replace data in thput graphs by env 4Tibor Frank1-46/+78
Change-Id: I6bd871d85c7ca2ed9748a96b0568f8f3dab82008 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit b478ee316158a56b7e9f1910edc84918bc7d9466)
2020-06-29Report 2005: Configure rls2005.27, add dataTibor Frank4-3/+17
Change-Id: I6a9911b500d40708e2570be9d83cdd860c677977 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 6349e9f96178bd0f6ef31cb2e5e8d1244c861724)
2020-06-26Report 2005: Fix comparison table hdr, add dataTibor Frank12-230/+268
Change-Id: I3ef6dfb1b3da4f91c77841536a840a439816e61f Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit c9f903e4f7894cb61cf3cc67fb37c7602c917567)
2020-06-26Report 2005: Add data, fix sorting in comp tablesTibor Frank2-8/+11
Change-Id: Ib0c42f5b9fbd9b9f9ebf0bff437ef9d145e6ddda Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit f278b55927de4aa59cf87ac1e752effd1c64035c)
2020-06-26Report 2005: Add dataTibor Frank1-16/+18
Change-Id: I7ffbe353739c3077bbfc03f25f4b6e03b2fdcccd Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 8ac495fdf576693d4c627a3211765facc688cfdc)
2020-06-25Reporet 2005: Add data, Fix comparison columnsTibor Frank1-100/+115
Change-Id: I83bd99c7afd63bd9ef0e432562c76cbe4ac8cb9d Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 94829f7603cc247d4e675c1a105ad27b073cb92a)
2020-06-25Report 2005: Add dataTibor Frank2-2/+25
Change-Id: I35803563351aa5419726a8a469f23557b49189f2 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit e2d6dfa204eb3abef8845e742719cee7d4865ff7)
2020-06-25Report 2005: Add 3n-skx comp tablesTibor Frank1-143/+143
Change-Id: Ic3237d165fdc9b7ca95498f724e0173f1cd29dad Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 72019941bfab96c7e687f5122f50e7c1f8cb2fca)
2020-06-25Report 2005: Add dataTibor Frank1-257/+145
Change-Id: I11c238327de71e75ca1ad099455f8daeb1ce996b Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 8bfc85eef3f6214200cf7eb8d426d96de923e985)
2020-06-25report: updated rls notes for vpp performance sectionMaciek Konstantynowicz1-103/+13
Change-Id: I114c7d64c24210df4273086757ef33735baffe94 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> (cherry picked from commit 0074e91ecc792db04f82f51dc760ddf29375dc13)
2020-06-25Report: Improve soak_tests/index.rstVratko Polak1-10/+5
- The -iterative- jobs should be used in future, but for 2005 the results still come from -verify- jobs. Change-Id: Ief6651a17543f27a3ccfaf2861aa6f511d80127e Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit a216afda94f4e23ecc50e03587e31b754d0f0116)
2020-06-25Report 2005: Add data, improve comp tables descTibor Frank1-133/+130
Change-Id: I7d3afd5c3f6322cb76668b7ecfa288e9b64c6cc3 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit e0f8fb48f1f569c78a92c075a66c256f1efb995b)
2020-06-24Report 2005: Add dataTibor Frank1-297/+289
Change-Id: Iffffa9dc7f87d0838cb674ffae01ca2407939dbe Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 3c1b802a13265c776bcf0712989558bd9ff0ee1a)
2020-06-24Report 2005: Update comp tables, add dataTibor Frank1-253/+349
Change-Id: Ifcbf9e1f382ea33d0601f0bf52ad08b5f5f123a4 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 3ac9ae837b482f0220fea4f44a4eb2e490e8fa9e)
2020-06-24Report 2005: Add env 2 data, update 3n-hsw comp tablesTibor Frank1-150/+84
Change-Id: Ibaab929900abec2321a36ed1251d936d4327c927 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 6d45a74ca33951a02b9a1bcc8b0e2cf2f9db8745)
2020-06-23Revert "Tweak TRex cores and RDMA pps limit"Vratko Polak1-6/+2
This reverts commit 925c5bfcffb2bc6b833a8e64b7f3a06bbca52197. It was affecting 2005 performance, confusing comparisons. The revert includes the RDMA limit. Change-Id: I9c31b061ee59bc5cb14d623ac98a65763ef75f1c Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit 6b81daa7407cd62a7916a1405a79a1f1f11555c1)
2020-06-22Report 2005: Add data, remove obsolete graphsTibor Frank5-1747/+5
Change-Id: Id8b4d2d52bc35527cce0067cffa9ffb865ddfcce Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 5b683bf3a43e8c5de1a48e2a842b952b4a9d7ae5)
2020-06-22Report: Add data, 2n-skx-nfv, configure 2005.26Tibor Frank8-3031/+3048
Change-Id: Ia00d19101e0521d89f23ee68be8e701b043a3a1e Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 1a0f5d37b11bafc784985875540f0e99abec88c0)
2020-06-20Report 2005: Add dataTibor Frank1-0/+6
Change-Id: I0a3bdefce6dae7cbd297f47c6aaf9f631f909eb9 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit ac38e4639b25835273f69a91d2779cae115bae30)
2020-06-19Report 2005: Add dataTibor Frank1-1/+17
Change-Id: Ie1d4677c91bfb3f9245dc553e3ca779f95c98ba1 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit b693006d4267dd19bb3ba3d873cdc8ce18d2fe92)
2020-06-19Report 2005: Add dataTibor Frank1-12/+40
Change-Id: If87e87170d4d1dfd533265fa5b1c6875a770146e Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 399d51b81b2144ad84edf6ea423cb04d69777eab)
2020-06-18Report 2005: Add dataTibor Frank2-7/+11
Change-Id: I6b36e1c2fc42e37aa3cb42b79844c3581e17e430 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 226b126e78fe7095b4dbee82dcb308c890a3155c)
2020-06-18Improve release notesVratko Polak1-12/+0
+ Remove commented-out alternative notes. Change-Id: Ib98348b00a2efa40f0b2e822681b1f5ba4e104fa Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit 4d6365deba4c28a8bc305169bb60c47f666c4a87)
2020-06-18PAL: Use the reconf term from methodologyVratko Polak2-7/+7
+ Instead of the term from test implementation. + The parser still looks for the old term. Change-Id: Ic07ac336085f2bb07f9d906e83b82cb84ebddb24 Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit ae654a8ade2a310effa49723ed577f05812a97ec)
2020-06-18Report 2005: Add dataTibor Frank1-21/+35
Change-Id: I2d3dd84aca4a1a41e652e4fd0d67fe6cee56bdac Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 75f8f739279790828ead808be3ecaa5c77b3073c)
2020-06-17Report 2005: Add data, remove plots without dataTibor Frank17-632/+662
Change-Id: Ia059695a18f3aa29a1bf7f16c2db17694c16b203 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 19b2d3d3cc01a0c0ceab1569bf8f9ca3c848b424)
2020-06-17Report 2005: Add dataTibor Frank1-4/+14
Change-Id: I14d04b6251a74ade89f43f4733b5f16caccdbd72 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 3efabd6b8d8730bd0fa1d8df9ad4850412f64469)
2020-06-16Report 2005: Fix graphs, tablesTibor Frank2-106/+48
Change-Id: Id0ae3a74b796b2495157e21d09467cddfad2d12a Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit a6464e9cefe273bd3caea8b672895e208aeb0fcb)