aboutsummaryrefslogtreecommitdiffstats
path: root/docs
AgeCommit message (Collapse)AuthorFilesLines
2020-07-13Report 2005: Add reconf testsTibor Frank2-2/+2
Change-Id: Ic9466d4c0e6fb757e7d7c01d1aa83a59c1389371 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit bc36a6a974e63722dbae42c552eb0d95ae7b95a9)
2020-07-13Report 2005: Fix titles in test envTibor Frank5-6/+6
Change-Id: I55e7a596d5fa23531e68d7ace9364411c3c372fc Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit d6aed8b19c60ff81cad100c9c3a6931ce1686f38)
2020-07-13Report 2005: Configure rls2005.39Tibor Frank1-1/+1
Change-Id: I7ea2e004b79d47420f6a1e0beb88731529b03706 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit f2606a6a0826cf95fd9fe0b0ff0eb43bffd8e8b7)
2020-07-13report: fixed misplaced environment versioning sectionMaciek Konstantynowicz2-42/+43
Change-Id: Id0da363b376e12dac583f95624ed6525b24290eb Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> (cherry picked from commit 30a988b35c6d66a11b5ec2f2c77c741dc942594e)
2020-07-10Docs: job-specs: dpdk and nfv-density test setsTibor Frank17-374/+487
+ synchronize iter dpdk test sets with coverage dpdk test sets + add iter nfv-density-mrr test sets Change-Id: I759025b6acf860aca9828f9fc1d82ab3a37ec98f Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit bc42880dfa7c5d4c9abe8e6957e44752db10918e)
2020-07-10report: added versioning sub-section to VPP Test Environment sectionMaciek Konstantynowicz1-0/+40
Change-Id: I59a93c0594ab5e5f0e267cacdf03d1f345e02b29 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> (cherry picked from commit 6c03d82f93fd0a4f0f7a7c750e18246260e11dd4)
2020-07-09Report 2005: Add data, review graphsTibor Frank27-349/+368
Change-Id: I2913ed579369a26a1226cfbe958432d1b3e11789 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 12c3608c3464add7664e3b8f41b07b9b8fd03f1c)
2020-07-08Report 2005: Add data, hide dnv, soak, reconf, nfvTibor Frank17-177/+169
Change-Id: Iff1b1db3e31d2e1f19f8309ba28f1f88e0538f6c Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit d0f1e8778dac3549a1f1e403541de9f3ee88ec8d)
2020-07-08PAL: Improve comparison tablesTibor Frank6-125/+125
- place RCAs to the columns with diffs CSIT-1737 Change-Id: I3ccf5ee510796684e3e09dbdc6264b05f391f633 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit ff8c8cf6083f64fd337115fec20501f7b247540e)
2020-07-07Report: 2005: Add data, configure rls2005.28Tibor Frank1-1/+1
Change-Id: I686102fd7d17ad287ae890f1170ef7c78ff74a0d Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 9439b30ba91e3532c66548c34bade4469fdfab37)
2020-07-02Trending and report alignmentTibor Frank29-4046/+17
- use test sets defined in report-iterative also for mrr tests and for mrr_daily and mlr_weekly Change-Id: I47fba2997cddaca934bdebd5fca6936e25332afc Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit ea77fd004ce6dfbfe48d861743a9d14f99a620a4)
2020-07-01docs: added mrr tests for vpp and dpdk to job_specs/report_iterativeMaciek Konstantynowicz14-0/+2202
Change-Id: Ie8fca17baa114fcdf5916e65311716a86e791709 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> (cherry picked from commit f4a8cf0ceadf483938ce10cce93942c0d7000a1e)
2020-06-29Report 2005: Configure rls2005.27, add dataTibor Frank1-1/+1
Change-Id: I6a9911b500d40708e2570be9d83cdd860c677977 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 6349e9f96178bd0f6ef31cb2e5e8d1244c861724)
2020-06-26Report 2005: Fix comparison table hdr, add dataTibor Frank11-26/+26
Change-Id: I3ef6dfb1b3da4f91c77841536a840a439816e61f Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit c9f903e4f7894cb61cf3cc67fb37c7602c917567)
2020-06-25report: updated rls notes for vpp performance sectionMaciek Konstantynowicz1-103/+13
Change-Id: I114c7d64c24210df4273086757ef33735baffe94 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> (cherry picked from commit 0074e91ecc792db04f82f51dc760ddf29375dc13)
2020-06-25Report: Improve soak_tests/index.rstVratko Polak1-10/+5
- The -iterative- jobs should be used in future, but for 2005 the results still come from -verify- jobs. Change-Id: Ief6651a17543f27a3ccfaf2861aa6f511d80127e Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit a216afda94f4e23ecc50e03587e31b754d0f0116)
2020-06-22Report 2005: Add data, remove obsolete graphsTibor Frank4-792/+0
Change-Id: Id8b4d2d52bc35527cce0067cffa9ffb865ddfcce Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 5b683bf3a43e8c5de1a48e2a842b952b4a9d7ae5)
2020-06-22Report: Add data, 2n-skx-nfv, configure 2005.26Tibor Frank5-1109/+1105
Change-Id: Ia00d19101e0521d89f23ee68be8e701b043a3a1e Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 1a0f5d37b11bafc784985875540f0e99abec88c0)
2020-06-18Improve release notesVratko Polak1-12/+0
+ Remove commented-out alternative notes. Change-Id: Ib98348b00a2efa40f0b2e822681b1f5ba4e104fa Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit 4d6365deba4c28a8bc305169bb60c47f666c4a87)
2020-06-17Report 2005: Add data, remove plots without dataTibor Frank16-625/+649
Change-Id: Ia059695a18f3aa29a1bf7f16c2db17694c16b203 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 19b2d3d3cc01a0c0ceab1569bf8f9ca3c848b424)
2020-06-16Report 2005: Fix graphs, tablesTibor Frank1-0/+2
Change-Id: Id0ae3a74b796b2495157e21d09467cddfad2d12a Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit a6464e9cefe273bd3caea8b672895e208aeb0fcb)
2020-06-16Report 2005: Add dataTibor Frank2-254/+250
Change-Id: I1ea07802294b498e61774038c3a2ae1bf6fffc7b Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 60b5545b670cbcb7813d0ca7d6748b83e48072c6)
2020-06-15Report 2005: Clean-up graphs and tablesTibor Frank46-1795/+1559
Change-Id: Ic0360a8a54e696aad5e7688d9f28808e868d1344 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 9b2acc9eea24958d7a84b0b6e77c658497579824)
2020-06-15Report 2005: Add data, hide dpdk 3n-tshTibor Frank4-17/+22
Change-Id: Id2c83dc218ad766008f65e2ad218eb01444cde07 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit a37d06fd84d6653990e39c135252ef1623d0ccfd)
2020-06-11docs: update 2n-skx job_specs for report_iterativeMaciek Konstantynowicz2-373/+328
Changes in vpp-2n-skx.md: - all nfv_density moved to separate file vpp-2n-skx-nfv-density.md - removed intel-x710: dot1q - removed drv_vfio_pci: vts, dot1q - Rebased on https://gerrit.fd.io/r/c/csit/+/27495 - *.md files moved to docs/job_specs/report_iterative/2n-skx/ and renamed Change-Id: Iff16f6673ea3d829c44fbd04d892abb845fa4c1e Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> (cherry picked from commit 6fa263815306b43ab1813360f0123e8a245b4b56)
2020-06-11docs: update 2n-clx job_specs for report_iterativeMaciek Konstantynowicz2-223/+146
Changes in vpp-2n-clx.md: - all nfv_density moved to separate file vpp-2n-clx-nfv-density.md - removed intel-x710: dot1q - removed drv_vfio_pci: vts, dot1q - Rebased on https://gerrit.fd.io/r/c/csit/+/27495 - *.md files moved to docs/job_specs/report_iterative/2n-clx/ and renamed Change-Id: I639abe794bde511d27cefa50db2860945dcc0050 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> (cherry picked from commit 1dbd6729f2a6ec77f0d9e867d2bf858d9b5db488)
2020-06-11docs: update 3n-skx job_specs for report_iterativeMaciek Konstantynowicz2-142/+67
Changes in vpp-3n-skx.md: - all nfv_density moved to separate file vpp-3n-skx-nfv-density.md - removed intel-x710: dot1q (except "./vm_vhost") - removed drv_vfio_pci: dot1q, ipsec aes128cbc - removed nat44, iacl, oacl - Rebased on https://gerrit.fd.io/r/c/csit/+/27495 - *.md files moved to docs/job_specs/report_iterative/3n-skx/ and renamed Change-Id: I952aeee65036919e35a2d98aaa5bb83743992966 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> (cherry picked from commit 6b5f02d7f004003e4d87d62f6add260ea126c0da)
2020-06-11Update selection of report-iterative test setsTibor Frank18-0/+200
- Create the same directory structure for report-iterative as it is for report-coverage. - Move files from report-iterative directory to created sub-directories. - Rename the moved files to keep the convention defined in report-coverage. - Update the corresponding functionality in resources/libraries/bash/function/common.sh The patches: - https://gerrit.fd.io/r/c/csit/+/27486 - https://gerrit.fd.io/r/c/csit/+/27484 - https://gerrit.fd.io/r/c/csit/+/27485 must be updated. Change-Id: I1aaf22690e3df5abf56893bb1d2d380debc54ddd Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 806a069bc5494d1c43dd9711e1512e518c823acd)
2020-06-10Report 2005: Add data, 2n-clx x533 cur vs prev tabTibor Frank1-0/+151
CSIT-1727 Change-Id: Iaf445a99aae3e7bef3004347c9d26102c5b6777b Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 972b5c9a4f25982865067dc08325c7ea16cfcd96)
2020-06-10docs: update 2n-dnv job_specs for report_coverageMaciek Konstantynowicz7-104/+14
Removed tests: 9000B 4c, 9000B 2c, 1518B 4c. Change-Id: Ica29eda359bfb72f536cbe0c731c1142e5f13125 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> (cherry picked from commit 61012e6fc1590376b327ebdc026be8278a277611)
2020-06-10docs: update 3n-hsw job_specs for report_coverageMaciek Konstantynowicz37-1177/+89
Removed for all tests: all packet sizes 4c, 9000B 2c. Corrected NIC names: s/intel-vic1227/cisco-vic1227/, s/intel-vic1385/cisco-vic1385/ Change-Id: I9a5af4f689cbb2576d6f8fd090d13d50ad0b2f04 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> (cherry picked from commit 3921adc2cfbbdbba28ed94a3dd19bb80a0d85702)
2020-06-10docs: update 3n-dnv job_specs for report_coverageMaciek Konstantynowicz10-136/+20
Removed tests: 9000B 4c, 9000B 2c, 1518B 4c. Change-Id: I2af4aedc12aeccf6c860b2faf84721d6414b4b55 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> (cherry picked from commit 366ac57ae0c775c4e60326ee51ce6659f841c0a9)
2020-06-10docs: update 2n-skx job_specs for report_coverageMaciek Konstantynowicz16-428/+32
Removed tests: 9000B 4c, 9000B 2c, 1518B 4c. Change-Id: Ia824679e5d1a724a4944676df89ebacc2889b602 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> (cherry picked from commit a33f758a6bca9c48940e7d69476cb78274395765)
2020-06-10docs: update 3n-skx job_specs for report_coverageMaciek Konstantynowicz38-1419/+71
Removed tests: - crypto: 1518B 4c, ipsec-policy 2c 4c, ipsec-int-aes128cbc 2c 4c - all non-crypto: 9000B 4c, 9000B 2c, 1518B 4c Change-Id: I50de07ca6e12c3aa86832c1bdc83db4be48fe347 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> (cherry picked from commit b4782ed542da67f619f1c043a8c6e23be81f715d)
2020-06-10Report 2005: vpp-device static contentJan Gelety2-3/+3
Change-Id: I2dad290d1374d0354999ea53a592b1c4db0d9884 Signed-off-by: Jan Gelety <jgelety@cisco.com> (cherry picked from commit 6ebf54b7c0471d2723066e051307bff5561f63d1)
2020-06-08Report 2005: Add data, configure 2005.24Tibor Frank1-1/+1
Change-Id: Iabd8dadda4ee7e0b9fc7044f4fc6addf8a106ab5 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit ba7130cebc9bc6ef66b9eb4f0e7d888462e10e48)
2020-06-02Report 2005: Add dataTibor Frank1-1/+0
Change-Id: I0a1fa4bdefef7a6335e0a99dba8945fa3e82f28f Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 6a0b39bd8e0dd1bed25e98632ee45f9a88e071d3)
2020-05-29Report: Add data and dpdk comparison tablesTibor Frank1-0/+92
+ data: + vpp-device + perf-sel-3n-hsw + dpdk-3n-hsw + dpdk-3n-skx + dpdk-2n-skx + dpdk-2n-clx + dpdk-2n-dnv + dpdk-3n-dnv + comparison tables current vs previous: + dpdk-2n-clx + dpdk-2n-dnv + dpdk-3n-dnv + dpdk-3n-tsh Ticket: CSIT-1723 Type: data Change-Id: I3a29e7eb8f3a4106d2819362db0078c3b2091275 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit f8103a10cf197c4b28a3d48abcf1bb6f16db5016)
2020-05-28Report: Fix links to html tablesTibor Frank9-92/+85
Type: Fix Change-Id: Ic4bc131ba7dac6c3f3e984a2fa224633a5cb6f86 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit d91be0977ab077324d95d5a50702d4cb244b686a)
2020-05-28PAL: Improvements in tables and formattingTibor Frank1-20/+22
+ legend + footnote + output to log + fix formatting in the methodology section Type: Improvements Change-Id: I605615a602b239265fc6768a65c8d33dd793d4c4 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 836cdd8930dd7383d5c59a4ae407864a1e03040f)
2020-05-27Report: configure report rls2005Tibor Frank4-216/+103
Ticket: CSIT-1722 Type: feature Change-Id: I76f7f323f000cbfc802c6206b6232665bb88448c Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 7248cf97d0f950cda2e1167478d44455e03ddc8d)
2020-05-27Report: Infra updatepmikus9-93/+217
Signed-off-by: pmikus <pmikus@cisco.com> Change-Id: Ie39585e88460d9a5e3764726d93dc065f5cbacfb (cherry picked from commit 9c459a2b303eb8d776ac040bc82830d850a67623)
2020-05-26FIX: add dpdk mrr_weekly and report_iterative job specsJan Gelety33-14/+464
- split job specs to directories Change-Id: I9a71621216ab0bdf85d147ce03f473e7cbb0b266 Signed-off-by: Jan Gelety <jgelety@cisco.com> (cherry picked from commit ae81c6c8ea54cd0ceee739fbce5d7e2445689ecb)
2020-05-26Add csit-vpp/dpdk-perf-report-coverage job and job specificationsJan Gelety143-0/+17482
- note: currently dpdk report-coverge test sets are equal to dpdk report-iterative test sets Change-Id: Ib9a718bfea4b24842742f49ee2eca022aa8a08e5 Signed-off-by: Jan Gelety <jgelety@cisco.com> (cherry picked from commit f7c08d2bd14872ad888df9b95b823ab1784aa737)
2020-05-13job-specs: new job test spec files including test count and durationsJan Gelety31-1199/+8087
Change-Id: I4ad87092bff1c072051ca1c7243d8dedb1c4576e Signed-off-by: Jan Gelety <jgelety@cisco.com> Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2020-05-13Report: Fix bad chars for LaTexTibor Frank1-6/+6
Change-Id: I776dbe0ef7761dbc647b22f709ea1debbeddd718 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-05-13Report: Add data, add pdf versionTibor Frank1-1/+1
Change-Id: I8c972aa7a1689494adc93d9c3c881e419913f47e Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-05-12Report CSIT-2001: updated rls notes for VPP.Maciek Konstantynowicz1-18/+54
Change-Id: I64853402cf6301a99ee97a463a5984516b52b0d3 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2020-05-11Report: Configure report 2001.20Tibor Frank1-1/+5
Change-Id: Ib0a3190dfd5b216aa9ff93d751fa48cd42cef88f Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-05-05Trending: CSIT-1301: Display stdev in hover infoTibor Frank3-33/+72
+ make possible to use dashboard for ndrpdr tests + fixes in ndrpdr weekly comparison Change-Id: I846dc207ea620fad78424a445b32095160d4431d Signed-off-by: Tibor Frank <tifrank@cisco.com>