aboutsummaryrefslogtreecommitdiffstats
path: root/docs/report
AgeCommit message (Collapse)AuthorFilesLines
2019-08-26Report: Select tests by name, specificationsTibor Frank182-13746/+5028
Change-Id: Ibcc5e67d49fba9c02b07af462a74d2a062412979 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-08-09Bump VPP stable version: socksvrVratko Polak2-2/+2
VPP changed the default socket path in: https://gerrit.fd.io/r/c/vpp/+/21100 Instead of "default", explicit value is used now. It coincides with VPP default one, and is stored in Constants.py (except documentation). The file name for robot side forwarded socket remains, as the path leading to is is different anyway. Change-Id: I0058d16794a3cd04411640c2c8d5fd4ee8cb997d Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-08-09DOC: rls1908 static contentPeter Mikus21-586/+1054
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Ia0778acc543a51fe85b8a75162f12905badaa382
2019-08-09Report: ConfigurationTibor Frank3-44/+4
Change-Id: I55dc7412e28cc2c5eb9c3f151e75a06be2d36f69 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-07-19PLRsearch methodology: Add more comments to graphsVratko Polak3-25/+151
Change-Id: I2d4743c6bb7dc91eca22b01298e4529f6b2e559d Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-07-17Use PapiSocketProvider for most PAPI callsVratko Polak2-0/+6
Ticket: CSIT-1541 Ticket: VPP-1722 Ticket: CSIT-1546 + Increase timeout to hide x520 slownes of show hardware detail. - Install sshpass and update ssh client in virl bootstrap. + Added TODOs to remove when CSIT-1546 is fixed. + Enable default socksvr on any startup conf. + Improve OptionString init and repr. - The non-socket executor still kept for stats. + Remove everything unrelated to stats from non-socket executor. - Remove some debug-loooking calls to avoid failures. TODO: Introduce proper parsing to the affected keywords. + Reduce logging from PAPI code to level INFO. - Needs https://gerrit.fd.io/r/20660 to fully work. + Change default values for LocalExecution.run() + Return code check enabled by default. Code is more readable when rc!=0 is allowed explicitly, and the test code will now detect unexpected failures. + Logging disabled by default. Output XML is large already. Important logging can be enabled explicitly. + Restore alphabetical order in common.sh functions. Change-Id: I05882cb6b620ad14638f7404b5ad38c7a5de9e6c Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-06-17Report 1904: Configure rls 1904.25Tibor Frank1-0/+5
Change-Id: I44bfc2247d4d2def131d89e1d97d8cad7522ccd1 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-06-10Report: Configure report 1904.24Tibor Frank1-0/+5
Change-Id: I4d6d913f0139fe0fab00668ec16081c04cc6bc0e Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-06-03Report: Configure Report 1904.23Tibor Frank1-0/+5
Change-Id: I0f19d4e3bdafbdf1a435436a2f25945c2b45e06e Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-05-24CSIT-1425 Upgrade TRex to v2.54Tibor Frank1-4/+3
Change-Id: I71010c18210e88828ded0bc679997d76f34886cb Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-05-24Report: Configure Report 1904.22Tibor Frank1-7/+12
Change-Id: Ic8d5a9a856658a2a2661cae8abd8d3b1127b4ff8 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-05-22Report: Update report historyTibor Frank1-0/+5
Change-Id: I790f5d658472d087cd33b6a08a55620e3e5906e3 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-05-17Report: Fix internal links to PLRsearch methodologyVratko Polak3-3/+3
Change-Id: I87b334e9c89b1469112dac4327faaf430c6f846a Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-05-16Improve soak graphs and contentVratko Polak2-5/+7
+ Fix duration, mention number of tests and runs. - Hover information still feels wrong. + Mention "critical rate" instead of "throughput" where possible. + Mention lower bounds are displayed. + Rename "plrsearch_algorithm" label to "PLRsearch". + Because the previous link did not work. Due to underscore? + Rename "SOAK" to "soak" or "Soak" (except when it is a tag). Change-Id: I9c079f8c2e93d96249d4b60893469c9257d4f3db Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-05-16CSIT-1488: Add data to the Report 1904Tibor Frank1-0/+3
Change-Id: I7484eeb872cd8fa736421a0ded2fcfffe733051e Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-05-16Report: Configure 1904.21Tibor Frank1-0/+3
Change-Id: Ib65580067d9c41137293036bbd786e31c2bdf503 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-05-15Report: Add pdf versionTibor Frank1-7/+9
Change-Id: Idc6936262a968e213f2fafa52adacfee65ad345c Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-05-15PLRsearch methodology: Add graphs with descriptions.Vratko Polak5-6976/+22451
Change-Id: I1acb74c6edb966dcdbbdaf88c05bfde1192bf74b Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-05-15Report: update known perf issuesJan Gelety1-0/+6
Change-Id: I83863b6a32a1f4d079e126458ba50a358e8de447 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-05-14CSIT-1504: Soak tests - graphTibor Frank3-8/+28
Change-Id: I8416e28a27c16da76c0ebb94f847539f662229fa Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-05-13CSIT-1500: Add comparison table for SOAK vs NDRPDRTibor Frank2-1/+19
Change-Id: I890b28b7a8c1f60cce4c985ccd94fcdfd3c47d7d Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-05-13Report: Add SOAK TestsTibor Frank3-3/+5
Change-Id: I22eec7cf8ff25958218d4b8ac6bab5a34b2f206c Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-05-13CSIT-1488: Add data to the Report 1904Tibor Frank1-1/+5
Change-Id: I6e35ba3a89e02fa1e34e5ef637598cb6e22baaaa Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-05-13Report: Configuration for 1904.20Tibor Frank1-0/+3
Change-Id: I4bbf1ed196947cc290de943b1e39721021d9d7d4 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-05-10Update perf release notes 1904Peter Mikus1-4/+7
Change-Id: Ia74d6270ef0b654efb77a369f240e7a9c53156c5 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-05-10Report: Hide DMMTibor Frank4-25/+25
Change-Id: Ib1381365b01cecb701a956a22131d2b4fe1a3b60 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-05-10report: added missing sub-section header in methodology throughputMaciek Konstantynowicz1-0/+3
Change-Id: Iadeaca5d39be051ef334f98e50a6a17210c503bf Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2019-05-10Update PLRsearch methodology to latest codeVratko Polak1-286/+105
Deleted much of terms and generalized descriptions, added more details on the current implementation. - Still with old graphs Change-Id: I9ba6b40d1d9d36d4f10382f60c756f5bc4708e4d Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-05-10report: edits of methodology mlrsearch sectionMaciek Konstantynowicz2-265/+29
Change-Id: I80b4f8223d2991e258ab422c447bdc09d92c9e9c Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2019-05-10Report: VPP_func update 2Jan Gelety1-2/+1
Change-Id: I840f61211bd01e26862ae7af40522a82ce8cfb25 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-05-10Update release notes 1904Peter Mikus1-5/+8
Change-Id: Ib31d809b2c1741374fe3bd03e21adea6336bc7f5 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-05-10report: further edits of methodology throughput sectionsMaciek Konstantynowicz8-142/+200
Change-Id: I571d1a47743eb31ee10caf3f3336ac7437daf878 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2019-05-10Release notes: 1904Peter Mikus2-30/+18
Change-Id: I3b075b210f3e3c126d049799aea15f6b75235677 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-05-10Report: VPP_func updateJan Gelety1-239/+81
Change-Id: I7d551e4d62b1678347c8c5c08a42201567a497cf Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-05-09Report: hide soak testsTibor Frank2-2/+2
Change-Id: I0c738764aaf16b5858d70d7a9fda6752b912cc01 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-05-09Report: nfv density graphs - update static contentTibor Frank3-9/+17
Change-Id: Ia271330e86fdba1332bb12890458a953c4e0832c Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-05-09Report: Remove DenvertonTibor Frank13-33/+57
Change-Id: I1c1fa3b466feb24b647255f2b0f70c2cff4cbf0d Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-05-09Report: Remove LigatoTibor Frank8-18/+17
Change-Id: Ia530ef2fb21968852a5366a1bf1c4d0521002c5b Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-05-08report: edits to methodology_kvm_vms_vhost_userMaciek Konstantynowicz1-46/+57
Change-Id: Iaa2cd0bbe6171ac800489b897ddae079332b48ee Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2019-05-08report: edits of methodology throughput sectionsMaciek Konstantynowicz5-31/+84
Change-Id: I9ed1c2d67bc53f98d36ad17afb9153de5e944b7f Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2019-05-07Report: Fix NFV GraphsTibor Frank1-1/+2
Change-Id: If11ed726cb75134c24cde3a752d2e72188bbe3a2 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-05-06CSIT-1492: Add new NF density tests to reportTibor Frank3-30/+426
Change-Id: Ifdfac80f7fd25124cb08a467329d6c8c525ffc06 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-05-06Report: Configure the versionTibor Frank1-1/+1
Change-Id: I29240b2286f48cc8027d97c9c1895c51b2a11ca5 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-05-03report 1904: updated methodology (nfv density, startup.conf) and vpp perf ↵Maciek Konstantynowicz3-35/+36
rls notes Change-Id: If6d24511d5d29dcc25c21437364e0da15af3cca1 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2019-05-03Update KVM methodologyPeter Mikus1-14/+64
Change-Id: I8be9b9295b691a1ec4b810e3a1255ad1bc6947ab Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-04-30Update report static contentPeter Mikus4-45/+38
Change-Id: I8aef71fb2cc09d2c7862884f7ca68c9786ad5165 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-04-29Report: Configure the versionTibor Frank1-1/+1
Change-Id: I064b16e0a2b7f96e4590622be340ab657d785f16 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-04-25CSIT-1489: Change graphs to display results by suite generatorTibor Frank29-273/+1195
Change-Id: I00fdc7ce87be5cecf5883ed2c991a8e67efd2e2a Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-04-23CSIT-1488: Add data to the Report 1904Tibor Frank1-1/+1
Change-Id: I2ba9eeedf5668b5a99acbe0d26add2aa0a836a9f Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-04-18Report: Static contentTibor Frank2-4/+4
Change-Id: If8e2593dcaff368b2c7e191f70bab15e8974bb38 Signed-off-by: Tibor Frank <tifrank@cisco.com>