aboutsummaryrefslogtreecommitdiffstats
path: root/docs
AgeCommit message (Collapse)AuthorFilesLines
2019-09-13Report: Add dataTibor Frank4-0/+26
Change-Id: I589a236919af913bb37d2db3b4079b16f1e64242 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 17220bfce36c723a3ca6fdd1ef757709ab50f4eb)
2019-09-12PAL: Add NFV reconf testsTibor Frank2-0/+133
Change-Id: I6fe36f05423c3c43081872153adf0f1a899381b6 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 5979e1020d4e41e08f1fe4e6d195a0a5bc020bb1)
2019-09-12Report: Configure 1908.38Tibor Frank1-0/+3
Change-Id: I0239e6c567c50c211ddabffa4b1bf22cdcec6462 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit e248c3fd06b4126b780eca85c5aae282cf872524)
2019-09-10PAL: Add replacing of data in tablesTibor Frank15-78/+999
+ vhost data Change-Id: I86fc97ba5c3b0feffec2dfb0ac11c5d3c9d53a81 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 4dc7d6cc7b695c21ef1e37fa6b754958fc50e484)
2019-09-09Report: Report historyTibor Frank1-7/+4
Change-Id: Ib74a10ccd589111dd3c830adec9293ff2c698772 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit fa6124e5a9ce40348a4113b7da009e99d231d437)
2019-09-09Report: Add dnv mrr dataTibor Frank6-0/+52
Change-Id: I3dcc813dce7b8938be6b2caaaf1e64ce9abb7fe9 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 80fd7db87eb177b2369cd01716662c63a642a513)
2019-09-09Report: Fix tsh and dnv plotsTibor Frank2-1/+3
Change-Id: I1d40849bc15f4433117af91f71e951a61924d732 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 620774fdc9a0fa2703fcaa8e18915d65cb2b1ed3)
2019-09-09Report: Add soak testsTibor Frank3-6/+3
Change-Id: I2161c8d8e54cfa35cd3febdda1cb47d6cec424a0 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit ba14f2b0ac026e537c79a61e800176b3404bde4d)
2019-09-06Report: Fix2 - Add 3n-dnv plots and tablesTibor Frank3-0/+3
Change-Id: Ia182e6e52a37f9b3248eab60ffe4dd4746ed7fa6 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 81907979cdf2ca6ca991410e8151170deb380bc1)
2019-09-06docs: add select list of tests for report - tsh and dnvJan Gelety3-0/+191
Change-Id: I63a69d998c80029422bae9f90e186eb2286196d1 Signed-off-by: Jan Gelety <jgelety@cisco.com> (cherry picked from commit a3da59a916817208f69cb718d00a5017d0e5c0e2)
2019-09-06Report: Fix - Add 3n-dnv plots and tablesTibor Frank4-3/+36
Change-Id: I5f09f1f20e532e71d6abde02111a90f5868035f3 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 1c77031813057a50781784fc8e34019805d222b8)
2019-09-06Report: Add 3n-dnv plots and tablesTibor Frank24-0/+1382
Change-Id: I6b65231f928b6168e0696f35fc253ce513163e50 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 1082d79a51e3caf60586e6176ee89ac3aadf04fc)
2019-09-05Report: Add 2n-dnv plots and tablesTibor Frank60-84/+826
Change-Id: Ibbd1775bec26817a4c193bc67ba03b29b8ddfff7 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 99219815466588419bd6705ff2ad8a9d9fc90dff)
2019-09-05Report: Fix fonts in release notes tableTibor Frank1-2/+2
Change-Id: I4a3486c313c4aa4754c455389b8ebb363ead469a Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 1a330e122eba0526960a581b32c0d7031c72f394)
2019-09-05Report: Configure Report 1908.37Tibor Frank1-0/+12
Change-Id: I1d883dbb299ecef151c7d7a9c5612ae0330e3538 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit d7813d33fef48421377c7eb6f24cd3998d8b0594)
2019-09-04docs: report vpp performance rls notes update.Maciek Konstantynowicz1-24/+68
Change-Id: Ie4a7a80cad9ff92b9f30953096cca8a029edc687 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> (cherry picked from commit 1abf61ca0224226e3f39ac491b2b84e49ac6092f)
2019-09-04Report methodology: PLRsearch update with graphsVratko Polak3-20198/+9391
Change-Id: Ib73a64c93bdba3945b8237783a24134b47d4eb99 Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit 55a8e9aa3a8583b46192ffdad9ef7265fa63d537)
2019-09-04docs: report packet_throughput_graphs text formatting fixes.Maciek Konstantynowicz1-11/+32
Change-Id: Ibea6e70e2fcf9cfeb7627ee1cbcfa6e177c0b2c6 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> (cherry picked from commit 32605fc1b4ff207776b6ff3f6a1975f77d8e4629)
2019-09-04Doc: Report release notes (perf)Peter Mikus1-0/+5
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I8c1667efec67febd375818bc1dfe1d9bebc70708 (cherry picked from commit b8ae239848d484cd0660fe406ae2c4a34c0551e0)
2019-09-04docs: added methodology terminology section to report.Maciek Konstantynowicz2-0/+79
Change-Id: Id787d12b577165a1081dba84b610c32df57a7c44 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> (cherry picked from commit 622726926fc12522e439455ade436f6dfcc0da06)
2019-09-04docs: report updates in physical_testbeds section.Maciek Konstantynowicz1-86/+163
Change-Id: Id31e6ed294dc80619a108296be580925509bb7d7 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> (cherry picked from commit a10342c5b6d989f64bd1fe49f0edd0c7585e54ea)
2019-09-04docs: updated report intro in packet_throughput_graphsMaciek Konstantynowicz1-5/+68
Change-Id: I3bf70cc7e48ef2134841bc4bf9300cda6a118cb3 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> (cherry picked from commit 6898a7671b00c5e5c48c58fdfaeb47bb7148d4bb)
2019-09-04Report: ixgbe for tshTibor Frank34-493/+521
Change-Id: I707a654b8853926f4cb1b78f3c65b55925e95ac1 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit d53a4da7e088fa8330e851cee3c6309ef13c8360)
2019-09-02Report: Add dataTibor Frank3-279/+276
Change-Id: If799a7a1d1b8f6ea59ebfba3dd4724b09e7680f2 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 6d981f513fba8cbec434f5c10f83081034372f20)
2019-09-02Report: functional tests static contentJan Gelety2-97/+70
Change-Id: I17238ff6d1760f6a956459e072ba0303abef3199 Signed-off-by: Jan Gelety <jgelety@cisco.com> (cherry picked from commit 97881b4e0142f98bbb8e1d54828bbc3c1b34d4ac)
2019-09-02Report: Add 3n-tshTibor Frank67-62/+3400
Change-Id: I6027b635191c7e64397915df8944699bb320daf3 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit a7886e481f492d996643fad5ab48944f1cd4f725)
2019-08-28docs: created full list of tests for report detailed results.Maciek Konstantynowicz3-0/+673
Change-Id: I82d298399b5899736c8e5ebb7204dbbddace79f4 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> (cherry picked from commit 97ff6490bbd4656e15422576556aeba8aa799345)
2019-08-28docs: created select list of tests for report and trending.Maciek Konstantynowicz3-0/+335
Change-Id: I2ad255c35490e52d9a55e24e64539549e6bdd36b Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> (cherry picked from commit 218572c4932c47f08cb0b64b5e493ac939ce73ae)
2019-08-28DOC: 1908rls release notes for VPP Hoststack TCP performance tests.Dave Wallace1-0/+4
Change-Id: I56d0519b5cbdfb8a60aab85a9a4d721fdfe022ce Signed-off-by: Dave Wallace <dwallacelf@gmail.com> (cherry picked from commit f4952736d2f356cd3423c55891e133536ddc9552)
2019-08-27docs: added csit tests job specs.Maciek Konstantynowicz1-0/+141
Change-Id: I271b1c700f72204dcf03bee6f2cd30b25ca5663e Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> (cherry picked from commit a0465dc55b2f7edfa86e7803704bdb1415fd2b8e)
2019-08-26Report: Comp TablesTibor Frank1-30/+30
Change-Id: I2cedef4dc274dc45ebc82911d53f3d5d14ffa381 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 7186f868f6fd24f8727e088301c4411c2a8e8a8c)
2019-08-26Report: NFVTibor Frank6-189/+185
Change-Id: Idf369766cb9acf82475b1d86860d72077b88dc35 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 320f82cc987dbc6d9c4ab1632de1005ac4c0077f)
2019-08-26Report: Modify comparison tables, add dataTibor Frank8-322/+291
Change-Id: I6d5e7cc0618a5b1889ab54c020fd98c661d20989 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit db49a120f90f59f5277a5c812544ea0ad1592eb8)
2019-08-26Report: Select tests by name, specificationsTibor Frank182-13746/+5028
Change-Id: Ibcc5e67d49fba9c02b07af462a74d2a062412979 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 33cfe1217cb2d6bc9655b01f200b0ec8d5ccb466)
2019-08-23Introduce reconfig suites, for dot1q+ip4+vxlanVratko Polak1-14/+32
Ticket: CSIT-1551 + Config copied from other suites. + Layer keywords prepared for additional chains. + Renamed "create" argument to "vlan_per_chain". + TrafficGenerator result extraction improvements. + Also unified TG type and subtype checking. + Throughput estimated as PDR for zero PLR. + Actual Qemu start is skipped. + Parse xstats instead of stats in trex stop scipt. - Because stats are unconditionally cleared on each script connect. + Remember start values to get better ReceiveMeasurementResult at stop. + Expose loss count and time as appropriate test message. + Autogen support. + Multiple chain amounts and core densities. - Only 1 additional chain. + Proper TAGs. Documented. + Clarified min framesize tags are for TG-DUT. + Added a TODO concerning overhead values. + Added 118B tag. + Robot performance keywords improvements. + Added missing return value documentation. + Frame size as required test variable, not an explicit argument. + MLRsearch keyword to store result (not into test message). - TODO: De-duplicate: main keyword to measure, minor to set test message. - But implementation uses the fact default arguments are different. + Keywords for starting and stopping background traffic. - No checks whether start-stop pair is complete. + Multiple minor indentation and logging improvements. - Missing / TODOs: - Support also vlan_per_chain=True? - Support dot1q without vxlan? - Support also deletion? - How to package config steps so -reconf can be generated from -ndrpdr? Change-Id: If0270697f9ffa837c34ef802917220a53f156703 Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit ff820e3d53434889aacde2373314c3be8d00f765)
2019-08-09DOC: rls1908 static contentPeter Mikus23-1204/+1054
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Ia0778acc543a51fe85b8a75162f12905badaa382 (cherry picked from commit ce1c52b1fd27d3e2b6c4909219fa98418565ba61)
2019-08-09Report: ConfigurationTibor Frank3-44/+4
Change-Id: I55dc7412e28cc2c5eb9c3f151e75a06be2d36f69 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit d6c832b02ac7d3073dd8651b089a72ec8240b183)
2019-08-09Trending: TSH ipsec testsTibor Frank2-8/+63
Change-Id: Ib9f867e2b55a61019b487c96b0a05e9fa175dd0f Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-08-08Trending: Add dnv mrr testsTibor Frank16-1/+407
Change-Id: If0c0d6b346e64caf7af4432917a91468a1f0554a Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-08-083n-tsh trending docs fixesjuraj.linkes7-237/+3
Change-Id: Icf4babf8f7924be864520a0ecf8f7e718de51c32 Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>
2019-08-07Update trending vpp refjuraj.linkes118-354/+354
Nexus to Packagecloud Xenial to Bionic Change-Id: Id702076b9a5c37e84719bae66bcd87c9ab5ed2b7 Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>
2019-08-02Add 3n-tsh mrr data to trending docsjuraj.linkes27-0/+698
Change-Id: I82f074c0f7261bd1019ade1e01781278b063c0cd Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>
2019-08-01Trending: Fix static content in dashboardTibor Frank1-6/+6
Change-Id: Idffb3ec30d402326e5962209872afb613df68970 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-07-25docs: fixed TOC and list indexes in testbed specificationMaciek Konstantynowicz1-63/+63
Change-Id: I262b4a2b8c0afae4fd49e4edee8f12b2dbc0ed60 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2019-07-25docs: updated testbed specification with clx buildMaciek Konstantynowicz1-142/+408
Change-Id: Idaea4ac8ba04bea591ade511f55a5e421d04b8f5 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2019-07-19PLRsearch methodology: Add more comments to graphsVratko Polak3-25/+151
Change-Id: I2d4743c6bb7dc91eca22b01298e4529f6b2e559d Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-07-17Use PapiSocketProvider for most PAPI callsVratko Polak2-0/+6
Ticket: CSIT-1541 Ticket: VPP-1722 Ticket: CSIT-1546 + Increase timeout to hide x520 slownes of show hardware detail. - Install sshpass and update ssh client in virl bootstrap. + Added TODOs to remove when CSIT-1546 is fixed. + Enable default socksvr on any startup conf. + Improve OptionString init and repr. - The non-socket executor still kept for stats. + Remove everything unrelated to stats from non-socket executor. - Remove some debug-loooking calls to avoid failures. TODO: Introduce proper parsing to the affected keywords. + Reduce logging from PAPI code to level INFO. - Needs https://gerrit.fd.io/r/20660 to fully work. + Change default values for LocalExecution.run() + Return code check enabled by default. Code is more readable when rc!=0 is allowed explicitly, and the test code will now detect unexpected failures. + Logging disabled by default. Output XML is large already. Important logging can be enabled explicitly. + Restore alphabetical order in common.sh functions. Change-Id: I05882cb6b620ad14638f7404b5ad38c7a5de9e6c Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-07-10Bash functions style cleanupVratko Polak1-15/+21
+ Update rst documentation for bash style + Command substitution: + Clarify when to use backticks. + Recommend avoiding nested command substitution. + Do not recommend putting command substitution results into quotes. + Function definition content: + Move "set -exuo pipefail" after comment only blocks. + Other set flags allowed for functions with good reasons. + Apply the new recommendations. - Blank lines unified in code but no written recommendation in rst. + Add missing references to functions called, variables read or set. + Add TODOs to where lists would be long. + Minor improvements to function descriptions. + Make "if" expressions more python-like. + Add missing "|| die" (or "|| true") where spotted. + Downgrade DEFAULT_NIC to a local variable. + Add TODO to list reasons for blacklisted tags. Change-Id: I05dce030a8c2cb1b3a242d8b977e8fe150d8ee20 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-07-08Next IETF draft version for PLRsearchVratko Polak1-186/+145
+ Finished the rewrite left in progress last time. + Described current logic (load selection) changed since last time. + Fixed fitting function formulas, normalization was wrong. + Other minor improvements. Change-Id: I3d762db98b6f8789207bc58db1f171faa6e753bd Signed-off-by: Vratko Polak <vrpolak@cisco.com> Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2019-07-08Update of draft-vpolak-mkonstan-bmwg-mlrsearch-01->02.Maciek Konstantynowicz2-362/+488
Change-Id: Iba2d5369298f8615aacb1ff0f73b4832d359b433 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>