aboutsummaryrefslogtreecommitdiffstats
path: root/docs
AgeCommit message (Collapse)AuthorFilesLines
2019-09-02Report: Add dataTibor Frank3-279/+276
Change-Id: If799a7a1d1b8f6ea59ebfba3dd4724b09e7680f2 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 6d981f513fba8cbec434f5c10f83081034372f20)
2019-09-02Report: functional tests static contentJan Gelety2-97/+70
Change-Id: I17238ff6d1760f6a956459e072ba0303abef3199 Signed-off-by: Jan Gelety <jgelety@cisco.com> (cherry picked from commit 97881b4e0142f98bbb8e1d54828bbc3c1b34d4ac)
2019-09-02Report: Add 3n-tshTibor Frank67-62/+3400
Change-Id: I6027b635191c7e64397915df8944699bb320daf3 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit a7886e481f492d996643fad5ab48944f1cd4f725)
2019-08-28docs: created full list of tests for report detailed results.Maciek Konstantynowicz3-0/+673
Change-Id: I82d298399b5899736c8e5ebb7204dbbddace79f4 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> (cherry picked from commit 97ff6490bbd4656e15422576556aeba8aa799345)
2019-08-28docs: created select list of tests for report and trending.Maciek Konstantynowicz3-0/+335
Change-Id: I2ad255c35490e52d9a55e24e64539549e6bdd36b Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> (cherry picked from commit 218572c4932c47f08cb0b64b5e493ac939ce73ae)
2019-08-28DOC: 1908rls release notes for VPP Hoststack TCP performance tests.Dave Wallace1-0/+4
Change-Id: I56d0519b5cbdfb8a60aab85a9a4d721fdfe022ce Signed-off-by: Dave Wallace <dwallacelf@gmail.com> (cherry picked from commit f4952736d2f356cd3423c55891e133536ddc9552)
2019-08-27docs: added csit tests job specs.Maciek Konstantynowicz1-0/+141
Change-Id: I271b1c700f72204dcf03bee6f2cd30b25ca5663e Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> (cherry picked from commit a0465dc55b2f7edfa86e7803704bdb1415fd2b8e)
2019-08-26Report: Comp TablesTibor Frank1-30/+30
Change-Id: I2cedef4dc274dc45ebc82911d53f3d5d14ffa381 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 7186f868f6fd24f8727e088301c4411c2a8e8a8c)
2019-08-26Report: NFVTibor Frank6-189/+185
Change-Id: Idf369766cb9acf82475b1d86860d72077b88dc35 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 320f82cc987dbc6d9c4ab1632de1005ac4c0077f)
2019-08-26Report: Modify comparison tables, add dataTibor Frank8-322/+291
Change-Id: I6d5e7cc0618a5b1889ab54c020fd98c661d20989 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit db49a120f90f59f5277a5c812544ea0ad1592eb8)
2019-08-26Report: Select tests by name, specificationsTibor Frank182-13746/+5028
Change-Id: Ibcc5e67d49fba9c02b07af462a74d2a062412979 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 33cfe1217cb2d6bc9655b01f200b0ec8d5ccb466)
2019-08-23Introduce reconfig suites, for dot1q+ip4+vxlanVratko Polak1-14/+32
Ticket: CSIT-1551 + Config copied from other suites. + Layer keywords prepared for additional chains. + Renamed "create" argument to "vlan_per_chain". + TrafficGenerator result extraction improvements. + Also unified TG type and subtype checking. + Throughput estimated as PDR for zero PLR. + Actual Qemu start is skipped. + Parse xstats instead of stats in trex stop scipt. - Because stats are unconditionally cleared on each script connect. + Remember start values to get better ReceiveMeasurementResult at stop. + Expose loss count and time as appropriate test message. + Autogen support. + Multiple chain amounts and core densities. - Only 1 additional chain. + Proper TAGs. Documented. + Clarified min framesize tags are for TG-DUT. + Added a TODO concerning overhead values. + Added 118B tag. + Robot performance keywords improvements. + Added missing return value documentation. + Frame size as required test variable, not an explicit argument. + MLRsearch keyword to store result (not into test message). - TODO: De-duplicate: main keyword to measure, minor to set test message. - But implementation uses the fact default arguments are different. + Keywords for starting and stopping background traffic. - No checks whether start-stop pair is complete. + Multiple minor indentation and logging improvements. - Missing / TODOs: - Support also vlan_per_chain=True? - Support dot1q without vxlan? - Support also deletion? - How to package config steps so -reconf can be generated from -ndrpdr? Change-Id: If0270697f9ffa837c34ef802917220a53f156703 Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit ff820e3d53434889aacde2373314c3be8d00f765)
2019-08-09DOC: rls1908 static contentPeter Mikus23-1204/+1054
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Ia0778acc543a51fe85b8a75162f12905badaa382 (cherry picked from commit ce1c52b1fd27d3e2b6c4909219fa98418565ba61)
2019-08-09Report: ConfigurationTibor Frank3-44/+4
Change-Id: I55dc7412e28cc2c5eb9c3f151e75a06be2d36f69 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit d6c832b02ac7d3073dd8651b089a72ec8240b183)
2019-08-09Trending: TSH ipsec testsTibor Frank2-8/+63
Change-Id: Ib9f867e2b55a61019b487c96b0a05e9fa175dd0f Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-08-08Trending: Add dnv mrr testsTibor Frank16-1/+407
Change-Id: If0c0d6b346e64caf7af4432917a91468a1f0554a Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-08-083n-tsh trending docs fixesjuraj.linkes7-237/+3
Change-Id: Icf4babf8f7924be864520a0ecf8f7e718de51c32 Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>
2019-08-07Update trending vpp refjuraj.linkes118-354/+354
Nexus to Packagecloud Xenial to Bionic Change-Id: Id702076b9a5c37e84719bae66bcd87c9ab5ed2b7 Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>
2019-08-02Add 3n-tsh mrr data to trending docsjuraj.linkes27-0/+698
Change-Id: I82f074c0f7261bd1019ade1e01781278b063c0cd Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>
2019-08-01Trending: Fix static content in dashboardTibor Frank1-6/+6
Change-Id: Idffb3ec30d402326e5962209872afb613df68970 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-07-25docs: fixed TOC and list indexes in testbed specificationMaciek Konstantynowicz1-63/+63
Change-Id: I262b4a2b8c0afae4fd49e4edee8f12b2dbc0ed60 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2019-07-25docs: updated testbed specification with clx buildMaciek Konstantynowicz1-142/+408
Change-Id: Idaea4ac8ba04bea591ade511f55a5e421d04b8f5 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2019-07-19PLRsearch methodology: Add more comments to graphsVratko Polak3-25/+151
Change-Id: I2d4743c6bb7dc91eca22b01298e4529f6b2e559d Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-07-17Use PapiSocketProvider for most PAPI callsVratko Polak2-0/+6
Ticket: CSIT-1541 Ticket: VPP-1722 Ticket: CSIT-1546 + Increase timeout to hide x520 slownes of show hardware detail. - Install sshpass and update ssh client in virl bootstrap. + Added TODOs to remove when CSIT-1546 is fixed. + Enable default socksvr on any startup conf. + Improve OptionString init and repr. - The non-socket executor still kept for stats. + Remove everything unrelated to stats from non-socket executor. - Remove some debug-loooking calls to avoid failures. TODO: Introduce proper parsing to the affected keywords. + Reduce logging from PAPI code to level INFO. - Needs https://gerrit.fd.io/r/20660 to fully work. + Change default values for LocalExecution.run() + Return code check enabled by default. Code is more readable when rc!=0 is allowed explicitly, and the test code will now detect unexpected failures. + Logging disabled by default. Output XML is large already. Important logging can be enabled explicitly. + Restore alphabetical order in common.sh functions. Change-Id: I05882cb6b620ad14638f7404b5ad38c7a5de9e6c Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-07-10Bash functions style cleanupVratko Polak1-15/+21
+ Update rst documentation for bash style + Command substitution: + Clarify when to use backticks. + Recommend avoiding nested command substitution. + Do not recommend putting command substitution results into quotes. + Function definition content: + Move "set -exuo pipefail" after comment only blocks. + Other set flags allowed for functions with good reasons. + Apply the new recommendations. - Blank lines unified in code but no written recommendation in rst. + Add missing references to functions called, variables read or set. + Add TODOs to where lists would be long. + Minor improvements to function descriptions. + Make "if" expressions more python-like. + Add missing "|| die" (or "|| true") where spotted. + Downgrade DEFAULT_NIC to a local variable. + Add TODO to list reasons for blacklisted tags. Change-Id: I05dce030a8c2cb1b3a242d8b977e8fe150d8ee20 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-07-08Next IETF draft version for PLRsearchVratko Polak1-186/+145
+ Finished the rewrite left in progress last time. + Described current logic (load selection) changed since last time. + Fixed fitting function formulas, normalization was wrong. + Other minor improvements. Change-Id: I3d762db98b6f8789207bc58db1f171faa6e753bd Signed-off-by: Vratko Polak <vrpolak@cisco.com> Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2019-07-08Update of draft-vpolak-mkonstan-bmwg-mlrsearch-01->02.Maciek Konstantynowicz2-362/+488
Change-Id: Iba2d5369298f8615aacb1ff0f73b4832d359b433 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2019-07-08Update draft-mkonstan-nf-service-density-00->01Maciek Konstantynowicz1-65/+174
Change-Id: Ic63aa09bfff98d358b770e378c5571f1114839b8 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2019-07-04Update draft-vpolak-bmwg-plrsearch-01->02Maciek Konstantynowicz2-229/+1
Change-Id: Ida23a50c9148570a6510f93a2bb731ea8b0b2b94 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2019-06-19Add 2-node and 3-node denverton to specificationsYulong Pei1-7/+82
Change-Id: I79fc4a4d28e1ec1aaa6590c6df340fa7d33c8654 Signed-off-by: Yulong Pei <yulong.pei@intel.com>
2019-06-19Add scale ipsec tunnel testsPeter Mikus1-2/+2
- 5K - 10K Change-Id: Iaa2c77d07c3686e09fe327c663d7d7fc42024034 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-06-17Report 1904: Configure rls 1904.25Tibor Frank1-0/+5
Change-Id: I44bfc2247d4d2def131d89e1d97d8cad7522ccd1 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-06-10Report: Configure report 1904.24Tibor Frank1-0/+5
Change-Id: I4d6d913f0139fe0fab00668ec16081c04cc6bc0e Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-06-03Report: Configure Report 1904.23Tibor Frank1-0/+5
Change-Id: I0f19d4e3bdafbdf1a435436a2f25945c2b45e06e Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-05-24CSIT-1425 Upgrade TRex to v2.54Tibor Frank1-4/+3
Change-Id: I71010c18210e88828ded0bc679997d76f34886cb Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-05-24Report: Configure Report 1904.22Tibor Frank1-7/+12
Change-Id: Ic8d5a9a856658a2a2661cae8abd8d3b1127b4ff8 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-05-23CSIT-1506: Rework IPsec base testcasesPeter Mikus1-4/+24
- Add: aes-128-gcm aes-128-gcm aes-256-gcm aes-256-gcm aes-128-cbc hmac-sha-256 aes-256-cbc hmac-sha-512 - Remove: hmac-sha1 - Scale will follow in next patch Change-Id: I789f71cf66cf61b8dbb3c6dbe9b6fdc79866ac33 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-05-22Report: Update report historyTibor Frank1-0/+5
Change-Id: I790f5d658472d087cd33b6a08a55620e3e5906e3 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-05-17Report: Fix internal links to PLRsearch methodologyVratko Polak3-3/+3
Change-Id: I87b334e9c89b1469112dac4327faaf430c6f846a Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-05-16Improve soak graphs and contentVratko Polak2-5/+7
+ Fix duration, mention number of tests and runs. - Hover information still feels wrong. + Mention "critical rate" instead of "throughput" where possible. + Mention lower bounds are displayed. + Rename "plrsearch_algorithm" label to "PLRsearch". + Because the previous link did not work. Due to underscore? + Rename "SOAK" to "soak" or "Soak" (except when it is a tag). Change-Id: I9c079f8c2e93d96249d4b60893469c9257d4f3db Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-05-16CSIT-1488: Add data to the Report 1904Tibor Frank1-0/+3
Change-Id: I7484eeb872cd8fa736421a0ded2fcfffe733051e Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-05-16Report: Configure 1904.21Tibor Frank1-0/+3
Change-Id: Ib65580067d9c41137293036bbd786e31c2bdf503 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-05-15Report: Add pdf versionTibor Frank1-7/+9
Change-Id: Idc6936262a968e213f2fafa52adacfee65ad345c Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-05-15PLRsearch methodology: Add graphs with descriptions.Vratko Polak5-6976/+22451
Change-Id: I1acb74c6edb966dcdbbdaf88c05bfde1192bf74b Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-05-15Report: update known perf issuesJan Gelety1-0/+6
Change-Id: I83863b6a32a1f4d079e126458ba50a358e8de447 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-05-15Trending: Add IPSECSWTibor Frank3-2/+47
Change-Id: I5437d46759c3fcf9a8f44d02d43a70f3f3b2635d Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-05-14CSIT-1504: Soak tests - graphTibor Frank3-8/+28
Change-Id: I8416e28a27c16da76c0ebb94f847539f662229fa Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-05-13CSIT-1500: Add comparison table for SOAK vs NDRPDRTibor Frank2-1/+19
Change-Id: I890b28b7a8c1f60cce4c985ccd94fcdfd3c47d7d Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-05-13Report: Add SOAK TestsTibor Frank3-3/+5
Change-Id: I22eec7cf8ff25958218d4b8ac6bab5a34b2f206c Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-05-13CSIT-1488: Add data to the Report 1904Tibor Frank1-1/+5
Change-Id: I6e35ba3a89e02fa1e34e5ef637598cb6e22baaaa Signed-off-by: Tibor Frank <tifrank@cisco.com>