aboutsummaryrefslogtreecommitdiffstats
path: root/docs
AgeCommit message (Collapse)AuthorFilesLines
2019-08-23Introduce reconfig suites, for dot1q+ip4+vxlanVratko Polak1-14/+32
Ticket: CSIT-1551 + Config copied from other suites. + Layer keywords prepared for additional chains. + Renamed "create" argument to "vlan_per_chain". + TrafficGenerator result extraction improvements. + Also unified TG type and subtype checking. + Throughput estimated as PDR for zero PLR. + Actual Qemu start is skipped. + Parse xstats instead of stats in trex stop scipt. - Because stats are unconditionally cleared on each script connect. + Remember start values to get better ReceiveMeasurementResult at stop. + Expose loss count and time as appropriate test message. + Autogen support. + Multiple chain amounts and core densities. - Only 1 additional chain. + Proper TAGs. Documented. + Clarified min framesize tags are for TG-DUT. + Added a TODO concerning overhead values. + Added 118B tag. + Robot performance keywords improvements. + Added missing return value documentation. + Frame size as required test variable, not an explicit argument. + MLRsearch keyword to store result (not into test message). - TODO: De-duplicate: main keyword to measure, minor to set test message. - But implementation uses the fact default arguments are different. + Keywords for starting and stopping background traffic. - No checks whether start-stop pair is complete. + Multiple minor indentation and logging improvements. - Missing / TODOs: - Support also vlan_per_chain=True? - Support dot1q without vxlan? - Support also deletion? - How to package config steps so -reconf can be generated from -ndrpdr? Change-Id: If0270697f9ffa837c34ef802917220a53f156703 Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit ff820e3d53434889aacde2373314c3be8d00f765)
2019-08-09DOC: rls1908 static contentPeter Mikus23-1204/+1054
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Ia0778acc543a51fe85b8a75162f12905badaa382 (cherry picked from commit ce1c52b1fd27d3e2b6c4909219fa98418565ba61)
2019-08-09Report: ConfigurationTibor Frank3-44/+4
Change-Id: I55dc7412e28cc2c5eb9c3f151e75a06be2d36f69 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit d6c832b02ac7d3073dd8651b089a72ec8240b183)
2019-08-09Trending: TSH ipsec testsTibor Frank2-8/+63
Change-Id: Ib9f867e2b55a61019b487c96b0a05e9fa175dd0f Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-08-08Trending: Add dnv mrr testsTibor Frank16-1/+407
Change-Id: If0c0d6b346e64caf7af4432917a91468a1f0554a Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-08-083n-tsh trending docs fixesjuraj.linkes7-237/+3
Change-Id: Icf4babf8f7924be864520a0ecf8f7e718de51c32 Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>
2019-08-07Update trending vpp refjuraj.linkes118-354/+354
Nexus to Packagecloud Xenial to Bionic Change-Id: Id702076b9a5c37e84719bae66bcd87c9ab5ed2b7 Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>
2019-08-02Add 3n-tsh mrr data to trending docsjuraj.linkes27-0/+698
Change-Id: I82f074c0f7261bd1019ade1e01781278b063c0cd Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>
2019-08-01Trending: Fix static content in dashboardTibor Frank1-6/+6
Change-Id: Idffb3ec30d402326e5962209872afb613df68970 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-07-25docs: fixed TOC and list indexes in testbed specificationMaciek Konstantynowicz1-63/+63
Change-Id: I262b4a2b8c0afae4fd49e4edee8f12b2dbc0ed60 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2019-07-25docs: updated testbed specification with clx buildMaciek Konstantynowicz1-142/+408
Change-Id: Idaea4ac8ba04bea591ade511f55a5e421d04b8f5 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2019-07-19PLRsearch methodology: Add more comments to graphsVratko Polak3-25/+151
Change-Id: I2d4743c6bb7dc91eca22b01298e4529f6b2e559d Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-07-17Use PapiSocketProvider for most PAPI callsVratko Polak2-0/+6
Ticket: CSIT-1541 Ticket: VPP-1722 Ticket: CSIT-1546 + Increase timeout to hide x520 slownes of show hardware detail. - Install sshpass and update ssh client in virl bootstrap. + Added TODOs to remove when CSIT-1546 is fixed. + Enable default socksvr on any startup conf. + Improve OptionString init and repr. - The non-socket executor still kept for stats. + Remove everything unrelated to stats from non-socket executor. - Remove some debug-loooking calls to avoid failures. TODO: Introduce proper parsing to the affected keywords. + Reduce logging from PAPI code to level INFO. - Needs https://gerrit.fd.io/r/20660 to fully work. + Change default values for LocalExecution.run() + Return code check enabled by default. Code is more readable when rc!=0 is allowed explicitly, and the test code will now detect unexpected failures. + Logging disabled by default. Output XML is large already. Important logging can be enabled explicitly. + Restore alphabetical order in common.sh functions. Change-Id: I05882cb6b620ad14638f7404b5ad38c7a5de9e6c Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-07-10Bash functions style cleanupVratko Polak1-15/+21
+ Update rst documentation for bash style + Command substitution: + Clarify when to use backticks. + Recommend avoiding nested command substitution. + Do not recommend putting command substitution results into quotes. + Function definition content: + Move "set -exuo pipefail" after comment only blocks. + Other set flags allowed for functions with good reasons. + Apply the new recommendations. - Blank lines unified in code but no written recommendation in rst. + Add missing references to functions called, variables read or set. + Add TODOs to where lists would be long. + Minor improvements to function descriptions. + Make "if" expressions more python-like. + Add missing "|| die" (or "|| true") where spotted. + Downgrade DEFAULT_NIC to a local variable. + Add TODO to list reasons for blacklisted tags. Change-Id: I05dce030a8c2cb1b3a242d8b977e8fe150d8ee20 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-07-08Next IETF draft version for PLRsearchVratko Polak1-186/+145
+ Finished the rewrite left in progress last time. + Described current logic (load selection) changed since last time. + Fixed fitting function formulas, normalization was wrong. + Other minor improvements. Change-Id: I3d762db98b6f8789207bc58db1f171faa6e753bd Signed-off-by: Vratko Polak <vrpolak@cisco.com> Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2019-07-08Update of draft-vpolak-mkonstan-bmwg-mlrsearch-01->02.Maciek Konstantynowicz2-362/+488
Change-Id: Iba2d5369298f8615aacb1ff0f73b4832d359b433 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2019-07-08Update draft-mkonstan-nf-service-density-00->01Maciek Konstantynowicz1-65/+174
Change-Id: Ic63aa09bfff98d358b770e378c5571f1114839b8 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2019-07-04Update draft-vpolak-bmwg-plrsearch-01->02Maciek Konstantynowicz2-229/+1
Change-Id: Ida23a50c9148570a6510f93a2bb731ea8b0b2b94 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2019-06-19Add 2-node and 3-node denverton to specificationsYulong Pei1-7/+82
Change-Id: I79fc4a4d28e1ec1aaa6590c6df340fa7d33c8654 Signed-off-by: Yulong Pei <yulong.pei@intel.com>
2019-06-19Add scale ipsec tunnel testsPeter Mikus1-2/+2
- 5K - 10K Change-Id: Iaa2c77d07c3686e09fe327c663d7d7fc42024034 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-06-17Report 1904: Configure rls 1904.25Tibor Frank1-0/+5
Change-Id: I44bfc2247d4d2def131d89e1d97d8cad7522ccd1 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-06-10Report: Configure report 1904.24Tibor Frank1-0/+5
Change-Id: I4d6d913f0139fe0fab00668ec16081c04cc6bc0e Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-06-03Report: Configure Report 1904.23Tibor Frank1-0/+5
Change-Id: I0f19d4e3bdafbdf1a435436a2f25945c2b45e06e Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-05-24CSIT-1425 Upgrade TRex to v2.54Tibor Frank1-4/+3
Change-Id: I71010c18210e88828ded0bc679997d76f34886cb Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-05-24Report: Configure Report 1904.22Tibor Frank1-7/+12
Change-Id: Ic8d5a9a856658a2a2661cae8abd8d3b1127b4ff8 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-05-23CSIT-1506: Rework IPsec base testcasesPeter Mikus1-4/+24
- Add: aes-128-gcm aes-128-gcm aes-256-gcm aes-256-gcm aes-128-cbc hmac-sha-256 aes-256-cbc hmac-sha-512 - Remove: hmac-sha1 - Scale will follow in next patch Change-Id: I789f71cf66cf61b8dbb3c6dbe9b6fdc79866ac33 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-05-22Report: Update report historyTibor Frank1-0/+5
Change-Id: I790f5d658472d087cd33b6a08a55620e3e5906e3 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-05-17Report: Fix internal links to PLRsearch methodologyVratko Polak3-3/+3
Change-Id: I87b334e9c89b1469112dac4327faaf430c6f846a Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-05-16Improve soak graphs and contentVratko Polak2-5/+7
+ Fix duration, mention number of tests and runs. - Hover information still feels wrong. + Mention "critical rate" instead of "throughput" where possible. + Mention lower bounds are displayed. + Rename "plrsearch_algorithm" label to "PLRsearch". + Because the previous link did not work. Due to underscore? + Rename "SOAK" to "soak" or "Soak" (except when it is a tag). Change-Id: I9c079f8c2e93d96249d4b60893469c9257d4f3db Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-05-16CSIT-1488: Add data to the Report 1904Tibor Frank1-0/+3
Change-Id: I7484eeb872cd8fa736421a0ded2fcfffe733051e Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-05-16Report: Configure 1904.21Tibor Frank1-0/+3
Change-Id: Ib65580067d9c41137293036bbd786e31c2bdf503 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-05-15Report: Add pdf versionTibor Frank1-7/+9
Change-Id: Idc6936262a968e213f2fafa52adacfee65ad345c Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-05-15PLRsearch methodology: Add graphs with descriptions.Vratko Polak5-6976/+22451
Change-Id: I1acb74c6edb966dcdbbdaf88c05bfde1192bf74b Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-05-15Report: update known perf issuesJan Gelety1-0/+6
Change-Id: I83863b6a32a1f4d079e126458ba50a358e8de447 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-05-15Trending: Add IPSECSWTibor Frank3-2/+47
Change-Id: I5437d46759c3fcf9a8f44d02d43a70f3f3b2635d Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-05-14CSIT-1504: Soak tests - graphTibor Frank3-8/+28
Change-Id: I8416e28a27c16da76c0ebb94f847539f662229fa Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-05-13CSIT-1500: Add comparison table for SOAK vs NDRPDRTibor Frank2-1/+19
Change-Id: I890b28b7a8c1f60cce4c985ccd94fcdfd3c47d7d Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-05-13Report: Add SOAK TestsTibor Frank3-3/+5
Change-Id: I22eec7cf8ff25958218d4b8ac6bab5a34b2f206c Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-05-13CSIT-1488: Add data to the Report 1904Tibor Frank1-1/+5
Change-Id: I6e35ba3a89e02fa1e34e5ef637598cb6e22baaaa Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-05-13Report: Configuration for 1904.20Tibor Frank1-0/+3
Change-Id: I4bbf1ed196947cc290de943b1e39721021d9d7d4 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-05-10Update perf release notes 1904Peter Mikus1-4/+7
Change-Id: Ia74d6270ef0b654efb77a369f240e7a9c53156c5 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-05-10Report: Hide DMMTibor Frank4-25/+25
Change-Id: Ib1381365b01cecb701a956a22131d2b4fe1a3b60 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-05-10report: added missing sub-section header in methodology throughputMaciek Konstantynowicz1-0/+3
Change-Id: Iadeaca5d39be051ef334f98e50a6a17210c503bf Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2019-05-10Update PLRsearch methodology to latest codeVratko Polak1-286/+105
Deleted much of terms and generalized descriptions, added more details on the current implementation. - Still with old graphs Change-Id: I9ba6b40d1d9d36d4f10382f60c756f5bc4708e4d Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-05-10report: edits of methodology mlrsearch sectionMaciek Konstantynowicz2-265/+29
Change-Id: I80b4f8223d2991e258ab422c447bdc09d92c9e9c Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2019-05-10Report: VPP_func update 2Jan Gelety1-2/+1
Change-Id: I840f61211bd01e26862ae7af40522a82ce8cfb25 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-05-10Update release notes 1904Peter Mikus1-5/+8
Change-Id: Ib31d809b2c1741374fe3bd03e21adea6336bc7f5 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-05-10report: further edits of methodology throughput sectionsMaciek Konstantynowicz8-142/+200
Change-Id: I571d1a47743eb31ee10caf3f3336ac7437daf878 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2019-05-10Release notes: 1904Peter Mikus2-30/+18
Change-Id: I3b075b210f3e3c126d049799aea15f6b75235677 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-05-10Report: VPP_func updateJan Gelety1-239/+81
Change-Id: I7d551e4d62b1678347c8c5c08a42201567a497cf Signed-off-by: Jan Gelety <jgelety@cisco.com>