aboutsummaryrefslogtreecommitdiffstats
path: root/docs
AgeCommit message (Collapse)AuthorFilesLines
2019-09-04docs: added methodology terminology section to report.Maciek Konstantynowicz2-0/+79
Change-Id: Id787d12b577165a1081dba84b610c32df57a7c44 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2019-09-04docs: report updates in physical_testbeds section.Maciek Konstantynowicz1-86/+163
Change-Id: Id31e6ed294dc80619a108296be580925509bb7d7 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2019-09-04docs: updated report intro in packet_throughput_graphsMaciek Konstantynowicz1-5/+68
Change-Id: I3bf70cc7e48ef2134841bc4bf9300cda6a118cb3 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2019-09-04Report: ixgbe for tshTibor Frank34-493/+521
Change-Id: I707a654b8853926f4cb1b78f3c65b55925e95ac1 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-02Report: Add dataTibor Frank3-279/+276
Change-Id: If799a7a1d1b8f6ea59ebfba3dd4724b09e7680f2 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-02Report: Add 3n-tshTibor Frank67-62/+3400
Change-Id: I6027b635191c7e64397915df8944699bb320daf3 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-08-30Report: functional tests static contentJan Gelety2-97/+70
Change-Id: I17238ff6d1760f6a956459e072ba0303abef3199 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-08-28docs: created full list of tests for report detailed results.Maciek Konstantynowicz3-0/+673
Change-Id: I82d298399b5899736c8e5ebb7204dbbddace79f4 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2019-08-28docs: created select list of tests for report and trending.Maciek Konstantynowicz3-0/+335
Change-Id: I2ad255c35490e52d9a55e24e64539549e6bdd36b Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2019-08-27DOC: 1908rls release notes for VPP Hoststack TCP performance tests.Dave Wallace1-0/+4
Change-Id: I56d0519b5cbdfb8a60aab85a9a4d721fdfe022ce Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
2019-08-27docs: added csit tests job specs.Maciek Konstantynowicz1-0/+141
Change-Id: I271b1c700f72204dcf03bee6f2cd30b25ca5663e Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2019-08-26Report: Comp TablesTibor Frank1-30/+30
Change-Id: I2cedef4dc274dc45ebc82911d53f3d5d14ffa381 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-08-26Report: NFVTibor Frank6-189/+185
Change-Id: Idf369766cb9acf82475b1d86860d72077b88dc35 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-08-26Report: Modify comparison tables, add dataTibor Frank8-322/+291
Change-Id: I6d5e7cc0618a5b1889ab54c020fd98c661d20989 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-08-26Report: Select tests by name, specificationsTibor Frank182-13746/+5028
Change-Id: Ibcc5e67d49fba9c02b07af462a74d2a062412979 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-08-23Introduce reconfig suites, for dot1q+ip4+vxlanVratko Polak1-14/+32
Ticket: CSIT-1551 + Config copied from other suites. + Layer keywords prepared for additional chains. + Renamed "create" argument to "vlan_per_chain". + TrafficGenerator result extraction improvements. + Also unified TG type and subtype checking. + Throughput estimated as PDR for zero PLR. + Actual Qemu start is skipped. + Parse xstats instead of stats in trex stop scipt. - Because stats are unconditionally cleared on each script connect. + Remember start values to get better ReceiveMeasurementResult at stop. + Expose loss count and time as appropriate test message. + Autogen support. + Multiple chain amounts and core densities. - Only 1 additional chain. + Proper TAGs. Documented. + Clarified min framesize tags are for TG-DUT. + Added a TODO concerning overhead values. + Added 118B tag. + Robot performance keywords improvements. + Added missing return value documentation. + Frame size as required test variable, not an explicit argument. + MLRsearch keyword to store result (not into test message). - TODO: De-duplicate: main keyword to measure, minor to set test message. - But implementation uses the fact default arguments are different. + Keywords for starting and stopping background traffic. - No checks whether start-stop pair is complete. + Multiple minor indentation and logging improvements. - Missing / TODOs: - Support also vlan_per_chain=True? - Support dot1q without vxlan? - Support also deletion? - How to package config steps so -reconf can be generated from -ndrpdr? Change-Id: If0270697f9ffa837c34ef802917220a53f156703 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-08-16labs: add new Cascade Lake IPsMohammed Naser1-28/+28
This patch adds the IP addresses for all the new Cascade Lake machines inside the FD.io labs. Signed-off-by: Mohammed Naser <mnaser@vexxhost.com> Change-Id: Icc35aac52cb04c9dcf4e2fa682fcbe24e7007d63
2019-08-09Bump VPP stable version: socksvrVratko Polak2-2/+2
VPP changed the default socket path in: https://gerrit.fd.io/r/c/vpp/+/21100 Instead of "default", explicit value is used now. It coincides with VPP default one, and is stored in Constants.py (except documentation). The file name for robot side forwarded socket remains, as the path leading to is is different anyway. Change-Id: I0058d16794a3cd04411640c2c8d5fd4ee8cb997d Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-08-09DOC: rls1908 static contentPeter Mikus23-1204/+1054
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Ia0778acc543a51fe85b8a75162f12905badaa382
2019-08-09Report: ConfigurationTibor Frank3-44/+4
Change-Id: I55dc7412e28cc2c5eb9c3f151e75a06be2d36f69 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-08-09Trending: TSH ipsec testsTibor Frank2-8/+63
Change-Id: Ib9f867e2b55a61019b487c96b0a05e9fa175dd0f Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-08-08Trending: ipsecTibor Frank18-191/+326
Change-Id: I2fc623ac152b8559a230b340be2f1cc92c7e934a Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-08-08Trending: Add dnv mrr testsTibor Frank16-1/+407
Change-Id: If0c0d6b346e64caf7af4432917a91468a1f0554a Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-08-083n-tsh trending docs fixesjuraj.linkes7-237/+3
Change-Id: Icf4babf8f7924be864520a0ecf8f7e718de51c32 Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>
2019-08-07Update trending vpp refjuraj.linkes118-354/+354
Nexus to Packagecloud Xenial to Bionic Change-Id: Id702076b9a5c37e84719bae66bcd87c9ab5ed2b7 Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>
2019-08-02Add 3n-tsh mrr data to trending docsjuraj.linkes27-0/+698
Change-Id: I82f074c0f7261bd1019ade1e01781278b063c0cd Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>
2019-08-01Trending: Fix static content in dashboardTibor Frank1-6/+6
Change-Id: Idffb3ec30d402326e5962209872afb613df68970 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-07-25docs: fixed TOC and list indexes in testbed specificationMaciek Konstantynowicz1-63/+63
Change-Id: I262b4a2b8c0afae4fd49e4edee8f12b2dbc0ed60 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2019-07-25docs: updated testbed specification with clx buildMaciek Konstantynowicz1-142/+408
Change-Id: Idaea4ac8ba04bea591ade511f55a5e421d04b8f5 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2019-07-19PLRsearch methodology: Add more comments to graphsVratko Polak3-25/+151
Change-Id: I2d4743c6bb7dc91eca22b01298e4529f6b2e559d Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-07-17Use PapiSocketProvider for most PAPI callsVratko Polak2-0/+6
Ticket: CSIT-1541 Ticket: VPP-1722 Ticket: CSIT-1546 + Increase timeout to hide x520 slownes of show hardware detail. - Install sshpass and update ssh client in virl bootstrap. + Added TODOs to remove when CSIT-1546 is fixed. + Enable default socksvr on any startup conf. + Improve OptionString init and repr. - The non-socket executor still kept for stats. + Remove everything unrelated to stats from non-socket executor. - Remove some debug-loooking calls to avoid failures. TODO: Introduce proper parsing to the affected keywords. + Reduce logging from PAPI code to level INFO. - Needs https://gerrit.fd.io/r/20660 to fully work. + Change default values for LocalExecution.run() + Return code check enabled by default. Code is more readable when rc!=0 is allowed explicitly, and the test code will now detect unexpected failures. + Logging disabled by default. Output XML is large already. Important logging can be enabled explicitly. + Restore alphabetical order in common.sh functions. Change-Id: I05882cb6b620ad14638f7404b5ad38c7a5de9e6c Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-07-10Bash functions style cleanupVratko Polak1-15/+21
+ Update rst documentation for bash style + Command substitution: + Clarify when to use backticks. + Recommend avoiding nested command substitution. + Do not recommend putting command substitution results into quotes. + Function definition content: + Move "set -exuo pipefail" after comment only blocks. + Other set flags allowed for functions with good reasons. + Apply the new recommendations. - Blank lines unified in code but no written recommendation in rst. + Add missing references to functions called, variables read or set. + Add TODOs to where lists would be long. + Minor improvements to function descriptions. + Make "if" expressions more python-like. + Add missing "|| die" (or "|| true") where spotted. + Downgrade DEFAULT_NIC to a local variable. + Add TODO to list reasons for blacklisted tags. Change-Id: I05dce030a8c2cb1b3a242d8b977e8fe150d8ee20 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-07-08Next IETF draft version for PLRsearchVratko Polak1-186/+145
+ Finished the rewrite left in progress last time. + Described current logic (load selection) changed since last time. + Fixed fitting function formulas, normalization was wrong. + Other minor improvements. Change-Id: I3d762db98b6f8789207bc58db1f171faa6e753bd Signed-off-by: Vratko Polak <vrpolak@cisco.com> Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2019-07-08Update of draft-vpolak-mkonstan-bmwg-mlrsearch-01->02.Maciek Konstantynowicz2-362/+488
Change-Id: Iba2d5369298f8615aacb1ff0f73b4832d359b433 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2019-07-08Update draft-mkonstan-nf-service-density-00->01Maciek Konstantynowicz1-65/+174
Change-Id: Ic63aa09bfff98d358b770e378c5571f1114839b8 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2019-07-04Update draft-vpolak-bmwg-plrsearch-01->02Maciek Konstantynowicz2-229/+1
Change-Id: Ida23a50c9148570a6510f93a2bb731ea8b0b2b94 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2019-06-19Add 2-node and 3-node denverton to specificationsYulong Pei1-7/+82
Change-Id: I79fc4a4d28e1ec1aaa6590c6df340fa7d33c8654 Signed-off-by: Yulong Pei <yulong.pei@intel.com>
2019-06-19Add scale ipsec tunnel testsPeter Mikus1-2/+2
- 5K - 10K Change-Id: Iaa2c77d07c3686e09fe327c663d7d7fc42024034 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-06-17Report 1904: Configure rls 1904.25Tibor Frank1-0/+5
Change-Id: I44bfc2247d4d2def131d89e1d97d8cad7522ccd1 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-06-10Report: Configure report 1904.24Tibor Frank1-0/+5
Change-Id: I4d6d913f0139fe0fab00668ec16081c04cc6bc0e Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-06-03Report: Configure Report 1904.23Tibor Frank1-0/+5
Change-Id: I0f19d4e3bdafbdf1a435436a2f25945c2b45e06e Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-05-24CSIT-1425 Upgrade TRex to v2.54Tibor Frank1-4/+3
Change-Id: I71010c18210e88828ded0bc679997d76f34886cb Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-05-24Report: Configure Report 1904.22Tibor Frank1-7/+12
Change-Id: Ic8d5a9a856658a2a2661cae8abd8d3b1127b4ff8 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-05-23CSIT-1506: Rework IPsec base testcasesPeter Mikus1-4/+24
- Add: aes-128-gcm aes-128-gcm aes-256-gcm aes-256-gcm aes-128-cbc hmac-sha-256 aes-256-cbc hmac-sha-512 - Remove: hmac-sha1 - Scale will follow in next patch Change-Id: I789f71cf66cf61b8dbb3c6dbe9b6fdc79866ac33 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-05-22Report: Update report historyTibor Frank1-0/+5
Change-Id: I790f5d658472d087cd33b6a08a55620e3e5906e3 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-05-17Report: Fix internal links to PLRsearch methodologyVratko Polak3-3/+3
Change-Id: I87b334e9c89b1469112dac4327faaf430c6f846a Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-05-16Improve soak graphs and contentVratko Polak2-5/+7
+ Fix duration, mention number of tests and runs. - Hover information still feels wrong. + Mention "critical rate" instead of "throughput" where possible. + Mention lower bounds are displayed. + Rename "plrsearch_algorithm" label to "PLRsearch". + Because the previous link did not work. Due to underscore? + Rename "SOAK" to "soak" or "Soak" (except when it is a tag). Change-Id: I9c079f8c2e93d96249d4b60893469c9257d4f3db Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-05-16CSIT-1488: Add data to the Report 1904Tibor Frank1-0/+3
Change-Id: I7484eeb872cd8fa736421a0ded2fcfffe733051e Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-05-16Report: Configure 1904.21Tibor Frank1-0/+3
Change-Id: Ib65580067d9c41137293036bbd786e31c2bdf503 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-05-15Report: Add pdf versionTibor Frank1-7/+9
Change-Id: Idc6936262a968e213f2fafa52adacfee65ad345c Signed-off-by: Tibor Frank <tifrank@cisco.com>