aboutsummaryrefslogtreecommitdiffstats
path: root/docs
AgeCommit message (Collapse)AuthorFilesLines
2019-09-12PAL: Add NFV reconf testsTibor Frank2-0/+133
Change-Id: I6fe36f05423c3c43081872153adf0f1a899381b6 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-12Report: Configure 1908.38Tibor Frank1-0/+3
Change-Id: I0239e6c567c50c211ddabffa4b1bf22cdcec6462 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-11Ansible: Cascadelake includePeter Mikus5-210/+1753
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Iecb18e9d94ff715e40152564fb778650d43a48d3
2019-09-10PAL: Add replacing of data in tablesTibor Frank15-78/+999
+ vhost data Change-Id: I86fc97ba5c3b0feffec2dfb0ac11c5d3c9d53a81 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-09Report: Report historyTibor Frank1-7/+4
Change-Id: Ib74a10ccd589111dd3c830adec9293ff2c698772 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-09Report: Add dnv mrr dataTibor Frank6-0/+52
Change-Id: I3dcc813dce7b8938be6b2caaaf1e64ce9abb7fe9 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-09Report: Fix tsh and dnv plotsTibor Frank2-1/+3
Change-Id: I1d40849bc15f4433117af91f71e951a61924d732 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-09Report: Add soak testsTibor Frank3-6/+3
Change-Id: I2161c8d8e54cfa35cd3febdda1cb47d6cec424a0 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-06Report: Fix2 - Add 3n-dnv plots and tablesTibor Frank3-0/+3
Change-Id: Ia182e6e52a37f9b3248eab60ffe4dd4746ed7fa6 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-03docs: add select list of tests for report - tsh and dnvJan Gelety3-0/+191
Change-Id: I63a69d998c80029422bae9f90e186eb2286196d1 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-09-06Report: Fix - Add 3n-dnv plots and tablesTibor Frank4-3/+36
Change-Id: I5f09f1f20e532e71d6abde02111a90f5868035f3 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-06Report: Add 3n-dnv plots and tablesTibor Frank24-0/+1382
Change-Id: I6b65231f928b6168e0696f35fc253ce513163e50 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-05Report: Add 2n-dnv plots and tablesTibor Frank60-84/+826
Change-Id: Ibbd1775bec26817a4c193bc67ba03b29b8ddfff7 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-05Report: Fix fonts in release notes tableTibor Frank1-2/+2
Change-Id: I4a3486c313c4aa4754c455389b8ebb363ead469a Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-05Report: Configure Report 1908.37Tibor Frank1-0/+12
Change-Id: I1d883dbb299ecef151c7d7a9c5612ae0330e3538 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-04Report methodology: PLRsearch update with graphsVratko Polak3-20198/+9391
Change-Id: Ib73a64c93bdba3945b8237783a24134b47d4eb99 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-09-04docs: report vpp performance rls notes update.Maciek Konstantynowicz1-24/+68
Change-Id: Ie4a7a80cad9ff92b9f30953096cca8a029edc687 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2019-09-04docs: report packet_throughput_graphs text formatting fixes.Maciek Konstantynowicz1-11/+32
Change-Id: Ibea6e70e2fcf9cfeb7627ee1cbcfa6e177c0b2c6 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2019-09-04Doc: Report release notes (perf)Peter Mikus1-0/+5
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I8c1667efec67febd375818bc1dfe1d9bebc70708
2019-09-04docs: added methodology terminology section to report.Maciek Konstantynowicz2-0/+79
Change-Id: Id787d12b577165a1081dba84b610c32df57a7c44 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2019-09-04docs: report updates in physical_testbeds section.Maciek Konstantynowicz1-86/+163
Change-Id: Id31e6ed294dc80619a108296be580925509bb7d7 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2019-09-04docs: updated report intro in packet_throughput_graphsMaciek Konstantynowicz1-5/+68
Change-Id: I3bf70cc7e48ef2134841bc4bf9300cda6a118cb3 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2019-09-04Report: ixgbe for tshTibor Frank34-493/+521
Change-Id: I707a654b8853926f4cb1b78f3c65b55925e95ac1 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-02Report: Add dataTibor Frank3-279/+276
Change-Id: If799a7a1d1b8f6ea59ebfba3dd4724b09e7680f2 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-09-02Report: Add 3n-tshTibor Frank67-62/+3400
Change-Id: I6027b635191c7e64397915df8944699bb320daf3 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-08-30Report: functional tests static contentJan Gelety2-97/+70
Change-Id: I17238ff6d1760f6a956459e072ba0303abef3199 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-08-28docs: created full list of tests for report detailed results.Maciek Konstantynowicz3-0/+673
Change-Id: I82d298399b5899736c8e5ebb7204dbbddace79f4 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2019-08-28docs: created select list of tests for report and trending.Maciek Konstantynowicz3-0/+335
Change-Id: I2ad255c35490e52d9a55e24e64539549e6bdd36b Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2019-08-27DOC: 1908rls release notes for VPP Hoststack TCP performance tests.Dave Wallace1-0/+4
Change-Id: I56d0519b5cbdfb8a60aab85a9a4d721fdfe022ce Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
2019-08-27docs: added csit tests job specs.Maciek Konstantynowicz1-0/+141
Change-Id: I271b1c700f72204dcf03bee6f2cd30b25ca5663e Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2019-08-26Report: Comp TablesTibor Frank1-30/+30
Change-Id: I2cedef4dc274dc45ebc82911d53f3d5d14ffa381 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-08-26Report: NFVTibor Frank6-189/+185
Change-Id: Idf369766cb9acf82475b1d86860d72077b88dc35 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-08-26Report: Modify comparison tables, add dataTibor Frank8-322/+291
Change-Id: I6d5e7cc0618a5b1889ab54c020fd98c661d20989 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-08-26Report: Select tests by name, specificationsTibor Frank182-13746/+5028
Change-Id: Ibcc5e67d49fba9c02b07af462a74d2a062412979 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-08-23Introduce reconfig suites, for dot1q+ip4+vxlanVratko Polak1-14/+32
Ticket: CSIT-1551 + Config copied from other suites. + Layer keywords prepared for additional chains. + Renamed "create" argument to "vlan_per_chain". + TrafficGenerator result extraction improvements. + Also unified TG type and subtype checking. + Throughput estimated as PDR for zero PLR. + Actual Qemu start is skipped. + Parse xstats instead of stats in trex stop scipt. - Because stats are unconditionally cleared on each script connect. + Remember start values to get better ReceiveMeasurementResult at stop. + Expose loss count and time as appropriate test message. + Autogen support. + Multiple chain amounts and core densities. - Only 1 additional chain. + Proper TAGs. Documented. + Clarified min framesize tags are for TG-DUT. + Added a TODO concerning overhead values. + Added 118B tag. + Robot performance keywords improvements. + Added missing return value documentation. + Frame size as required test variable, not an explicit argument. + MLRsearch keyword to store result (not into test message). - TODO: De-duplicate: main keyword to measure, minor to set test message. - But implementation uses the fact default arguments are different. + Keywords for starting and stopping background traffic. - No checks whether start-stop pair is complete. + Multiple minor indentation and logging improvements. - Missing / TODOs: - Support also vlan_per_chain=True? - Support dot1q without vxlan? - Support also deletion? - How to package config steps so -reconf can be generated from -ndrpdr? Change-Id: If0270697f9ffa837c34ef802917220a53f156703 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-08-16labs: add new Cascade Lake IPsMohammed Naser1-28/+28
This patch adds the IP addresses for all the new Cascade Lake machines inside the FD.io labs. Signed-off-by: Mohammed Naser <mnaser@vexxhost.com> Change-Id: Icc35aac52cb04c9dcf4e2fa682fcbe24e7007d63
2019-08-09Bump VPP stable version: socksvrVratko Polak2-2/+2
VPP changed the default socket path in: https://gerrit.fd.io/r/c/vpp/+/21100 Instead of "default", explicit value is used now. It coincides with VPP default one, and is stored in Constants.py (except documentation). The file name for robot side forwarded socket remains, as the path leading to is is different anyway. Change-Id: I0058d16794a3cd04411640c2c8d5fd4ee8cb997d Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-08-09DOC: rls1908 static contentPeter Mikus23-1204/+1054
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Ia0778acc543a51fe85b8a75162f12905badaa382
2019-08-09Report: ConfigurationTibor Frank3-44/+4
Change-Id: I55dc7412e28cc2c5eb9c3f151e75a06be2d36f69 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-08-09Trending: TSH ipsec testsTibor Frank2-8/+63
Change-Id: Ib9f867e2b55a61019b487c96b0a05e9fa175dd0f Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-08-08Trending: ipsecTibor Frank18-191/+326
Change-Id: I2fc623ac152b8559a230b340be2f1cc92c7e934a Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-08-08Trending: Add dnv mrr testsTibor Frank16-1/+407
Change-Id: If0c0d6b346e64caf7af4432917a91468a1f0554a Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-08-083n-tsh trending docs fixesjuraj.linkes7-237/+3
Change-Id: Icf4babf8f7924be864520a0ecf8f7e718de51c32 Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>
2019-08-07Update trending vpp refjuraj.linkes118-354/+354
Nexus to Packagecloud Xenial to Bionic Change-Id: Id702076b9a5c37e84719bae66bcd87c9ab5ed2b7 Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>
2019-08-02Add 3n-tsh mrr data to trending docsjuraj.linkes27-0/+698
Change-Id: I82f074c0f7261bd1019ade1e01781278b063c0cd Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>
2019-08-01Trending: Fix static content in dashboardTibor Frank1-6/+6
Change-Id: Idffb3ec30d402326e5962209872afb613df68970 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-07-25docs: fixed TOC and list indexes in testbed specificationMaciek Konstantynowicz1-63/+63
Change-Id: I262b4a2b8c0afae4fd49e4edee8f12b2dbc0ed60 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2019-07-25docs: updated testbed specification with clx buildMaciek Konstantynowicz1-142/+408
Change-Id: Idaea4ac8ba04bea591ade511f55a5e421d04b8f5 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2019-07-19PLRsearch methodology: Add more comments to graphsVratko Polak3-25/+151
Change-Id: I2d4743c6bb7dc91eca22b01298e4529f6b2e559d Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-07-17Use PapiSocketProvider for most PAPI callsVratko Polak2-0/+6
Ticket: CSIT-1541 Ticket: VPP-1722 Ticket: CSIT-1546 + Increase timeout to hide x520 slownes of show hardware detail. - Install sshpass and update ssh client in virl bootstrap. + Added TODOs to remove when CSIT-1546 is fixed. + Enable default socksvr on any startup conf. + Improve OptionString init and repr. - The non-socket executor still kept for stats. + Remove everything unrelated to stats from non-socket executor. - Remove some debug-loooking calls to avoid failures. TODO: Introduce proper parsing to the affected keywords. + Reduce logging from PAPI code to level INFO. - Needs https://gerrit.fd.io/r/20660 to fully work. + Change default values for LocalExecution.run() + Return code check enabled by default. Code is more readable when rc!=0 is allowed explicitly, and the test code will now detect unexpected failures. + Logging disabled by default. Output XML is large already. Important logging can be enabled explicitly. + Restore alphabetical order in common.sh functions. Change-Id: I05882cb6b620ad14638f7404b5ad38c7a5de9e6c Signed-off-by: Vratko Polak <vrpolak@cisco.com>