aboutsummaryrefslogtreecommitdiffstats
path: root/docs
AgeCommit message (Collapse)AuthorFilesLines
2019-05-03report 1904: updated methodology (nfv density, startup.conf) and vpp perf ↵Maciek Konstantynowicz3-35/+36
rls notes Change-Id: If6d24511d5d29dcc25c21437364e0da15af3cca1 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2019-05-03Update KVM methodologyPeter Mikus2-17/+70
Change-Id: I8be9b9295b691a1ec4b810e3a1255ad1bc6947ab Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-04-30Update report static contentPeter Mikus4-45/+38
Change-Id: I8aef71fb2cc09d2c7862884f7ca68c9786ad5165 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-04-29Report: Configure the versionTibor Frank1-1/+1
Change-Id: I064b16e0a2b7f96e4590622be340ab657d785f16 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-04-26NF density tests with dtc=0.5 and dtcr=2Peter Mikus1-0/+10
Change-Id: Icff556142280ad0b6261e0a2bfb71672ee6b3807 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-04-25CSIT-1489: Change graphs to display results by suite generatorTibor Frank29-273/+1195
Change-Id: I00fdc7ce87be5cecf5883ed2c991a8e67efd2e2a Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-04-23CSIT-1488: Add data to the Report 1904Tibor Frank1-1/+1
Change-Id: I2ba9eeedf5668b5a99acbe0d26add2aa0a836a9f Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-04-18Report: Static contentTibor Frank2-4/+4
Change-Id: If8e2593dcaff368b2c7e191f70bab15e8974bb38 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-04-18CSIT-1487: Configure PAL for the Report 1904Tibor Frank5-13/+15
Change-Id: I4f112693a3b50665a9c53290de42d8e365c6d415 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-04-18Add perpatch info to cpta methodologyVratko Polak8-270/+360
Also, split methodology file into multiple, per section. Change-Id: I973b93d1a99205d7adb80996a3657215e05b8985 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-04-18CSIT-1482: Change trending graphsTibor Frank6-0/+11
- Change trending graphs to display results when using suite generator Change-Id: I4f822c180f9c206be19a9c75ce105c2225ad9171 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-04-17Clean up traffic_profile vs osi_layerVratko Polak1-14/+11
The two types were not well distinguished before. Error introduced in: https://gerrit.fd.io/r/#/c/17811/84/resources/libraries/robot/performance/performance_setup.robot@255 Error hotfixed in: https://gerrit.fd.io/r/#/c/18847/4/resources/libraries/robot/shared/default.robot@109 + Rename some arguments and improve method docstrings. Newly introduced argument name osi_layer should be dissimilar enough. Change-Id: Ie0f6f97dc010fc6477f09c54574970f1d15462e2 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-04-09Add vagrant setup for testing VPP device locallyLudovit Mikula2-16/+46
Fixed trailing whitespaces Fixed tabs vs. spaces Removed dead code Changed network interface naming Changed default number of retries for VPP startup to 120 Updated number of hugepages during provisioning Externalized CSIT related sysctl settings to 90-csit.conf Removed hardcoded local docker image name. Added new interface required for honeycomb device testing. Change-Id: I5eb38c8b1a4d96e4220dbd2e202e94f1d47e804e Signed-off-by: Ludovit Mikula <ludovit.mikula@pantheon.tech>
2019-04-08Upgrade autogen to NICs and search typesVratko Polak1-0/+28
+ All perf suites updated, as autogen change is backward incompatible. + Only x710 -ndrpdr suites remain in git repository. + Removed retry feature of run_tests. + Renamed topology_type and traffic_type to traffic_profile. + Renamed framesize to frame_size; nic_model to nic_name. + Reordered Variables table to start with nic_name and overhead. + Fixed wrong overhead value in some cbc-sha1 suites. + Fixed some suite tags. ++ Introduced tags to distinguish suites, such as IPSECINT. + Bound crypto hardware to NIC name. + Implemented NIC limit hiding. + Also search and teardown related arguments are now hidden. + Main measurement keywords updated to new arg handling. + Max rate related keywords moved to performance_limits.robot + Teardowns unified. + Generated tests are archived. ++ Generated directory is .gitignore-d. + Regenerator raises an exception on seeing non-compatible suite. ++ Relatively helpful message should be seen in exception. + Suite and template Documentation has generated parts. +- With short NIC names only. + Autogen checker also upgraded. + Tag expressions replaced with long files to ensure analogous tests. Change-Id: I60e9a999187e7da1f60d0eb4fb02afa14682aa46 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-04-05Fixes for Taishan testbedjuraj.linkes2-10/+6
* rename NICs in Taishan testbed to Intel-X520-DA2 * fix testbed NIC selection * remove unnecessary 82599es tests * blacklist unsupported tests on Taishan testbed * lowercase previously created bash local variables Change-Id: I3b7f59e2edc00929fab2f5a0fce483f236f83075 Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>
2019-04-03Change 2 node Denverton testbed descriptionYulong Pei1-4/+5
Change-Id: I09c5ac3c4fe90b1fff46c4211b401daefe40ac31 Signed-off-by: Yulong Pei <yulong.pei@intel.com>
2019-04-02Update draft-vpolak-mkonstan-bmwg-mlrsearch-00->01.Maciek Konstantynowicz1-72/+74
Change-Id: I7345fdf63a1e7355812e5089e16e14f47cd6e890 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2019-04-01CSIT-1412: Create trending graphs for svc densityTibor Frank5-0/+205
- static content - plots Change-Id: If3d77f5415acfa2efe2bc7ca13e426747b027f8e Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-03-28Report: Configure 1901.1.13Tibor Frank1-0/+3
Change-Id: I17c72ddb8bc5df364761c9e0453aeb128d7951e9 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-03-26Report: Update vpp perf tests release notesJan Gelety1-2/+2
Change-Id: I00bf6cf1d1c38a125be03a82853426e7980e088a Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-03-21Report: Add note about nr of test runsTibor Frank1-0/+7
Change-Id: If7a29bb268c422f788b418c597af8305e04847cf Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-03-20ietf draft: nfv service density rev. -00Maciek Konstantynowicz1-0/+874
Change-Id: I0490db919b4da198545f4a332fd722855bac84a8 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2019-03-19Report: Remove VNFTibor Frank5-14/+37
- add comparisons for dnv Change-Id: I123a925a3c91fba782f152b3cd73f1b63fe50c59 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-03-19Report: Configure 1901.1Tibor Frank1-1/+1
Change-Id: Ica2483bdaebe70b9d6668a36a1b855c52e4d7c86 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-03-15Report: Fix the information about 2-Node Atom DenvertonTibor Frank2-3/+3
Change-Id: I137af7fd34d352c9ed2fba1ac5eca5a409c0ab92 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-03-14CSIT-1461: Edit VPP Release notesTibor Frank1-12/+9
Change-Id: I794fe95df97834b889bf24fc142c5478ce7c0623 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-03-14Report: Add Denverton static contentTibor Frank14-27/+51
Change-Id: I0ba254c00f7aacb425034721fcaed73bfd4dbc01 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-03-13Updated IETF draft: draft-vpolak-bmwg-plrsearch-01.Maciek Konstantynowicz1-0/+911
Change-Id: I507d44f75383046b01def750af51a911b8ec5aa3 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2019-03-11CSIT-1456: Report 1901.1 ConfigurationTibor Frank3-48/+6
Change-Id: Ic629722527e6db6c0594d9499a123b29dc8cf258 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-03-06docs/lab: re-fixed TOC hyperlinks and editing nitsMaciek Konstantynowicz3-25/+29
Change-Id: If42f52a249df70a96fd4fe4aedafad14f8ad03c1 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2019-03-06doc/lab: fixed TOC hyperlinksMaciek Konstantynowicz3-128/+117
Change-Id: Id0de47f08b0f2ca3c60bbcae44b413a94af7afd7 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2019-03-06docs/lab: merged testbed specifications, separated out detailed HW and BIOS ↵Maciek Konstantynowicz4-2007/+2021
configs. Change-Id: I5945723676361fdbe180a3bd5a6a366102ee6c67 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2019-03-05Report: Add LB DataTibor Frank1-0/+5
- Change the version to 1901.10 Change-Id: I4a976a55b375a00fe3498ef26e676ce9410ff7f2 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-03-04Rename to Constants.pyVratko Polak1-1/+1
Motivation: Make the constants available also for Robot. Restraint: Robotframework user guide says: Because variable files are always imported using a file system path, creating them as classes has some restrictions: Python classes must have the same name as the module they are located. Change-Id: I638ef3fe045db132e366de2e2699638b8637e45e Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-03-01Add ARM Taishan testbed33 perftestStanislav Chlebec1-0/+4
Change-Id: Iaa0e7fbca7de26c7dce8b389cc3494f628a2ecd0 Signed-off-by: Stanislav Chlebec <stanislav.chlebec@pantheon.tech> Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>
2019-02-28Report: Remove disabled models from specificationTibor Frank2-3/+9
Change-Id: Ief23b6c9a2f94af2473772c29bb3c4636ea5a1d5 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-02-27Bash style: Add rules for handling working dirVratko Polak1-0/+94
+ Also added details related to "set -e" and exit codes. Change-Id: I731151efd7facc1def3c8cbba4e466e793c93689 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-02-27Add tox.ini and few checker scriptsVratko Polak1-2/+1
The plan is to change csit-validate-pylint-master job to fail if (and only if) tox fails. This will allow us to easily add checks, with or without the voting power. Each check produces log (ignored in .gitignore) the voting job can archive. + Made autogen quiet by default, to avoid spam in autogen checker. + Unified the way direct csit subdirectories are git-ignored. Change-Id: I6477b1ef7da6d3e30f68c5850d04900cc52f431e Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-02-26CSIT-1440: Re-organize graphs in reportTibor Frank3-61/+62
- fixes Change-Id: I4b960651570c9c1174637a8c043f5ced3ce79538 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-02-26FIX: Hardware sections - reportPeter Mikus7-695/+219
Change-Id: I4a64f87fe43eb94841c55d63a7befff0d2c2a477 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-02-26Report: Remove TCP/IPTibor Frank3-3/+11
Change-Id: I9d3c8272654bb5c4c8ebe1a07e9a1d8d9d173407 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-02-26CSIT-1440: Re-organize graphs in reportTibor Frank31-513/+597
- fixes Change-Id: I5e4c1f96ab12b7732f29083ff070861eae984ca6 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-02-26CSIT-1440: Re-organize graphs in reportTibor Frank26-550/+148
- latency - multi-core Change-Id: I8a0f51d51eb451f3c57c15579b4e775e0bffddab Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-02-25CSIT-1440: Re-organize graphs in reportTibor Frank13-595/+122
- Throughput Change-Id: Iab94a7c66d3483707ed99e49489ebf71947a4fca Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-02-21Report: Add dataTibor Frank1-0/+5
Change-Id: I9c03434f3f6b7acf22e9a4f58fe32b43a092f237 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-02-20Report: add dataTibor Frank3-21/+23
Change-Id: I7387bdea66f8ddc58740908b2c69fc6b27b2b01c Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-02-20Report: Remove NSH_SFCTibor Frank3-5/+4
Change-Id: I639eb5bfbff9a088b0d6b096bd10e82fd0824265 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-02-20CSIT-1438: Remove Denverton from ReportTibor Frank5-43/+8
- The files are kept, what if ... Change-Id: I7533e46e41e3e0a43e3b8e36b07b2f2536002712 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-02-20CSIT-1436: Add titles to plots in TrendingTibor Frank117-2726/+684
CSIT-1435: Remove index from Trending Change-Id: I616b055d7ad12f241df5fa43fb121d20ef7d7e23 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-02-19Report: Add dataTibor Frank4-11/+5
- ligato Change-Id: I52109c8a3a3b94d841f8b3eb12246e17761385ca Signed-off-by: Tibor Frank <tifrank@cisco.com>