aboutsummaryrefslogtreecommitdiffstats
path: root/docs
AgeCommit message (Collapse)AuthorFilesLines
2019-06-03Report: Configure Report 1904.23Tibor Frank1-0/+5
Change-Id: I0f19d4e3bdafbdf1a435436a2f25945c2b45e06e Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-05-24Report: Configure Report 1904.22Tibor Frank1-7/+12
Change-Id: Ic8d5a9a856658a2a2661cae8abd8d3b1127b4ff8 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 260238857d4b9f3aabb474bd78dfeff0e4a37fbc)
2019-05-22Report: Update report historyTibor Frank1-0/+5
Change-Id: I790f5d658472d087cd33b6a08a55620e3e5906e3 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit c7726da44e7ab1cb7d1b1083e02ba54a98ca7b42)
2019-05-17Report: Fix internal links to PLRsearch methodologyVratko Polak3-3/+3
Change-Id: I87b334e9c89b1469112dac4327faaf430c6f846a Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit b297d7fca14caa89c24ff3e34cbe58f40aba7c88)
2019-05-16Improve soak graphs and contentVratko Polak2-5/+7
+ Fix duration, mention number of tests and runs. - Hover information still feels wrong. + Mention "critical rate" instead of "throughput" where possible. + Mention lower bounds are displayed. + Rename "plrsearch_algorithm" label to "PLRsearch". + Because the previous link did not work. Due to underscore? + Rename "SOAK" to "soak" or "Soak" (except when it is a tag). Change-Id: I9c079f8c2e93d96249d4b60893469c9257d4f3db Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit 9a6b6ed77705147032abee3fc98a2f7d370427c0)
2019-05-16CSIT-1488: Add data to the Report 1904Tibor Frank1-0/+3
Change-Id: I7484eeb872cd8fa736421a0ded2fcfffe733051e Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit b659ab3d2638652de0357d29be1ec7704df97555)
2019-05-16Report: Configure 1904.21Tibor Frank1-0/+3
Change-Id: Ib65580067d9c41137293036bbd786e31c2bdf503 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit c653499009183a8431350733df81c4162406f3ab)
2019-05-15Report: Add pdf versionTibor Frank1-7/+9
Change-Id: Idc6936262a968e213f2fafa52adacfee65ad345c Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 619cbff63ab7570bb904acccd627d65f328a1e9a)
2019-05-15PLRsearch methodology: Add graphs with descriptions.Vratko Polak5-6976/+22451
Change-Id: I1acb74c6edb966dcdbbdaf88c05bfde1192bf74b Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit c29fa202d2ce4e4c28c41ab4b6ba2353acf42c92)
2019-05-15Report: update known perf issuesJan Gelety1-0/+6
Change-Id: I83863b6a32a1f4d079e126458ba50a358e8de447 Signed-off-by: Jan Gelety <jgelety@cisco.com> (cherry picked from commit d6756e397a108f971622890b5132cc29ff9e5f65)
2019-05-15Trending: Add IPSECSWTibor Frank3-2/+47
Change-Id: I5437d46759c3fcf9a8f44d02d43a70f3f3b2635d Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 5ec0a299c5f9ad2f4843478db69bc6bbc697b0a2)
2019-05-14CSIT-1504: Soak tests - graphTibor Frank3-8/+28
Change-Id: I8416e28a27c16da76c0ebb94f847539f662229fa Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 0c0cf8698e0852e87feaff3a312916cce68fc482)
2019-05-13CSIT-1500: Add comparison table for SOAK vs NDRPDRTibor Frank2-1/+19
Change-Id: I890b28b7a8c1f60cce4c985ccd94fcdfd3c47d7d Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit db2fcb13bab0085abaaa704e87e345d43734ac86)
2019-05-13Report: Add SOAK TestsTibor Frank3-3/+5
Change-Id: I22eec7cf8ff25958218d4b8ac6bab5a34b2f206c Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 80950e65bd14f6425127f7073b960a1fb2c3c4f7)
2019-05-13CSIT-1488: Add data to the Report 1904Tibor Frank1-1/+5
Change-Id: I6e35ba3a89e02fa1e34e5ef637598cb6e22baaaa Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 36b2dffd55dee362d96aae98d563a0c2b475573e)
2019-05-13Report: Configuration for 1904.20Tibor Frank1-0/+3
Change-Id: I4bbf1ed196947cc290de943b1e39721021d9d7d4 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 9cf8c5c4a70a478c9e74cdec398098fd8138d491)
2019-05-10Update perf release notes 1904Peter Mikus1-4/+7
Change-Id: Ia74d6270ef0b654efb77a369f240e7a9c53156c5 Signed-off-by: Peter Mikus <pmikus@cisco.com> (cherry picked from commit f99ce0d330567ef331f6622559e4561485378f5f)
2019-05-10Report: Hide DMMTibor Frank4-25/+25
Change-Id: Ib1381365b01cecb701a956a22131d2b4fe1a3b60 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 4dc14417a7c412520121178dd184eecaf292c5e1)
2019-05-10report: added missing sub-section header in methodology throughputMaciek Konstantynowicz1-0/+3
Change-Id: Iadeaca5d39be051ef334f98e50a6a17210c503bf Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> (cherry picked from commit c1f2df2b6f3ce5c7bbaef7749a55a79f9607bace)
2019-05-10Update PLRsearch methodology to latest codeVratko Polak1-286/+105
Deleted much of terms and generalized descriptions, added more details on the current implementation. - Still with old graphs Change-Id: I9ba6b40d1d9d36d4f10382f60c756f5bc4708e4d Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit 03363a60e2b38976aba91b110cd2040e1fda2401)
2019-05-10report: edits of methodology mlrsearch sectionMaciek Konstantynowicz2-265/+29
Change-Id: I80b4f8223d2991e258ab422c447bdc09d92c9e9c Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> (cherry picked from commit b4b1c9bf381c1570a15651dfb1997a657cbbcc92)
2019-05-10Report: VPP_func update 2Jan Gelety1-2/+1
Change-Id: I840f61211bd01e26862ae7af40522a82ce8cfb25 Signed-off-by: Jan Gelety <jgelety@cisco.com> (cherry picked from commit 24c3dd59d7a004bc6353e13d750b9ced098cf52d)
2019-05-10Release notes: 1904Peter Mikus1-19/+1
Change-Id: I3b075b210f3e3c126d049799aea15f6b75235677 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-05-10Update release notes 1904Peter Mikus1-11/+20
Change-Id: Ib31d809b2c1741374fe3bd03e21adea6336bc7f5 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-05-10report: further edits of methodology throughput sectionsMaciek Konstantynowicz8-142/+200
Change-Id: I571d1a47743eb31ee10caf3f3336ac7437daf878 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> (cherry picked from commit 342ba492f7066402e35654199193e20135f39b6d)
2019-05-10Report: VPP_func updateJan Gelety1-239/+81
Change-Id: I7d551e4d62b1678347c8c5c08a42201567a497cf Signed-off-by: Jan Gelety <jgelety@cisco.com> (cherry picked from commit 7ea52a880f33af192445b3c67ec66d55e4308153)
2019-05-09Report: hide soak testsTibor Frank2-2/+2
Change-Id: I0c738764aaf16b5858d70d7a9fda6752b912cc01 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit c4f2951030265f6b32e18d44278dbd9f59ae1383)
2019-05-09Report: nfv density graphs - update static contentTibor Frank3-9/+17
Change-Id: Ia271330e86fdba1332bb12890458a953c4e0832c Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit f5319efb9812adee82aecca22ce80a7469752728)
2019-05-09Report: Remove DenvertonTibor Frank13-33/+57
Change-Id: I1c1fa3b466feb24b647255f2b0f70c2cff4cbf0d Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit e0db487320596ce7fbdd29bd121969878297e12a)
2019-05-09Report: Remove LigatoTibor Frank8-18/+17
Change-Id: Ia530ef2fb21968852a5366a1bf1c4d0521002c5b Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 1c207fa820cc52be70737b61090287b0eb7030af)
2019-05-08report: edits to methodology_kvm_vms_vhost_userMaciek Konstantynowicz1-46/+57
Change-Id: Iaa2cd0bbe6171ac800489b897ddae079332b48ee Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> (cherry picked from commit 3a5e059cfbe8961799fb5e89e716c506175332d7)
2019-05-08report: edits of methodology throughput sectionsMaciek Konstantynowicz5-31/+84
Change-Id: I9ed1c2d67bc53f98d36ad17afb9153de5e944b7f Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> (cherry picked from commit cc7a7eea385534107bfdae744797d68782488a5e)
2019-05-07Report: Fix NFV GraphsTibor Frank1-1/+2
Change-Id: If11ed726cb75134c24cde3a752d2e72188bbe3a2 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 06785b385fb4acf5fd5f20ce3ee7a46e0b863c06)
2019-05-06CSIT-1492: Add new NF density tests to reportTibor Frank3-30/+426
Change-Id: Ifdfac80f7fd25124cb08a467329d6c8c525ffc06 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 1f47e6144f553c7fb510c93a5b14b1b4d6c4648a)
2019-05-06Report: Configure the versionTibor Frank1-1/+1
Change-Id: I29240b2286f48cc8027d97c9c1895c51b2a11ca5 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 7d977f33e0e72db063ead4d6c33c213c114e6e26)
2019-05-03report 1904: updated methodology (nfv density, startup.conf) and vpp perf ↵Maciek Konstantynowicz3-35/+36
rls notes Change-Id: If6d24511d5d29dcc25c21437364e0da15af3cca1 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> (cherry picked from commit a8c3f441fa595311f60bcc634a2720f204ced733)
2019-05-03Update KVM methodologyPeter Mikus2-17/+70
Change-Id: I8be9b9295b691a1ec4b810e3a1255ad1bc6947ab Signed-off-by: Peter Mikus <pmikus@cisco.com> (cherry picked from commit 11173c99a4416de8970fe67cef4fff2d9119ef14)
2019-04-30NF density tests with dtc=0.5 and dtcr=2Peter Mikus1-0/+10
Change-Id: Icff556142280ad0b6261e0a2bfb71672ee6b3807 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-04-30Update report static contentPeter Mikus4-45/+38
Change-Id: I8aef71fb2cc09d2c7862884f7ca68c9786ad5165 Signed-off-by: Peter Mikus <pmikus@cisco.com> (cherry picked from commit a611ee796ea6b224018953c276e67900b212dc44)
2019-04-29Report: Configure the versionTibor Frank1-1/+1
Change-Id: I064b16e0a2b7f96e4590622be340ab657d785f16 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit a839a1092c783f0d94f3ab0297505832161cd584)
2019-04-25CSIT-1489: Change graphs to display results by suite generatorTibor Frank29-273/+1195
Change-Id: I00fdc7ce87be5cecf5883ed2c991a8e67efd2e2a Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit cc7ced86fd14dcafc5e6146a2e30e630429e211c)
2019-04-23CSIT-1488: Add data to the Report 1904Tibor Frank1-1/+1
Change-Id: I2ba9eeedf5668b5a99acbe0d26add2aa0a836a9f Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 2ed4d8c5c1b039944335b3113dd053784d64d8b8)
2019-04-18Report: Static contentTibor Frank2-4/+4
Change-Id: If8e2593dcaff368b2c7e191f70bab15e8974bb38 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 012b57e651e4c3fc010dea49235aafd16b3bef66)
2019-04-18CSIT-1487: Configure PAL for the Report 1904Tibor Frank5-13/+15
Change-Id: I4f112693a3b50665a9c53290de42d8e365c6d415 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 3969bc368a73f12ab3550b87ef6102c209c66676)
2019-04-18Add perpatch info to cpta methodologyVratko Polak8-270/+360
Also, split methodology file into multiple, per section. Change-Id: I973b93d1a99205d7adb80996a3657215e05b8985 Signed-off-by: Vratko Polak <vrpolak@cisco.com> (cherry picked from commit 4f2d0c379b50b66e70d9615fc8425cd4772f7738)
2019-04-18CSIT-1482: Change trending graphsTibor Frank6-0/+11
- Change trending graphs to display results when using suite generator Change-Id: I4f822c180f9c206be19a9c75ce105c2225ad9171 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 07111b63caa5f162c0921b5a91a4de2d13505a7d)
2019-04-09Add vagrant setup for testing VPP device locallyLudovit Mikula2-16/+46
Fixed trailing whitespaces Fixed tabs vs. spaces Removed dead code Changed network interface naming Changed default number of retries for VPP startup to 120 Updated number of hugepages during provisioning Externalized CSIT related sysctl settings to 90-csit.conf Removed hardcoded local docker image name. Added new interface required for honeycomb device testing. Change-Id: I5eb38c8b1a4d96e4220dbd2e202e94f1d47e804e Signed-off-by: Ludovit Mikula <ludovit.mikula@pantheon.tech>
2019-04-08Upgrade autogen to NICs and search typesVratko Polak1-0/+28
+ All perf suites updated, as autogen change is backward incompatible. + Only x710 -ndrpdr suites remain in git repository. + Removed retry feature of run_tests. + Renamed topology_type and traffic_type to traffic_profile. + Renamed framesize to frame_size; nic_model to nic_name. + Reordered Variables table to start with nic_name and overhead. + Fixed wrong overhead value in some cbc-sha1 suites. + Fixed some suite tags. ++ Introduced tags to distinguish suites, such as IPSECINT. + Bound crypto hardware to NIC name. + Implemented NIC limit hiding. + Also search and teardown related arguments are now hidden. + Main measurement keywords updated to new arg handling. + Max rate related keywords moved to performance_limits.robot + Teardowns unified. + Generated tests are archived. ++ Generated directory is .gitignore-d. + Regenerator raises an exception on seeing non-compatible suite. ++ Relatively helpful message should be seen in exception. + Suite and template Documentation has generated parts. +- With short NIC names only. + Autogen checker also upgraded. + Tag expressions replaced with long files to ensure analogous tests. Change-Id: I60e9a999187e7da1f60d0eb4fb02afa14682aa46 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-04-05Fixes for Taishan testbedjuraj.linkes2-10/+6
* rename NICs in Taishan testbed to Intel-X520-DA2 * fix testbed NIC selection * remove unnecessary 82599es tests * blacklist unsupported tests on Taishan testbed * lowercase previously created bash local variables Change-Id: I3b7f59e2edc00929fab2f5a0fce483f236f83075 Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>
2019-04-03Change 2 node Denverton testbed descriptionYulong Pei1-4/+5
Change-Id: I09c5ac3c4fe90b1fff46c4211b401daefe40ac31 Signed-off-by: Yulong Pei <yulong.pei@intel.com>