aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2019-03-06add vxlan perf test cases for Intel-X553 of Denverton platformYulong Pei2-0/+262
add below vxlan perf test cases for Intel-X553 of Denverton platform, 10ge2p1x553-ethip4vxlan-l2bdbasemaclrn-mrr.robot 10ge2p1x553-ethip4vxlan-l2bdbasemaclrn-ndrpdr.robot Change-Id: Ia0bbdd5d465bd1ac8d9930ac67099c63773a6cef Signed-off-by: Yulong Pei <yulong.pei@intel.com>
2019-03-06add dpdk-plugin for honeycomb download artifactsMichal Cmarada2-2/+2
Change-Id: I90c491e8039b20bbb0ef23bb1912e275030bef0b Signed-off-by: Michal Cmarada <mcmarada@cisco.com>
2019-03-06FIX: Selecting VPP packagesPeter Mikus1-1/+2
There is an issue when multiple VPP versions of same commit but different build is in repository. Artifacts.sh will find multiple version and cennot properly download only one. 00:00:46.522 ++ apt-get -y download libvppinfra=19.04-rc0~290-gd4295e61a~b2173 19.04-rc0~290-gd4295e61a~b2172 19.04-rc0~290-gd4295e61a~b2171 libvppinfra-dev=19.04-rc0~290-gd4295e61a~b2173 19.04-rc0~290-gd4295e61a~b2172 19.04-rc0~290-gd4295e61a~b2171 <truncated...//pm> This patch will select latest as the behavior is result of re-merge effect. Change-Id: I8ce21244e2b05e60af0ea51107f9138173844330 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-03-05CSIT-1362: migrate package download scripts for hc2vpp jobsMichal Cmarada2-101/+142
As part of Bionic update for honeycomb (HC2VPP-372) scripts need to be updated. Switching to Packagecloud instead of nexus simplifies this process. Change-Id: I243367e8c1d7c3de5890d6846c199563cef457bf Signed-off-by: Michal Cmarada <mcmarada@cisco.com>
2019-03-05Report: Add LB DataTibor Frank4-2/+32
- Change the version to 1901.10 Change-Id: I4a976a55b375a00fe3498ef26e676ce9410ff7f2 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-03-04Rename to Constants.pyVratko Polak27-27/+32
Motivation: Make the constants available also for Robot. Restraint: Robotframework user guide says: Because variable files are always imported using a file system path, creating them as classes has some restrictions: Python classes must have the same name as the module they are located. Change-Id: I638ef3fe045db132e366de2e2699638b8637e45e Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-03-01Add ARM Taishan testbed33 perftestStanislav Chlebec53-40/+6218
Change-Id: Iaa0e7fbca7de26c7dce8b389cc3494f628a2ecd0 Signed-off-by: Stanislav Chlebec <stanislav.chlebec@pantheon.tech> Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>
2019-02-26FIX: ipsec + vpp stable version updateJan Gelety18-87/+119
- use exec ipsec sa add - use exec ipsec spd add - use exec set ipsec sa Change-Id: I69d59dd230b99d8efc9bcb5e3fbab79a8b11b18a Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-02-28Report: Remove disabled models from specificationTibor Frank3-3401/+27
Change-Id: Ief23b6c9a2f94af2473772c29bb3c4636ea5a1d5 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-02-27CSIT-1449 Ansible: Adding calibration supportPeter Mikus11-239/+135
- Remove obsolete bootstrap_setup.sh. - Add calibration support into ansible. - Inject Ansible run with calibration to every job. Change-Id: Ib2d6cd0c04d3bce700b205bef34c3c88edb26e28 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-02-27CSIT-1418 Switch performance jobs to VPP-bionic buildPeter Mikus1-10/+3
Change-Id: Ia38e70a418570d168bf330ce1b3c91351b326181 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-02-27Report: Add dataTibor Frank1-10/+100
- Link Bonding, 3n-hsw, 3n-skx Change-Id: Ie10319357d0917baf11f70c5de3ed3deb6c1850b Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-02-27Bash style: Add rules for handling working dirVratko Polak1-0/+94
+ Also added details related to "set -e" and exit codes. Change-Id: I731151efd7facc1def3c8cbba4e466e793c93689 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-02-27Add tox.ini and few checker scriptsVratko Polak14-62/+371
The plan is to change csit-validate-pylint-master job to fail if (and only if) tox fails. This will allow us to easily add checks, with or without the voting power. Each check produces log (ignored in .gitignore) the voting job can archive. + Made autogen quiet by default, to avoid spam in autogen checker. + Unified the way direct csit subdirectories are git-ignored. Change-Id: I6477b1ef7da6d3e30f68c5850d04900cc52f431e Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-02-27Report: Enable pdf versionTibor Frank1-2/+2
Change-Id: I166926bc85d4c7cb708633203e58f68abb6f4e21 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-02-26CSIT-1440: Re-organize graphs in reportTibor Frank4-191/+192
- fixes Change-Id: I4b960651570c9c1174637a8c043f5ced3ce79538 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-02-26FIX: Hardware sections - reportPeter Mikus8-695/+222
Change-Id: I4a64f87fe43eb94841c55d63a7befff0d2c2a477 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-02-26Report: Remove TCP/IPTibor Frank3-3/+11
Change-Id: I9d3c8272654bb5c4c8ebe1a07e9a1d8d9d173407 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-02-26CSIT-1440: Re-organize graphs in reportTibor Frank32-861/+945
- fixes Change-Id: I5e4c1f96ab12b7732f29083ff070861eae984ca6 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-02-26De-duplicate unidirection supportVratko Polak2-346/+106
- Latency is now reported in both directions. -- For unidirection that means additional -1/-1/-1. + Changed function argument wrapping to save vertical space. + Changed trex command synthesys to save vertical space. + Fixed handling of command line arguments to avoid superfluous spaces. + More care distinguishing (0, 1) from (port_0, port_1). - Not renaming the original port arguments. Change-Id: I7b1736b594f6edea52eb07e5bc76ef52d0af92f8 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-02-26CSIT-1440: Re-organize graphs in reportTibor Frank28-2054/+1765
- latency - multi-core Change-Id: I8a0f51d51eb451f3c57c15579b4e775e0bffddab Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-02-26CSIT-1448 Ansible: Clean hugepage configurationPeter Mikus39-102/+388
Change-Id: I1e91d63bb5cd671d2d1d94f8711233bec0fe6505 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-02-25CSIT-1440: Re-organize graphs in reportTibor Frank15-2403/+2054
- Throughput Change-Id: Iab94a7c66d3483707ed99e49489ebf71947a4fca Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-02-25FIX: VPP PIDs can also be separated by spaces not only by line breaksJan Gelety1-6/+4
Change-Id: I6a5e8732be224927aa965cdf6b93998aa8699639 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-02-22CSIT-1437 Create portable host-setup documentPeter Mikus77-1199/+533
- Ansible simplified and optimalized - Porting global variables into single file - Rework the README.md - Tested outside LF environemnt Change-Id: I124cffa5c4510edf365e8b558da0c8c498f55d50 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-02-21Report: Configure for 1901.09Tibor Frank2-2/+2
Change-Id: Ief796f52c15a5c62962a82eea8f740ae17277638 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-02-21Report: Add dataTibor Frank2-3/+14
Change-Id: I9c03434f3f6b7acf22e9a4f58fe32b43a092f237 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-02-20Report: add dataTibor Frank4-22/+28
Change-Id: I7387bdea66f8ddc58740908b2c69fc6b27b2b01c Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-02-20Report: Remove NSH_SFCTibor Frank3-5/+4
Change-Id: I639eb5bfbff9a088b0d6b096bd10e82fd0824265 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-02-20CSIT-1438: Remove Denverton from ReportTibor Frank5-43/+8
- The files are kept, what if ... Change-Id: I7533e46e41e3e0a43e3b8e36b07b2f2536002712 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-02-20Report: Add dataTibor Frank1-6/+13
- ligato Change-Id: I813ccf2528a542d772eccf658f2983af0ce7c303 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-02-20CSIT-1436: Add titles to plots in TrendingTibor Frank121-3780/+1794
CSIT-1435: Remove index from Trending Change-Id: I616b055d7ad12f241df5fa43fb121d20ef7d7e23 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-02-20FIX: Static variables all over the place for per patchPeter Mikus3-16/+31
- Incredible why is it so hard to write scripts not hardcoding anything. Change-Id: I48cf2cc3d25f9665a9ff7ca26756d3b70cdd2f9c Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-02-19CSIT-1419 Convert vpp-virl job to vpp-devicePeter Mikus3-71/+108
Change-Id: I5af6de4b96775a72855e1644ca4d8d9b4b2f9e25 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-02-19Allow more perftest strings in get_test_tag_stringVratko Polak1-4/+9
This is needed to support other TBs in perpatch job. Change-Id: I9de70e818a32fa9990d90cb14498a26570b774a4 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-02-19Ansible testbed setup for Taishan testbedStanislav Chlebec45-92/+245
Change-Id: I4b42aa5bf7635ade95f81c0c92a6ff1bf43d3fa0 Signed-off-by: Stanislav Chlebec <stanislav.chlebec@pantheon.tech> Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>
2019-02-19Adapt autogen for SFd testsVratko Polak79-45/+47
+ Make the skipping logic in autogen more flexible. + Do not emit 4c cases when there is too much VMs/containers. + Peter says the second -eth- should be renamed away from suites. + Regenerate suites so test case names match (new) suite names. Change-Id: I95ecc47ca07b8bae6693d5d4330811ff55672fc4 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-02-19Expose DPDK version into separate Variable filePeter Mikus2-3/+7
Change-Id: If9707297a430285a242c3dae49c216d952a9be12 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-02-19Report: Add dataTibor Frank5-332/+299
- ligato Change-Id: I52109c8a3a3b94d841f8b3eb12246e17761385ca Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-02-19Report: Configure 1901.08Tibor Frank3-3/+19
Change-Id: I00dfd25a369c8b9d86a0ac4eba7ad2efa570b1a4 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-02-18Bash style: Explain some rules for entry and libsVratko Polak1-1/+33
Change-Id: I694ef0c45dfa342651f078d13cc0f7eaaeff82e9 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-02-18Remove unused performance util keywordsVratko Polak1-71/+25
+ Added some TODOs. + Get Frame Size updates: ++ Renamed to Get Average Frame Size. ++ Called by Get Max Rate And Jumbo. ++ Moved to the top. Change-Id: I149831b630d4c0ae098f7189f2231b72c6fb7668 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-02-18Report: Add dataTibor Frank2-200/+219
Change-Id: I0879377a00ce11b092566717408886d82c5de847 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-02-18CSIT-1433: Add data sets to all tablesTibor Frank2-1843/+764
- Improving and simplifying the process of adding new data. Change-Id: I778af0274584b881de4e1f90f63cdc04d1b796bb Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-02-18Doc: Methodology update for /new/ trendingVratko Polak1-54/+68
Change-Id: Ibaf4594589cb7bcf1ad236c99f03a9f18b579a74 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-02-15CSIT-1135: Add bash code style guide documentVratko Polak2-1/+588
- The document is currently an orphan. Change-Id: I37377e2f7b5e928351336bd18ef037da4d3513fa Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-02-15Improve PLRsearch graphical exampleVratko Polak4-2024/+7021
+ Two graphs now. + Larger font in graphs. + More descriptions within graphs. + Text before graphs explaining what is shown. Change-Id: I1da6b55abe7380b61988e03d83f34f7f991085d6 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-02-15Report: Add dataTibor Frank1-0/+4
Change-Id: I8b611488f5ff4395513b33c5f917c4f922f240c1 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-02-14Update soak results pageVratko Polak2-6/+9
+ Link to methodology (instead telling readers to search there). + Explain low amount of test results shown. + Clarify that y-axis shows an estimated interval (not direct measurement). Change-Id: I4d9132fa102624a38d52f0e52dd12e834bd1350f Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-02-14Report: Add dataTibor Frank10-113/+287
Change-Id: I08d4773dadb702179f2ac9cb1a5151476878c261 Signed-off-by: Tibor Frank <tifrank@cisco.com>