aboutsummaryrefslogtreecommitdiffstats
path: root/resources
AgeCommit message (Collapse)AuthorFilesLines
2017-05-30Do not fail test case when no vpp pid detected in the tear downJan Gelety2-5/+17
- currently when no pid (or more pids) detected in the test case tear down of successfully run test case not only the WARN message is logged but the whole test case is failed - to change this behaviour but keep test case failure if no vpp pid (or more vpp pids) detected in test case setup the low level KW "Get VPP PID" behaviour has been changed to return one or more pids or None w/o raising an error and check has been moved to higher level KW "Save VPP PIDs" - there was added suite name and test case name to WARN message when no pid or more pids detected in the test case tear down Change-Id: I04f8d81c1ca48a1e4a45bd0e58f00d36d51c6933 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-05-28 Add the DPDK l3fwd performance test case.Fangyin Hu3-1/+164
fix some code style issue and rebase the code. change the DPDK l3fwd test case name and rebase the code. fix the pylint errors. change the DPDK version to 17.05 Rebase the code. Fix the l3fwd test code like the l2fwd. Fix the run l3fwd script issues. Rebase the code and review. Fix the l3fwd script issues. verify-perf-dpdk-long Change-Id: I5c5625ebcd5ff16f47fbee361789be3fece1ddbc Signed-off-by: Fangyin Hu <fangyinx.hu@intel.com>
2017-05-25CSIT-597: added additional variables needed for virl host construction.Ed Kern2-20/+19
Also converted ansible_hosts file to utf-8 because the dos format it was in was pissing me off. Change-Id: Ie436f5abc6b397d406efec6e49e0845d915f2310 Signed-off-by: Ed Kern <ejk@cisco.com>
2017-05-25CSIT-612 Report: Minimization of hand-crafted content.Peter Mikus1-5/+27
- replace dynamic text content and links by variables. Change-Id: I1a7ec371fc80af3c9dd416bf91dd2c639097cf1e Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-05-25CSIT-613 Update VIRL ansible filesselias1-8/+4
Update VIRL ansible files Change-Id: Ie64ddb1238888518e9384711669a028097d816af Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-05-25CSIT-597: quotas to default user, use command crudini over ini for : vs = ↵Ed Kern3-101/+108
sep and alternate salt master altered virl.ini for eth0 being on flat port Change-Id: I12dacc32ca3f542f18d4569947123e49d07d74ef Signed-off-by: Ed Kern <ejk@cisco.com>
2017-05-24CSIT-597: revert to old style interface namingEd Kern2-2/+9
Change-Id: I0ae5295fe0bd046e643df2d2abf2b88f76f3179f Signed-off-by: Ed Kern <ejk@cisco.com>
2017-05-23Modify garbage cleaning on VIRLPeter Mikus1-1/+1
Decrease the threshold of old session directories and add cleaning of non-empty directories Change-Id: I77950065e5e09aaaf38cf2d9cb3f4c3f8cdcf58c Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-05-23Upgrade T-rex to version 2.25Peter Mikus5-13/+6
- Upgrade T-rex to v2.25 with multiple bug fixes. Change-Id: Idc422172ce98c37ace7bbbf054a2b024c313bbf7 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-05-22HC Test: Improve logging of Honeycomb and VPP restartselias1-4/+10
Change-Id: I69d73ba3f672af88563715d17c94c73d8d5e7ff2 Signed-off-by: selias <samelias@cisco.com>
2017-05-17CSIT-580: IPSec tests - modifications related to the latest changesTibor Frank1-3/+3
- The startup option 'enable-cryptodev' has been removed and unless not enough cryptodevs are found, DPDK cryptodev will be enabled by default. Change-Id: I19a483435256d8cf4101dc9f10a7c95ed5594e75 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-05-17CSIT-557 HC Test: Fix ODL setup in Honeycomb-odl jobsselias1-2/+2
Change-Id: I917f3bfd9cea043e1bc820536db07697e0d41040 Signed-off-by: selias <samelias@cisco.com>
2017-05-17Fix start-testcase script on VIRLPeter Mikus1-67/+171
- Fix pylint errors - Add expiry option to set expiration of simulation - Add more sanitization of exceptions - Fix printing of debug messages to stderr Change-Id: Iecc1fe042b6da104a164fb5701e665b6f3aa298b Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-05-17CSIT-576 HC Test: Improve SPAN test coverageselias3-17/+179
- add test for multiple destination interfaces using one source interface - duplicate all existing cases using a sub-interface as the destination Change-Id: Ifabf78bca258247a19624b2b2a0474d21d1229d3 Signed-off-by: selias <samelias@cisco.com>
2017-05-17CSIT-577 HC Test: Scripts for test jobs using ODL clientselias3-33/+28
ODL client can be used to translate Restconf requests into Netconf. This way Honeycomb's Netconf interface can be tested using existing test cases. - add bootstrap scripts for verify and integration job - update __init__.robot to handle new {HC_ODL} variable Change-Id: I7e156dab3d5434dff246bfd02090f3c6bea81b86 Signed-off-by: selias <samelias@cisco.com>
2017-05-17CSIT-562 HC Test: Persistence suite rework, part1selias16-135/+234
- rename keywords that check operational data, to distinguish from keywords that check configuration data - modify existing persistence cases so that they don't affect each other - add feature-specific persistence tests for: Interface Management, L2 bridge - move Interface Management variables to separate file so they can be reused - add new tag HC_PERSIST to execute persistence tests separately - update existing Honeycomb tags to comply with CSIT conventions More feature-specific tests to be added in part2. Change-Id: I8657da4bb9e9a3d5261c04f5f1999b2572f605ef Signed-off-by: selias <samelias@cisco.com>
2017-05-17CSIT-563: HC Test: improved Lisp test coveragejan.hradil8-10/+625
added TC09-TC14 with following features: Map Resolver Map Server PETR configuration RLOC Probing Map Register Map Request mode Change-Id: I0e8a573e9a0f7ef3c688a014ff879e2b3d6b9b1e Signed-off-by: jan.hradil <jan.hradil@pantheon.tech> Signed-off-by: selias <samelias@cisco.com>
2017-05-17Fix: use pci/rescan to avoid occasional bind issue on Centos7Jan Gelety1-1/+7
- rarelly binding of one of TG interfaces fails with "No such device" error; usage of rescan should avoid such situations Change-Id: Icbeb48ea6f8adb863e6517d4a35d6aca4238309a Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-05-16Add Garbage Cleanning to VIRLPeter Mikus1-0/+20
- add cleaning of old VPP builds (deb|rpm) - add cleaning of old session dirs - add cleaning of old QEMU logs Change-Id: Ib2849cc3969de75525f13d80dc87b32fb82865af Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-05-12Fix: SetupFramework sparse file handlingPeter Mikus1-1/+2
- Fix the issue during packing of the framework when source directory contains sparse files. By default tar is throwing warning resulting in return code other then 0. Change-Id: I39a9c1956685158e2e0fd9ef9545f90e3ef2a89f Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-05-05HC Test: update routing test keyword due to namespace changesselias1-1/+1
- changed in https://gerrit.fd.io/r/6303 Change-Id: If5fdfcf21c757f9199f168bfd044c7fefce87bef Signed-off-by: selias <samelias@cisco.com>
2017-05-05Use 'Qemu Kill All' in perf test teardownJan Gelety2-4/+4
- replace 'Qemu Kill' KW by 'Qemu Kill All' - use self.qemu_kill_all() in case of qemu_start(self) failure Change-Id: I19d4c64d5daef4f00548344d45f0d4943ca4f7e8 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-05-03HC Test: Update honeycomb suite setupselias3-12/+36
- remove workaround for jVPP version mismatch - increase Java API command timeout Change-Id: Ic6a61ff029cc7cdfec1f75890e18599e3b05f019 Signed-off-by: selias <samelias@cisco.com>
2017-05-03Fix Honeycomb source data path for report.Peter Mikus1-1/+1
Change-Id: Ifcae7625dd2325461f70382439a52d9091d7121c Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-05-03Update links with source data for rls reportPeter Mikus1-65/+65
Change-Id: Ic105fb63f5314da2a30aa1c562e4b98a1bb67788 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-05-03Update data points for rls1704 reportPeter Mikus1-3/+3
Change-Id: Iae8b0833d88d0331f0b8296c79f5267e3a32f53c Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-05-02csit-validate-pylint-master/3731 for build 3731jan.hradil8-36/+29
pylint repairs deleted duplicated method from HcPersistence.py Change-Id: I426e6c15957c995ea10bd11ae2deac75b1cab922 Signed-off-by: jan.hradil <jan.hradil@pantheon.tech>
2017-04-28Update ansible playbooks VIRL setupMatej Klotton2-1/+21
Change-Id: I704991c65dc5fc9ce40ade932cab104fa468696c Signed-off-by: Matej Klotton <mklotton@cisco.com>
2017-04-28csit rls1704: updates to /testpmd_performance_tests/packet_*_graphs files.Maciek Konstantynowicz1-1/+1
Change-Id: I7c9fefd93e768368ac1093ffd4589dcf63a6375c Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2017-04-27Report-gen updatePeter Mikus1-11/+11
- fix header in IPsec sections - fix IP4 regexp to include SNAT - update source data for perf trending - fix rendering of Trex section Change-Id: I20660eb997a33cdca89490f2ef1cd1dcd339ff15 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-04-26Fix: Report table layout in RTD SphinxPeter Mikus1-1/+1
Change-Id: Ibdac46c7ec6d8381da89ea9bb7e407b91c5029df Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-04-26CSIT rls1704 report - small updatesJan Gelety1-1/+1
Change-Id: I80b5aaf2bab77a6131fca8cf4e903ef6aecd1195 Signed-off-by: Jan Gelety <jgelety@cisco.com> Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2017-04-26CSIT doc gen: Use html <pre> tag for data from teardown.Jan Gelety1-6/+16
Change-Id: Ie8d856d0a7b90eeecffcb38cd8e8b0647a534d8d Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-04-26Update run_report.sh script for generating reportPeter Mikus1-89/+103
Change-Id: I8ba216fd90285ffef34d255b7a672a4d944caff3 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-04-26Update: report source data linksPeter Mikus1-3/+3
Change-Id: I74b9b1070380dcc5f721d695989f3bd676b6df91 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-04-25rls1704 report - updated sections:Maciek Konstantynowicz1-1/+1
- vpp_performance_tests/overview.rst - vpp_performance_tests/csit_release_notes - vpp_performance_tests/test_environment - honeycomb_functional_tests/csit_release_notes Change-Id: I047c4934f0de18b3adb5e8ae4b6eb1a270b75cc7 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2017-04-25Fix: CSIT report gen for policerJan Gelety1-1/+1
Change-Id: I45bd6e8099b702965e0d20b44b6e99971f25af53 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-04-25Vhost testsMatej Klotton5-40/+229
Change-Id: I03722afe13722941e084bc01161f7c2af30e3cb1 Signed-off-by: Matej Klotton <mklotton@cisco.com>
2017-04-25Fix: CSIT report gen - teardonw data + run_report.shJan Gelety2-21/+27
Change-Id: Ie846ff0503d14f861738b2753328bb6a64ac8216 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-04-25Update report links to source dataPeter Mikus1-1/+1
Change-Id: Ifd5689eac5251316e24283fb94526ad52567d1ac Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-04-25CSIT doc gen: Add configurations and operational data.Jan Gelety1-4/+186
- vpp perf configurations and operational data - vpp func configurations Change-Id: I634682e55a2862b927546e2657aabb242c730be1 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-04-25CSIT doc gen: Script to get data from teardown.Jan Gelety1-0/+619
- generate rst/html/md/wiki file with required data from teardown per TC - implemented: - VAT command history of all DUTs per TC - ouptup of CLI command "Show Runtime" (VPP operational data) Change-Id: I0771f3e0c20dfff9d00df62bdcc6013a32ef9001 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-04-25CSIT-534 HC Test: policer testsjan.hradil6-0/+431
Added empty lines where needed Repaired Phrasese "Given" --> "And" where necessary in mgmt-cfg-policer-apihc-func.robot Corrected English in mgmt-cfg-policer-apihc-func.robot - in TC07 Documentation Change-Id: Id99d7fd04d8f2dcae1820baa208ce338fad3a290 Signed-off-by: jan.hradil <jan.hradil@pantheon.tech>
2017-04-24Fix: Report generationPeter Mikus2-22/+20
- Add IPsec plots - Fix plots rendering Change-Id: Ie8f5d2fa6724268ac05ed4f6ea53bb7c593f676e Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-04-22Update data source for release reportPeter Mikus1-3/+3
Change-Id: Ifccd3fd895ae52c78b1ae7a6d0d30d9334d30a05 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-04-22Fix typo in run_reportPeter Mikus1-1/+1
Change-Id: Ide358bf67fd70717b7545bdf2a56562169cdef8a Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-04-22Fix run_report.shPeter Mikus1-8/+8
- fix sed delimiter to eliminate / Change-Id: I4d6253d7845937ee452da342819d1c390ca28054 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-04-21Report generation script updatespmikus4-145/+510
- Add new type of throughput plots - Update Sphinx, Sphinx-rtd-theme and Plotly packages - Add auto generation of detailed test results - Small fixes Change-Id: I706777160a7f166e0a335c64428d10cb546fa854 Signed-off-by: pmikus <pmikus@cisco.com> Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-04-21CSIT-561: Add release and version to the headerTibor Frank1-1/+2
Change-Id: I73ca0e924b74a8cc523c00b00a80598e09c8ef43 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-04-21HC Test: update plugin-ACL test suiteselias1-0/+9
- fix variables in routed icmpv6 test case - remove EXPECTED_FAILING tag from IPv6 and ICMPv6 cases - create and use keywords for test teardown Change-Id: I91792b5900015827bc2bcfd138192f972f92df28 Signed-off-by: selias <samelias@cisco.com>