aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2017-05-17Fix start-testcase script on VIRLPeter Mikus5-71/+183
- Fix pylint errors - Add expiry option to set expiration of simulation - Add more sanitization of exceptions - Fix printing of debug messages to stderr Change-Id: Iecc1fe042b6da104a164fb5701e665b6f3aa298b Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-05-17Func test reorg - decrease exec time per vpp patchJan Gelety43-63/+74
- remove tests covered by make test - remove some negative tests Change-Id: I35d641562ee85888f7d1dd60dd892689b1e9c52d Signed-off-by: Jan Gelety <jgelety@cisco.com> Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2017-05-17CSIT-576 HC Test: Improve SPAN test coverageselias5-51/+351
- add test for multiple destination interfaces using one source interface - duplicate all existing cases using a sub-interface as the destination Change-Id: Ifabf78bca258247a19624b2b2a0474d21d1229d3 Signed-off-by: selias <samelias@cisco.com>
2017-05-17CSIT-577 HC Test: Scripts for test jobs using ODL clientselias6-38/+511
ODL client can be used to translate Restconf requests into Netconf. This way Honeycomb's Netconf interface can be tested using existing test cases. - add bootstrap scripts for verify and integration job - update __init__.robot to handle new {HC_ODL} variable Change-Id: I7e156dab3d5434dff246bfd02090f3c6bea81b86 Signed-off-by: selias <samelias@cisco.com>
2017-05-17CSIT-562 HC Test: Persistence suite rework, part1selias43-423/+599
- rename keywords that check operational data, to distinguish from keywords that check configuration data - modify existing persistence cases so that they don't affect each other - add feature-specific persistence tests for: Interface Management, L2 bridge - move Interface Management variables to separate file so they can be reused - add new tag HC_PERSIST to execute persistence tests separately - update existing Honeycomb tags to comply with CSIT conventions More feature-specific tests to be added in part2. Change-Id: I8657da4bb9e9a3d5261c04f5f1999b2572f605ef Signed-off-by: selias <samelias@cisco.com>
2017-05-17CSIT-563: HC Test: improved Lisp test coveragejan.hradil9-24/+685
added TC09-TC14 with following features: Map Resolver Map Server PETR configuration RLOC Probing Map Register Map Request mode Change-Id: I0e8a573e9a0f7ef3c688a014ff879e2b3d6b9b1e Signed-off-by: jan.hradil <jan.hradil@pantheon.tech> Signed-off-by: selias <samelias@cisco.com>
2017-05-17Fix: use pci/rescan to avoid occasional bind issue on Centos7Jan Gelety1-1/+7
- rarelly binding of one of TG interfaces fails with "No such device" error; usage of rescan should avoid such situations Change-Id: Icbeb48ea6f8adb863e6517d4a35d6aca4238309a Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-05-16Add RA suppress to IPv6 Equal-cost multipath routing test caseJan Gelety1-0/+1
Change-Id: I9aa7220db01016d553cd389ad4827a3f86da9310 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-05-16Fix typo in weekly bootstrap fileJan Gelety1-1/+1
Change-Id: I2dc221c433ba87d0f98082c0c3aef2df838cd750 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-05-16Add Garbage Cleanning to VIRLPeter Mikus1-0/+20
- add cleaning of old VPP builds (deb|rpm) - add cleaning of old session dirs - add cleaning of old QEMU logs Change-Id: Ib2849cc3969de75525f13d80dc87b32fb82865af Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-05-15Bump to DPDK 1705 vpp2Neale Ranns1-1/+1
Change-Id: I6cc48962433e105c10384faa192d91a2c390011c Signed-off-by: Neale Ranns <nranns@cisco.com>
2017-05-14DPDK version bumpNeale Ranns5-6/+6
Change-Id: Ia89d64a2c985ff949969c406f0e6cea03cc8c170 Signed-off-by: Neale Ranns <nranns@cisco.com>
2017-05-12Fix: SetupFramework sparse file handlingPeter Mikus1-1/+2
- Fix the issue during packing of the framework when source directory contains sparse files. By default tar is throwing warning resulting in return code other then 0. Change-Id: I39a9c1956685158e2e0fd9ef9545f90e3ef2a89f Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-05-11CSIT-574: IPSec Scale File Splitsjan.hradil9-1164/+1452
split file into two separate files based on number of tunnels values 1 or 1000 corrected name errors - scale -> base Change-Id: I7114c777f3cc3d7f4951a1f59e54f3a7bbe404ec Signed-off-by: jan.hradil <jan.hradil@pantheon.tech>
2017-05-10CSIT-573: Split SNAT scale tests to multiple filesjan.hradil8-919/+1269
split file with many test cases into mutliple files based on users and ports added SRC_USER tags removed empty lines at EOF Change-Id: I19c79cdf8d7de4147c98bc061559af1fde10ab8c Signed-off-by: jan.hradil <jan.hradil@pantheon.tech>
2017-05-09csit report - fixed table format in vpp_performance_tests/csit_release_notes.rstMaciek Konstantynowicz1-1/+1
Change-Id: Ie9d4a9ba373c0e6131f0a2d3e49f20a315da3b9a Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2017-05-05HC Test: update routing test keyword due to namespace changesselias1-1/+1
- changed in https://gerrit.fd.io/r/6303 Change-Id: If5fdfcf21c757f9199f168bfd044c7fefce87bef Signed-off-by: selias <samelias@cisco.com>
2017-05-05Use 'Qemu Kill All' in perf test teardownJan Gelety2-4/+4
- replace 'Qemu Kill' KW by 'Qemu Kill All' - use self.qemu_kill_all() in case of qemu_start(self) failure Change-Id: I19d4c64d5daef4f00548344d45f0d4943ca4f7e8 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-05-03HC Test: Update honeycomb suite setupselias4-13/+37
- remove workaround for jVPP version mismatch - increase Java API command timeout Change-Id: Ic6a61ff029cc7cdfec1f75890e18599e3b05f019 Signed-off-by: selias <samelias@cisco.com>
2017-05-03CSIT-566: Use RA suppress in LISP and VXLAN IPv6 related test casesJan Gelety19-0/+25
Change-Id: I788bf465242f5894c65b58f14d2355d29755eda5 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-05-03Update to csit rls1704 report - perf changes tables - based on increased ↵Maciek Konstantynowicz1-12/+12
number of test job executions. Change-Id: I659f7f3da2464081be540c80cb2d71c107455a5e Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2017-05-03Updates to csit rls1704 report related to increased number of test job ↵Maciek Konstantynowicz21-395/+134
executions. Change-Id: If16e312eeb377cabc96fe1a671d9bdfedf5e87b0 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2017-05-03Fix Honeycomb source data path for report.Peter Mikus1-1/+1
Change-Id: Ifcae7625dd2325461f70382439a52d9091d7121c Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-05-03Update links with source data for rls reportPeter Mikus1-65/+65
Change-Id: Ic105fb63f5314da2a30aa1c562e4b98a1bb67788 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-05-03Update data points for rls1704 reportPeter Mikus1-3/+3
Change-Id: Iae8b0833d88d0331f0b8296c79f5267e3a32f53c Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-05-02csit-validate-pylint-master/3731 for build 3731jan.hradil8-36/+29
pylint repairs deleted duplicated method from HcPersistence.py Change-Id: I426e6c15957c995ea10bd11ae2deac75b1cab922 Signed-off-by: jan.hradil <jan.hradil@pantheon.tech>
2017-04-28Fix: VAT timeout in IPv6 scale 2MPeter Mikus2-0/+27
- Fix VAT timeout issue in IPv6 scale testing with 2M FIB entries by increasing heapsize to 3G Change-Id: Ie81619085fbd5a2a86848513d139932a12babf67 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-04-28Update ansible playbooks VIRL setupMatej Klotton2-1/+21
Change-Id: I704991c65dc5fc9ce40ade932cab104fa468696c Signed-off-by: Matej Klotton <mklotton@cisco.com>
2017-04-28csit rls1704: updates to /testpmd_performance_tests/packet_*_graphs files.Maciek Konstantynowicz4-15/+21
Change-Id: I7c9fefd93e768368ac1093ffd4589dcf63a6375c Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2017-04-27Update of VPP_STABLE_VER_UBUNTUJan Gelety1-1/+1
- use new vpp ref build: 17.07-rc0~144-g36c1308~b2247_amd64 - build tested by semiweekly job: https://jenkins.fd.io/view/csit/job/csit-vpp-verify-master-ubuntu1604-semiweekly/31/ Change-Id: Ie1541da709828aebfcbb1068427d9b3f7e97ffc6 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-04-27csit rls1704 report: final update to csit_release_notes.rst, ↵Maciek Konstantynowicz15-53/+95
packet_*_graphs.rst files. Change-Id: I531706f87716a3db8c5417be6ce4933e02e2a622 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2017-04-27Report-gen updatePeter Mikus4-39/+47
- fix header in IPsec sections - fix IP4 regexp to include SNAT - update source data for perf trending - fix rendering of Trex section Change-Id: I20660eb997a33cdca89490f2ef1cd1dcd339ff15 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-04-27csit rls1704 report: updates to csit_release_notes.rst files.Maciek Konstantynowicz2-84/+86
Change-Id: I672beb5e710bcec7aba738efe75e508e9394fafe Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2017-04-26update to csti rls1704 report: vpp_unittest_results.rstMaciek Konstantynowicz1-51/+291
Change-Id: I3af10e3caeaa4150b35a118899e233e33877c673 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2017-04-26Fix: Report table layout in RTD SphinxPeter Mikus1-1/+1
Change-Id: Ibdac46c7ec6d8381da89ea9bb7e407b91c5029df Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-04-26CSIT rls1704 report - small updatesJan Gelety5-20/+22
Change-Id: I80b5aaf2bab77a6131fca8cf4e903ef6aecd1195 Signed-off-by: Jan Gelety <jgelety@cisco.com> Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2017-04-26Edits to csit rls1704 report: vpp_unit_tests sections.Maciek Konstantynowicz2-4/+8
Change-Id: I1eceb766f53c7bd25c791c16b8fbc027009df3f0 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2017-04-26Edits to csit rls1704 report: csit_tag_description.rst.Maciek Konstantynowicz1-2/+5
Change-Id: Iee1b6fd98b73be1821068f08fa469222eb938a32 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2017-04-26csit rls1704 report - updated csit_release_notes.rst and overview.rst files.Maciek Konstantynowicz6-33/+105
Change-Id: I0b5005a4c8dc566e559638d981fb0e8a7b079499 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2017-04-26CSIT rls1704 report - update of functional csit_release_notes.rstJan Gelety1-46/+44
Change-Id: I4c6526ffdfeacdfaa02cd77d862e52cf1ed12714 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-04-26CSIT doc gen: Use html <pre> tag for data from teardown.Jan Gelety1-6/+16
Change-Id: Ie8d856d0a7b90eeecffcb38cd8e8b0647a534d8d Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-04-26Update run_report.sh script for generating reportPeter Mikus11-120/+538
Change-Id: I8ba216fd90285ffef34d255b7a672a4d944caff3 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-04-26Update: report source data linksPeter Mikus1-3/+3
Change-Id: I74b9b1070380dcc5f721d695989f3bd676b6df91 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-04-25CSIT rls1704 report - update of vpp_functional_tests/csit_release_notes.rstJan Gelety1-4/+8
Change-Id: I09a0041de447f18c291163ef26c5cce0f1c94645 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-04-25CSIT rls1704 report - update to vpp_functional_tests/csit_release_notes.rstJan Gelety1-17/+25
Change-Id: I400f49ab5399a83b925fbbe2b52e37fd97f464f0 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-04-25rls1704 report - updated sections:Maciek Konstantynowicz7-163/+193
- vpp_performance_tests/overview.rst - vpp_performance_tests/csit_release_notes - vpp_performance_tests/test_environment - honeycomb_functional_tests/csit_release_notes Change-Id: I047c4934f0de18b3adb5e8ae4b6eb1a270b75cc7 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2017-04-25Fix: CSIT report gen for policerJan Gelety1-1/+1
Change-Id: I45bd6e8099b702965e0d20b44b6e99971f25af53 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-04-25CSIT rls1704 report - update to handcrafted sections:Maciek Konstantynowicz22-1294/+1429
- index.rst - vpp_performance_tests/csit_release_notes - vpp_performance_tests/overview.rst - vpp_performance_tests/packet_throughput_graphs/... - testpmd_performance_tests/csit_release_notes.rst - vpp_functional_tests/csit_release_notes.rst - testpmd_performance_tests/packet_latency_graphs/... - testpmd_performance_tests/packet_throughput_graphs/... Change-Id: I06bd27bc30d06d69873da74756ca586e12e55643 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2017-04-25Vhost testsMatej Klotton8-42/+462
Change-Id: I03722afe13722941e084bc01161f7c2af30e3cb1 Signed-off-by: Matej Klotton <mklotton@cisco.com>
2017-04-25Improve doc in data driven perf testsTibor Frank6-63/+132
Change-Id: I1aed068cfd502d4064be194417e91e0459d25a88 Signed-off-by: Tibor Frank <tifrank@cisco.com>