aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2017-04-26CSIT rls1704 report - update of vpp_functional_tests/csit_release_notes.rstJan Gelety1-7/+6
Change-Id: I09a0041de447f18c291163ef26c5cce0f1c94645 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-04-26rls1704 report - updated sections:Maciek Konstantynowicz7-163/+193
- vpp_performance_tests/overview.rst - vpp_performance_tests/csit_release_notes - vpp_performance_tests/test_environment - honeycomb_functional_tests/csit_release_notes Change-Id: I047c4934f0de18b3adb5e8ae4b6eb1a270b75cc7 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2017-04-25Fix: CSIT report gen for policerJan Gelety1-1/+1
Change-Id: I45bd6e8099b702965e0d20b44b6e99971f25af53 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-04-25CSIT rls1704 report - update to handcrafted sections:Maciek Konstantynowicz22-1294/+1429
- index.rst - vpp_performance_tests/csit_release_notes - vpp_performance_tests/overview.rst - vpp_performance_tests/packet_throughput_graphs/... - testpmd_performance_tests/csit_release_notes.rst - vpp_functional_tests/csit_release_notes.rst - testpmd_performance_tests/packet_latency_graphs/... - testpmd_performance_tests/packet_throughput_graphs/... Change-Id: I06bd27bc30d06d69873da74756ca586e12e55643 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> (cherry picked from commit 02f2a2176ec92efdf63399fb7dba1eb586465f38)
2017-04-25Improve doc in data driven perf testsTibor Frank6-63/+132
Change-Id: I1aed068cfd502d4064be194417e91e0459d25a88 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit f496b8dd088f9ba89710b8b6f8d0fb380740458f)
2017-04-25Fix: CSIT report gen - teardown data + run_report.shJan Gelety2-21/+27
Change-Id: Ie846ff0503d14f861738b2753328bb6a64ac8216 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-04-25CSIT doc gen: Add configurations and operational data.Jan Gelety6-3/+269
- vpp perf configurations and operational data - vpp func configurations Change-Id: I634682e55a2862b927546e2657aabb242c730be1 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-04-25CSIT doc gen: Script to get data from teardown.Jan Gelety1-0/+619
- generate rst/html/md/wiki file with required data from teardown per TC - implemented: - VAT command history of all DUTs per TC - ouptup of CLI command "Show Runtime" (VPP operational data) Change-Id: I0771f3e0c20dfff9d00df62bdcc6013a32ef9001 Signed-off-by: Jan Gelety <jgelety@cisco.com> (cherry picked from commit 589601a406783d90ba0668428f1a96da1ec9fecb)
2017-04-251704 report - fix mistake in honeycomb sectionselias1-1/+1
Change-Id: I6517ea48a6df95cc855596843d736658471486ea Signed-off-by: selias <samelias@cisco.com>
2017-04-251704 Report - Honeycomb sectionselias3-28/+62
Change-Id: I8006cf8187f943b8d880c8193b6b1bde25ad343c Signed-off-by: selias <samelias@cisco.com>
2017-04-25HC Test: add expected_failing tag to "disable_lisp" caseselias1-0/+2
Change-Id: I614dea8d830e8bf97ac4b4ad24d21d3b707fae8a Signed-off-by: selias <samelias@cisco.com>
2017-04-24Download the latest VPP build for *NIGHTLY and *DAILY jobsTibor Frank1-1/+3
Change-Id: I15755c9fc5f95497c84a20d83c3dabddf53c2225 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit e96838cfbc9a742a7c543a1b88a2d4d2eaf5d08b)
2017-04-24Fix: Report vhost and testpmd plotsPeter Mikus4-227/+256
Change-Id: Iaf41d9132a52e1d4e199bba31abedba66143bfc7 Signed-off-by: Peter Mikus <pmikus@cisco.com> (cherry picked from commit 77053a6017391491dcd3a41ca7a9451ab3d5944a)
2017-04-24Fix: Report generationPeter Mikus18-59/+275
- Add IPsec plots - Fix plots rendering Change-Id: Ie8f5d2fa6724268ac05ed4f6ea53bb7c593f676e Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-04-24CSIT-554: Performance jobs reorganisation, part 4Tibor Frank1-0/+48
Add: - vpp-csit-verify-hw-perf Change-Id: Ia6b4773256b78ce26c0ef29e70964966f3b901ca Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit bc26996dcd0e92af29e5208cbcecd8d347cf1210)
2017-04-24CSIT-557: Performance jobs reorganisation, part 3Tibor Frank10-8/+76
Add: - csit-vpp-perf-verify Change-Id: Ifc97228f5066f5a2ab3404b9b62d09b49af3f061 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 7a52c16bc35b6abfd0cfacbc6be79b38ee467367)
2017-04-24Fix: tc02-64B-1t1c-eth-l2xcbase-eth-4vhost-2vm-pdrdiscPeter Mikus1-0/+1
- Fix missing keyword Change-Id: Iea1fa4e389f87113b205f53d0f57cbb05fcbff0a Signed-off-by: Peter Mikus <pmikus@cisco.com> (cherry picked from commit 3305d93551d0cc861558da09a26c8103453d9d6c)
2017-04-23Fix typo in run_reportPeter Mikus1-1/+1
Change-Id: Ide358bf67fd70717b7545bdf2a56562169cdef8a Signed-off-by: Peter Mikus <pmikus@cisco.com> (cherry picked from commit 4f569f553c9cd30922292b644f4c2bab40e9dd5c)
2017-04-23Fix LISPGPE+IPSEC after cherry picksPeter Mikus1-16/+62
Change-Id: Iacf4412f97092faf791854afb7fb726838febb2b Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-04-22Fix run_report.shPeter Mikus1-8/+8
- fix sed delimiter to eliminate / Change-Id: I4d6253d7845937ee452da342819d1c390ca28054 Signed-off-by: Peter Mikus <pmikus@cisco.com> (cherry picked from commit 00a0cdaeb8cd186f5bd0f7ead5b60c6d49a4929f)
2017-04-22Report generation script updatespmikus12-4862/+590
- Add new type of throughput plots - Update Sphinx, Sphinx-rtd-theme and Plotly packages - Add auto generation of detailed test results - Small fixes Change-Id: I706777160a7f166e0a335c64428d10cb546fa854 Signed-off-by: pmikus <pmikus@cisco.com> Signed-off-by: Peter Mikus <pmikus@cisco.com> (cherry picked from commit 5b702673375a2a098311c23ab83487d3e1e02e72)
2017-04-21Added Ethernet frame size tags for performance tests:Maciek Konstantynowicz73-1060/+1067
- 64B, 78B, IMIX, 1460B, 1480B, 1514B, 1518B, 9000B. Change-Id: I007928855ed05ac2e3aca02298b9436b9b6becdc Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2017-04-21tag_documentation.rst - added:Maciek Konstantynowicz1-0/+16
- Ethernet frame size tags for performance tests: 78B, 1460B, 1480B, 1514B. Change-Id: Ifed47794cac3f7cf9d0d6315901fe47233ffc46e Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> (cherry picked from commit 60ea1ed962e27f0043509747407a61ec817d4760)
2017-04-21tag_documentation.rst - added: Ethernet frame size tags for performance testsMaciek Konstantynowicz1-4/+22
Change-Id: I65c967d0daf87a6a21e7000d2aea24f278fe5281 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> (cherry picked from commit 2c1706d69455d8479b0b0318d4c2fa8b4ab806cb)
2017-04-21CSIT rls1704 report - update to handcraftec sections:Maciek Konstantynowicz28-813/+224
- introduction /overview /general_notes /csit_test_naming - vpp_performance_tests /overview /csit_release_notes /test_environment /documentation /xx_graphs - vpp_functional_tests /overview /csit_release_notes /documentation - testpmd_performance_tests /overview /csit_release_notes /test_environment /documentation /xx_graphs Change-Id: I10593d4155edc663ca07ae5cd29eb679c5f5d85f Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> (cherry picked from commit 5d294b7d4c501d971d67c4e3fe192a9dc504d76e)
2017-04-21CSIT-561: Add release and version to the headerTibor Frank1-1/+2
Change-Id: I73ca0e924b74a8cc523c00b00a80598e09c8ef43 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit bc2036f4ce9b8aa705161ee1c8566b134fc6570c)
2017-04-20HC Test: update persistence suiteselias3-5/+46
- fix "enable persistence" is suite setup - update Jira links to persistence bug - log content of persistence file before each restart Change-Id: I68ad759ded5d6bee277cf946953c11f19628a9e7 Signed-off-by: selias <samelias@cisco.com> (cherry picked from commit 6a4018c9d8b356bc55af135d68803a08729d0ae1)
2017-04-19CSIT-561: Add filtering of testsuits to report generationTibor Frank1-6/+30
Change-Id: I751600f7ea9937bc8bfde7d6062eeaadf3ee68dd Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit c46911d3ee7b11af9b88cf235ce06f8fb24554fc)
2017-04-19CSIT-559: Performance jobs reorganisation, part 3Tibor Frank1-0/+8
Add: - csit-vpp-perf-ndrchk-daily Change-Id: I4edfa86810744168307d9cbeb979d40dc5e21eb0 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 25b577d61445aa0607725a0172b72b5c01582b73)
2017-04-19CSIT-558: Performance jobs reorganization, part 2Tibor Frank1-2/+26
Add: - csit-vpp-perf-check Change-Id: I31e40d37e38d27d3be15a40f6044ce5d907067be Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 47a843ce28984d752dff064afb78c91f18741611)
2017-04-19Use QEMU virtio queue size 1024 for perf testsJan Gelety16-262/+10
- use Build QEMU KW to apply patch to increase default virtio queue size - remove Set Scheduler Policy Change-Id: I04a7febd6366abd324d42f781645a8a0b520b325 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-04-19Fix: IPSec+Lisp suite namingPeter Mikus1-0/+363
Change-Id: I9d5fbffbdfa257354104cd01818223ab2db229f8 Signed-off-by: Peter Mikus <pmikus@cisco.com> (cherry picked from commit 0284cfd6ae5dbd98e94d457b444746ed828b3901)
2017-04-19CSIT-531: Performance jobs reorganization, part 1Tibor Frank1-5/+17
Add: - csit-vpp-perf-trend-daily - csit-vpp-perf-trend-semiweekly Change-Id: I59ed581f9fb2457cf1e3a58bac625f3b807d653f Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 65765ab9f038aed6729fd436e6af6d3ca339e0d8)
2017-04-19CSIT-560: csit src code doc generation for 1704Tibor Frank1-4/+8
Change-Id: I9f07f326e12942404d670004bb9463039967f954 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 38ac6262bcd8dcf2d9a600188c7adb5989ff86b8)
2017-04-18Remove the tag THIS from SNAT perf testsTibor Frank2-2/+2
Change-Id: I54ac114b72763bbf1d2dd57956c0a6f99af82da1 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 928c10f757eeb9df8eb78c6c4ad026b62f792962)
2017-04-18CSIT-545: Performance tests for SNATTibor Frank17-47/+1891
- High level definition (HLD) - Low level definition (LLD) - Add keywords to set SNAT - Add tests according to HLD, LLD Change-Id: I7bf0b1870ac9c3adb36bb6590be9a3eb4ea8aa9a Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-04-13HC Test: update honeycomb package download scriptsselias2-13/+25
- add "_amd64" to version parameter for .deb packages - install only vpp-api-java on maven build slave Change-Id: Ie61974c3c2806d1d3e0281bd0b5149f1b0d1443d Signed-off-by: selias <samelias@cisco.com>
2017-04-12Updated of DPDK stable version.Jan Gelety1-1/+1
Change-Id: Id122bda1489dab763d58cf0b31f222af16ee2651 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-04-12Settings of URLs and VPP builds for branch rls1704Jan Gelety5-5/+5
Change-Id: I6b3dc77c1a064f015e934e537728d6678ae1cfc0 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-04-12CSIT-544 HC Test: adapt package download script to changes in hc2vppselias2-17/+63
Required after https://gerrit.fd.io/r/5908 hc2vpp packages to be published with a specific VPP version dependency. Change-Id: I9a31a83ec033a01556b4afd8575d8ccae4139b7f Signed-off-by: selias <samelias@cisco.com>
2017-04-12HC Test: update URL paths with ODL mountpointselias5-5/+5
other minor fixes: - update teardown keyword in proxyARP suite - increase timeout for SLAAC traffic test Change-Id: Ia16d096c54ceac501a24d5d910dd18e33d900d2a Signed-off-by: selias <samelias@cisco.com>
2017-04-11CSIT-529 HC Test: SLAACjan.hradil5-0/+364
Change-Id: I14525a36d614372b7b418f1c10f95c371b7b8545 Signed-off-by: jan.hradil <jan.hradil@pantheon.tech>
2017-04-10Don't use dpdk dev packages - weekly, func and perf jobsJan Gelety3-10/+5
- remove donwload and installation of DPDK development packages - keep download and installation of vpp-dpdk-dkms deb package that contains igb_uio driver needed for e.g. cryptodev tests Change-Id: I3d87fa1cd1efaad522f47df0e71a4885466a14c0 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-04-10HC Test: Fix proxyARP test teardownselias2-3/+1
- interface assignment is removed automatically with proxyARP settings Change-Id: Id0c7e8fd9cbb263e547ac5e2534f3e650115cb81 Signed-off-by: selias <samelias@cisco.com>
2017-04-10Update of VPP_STABLE_VER_UBUNTUJan Gelety1-1/+1
- use new vpp ref build: 17.07-rc0~81-gd927834~b2184_amd64 - build tested by semiweekly job: https://jenkins.fd.io/view/csit/job/csit-vpp-verify-master-ubuntu1604-semiweekly/26/ Change-Id: I96684c6b17a4bb64b4070e440150ff4cac9a57a9 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-04-10IPsec Multi-Tunnel performance test suiteKirill Rybalchenko14-18/+3355
Change-Id: I4b0ba83960e50089f29cab9a30ab760241c6f566 Signed-off-by: Kirill Rybalchenko <kirill.rybalchenko@intel.com>
2017-04-09CSIT-441 vhost - Parametrized qemu installpmikus5-44/+118
Update the current QEMU installation script with option to override QEMU installation and to apply additional patches. Additional patches are applied from qemu_patches directory and subdir for specific QEMU version by run-parts. This means that all patches for particular version are applied. All keywords for build QEMU are updated. Change-Id: I0c874a96ac828dff657ee33eb87d88a8854128ad Signed-off-by: pmikus <pmikus@cisco.com>
2017-04-07CSIT-553 Make QEMU bin configurablepmikus3-11/+29
Add option to set path for QEMU binary and make it configurable in perf testaces as global variable. Change-Id: I95f4b1ab790b576f1eca02ccdb86f7a6ced80630 Signed-off-by: pmikus <pmikus@cisco.com>
2017-04-07HC Test: update ACL-plugil test suiteselias1-4/+12
- add EXPECTED_FAILING tags to IPv6 cases, next-header 17 (UDP) does not hit the classify node - fix MAC address mixup in reflexive cases Change-Id: I3d2a6c73835e23b6755b033ac3a0cc3f28d932df Signed-off-by: selias <samelias@cisco.com>
2017-04-06CSIT-552: Add xl710 perf test with 2 VMs per DUTJan Gelety3-0/+1812
- 40ge2p1xl710-eth-l2bdbasemaclrn-eth-4vhost-2vm-ndrpdrdisc - 40ge2p1xl710-eth-l2xcbase-eth-4vhost-2vm-ndrpdrdisc - 40ge2p1xl710-ethip4-ip4base-eth-4vhost-2vm-ndrpdrdisc Change-Id: I2d2f8e9b8966bd6e19014cf7a234c3c02bb9251c Signed-off-by: Jan Gelety <jgelety@cisco.com>