aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2017-02-08csit rls1701 report nits and updates:rls1701Maciek Konstantynowicz15-30/+72
- Completed paragraph for each thput and latency graph in report describing: graphs title, x-axis, y-axis, legend. Change-Id: Ia45e2da2623b909123f6b3d4abe65e6caf72e058 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> (cherry picked from commit 1fcfc9bcc91c9bf9f1ab10fab898efc0d8c1e25f)
2017-02-06Fix: Add apt-get update for report-genPeter Mikus1-1/+2
Change-Id: Id98c370be0a74b16667dd3b43fc44e36c286fdf0 Signed-off-by: pmikus <pmikus@cisco.com> (cherry picked from commit 740d81284695c398a0449ba72a213cd905d9c0a8)
2017-02-06csit rls1701 report edits:Maciek Konstantynowicz76-915/+1351
- simplified section structure for clarity and readability, - updated overview sections, - moved not rls related content from rls_notes to overview sections, - removed section title suffixes: HW, VIRL. - completed vpp_unit_tests and vpp_unittest_results sections. - updated all documentation sections. - updated rls_notes sections for vpp performance and vpp functional. Change-Id: Id2c2abbf9d3531ec9f63ecd353f385a0b55ae1ba Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> Signed-off-by: pmikus <pmikus@cisco.com> Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> Signed-off-by: pmikus <pmikus@cisco.com> Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> (cherry picked from commit da2aa127ee071e37bc4d6060dd39476179e65365)
2017-02-06CSIT 1701 report files and script AD1pmikus26-2209/+2504
CSIT 1701 report files and script addendum 1 Edits to correct and align all Overview sub-sections. Updates in Performance CSIT Release Notes - added more NDR and PDR performance changes. Change-Id: I52b6ee89e9c536fb4ab9d30dc27cca8dbdd88a20 Signed-off-by: pmikus <pmikus@cisco.com> Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> Signed-off-by: pmikus <pmikus@cisco.com> (cherry picked from commit 35e5a327a66c05a3356d214dcfdece59ca725998)
2017-02-02HC Test: Test jobs for 17.01selias3-25/+34
- modify bootstrap and package download scripts to accept branch argument Change-Id: I863fb88cfb72b3375d32fec0d191e06fc0ab85cd Signed-off-by: selias <samelias@cisco.com>
2017-02-01CSIT 1701 report files and scriptpmikus61-0/+16068
Add RST source files and script to generate CSIT 1701 report Change-Id: I4345564547270ba10c64d6beebf2c2b5a83de459 Signed-off-by: pmikus <pmikus@cisco.com> Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> Signed-off-by: pmikus <pmikus@cisco.com> (cherry picked from commit 223a5c2eed4a935b27d390b89aa849a3825d86bb)
2017-01-30Add exception processing to output.xml parserTibor Frank2-23/+43
Change-Id: Ie7d7a004ae540233efcb3c3114d46d40d5d1f07d Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit bfa305de45a6c9ef9a20b08b013699c2832a71ae)
2017-01-27CSIT-506: HC Test- Update and cleanup all suitesselias25-124/+155
- remove EXPECTED_FAILING tag from IPv4 neighbor, IPv6 address, MTU - fix bridge domain removal with interfaces assigned, it should fail - fix teardown of L2 FIB suite (bridge domain removal, see above) - disable vhost-user "server" test cases (VPP bug) - fix keyword verifying sub-interface state - update ACL test data (yang model changes) - remove EXPECTED_FAILING tag from ACL table removal test - update Jira IDs and comments in failing Lisp test case - remove EXPECTED_FAILING tag from Lisp removal test case - use vhost-user "client" instead of "server" in persistence tests Change-Id: I32eafb6013b4512090c0d9365e10c61029179d49 Signed-off-by: selias <samelias@cisco.com>
2017-01-27CSIT-508: Add perf tests for Cisco VIC-1227 L2BDMiroslav Miklus2-0/+294
- 10ge2p1vic1227-eth-l2bdbasemaclrn-ndrdisc Change-Id: Ib0e99f8160ca951b58b0244de88fa587e61bd941 Signed-off-by: Miroslav Miklus <mmiklus@cisco.com> (cherry picked from commit 8aed285bf13782990c97348f30b1b265a48af81f)
2017-01-27CSIT-507: Add perf tests for Cisco VIC-1385 L2BDMiroslav Miklus1-0/+348
- 40ge2p1vic1385-eth-l2bdbasemaclrn-ndrdisc Change-Id: I8e1f49b5d41a81544b8a03dd2d6be98c97b94d28 Signed-off-by: Miroslav Miklus <mmiklus@cisco.com> (cherry picked from commit 62def50b10bda209d4da5ef8cbe171552651460b)
2017-01-26Fix: Display of PDR latencypmikus1-3/+7
Fix the string in PDR latency output Change-Id: I7f244e29015da4e71485e88f2988efa73b6f4853 Signed-off-by: pmikus <pmikus@cisco.com> (cherry picked from commit 95001e8ad4ec76d2a18cd67494a75ac9e2199564)
2017-01-26CSIT-511: Add script to generate report with TC resultsTibor Frank1-100/+286
Change-Id: Iee1c3310e445487bb216c4e9c6a3bc7ee7879788 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 4c7c2be2054c023037ec451a9d040e2b10fe8f0d)
2017-01-26CSIT-512: Add x710, xl710 l2bd vhost testsTibor Frank3-24/+1389
- 10ge2p1x710-eth-l2bdbasemaclrn-eth-2vhost-1vm-ndrdisc - 40ge2p1xl710-eth-l2bdbasemaclrn-eth-2vhost-1vm-ndrdisc Change-Id: I99a70c8fcdfc0fffda96606033ba8752d6c07952 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 9d64f8be1cc66fa60717a5118cd193ae3f8c9089)
2017-01-26csit-func-hc naming changeselias18-86/+86
- change test suite filenames - add numbering to all test cases more details at https://wiki.fd.io/view/CSIT/csit-perf-tc-naming-change Change-Id: I58e6c60f750c07e99c6949d8fe2510780fa9007a Signed-off-by: selias <samelias@cisco.com> (cherry picked from commit 20a24b36a6fc172c209dcc154e138f6e06e85bd5)
2017-01-25Remove _base from test suite dir namesJan Gelety22-1/+1
Change-Id: I4168dc077d2d1a9a9ae9dce4bf17da1be9a1d61d Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-01-25csit-func-tc-naming-change - phase 1Jan Gelety97-3281/+5537
- change of ts directories - change of ts file names - splitting of former files to more files when suitable - more details: https://wiki.fd.io/view/CSIT/csit-perf-tc-naming-change Change-Id: Ifda1038f8323735f86c1be7ba7f93e3fda183618 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-01-24CSIT-509: Add perf tests for vlan + l2 + vhostTibor Frank4-3/+1493
Change-Id: I65e716b51dd35092c10574ac4580ee4b8bd3b24b Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit c232d04e7a5bffb72063240ee7e15967f46c4873)
2017-01-23Update of VPP_STABLE_VERJan Gelety1-1/+1
- use new vpp ref build: 17.01-release_amd64 - build tested by semiweekly job: https://jenkins.fd.io/job/csit-vpp-verify-1701-semiweekly/5/ Change-Id: Iaa8e0cbeb072ea20d390637b66ce7be04d93a45d Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-01-20Mark VXLAN test as non criticalMatej Klotton1-0/+1
Change-Id: I1a788de4106d7e71d8cad6b68759b9a01d21bb4a Signed-off-by: Matej Klotton <mklotton@cisco.com>
2017-01-19Fix: Adjust NDRCHK threshold valuespmikus2-12/+12
Adjust treshold values in NDRCHK tests based on latest data. Change-Id: I10f39b9a1a071bf0b38c91f904361ad7f54ccc92 Signed-off-by: pmikus <pmikus@cisco.com> (cherry picked from commit 7661ed85d1080edf8d0c8711f1fffc5d484ebf06)
2017-01-19Add unified latency output for PDRDISC and NDRDISCpmikus1-5/+7
Add same latency formatting for PDR as for NDR search results. This will help us to parse the data in same way. Change-Id: I3be79cc7623f8c9d39fd44babd252ceec58c114b Signed-off-by: pmikus <pmikus@cisco.com> (cherry picked from commit ac7203cc1104f0e4868c07748d8a6b288182263f)
2017-01-19Renaming of all perf TCs.Tibor Frank55-955/+991
Change-Id: Id71abf4f52d7fc555ed9c3ec19563d54f5db9ec5 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 1c9b487b0d3652e477490eb1237c5870296dc497)
2017-01-18Update: robot parser scriptspmikus2-13/+25
Update robot parser script due to new naming and TAG structure Change-Id: I963de747d2c88dadcb2d3fa48747fb2ef1403294 Signed-off-by: pmikus <pmikus@cisco.com> (cherry picked from commit 6a00ab3009930ba06bb2b28118398d8f232be4b9)
2017-01-17VIRL test: Replace IP probe for VXLAN testMatej Klotton3-2/+12
Change-Id: Ic16f91beabdc2ac2e19ccc65c04790d36c15d477 Signed-off-by: Matej Klotton <mklotton@cisco.com> (cherry picked from commit eb4515115a69f5a3fe9b2fe178110cc5ff78b73a)
2017-01-16Tags for tests with IPSec.Tibor Frank1-0/+24
Change-Id: Ic06bd15de44303f99133fa0df83319b5568b64dd Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 2d7b6c3e4a8d62fb77134292e8b583aaea86dbd1)
2017-01-13Update of VPP_STABLE_VERJan Gelety1-1/+1
- use new vpp ref build: 17.01-rc2~5-g257d5e2~b17_amd64 - build tested by semiweekly job: https://jenkins.fd.io/job/csit-vpp-verify-1701-semiweekly/2/ Change-Id: Ieac1212eab8319ddaaca02d2c33c19245ac215de Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-01-13Change vpp nexus repo url to stable.1701Jan Gelety1-1/+1
Change-Id: I5ef9462ddca5626fe529938d6dd6290e00444cf9 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-01-12Update: plot script for new tagspmikus1-1/+1
Update plot script based on the change in TC TAGS Change-Id: I9412e38d4306b69c75b16943b64b987c2553c167 Signed-off-by: pmikus <pmikus@cisco.com>
2017-01-12CSIT-501: Perf tests re-taggingTibor Frank55-905/+865
- Implement tags introduced by https://gerrit.fd.io/r/#/c/3856/ Change-Id: I59313f43f338e2b4a1ad5caf9521b1a0da84d1d3 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-01-12Clean up bootstrap-verify-perf filepmikus1-57/+2
Remove obsolete code from performance bootstrap file Change-Id: I8486c000ee4049b390017a1bf96459ec9fc828ea Signed-off-by: pmikus <pmikus@cisco.com>
2017-01-11 Add the DPDK l2fwd performance test cases.Fangyin Hu13-33/+1093
Change-Id: I996847a4871ed994cd9b5edb459fb079ff39c86d Signed-off-by: Fangyin Hu <fangyinx.hu@intel.com>
2017-01-11Fix: Crypto-dev TB3 topology changespmikus1-8/+10
- Add crypto device into TB3 topology file - Change the @PCI after new device insertion Change-Id: I7fabe3173506c473982490fe24976b68ab45430c Signed-off-by: pmikus <pmikus@cisco.com>
2017-01-10CSIT-482: HC Test - NATselias9-0/+631
- add NAT test suite - add keywords and methods for configuring and reading NAT settings - add test data used in NAT suite Change-Id: Iaa2ac1eb156bc9bcff41ec242318f6a973210d38 Signed-off-by: selias <samelias@cisco.com>
2017-01-10CSIT-469 Rename performance suitespmikus55-3441/+3941
Rename performance suites and add more TAGS Change-Id: I6a5251bb6e380fe2a47a6ec1c1aeb4a9f70c5ce3 Signed-off-by: pmikus <pmikus@cisco.com>
2017-01-10HC Test: Fix log archiving in honeycomb testsselias1-0/+16
Change-Id: Iad743b3c0e2d1b57e7c6bcae521fe958fbb06ced Signed-off-by: selias <samelias@cisco.com>
2017-01-10Fix: Add prefix to elements of output-perf-xmlpmikus1-1/+1
Robot results parser is using names of suites to create XML with performance data. This patch is supposed to fix the situation when the name of suite starts with digit. This leads to issue that final XML is not valid. Change-Id: I0046da4ff62f661de07f8e659ae511610c8c61f8 Signed-off-by: pmikus <pmikus@cisco.com>
2017-01-10CSIT-499: Perf Tests - VXLAN + L2BD + vhostTibor Frank2-0/+728
- Packet throughput L2BD test cases with VXLANoIPv4 and vhost Change-Id: I6373ef232e5ce7155f8dec80ffa576a6a6b69b81 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-01-09Update of VPP_STABLE_VERJan Gelety1-1/+1
- use new vpp ref build: 17.04-rc0~64-gf952692~b1689_amd64 - build tested by semiweekly job: https://jenkins.fd.io/job/csit-vpp-verify-master-semiweekly/1072/ Change-Id: I6e760f4145ee5c31f34f725c9d9d923575688410 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-01-05Fix pylint messagesPeter Mikus1-2/+2
Change-Id: I78ca27169f7f0fd6d786f222684e4c482ae54a43 Signed-off-by: pmikus <pmikus@cisco.com>
2017-01-04CSIT-498: Packet throughput L2BD with VXLANoIPv4Tibor Frank2-0/+498
- Add performance tests for packet throughput L2BD with VXLANoIPv4 Change-Id: Id0872e1847f5a0e0eb37ba352bf75f56c51c7a45 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-01-04Add Centos 7 image to CSIT.Thomas F Herbert23-0/+1892
JIRA: CSIT-256 JIRA: CSIT-490 libpcap and Qemu version 2.3.0 Centos 7.3 support added from 7.3.1611 base image. Change-Id: Ia4ebe22980206cade4beb87760a455ca18f9fbfc Signed-off-by: Thomas F Herbert <therbert@redhat.com>
2017-01-02Update of VPP_STABLE_VERJan Gelety1-1/+1
- use new vpp ref build: 17.04-rc0~25-gfdc62ab~b1650_amd64 - build tested by semiweekly job: https://jenkins.fd.io/job/csit-vpp-verify-master-semiweekly/1070/ Change-Id: I7eadc339053cfeff99103308660933eb3362f046 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-01-02CSIT-488 TLDK jbb validation jobs need cmake installedpmikus8-5/+299
Add cmake into VIRL Ubuntu image Change-Id: I2cd33a58c0043a2c3e04809d1f73068520767929 Signed-off-by: pmikus <pmikus@cisco.com>
2016-12-21Fix: Qemu wait_until_vm_bootpmikus1-1/+1
There is an issue that booting Nested VM is successful but QGA guest-ping or flush returns partial response. This fix suppose to do checking until an error or timeout occurs. In case of QGA returns correct response it is success. In case of partial response it will log an error and continue in checking. Change-Id: Idb2c5e5ea54bfc1e118ff62dd15696a1797dfdd9 Signed-off-by: pmikus <pmikus@cisco.com>
2016-12-19Update of VPP_STABLE_VERJan Gelety1-1/+1
- use new vpp ref build: 17.01-rc0~256-gbd6462e~b1592_amd64 - build tested by semiweekly job: https://jenkins.fd.io/job/csit-vpp-verify-master-semiweekly/1065/ Change-Id: I70019095a41c5e8bc8a15c472c608b77124cbe7f Signed-off-by: Jan Gelety <jgelety@cisco.com>
2016-12-17Pylint fixesPeter Mikus1-8/+8
- fix Map.py Change-Id: I0241e655df12f8135884e48d14c8eea43c501323 Signed-off-by: pmikus <pmikus@cisco.com>
2016-12-16Fix: CSIT documentation auto generationPeter Mikus1-1/+1
- fix the path error Change-Id: Ia1e491bd9a9f7f803571e8e7309c97fc7f388efc Signed-off-by: pmikus <pmikus@cisco.com>
2016-12-16HC Test: Add EXPECTED_FAILING tag to expected test faluresselias3-3/+6
Change-Id: Ic197001f2bb5ad5be9246025502d49e90e0c44aa Signed-off-by: selias <samelias@cisco.com>
2016-12-16CSIT Documentation auto generationTibor Frank2-1/+13
- remove all *.rst files in env from build - add ignore list for directories which will not be included in build Change-Id: Ifef18255d366094704041b526d707fdb6fc4567d Signed-off-by: Tibor Frank <tifrank@cisco.com>
2016-12-16CSIT-484: HC Test: Lispselias8-0/+941
- add Lisp test suite - add Lisp test data - add keywords and methods used in Lisp tests Change-Id: Ie7819e20cf48e7dac106d60cce316ce69ab75786 Signed-off-by: selias <samelias@cisco.com>