aboutsummaryrefslogtreecommitdiffstats
path: root/resources
AgeCommit message (Collapse)AuthorFilesLines
2017-02-15HC Test: ACL updatesselias9-432/+795
- update low level ACL based on yang model changes - remove ietf-ACL test suite and test data and keywords - add ACL-plugin test suite, test data and keywords The ietf model of ACLs is no longer supported in Honeycomb. It has been replaced by the ACL plugin. Change-Id: Ic2c2a3e11c9717d1d3885275f6b868a0098343f9 Signed-off-by: selias <samelias@cisco.com>
2017-02-15HC Test: Update sNAT tests due to API changesselias2-6/+13
- add protocol value to expected VAT data - add protocol value to snat_static_mapping_dump parser - add temp workaround for returned "error:misc" on Ubuntu14.04 Change-Id: I42776b62b04eac65d03dcae1ec6a386a765b2e52 Signed-off-by: selias <samelias@cisco.com>
2017-02-15HC Test: Add temporary workaround for VAT issues on Ubuntu14.04selias1-0/+18
Some VAT commands return "error:misc" in addition to their normal JSON output. This causes the JSON parser to complain about extra data. Change-Id: I0da9739f371998dd6e2e6d6f70c1e8a3d82b6350 Signed-off-by: selias <samelias@cisco.com>
2017-02-14HC Test: Add branch and os parameters to honeycomb scriptsselias2-6/+34
- partial cherrypick of https://gerrit.fd.io/r/4933 - add OS argument to scripts in preparation for Ubuntu16 and Centos7 Change-Id: I14119703be0f73766a731478e09e0126078f84ba Signed-off-by: selias <samelias@cisco.com>
2017-02-13Introduce simple VAT history per test caseJan Gelety3-3/+102
- print list of VAT commands executed per DUT node during the test case in the func test teardown Change-Id: I18a750ebfb7560eff9f5c4f0826ef84c3f64b4a8 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-02-10CSIT-518: Add testpmd numa awarenessTibor Frank4-97/+162
Change-Id: I982834de1fbe71cf5303808ea58d4b58e530ffcb Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-02-09Upgrade T-rex to newer versionPeter Mikus5-6/+6
Change-Id: I8b918a3c1d8109fb64bfdeec8e5c9afe45a86d21 Signed-off-by: pmikus <pmikus@cisco.com>
2017-02-08csit rls1701 report nits and updates:Maciek Konstantynowicz1-2/+2
- Completed paragraph for each thput and latency graph in report describing: graphs title, x-axis, y-axis, legend. Change-Id: Ia45e2da2623b909123f6b3d4abe65e6caf72e058 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2017-02-07CSIT-517: DPDK initialization and teardownTibor Frank1-10/+14
Change-Id: Iff42549e3be610c88b7a7d5518ef2cbb88c75ed2 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-02-07CSIT doc autogen: Add media wiki formatTibor Frank1-8/+54
Change-Id: I4231cf4f056b2370e0a7a7f8a7267859bbeccd6f Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-02-06Fix: Add apt-get update for report-genPeter Mikus1-1/+2
Change-Id: Id98c370be0a74b16667dd3b43fc44e36c286fdf0 Signed-off-by: pmikus <pmikus@cisco.com>
2017-02-06csit rls1701 report edits:Maciek Konstantynowicz1-10/+10
- simplified section structure for clarity and readability, - updated overview sections, - moved not rls related content from rls_notes to overview sections, - removed section title suffixes: HW, VIRL. - completed vpp_unit_tests and vpp_unittest_results sections. - updated all documentation sections. - updated rls_notes sections for vpp performance and vpp functional. Change-Id: Id2c2abbf9d3531ec9f63ecd353f385a0b55ae1ba Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> Signed-off-by: pmikus <pmikus@cisco.com> Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> Signed-off-by: pmikus <pmikus@cisco.com> Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2017-02-03Revert "Fix: CSIT 1701 report files and script AD1"Peter Mikus1-1/+1
This reverts commit 8e3e798d302bef12d490c2963056bbcceedb8b13. Change-Id: I90c40e51b2f0e364ca33fb92fa36f8cae3e5829c Signed-off-by: pmikus <pmikus@cisco.com>
2017-02-03Fix: CSIT 1701 report files and script AD1Peter Mikus1-1/+1
fix libxslt-dev package Change-Id: I9ee8f23faa3a30a4e5894045b8375f983d05adc1 Signed-off-by: pmikus <pmikus@cisco.com>
2017-02-03CSIT 1701 report files and script AD1pmikus3-66/+49
CSIT 1701 report files and script addendum 1 Edits to correct and align all Overview sub-sections. Updates in Performance CSIT Release Notes - added more NDR and PDR performance changes. Change-Id: I52b6ee89e9c536fb4ab9d30dc27cca8dbdd88a20 Signed-off-by: pmikus <pmikus@cisco.com> Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> Signed-off-by: pmikus <pmikus@cisco.com>
2017-02-03Fix: Timeout during VPP installationPeter Mikus1-2/+2
Increase timeout during installation of VPP packages to 60s. Change-Id: I9384564a45951bbfb648c99f25d8de70b79ab783 Signed-off-by: pmikus <pmikus@cisco.com>
2017-02-03CSIT-516: Add keywords for 2-node topologyTibor Frank3-23/+156
Change-Id: Ib5a1e207f1dec99747329a755c3c365fef4bd64c Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-02-01CSIT 1701 report files and scriptpmikus4-0/+638
Add RST source files and script to generate CSIT 1701 report Change-Id: I4345564547270ba10c64d6beebf2c2b5a83de459 Signed-off-by: pmikus <pmikus@cisco.com> Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> Signed-off-by: pmikus <pmikus@cisco.com>
2017-01-31CSIT doc: Add chapter numberingTibor Frank5-76/+72
Change-Id: I5cdcda0461e6f4bdabd91ea440edf7a71db9afd9 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-01-30HC Test: Fix jvpp workaround for 17.04selias1-2/+2
- original commit at https://gerrit.fd.io/r/4683 Change-Id: I0b2d77f66830fbbc2d27e9015ec67ea9cd9a9885 Signed-off-by: selias <samelias@cisco.com>
2017-01-30Add exception processing to output.xml parserTibor Frank1-21/+42
Change-Id: Ie7d7a004ae540233efcb3c3114d46d40d5d1f07d Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-01-27CSIT-506: HC Test- Update and cleanup all suitesselias10-42/+96
- remove EXPECTED_FAILING tag from IPv4 neighbor, IPv6 address, MTU - fix bridge domain removal with interfaces assigned, it should fail - fix teardown of L2 FIB suite (bridge domain removal, see above) - disable vhost-user "server" test cases (VPP bug) - fix keyword verifying sub-interface state - update ACL test data (yang model changes) - remove EXPECTED_FAILING tag from ACL table removal test - update Jira IDs and comments in failing Lisp test case - remove EXPECTED_FAILING tag from Lisp removal test case - use vhost-user "client" instead of "server" in persistence tests Change-Id: I32eafb6013b4512090c0d9365e10c61029179d49 Signed-off-by: selias <samelias@cisco.com>
2017-01-27HC Test: Workaround for 17.04 jvpp version mismatchselias3-47/+57
- add workaround for mismatched jvpp versions in deb packages - disable NSH_SFC madule and test suite, it depends on outdated jvpp - cleanup package download script used in hc2vpp-csit-verify job Change-Id: I98526baa4de08bbbab2339c9e81f49cd189b57ac Signed-off-by: selias <samelias@cisco.com>
2017-01-27Add Centos specific bootstrap files.Thomas F Herbert3-0/+433
Add download and install script for rpms. Add topology virl file for Centos. Change VPP repo urls for centos. JIRA: CSIT-356 Change-Id: I3a0a88958a712d1b652f19c76e5e1b019796d0ae Signed-off-by: Thomas F Herbert <therbert@redhat.com>
2017-01-26Fix: Display of PDR latencypmikus1-3/+7
Fix the string in PDR latency output Change-Id: I7f244e29015da4e71485e88f2988efa73b6f4853 Signed-off-by: pmikus <pmikus@cisco.com>
2017-01-26CSIT-511: Add script to generate report with TC resultsTibor Frank1-100/+286
Change-Id: Iee1c3310e445487bb216c4e9c6a3bc7ee7879788 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-01-26CSIT-512: Add x710, xl710 l2bd vhost testsTibor Frank1-24/+51
- 10ge2p1x710-eth-l2bdbasemaclrn-eth-2vhost-1vm-ndrdisc - 40ge2p1xl710-eth-l2bdbasemaclrn-eth-2vhost-1vm-ndrdisc Change-Id: I99a70c8fcdfc0fffda96606033ba8752d6c07952 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-01-26CSIT doc gen: remove "package" and change "module" to "suite"Tibor Frank1-5/+5
Change-Id: I36664eb4c1ade7c2c96df457ed939f8681ba2dce Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-01-25Centos 7.3 image Version 1.2 Add dhcp client to VIRL base imageThomas F Herbert4-1/+70
Change-Id: Ibedc2002f26824cc763eb2ff62de09d5f262e0c3 Signed-off-by: Thomas F Herbert <therbert@redhat.com>
2017-01-24CSIT-509: Add perf tests for vlan + l2 + vhostTibor Frank1-2/+82
Change-Id: I65e716b51dd35092c10574ac4580ee4b8bd3b24b Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-01-19Add unified latency output for PDRDISC and NDRDISCpmikus1-5/+7
Add same latency formatting for PDR as for NDR search results. This will help us to parse the data in same way. Change-Id: I3be79cc7623f8c9d39fd44babd252ceec58c114b Signed-off-by: pmikus <pmikus@cisco.com>
2017-01-17Update: robot parser scriptspmikus2-13/+25
Update robot parser script due to new naming and TAG structure Change-Id: I963de747d2c88dadcb2d3fa48747fb2ef1403294 Signed-off-by: pmikus <pmikus@cisco.com>
2017-01-17VIRL test: Replace IP probe for VXLAN testMatej Klotton2-2/+8
Change-Id: Ic16f91beabdc2ac2e19ccc65c04790d36c15d477 Signed-off-by: Matej Klotton <mklotton@cisco.com>
2017-01-13VIRL test: VXLAN-L2BD-vhos_user test (CSIT-500)Jan Gelety2-19/+44
- Create test cases to test VXLAN+L2BD+vhost_user IPv4 and IPv6 scenarios Change-Id: I46d27f22ec2e2e35fd5067ba7eeda9a2ccff9f84 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-01-12Update: plot script for new tagspmikus1-1/+1
Update plot script based on the change in TC TAGS Change-Id: I9412e38d4306b69c75b16943b64b987c2553c167 Signed-off-by: pmikus <pmikus@cisco.com>
2017-01-11 Add the DPDK l2fwd performance test cases.Fangyin Hu6-9/+517
Change-Id: I996847a4871ed994cd9b5edb459fb079ff39c86d Signed-off-by: Fangyin Hu <fangyinx.hu@intel.com>
2017-01-10CSIT-482: HC Test - NATselias8-0/+527
- add NAT test suite - add keywords and methods for configuring and reading NAT settings - add test data used in NAT suite Change-Id: Iaa2ac1eb156bc9bcff41ec242318f6a973210d38 Signed-off-by: selias <samelias@cisco.com>
2017-01-10HC Test: Fix log archiving in honeycomb testsselias1-0/+16
Change-Id: Iad743b3c0e2d1b57e7c6bcae521fe958fbb06ced Signed-off-by: selias <samelias@cisco.com>
2017-01-10Fix: Add prefix to elements of output-perf-xmlpmikus1-1/+1
Robot results parser is using names of suites to create XML with performance data. This patch is supposed to fix the situation when the name of suite starts with digit. This leads to issue that final XML is not valid. Change-Id: I0046da4ff62f661de07f8e659ae511610c8c61f8 Signed-off-by: pmikus <pmikus@cisco.com>
2017-01-10CSIT-499: Perf Tests - VXLAN + L2BD + vhostTibor Frank1-0/+44
- Packet throughput L2BD test cases with VXLANoIPv4 and vhost Change-Id: I6373ef232e5ce7155f8dec80ffa576a6a6b69b81 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-01-04CSIT-498: Packet throughput L2BD with VXLANoIPv4Tibor Frank1-0/+23
- Add performance tests for packet throughput L2BD with VXLANoIPv4 Change-Id: Id0872e1847f5a0e0eb37ba352bf75f56c51c7a45 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-01-04Add Centos 7 image to CSIT.Thomas F Herbert23-0/+1892
JIRA: CSIT-256 JIRA: CSIT-490 libpcap and Qemu version 2.3.0 Centos 7.3 support added from 7.3.1611 base image. Change-Id: Ia4ebe22980206cade4beb87760a455ca18f9fbfc Signed-off-by: Thomas F Herbert <therbert@redhat.com>
2017-01-02CSIT-488 TLDK jbb validation jobs need cmake installedpmikus4-1/+295
Add cmake into VIRL Ubuntu image Change-Id: I2cd33a58c0043a2c3e04809d1f73068520767929 Signed-off-by: pmikus <pmikus@cisco.com>
2016-12-21Fix: Qemu wait_until_vm_bootpmikus1-1/+1
There is an issue that booting Nested VM is successful but QGA guest-ping or flush returns partial response. This fix suppose to do checking until an error or timeout occurs. In case of QGA returns correct response it is success. In case of partial response it will log an error and continue in checking. Change-Id: Idb2c5e5ea54bfc1e118ff62dd15696a1797dfdd9 Signed-off-by: pmikus <pmikus@cisco.com>
2016-12-17Pylint fixesPeter Mikus1-8/+8
- fix Map.py Change-Id: I0241e655df12f8135884e48d14c8eea43c501323 Signed-off-by: pmikus <pmikus@cisco.com>
2016-12-16Fix: CSIT documentation auto generationPeter Mikus1-1/+1
- fix the path error Change-Id: Ia1e491bd9a9f7f803571e8e7309c97fc7f388efc Signed-off-by: pmikus <pmikus@cisco.com>
2016-12-16CSIT Documentation auto generationTibor Frank2-1/+13
- remove all *.rst files in env from build - add ignore list for directories which will not be included in build Change-Id: Ifef18255d366094704041b526d707fdb6fc4567d Signed-off-by: Tibor Frank <tifrank@cisco.com>
2016-12-16CSIT-484: HC Test: Lispselias7-0/+782
- add Lisp test suite - add Lisp test data - add keywords and methods used in Lisp tests Change-Id: Ie7819e20cf48e7dac106d60cce316ce69ab75786 Signed-off-by: selias <samelias@cisco.com>
2016-12-16CSIT-424: HC Test: JSON comparison function reworkselias6-95/+64
When comparing multi-level JSON trees, the exceptions raised carry more useful information. Keys and values not present in reference data are ignored. No longer puts chunks of honeycomb's log file into robot report. The entire log file will be archived after https://gerrit.fd.io/r/4171 Change-Id: Ib597080fa3d9b2c43463c76ee0d52f317ea072e7 Signed-off-by: selias <samelias@cisco.com>
2016-12-16Pylint fixesTibor Frank32-180/+190
- Fix PyLint errors - Fix comments in touched python modules Change-Id: I26db2d292a41969cf38b9b0bdd49c4fb15349102 Signed-off-by: Tibor Frank <tifrank@cisco.com>