aboutsummaryrefslogtreecommitdiffstats
path: root/resources
AgeCommit message (Collapse)AuthorFilesLines
2017-10-11CSIT-755: Presentation and analytics layerTibor Frank19-0/+10932
- CSIT-760: Configuration - real example - CSIT-774: Implementation - parse configuration - CSIT-779: Implementation - set environment - CSIT-780: Implementation - download data - CSIT-783: Implementation - debug mode - CSIT-761: Implementation - Data pre-processing - parse input files - CSIT-784: Implementation - Data pre-processing - store the data, access to data - CSIT-789: Implementation - Data pre-processing - extract Documentation of the suite - CSIT-757: Low Level Design - CSIT-788: Implementation - Data pre-processing - extract VAT history and show runtime - CSIT-785: Implementation - Data filtering - CSIT-763: Presentation - tables - CSIT-804: Presentation - files - CSIT-762: Presentation - plots - LLD: API + functional diagram - CSIT-807: Element's models - CSIT-813: Process static content - CSIT-812: Report generation - CSIT-764: Integration to CSIT - CSIT-822: Archiving - CSIT-790: Documentation - configuration od the Input data is the same as for 17.07 report Change-Id: I6fd1eb1df4af99eaf91925282cdee1c892698c59 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-10-09CSIT-775 HC Test: CRUD over IPv6 control-plane interfaceselias7-29/+251
Adds new test suite which accesses Honeycomb's Restconf and Netconf northbound over IPv6. This is done by sending the requests to TG where an IPv4 to IPv6 tunnel is configured to the Honeycomb DUT. Change-Id: I3b7467d8108b0da9756e632851215c66ed41bb61 Signed-off-by: selias <samelias@cisco.com>
2017-10-09FIB table add/deleteNeale Ranns4-21/+24
Change-Id: Icadb4884a1c08a2230fd4692df69310ce382ec94 Signed-off-by: Neale Ranns <nranns@cisco.com>
2017-10-09CSIT-768: Refactor Python container librariesPeter Mikus8-355/+922
CSIT-769: Implement L2 RF keywords for container orchestration Change-Id: I7637d1ecc3a45111522b8d6c578b3f88369aff6b Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-10-05HC Test: remove log check from HC startupselias3-31/+14
- remove log check from "Check Honeycomb Startup State" keyword - fix workaround for ODL startup issue - change log level for HttpRequestError so it doesn't clutter log.html output - update EXPECTED_FAILING tags for plugin-acl and routing suites Change-Id: I7380d24801a6535bdf77505edada39ea2412e833 Signed-off-by: selias <samelias@cisco.com>
2017-10-03HC Test: increase timeout for archiving HC log fileselias3-4/+7
- add timeout parameter to ssh.scp method - increase timeout in "Archive Honeycomb Log" keyword - increase timeout for copying ODL client in setup Change-Id: I9e914d5f439fd14471b10b611efdbb6afada4c6e Signed-off-by: selias <samelias@cisco.com>
2017-09-28HC Test: Fix intermittent failures of HC startupselias7-137/+187
- rework "check Honeycomb startup state" keyword - increase timeout value for startup - add separators to Honeycomb log file between test suites - other minor fixes: - remove usused import from NAT suite - fix loop in ICMPv6 ND proxy traffic script - add teardown to LISP cases - update prerequisites for sub-interface SPAN test Change-Id: I2f714ffc1d2e8435d3abe690d8bd15099e071c9a Signed-off-by: selias <samelias@cisco.com>
2017-09-28FIX: Vhost tests waiting for VirtualEthernet UPPeter Mikus1-6/+0
Due to the change in VPP #8472 When changing the admin state of a vhost-user interface, do not put it in link-up mode if the interface is not actually ready. We have to remove "All Vpp Interfaces Ready Wait" for VirtualEthernet interfaces. Change-Id: I70d60b9f54a75b18b179f3315b636b763962acdd Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-09-27HC Test: update ODL startup in hc2vpp jobsselias5-46/+65
- mountpoint configuration through controller-config is deprecated. Use the new method through odl-netconf-topology feature. Change-Id: I1297622db7ab6a3853b3c97ab7f59c31b4269b6d Signed-off-by: selias <samelias@cisco.com>
2017-09-22CSIT-796: l2bd-memif perf testsJan Gelety2-5/+52
Change-Id: Ic714fa7baec49dcba1a8eb6a578183c6771e3493 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-09-18Ignore unexpected ICMPv6 Neighbor Discovery - Neighbor Solicitation packetsJan Gelety22-424/+631
We need to adapt all functional traffic scripts related to functional IPv6 tests to ingore receiving of unexpected ICMPv6ND_NS (ICMPv6 Neighbor Discovery - Neighbor Solicitation) packets that are sent automatically and we cannot avoid to receive them. The reason is to prevent false negative test results in case of csit functional tests that could block creation of new operational branch (csit weekly jobs), usage of new vpp builds (csit semiweekly jobs) and merging patches - csit as well as vpp. Change-Id: I43c90e7c766762fa769a81661338759a11b401a1 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-09-08CSIT-665: Re-write L1 robot keywords in pythonDasa Simkova8-108/+148
Change-Id: Iddd823375ddd17b9abd5f02ee3aea3bfcb625149 Signed-off-by: Dasa Simkova <dspropagacie@gmail.com>
2017-09-06HC Test: re-enable NSH tests, minor fixesselias4-35/+29
NSH plugin was fixed in https://gerrit.fd.io/r/8218 - updated lispGPE test data - added missing teardown to multi-IP traffic test - marked L2-fib update revert case as failing Change-Id: I5cf8c718e808d5d8cb69e2f769c829c868bf9924 Signed-off-by: selias <samelias@cisco.com>
2017-09-04CSIT-786 L2FIB scale testingPeter Mikus4-0/+438
L2FIB scale testing for 10k, 100k, 1m FIB entries ./l2: 10ge2p1x520-eth-l2bdscale10kmaclrn-ndrpdrdisc.robot 10ge2p1x520-eth-l2bdscale100kmaclrn-ndrpdrdisc.robot 10ge2p1x520-eth-l2bdscale1mmaclrn-ndrpdrdisc.robot 10ge2p1x520-eth-l2bdscale10kmaclrn-eth-2vhostvr1024-1vm-cfsrr1-ndrpdrdisc 10ge2p1x520-eth-l2bdscale100kmaclrn-eth-2vhostvr1024-1vm-cfsrr1-ndrpdrdisc 10ge2p1x520-eth-l2bdscale1mmaclrn-eth-2vhostvr1024-1vm-cfsrr1-ndrpdrdisc Change-Id: I7e3884bd5ab5294c289030a3465ec5b6def83cf7 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-09-03Update T-rex to v2.29Peter Mikus5-5/+5
Change-Id: Id60525182cbe5870f40aebf165e8bd86c101d267 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-08-28FIX: SNAT -> NAT renaming of APIPeter Mikus23-340/+316
- Based on https://gerrit.fd.io/r/#/c/8146/ Change-Id: I774483c7e2b419a9b9b6be78812ecf53a5c91eab Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-08-28Fix: Do not validate LXC imagePeter Mikus1-2/+3
Change-Id: I476f463ad7dd91f1d80a1e4b537a2cb3dd4ddee5 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-08-25Update T-rex to v2.28Peter Mikus5-5/+5
Change-Id: I506589c3785eec3a2eaa9fdb32bfc3375388d6f4 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-08-25HC Test: Disable NSH plugin installation and testsselias2-10/+12
- VPP refuses to start with vpp-nsh-plugin installed Change-Id: If1ca45295c63094d2542fc829b8eae7dc0e4977c Signed-off-by: selias <samelias@cisco.com>
2017-08-16CSIT-777: L2 keywords for MACIP ACL testsJan Gelety3-10/+187
Change-Id: I678d87770405105555ccc30ce0003f704d7ca82e Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-08-16CSIT-770 Installation of prerequisites on physical hostsPeter Mikus3-5/+46
- Update ansible to install kubernetes and docker Change-Id: Ibf57d4fa697f7c9b58f2e4925387b0c4e8b67274 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-08-15HC Test: cleanup test failuresselias1-2/+2
- have unnumbered interface cases use a real interface instead of local0 - add EXPECTED_FAILING tag and Jira link to known failing test cases Change-Id: I8bc0f4a74ea1949289a3f12dd54168acdf9edc39 Signed-off-by: selias <samelias@cisco.com>
2017-08-14CSIT-777: L1 keywords for MACIP ACL testsJan Gelety6-5/+143
Change-Id: I90eb824cbabaaece6798812268177ad9bd4eff65 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-08-10Fix: Memif API changePeter Mikus1-4/+4
Due to changes in API in latest VPP, Memif/LXC test are failing. This patch is supposed to change Memif config in LXC. Change-Id: I5c3844fd7559eba948bcb5619c8969611eb200c2 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-08-09CSIT-611: HC Test: Lisp suite updates + LispGPEselias12-98/+1323
- added LispGPE test suite - added IPv6 tests to Lisp suite - added traffic tests to Lisp suite Change-Id: I3b699149cd73ebf5856072d3f26e98a370dbfc4b Signed-off-by: selias <samelias@cisco.com>
2017-08-07HC Test: test data updates for HC bump to ODL-Carbon dependenciesselias3-4/+4
related Honeycomb change: https://gerrit.fd.io/r/6924 Change-Id: I290a65428c8d64304be6e35dad5d21755a925f86 Signed-off-by: selias <samelias@cisco.com>
2017-08-02Fix: Release report PDF generation bugPeter Mikus1-5/+3
QXcbConnection: Could not connect to display Change-Id: Ie6e99f7dc3a0372768955c28f32c90c542e0be78 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-08-02CSIT-744 Update report content for proper parsingPeter Mikus4-55/+63
Follow the good practices for formatting. Update the content of release report RST files to use the proper directives like :cite:, :footnote:, :abbr:, :captions: etc.With these markings we will be able to format output in proper way and style it in various sphinx output builders. Change-Id: Ibbb538d43c3bd364a6acdcc990097a477f49de00 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-08-01CSIT-699: Add l2bd+dot1q perf testsJan Gelety1-0/+37
Change-Id: I3d8cbb235918331b3c60147f7870a4aa90036748 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-08-01CSIT-727 Add the tcpdump application into the VIRL imagePeter Mikus12-15/+428
- Reqested by TLDK Change-Id: Iac94a946005fe2e919334309c77b8774af1a1573 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-07-31CSIT-618 Add LaTeX support to release reportPeter Mikus5-32/+193
- Add option to generate PDF from release report. - Conditional content - Static plot conversion Change-Id: I7c4f0b41898791d1cab446d0fc3b07220380e1b8 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-07-28HC Test: add mising sudo to ODL client statupselias1-1/+1
Change-Id: I5231cb131f09edc0271c99095aacbf68144e7ded Signed-off-by: selias <samelias@cisco.com>
2017-07-26Add memif to reportTibor Frank1-2/+2
Change-Id: Ie62a4d8b324e6557d9fdf9e37835bb79770bb7e5 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-07-26CSIT-618 Update release report datapointsPeter Mikus1-1/+1
Change-Id: Id1fe7dc826bb22e4267c29cce2a544c314ac0648 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-07-26Fix pylint errorsTibor Frank5-28/+27
Change-Id: I9b8d69978ee35bf7610cdfd372135ce3515eec96 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-07-25report content - honeycomb, part 3selias1-2/+2
Change-Id: Ib87ef43e2ccdcd12b942f623051a4f268dda1a42 Signed-off-by: selias <samelias@cisco.com>
2017-07-25CSIT-618 Release report update VIIIPeter Mikus2-5/+7
Change-Id: Idec390861aa5ac8a1a485d5996fbfef444ac8a29 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-07-25report content - honeycomb, part2selias1-1/+1
Change-Id: I0e49be2c78130b3a289b8d04839ed005b6a5ad7e Signed-off-by: selias <samelias@cisco.com>
2017-07-25Report: Use rounded valuesTibor Frank1-2/+3
Change-Id: I218ea0900ec6f5d3e513f5dfc15f6f4f3db16a66 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-07-25Display "change" in format "xx.x%"Tibor Frank1-2/+2
Change-Id: I79e9abc28926759e3c4ce775ab2afa9fed79a377 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-07-25CSIT-618 Update report data points.Peter Mikus1-1/+1
Change-Id: I9294e81690eabd198fe1b6d4974c5c4186e06d89 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-07-24FIX: Path in run_report.shPeter Mikus1-1/+1
Change-Id: I2341a23b6165d0cec760021980937a3dc8dde7f0 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-07-24FIX: Typo in report_genPeter Mikus2-2/+2
Change-Id: Ia8826ccf79b405d35025e06cafb8a80b877dc77d Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-07-24Report - fix generation of performance improvementsTibor Frank1-1/+1
Change-Id: I93ef628f7abb82b880a02a5deddc36e626389e04 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-07-24FIX: Typo in run_report scriptPeter Mikus1-1/+1
Change-Id: I267b1bcc2aad6ccf1a162376950c27f96de7c03f Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-07-24CSIT-618 Release report update VIIPeter Mikus1-22/+56
Change-Id: Ide7771b59cc3ee7619502a6805c8401528a8c874 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-07-24Static report content - Honeycombselias3-2/+21
Change-Id: I39899747f99684b932bb9c88268391e55b6fc779 Signed-off-by: selias <samelias@cisco.com>
2017-07-24CSIT-726: Automate data collection for csv files for perf improvmentsTibor Frank3-0/+227
Change-Id: Ia161ecf9af94fd7193bba045be56738b323e4e2e Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-07-24CSIT-618 Update plot data pointsPeter Mikus1-1/+1
Change-Id: I07102a162fbaad578b38f77e6069d277bb98517c Signed-off-by: Peter Mikus <pmikus@cisco.com>
2017-07-23CSIT-618 Update plot data points.Peter Mikus1-1/+1
Change-Id: I7d7074af7506c4ec88061360e1cc88cadb52786c Signed-off-by: Peter Mikus <pmikus@cisco.com>