aboutsummaryrefslogtreecommitdiffstats
path: root/resources
AgeCommit message (Collapse)AuthorFilesLines
2017-02-08csit rls1701 report nits and updates:rls1701Maciek Konstantynowicz1-2/+2
- Completed paragraph for each thput and latency graph in report describing: graphs title, x-axis, y-axis, legend. Change-Id: Ia45e2da2623b909123f6b3d4abe65e6caf72e058 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> (cherry picked from commit 1fcfc9bcc91c9bf9f1ab10fab898efc0d8c1e25f)
2017-02-06Fix: Add apt-get update for report-genPeter Mikus1-1/+2
Change-Id: Id98c370be0a74b16667dd3b43fc44e36c286fdf0 Signed-off-by: pmikus <pmikus@cisco.com> (cherry picked from commit 740d81284695c398a0449ba72a213cd905d9c0a8)
2017-02-06csit rls1701 report edits:Maciek Konstantynowicz1-10/+10
- simplified section structure for clarity and readability, - updated overview sections, - moved not rls related content from rls_notes to overview sections, - removed section title suffixes: HW, VIRL. - completed vpp_unit_tests and vpp_unittest_results sections. - updated all documentation sections. - updated rls_notes sections for vpp performance and vpp functional. Change-Id: Id2c2abbf9d3531ec9f63ecd353f385a0b55ae1ba Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> Signed-off-by: pmikus <pmikus@cisco.com> Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> Signed-off-by: pmikus <pmikus@cisco.com> Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> (cherry picked from commit da2aa127ee071e37bc4d6060dd39476179e65365)
2017-02-06CSIT 1701 report files and script AD1pmikus3-66/+49
CSIT 1701 report files and script addendum 1 Edits to correct and align all Overview sub-sections. Updates in Performance CSIT Release Notes - added more NDR and PDR performance changes. Change-Id: I52b6ee89e9c536fb4ab9d30dc27cca8dbdd88a20 Signed-off-by: pmikus <pmikus@cisco.com> Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> Signed-off-by: pmikus <pmikus@cisco.com> (cherry picked from commit 35e5a327a66c05a3356d214dcfdece59ca725998)
2017-02-02HC Test: Test jobs for 17.01selias2-23/+30
- modify bootstrap and package download scripts to accept branch argument Change-Id: I863fb88cfb72b3375d32fec0d191e06fc0ab85cd Signed-off-by: selias <samelias@cisco.com>
2017-02-01CSIT 1701 report files and scriptpmikus4-0/+638
Add RST source files and script to generate CSIT 1701 report Change-Id: I4345564547270ba10c64d6beebf2c2b5a83de459 Signed-off-by: pmikus <pmikus@cisco.com> Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com> Signed-off-by: pmikus <pmikus@cisco.com> (cherry picked from commit 223a5c2eed4a935b27d390b89aa849a3825d86bb)
2017-01-30Add exception processing to output.xml parserTibor Frank1-21/+42
Change-Id: Ie7d7a004ae540233efcb3c3114d46d40d5d1f07d Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit bfa305de45a6c9ef9a20b08b013699c2832a71ae)
2017-01-27CSIT-506: HC Test- Update and cleanup all suitesselias10-42/+96
- remove EXPECTED_FAILING tag from IPv4 neighbor, IPv6 address, MTU - fix bridge domain removal with interfaces assigned, it should fail - fix teardown of L2 FIB suite (bridge domain removal, see above) - disable vhost-user "server" test cases (VPP bug) - fix keyword verifying sub-interface state - update ACL test data (yang model changes) - remove EXPECTED_FAILING tag from ACL table removal test - update Jira IDs and comments in failing Lisp test case - remove EXPECTED_FAILING tag from Lisp removal test case - use vhost-user "client" instead of "server" in persistence tests Change-Id: I32eafb6013b4512090c0d9365e10c61029179d49 Signed-off-by: selias <samelias@cisco.com>
2017-01-26Fix: Display of PDR latencypmikus1-3/+7
Fix the string in PDR latency output Change-Id: I7f244e29015da4e71485e88f2988efa73b6f4853 Signed-off-by: pmikus <pmikus@cisco.com> (cherry picked from commit 95001e8ad4ec76d2a18cd67494a75ac9e2199564)
2017-01-26CSIT-511: Add script to generate report with TC resultsTibor Frank1-100/+286
Change-Id: Iee1c3310e445487bb216c4e9c6a3bc7ee7879788 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 4c7c2be2054c023037ec451a9d040e2b10fe8f0d)
2017-01-26CSIT-512: Add x710, xl710 l2bd vhost testsTibor Frank1-24/+51
- 10ge2p1x710-eth-l2bdbasemaclrn-eth-2vhost-1vm-ndrdisc - 40ge2p1xl710-eth-l2bdbasemaclrn-eth-2vhost-1vm-ndrdisc Change-Id: I99a70c8fcdfc0fffda96606033ba8752d6c07952 Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit 9d64f8be1cc66fa60717a5118cd193ae3f8c9089)
2017-01-25csit-func-tc-naming-change - phase 1Jan Gelety1-18/+42
- change of ts directories - change of ts file names - splitting of former files to more files when suitable - more details: https://wiki.fd.io/view/CSIT/csit-perf-tc-naming-change Change-Id: Ifda1038f8323735f86c1be7ba7f93e3fda183618 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-01-24CSIT-509: Add perf tests for vlan + l2 + vhostTibor Frank1-2/+82
Change-Id: I65e716b51dd35092c10574ac4580ee4b8bd3b24b Signed-off-by: Tibor Frank <tifrank@cisco.com> (cherry picked from commit c232d04e7a5bffb72063240ee7e15967f46c4873)
2017-01-19Add unified latency output for PDRDISC and NDRDISCpmikus1-5/+7
Add same latency formatting for PDR as for NDR search results. This will help us to parse the data in same way. Change-Id: I3be79cc7623f8c9d39fd44babd252ceec58c114b Signed-off-by: pmikus <pmikus@cisco.com> (cherry picked from commit ac7203cc1104f0e4868c07748d8a6b288182263f)
2017-01-18Update: robot parser scriptspmikus2-13/+25
Update robot parser script due to new naming and TAG structure Change-Id: I963de747d2c88dadcb2d3fa48747fb2ef1403294 Signed-off-by: pmikus <pmikus@cisco.com> (cherry picked from commit 6a00ab3009930ba06bb2b28118398d8f232be4b9)
2017-01-17VIRL test: Replace IP probe for VXLAN testMatej Klotton2-2/+8
Change-Id: Ic16f91beabdc2ac2e19ccc65c04790d36c15d477 Signed-off-by: Matej Klotton <mklotton@cisco.com> (cherry picked from commit eb4515115a69f5a3fe9b2fe178110cc5ff78b73a)
2017-01-12Update: plot script for new tagspmikus1-1/+1
Update plot script based on the change in TC TAGS Change-Id: I9412e38d4306b69c75b16943b64b987c2553c167 Signed-off-by: pmikus <pmikus@cisco.com>
2017-01-11 Add the DPDK l2fwd performance test cases.Fangyin Hu6-9/+517
Change-Id: I996847a4871ed994cd9b5edb459fb079ff39c86d Signed-off-by: Fangyin Hu <fangyinx.hu@intel.com>
2017-01-10CSIT-482: HC Test - NATselias8-0/+527
- add NAT test suite - add keywords and methods for configuring and reading NAT settings - add test data used in NAT suite Change-Id: Iaa2ac1eb156bc9bcff41ec242318f6a973210d38 Signed-off-by: selias <samelias@cisco.com>
2017-01-10HC Test: Fix log archiving in honeycomb testsselias1-0/+16
Change-Id: Iad743b3c0e2d1b57e7c6bcae521fe958fbb06ced Signed-off-by: selias <samelias@cisco.com>
2017-01-10Fix: Add prefix to elements of output-perf-xmlpmikus1-1/+1
Robot results parser is using names of suites to create XML with performance data. This patch is supposed to fix the situation when the name of suite starts with digit. This leads to issue that final XML is not valid. Change-Id: I0046da4ff62f661de07f8e659ae511610c8c61f8 Signed-off-by: pmikus <pmikus@cisco.com>
2017-01-10CSIT-499: Perf Tests - VXLAN + L2BD + vhostTibor Frank1-0/+44
- Packet throughput L2BD test cases with VXLANoIPv4 and vhost Change-Id: I6373ef232e5ce7155f8dec80ffa576a6a6b69b81 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-01-04CSIT-498: Packet throughput L2BD with VXLANoIPv4Tibor Frank1-0/+23
- Add performance tests for packet throughput L2BD with VXLANoIPv4 Change-Id: Id0872e1847f5a0e0eb37ba352bf75f56c51c7a45 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-01-04Add Centos 7 image to CSIT.Thomas F Herbert23-0/+1892
JIRA: CSIT-256 JIRA: CSIT-490 libpcap and Qemu version 2.3.0 Centos 7.3 support added from 7.3.1611 base image. Change-Id: Ia4ebe22980206cade4beb87760a455ca18f9fbfc Signed-off-by: Thomas F Herbert <therbert@redhat.com>
2017-01-02CSIT-488 TLDK jbb validation jobs need cmake installedpmikus4-1/+295
Add cmake into VIRL Ubuntu image Change-Id: I2cd33a58c0043a2c3e04809d1f73068520767929 Signed-off-by: pmikus <pmikus@cisco.com>
2016-12-21Fix: Qemu wait_until_vm_bootpmikus1-1/+1
There is an issue that booting Nested VM is successful but QGA guest-ping or flush returns partial response. This fix suppose to do checking until an error or timeout occurs. In case of QGA returns correct response it is success. In case of partial response it will log an error and continue in checking. Change-Id: Idb2c5e5ea54bfc1e118ff62dd15696a1797dfdd9 Signed-off-by: pmikus <pmikus@cisco.com>
2016-12-17Pylint fixesPeter Mikus1-8/+8
- fix Map.py Change-Id: I0241e655df12f8135884e48d14c8eea43c501323 Signed-off-by: pmikus <pmikus@cisco.com>
2016-12-16Fix: CSIT documentation auto generationPeter Mikus1-1/+1
- fix the path error Change-Id: Ia1e491bd9a9f7f803571e8e7309c97fc7f388efc Signed-off-by: pmikus <pmikus@cisco.com>
2016-12-16CSIT Documentation auto generationTibor Frank2-1/+13
- remove all *.rst files in env from build - add ignore list for directories which will not be included in build Change-Id: Ifef18255d366094704041b526d707fdb6fc4567d Signed-off-by: Tibor Frank <tifrank@cisco.com>
2016-12-16CSIT-484: HC Test: Lispselias7-0/+782
- add Lisp test suite - add Lisp test data - add keywords and methods used in Lisp tests Change-Id: Ie7819e20cf48e7dac106d60cce316ce69ab75786 Signed-off-by: selias <samelias@cisco.com>
2016-12-16CSIT-424: HC Test: JSON comparison function reworkselias6-95/+64
When comparing multi-level JSON trees, the exceptions raised carry more useful information. Keys and values not present in reference data are ignored. No longer puts chunks of honeycomb's log file into robot report. The entire log file will be archived after https://gerrit.fd.io/r/4171 Change-Id: Ib597080fa3d9b2c43463c76ee0d52f317ea072e7 Signed-off-by: selias <samelias@cisco.com>
2016-12-16Pylint fixesTibor Frank32-180/+190
- Fix PyLint errors - Fix comments in touched python modules Change-Id: I26db2d292a41969cf38b9b0bdd49c4fb15349102 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2016-12-15HC Test: fix archiving artifacts in csit-hc2vpp jobsselias2-1/+28
Change-Id: I392eac7404d5e1793a7de9d7a44b9defb89e7b9d Signed-off-by: selias <samelias@cisco.com>
2016-12-15 check the return valueFangyin Hu1-0/+373
Change-Id: Id507ba1a139415b395f99cd3fcbe2581e1fe3f54 Signed-off-by: Fangyin Hu <fangyinx.hu@intel.com>
2016-12-14Fix: Qemu wait_until_vm_bootPeter Mikus1-9/+18
There is an issue that booting Nested VM is successful but QGA guest-ping returns partial response. This fix suppose to do checking until an error or timeout occurs. In case of QGA returns correct response it is success. In case of partial response it will log an error and continue in checking. Change-Id: I8a2469287abaa9398a9206988e579912840f20c4 Signed-off-by: pmikus <pmikus@cisco.com>
2016-12-14vhost perf testing with Qemu 5t5pcpmikus1-12/+10
Currently we were using 3t3pc for Qemu (2t2pc testpmd). This is not enough anymore as we are testing VPP with 4t4pc. This patch is supposed to increase the number of core used by testpmd. Change-Id: Id58634c050b51943679a1f7cb74c624a98d81a27 Signed-off-by: pmikus <pmikus@cisco.com>
2016-12-14fix of stop-testcase scriptJan Gelety1-2/+5
- use if statement to avoid deletion of /nfs/scratch directory in case that session-id is not provided Change-Id: Iffca231755ebef71babdd74447a0712bc21265ed Signed-off-by: Jan Gelety <jgelety@cisco.com>
2016-12-13CSIT-470 Add option to configure CFS scheduler priority for VPPpmikus2-8/+120
Add option to configure CFS scheduler priority for VPP Change-Id: Id358ebe41d7e868fd412d554d886567f81894b86 Signed-off-by: pmikus <pmikus@cisco.com>
2016-12-12Fix: Nested VM performance optimizationspmikus2-4/+16
- Fix he issue with packet loss by workaround - Fix the isolcpu patch Change-Id: Ia9945963a63fceef5ce00d9cbcd0228c81783a47 Signed-off-by: pmikus <pmikus@cisco.com>
2016-12-12CSIT-484: HC Test: Add scripts for new hc2vpp jobsselias2-1/+84
- add package download script that also installs jvpp .jar to maven local repo - add bootstrap scripts for the new jobs Related ci-management commit: https://gerrit.fd.io/r/4171 Change-Id: I11ec3d93d3b6f6d84c0c1c5e54f166dab96a05ee Signed-off-by: selias <samelias@cisco.com>
2016-12-12CSIT-474: CSIT documentation auto generationTibor Frank1-1/+6
- Remove env dirs from built doc - Create tar.gz file from built doc Change-Id: Ic5e5eb339058783b0e88296f332988a70ab6189e Signed-off-by: Tibor Frank <tifrank@cisco.com>
2016-12-08CSIT-494 Add multi-queue support for Qemupmikus1-5/+7
Add multi-queue support when starting qemu. Full implementation will be following in near future. Change-Id: I743bbde67254b26a4e4e98072bad57dde728845a Signed-off-by: pmikus <pmikus@cisco.com>
2016-12-07Fix map-e variable set generatorMatej Klotton1-1/+4
- a first octet can not be 127. Change-Id: I003a00b4aed61f46d4ae6a4bace561bba9ee5a28 Signed-off-by: Matej Klotton <mklotton@cisco.com>
2016-12-07Add system optimization on physical testbed Ipmikus1-8/+71
This patch is adding kernel and vm optimizations for physical testbeds. Change-Id: I7b54bf528f7d2cee788d8047d259877b7e362872 Signed-off-by: pmikus <pmikus@cisco.com>
2016-12-05CSIT-425: HC Test: Fix package download scriptselias1-1/+1
Change-Id: I2fefae2cea5fadec8c0096571397c71f26b86263 Signed-off-by: selias <samelias@cisco.com>
2016-12-02Fix: Reading huge pages information during Qemu startpmikus1-13/+82
Reading information from sysfs or proc files is randomly failing returning empty string without any error. This fix suppose to add the retries to read the hugepages information multiple times and raise exception if reading failed. Change-Id: I7c88504765c39b11c81f7a8e77e5b0e32b7225fe Signed-off-by: pmikus <pmikus@cisco.com>
2016-12-02Fix dpdk16.11 hashsumpmikus1-1/+1
Due to rebuild of DPDK 16.11 package by DPDK-dev there is a changed hash sum. This fix is supposed to correct hash sum. Change-Id: I68fc81bcf848abca07e902a0b8754d56a3d2733c Signed-off-by: pmikus <pmikus@cisco.com>
2016-12-01CSIT-481: HC Test: Port mirroring (SPAN)selias6-6/+248
- add port mirroring test suite - add relevant keywords Change-Id: I4ff398dd2ab4323e2a53af2812bf07cbb7043252 Signed-off-by: selias <samelias@cisco.com>
2016-12-01Add list of packages for ubuntu VIRL image 1.5pmikus2-0/+283
Change-Id: I94db829471f40b4499d7cb434d03f672e1b68d8e Signed-off-by: pmikus <pmikus@cisco.com>
2016-11-30CSIT-467 Add libpcap-dev packages to VIRL imagepmikus4-6/+11
- Add libpcap-dev packages to VIRL image - Small fixes Change-Id: I111b0d7e89180ffb7efa76c6503e687f715367f8 Signed-off-by: pmikus <pmikus@cisco.com>