aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2017-01-26csit-func-hc naming changeselias18-86/+86
- change test suite filenames - add numbering to all test cases more details at https://wiki.fd.io/view/CSIT/csit-perf-tc-naming-change Change-Id: I58e6c60f750c07e99c6949d8fe2510780fa9007a Signed-off-by: selias <samelias@cisco.com>
2017-01-26CSIT doc gen: remove "package" and change "module" to "suite"Tibor Frank1-5/+5
Change-Id: I36664eb4c1ade7c2c96df457ed939f8681ba2dce Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-01-25Centos 7.3 image Version 1.2 Add dhcp client to VIRL base imageThomas F Herbert4-1/+70
Change-Id: Ibedc2002f26824cc763eb2ff62de09d5f262e0c3 Signed-off-by: Thomas F Herbert <therbert@redhat.com>
2017-01-25Remove _base from test suite dir namesJan Gelety22-1/+1
Change-Id: I2e495f99a88dedc47f64efcc14722bb629a25f02 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-01-24Correction of dpdk packages download when vpp deb packages providedJan Gelety3-10/+17
Change-Id: I7cefd0797103e5062eb48df95ad2e48cdddc19b6 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-01-24csit-func-tc-naming-change - phase 1Jan Gelety96-3396/+5495
- change of ts directories - change of ts file names - splitting of former files to more files when suitable - more details: https://wiki.fd.io/view/CSIT/csit-perf-tc-naming-change Change-Id: Ifda1038f8323735f86c1be7ba7f93e3fda183618 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-01-24CSIT-509: Add perf tests for vlan + l2 + vhostTibor Frank4-3/+1493
Change-Id: I65e716b51dd35092c10574ac4580ee4b8bd3b24b Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-01-23Update of VPP_STABLE_VERJan Gelety5-7/+19
- use new vpp ref build: 17.04-rc0~134-g2ce7f98~b1759_amd64 - build tested by semiweekly job: https://jenkins.fd.io/job/csit-vpp-verify-master-semiweekly/1076/ - use new path for DPDK packages Change-Id: I1001ee3a22817f97a60b3a6555e3026d2b153913 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-01-20Mark VXLAN test as non criticalMatej Klotton1-0/+1
Change-Id: I1a788de4106d7e71d8cad6b68759b9a01d21bb4a Signed-off-by: Matej Klotton <mklotton@cisco.com>
2017-01-19Fix: Adjust NDRCHK threshold valuespmikus2-12/+12
Adjust treshold values in NDRCHK tests based on latest data. Change-Id: I10f39b9a1a071bf0b38c91f904361ad7f54ccc92 Signed-off-by: pmikus <pmikus@cisco.com>
2017-01-19Add unified latency output for PDRDISC and NDRDISCpmikus1-5/+7
Add same latency formatting for PDR as for NDR search results. This will help us to parse the data in same way. Change-Id: I3be79cc7623f8c9d39fd44babd252ceec58c114b Signed-off-by: pmikus <pmikus@cisco.com>
2017-01-18Renaming of all perf TCs.Tibor Frank55-955/+991
Change-Id: Id71abf4f52d7fc555ed9c3ec19563d54f5db9ec5 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-01-17Update: robot parser scriptspmikus2-13/+25
Update robot parser script due to new naming and TAG structure Change-Id: I963de747d2c88dadcb2d3fa48747fb2ef1403294 Signed-off-by: pmikus <pmikus@cisco.com>
2017-01-17Update of VPP_STABLE_VERJan Gelety1-1/+1
- use new vpp ref build: 17.04-rc0~105-g5a3a6c0~b1730_amd64 - build tested by semiweekly job: https://jenkins.fd.io/job/csit-vpp-verify-master-semiweekly/1074/ Change-Id: Ied08466e0aafee1913697873596a43d416e2cc65 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-01-17VIRL test: Replace IP probe for VXLAN testMatej Klotton3-2/+12
Change-Id: Ic16f91beabdc2ac2e19ccc65c04790d36c15d477 Signed-off-by: Matej Klotton <mklotton@cisco.com>
2017-01-13VIRL test: VXLAN-L2BD-vhos_user test (CSIT-500)Jan Gelety3-27/+185
- Create test cases to test VXLAN+L2BD+vhost_user IPv4 and IPv6 scenarios Change-Id: I46d27f22ec2e2e35fd5067ba7eeda9a2ccff9f84 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-01-13Tags for tests with IPSec.Tibor Frank1-0/+24
Change-Id: Ic06bd15de44303f99133fa0df83319b5568b64dd Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-01-12Update: plot script for new tagspmikus1-1/+1
Update plot script based on the change in TC TAGS Change-Id: I9412e38d4306b69c75b16943b64b987c2553c167 Signed-off-by: pmikus <pmikus@cisco.com>
2017-01-12CSIT-501: Perf tests re-taggingTibor Frank55-905/+865
- Implement tags introduced by https://gerrit.fd.io/r/#/c/3856/ Change-Id: I59313f43f338e2b4a1ad5caf9521b1a0da84d1d3 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-01-12Clean up bootstrap-verify-perf filepmikus1-57/+2
Remove obsolete code from performance bootstrap file Change-Id: I8486c000ee4049b390017a1bf96459ec9fc828ea Signed-off-by: pmikus <pmikus@cisco.com>
2017-01-11 Add the DPDK l2fwd performance test cases.Fangyin Hu13-33/+1093
Change-Id: I996847a4871ed994cd9b5edb459fb079ff39c86d Signed-off-by: Fangyin Hu <fangyinx.hu@intel.com>
2017-01-11Fix: Crypto-dev TB3 topology changespmikus1-8/+10
- Add crypto device into TB3 topology file - Change the @PCI after new device insertion Change-Id: I7fabe3173506c473982490fe24976b68ab45430c Signed-off-by: pmikus <pmikus@cisco.com>
2017-01-10CSIT-482: HC Test - NATselias9-0/+631
- add NAT test suite - add keywords and methods for configuring and reading NAT settings - add test data used in NAT suite Change-Id: Iaa2ac1eb156bc9bcff41ec242318f6a973210d38 Signed-off-by: selias <samelias@cisco.com>
2017-01-10CSIT-469 Rename performance suitespmikus55-3441/+3941
Rename performance suites and add more TAGS Change-Id: I6a5251bb6e380fe2a47a6ec1c1aeb4a9f70c5ce3 Signed-off-by: pmikus <pmikus@cisco.com>
2017-01-10HC Test: Fix log archiving in honeycomb testsselias1-0/+16
Change-Id: Iad743b3c0e2d1b57e7c6bcae521fe958fbb06ced Signed-off-by: selias <samelias@cisco.com>
2017-01-10Fix: Add prefix to elements of output-perf-xmlpmikus1-1/+1
Robot results parser is using names of suites to create XML with performance data. This patch is supposed to fix the situation when the name of suite starts with digit. This leads to issue that final XML is not valid. Change-Id: I0046da4ff62f661de07f8e659ae511610c8c61f8 Signed-off-by: pmikus <pmikus@cisco.com>
2017-01-10CSIT-499: Perf Tests - VXLAN + L2BD + vhostTibor Frank2-0/+728
- Packet throughput L2BD test cases with VXLANoIPv4 and vhost Change-Id: I6373ef232e5ce7155f8dec80ffa576a6a6b69b81 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-01-09Update of VPP_STABLE_VERJan Gelety1-1/+1
- use new vpp ref build: 17.04-rc0~64-gf952692~b1689_amd64 - build tested by semiweekly job: https://jenkins.fd.io/job/csit-vpp-verify-master-semiweekly/1072/ Change-Id: I6e760f4145ee5c31f34f725c9d9d923575688410 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-01-05Fix pylint messagesPeter Mikus1-2/+2
Change-Id: I78ca27169f7f0fd6d786f222684e4c482ae54a43 Signed-off-by: pmikus <pmikus@cisco.com>
2017-01-04CSIT-498: Packet throughput L2BD with VXLANoIPv4Tibor Frank2-0/+498
- Add performance tests for packet throughput L2BD with VXLANoIPv4 Change-Id: Id0872e1847f5a0e0eb37ba352bf75f56c51c7a45 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2017-01-04Add Centos 7 image to CSIT.Thomas F Herbert23-0/+1892
JIRA: CSIT-256 JIRA: CSIT-490 libpcap and Qemu version 2.3.0 Centos 7.3 support added from 7.3.1611 base image. Change-Id: Ia4ebe22980206cade4beb87760a455ca18f9fbfc Signed-off-by: Thomas F Herbert <therbert@redhat.com>
2017-01-02Update of VPP_STABLE_VERJan Gelety1-1/+1
- use new vpp ref build: 17.04-rc0~25-gfdc62ab~b1650_amd64 - build tested by semiweekly job: https://jenkins.fd.io/job/csit-vpp-verify-master-semiweekly/1070/ Change-Id: I7eadc339053cfeff99103308660933eb3362f046 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2017-01-02CSIT-488 TLDK jbb validation jobs need cmake installedpmikus8-5/+299
Add cmake into VIRL Ubuntu image Change-Id: I2cd33a58c0043a2c3e04809d1f73068520767929 Signed-off-by: pmikus <pmikus@cisco.com>
2016-12-21Fix: Qemu wait_until_vm_bootpmikus1-1/+1
There is an issue that booting Nested VM is successful but QGA guest-ping or flush returns partial response. This fix suppose to do checking until an error or timeout occurs. In case of QGA returns correct response it is success. In case of partial response it will log an error and continue in checking. Change-Id: Idb2c5e5ea54bfc1e118ff62dd15696a1797dfdd9 Signed-off-by: pmikus <pmikus@cisco.com>
2016-12-19Update of VPP_STABLE_VERJan Gelety1-1/+1
- use new vpp ref build: 17.01-rc0~256-gbd6462e~b1592_amd64 - build tested by semiweekly job: https://jenkins.fd.io/job/csit-vpp-verify-master-semiweekly/1065/ Change-Id: I70019095a41c5e8bc8a15c472c608b77124cbe7f Signed-off-by: Jan Gelety <jgelety@cisco.com>
2016-12-17Pylint fixesPeter Mikus1-8/+8
- fix Map.py Change-Id: I0241e655df12f8135884e48d14c8eea43c501323 Signed-off-by: pmikus <pmikus@cisco.com>
2016-12-16Fix: CSIT documentation auto generationPeter Mikus1-1/+1
- fix the path error Change-Id: Ia1e491bd9a9f7f803571e8e7309c97fc7f388efc Signed-off-by: pmikus <pmikus@cisco.com>
2016-12-16HC Test: Add EXPECTED_FAILING tag to expected test faluresselias3-3/+6
Change-Id: Ic197001f2bb5ad5be9246025502d49e90e0c44aa Signed-off-by: selias <samelias@cisco.com>
2016-12-16CSIT Documentation auto generationTibor Frank2-1/+13
- remove all *.rst files in env from build - add ignore list for directories which will not be included in build Change-Id: Ifef18255d366094704041b526d707fdb6fc4567d Signed-off-by: Tibor Frank <tifrank@cisco.com>
2016-12-16CSIT-484: HC Test: Lispselias8-0/+941
- add Lisp test suite - add Lisp test data - add keywords and methods used in Lisp tests Change-Id: Ie7819e20cf48e7dac106d60cce316ce69ab75786 Signed-off-by: selias <samelias@cisco.com>
2016-12-16CSIT-424: HC Test: JSON comparison function reworkselias6-95/+64
When comparing multi-level JSON trees, the exceptions raised carry more useful information. Keys and values not present in reference data are ignored. No longer puts chunks of honeycomb's log file into robot report. The entire log file will be archived after https://gerrit.fd.io/r/4171 Change-Id: Ib597080fa3d9b2c43463c76ee0d52f317ea072e7 Signed-off-by: selias <samelias@cisco.com>
2016-12-16Pylint fixesTibor Frank33-184/+194
- Fix PyLint errors - Fix comments in touched python modules Change-Id: I26db2d292a41969cf38b9b0bdd49c4fb15349102 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2016-12-15HC Test: fix archiving artifacts in csit-hc2vpp jobsselias5-10/+35
Change-Id: I392eac7404d5e1793a7de9d7a44b9defb89e7b9d Signed-off-by: selias <samelias@cisco.com>
2016-12-15 check the return valueFangyin Hu2-0/+590
Change-Id: Id507ba1a139415b395f99cd3fcbe2581e1fe3f54 Signed-off-by: Fangyin Hu <fangyinx.hu@intel.com>
2016-12-15 download and install DPDK in the robot file.Fangyin Hu1-0/+157
Change-Id: I6bb80331fb0b61dd276a9f23f906c3fdd615c569 Signed-off-by: Fangyin Hu <fangyinx.hu@intel.com>
2016-12-14Fix: Qemu wait_until_vm_bootPeter Mikus1-9/+18
There is an issue that booting Nested VM is successful but QGA guest-ping returns partial response. This fix suppose to do checking until an error or timeout occurs. In case of QGA returns correct response it is success. In case of partial response it will log an error and continue in checking. Change-Id: I8a2469287abaa9398a9206988e579912840f20c4 Signed-off-by: pmikus <pmikus@cisco.com>
2016-12-14vhost perf testing with Qemu 5t5pcpmikus4-23/+21
Currently we were using 3t3pc for Qemu (2t2pc testpmd). This is not enough anymore as we are testing VPP with 4t4pc. This patch is supposed to increase the number of core used by testpmd. Change-Id: Id58634c050b51943679a1f7cb74c624a98d81a27 Signed-off-by: pmikus <pmikus@cisco.com>
2016-12-14fix of stop-testcase scriptJan Gelety1-2/+5
- use if statement to avoid deletion of /nfs/scratch directory in case that session-id is not provided Change-Id: Iffca231755ebef71babdd74447a0712bc21265ed Signed-off-by: Jan Gelety <jgelety@cisco.com>
2016-12-13HC Test: fix artifact archiving in csit-hc2vpp jobsselias3-213/+12
- scp the honeycomb log from virl DUT - remove unused bootstrap file left over from the old job Change-Id: I863436bb8865d2003812e21f01854855059665f6 Signed-off-by: selias <samelias@cisco.com>
2016-12-13CSIT-470 Add option to configure CFS scheduler priority for VPPpmikus5-14/+177
Add option to configure CFS scheduler priority for VPP Change-Id: Id358ebe41d7e868fd412d554d886567f81894b86 Signed-off-by: pmikus <pmikus@cisco.com>