aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2019-01-11CSIT-1393: Check and correct all existing graphs in the ReportTibor Frank1-220/+256
Change-Id: Ie6a63c91dfa7d0a7c688062b3a16663d84fcadc9 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-01-11Markdown doc with FD.io CSIT physical lab design for Hsw.Maciek Konstantynowicz1-0/+1781
Change-Id: Icf3eabe120a7d3c8ba93b347fca20c05fc360f5e Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2019-01-11Markdown doc with FD.io CSIT physical lab design for Skx, Arm, Atom.Maciek Konstantynowicz1-0/+1386
Change-Id: Ib93c3320d213e74f67984c90a0e30bd7b2d63181 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2019-01-11Improve host-setup ansible scriptsPeter Mikus28-8/+26
Change-Id: I5b44be94e6c4ce5e19797d590cbd7f5de82698d5 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-01-11CSIT-1394: Modify existing comparison tablesTibor Frank3-36/+334
Change-Id: I3096bb2faeb61dc5715334cf19fe0e532fe4c68e Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-01-10CSIT-1362: migrate to package cloud for HC performance testsMichal Cmarada2-1/+120
Change-Id: I43f62ea97e432504eb4ece85744d7fd6ff426113 Signed-off-by: Michal Cmarada <mcmarada@cisco.com>
2019-01-10VPP_Device - add baseline tests - part IIa)Jan Gelety13-68/+542
CSIT-1372 Add following baseline tests to VPP_Device: - ip4 eth2p-ethip4-ip4base-eth-2vhost-1vm-dev - ip6 eth2p-ethip6-ip6base-eth-2vhost-1vm-dev - l2bd eth2p-eth-l2bdbasemaclrn-eth-2vhost-1vm-dev - l2xc eth2p-eth-l2xcbase-eth-2vhost-1vm-dev + fix doc strings in all vpp_device tests Change-Id: Icc5ed801f3e8f6dedaa611779bd86fc20102fa74 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-01-10CSIT-1389 Refactor current keywords for multichaining - CNF (II)Peter Mikus48-416/+314
Change-Id: Ic6af8ebf59589bea66322fc87a33218c7dc0c132 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-01-09fix permissions for dut_setup.shMichal Cmarada1-0/+0
Change-Id: Ia11125e889a981a762c54281375a4e78159d8c69 Signed-off-by: Michal Cmarada <mcmarada@cisco.com>
2019-01-09performance tests updateMichal Cmarada1-3/+3
Change-Id: If199757123974cf0889c2284ffc5c37ea9b18e7c Signed-off-by: Michal Cmarada <mcmarada@cisco.com>
2019-01-09CSIT-1389 Refactor current keywords for multichaining - CNFPeter Mikus50-569/+337
- Add ability to create matrix of containers (chains x nodeness) - Change default Docker image to csit-dut - Use new resource mapping function Change-Id: Iaac0f2efc99146fbaef0b33dc71b38770610023d Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-01-08[V4] Add sending unidirectional traffic support for TG in CSITYulong Pei3-18/+326
Extend TG in CSIT to support to send unidirectional traffic, and then it can be used by unidirectional test cases e.g. Load balancer. Change-Id: Ie25bcdf7d4525a6d88d8ecd11a1b6d98275fa4d6 Signed-off-by: Yulong Pei <yulong.pei@intel.com>
2019-01-08CSIT-1387 Implement mapping functionPeter Mikus3-114/+134
Implement universal mapping function for placing the NF threads to cpu cores/threads. - Must be SMT aware. - Must work with N-core NF. - Must be DUT (vswtich) aware. - Must be deterministic. - Must use DTCR and MTCR parameters. Change-Id: I98b61861f85c5af7ecd856719b4adf2ba95c262f Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-01-07Trending: Add latest changes to the "new" dirTibor Frank10-91/+125
Change-Id: Ib5d1c9561c5d21f2d72b5c1b643c114f37bacd1a Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-01-07Updated trending methodology doc.Maciek Konstantynowicz1-7/+15
Change-Id: Iecb4c0799ae9c156e054d209e5eaba5972a3f556 Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2019-01-07Update of VPP_STABLE_VERJan Gelety2-2/+2
- use new vpp ref build - ubuntu 16.04: 19.01-rc0~597-g03afb6d~b6077 - use new vpp ref build - centos7: 19.01-rc0~597_g03afb6d~b5892 Change-Id: I50a4fd324370f8dd9f17273e3f1ed8d4b36acd43 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-01-07Adding pip requirementsJan Gelety9-12/+499
- add pexpect - needed for vpp_device vhost tests - add dill, numpy, scipy - needed for PLRSearch Change-Id: Ib53f19e954f440773103b7913603a0c86ed81039 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-01-04Trending: Remove unneeded tests from DashboardTibor Frank6-56/+108
Change-Id: I0f57735bcc578b42994721ca88dc1bb60af475de Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-01-04CSIT-1382 Create weekly/semiweekly job for vpp-devicePeter Mikus1-4/+5
- Update gather function Change-Id: If130b93fd8c9752bb804a8ecc53c1598e8669031 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-01-03Update of VPP_STABLE_VERJan Gelety2-2/+2
- use new vpp ref build - ubuntu 16.04: 19.01-rc0~580-g22af447~b6060 - use new vpp ref build - centos7: 19.01-rc0~580_g22af447~b5875 Change-Id: I939224ad47d684b7ab5f19198086f537e0699a32 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-01-02Trending: Align the content of old and new dirsTibor Frank9-41/+132
Change-Id: I39d1f71adac0bad3dbe18a987909904ea5c1e6cb Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-01-02VHOST vectors.Peter Mikus1-4/+7
Change-Id: I5e17c5ab5cb99af0ac3d063ffc911bf95457d3e4 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-12-19FIX: Avoid duplicated KW names in perf and func testsJan Gelety8-43/+43
Change-Id: I66c68edf6e26fa7baa7bdc5f5d60d4d4aa3af6b9 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-12-19Update of VPP_STABLE_VERJan Gelety2-2/+2
- use new vpp ref build - ubuntu 16.04: 19.01-rc0~501-gbef3619~b5981 - use new vpp ref build - centos7: 19.01-rc0~501_gbef3619~b5796 Change-Id: Idb9468bc1c328952b7c60f22be26f04b8d473781 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-12-18FIX: do not use dump stats in IPv6 base testsJan Gelety1-5/+0
Change-Id: I9983b4aa1d6575f017bdfd69b6ab3b26206d9605 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-12-18Adding DMM build artifactssharath4-2/+67
Change-Id: Ia5153d8e716d506c85ec8b723331438efd66ab6a Signed-off-by: sharath <sharathkumarboyanapally@gmail.com>
2018-12-17FIX: Update PAPI to work with string changes in Python APIJan Gelety4-9/+11
Change-Id: I3b5f0568b5928cf12aaf2a555f52dd9809348579 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-12-14Trending: Reduce input dataTibor Frank1-18/+18
Change-Id: Ic49d52b924cbb468ed32fc8561a1101168b15614 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-12-13CSIT-1377: Implement systematic solution using defined time periodTibor Frank4-3/+76
Change-Id: I03d8a5fcf9e6392e238e04a06c0463c17b5a4a47 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-12-13Trending: New sensitive detectionVratko Polak35-0/+46800
This enables PAL to consider burst size and stdev when detecting anomalies. Currently added as a separate presentation_new directory, so the previous detection is still available by default. TODO: If the state with two detections persists for some time, create a script for generating presentation_new/ (from presentation/) to simplify maintenance. Change-Id: Ic118aaf5ff036bf244c5820c86fa3766547fa938 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-12-13Update of VPP_STABLE_VERJan Gelety2-2/+2
- use new vpp ref build - ubuntu 16.04: 19.01-rc0~457-g11312ef~b5933 - use new vpp ref build - centos7: 19.01-rc0~457_g11312ef~b5746 Change-Id: Ie15c5bdfb433c2320a833f4c5d272c65d4cb1491 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-12-11Delete old NDR/PDR keywordsVratko Polak1-376/+0
Change-Id: I932d46646408a030ffdeb78b3a3e19c39455750d Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-12-11Add missing = to all suite VariablesVratko Polak149-323/+323
Use the following if we ever decide '} =' is better than '}='. $ cd csit/tests $ find . -type f -print0 | xargs -0 sed -i -E 's/^\| \$\{(.*)\}= \|([^|])/\| \$\{\1\} = \|\2/g' FIXME: Add a corresponding check to https://gerrit.fd.io/r/13450 Change-Id: I73c516a0d7e475ff0986fd6515aaae10accd1a3a Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-12-10Reduce the input data for trendingTibor Frank1-9/+9
Change-Id: I88ecdcf2ae4229318ea4b4f775d85597aef531c2 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-12-07VPP_Device - add baseline tests - part IJan Gelety9-262/+1143
CSIT-1370 Add following baseline tests to VPP_Device: - ip4 eth2p-ethip4-ip4base-dev - ip6 eth2p-ethip6-ip6base-dev - l2bd eth2p-eth-l2bdbasemaclrn-dev Change-Id: Ic20000eb38c5511c27d020f3aa76b2620d7f7ef9 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-12-06Report: we use IMIX also for ip6Vratko Polak1-2/+2
Change-Id: Ic3aa4325357186bc9c23a9fbe4f8ac4278ddbea9 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-12-03CSIT-1374: Split the files with graphs int he ReportTibor Frank158-19691/+22310
- Packet Latency - Throughput Speedup Analysis - Packet Throughput Change-Id: If0df9fe8940eae08734f95c5150e10f2317c4927 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-12-03Change the Report version to .49Tibor Frank3-3/+6
Change-Id: I14a371bcfb043ccb0a5cffc48f6f6f18d61f1942 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-12-03Update of VPP_STABLE_VERJan Gelety2-2/+2
- use new vpp ref build - ubuntu 16.04: 19.01-rc0~394-g6b4a32d~b5870 - use new vpp ref build - centos7: 19.01-rc0~394_g6b4a32d~b5683 Change-Id: Idf497fc7348bb8e6987025d8b56488b7282f5cda Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-12-03Fix: CSIT-1299: Revise the graphs in TrendingTibor Frank1-1/+1
- Graph: l2-feature-1t1c-x520-3n-hsw-oacl Change-Id: Id724d98adc2b5bc5c1779df8b903215e8cf507f3 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-11-30CSIT-1299: Revise the graphs in TrendingTibor Frank6-302/+299
Change-Id: Ie8cbc7bc8a58aca41c8cb35c14dbd8e80f027f5c Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-11-29FIX: VPP_Device - use vpp bionic packagesJan Gelety4-4/+13
Because there is already used ubuntu bionic on VPP device testbed and used download script from pacakgecloud site donwloads packages based on host OS we need additional file to store vpp bionic stable version for VPP_Device tests. Change-Id: If834dc8af7dffa19b8ddeae013c3da9b37a5a81a Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-11-29FIX: Exclude softwire func tests from executionJan Gelety6-2/+7
CSIT-1371 Map commands were remove from VAT by patch https://gerrit.fd.io/r/#/c/16115/. Excluding softwire functional tests from execution until corresponding csit KWs are fixed. Change-Id: I2adc580fb4770746c355f12f5ce7e7f8823255d8 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-11-28Add trial duration info to tag documentationVratko Polak1-1/+3
Change-Id: Iad77972ab6a3f4eb4c2e3c09aebfcce0fc5f999b Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-11-28CSIT-1340: Fix the list of failed tests in TrendingTibor Frank2-10/+21
Change-Id: I7c4adeb96d893f4d6d50f0fafcb5e908f57d478a Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-11-28Report versioningTibor Frank1-90/+91
Change-Id: I988f85c5c7dc13da0b71ba1831dfc4fc336f482a Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-11-28CSIT-1340: Fix the list of failed tests in TrendingTibor Frank1-3/+3
Change-Id: I15f88c3f23f2c886367b54147cdf94155ca5e634 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-11-28Report: Set precise NIC limit for x553Tibor Frank1-1/+1
Change-Id: I183471013b06e67100637da589031672fd830a74 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-11-28Report: Set NIC limit for x553Tibor Frank2-0/+3
Change-Id: Ibe85ed844501504085065631b393d2746227ea72 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-11-28CSIT-1351: Add Denverton results to reportTibor Frank1-1/+1
Change-Id: Ic42dff93304baccb099beac08fc754fc48fa9cb9 Signed-off-by: Tibor Frank <tifrank@cisco.com>