aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2019-01-07Adding pip requirementsJan Gelety9-12/+499
- add pexpect - needed for vpp_device vhost tests - add dill, numpy, scipy - needed for PLRSearch Change-Id: Ib53f19e954f440773103b7913603a0c86ed81039 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-01-04Trending: Remove unneeded tests from DashboardTibor Frank6-56/+108
Change-Id: I0f57735bcc578b42994721ca88dc1bb60af475de Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-01-04CSIT-1382 Create weekly/semiweekly job for vpp-devicePeter Mikus1-4/+5
- Update gather function Change-Id: If130b93fd8c9752bb804a8ecc53c1598e8669031 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-01-03Update of VPP_STABLE_VERJan Gelety2-2/+2
- use new vpp ref build - ubuntu 16.04: 19.01-rc0~580-g22af447~b6060 - use new vpp ref build - centos7: 19.01-rc0~580_g22af447~b5875 Change-Id: I939224ad47d684b7ab5f19198086f537e0699a32 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-01-02Trending: Align the content of old and new dirsTibor Frank9-41/+132
Change-Id: I39d1f71adac0bad3dbe18a987909904ea5c1e6cb Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-01-02VHOST vectors.Peter Mikus1-4/+7
Change-Id: I5e17c5ab5cb99af0ac3d063ffc911bf95457d3e4 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-12-19FIX: Avoid duplicated KW names in perf and func testsJan Gelety8-43/+43
Change-Id: I66c68edf6e26fa7baa7bdc5f5d60d4d4aa3af6b9 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-12-19Update of VPP_STABLE_VERJan Gelety2-2/+2
- use new vpp ref build - ubuntu 16.04: 19.01-rc0~501-gbef3619~b5981 - use new vpp ref build - centos7: 19.01-rc0~501_gbef3619~b5796 Change-Id: Idb9468bc1c328952b7c60f22be26f04b8d473781 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-12-18FIX: do not use dump stats in IPv6 base testsJan Gelety1-5/+0
Change-Id: I9983b4aa1d6575f017bdfd69b6ab3b26206d9605 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-12-18Adding DMM build artifactssharath4-2/+67
Change-Id: Ia5153d8e716d506c85ec8b723331438efd66ab6a Signed-off-by: sharath <sharathkumarboyanapally@gmail.com>
2018-12-17FIX: Update PAPI to work with string changes in Python APIJan Gelety4-9/+11
Change-Id: I3b5f0568b5928cf12aaf2a555f52dd9809348579 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-12-14Trending: Reduce input dataTibor Frank1-18/+18
Change-Id: Ic49d52b924cbb468ed32fc8561a1101168b15614 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-12-13CSIT-1377: Implement systematic solution using defined time periodTibor Frank4-3/+76
Change-Id: I03d8a5fcf9e6392e238e04a06c0463c17b5a4a47 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-12-13Trending: New sensitive detectionVratko Polak35-0/+46800
This enables PAL to consider burst size and stdev when detecting anomalies. Currently added as a separate presentation_new directory, so the previous detection is still available by default. TODO: If the state with two detections persists for some time, create a script for generating presentation_new/ (from presentation/) to simplify maintenance. Change-Id: Ic118aaf5ff036bf244c5820c86fa3766547fa938 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-12-13Update of VPP_STABLE_VERJan Gelety2-2/+2
- use new vpp ref build - ubuntu 16.04: 19.01-rc0~457-g11312ef~b5933 - use new vpp ref build - centos7: 19.01-rc0~457_g11312ef~b5746 Change-Id: Ie15c5bdfb433c2320a833f4c5d272c65d4cb1491 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-12-11Delete old NDR/PDR keywordsVratko Polak1-376/+0
Change-Id: I932d46646408a030ffdeb78b3a3e19c39455750d Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-12-11Add missing = to all suite VariablesVratko Polak149-323/+323
Use the following if we ever decide '} =' is better than '}='. $ cd csit/tests $ find . -type f -print0 | xargs -0 sed -i -E 's/^\| \$\{(.*)\}= \|([^|])/\| \$\{\1\} = \|\2/g' FIXME: Add a corresponding check to https://gerrit.fd.io/r/13450 Change-Id: I73c516a0d7e475ff0986fd6515aaae10accd1a3a Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-12-10Reduce the input data for trendingTibor Frank1-9/+9
Change-Id: I88ecdcf2ae4229318ea4b4f775d85597aef531c2 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-12-07VPP_Device - add baseline tests - part IJan Gelety9-262/+1143
CSIT-1370 Add following baseline tests to VPP_Device: - ip4 eth2p-ethip4-ip4base-dev - ip6 eth2p-ethip6-ip6base-dev - l2bd eth2p-eth-l2bdbasemaclrn-dev Change-Id: Ic20000eb38c5511c27d020f3aa76b2620d7f7ef9 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-12-06Report: we use IMIX also for ip6Vratko Polak1-2/+2
Change-Id: Ic3aa4325357186bc9c23a9fbe4f8ac4278ddbea9 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-12-03CSIT-1374: Split the files with graphs int he ReportTibor Frank158-19691/+22310
- Packet Latency - Throughput Speedup Analysis - Packet Throughput Change-Id: If0df9fe8940eae08734f95c5150e10f2317c4927 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-12-03Change the Report version to .49Tibor Frank3-3/+6
Change-Id: I14a371bcfb043ccb0a5cffc48f6f6f18d61f1942 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-12-03Update of VPP_STABLE_VERJan Gelety2-2/+2
- use new vpp ref build - ubuntu 16.04: 19.01-rc0~394-g6b4a32d~b5870 - use new vpp ref build - centos7: 19.01-rc0~394_g6b4a32d~b5683 Change-Id: Idf497fc7348bb8e6987025d8b56488b7282f5cda Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-12-03Fix: CSIT-1299: Revise the graphs in TrendingTibor Frank1-1/+1
- Graph: l2-feature-1t1c-x520-3n-hsw-oacl Change-Id: Id724d98adc2b5bc5c1779df8b903215e8cf507f3 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-11-30CSIT-1299: Revise the graphs in TrendingTibor Frank6-302/+299
Change-Id: Ie8cbc7bc8a58aca41c8cb35c14dbd8e80f027f5c Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-11-29FIX: VPP_Device - use vpp bionic packagesJan Gelety4-4/+13
Because there is already used ubuntu bionic on VPP device testbed and used download script from pacakgecloud site donwloads packages based on host OS we need additional file to store vpp bionic stable version for VPP_Device tests. Change-Id: If834dc8af7dffa19b8ddeae013c3da9b37a5a81a Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-11-29FIX: Exclude softwire func tests from executionJan Gelety6-2/+7
CSIT-1371 Map commands were remove from VAT by patch https://gerrit.fd.io/r/#/c/16115/. Excluding softwire functional tests from execution until corresponding csit KWs are fixed. Change-Id: I2adc580fb4770746c355f12f5ce7e7f8823255d8 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-11-28Add trial duration info to tag documentationVratko Polak1-1/+3
Change-Id: Iad77972ab6a3f4eb4c2e3c09aebfcce0fc5f999b Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-11-28CSIT-1340: Fix the list of failed tests in TrendingTibor Frank2-10/+21
Change-Id: I7c4adeb96d893f4d6d50f0fafcb5e908f57d478a Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-11-28Report versioningTibor Frank1-90/+91
Change-Id: I988f85c5c7dc13da0b71ba1831dfc4fc336f482a Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-11-28CSIT-1340: Fix the list of failed tests in TrendingTibor Frank1-3/+3
Change-Id: I15f88c3f23f2c886367b54147cdf94155ca5e634 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-11-28Report: Set precise NIC limit for x553Tibor Frank1-1/+1
Change-Id: I183471013b06e67100637da589031672fd830a74 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-11-28Report: Set NIC limit for x553Tibor Frank2-0/+3
Change-Id: Ibe85ed844501504085065631b393d2746227ea72 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-11-28CSIT-1351: Add Denverton results to reportTibor Frank1-1/+1
Change-Id: Ic42dff93304baccb099beac08fc754fc48fa9cb9 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-11-27CSIT python API introductionJan Gelety8-14/+557
Jira: CSIT-1336 Change-Id: I96d2b0221c5a7466484a82339fc132c5921532d1 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-11-27HLD: Python API in CSITJan Gelety1-0/+133
Jira: CSIT-1335 Change-Id: Ifeebc6dad1e217e24455c4e627af740013429b56 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-11-27Report: Fix two minor whitespace errorsVratko Polak1-2/+1
Change-Id: Ib2bd38e1b8735b13ed24e9f190166fe5692a13de Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-11-27Report: Report RevisionsTibor Frank4-90/+94
Change-Id: I30ab711834bba97c0b79f0c7f1f6ed556ab97f15 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-11-27Report: versioningTibor Frank8-26/+32
Change-Id: I890d52b4b5b87cd1b3952b3d4bb3cbbff069a9c7 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-11-26CSIT-1351: Add Denverton results to reportTibor Frank9-2/+1068
- add graphs Change-Id: I8220bfe61715916e915ae7adc37f36adcb4af8d2 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-11-23CSIT-1351: Add Denverton results to reportTibor Frank1-5/+0
Change-Id: Id98822de2609e5a18a81d6b7b4b44d5a1652a592 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-11-23Adding python-cffi requirementsPeter Mikus14-16/+499
- Introduce Ubuntu 18.04.5 VIRL image - FIX mac addresses for dhcp - Add ansible task for python-cffi install on perf testbeds Change-Id: I8acfcdc8ee97c13ad4795a4ccde868a96b3fee47 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-11-23Report: Update version and document historyTibor Frank6-3/+22
Change-Id: If562f112daa218ff40a7d8ccb5a144feb2c32760 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-11-23CSIT-1351: Add Denverton results to reportTibor Frank8-2/+177
- Add tests' configurations - Add tests' operational data Change-Id: Ie435beb5942a6525fe8f3ccbcfabd887ff98ff0a Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-11-23Move reservation directory to TG node.Vratko Polak1-10/+14
Testing has showed SSH access to DUT affects performance. Downside: No support for non-Linux TGs. Complication: After merge there might be conflicts with older jobs, including jobs for other branches. Change-Id: Icefddc5a9ca8f4d830460e53a82bb45231f7222e Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-11-23Trending: Reduce the input dataTibor Frank1-1/+1
Change-Id: I60172aeb24cacd58bd87ca585106d53b6dbad6a4 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-11-21Report: Fix the labelsTibor Frank4-8/+8
Change-Id: I82740007b4c12b8a21014b4572b034013f165280 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-11-21Report: Disable archiving the report in JenkinsTibor Frank1-1/+0
- The zipped Report is 7.3GB big, it takes 13 minutes to create the archive and 14 minutes to archive it. Nobody needs it. Change-Id: Iffd72498b30b1aebc2d3b9be03f31d972a461d6b Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-11-21CSIT-1351: Add Denverton results to reportTibor Frank2-13/+5
Change-Id: I933220671cecd1ecceef6cc36a204fa8d7144508 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-11-21CSIT-1351: Add Denverton results to reportTibor Frank3-2/+10
Change-Id: I0a93ce903ee35098da4ebfd4dd3b2a479e12711b Signed-off-by: Tibor Frank <tifrank@cisco.com>