aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2018-12-11Add missing = to all suite VariablesVratko Polak149-323/+323
Use the following if we ever decide '} =' is better than '}='. $ cd csit/tests $ find . -type f -print0 | xargs -0 sed -i -E 's/^\| \$\{(.*)\}= \|([^|])/\| \$\{\1\} = \|\2/g' FIXME: Add a corresponding check to https://gerrit.fd.io/r/13450 Change-Id: I73c516a0d7e475ff0986fd6515aaae10accd1a3a Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-12-10Reduce the input data for trendingTibor Frank1-9/+9
Change-Id: I88ecdcf2ae4229318ea4b4f775d85597aef531c2 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-12-07VPP_Device - add baseline tests - part IJan Gelety9-262/+1143
CSIT-1370 Add following baseline tests to VPP_Device: - ip4 eth2p-ethip4-ip4base-dev - ip6 eth2p-ethip6-ip6base-dev - l2bd eth2p-eth-l2bdbasemaclrn-dev Change-Id: Ic20000eb38c5511c27d020f3aa76b2620d7f7ef9 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-12-06Report: we use IMIX also for ip6Vratko Polak1-2/+2
Change-Id: Ic3aa4325357186bc9c23a9fbe4f8ac4278ddbea9 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-12-03CSIT-1374: Split the files with graphs int he ReportTibor Frank158-19691/+22310
- Packet Latency - Throughput Speedup Analysis - Packet Throughput Change-Id: If0df9fe8940eae08734f95c5150e10f2317c4927 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-12-03Change the Report version to .49Tibor Frank3-3/+6
Change-Id: I14a371bcfb043ccb0a5cffc48f6f6f18d61f1942 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-12-03Update of VPP_STABLE_VERJan Gelety2-2/+2
- use new vpp ref build - ubuntu 16.04: 19.01-rc0~394-g6b4a32d~b5870 - use new vpp ref build - centos7: 19.01-rc0~394_g6b4a32d~b5683 Change-Id: Idf497fc7348bb8e6987025d8b56488b7282f5cda Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-12-03Fix: CSIT-1299: Revise the graphs in TrendingTibor Frank1-1/+1
- Graph: l2-feature-1t1c-x520-3n-hsw-oacl Change-Id: Id724d98adc2b5bc5c1779df8b903215e8cf507f3 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-11-30CSIT-1299: Revise the graphs in TrendingTibor Frank6-302/+299
Change-Id: Ie8cbc7bc8a58aca41c8cb35c14dbd8e80f027f5c Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-11-29FIX: VPP_Device - use vpp bionic packagesJan Gelety4-4/+13
Because there is already used ubuntu bionic on VPP device testbed and used download script from pacakgecloud site donwloads packages based on host OS we need additional file to store vpp bionic stable version for VPP_Device tests. Change-Id: If834dc8af7dffa19b8ddeae013c3da9b37a5a81a Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-11-29FIX: Exclude softwire func tests from executionJan Gelety6-2/+7
CSIT-1371 Map commands were remove from VAT by patch https://gerrit.fd.io/r/#/c/16115/. Excluding softwire functional tests from execution until corresponding csit KWs are fixed. Change-Id: I2adc580fb4770746c355f12f5ce7e7f8823255d8 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-11-28Add trial duration info to tag documentationVratko Polak1-1/+3
Change-Id: Iad77972ab6a3f4eb4c2e3c09aebfcce0fc5f999b Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-11-28CSIT-1340: Fix the list of failed tests in TrendingTibor Frank2-10/+21
Change-Id: I7c4adeb96d893f4d6d50f0fafcb5e908f57d478a Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-11-28Report versioningTibor Frank1-90/+91
Change-Id: I988f85c5c7dc13da0b71ba1831dfc4fc336f482a Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-11-28CSIT-1340: Fix the list of failed tests in TrendingTibor Frank1-3/+3
Change-Id: I15f88c3f23f2c886367b54147cdf94155ca5e634 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-11-28Report: Set precise NIC limit for x553Tibor Frank1-1/+1
Change-Id: I183471013b06e67100637da589031672fd830a74 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-11-28Report: Set NIC limit for x553Tibor Frank2-0/+3
Change-Id: Ibe85ed844501504085065631b393d2746227ea72 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-11-28CSIT-1351: Add Denverton results to reportTibor Frank1-1/+1
Change-Id: Ic42dff93304baccb099beac08fc754fc48fa9cb9 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-11-27CSIT python API introductionJan Gelety8-14/+557
Jira: CSIT-1336 Change-Id: I96d2b0221c5a7466484a82339fc132c5921532d1 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-11-27HLD: Python API in CSITJan Gelety1-0/+133
Jira: CSIT-1335 Change-Id: Ifeebc6dad1e217e24455c4e627af740013429b56 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-11-27Report: Fix two minor whitespace errorsVratko Polak1-2/+1
Change-Id: Ib2bd38e1b8735b13ed24e9f190166fe5692a13de Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-11-27Report: Report RevisionsTibor Frank4-90/+94
Change-Id: I30ab711834bba97c0b79f0c7f1f6ed556ab97f15 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-11-27Report: versioningTibor Frank8-26/+32
Change-Id: I890d52b4b5b87cd1b3952b3d4bb3cbbff069a9c7 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-11-26CSIT-1351: Add Denverton results to reportTibor Frank9-2/+1068
- add graphs Change-Id: I8220bfe61715916e915ae7adc37f36adcb4af8d2 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-11-23CSIT-1351: Add Denverton results to reportTibor Frank1-5/+0
Change-Id: Id98822de2609e5a18a81d6b7b4b44d5a1652a592 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-11-23Adding python-cffi requirementsPeter Mikus14-16/+499
- Introduce Ubuntu 18.04.5 VIRL image - FIX mac addresses for dhcp - Add ansible task for python-cffi install on perf testbeds Change-Id: I8acfcdc8ee97c13ad4795a4ccde868a96b3fee47 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2018-11-23Report: Update version and document historyTibor Frank6-3/+22
Change-Id: If562f112daa218ff40a7d8ccb5a144feb2c32760 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-11-23CSIT-1351: Add Denverton results to reportTibor Frank8-2/+177
- Add tests' configurations - Add tests' operational data Change-Id: Ie435beb5942a6525fe8f3ccbcfabd887ff98ff0a Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-11-23Move reservation directory to TG node.Vratko Polak1-10/+14
Testing has showed SSH access to DUT affects performance. Downside: No support for non-Linux TGs. Complication: After merge there might be conflicts with older jobs, including jobs for other branches. Change-Id: Icefddc5a9ca8f4d830460e53a82bb45231f7222e Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2018-11-23Trending: Reduce the input dataTibor Frank1-1/+1
Change-Id: I60172aeb24cacd58bd87ca585106d53b6dbad6a4 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-11-21Report: Fix the labelsTibor Frank4-8/+8
Change-Id: I82740007b4c12b8a21014b4572b034013f165280 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-11-21Report: Disable archiving the report in JenkinsTibor Frank1-1/+0
- The zipped Report is 7.3GB big, it takes 13 minutes to create the archive and 14 minutes to archive it. Nobody needs it. Change-Id: Iffd72498b30b1aebc2d3b9be03f31d972a461d6b Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-11-21CSIT-1351: Add Denverton results to reportTibor Frank2-13/+5
Change-Id: I933220671cecd1ecceef6cc36a204fa8d7144508 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-11-21CSIT-1351: Add Denverton results to reportTibor Frank3-2/+10
Change-Id: I0a93ce903ee35098da4ebfd4dd3b2a479e12711b Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-11-21doc: add calibration result and meltspec check result for DenvertonYulong Pei3-0/+331
Change-Id: I0094ba5ea59b18d6a7a9235cd153db393517cc02 Signed-off-by: Yulong Pei <yulong.pei@intel.com>
2018-11-21doc: add 2-node denverton section to physical testbedsYulong Pei2-0/+5555
Change-Id: I7e35622f8b6b8e1a76f0e1c8fe17f4c9c40937b4 Signed-off-by: Yulong Pei <yulong.pei@intel.com>
2018-11-21Trending: Reduce the input dataTibor Frank1-2/+2
Change-Id: I8a4bb7bc9fa34ace12621e7ffd5acba2c8aa2d9f Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-11-21CSIT-1351: Add Denverton results to reportTibor Frank8-52/+68
Change-Id: I4c2ae4ca8ababcae07861ad253dd080b25f16279 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-11-21CSIT-1351: Add Denverton results to reportTibor Frank1-1/+2
Change-Id: Ic2362a4c9dceff45e40b43dad8f8161cb65a03f4 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-11-20CSIT-1351: Add Denverton results to reportTibor Frank1-3/+2
Change-Id: I713fc07aea6914dd554240e68231caf957b426a6 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-11-20CSIT-1351: Add Denverton results to reportTibor Frank7-41/+166
Change-Id: I0e92c183fe972ce9fe8e7b3d3fca6e6bb86ddd54 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-11-20CSIT-1359: Add 3n-skx and 2n-skx comparisons to ReportTibor Frank7-3/+360
- 3n-Skx vs. 2n-Skx Testbeds Change-Id: I63e1d34d4589bbb771961ed3c21f0271fee728ad Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-11-20Fix Acl Plugin tests after update of Acl modelsMichal Cmarada3-331/+339
Change-Id: I8c4090b508e28ae8f289e9dbbd5c72bbc3af4aca Signed-off-by: Michal Cmarada <mcmarada@cisco.com>
2018-11-20Update of VPP_STABLE_VERJan Gelety1-1/+1
- use new vpp ref build - ubuntu 16.04: 19.01-rc0~256-ga7dcae7~b5735_amd64 Change-Id: I2d758dca16eda0bdf17c5289ac386af19c0693bb Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-11-19Report: Edit the chapters' titlesTibor Frank23-45/+49
Change-Id: I23cedb3ad0f188e9c7570f549e397f4c42404fab Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-11-19Report: Change the title of Report historyTibor Frank1-2/+4
Change-Id: Idda7feb2f3c11d7fbe7d872eb5b849878965a407 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-11-16CSIT-1359: Add 3n-skx and 2n-skx comparisons to ReportTibor Frank4-84/+1021
Change-Id: I031497db5268bf4fccd6155349ac4bea70a80fb0 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-11-16Update of VPP_STABLE_VERJan Gelety1-1/+1
- use new vpp ref build - ubuntu 16.04: 19.01-rc0~234-gb11175d~b5713_amd64 Change-Id: I42233a502b75fe4b7017769ff5942a2cce5e068a Signed-off-by: Jan Gelety <jgelety@cisco.com>
2018-11-16CSIT-1350: Add new data to 1810 reportTibor Frank2-3/+7
Change-Id: I2cb6e23af018114f9e065074ac2392cd06a719dc Signed-off-by: Tibor Frank <tifrank@cisco.com>
2018-11-16Report: Fix legend in the graphsTibor Frank2-3/+3
Change-Id: I597bd4483686fb0807526e8734bebdf64aadf7d9 Signed-off-by: Tibor Frank <tifrank@cisco.com>