aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2020-01-23Report: Add diagrams for testbedsTibor Frank7-12/+4412
- Diagrams for testbeds: - 3n-dnv - 3n-tsh - 2n-clx - Replace s/Cascadelake/Cascade Lake Change-Id: I77e7659a0aba4766a28577f940b7e44e60cbd82d Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-01-22Generate tests in deterministic orderVratko Polak1-1/+2
Change-Id: I47e45f395976fd65a8da0e93bc33588cc213c79e Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2020-01-22fix loadbalancer running error(Caused by code upgrades)haiyanx1.zhang1-3/+3
Signed-off-by: haiyanx1.zhang <haiyanx1.zhang@intel.com> Change-Id: I39bd1d9ad59971bb8cba6e664ba5509abba6a527
2020-01-22PAL: Process HDRH LatencyTibor Frank1-16/+76
Change-Id: Ifc48869ccb6c05f4b5af6cd97e05f009c7632dc7 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-01-21Ndrpdr: Add latency trials for smaller loadsVratko Polak2-11/+82
Change-Id: I46bd4b58bdd02a3deed38c158214e1e9977dde05 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2020-01-20Update of VPP_STABLE_VER filesJan Gelety2-2/+2
- use new vpp ref build - ubuntu 18.04: 20.05-rc0~14-gdb43bb6af - use new vpp ref build - centos7: 20.05-rc0~14_gdb43bb6~b8721 Change-Id: I482f40023f6708908e510fa5eede391f62f68c95 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2020-01-20reduce test cases for 2n-dnv and 3n-dnv mrr daily testYulong Pei2-202/+2
since dnv platform is to use by low end market product, no need care more about too much flows performance test. Change-Id: Id7204b0353cbf968e641f14ed980f01af75971b2 Signed-off-by: Yulong Pei <yulong.pei@intel.com>
2020-01-20FIX: Hugepages should be detected also from overcommitPeter Mikus2-148/+70
Change-Id: I36ec9d61f775791ad0632a579c4921889d1f5acf Signed-off-by: Peter Mikus <pmikus@cisco.com>
2020-01-20revert "Report: Remove 'avf' from TC name in plots"Tibor Frank1-9/+6
Change-Id: I9b10b8f2f84daad543ac9b84671753785dfb23ad Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-01-17perf: add TCP Iperf3+LDPRELOAD test suiteDave Wallace10-55/+355
Change-Id: Icff49fb31cce342a2a4ae799e844ec91f9e5e366 Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
2020-01-17Fix unreservationVratko Polak1-2/+3
It got broken by the previous reservation fix. Change-Id: I5d9091b7fa4fcc37148c0223fe8eb83f7e5b6770 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2020-01-17Report: Remove 'avf' from TC name in plotsTibor Frank1-5/+7
Change-Id: Ie1d04347de123032a5d424747d216f90022bc813 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-01-16FIX: remove 4drc nfv_density chain ipsec tests from 3n-hsw daily jobJan Gelety1-12/+0
- not enough cpu cores reported Change-Id: If3ddbbf4f5af741f328c45ac6b8c874e61d348ab Signed-off-by: Jan Gelety <jgelety@cisco.com>
2020-01-17FIX: missing write of mac_dst for direction 0 --> 1 in cnf trex profilesJan Gelety34-1/+137
Change-Id: I3acf5220c24f77bc4bfc451919bf9b5345a988ef Signed-off-by: Jan Gelety <jgelety@cisco.com>
2020-01-17Fix reservation if connect failsVratko Polak1-4/+8
Change-Id: I136cc51cbd5a01451e04a39c5d8e5554d6d39305 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2020-01-17Report: Prepare data setsTibor Frank2-639/+517
Change-Id: Ice90ffe8563d6283050f2b229fc5e50ab64ac253 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-01-16FIX: L2XC with vhost and VLANJan Gelety1-0/+3
Change-Id: Ia87abadba431099eeacd8b50ce5d116597a1f393 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2020-01-16Python3: Migration of files under traffic-profiles/trexBalaji Venkatraman130-4745/+10715
Change-Id: Iae16225d3d3daa4e1e9b177228fb89efe4aa5405 Signed-off-by: Balaji Venkatraman <balajiv@cisco.com>
2020-01-16Report: Latency by Percentile DistributionTibor Frank1-2/+7
- legend Change-Id: I35477ce5c2cabfdcef68424854a8574bd3655e55 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-01-16Report: Latency by Percentile DistributionTibor Frank2-5/+5
- Set X-axis Change-Id: Ica300c7b1352c824bf51ac26e7485c9295ac60dc Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-01-16Report: Add placeholders for new TBsTibor Frank4-3/+247
Change-Id: I92cb693343c4f96503b45a15211e0dadd6fcde5f Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-01-16Remove leftovers from previous removalsVratko Polak1-6/+5
- Except KubernetesUtils and its bash dependencies. It is a dead code currently, but we hope new tests will resurrect it. + Mention device tests instead of functional in Readme. Change-Id: I6bdbea13ea9f995a06a0fb7cb5e98ae4fce29581 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2020-01-15Report: Latency by Percentile DistributionTibor Frank1-1/+7
- Set the position of the Lagend Change-Id: I1bcea6002bd8beeba3300c9976d1603a234c3c14 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-01-15Report: Add Latency by Percentile DistributionTibor Frank59-4/+10313
Change-Id: I5291db8117da611497e910aa7cd2fbb2276bfe65 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-01-15Docs: Update report sectionsPeter Mikus16-394/+277
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Ib6e9ac003c1d91673984c52baf2f3eec30c9d21d
2020-01-15Ansible: Increase TG hugepagesPeter Mikus20-57/+17
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Ifa87e372ed45f6dfc883723acbb325e34fb814a8
2020-01-15Remove everything related to TLDKVratko Polak28-1157/+0
- Leftovers from kubernetes found, but not removed here. Change-Id: If8cb9269d0f3e69f642d7fe02c59122e17925a4d Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2020-01-10Trending: new daily setJan Gelety57-619/+3935
New daily sets are prepared based on information in https://gerrit.fd.io/r/c/csit/+/24073/1/docs/job_specs/perf_tests_job_specs.md and previous test set definitions in docs/job_specs/test_select_list_[2n|3n]_[clx|skx|hsw|tsh|dnv].md files. - mrr-daily-2n-clx: 510 TCs (incl. nfv_density), expected exec. time 8:50h - mrr-daily-2n-skx: 525 TCs (incl. nfv_density), expected exec. time 7:55h - mrr-daily-3n-skx: 393 TCs (incl. nfv_density), expected exec. time 11:00h - mrr-daily-3n-hsw: 177 TCs (incl. nfv_density), expected exec. time 7:10h - mrr-daily-3n-tsh: 204 TCs, expected exec. time 21:00h - mrr-daily-2n-dnv: 84 TCs, expected exec. time 2:25h - mrr-daily-3n-dnv: 144 TCs, expected exec. time 6:35h + add some missing test suites + add trex-sl-2n-ethip4udp-1000u15p.py T-Rex traffic profile + correction of TS and TC names and tags in directory tests/vpp/perf/nfv_density/chain_ipsec Change-Id: Icfc86e9af97ed8dd8ccd2a34355c99aad69a28c0 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2020-01-10Support suite tags in autogenVratko Polak501-23/+674
+ Include a script to add suite tags to many suites at once. + Add suite tags also to device tests (not covered by autogen). Change-Id: I514ee6178e22999b43460028fe2696738b012f04 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2020-01-10Autogen: Generate also NIC drivers.Vratko Polak223-4089/+465
+ Disallowed -avf- (or -rdma-) as "template" suites. + GBP suite switched to DPDK driver in repo. + Each NIC has its own list of supported drivers, in Constants. + Updated tag expressions for daily jobs: + Feature, ipsec, memif, scale, srv6, tunnels, vhost and vts are tested only with vfio-pci. + Other (base, dot1q, dot1ad) tested with all drivers. + Setup actions currently depend on driver, generated. - The performance_rdma action is trivial for now. - Several tests fail, to be fixed later, e.g. by performance_rdma. + Reconf tests are also supported. + Added DRV_VFIO_PCI tags missing, mainly in density tests. - Vhost suites (density, reconf) are failing, but suites look good. - TCP suites do not support NIC drivers yet. - DPDK obviously not supported. + Use Python 3 in regenerate scripts. + Fix typos binded => bound. + File open modes set either u"rt" or u"wt" everywhere. + Remove a trailing space in an environment variable name. Change-Id: I290470675dc5c9e88b2eaa5ab6285ecd9ed7827a Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2020-01-15Report: Current vs. Previous Release - NFV TestsTibor Frank2-0/+202
Change-Id: I00cbde38b8f900efe3e3123a942de2288381ea3b Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-01-15Hoststack perf infrastructure refactoringDave Wallace19-80/+1067
- DUT only topology (hoststack test apps are co-located with vpp) - Make vpp app specific keywords generic where applicable - Add IP4 Prefix to topology file - Support running wrk in linux namespace - Refactor namespace cleanup - Remove redundant namespace creation code - Refactor test/keyword dirs: tcp -> hoststack - Add hoststack utility keywords - Refactor wrk suite setup/teardown - Update tests with recent perf infra changes Change-Id: Ia1cf07978d579393eef94923819a87c8c1f36f34 Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
2020-01-14FIX: VXLAN scalePeter Mikus1-3/+5
+ Another stupid arp -> neighbor rename Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Ia873d6c2a485659033f71cdf546782db74787d13
2020-01-14FIX: NF_density testsPeter Mikus1-2/+2
+ ARP -> Neighbor Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I74044bd7db6cb4b1bd3648a424e9c8f1473be8d1
2020-01-14Update comments in crc file.Vratko Polak1-5/+4
+ L2patch is already covered. + RDMA is not device testable yet. Change-Id: I1dcccfcb340a8fe61c20d3516340e26db293cfaa Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2020-01-14Report: Add VNF Service Chains TunnelsTibor Frank6-333/+989
Change-Id: Iafdcb543f6adc583567a05aa5a882dce17b58f03 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-01-13FIX: NF_density testsPeter Mikus5-9/+9
+ Because arp->neigbor was so important to do. Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I552e175b7555ebf5053d7994c0c9173c0c96fc58
2020-01-13Report: Move VTS tests from 3n to 2nTibor Frank18-808/+203
Change-Id: Ie2faa6cb611d372c4a20584f7b40f3281660f2b1 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-01-13CSIT-1597 API cleanup: rdmaJan Gelety4-247/+21
- cover API changes in VPP: https://gerrit.fd.io/r/c/vpp/+/24225 - update vpp stable to version 20.01-rc0~1011 Change-Id: Ibbfdbe867cf89715619efc5c5507859983025ece Signed-off-by: Jan Gelety <jgelety@cisco.com>
2020-01-10Report: Add comparison tablesTibor Frank6-212/+1035
CSIT-1654 Change-Id: I280195b295d4fc717cb355e78c5f1731bb1eabe5 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-01-10Report: Add 2n-clxTibor Frank113-76/+7624
Change-Id: I34dc11c28d21f0b9fed87d76942fe8b8cdd86c88 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-01-09FIX: Container testPeter Mikus2-9/+15
+ We should check if container is UP + We should adjust privileges. Change-Id: I3f604b7b9740943b4fd3b0574c18d2729e88b816 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2020-01-09Report: Configure Report 2001Tibor Frank12-93/+25
Change-Id: I5ef3c37cf329b76a1a7f94d60c3563872eef3c5d Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-01-09DMM: RemoveTibor Frank27-1302/+7
Change-Id: Ibbfbed79e473c804390802ae1ecd737b50c06aa3 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-01-08API: Add collection for 24225/3Jan Gelety1-8/+8
Change-Id: I5c4593d05dbcb4d918611dc7520432a446dbf664 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2020-01-08PAL: Set y-axis for HDRHistogramTibor Frank1-3/+4
Change-Id: Ibdee625d6d9215b18771a6348735dc6a07e9ae58 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2020-01-08Track real(er) duration of trafficVratko Polak1-0/+7
+ Print duration. - Missing: Parse duration. - We do not have good formula to compensate, yet. Change-Id: I1c76ac35ce531b1994480d6aa0638f16992231f5 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2020-01-07T-Rex: Upgrade to 2.73 with DDP profile fixPeter Mikus6-12/+7
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Icaa99e0a71a19ba23697c21a4b5aa046813a718a
2020-01-07Vhost: Add GSO optionPeter Mikus5-14/+39
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Iba9af71c293645b480203af72fcf940cbe9ccb3a
2020-01-07Fix Trex start configurationVratko Polak2-12/+21
Since https://gerrit.fd.io/r/c/csit/+/24056 csit-vpp perf tests are failing. Turns out the reason is too large limit_memory value, but other improvements applied during investigation are included as well. + Cat trex.log if trex fails to start. + Improve trex startup command formatting (remove double spaces). + Reorder imports. Change-Id: I2c1106ea6f88a1a275682e73eba212d08c7947c8 Signed-off-by: Vratko Polak <vrpolak@cisco.com>