aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2019-11-11Remove the leftovers of the old testbed cleanupVratko Polak3-152/+2
Change-Id: I464db6fb6c220f23f2fe69df2c793175975d7b72 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-11-11Add accidentally deleted NAT setup commandVratko Polak1-0/+1
One suite was missing "And Add NAT to all DUTs". Change-Id: I6e9c3de9f236a080cfe829db2d155a6f6ba3b3f4 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-11-11FIX: do not use ping in vpp-device testsJan Gelety25-345/+332
Change-Id: Ic11f863e7ffad70d45e6e8dc39c70efc62cecc96 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-11-11FIX: Paths for new Docker imagesPeter Mikus2-10/+10
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Ia39ff6445e4029a78d008d5690661610a1e9ed50
2019-11-11FIX: 2lbvpplacpPeter Mikus4-4/+0
- These testcases are non standard so they need to be refactored to be able to use the interface layers Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I9400846ff04f1864babd6d7fa153f0c3708cb105
2019-11-08Prevent many TC triggered by bad tag expressionsVratko Polak1-2/+8
Typical example: Use multiple perftest lines in a comment. Atypical example: Use perftest as an expression (without any ANDs). Fix: Die if "perftest" is found in the tag expression (before prefixing). Change-Id: I0230541b30557ce7a4e9d57c8303cd432f86747d Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-11-07FIX: use correct NIC for mr-daily-master jobJan Gelety1-1/+1
Change-Id: I57bc8c7eda7ea959d92f7e35b7989d64b20743a0 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-11-08FIX: Small ansible fixesPeter Mikus3-2/+2
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I55e0f8c28ea166464026b61e3fd2b18faf8744f2
2019-11-07Source ansible.sh for entry scripts using cleanupVratko Polak2-0/+4
Change-Id: Iee02577ee0c054feb61edee807182c6808f235b0 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-11-05Cleanup via AnsiblePeter Mikus17-763/+320
+ Remove dependency on topo_ scripts that depends on custom SSH() that depends on framework itself. This way the cleanup is independent of failure in our SSH libs. + Simple ansible command can do cleanup of a machine: ansible-playbook --inventory inventories/lf_inventory/hosts site.yaml \ --limit '10.32.8.18' --tags 'cleanup' + Add vpp_device reset and cleanup. + Remove historical scripts. - Still in testing beta phase. - Need to add SRIOV cleanup. Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I68e23304c7ad01041f51263c328c6e8d9b555cb7
2019-11-04Trending: Fix alertsTibor Frank1-1/+1
Change-Id: I0f54bbf34493cab927408aa1da7d855ce15db061 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-10-29New daily triggersJan Gelety6-12/+285
New daily triggers defined based on requirements defined in https://gerrit.fd.io/r/c/csit/+/22341/34/resources/tools/presentation/doc/trending_test_groups.md Change-Id: I95bff10d9a2e29c712a33f7c043933244b712fd0 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-10-31Regularize spaces in crc listVratko Polak1-12/+12
Two spaces before hash if after quote, single space otherwise (or 4 spaces if the hash is commenting out the whole line). Change-Id: Icee85996a00e4e31ce61ad5030f4cdbedeacd506 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-10-31Copy missing lines to second CRC collectionVratko Polak1-0/+4
Change-Id: If8fa609bf0c58ad0cc63a8320f298c026f8b7900 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-10-30Framework: Add show log as tear down actionPeter Mikus3-13/+26
+ We can see what is happening when debug level is increased + Big caveat of VPP is that it does not allow to configure default global level. Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I5ea1a618161cdb3170cab022d7451e52271f83c0
2019-10-30Add: Use containers for shared TGPeter Mikus8-6/+108
+ Ansible + Service for auto load during restart + By default created 2 instances of Docker container + Small modification of Trex to use prefixes + DNV topology to use ssh port to connect to docker Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Ibc2b2f0e509d920fc3e05d012b88abc388f5c3e7
2019-10-30FIX: IPSecHWPeter Mikus8-16/+0
- IPsec proto is not for GCM Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: If6a9721574a72dacb4486c837100e4f2ed2bab19
2019-10-29API: Add collection for 21551/12Jan Gelety1-0/+235
Change-Id: Ia1232a71378f925110741ad9f914d8c5abd6941e Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-10-28TrafficGenerator: Skip only the first equalsVratko Polak1-5/+5
HRDhistogram output contains essential trailing equals. Edit all fields even though we do not expect equals in others. Change-Id: I9f4f07fc4d6f4583989a9c0e45f68bc0cd9a65fe Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-10-28PAL: Add sortable html table for comparisonsTibor Frank5-43/+300
Change-Id: I2d690685c5728e5f36b09d542e0f6d1a08cd151a Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-10-25FIX: Limitation for NICsPeter Mikus2-5/+20
Change-Id: I8e0a14f59e20d61096e069bb80a0e2c00977ac5c Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-10-25ADD: Mellanox RDMA interface supportPeter Mikus5-11/+59
+ Add functions for creating rdma interface + Fix traffic generator Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I81787b72ff5ee926ed652d350888c4f86da766f1
2019-10-25Introduce pre-initialize driver layerPeter Mikus486-2732/+3421
+ This will help unify driver base differences between TCs. + Decrease amount of logic needed for suite generator. Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I1e84ba361dc1e829f0612c58a61096e2633ce0c5
2019-10-21CRCs: Update comments and improve CSIT checks.Vratko Polak2-77/+101
+ Restore alphabetic order in yaml. + Mark the lisp messages verified to be covered by dev instead of virl. + Mark the GBP messages verified by devicetest now. + Mark acl_add_replace as dev and create_subif as perf. + Mark ip_probe_neighbor as unused L1. + Improve loadbalancer comments. - Nat4 testcase is described, even if not merged yet. + Forget reported CRC after initial dir report, and report them again (once) in test cases (if hit). With this, single run (with fail on crc off) gives full info. + Small improvements to CRC library docstrings and messages. Change-Id: Ic1cfad45e10d437be827af2a89eac49e25267b59 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-10-10Update of VPP_STABLE_VER filesJan Gelety3-3/+3
- use new vpp ref build - ubuntu 16.04: 20.01-rc0~453-g349cd1a~b8252 - use new vpp ref build - ubuntu 18.04: 20.01-rc0~453-g349cd1af7 - use new vpp ref build - centos7: 20.01-rc0~453_g349cd1a~b8066 Change-Id: I083e3b66fa52f4aab1883d0a9855d3be8c64c671 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-10-19Tests: Introduce driver layerPeter Mikus483-504/+1433
+ Small bugfixes in various suites Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I051af0a6da7340fe3f617400370c3846ca5241ab
2019-10-18Autogen checker: Fix difference reporting branchVratko Polak1-2/+3
Change-Id: I85da5ec38643524fa1af7ed7628025a4a52463f5 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-10-18Trending: reduce input dataTibor Frank1-159/+159
Change-Id: I931c4140b3a6ced30030e4573fdd77e80987f972 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-10-17FIX: Migrate VPP device Centos imagePeter Mikus1-1/+1
+ Migrate to new image Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Ib08c5169daac76b0b4c97da3faa40585aeafbc60
2019-10-17Ansible: Role cleanupPeter Mikus26-145/+216
+ Separate and reuse role (better naming) + Cleanup in naming + Introduce defaults that can be overriden Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Iedaf7caba1d05a35a6f61cd21a483cdbc0073d32
2019-10-16Core-keeper: Process files instead transferPeter Mikus1-23/+9
+ Instead of transferring large files, post-process directly via CSIT. Extract backtrace as a start point. Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I79ad760d310c95d807242ad1997dd657d5142459
2019-10-16Ansible: Clean Python requirementsPeter Mikus9-122/+99
+ minor cleanup Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Iff9c643f6e9b52dc6a11b04624452f115f3a834e
2019-10-16VPPD: GBP test casePeter Mikus3-3/+243
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I020cdb6ced70a9c22773dfbe1662aecd2b744d2d
2019-10-14Ansible: Mellanox installPeter Mikus8-105/+152
+ OFED + ibdev2netdev - aligning few naming conventions Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I0dff28b2cd4bbc4753597366d9b03b497fa336c4
2019-10-11Add: Parsing of show run over PAPIPeter Mikus1-53/+71
+ Add parsing of show run over PAPI STATS + Add missing outputs vs show run over CLI Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I88555ff4266d41ae1d9436181aad5c324ea9dab4
2019-10-11Trending: Reorganization of tests in graphsTibor Frank1-0/+951
Change-Id: I41ddcb65d099294c5ae510b2a5f237de973e27b7 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-10-11Trending: Generate email body for regressions and progressionsTibor Frank3-16/+52
Change-Id: Iee652fc48b574b7866d5e7f0b7b927f96de3d25f Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-10-09Update of VPP_STABLE_VER filesJan Gelety4-240/+5
- use new vpp ref build - ubuntu 16.04: 20.01-rc0~375-g3ae9f5a~b8172 - use new vpp ref build - ubuntu 18.04: 20.01-rc0~375-g3ae9f5a90 - use new vpp ref build - centos7: 20.01-rc0~375_g3ae9f5a~b7986 Change-Id: I16cf7e9db8f5b6c4f94786b089a1686c823cc1bd Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-10-09FIX: AnsiblePeter Mikus3-9/+9
+ Cover all CSIT devices with netplan to prevent DHCP usage + Move netplan to common role Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Ic3790f8ff770edf64b4066f8ddb99454643f5846
2019-10-09Add vpp loadbalancer maglev mode test suitehaiyanX1.zhang8-0/+514
Change-Id: I61555ba566efef0a2151db9a30bf7f5d9ccad1df Signed-off-by: haiyanx1.zhang <haiyanx1.zhang@intel.com>
2019-10-09FIX: Add SRIOV cleanupPeter Mikus1-3/+5
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I344cbab78e1491b1dc0b64598f1eae23c8d2cdcf
2019-10-07Trending: Send alerts when regression occursTibor Frank3-30/+53
Change-Id: I45d218ea323245199ad5093bd64c6a9bd862cad9 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-10-07FIX: LXC tmpfs mountPeter Mikus1-5/+11
- Should fix the read/write to socket for LXC Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I56a84145cf2fb95742423789681ca2e24ddf0c98
2019-10-04FIX: put back the correct value of FAIL_ON_CRC_MISMATCH constantJan Gelety1-2/+1
Change-Id: Ia395cfbc5325d292bf8c32bb24e9a1478c140780 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-10-04Update of VPP_STABLE_VER filesJan Gelety5-4/+9
- use new vpp ref build - ubuntu 16.04: 20.01-rc0~324-g66a332c~b8122 - use new vpp ref build - ubuntu 18.04: 20.01-rc0~324-g66a332cf1 - use new vpp ref build - centos7: 20.01-rc0~324_g66a332c~b7936 Change-Id: I82c6032742939417914f5210b1fba4464ab1e70d Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-10-07Report: Set the backgroud of graphsTibor Frank1-0/+12
Change-Id: Icd5f2ed496128b4cdc5f1113c778f66bbef5def3 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-10-04FIX: Add SRIOV cleanupPeter Mikus1-11/+19
If Jenkins interrupt pybot during AVF tests (that is happening more frequently as coverage increased) the interfaces remains in link UP state. Next run VPP cannot grab interfaces as they are in UP state in and kernel driver. This results in testcase failing. Patch is supposed to do put interfaces in topology down so VPP can bind them back to vfio-pci. Change-Id: I2aa9e5944d39474965eac3c5f1b472f58e9aa8b5 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-10-04FIX: use int of sw_if_index in call of sw_interface_set_flags apiJan Gelety1-1/+1
- it will avoid situation that corresponding port is not up and its sw_if_index value in topology file is None that is interpreted as 0 in vpp api so it set flag for local0 interface Change-Id: I9145077d787ddde50a29bcd4091035e95077f946 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-10-04FIX: IPv6 AVF dot1qPeter Mikus2-2/+4
Change-Id: Id199eb774850153fb225434d4a3d194706fdfdb3 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-10-03Trending: Report also nr of passed tests in emailTibor Frank3-128/+172
Change-Id: I7ae188f5f684bd93352255d6b5c491b6d78c822c Signed-off-by: Tibor Frank <tifrank@cisco.com>