aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2019-11-13Add vpp loadbalancer l3dsr/nat4 mode test suiteshaiyanx1.zhang6-17/+413
Change-Id: I03603108fe7128fb4bde4abddb6a0959dd5b5c73 Signed-off-by: haiyanx1.zhang <haiyanx1.zhang@intel.com>
2019-11-13Trending: Input dataTibor Frank1-206/+159
Change-Id: I9b1060cb6162521bfdfe4b875444dc09c109960d Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-11-11New weekly mrr triggerJan Gelety2-433/+5
Change-Id: Iff21ad109e5f0a8ed06bd561e75c8a708e84c036 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-11-12FIX: Supervisor initializationPeter Mikus1-22/+21
- Next step: remove supervisor entirely Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I7ff5d76168d5d0f77e335975552638efac77cfc8
2019-11-11Remove the leftovers of the old testbed cleanupVratko Polak3-152/+2
Change-Id: I464db6fb6c220f23f2fe69df2c793175975d7b72 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-11-11Add accidentally deleted NAT setup commandVratko Polak1-0/+1
One suite was missing "And Add NAT to all DUTs". Change-Id: I6e9c3de9f236a080cfe829db2d155a6f6ba3b3f4 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-11-11FIX: do not use ping in vpp-device testsJan Gelety25-345/+332
Change-Id: Ic11f863e7ffad70d45e6e8dc39c70efc62cecc96 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-11-11FIX: Paths for new Docker imagesPeter Mikus2-10/+10
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Ia39ff6445e4029a78d008d5690661610a1e9ed50
2019-11-11FIX: 2lbvpplacpPeter Mikus4-4/+0
- These testcases are non standard so they need to be refactored to be able to use the interface layers Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I9400846ff04f1864babd6d7fa153f0c3708cb105
2019-11-08Prevent many TC triggered by bad tag expressionsVratko Polak1-2/+8
Typical example: Use multiple perftest lines in a comment. Atypical example: Use perftest as an expression (without any ANDs). Fix: Die if "perftest" is found in the tag expression (before prefixing). Change-Id: I0230541b30557ce7a4e9d57c8303cd432f86747d Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-11-07FIX: use correct NIC for mr-daily-master jobJan Gelety1-1/+1
Change-Id: I57bc8c7eda7ea959d92f7e35b7989d64b20743a0 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-11-08FIX: Small ansible fixesPeter Mikus3-2/+2
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I55e0f8c28ea166464026b61e3fd2b18faf8744f2
2019-11-07Source ansible.sh for entry scripts using cleanupVratko Polak2-0/+4
Change-Id: Iee02577ee0c054feb61edee807182c6808f235b0 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-11-05Cleanup via AnsiblePeter Mikus17-763/+320
+ Remove dependency on topo_ scripts that depends on custom SSH() that depends on framework itself. This way the cleanup is independent of failure in our SSH libs. + Simple ansible command can do cleanup of a machine: ansible-playbook --inventory inventories/lf_inventory/hosts site.yaml \ --limit '10.32.8.18' --tags 'cleanup' + Add vpp_device reset and cleanup. + Remove historical scripts. - Still in testing beta phase. - Need to add SRIOV cleanup. Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I68e23304c7ad01041f51263c328c6e8d9b555cb7
2019-11-04Trending: Fix alertsTibor Frank1-1/+1
Change-Id: I0f54bbf34493cab927408aa1da7d855ce15db061 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-10-29New daily triggersJan Gelety6-12/+285
New daily triggers defined based on requirements defined in https://gerrit.fd.io/r/c/csit/+/22341/34/resources/tools/presentation/doc/trending_test_groups.md Change-Id: I95bff10d9a2e29c712a33f7c043933244b712fd0 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-10-31Regularize spaces in crc listVratko Polak1-12/+12
Two spaces before hash if after quote, single space otherwise (or 4 spaces if the hash is commenting out the whole line). Change-Id: Icee85996a00e4e31ce61ad5030f4cdbedeacd506 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-10-31Copy missing lines to second CRC collectionVratko Polak1-0/+4
Change-Id: If8fa609bf0c58ad0cc63a8320f298c026f8b7900 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-10-30Framework: Add show log as tear down actionPeter Mikus3-13/+26
+ We can see what is happening when debug level is increased + Big caveat of VPP is that it does not allow to configure default global level. Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I5ea1a618161cdb3170cab022d7451e52271f83c0
2019-10-30Add: Use containers for shared TGPeter Mikus8-6/+108
+ Ansible + Service for auto load during restart + By default created 2 instances of Docker container + Small modification of Trex to use prefixes + DNV topology to use ssh port to connect to docker Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Ibc2b2f0e509d920fc3e05d012b88abc388f5c3e7
2019-10-30FIX: IPSecHWPeter Mikus8-16/+0
- IPsec proto is not for GCM Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: If6a9721574a72dacb4486c837100e4f2ed2bab19
2019-10-29API: Add collection for 21551/12Jan Gelety1-0/+235
Change-Id: Ia1232a71378f925110741ad9f914d8c5abd6941e Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-10-28TrafficGenerator: Skip only the first equalsVratko Polak1-5/+5
HRDhistogram output contains essential trailing equals. Edit all fields even though we do not expect equals in others. Change-Id: I9f4f07fc4d6f4583989a9c0e45f68bc0cd9a65fe Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-10-28PAL: Add sortable html table for comparisonsTibor Frank5-43/+300
Change-Id: I2d690685c5728e5f36b09d542e0f6d1a08cd151a Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-10-25FIX: Limitation for NICsPeter Mikus2-5/+20
Change-Id: I8e0a14f59e20d61096e069bb80a0e2c00977ac5c Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-10-25ADD: Mellanox RDMA interface supportPeter Mikus5-11/+59
+ Add functions for creating rdma interface + Fix traffic generator Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I81787b72ff5ee926ed652d350888c4f86da766f1
2019-10-25Introduce pre-initialize driver layerPeter Mikus486-2732/+3421
+ This will help unify driver base differences between TCs. + Decrease amount of logic needed for suite generator. Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I1e84ba361dc1e829f0612c58a61096e2633ce0c5
2019-10-21CRCs: Update comments and improve CSIT checks.Vratko Polak2-77/+101
+ Restore alphabetic order in yaml. + Mark the lisp messages verified to be covered by dev instead of virl. + Mark the GBP messages verified by devicetest now. + Mark acl_add_replace as dev and create_subif as perf. + Mark ip_probe_neighbor as unused L1. + Improve loadbalancer comments. - Nat4 testcase is described, even if not merged yet. + Forget reported CRC after initial dir report, and report them again (once) in test cases (if hit). With this, single run (with fail on crc off) gives full info. + Small improvements to CRC library docstrings and messages. Change-Id: Ic1cfad45e10d437be827af2a89eac49e25267b59 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-10-10Update of VPP_STABLE_VER filesJan Gelety3-3/+3
- use new vpp ref build - ubuntu 16.04: 20.01-rc0~453-g349cd1a~b8252 - use new vpp ref build - ubuntu 18.04: 20.01-rc0~453-g349cd1af7 - use new vpp ref build - centos7: 20.01-rc0~453_g349cd1a~b8066 Change-Id: I083e3b66fa52f4aab1883d0a9855d3be8c64c671 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-10-19Tests: Introduce driver layerPeter Mikus483-504/+1433
+ Small bugfixes in various suites Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I051af0a6da7340fe3f617400370c3846ca5241ab
2019-10-18Autogen checker: Fix difference reporting branchVratko Polak1-2/+3
Change-Id: I85da5ec38643524fa1af7ed7628025a4a52463f5 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-10-18Trending: reduce input dataTibor Frank1-159/+159
Change-Id: I931c4140b3a6ced30030e4573fdd77e80987f972 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-10-17FIX: Migrate VPP device Centos imagePeter Mikus1-1/+1
+ Migrate to new image Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Ib08c5169daac76b0b4c97da3faa40585aeafbc60
2019-10-17Ansible: Role cleanupPeter Mikus26-145/+216
+ Separate and reuse role (better naming) + Cleanup in naming + Introduce defaults that can be overriden Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Iedaf7caba1d05a35a6f61cd21a483cdbc0073d32
2019-10-16Core-keeper: Process files instead transferPeter Mikus1-23/+9
+ Instead of transferring large files, post-process directly via CSIT. Extract backtrace as a start point. Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I79ad760d310c95d807242ad1997dd657d5142459
2019-10-16Ansible: Clean Python requirementsPeter Mikus9-122/+99
+ minor cleanup Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Iff9c643f6e9b52dc6a11b04624452f115f3a834e
2019-10-16VPPD: GBP test casePeter Mikus3-3/+243
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I020cdb6ced70a9c22773dfbe1662aecd2b744d2d
2019-10-14Ansible: Mellanox installPeter Mikus8-105/+152
+ OFED + ibdev2netdev - aligning few naming conventions Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I0dff28b2cd4bbc4753597366d9b03b497fa336c4
2019-10-11Add: Parsing of show run over PAPIPeter Mikus1-53/+71
+ Add parsing of show run over PAPI STATS + Add missing outputs vs show run over CLI Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I88555ff4266d41ae1d9436181aad5c324ea9dab4
2019-10-11Trending: Reorganization of tests in graphsTibor Frank1-0/+951
Change-Id: I41ddcb65d099294c5ae510b2a5f237de973e27b7 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-10-11Trending: Generate email body for regressions and progressionsTibor Frank3-16/+52
Change-Id: Iee652fc48b574b7866d5e7f0b7b927f96de3d25f Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-10-09Update of VPP_STABLE_VER filesJan Gelety4-240/+5
- use new vpp ref build - ubuntu 16.04: 20.01-rc0~375-g3ae9f5a~b8172 - use new vpp ref build - ubuntu 18.04: 20.01-rc0~375-g3ae9f5a90 - use new vpp ref build - centos7: 20.01-rc0~375_g3ae9f5a~b7986 Change-Id: I16cf7e9db8f5b6c4f94786b089a1686c823cc1bd Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-10-09FIX: AnsiblePeter Mikus3-9/+9
+ Cover all CSIT devices with netplan to prevent DHCP usage + Move netplan to common role Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: Ic3790f8ff770edf64b4066f8ddb99454643f5846
2019-10-09Add vpp loadbalancer maglev mode test suitehaiyanX1.zhang8-0/+514
Change-Id: I61555ba566efef0a2151db9a30bf7f5d9ccad1df Signed-off-by: haiyanx1.zhang <haiyanx1.zhang@intel.com>
2019-10-09FIX: Add SRIOV cleanupPeter Mikus1-3/+5
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I344cbab78e1491b1dc0b64598f1eae23c8d2cdcf
2019-10-07Trending: Send alerts when regression occursTibor Frank3-30/+53
Change-Id: I45d218ea323245199ad5093bd64c6a9bd862cad9 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-10-07FIX: LXC tmpfs mountPeter Mikus1-5/+11
- Should fix the read/write to socket for LXC Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I56a84145cf2fb95742423789681ca2e24ddf0c98
2019-10-04FIX: put back the correct value of FAIL_ON_CRC_MISMATCH constantJan Gelety1-2/+1
Change-Id: Ia395cfbc5325d292bf8c32bb24e9a1478c140780 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-10-04Update of VPP_STABLE_VER filesJan Gelety5-4/+9
- use new vpp ref build - ubuntu 16.04: 20.01-rc0~324-g66a332c~b8122 - use new vpp ref build - ubuntu 18.04: 20.01-rc0~324-g66a332cf1 - use new vpp ref build - centos7: 20.01-rc0~324_g66a332c~b7936 Change-Id: I82c6032742939417914f5210b1fba4464ab1e70d Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-10-07Report: Set the backgroud of graphsTibor Frank1-0/+12
Change-Id: Icd5f2ed496128b4cdc5f1113c778f66bbef5def3 Signed-off-by: Tibor Frank <tifrank@cisco.com>