aboutsummaryrefslogtreecommitdiffstats
path: root/resources/libraries
AgeCommit message (Collapse)AuthorFilesLines
2016-11-04CSIT-457: Address Honeycomb test failuresselias9-115/+131
- tag all not-implemented features with EXPECTED_FAILING - add workarounds for known issues with VAT dump commands - replace hardcoded test data with parametrized - separate IP neighbor and IP address into two test cases - support unordered lists with compare_data_structures keyword Change-Id: I2c683162325cee720ba496489787fa50e9c72b8c Signed-off-by: selias <samelias@cisco.com>
2016-11-03CSIT-245: IPv6 - ip4-lispgpe-ip6Zdeno Olsovsky1-6/+14
Change-Id: Ie88cadfc2eab31cd1f411b9648b1a3515e4baa89 Signed-off-by: Zdeno Olsovsky <zolsovsk@cisco.com> Signed-off-by: Matej Klotton <mklotton@cisco.com>
2016-10-31CSIT-385 CSIT-386 IPv4/IPv6 IPsec testsPatrik Hrnciar2-2/+50
- encryption/integrity key update tests Change-Id: Iddbe35e2f421b5048e60663bff2b0bf1968a9782 Signed-off-by: Patrik Hrnciar <phrnciar@cisco.com> Signed-off-by: Matej Klotton <mklotton@cisco.com>
2016-10-27Increase timeout for 'vpp restart' operationsMiroslav Miklus1-2/+2
Systemd first send SIGTERM and wait 90s (default value) to send SIGKILL to terminate the vpp service. Change-Id: Ia582cfdc4bebc5d3530e82692856fe733d0b001e Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2016-10-27Revert "Use 3 tries to prepare DUT for testing"Dave Wallace1-3/+1
This reverts commit d551ef4b72448c3ccb493559826b976a2d3d8649. Change-Id: Icff3a98b96298385a2e4789d40ef60d70f440492 Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
2016-10-26Use 3 tries to prepare DUT for testingJan Gelety1-1/+3
- workaround to deal with occasional vpp restart issue Change-Id: I74a9148045bf4f80c9ba943e9c74338e08b2a72e Signed-off-by: Jan Gelety <jgelety@cisco.com>
2016-10-26CSIT-395 Update TRex version to v2.09pmikus1-7/+9
- Update TRex to v2.09 Change-Id: I53221aff346840e0438dd1385cedd1db57ca5f3b Signed-off-by: pmikus <pmikus@cisco.com>
2016-10-25CSIT-453: Switch Nested VM to 1.4 in perfpmikus1-6/+2
Currently in performance testing we are using Nested VM v1.3 with DPDK16.07. This patch will change the Nested VM to version 1.4 which includes DPDK16.09. Change-Id: I7cf2edda09f677ad9ddd3cc882000b9537bcc74c Signed-off-by: pmikus <pmikus@cisco.com>
2016-10-24Use only Qemu Kill on the teardown of double qemu setupJan Gelety1-7/+1
- do not use Qemu System Powerdown or Qemu Quit in the teardown of double qemu setup - use just Qemu Kill there Change-Id: I8dd1e4055e0adb5d306e3a9904090a271d17c3e5 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2016-10-24CSIT-452: Switch Qemu binary to Ubuntu defaultpmikus1-1/+1
- Switch Qemu binary to default path and remove building qemu in performance jobs Change-Id: I5e8bb510beb672d034699192a7c454c56f2d2581 Signed-off-by: pmikus <pmikus@cisco.com>
2016-10-20CSIT-427: Honeycomb ietf-ACL tests - L4 and misc.selias5-31/+27
- add test cases for: L4 port range ACLs multiple classify rules L2 ACL on egress interface - add L4 configuration to mixed ACL test - add test variables for new test cases - update HTTPRequests to treat code 201 as a positive response Change-Id: If43007545fec174af12dab594f8a1b15b2e4a536 Signed-off-by: selias <samelias@cisco.com>
2016-10-20CSIT-427: Honeycomb ietf-ACL tests - mixed layersselias2-11/+25
- add test cases for mixing L2 and L3 rules - update methods with mixed-acl functionality - update test variables Change-Id: I2aaa3033eede609627f751ea896e098548ffae98 Signed-off-by: selias <samelias@cisco.com>
2016-10-20CSIT-427: Honeycomb ietf-ACL tests - L3selias1-27/+36
- add test cases for layer 3 ACL - IPv4, IPv6, protocol/next-header - update methods with L3 functionality - update test variables Change-Id: Ia7ec03268845191021366621040dc411da0a2a93 Signed-off-by: selias <samelias@cisco.com>
2016-10-20CSIT-427: Honeycomb ietf-ACL tests - L2selias7-10/+298
- add keywords for accessing Honeycomb's ietf-acl node - add variable file with ietf-acl test data - add ietf-acl traffic test suite - modify bridge domain teardown keyword to unassign interfaces from the bridge domain before delete Change-Id: I6df1771f2fb9b42f30b5af8f54a384c6714f5949 Signed-off-by: selias <samelias@cisco.com>
2016-10-20Add topology method for generic handling of interface referencesselias1-1/+78
- add "convert_interface_reference" to topology.py This is a convenience method, mainly intended for Honeycomb tests which often require conversions between interface key, name and sw_if_index. Change-Id: I427736111f2a1dc07a581c9ccc25e181065bb6fd Signed-off-by: selias <samelias@cisco.com>
2016-10-19T-REX installer preserve env variablesMiroslav Miklus1-1/+1
This can be usefull for variables like http_proxy. Change-Id: I31128d2a57c961c6d888b6693b68fb57bde11436 Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2016-10-17FIX: LISP performance 6o4 failingpmikus1-2/+2
Change-Id: I08cecbe8310fd21356287ffbb33c3be58b721f10 Signed-off-by: pmikus <pmikus@cisco.com>
2016-10-14CSIT-351: Testing Ubuntu 16.04.1 changespmikus4-8/+7
- Update the repository to get xenial packages - Update phy topology files with new pass - Update bootstrap to use new VIRL image - Update framework to reflect 16.04 dependencies - CSIT-116: Modify VIRL username/password Change-Id: I4de44755170fd0481acef34c7c2d9c299bc300da Signed-off-by: pmikus <pmikus@cisco.com>
2016-10-10Ipv6 TEST fixesMiroslav Miklus3-7/+5
- Increase interactive terminal timeout - ip6 heapsize - performance lib fix Change-Id: Iac6beb041200c4b0c5cf29dceb5113df64c6c9b0 Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2016-10-10CSIT-392: ip4-lispgpe-ip4Tibor Frank1-0/+20
- ip4-lispgpe-ip4 - main fib, vrf, virt2lisp Change-Id: I28c81e91689021693ce76352878fa21e953a4ef6 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2016-10-07CSIT-247: IPv6 - ip6-ipsec-lispgpe-ip6 - main fib, phy2lisp, virt2lispZdeno Olsovsky1-0/+52
Change-Id: I039e14b7c227318c70826068368430978f8f0a51 Signed-off-by: Zdeno Olsovsky <zolsovsk@cisco.com>
2016-10-07CSIT-257: L2enc - l2-eth-lispgpe-ip4 - L2BDZdeno Olsovsky2-6/+126
Change-Id: I0ee68f707c4175940538654f3a4bbd7d1a91bef1 Signed-off-by: Zdeno Olsovsky <zolsovsk@cisco.com>
2016-10-05CSIT-176 Fix interactive SSH console deadlockpmikus1-17/+24
Change-Id: Iba291d6781238c0e880534195ff65a7b3c4bede1 Signed-off-by: pmikus <pmikus@cisco.com>
2016-10-05IPv4 2M scale tests - adjust heapsize to 3GMiroslav Miklus1-0/+10
Change-Id: I78e700e2137fd35d79c9b6b5ba27bb21adc3f6fa Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2016-10-04CSIT-227, CSIT-240 IPv4/IPv6 Multipath routing testsPatrik Hrnciar2-3/+56
- add IPv4 Equal-cost multipath routing test - add IPv6 Equal-cost multipath routing test Change-Id: I62eaf9983b7767e124f80af7d8c8652ffc460cf8 Signed-off-by: Patrik Hrnciar <phrnciar@cisco.com>
2016-10-04Fix pylint warnings in python librariesselias15-88/+205
- no functional changes - fixes 80+ PEP-8 violations Change-Id: Icf414778ec40d5cb44364fa69a876f9a1870c3c7 Signed-off-by: selias <samelias@cisco.com>
2016-10-04Interactive terminal fixesMiroslav Miklus2-6/+14
- remember if execution timed out and do not try to send "quit" on close - increase timeout of vat command execution from 10s to 60s Change-Id: I2b96a6dce1220eff45002276d1fe8a771fca2205 Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2016-10-03CSIT-231: ip4-ipsec-lispgpe-ip4Tibor Frank1-0/+75
- main fib, - vrf, - phy2lisp Change-Id: I9fd97462f0b290dab860ac601fbb37b4cecfb909 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2016-10-03CSIT-235: Switched Port Analyzer mirroring (SPAN) - IPv4selias6-1/+117
- add library for SPAN setup - add telemetry traffic script and a keyword to run it - add "telemetry" folders for python and robot libraries - move IPFIX libraries to these new folders - add first SPAN test case, mirroring IPv4 ICMP packets Change-Id: Ibca35f724c13662bf80dce2d7e2649d1a0b8676a Signed-off-by: selias <samelias@cisco.com>
2016-10-03INMARSAT-54 Honeycomb configures PBBpmikus3-3/+218
- CRUD tests usinf Honeycomb REST API Change-Id: I4885cd0feb26f8ef56beb0d8848772ea2d42cb3a Signed-off-by: Tibor Frank <tifrank@cisco.com>
2016-10-03CSIT-405: Honeycomb test update and cleanupselias9-22/+113
- update suite setup and constants to allow test runs again - cleanup basic interface keywords - cleanup L2-fib test data - add "continue on failure" keyword to some partially failing tests - add teardown to all suites, restarts honeycomb if suite had test failures - fix minor PEP-8 violations in Topology.py Change-Id: Ic5b434af71f77855f81461b280299b8318932c5a Signed-off-by: selias <samelias@cisco.com>
2016-10-03LISP - implement changes done in VPP-376Tibor Frank2-30/+36
Change-Id: Ia9f7913522421b6fd9ecba18eb4d68bc0f3b3271 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2016-10-03CSIT-416: Remove performance rate variablespmikus1-164/+0
Change-Id: I15ee953990f2ac11be361f3d0954bc12b3a9351d Signed-off-by: pmikus <pmikus@cisco.com>
2016-09-29Enable paramiko ssh keepalive (10s)Miroslav Miklus1-0/+2
Change-Id: I1e46ad76f033d239ad29d3b6fe00011a4444453d Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2016-09-28Add automated deployment of Honeycomb on DUTsTibor Frank1-0/+54
JIRA: CSIT-56 - create bootstrap_vpp_honeycomb.sh script which deploys VPP and Honeycomb on DUTs - Modify start-testcase script Change-Id: I88511479cb8681168675c934f4fccbea83fa34bc Signed-off-by: Tibor Frank <tifrank@cisco.com>
2016-09-26Fix drop rate search for worst of nStefano Chiesa1-1/+1
Change-Id: Ie98ab1095dedb4c24dbd44f64d3781934f664561 Signed-off-by: Stefano Chiesa <ssuryant@cisco.com>
2016-09-25Use tmp directory for log filesJan Gelety1-2/+2
- store log files in tmp directory and exclude all files in this directory from archiving when creating tarballs Change-Id: Ie3e11670c9d466c5fcf41d03ccd0a7bbb04ffeb0 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2016-09-24CSIT-412 replace latency (N/A) string by number -1Miroslav Miklus1-11/+2
Change-Id: Id6373d3bbfcc42e315976b59aa86c6cadee411f1 Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2016-09-22CSIT-411 Show Vhost Userpmikus2-0/+17
- Add keyword to show vhost user Change-Id: Ia844bbcb8507b8c7cbf6b7bb1a7dc8d10148d6f4 Signed-off-by: pmikus <pmikus@cisco.com>
2016-09-21Measure latency returns -1 if rate<=10kppsMiroslav Miklus1-16/+17
Change-Id: I25dca3e6ce7da1304211d87f1af72fceda6dc23b Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2016-09-21CSIT-360: Fix: Parallel test sets run.Matej Klotton1-6/+9
- fix typos Change-Id: I5292b27ae584c86cb4986df5439bdebd5fa40b67 Signed-off-by: Matej Klotton <mklotton@cisco.com>
2016-09-20Documentation fix - show statsMiroslav Miklus1-1/+1
Change-Id: Ib5f3dc697d1da6a86b70c5ba7d8ea8711a2fc492 Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2016-09-20CSIT-360: Parallel test sets runJan Gelety1-1/+11
- use parallel test set runs on as many VIRL sessions as needed for defined test sets Change-Id: I7640f15894a1451aba963989fab4dc838f2ab6d8 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2016-09-15CSIT-408 sub-NDR latency measurementsMiroslav Miklus3-15/+97
- measure latency at 10% and 50% of found NDR. - fix the accuracy reported by T-REX (round to usec) Change-Id: I9fe2b5f942cb816db6fd0bb4262b48b8da6dac2f Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
2016-09-15CSIT-404 Adjust DPDK testpmd startup parameterspmikus2-19/+25
Change-Id: If0f58e725e15aa01b61bc43b222c6254af9cd07e Signed-off-by: pmikus <pmikus@cisco.com>
2016-09-14CSIT-241: IPv6 Router Advertisementselias1-5/+44
- add traffic script to verify Router Solicitation response - add keyword to execute traffic script - add test case 02: retransmit RA message after set interval - add test case 03: respond to RS request Change-Id: I83d742713ae42d0a1baacf460c29c06d32669b9a Signed-off-by: selias <samelias@cisco.com>
2016-09-12CSIT-384: IPSEC IPv6 negative test casesJan Gelety1-1/+1
- use integrity and/or encryption key(s) different from integrity and encryption keys stored on VPP node to create tx packet on TG Change-Id: I0f02523ec7649b8a1555869bdc4b7090b7585cac Signed-off-by: Jan Gelety <jgelety@cisco.com>
2016-09-12CSIT-383: IPSEC IPv4 negative test casesJan Gelety3-8/+15
- use integrity and/or encryption key(s) different from integrity and encryption keys stored on VPP node to create tx packet on TG Change-Id: I38bf7e1dd6f488e605bad991c7a7f4d1ff226e8c Signed-off-by: Jan Gelety <jgelety@cisco.com>
2016-09-12Fix of Qemu issuesJan Gelety1-0/+2
- use path to IPUtil where KWs "Setup Network Namespace" and "Set Linux Interface IP" are used Change-Id: I012cb7df4b871353aa68c10ca7069de7a2ab5d3b Signed-off-by: Jan Gelety <jgelety@cisco.com>
2016-09-08CSIT-390 Replace rate calculation Ipmikus1-0/+1
- Replace static max rate variables by calculation of max rate based on nic limits Change-Id: I0f7f7e46c6f46f87dfa5f34b9b9fdb4610513081 Signed-off-by: pmikus <pmikus@cisco.com>