summaryrefslogtreecommitdiffstats
path: root/scripts/automation/regression
AgeCommit message (Collapse)AuthorFilesLines
2017-01-31regression fix elkYaroslav Brustinov1-24/+22
Change-Id: I9c064305dac5907df0cc6cb15298ebcf0bd1a62a Signed-off-by: Yaroslav Brustinov <ybrustin@cisco.com>
2017-01-31regression: fill-in some of ELK fieldsYaroslav Brustinov3-41/+61
Change-Id: I0dced2fb88bcccabdfd8aef745d8408b389099a8 Signed-off-by: Yaroslav Brustinov <ybrustin@cisco.com>
2017-01-30regression: add global config file (currently ELK and GA info)Yaroslav Brustinov3-423/+40
Change-Id: I3b3158668059255b85e9da0af6dfc8e319894556 Signed-off-by: Yaroslav Brustinov <ybrustin@cisco.com>
2017-01-25Do not check latency on stateful regression for virt NICsIdo Barnea1-2/+2
Signed-off-by: Ido Barnea <ibarnea@cisco.com>
2017-01-25trex21 regression filesIdo Barnea2-0/+195
Signed-off-by: Ido Barnea <ibarnea@cisco.com>
2017-01-24Fixed support for i40evf + Refactor of VM driversIdo Barnea1-0/+6
Signed-off-by: Ido Barnea <ibarnea@cisco.com>
2017-01-23fix trex-333Hanoh Haim2-15/+26
Signed-off-by: Hanoh Haim <hhaim@cisco.com>
2017-01-22fix VMXNET3 regreesion issueHanoh Haim1-0/+9
Signed-off-by: Hanoh Haim <hhaim@cisco.com>
2017-01-22 reduce wiki02 performance noiseHanoh Haim1-6/+6
Signed-off-by: Hanoh Haim <hhaim@cisco.com>
2017-01-22Stateful - add short flow test with high active flow 8-4MflowsHanoh Haim4-0/+148
Signed-off-by: Hanoh Haim <hhaim@cisco.com>
2017-01-21typoYaroslav Brustinov1-2/+2
Change-Id: I6865ee1dd8ac43402e1d8a3e6ea9711040c2b29a Signed-off-by: Yaroslav Brustinov <ybrustin@cisco.com>
2017-01-21regression: static routing should be used with -e and not -pYaroslav Brustinov1-3/+3
Change-Id: I4b7f052b79845568f31ee268593778b564d211fb Signed-off-by: Yaroslav Brustinov <ybrustin@cisco.com>
2017-01-20add bp-sim-64 test with client config; move generated files to generated ↵Yaroslav Brustinov4-66/+107
directory Change-Id: I036e5666d1a2b1ec8045f82df64cce08503cdc80 Signed-off-by: Yaroslav Brustinov <ybrustin@cisco.com>
2017-01-16Kibanna time in Jerusalem timezoneHanoh Haim2-2/+2
Signed-off-by: Hanoh Haim <hhaim@cisco.com>
2017-01-16elk - add more fieldsHanoh Haim2-35/+35
Signed-off-by: Hanoh Haim <hhaim@cisco.com>
2017-01-16refactor regression tests so that nbar test will not run twiceIdo Barnea2-31/+28
Signed-off-by: Ido Barnea <ibarnea@cisco.com>
2017-01-16fix statful total dp cores calculationHanoh Haim1-3/+4
Signed-off-by: Hanoh Haim <hhaim@cisco.com>
2017-01-16another fix to elk @ regressionYaroslav Brustinov2-15/+18
Change-Id: I6c97c9e6c9ec9f5b12e586c03daf2b53a540cefc Signed-off-by: Yaroslav Brustinov <ybrustin@cisco.com>
2017-01-15log to elk nose tests resultsHanoh Haim1-0/+182
Signed-off-by: Hanoh Haim <hhaim@cisco.com>
2017-01-15hotfix for get model - does not work on regressionHanoh Haim1-2/+4
Signed-off-by: Hanoh Haim <hhaim@cisco.com>
2017-01-15hotfix for get version API - does not work on regressionHanoh Haim1-1/+1
Signed-off-by: Hanoh Haim <hhaim@cisco.com>
2017-01-15add elkHanoh Haim7-35/+548
Signed-off-by: Hanoh Haim <hhaim@cisco.com>
2017-01-14another fix to vlans configYaroslav Brustinov1-1/+1
Change-Id: I5b809689eadb86f8be9052714ef79598d5b39b2c Signed-off-by: Yaroslav Brustinov <ybrustin@cisco.com>
2017-01-14Regression: fix configure_basic_filtered_interfaces with vlansYaroslav Brustinov1-5/+13
Regression: speedup load of clean config dpdk_nic_bind: printing table with interfaces: take info from Linux and not TRex in case of Mellanox Doc performance: fix time format Change-Id: I3b022a2406efb058851033acfffc00766d13a1f1 Signed-off-by: Yaroslav Brustinov <ybrustin@cisco.com>
2017-01-12Regression: fix call to __init__ of parent of CTRexClientCfg_Test, which ↵Yaroslav Brustinov1-2/+1
skips not supported modes Change-Id: Ib9a26496f8c1ca64e5ffa4c0e668c6e15c7116fd Signed-off-by: Yaroslav Brustinov <ybrustin@cisco.com>
2017-01-12client config regression tests with NBAR and VLANIdo Barnea5-76/+220
Signed-off-by: Ido Barnea <ibarnea@cisco.com>
2017-01-08fix new mlx5 driver regression nameHanoh Haim1-1/+1
Signed-off-by: Hanoh Haim <hhaim@cisco.com>
2017-01-05Tune multiplier for trex-25, on the verge of avalancheHanoh Haim1-1/+1
Signed-off-by: Hanoh Haim <hhaim@cisco.com>
2017-01-05Regression: test_all_profiles at trex07 skip failing profiles:Yaroslav Brustinov2-4/+2
https://trex-tgn.cisco.com/youtrack/issue/trex-325 Change-Id: Ic9d197e4c72415eac7fd2651dd130491e3509e8f Signed-off-by: Yaroslav Brustinov <ybrustin@cisco.com>
2017-01-03STL Console: fix crash in case of no supported speeds reported by DPDKYaroslav Brustinov1-1/+1
Regression: update stl performance kiwi benchmark (was my typo) Change-Id: I0ea615d2511ea0339665e8fa5c8621eec9ebcb1e Signed-off-by: Yaroslav Brustinov <ybrustin@cisco.com>
2017-01-03Stateless API: increase delay in remove rx filters to 100ms in case of ↵Yaroslav Brustinov1-1/+4
virtual NICs. Regression: increase delay in remove rx filters in trex07 to 100ms in test_all_profiles test. Change-Id: Ia7dda25c94aeadcaae0b16023f6ea2957a99906f Signed-off-by: Yaroslav Brustinov <ybrustin@cisco.com>
2017-01-01Regression stl performance: send to GA in case of failure tooYaroslav Brustinov1-13/+8
Change-Id: Ia1c412df58d184d129722bb4787d10b59eff2370 Signed-off-by: Yaroslav Brustinov <ybrustin@cisco.com>
2017-01-01regression: update trex11 stateless bench based on 12 last regression reportsYaroslav Brustinov1-12/+12
Change-Id: I637087ea9499668ecb1c39b10d7c17f058dff82a Signed-off-by: Yaroslav Brustinov <ybrustin@cisco.com>
2017-01-01regression: update stl performance benchmark based on 100 last regression ↵Yaroslav Brustinov3-13/+13
reports Change-Id: I2c18532063423f9229f26080cbb7a2e612ff8c27 Signed-off-by: Yaroslav Brustinov <ybrustin@cisco.com>
2016-12-31regression: avoid queue full at trex11Yaroslav Brustinov2-10/+12
Change-Id: If6ff7e2675657bc53ef49237db3604b088a48ffc Signed-off-by: Yaroslav Brustinov <ybrustin@cisco.com>
2016-12-31regression:Yaroslav Brustinov2-2/+51
do not retry on stateless performance failure, results are the same per TRex run. add trex11 performance section for not to skip. TODO: calibrate Change-Id: I358121c2b89455c91f4c9dd078dedf0921c3d8a1 Signed-off-by: Yaroslav Brustinov <ybrustin@cisco.com>
2016-12-31regression: tune kiwi02 performanceYaroslav Brustinov1-3/+3
Change-Id: I6f12bb282b6f0ef7c6fd5812f2ea89a59c7f7c83 Signed-off-by: Yaroslav Brustinov <ybrustin@cisco.com>
2016-12-26Regression: update stateful benchmark at kiwi02Yaroslav Brustinov1-3/+3
Change-Id: I2e987c32b6dd77360cddd5ee8afd098caff49cd0 Signed-off-by: Yaroslav Brustinov <ybrustin@cisco.com>
2016-12-25Regression: verify connectivity to trex_daemon_serverYaroslav Brustinov1-14/+22
Change-Id: Ie83ebb7bfc08fef6060b7e61f865c5fa00530cac Signed-off-by: Yaroslav Brustinov <ybrustin@cisco.com>
2016-12-25Regression: handle exceptions during mapping to skip other testsYaroslav Brustinov1-10/+14
Change-Id: Icbb0a2469be5c90248b80eb46c1c80355b48acb1 Signed-off-by: Yaroslav Brustinov <ybrustin@cisco.com>
2016-12-25Regression: adapt IMIX stateful benchmark to removal of mbuf optimizationYaroslav Brustinov5-14/+14
Change-Id: I5a8b3912cad47070cc78658762d98aefe68085c4 Signed-off-by: Yaroslav Brustinov <ybrustin@cisco.com>
2016-12-23Regression stateful: division by zero due to rounding of small numbers, only ↵Yaroslav Brustinov1-8/+7
warn for too high BW, not fail. (will be noticed by failured of queue full etc.) Change-Id: I4ecfb13032a3d8cb27fb224fb5ed8dd4e10f68a2 Signed-off-by: Yaroslav Brustinov <ybrustin@cisco.com>
2016-12-22Less strict check on end of warmup state in Stateful API (96% of expected)Yaroslav Brustinov1-3/+15
Regression: (stateful) check that the BW is less than expected + 5%. Change-Id: Ie181a970d81fbca30a17d17ee98d0228603db11c Signed-off-by: Yaroslav Brustinov <ybrustin@cisco.com>
2016-12-22Revert "stateful repeat flows is no accurate - filter tests for now until it ↵Hanoh Haim4-33/+32
will be fixed" This reverts commit 1eea3fc8a3721b10e062401f7e47ccf18e59fbe5.
2016-12-22UDP NAT --learn mode 1,3 support - doc + regression testsIdo Barnea4-5/+18
Signed-off-by: Ido Barnea <ibarnea@cisco.com>
2016-12-22stateful repeat flows is no accurate - filter tests for now until it will be ↵Hanoh Haim4-32/+33
fixed Signed-off-by: Hanoh Haim <hhaim@cisco.com>
2016-12-16regression: add --restart-daemon flag, without it trex_daemon_server will ↵Yaroslav Brustinov2-20/+18
not be restarted. Change-Id: I5750a11cc9587ae639ef8044f3ff5f1bdf19441b Signed-off-by: Yaroslav Brustinov <ybrustin@cisco.com>
2016-12-15Fix Trex25 Ipv6 statefull latency test failuresIdo Barnea1-1/+14
Signed-off-by: Ido Barnea <ibarnea@cisco.com>
2016-12-14tune trex-09 performanceHanoh Haim1-1/+1
Signed-off-by: Hanoh Haim <hhaim@cisco.com>
2016-12-14Small fix left out in 6c31c0534acf57fc3e0e26fe964bbc67d9d7d63cIdo Barnea1-1/+1
Signed-off-by: Ido Barnea <ibarnea@cisco.com>