summaryrefslogtreecommitdiffstats
path: root/scripts/automation/regression
AgeCommit message (Collapse)AuthorFilesLines
2017-01-12Regression: fix call to __init__ of parent of CTRexClientCfg_Test, which ↵Yaroslav Brustinov1-2/+1
skips not supported modes Change-Id: Ib9a26496f8c1ca64e5ffa4c0e668c6e15c7116fd Signed-off-by: Yaroslav Brustinov <ybrustin@cisco.com>
2017-01-12client config regression tests with NBAR and VLANIdo Barnea5-76/+220
Signed-off-by: Ido Barnea <ibarnea@cisco.com>
2017-01-08fix new mlx5 driver regression nameHanoh Haim1-1/+1
Signed-off-by: Hanoh Haim <hhaim@cisco.com>
2017-01-05Tune multiplier for trex-25, on the verge of avalancheHanoh Haim1-1/+1
Signed-off-by: Hanoh Haim <hhaim@cisco.com>
2017-01-05Regression: test_all_profiles at trex07 skip failing profiles:Yaroslav Brustinov2-4/+2
https://trex-tgn.cisco.com/youtrack/issue/trex-325 Change-Id: Ic9d197e4c72415eac7fd2651dd130491e3509e8f Signed-off-by: Yaroslav Brustinov <ybrustin@cisco.com>
2017-01-03STL Console: fix crash in case of no supported speeds reported by DPDKYaroslav Brustinov1-1/+1
Regression: update stl performance kiwi benchmark (was my typo) Change-Id: I0ea615d2511ea0339665e8fa5c8621eec9ebcb1e Signed-off-by: Yaroslav Brustinov <ybrustin@cisco.com>
2017-01-03Stateless API: increase delay in remove rx filters to 100ms in case of ↵Yaroslav Brustinov1-1/+4
virtual NICs. Regression: increase delay in remove rx filters in trex07 to 100ms in test_all_profiles test. Change-Id: Ia7dda25c94aeadcaae0b16023f6ea2957a99906f Signed-off-by: Yaroslav Brustinov <ybrustin@cisco.com>
2017-01-01Regression stl performance: send to GA in case of failure tooYaroslav Brustinov1-13/+8
Change-Id: Ia1c412df58d184d129722bb4787d10b59eff2370 Signed-off-by: Yaroslav Brustinov <ybrustin@cisco.com>
2017-01-01regression: update trex11 stateless bench based on 12 last regression reportsYaroslav Brustinov1-12/+12
Change-Id: I637087ea9499668ecb1c39b10d7c17f058dff82a Signed-off-by: Yaroslav Brustinov <ybrustin@cisco.com>
2017-01-01regression: update stl performance benchmark based on 100 last regression ↵Yaroslav Brustinov3-13/+13
reports Change-Id: I2c18532063423f9229f26080cbb7a2e612ff8c27 Signed-off-by: Yaroslav Brustinov <ybrustin@cisco.com>
2016-12-31regression: avoid queue full at trex11Yaroslav Brustinov2-10/+12
Change-Id: If6ff7e2675657bc53ef49237db3604b088a48ffc Signed-off-by: Yaroslav Brustinov <ybrustin@cisco.com>
2016-12-31regression:Yaroslav Brustinov2-2/+51
do not retry on stateless performance failure, results are the same per TRex run. add trex11 performance section for not to skip. TODO: calibrate Change-Id: I358121c2b89455c91f4c9dd078dedf0921c3d8a1 Signed-off-by: Yaroslav Brustinov <ybrustin@cisco.com>
2016-12-31regression: tune kiwi02 performanceYaroslav Brustinov1-3/+3
Change-Id: I6f12bb282b6f0ef7c6fd5812f2ea89a59c7f7c83 Signed-off-by: Yaroslav Brustinov <ybrustin@cisco.com>
2016-12-26Regression: update stateful benchmark at kiwi02Yaroslav Brustinov1-3/+3
Change-Id: I2e987c32b6dd77360cddd5ee8afd098caff49cd0 Signed-off-by: Yaroslav Brustinov <ybrustin@cisco.com>
2016-12-25Regression: verify connectivity to trex_daemon_serverYaroslav Brustinov1-14/+22
Change-Id: Ie83ebb7bfc08fef6060b7e61f865c5fa00530cac Signed-off-by: Yaroslav Brustinov <ybrustin@cisco.com>
2016-12-25Regression: handle exceptions during mapping to skip other testsYaroslav Brustinov1-10/+14
Change-Id: Icbb0a2469be5c90248b80eb46c1c80355b48acb1 Signed-off-by: Yaroslav Brustinov <ybrustin@cisco.com>
2016-12-25Regression: adapt IMIX stateful benchmark to removal of mbuf optimizationYaroslav Brustinov5-14/+14
Change-Id: I5a8b3912cad47070cc78658762d98aefe68085c4 Signed-off-by: Yaroslav Brustinov <ybrustin@cisco.com>
2016-12-23Regression stateful: division by zero due to rounding of small numbers, only ↵Yaroslav Brustinov1-8/+7
warn for too high BW, not fail. (will be noticed by failured of queue full etc.) Change-Id: I4ecfb13032a3d8cb27fb224fb5ed8dd4e10f68a2 Signed-off-by: Yaroslav Brustinov <ybrustin@cisco.com>
2016-12-22Less strict check on end of warmup state in Stateful API (96% of expected)Yaroslav Brustinov1-3/+15
Regression: (stateful) check that the BW is less than expected + 5%. Change-Id: Ie181a970d81fbca30a17d17ee98d0228603db11c Signed-off-by: Yaroslav Brustinov <ybrustin@cisco.com>
2016-12-22Revert "stateful repeat flows is no accurate - filter tests for now until it ↵Hanoh Haim4-33/+32
will be fixed" This reverts commit 1eea3fc8a3721b10e062401f7e47ccf18e59fbe5.
2016-12-22UDP NAT --learn mode 1,3 support - doc + regression testsIdo Barnea4-5/+18
Signed-off-by: Ido Barnea <ibarnea@cisco.com>
2016-12-22stateful repeat flows is no accurate - filter tests for now until it will be ↵Hanoh Haim4-32/+33
fixed Signed-off-by: Hanoh Haim <hhaim@cisco.com>
2016-12-16regression: add --restart-daemon flag, without it trex_daemon_server will ↵Yaroslav Brustinov2-20/+18
not be restarted. Change-Id: I5750a11cc9587ae639ef8044f3ff5f1bdf19441b Signed-off-by: Yaroslav Brustinov <ybrustin@cisco.com>
2016-12-15Fix Trex25 Ipv6 statefull latency test failuresIdo Barnea1-1/+14
Signed-off-by: Ido Barnea <ibarnea@cisco.com>
2016-12-14tune trex-09 performanceHanoh Haim1-1/+1
Signed-off-by: Hanoh Haim <hhaim@cisco.com>
2016-12-14Small fix left out in 6c31c0534acf57fc3e0e26fe964bbc67d9d7d63cIdo Barnea1-1/+1
Signed-off-by: Ido Barnea <ibarnea@cisco.com>
2016-12-13Temporary Revert "Small fix left out in ↵Ido Barnea1-1/+1
6c31c0534acf57fc3e0e26fe964bbc67d9d7d63c" since it brakes regression on 06 and 25. Seems like real issue on these setups. This reverts commit fe755604ec04ed7f8622394f99f0048901dad4e1.
2016-12-13Small fix left out in 6c31c0534acf57fc3e0e26fe964bbc67d9d7d63cIdo Barnea1-1/+1
Signed-off-by: Ido Barnea <ibarnea@cisco.com>
2016-12-12Added VIC tests + VIC small fix + fail tests if latency packets failIdo Barnea2-2/+24
Signed-off-by: Ido Barnea <ibarnea@cisco.com>
2016-12-12tune trex-09 resultsHanoh Haim1-1/+1
Signed-off-by: Hanoh Haim <hhaim@cisco.com>
2016-12-08Regression: change trex14 configYaroslav Brustinov4-19/+329
Doc: add readme file on how to build Change-Id: I2d3765ad90c99e6c7bd839d8c824b6c1fada9c88 Signed-off-by: Yaroslav Brustinov <ybrustin@cisco.com>
2016-11-29temporarely disable client config test on kiwi02Ido Barnea1-1/+3
Signed-off-by: Ido Barnea <ibarnea@cisco.com>
2016-11-28cisco VIC fix stateful regression fileHanoh Haim1-27/+14
Signed-off-by: Hanoh Haim <hhaim@cisco.com>
2016-11-28cisco VIC - skip test with 9K packet len due to trex-282Hanoh Haim3-48/+20
Signed-off-by: Hanoh Haim <hhaim@cisco.com>
2016-11-28add VIC reg filesHanoh Haim4-38/+312
Signed-off-by: Hanoh Haim <hhaim@cisco.com>
2016-11-28regression: update ipg_usec at stateless benchmark at trex06Yaroslav Brustinov1-1/+1
Signed-off-by: Yaroslav Brustinov <ybrustin@cisco.com>
2016-11-28Add src_ip to regression client_cfg fileIdo Barnea1-0/+8
Signed-off-by: Ido Barnea <ibarnea@cisco.com>
2016-11-28regression: move trex15 (vmxnet3) to trex03, move trex17 (e1000) to trex06Yaroslav Brustinov4-2/+2
Signed-off-by: Yaroslav Brustinov <ybrustin@cisco.com>
2016-11-27client config regressionIdo Barnea2-0/+90
Signed-off-by: Ido Barnea <ibarnea@cisco.com>
2016-11-24performance test - relaxing the numbersimarom1-2/+2
Signed-off-by: imarom <imarom@cisco.com>
2016-11-20regression - aggregate_results fixes #2Yaroslav Brustinov1-2/+3
Signed-off-by: Yaroslav Brustinov <ybrustin@cisco.com>
2016-11-20regression - aggregate_results fixesYaroslav Brustinov1-16/+25
Signed-off-by: Yaroslav Brustinov <ybrustin@cisco.com>
2016-11-20regression - aggregate results: add option to read last commit info from fileYaroslav Brustinov1-10/+15
Signed-off-by: Yaroslav Brustinov <ybrustin@cisco.com>
2016-11-16change order of cores in produced config fileYaroslav Brustinov1-11/+11
fix bug of writing reduced number of cores in VM try using "main" thread for rx Signed-off-by: Yaroslav Brustinov <ybrustin@cisco.com>
2016-11-16trex07 fix queue_full in regressionHanoh Haim1-1/+1
Signed-off-by: Hanoh Haim <hhaim@cisco.com>
2016-11-16update trex07 benchmark resultsHanoh Haim1-2/+2
Signed-off-by: Hanoh Haim <hhaim@cisco.com>
2016-11-16add trex08 benchmark resultsHanoh Haim1-0/+50
Signed-off-by: Hanoh Haim <hhaim@cisco.com>
2016-11-16fail in case of queue full - the CPU is not validHanoh Haim1-0/+4
Signed-off-by: Hanoh Haim <hhaim@cisco.com>
2016-11-15connectx-4 another benchmark updateHanoh Haim1-3/+3
Signed-off-by: Hanoh Haim <hhaim@cisco.com>
2016-11-15fix python3 regression issueHanoh Haim1-2/+2
Signed-off-by: Hanoh Haim <hhaim@cisco.com>