Age | Commit message (Collapse) | Author | Files | Lines |
|
Change-Id: Id7c81a92dd50db365c219529a687fa37fd05ceb3
Signed-off-by: Peter Mikus <pmikus@cisco.com>
|
|
Change-Id: Ic493253dc29dad4fc7e6541e4b839ca5898a6a40
Signed-off-by: Peter Mikus <pmikus@cisco.com>
|
|
The number of tests executed is intentionally smaller,
as recently the runtime has gone up too much.
New numbers:
csit-vpp-perf-mrr-daily-master: 120
csit-vpp-perf-mrr-daily-master-2n-skx: 72
csit-vpp-perf-mrr-daily-master-3n-skx: 126
More details included as diff files.
+ Less per-testbed exceptions.
- Single/double links tags still set at two places.
Change-Id: I1149d3e52edf38c7d9d3e0160c533e35ae944d0d
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
Change-Id: I3ba6c7dc6a72e376419990ce7f5acc8d373f246f
Signed-off-by: Peter Mikus <pmikus@cisco.com>
|
|
CSIT-1505
Parse {os} parameter from job and use it to separate the correct
image for each distro and the correct stable package versions.
Use two vpp device image names, one for Ubuntu and one for Centos.
Centos sut image is in https://hub.docker.com/r/snergster/csit-sut-centos
Source for Centos sut image:
https://github.com/snergfdio/multivppcache/tree/master/csit-sut-centos
Change-Id: I568c82710d730c4ed0ca25bc12cb6074e1cbe27e
Signed-off-by: Thomas F Herbert <therbert@redhat.com>
|
|
Change-Id: Ib633266daaf67f257867f5ba0b2836f777ecd3bf
Signed-off-by: Peter Mikus <pmikus@cisco.com>
|
|
Change-Id: I10eeb4ee30a57712824e68176d92d1ecb5f0d1b0
Signed-off-by: Peter Mikus <pmikus@cisco.com>
|
|
Change-Id: I9e3f1a2a2a1c11a355cd66c940beb663ecc7d7a4
Signed-off-by: Tibor Frank <tifrank@cisco.com>
|
|
- due to VAT to PAPI migration some tests
need to be updated
- fixed HC tests: ACL, Interfaces/SubInterfaces, Tap
Vhost, Vxlan, Vxlan-gpe
Change-Id: I9adad041a619b48057bdda388becd53dde484483
Signed-off-by: Michal Cmarada <mcmarada@cisco.com>
|
|
Change-Id: Id186c3c280a6b876b8212e01b261ad8c65e5f40c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
|
|
Change-Id: I235d4654b04275877b3c5f4cf49ef5755c3f4985
Signed-off-by: Tibor Frank <tifrank@cisco.com>
|
|
Change-Id: I25e51022e0ec961fce444bc8f0f4413d0e95d7eb
Signed-off-by: Jan Gelety <jgelety@cisco.com>
|
|
+ Fix the version of MMD tool to always latest
Change-Id: Iafd7f40d618b8e4995b5cc12fe06056719f58517
Signed-off-by: Peter Mikus <pmikus@cisco.com>
|
|
Change-Id: I0062710d58996be767a852dc00545fedd60a5c72
Signed-off-by: Jan Gelety <jgelety@cisco.com>
|
|
Change-Id: I484cda8c8410e2f38d68da82761b1154dda26b1c
Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>
|
|
Using multiprocessing sometimes causes scp to hang when copying files.
Threading is also more lightweight.
Change-Id: I047b4835bbf1584c80469b27af5394d89087e8a9
Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>
|
|
- new ietf-interfaces makes interfaces-state obsolete
- updates honeycomb tests to latest ietf-interfaces model
Change-Id: I5502a5ab23661429caca9498407d7121d423a1a3
Signed-off-by: Michal Cmarada <mcmarada@cisco.com>
|
|
Change-Id: I7b8e30903a8bc012a3bb43bfb33755e08b56dc1d
Signed-off-by: Jan Gelety <jgelety@cisco.com>
|
|
Change-Id: I71010c18210e88828ded0bc679997d76f34886cb
Signed-off-by: Peter Mikus <pmikus@cisco.com>
|
|
- Add:
aes-128-gcm aes-128-gcm
aes-256-gcm aes-256-gcm
aes-128-cbc hmac-sha-256
aes-256-cbc hmac-sha-512
- Remove:
hmac-sha1
- Scale will follow in next patch
Change-Id: I789f71cf66cf61b8dbb3c6dbe9b6fdc79866ac33
Signed-off-by: Peter Mikus <pmikus@cisco.com>
|
|
The next version of suite generator will avoid generating them,
for now we just exclude by a tag expression.
Change-Id: I68c80c412ea327c11366f539b10de19df50152c2
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
Change-Id: I2c0877f4d8b6cad2694c43a4350998cd2b830680
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
Change-Id: Ie4acaecf60e03fc4e843e29d8222fbf2f00bbf44
Signed-off-by: Peter Mikus <pmikus@cisco.com>
|
|
Change-Id: Id43c7c299d2e112b6caf00a3d340e6051ab337b6
Signed-off-by: Peter Mikus <pmikus@cisco.com>
|
|
Change-Id: Id9beeed270b91a35108adef594f50105198225d6
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
- use new vpp ref build - ubuntu 16.04:
19.08-rc0~212-gf6c7aec~b7060
- use new vpp ref build - ubuntu 18.04:
19.08-rc0~212-gf6c7aec95
- use new vpp ref build - centos7:
19.08-rc0~212_gf6c7aec~b6916
Change-Id: Ifd042fae1a46b07a5f463309f2b9cceb8054412f
Signed-off-by: Jan Gelety <jgelety@cisco.com>
|
|
Change-Id: I31acda10c4bd8de6f0094e697ef1219e77c5fbb1
Signed-off-by: Peter Mikus <pmikus@cisco.com>
|
|
Change-Id: I12865ea4f48c1902e80e67463fff4cf481a2e24c
Signed-off-by: Peter Mikus <pmikus@cisco.com>
|
|
+ Extract several tracker classes and use them in Integrator.
+ Apply next_rate workarounds to focus more on critical region.
+ Rewrite stretch function, as the previous implementation was wrong.
+ Rework logging:
++ Use injected trace() function in Integrator.
++ Inject function that skips trace logging on default initialization.
++ Use the same multiprocessing-safe passing, but separate queue.
+ Set duration to 120m in Robot, but keep at 30m in Python.
+ Apply minor changes to make computations more reproducible:
++ Attempt to log everything needed by reproducibility in one line.
++ Log samples used, and make it settable as upper limit.
++ Use repr output in TRex scripts, to avoid rounding when copypasting.
+- Numpy seems to be sharing PRNG between processes.
+-- An edit to disable one thread is needed for full reproducibility.
+-- Such an edit is prepared, but will not be merged anytime soon.
Change-Id: Icf56429b34ab6de2d18a12e6c676e2d242b3ba4c
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
Change-Id: If4b013ef4bf4bc8f857913f3847ab3b2e2aa5a5d
Signed-off-by: Peter Mikus <pmikus@cisco.com>
|
|
Change-Id: I7f71a9709ad55ce03d73e23cc8a9f5064947ed51
Signed-off-by: Peter Mikus <pmikus@cisco.com>
|
|
Change-Id: Ib2f3f3f8dc3e202dc1db53c739d9309be2ed8a60
Signed-off-by: Peter Mikus <pmikus@cisco.com>
|
|
Change-Id: I7fb255c26bfb62a273844b3753aa37b742835045
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
Change-Id: Ibe52125089f39e0ff17ec607a3ed00c61d52ab8c
Signed-off-by: Peter Mikus <pmikus@cisco.com>
|
|
Change-Id: Icff556142280ad0b6261e0a2bfb71672ee6b3807
Signed-off-by: Peter Mikus <pmikus@cisco.com>
|
|
Change-Id: I4955210e2c723d4b91d8829ac42e47937d17833f
Signed-off-by: Peter Mikus <pmikus@cisco.com>
|
|
- By adding crypto_ipsecmb.so into the list of loaded plugins
Change-Id: I52de9b410441422ad8e337208f40360fbdea264d
Signed-off-by: Peter Mikus <pmikus@cisco.com>
|
|
Add buffers-per-numa (previously num-mbuf)
Change-Id: Iad0863668a65b1595630d49a047d591659c7bba5
Signed-off-by: Peter Mikus <pmikus@cisco.com>
|
|
The idea is to run test generation and archivation
before testbed reservation, as during generation and archivation
the testbed can be used by another job.
The two steps are moved just before (physical or docker) reservation,
as they currently take considerable time,
so simpler steps are kept before to save time if they fail.
Coincidentally, it is also just after activate_virtualenv,
Python is needed for test generation.
Change-Id: I8b41b91dba8118e89301e3fcf89d5cd14ac054a2
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
Change-Id: Ib39671dcb808142037c2950b8b02b9aa64d72a3b
Signed-off-by: Jan Gelety <jgelety@cisco.com>
(cherry picked from commit 48b40a6789050e8f40405663cc0e437df26fc56a)
|
|
Change-Id: Ief72af680a6252faf749b06b5289b8033af99b2d
Signed-off-by: Peter Mikus <pmikus@cisco.com>
|
|
Change-Id: I2947394a478bde3fe048aef99fd7b5a394764ae2
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
CSIT-1485
- Measurement results are inconsistent, creating false positives.
- To avoid false positives, sensitivity has to be lowered.
+ Measurements are no more interleaved.
+ Measurement result are no longer filtered.
+ The job now runs faster.
- Ip6base regressions smaller than 4% are tolerated.
+ Ip6base false positives can happen, but less than 10% of the time.
- Part of job parameters is set on ci-management level.
+ Voter script output is improved.
Change-Id: I0ec7d5df8b397daf7ff0277a1137ee9f36d8d866
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
The two types were not well distinguished before.
Error introduced in:
https://gerrit.fd.io/r/#/c/17811/84/resources/libraries/robot/performance/performance_setup.robot@255
Error hotfixed in:
https://gerrit.fd.io/r/#/c/18847/4/resources/libraries/robot/shared/default.robot@109
+ Rename some arguments and improve method docstrings.
Newly introduced argument name osi_layer should be dissimilar enough.
Change-Id: Ie0f6f97dc010fc6477f09c54574970f1d15462e2
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
+ Convert DpdkUtil to use it.
++ Rename args to kwargs where needed.
++ Fix errors in docstrings.
+ Also convert and QemuUtils to use it.
++ Minor formatting edits to save space.
+ Add disconnect parameter to some ssh.py functions.
++ ssh.SSH.disconnect() tries to work without argument.
+ Exec functions in ssh.py accept OptionString commands.
Change-Id: I82da71c568d120c283544c90242993fc76e9e83a
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
|
|
Change-Id: Ief75fcdc2c3ab77b708d1c7e7aecf312ea852898
Signed-off-by: Michal Cmarada <mcmarada@cisco.com>
|
|
- Side effect of other troubleshooting, but better to
merge then throw away.
Change-Id: Idc1a0ca66b35b61c1ffd11242cd7b7133ae4cbd7
Signed-off-by: Peter Mikus <pmikus@cisco.com>
|
|
Change-Id: I141baa77c78ec467a56fcafb86061efe198dca9d
Signed-off-by: Jan Gelety <jgelety@cisco.com>
|
|
+Unify QEMU parameter to Contants.
Change-Id: I95adfc97dd7008c19e60ba3fa8668818b503bee8
Signed-off-by: Peter Mikus <pmikus@cisco.com>
|
|
- Useful for post-processing.
Change-Id: I6f71087f8c6f6d66fd86207d5df9abd10e94f855
Signed-off-by: Peter Mikus <pmikus@cisco.com>
|