aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2019-05-22CSIT-1488: Add data to the Report 1904Tibor Frank1-0/+2
Change-Id: I3af37de91450a4ac11eb6e6e8cd271de41e985bf Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-05-22Exclude IPSECHW tests on NICs other than xl710Vratko Polak1-0/+1
The next version of suite generator will avoid generating them, for now we just exclude by a tag expression. Change-Id: I68c80c412ea327c11366f539b10de19df50152c2 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-05-21Update Centos VIRL image to version 2.5Thomas F Herbert5-1/+103
Update CentOS release. Add python34. Change-Id: Ie0a11810c5b120cfd170dc4eaf3e72bbd3155d4a Signed-off-by: Thomas F Herbert <therbert@redhat.com>
2019-05-21CSIT-1488: Add data to the Report 1904Tibor Frank1-0/+2
Change-Id: I6c6f478a0dc54a10e4b7568dc86aa883e896e28a Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-05-20FIX2: VTS cpu listJan Gelety3-3/+3
Change-Id: Ibd0f719585d6482a65ae6cea516a4da017281ef5 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-05-20Report: Remove (IPSECHW and x520) tests from reportTibor Frank1-6/+6
Change-Id: I1481cd889aab7cc1f8d6b7c3a3cd5e96e955bb8a Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-05-20FIX: VTS cpu listJan Gelety3-9/+9
Change-Id: Ic3ac22642e443f30a46914c18cd9a9b54064286b Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-05-20CSIT-1488: Add data to the Report 1904Tibor Frank1-8/+4
Change-Id: I632ed9e00feb26b734f86bfe75dca9e14ac57f0c Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-05-17Report: Fix internal links to PLRsearch methodologyVratko Polak3-3/+3
Change-Id: I87b334e9c89b1469112dac4327faaf430c6f846a Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-05-17Report: table_soak_vs_ndrTibor Frank1-3/+4
Change-Id: Ia313fb43c315990212501b4139f3f1f7bc9d67f5 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-05-17Reduce the number of tests loops in virl timed jobsJan Gelety2-2/+2
- with current number of test loops jobs fail with timeout Change-Id: Id08cd1a9221eda116e018a44bece68a494286169 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-05-17Trending: Reduce input dataTibor Frank2-45/+93
Change-Id: Ib540a687a0b8b27584f6d8c571cfd453122f0f91 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-05-17CSIT-1488: Add data to the Report 1904Tibor Frank1-8/+27
Change-Id: Ic693d6750007727b6e773e17f8f2fba2f96c2c86 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-05-17Report soak comparison: Add stdev for deltaVratko Polak2-3/+36
Change-Id: Ibbff3c123afac2e68caf33f3ccd5fc4909509917 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-05-16Tests: Add IPSEC SW scale testsTibor Frank4-0/+648
Change-Id: I4339059a0cf67acce668abe42aab59bbb17916d9 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-05-16Avoid !r format appending u on unicodeVratko Polak2-0/+12
Change-Id: I2c0877f4d8b6cad2694c43a4350998cd2b830680 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-05-16FIX: IPsec selection backend.Peter Mikus1-1/+1
Change-Id: Ie4acaecf60e03fc4e843e29d8222fbf2f00bbf44 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-05-16Make topology files read dynamically from directoryPeter Mikus3-24/+7
Change-Id: Id43c7c299d2e112b6caf00a3d340e6051ab337b6 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-05-16Improve soak graphs and contentVratko Polak3-21/+23
+ Fix duration, mention number of tests and runs. - Hover information still feels wrong. + Mention "critical rate" instead of "throughput" where possible. + Mention lower bounds are displayed. + Rename "plrsearch_algorithm" label to "PLRsearch". + Because the previous link did not work. Due to underscore? + Rename "SOAK" to "soak" or "Soak" (except when it is a tag). Change-Id: I9c079f8c2e93d96249d4b60893469c9257d4f3db Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-05-16CSIT-1488: Add data to the Report 1904Tibor Frank2-2/+13
Change-Id: I7484eeb872cd8fa736421a0ded2fcfffe733051e Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-05-16Report: Configure 1904.21Tibor Frank3-2/+5
Change-Id: Ib65580067d9c41137293036bbd786e31c2bdf503 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-05-15Avoid double link tests for nic_intel-xxv710Vratko Polak1-0/+2
Change-Id: Id9beeed270b91a35108adef594f50105198225d6 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-05-15Update of VPP_STABLE_VER files + quick fix for gre create tunnelJan Gelety6-23/+40
- use new vpp ref build - ubuntu 16.04: 19.08-rc0~212-gf6c7aec~b7060 - use new vpp ref build - ubuntu 18.04: 19.08-rc0~212-gf6c7aec95 - use new vpp ref build - centos7: 19.08-rc0~212_gf6c7aec~b6916 Change-Id: Ifd042fae1a46b07a5f463309f2b9cceb8054412f Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-05-15Report: Add pdf versionTibor Frank2-9/+11
Change-Id: Idc6936262a968e213f2fafa52adacfee65ad345c Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-05-15PLRsearch methodology: Add graphs with descriptions.Vratko Polak5-6976/+22451
Change-Id: I1acb74c6edb966dcdbbdaf88c05bfde1192bf74b Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-05-15CSIT-1504: Soak tests - graphTibor Frank2-2/+2
Change-Id: I1e39a995565cbda2184378268e2da2b465b147cd Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-05-15Report: update known perf issuesJan Gelety1-0/+6
Change-Id: I83863b6a32a1f4d079e126458ba50a358e8de447 Signed-off-by: Jan Gelety <jgelety@cisco.com>
2019-05-15FIX: Honeycomb restart sequencePeter Mikus1-1/+3
Change-Id: I31acda10c4bd8de6f0094e697ef1219e77c5fbb1 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-05-15CSIT-1504: Soak tests - graphTibor Frank1-2/+7
Change-Id: If31eb363680a3cd81c38f078c9ad28a569d321da Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-05-15Fix teardown keyword for wrk testVratko Polak1-1/+1
Change-Id: Ib0a86cdb250f4eb7a5a08d205c0b17c7bf9fd851 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-05-15CSIT-1504: Soak tests - box plotsTibor Frank1-0/+3
Change-Id: I29a25dad1fee07c0a387dc985718eae858abb2f4 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-05-15CSIT-1504: Soak tests - box plotsTibor Frank1-0/+8
Change-Id: Id066787f4445b675ef0691a405d0f403b45d6fc2 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-05-15Report: clean-up ipsec testsTibor Frank1-28/+4
Change-Id: I3fd52fdeccc73332a85f695442cbe86fcf94b489 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-05-15Trending: Add IPSECSWTibor Frank5-5/+78
Change-Id: I5437d46759c3fcf9a8f44d02d43a70f3f3b2635d Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-05-15CSIT-1504: Soak tests - box plotsTibor Frank3-19/+18
- table: stdev, round deltas to 2 dec places Change-Id: I29cd1f7c9ba8ef73a8281d42ac9f6a06ed30bbdf Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-05-15FIX: Remove old restart sequence - HoneycombPeter Mikus5-16/+25
Change-Id: I12865ea4f48c1902e80e67463fff4cf481a2e24c Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-05-14CSIT-1504: Soak tests - graphTibor Frank4-37/+55
Change-Id: I8416e28a27c16da76c0ebb94f847539f662229fa Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-05-14Report: Remove CFS_OPT from 2n/3n-skx ndrpdr fullTibor Frank1-12/+12
Change-Id: If82e9c19e9d2035e62c7e455458ebdef20659adb Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-05-14CSIT-1500: Add comparison table for SOAK vs NDRPDRTibor Frank2-73/+44
- clean-up Change-Id: I020837a89415fdb891ffbb094c9a5edf50946dd2 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-05-14FIX: Remove old VPP Restart sequencePeter Mikus1-1/+0
- Honeycomb __init__ Change-Id: I0a230ac5692e7701b485698e9406461d7a251bf9 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-05-13Remove CFSRR1 VM testsPeter Mikus6-870/+0
- Per agreed Change-Id: Ie955ebfe19bff8c4a8671a0f62eea5be4407caa5 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-05-13CSIT-1500: Add comparison table for SOAK vs NDRPDRTibor Frank2-1/+7
- fix text case name Change-Id: I01c228a920729b2e2ab3e4fb4669d68469b1c58f Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-05-13FIX: Latency stream not using VM transformationPeter Mikus1-6/+4
Change-Id: Ibda7467dac7775427a8edafc6fa76f936d15d272 Signed-off-by: Peter Mikus <pmikus@cisco.com>
2019-05-13CSIT-1500: Add comparison table for SOAK vs NDRPDRTibor Frank1-2/+13
- fix model Change-Id: Ifae4b4039c905c990dda578a620b9ffc232e5786 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-05-13CSIT-1500: Add comparison table for SOAK vs NDRPDRTibor Frank5-43/+238
Change-Id: I890b28b7a8c1f60cce4c985ccd94fcdfd3c47d7d Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-05-13Report: Add SOAK TestsTibor Frank4-52/+55
Change-Id: I22eec7cf8ff25958218d4b8ac6bab5a34b2f206c Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-05-13CSIT-1488: Add data to the Report 1904Tibor Frank2-11/+22
Change-Id: I6e35ba3a89e02fa1e34e5ef637598cb6e22baaaa Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-05-13Report: Configuration for 1904.20Tibor Frank3-2/+5
Change-Id: I4bbf1ed196947cc290de943b1e39721021d9d7d4 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-05-10Report: Add pdf versionTibor Frank1-2/+2
Change-Id: I6d4770b163844bb5b30d62b2becac13714702b06 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-05-10PLRsearch: Use stat trackers to shorten IntegratorVratko Polak6-411/+709
+ Extract several tracker classes and use them in Integrator. + Apply next_rate workarounds to focus more on critical region. + Rewrite stretch function, as the previous implementation was wrong. + Rework logging: ++ Use injected trace() function in Integrator. ++ Inject function that skips trace logging on default initialization. ++ Use the same multiprocessing-safe passing, but separate queue. + Set duration to 120m in Robot, but keep at 30m in Python. + Apply minor changes to make computations more reproducible: ++ Attempt to log everything needed by reproducibility in one line. ++ Log samples used, and make it settable as upper limit. ++ Use repr output in TRex scripts, to avoid rounding when copypasting. +- Numpy seems to be sharing PRNG between processes. +-- An edit to disable one thread is needed for full reproducibility. +-- Such an edit is prepared, but will not be merged anytime soon. Change-Id: Icf56429b34ab6de2d18a12e6c676e2d242b3ba4c Signed-off-by: Vratko Polak <vrpolak@cisco.com>