aboutsummaryrefslogtreecommitdiffstats
path: root/resources/tools
AgeCommit message (Collapse)AuthorFilesLines
2019-08-26Report: TablesTibor Frank2-37/+304
Change-Id: I5084163758c5f15f482c6c8e08ee70c4a4f50431 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-08-26Report: Modify comparison tables, add dataTibor Frank1-1159/+1007
Change-Id: I6d5e7cc0618a5b1889ab54c020fd98c661d20989 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-08-26Report: Select tests by name, specificationsTibor Frank2-18533/+3243
Change-Id: Ibcc5e67d49fba9c02b07af462a74d2a062412979 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-08-23Introduce reconfig suites, for dot1q+ip4+vxlanVratko Polak1-13/+26
Ticket: CSIT-1551 + Config copied from other suites. + Layer keywords prepared for additional chains. + Renamed "create" argument to "vlan_per_chain". + TrafficGenerator result extraction improvements. + Also unified TG type and subtype checking. + Throughput estimated as PDR for zero PLR. + Actual Qemu start is skipped. + Parse xstats instead of stats in trex stop scipt. - Because stats are unconditionally cleared on each script connect. + Remember start values to get better ReceiveMeasurementResult at stop. + Expose loss count and time as appropriate test message. + Autogen support. + Multiple chain amounts and core densities. - Only 1 additional chain. + Proper TAGs. Documented. + Clarified min framesize tags are for TG-DUT. + Added a TODO concerning overhead values. + Added 118B tag. + Robot performance keywords improvements. + Added missing return value documentation. + Frame size as required test variable, not an explicit argument. + MLRsearch keyword to store result (not into test message). - TODO: De-duplicate: main keyword to measure, minor to set test message. - But implementation uses the fact default arguments are different. + Keywords for starting and stopping background traffic. - No checks whether start-stop pair is complete. + Multiple minor indentation and logging improvements. - Missing / TODOs: - Support also vlan_per_chain=True? - Support dot1q without vxlan? - Support also deletion? - How to package config steps so -reconf can be generated from -ndrpdr? Change-Id: If0270697f9ffa837c34ef802917220a53f156703 Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-08-23Report: Specify groups of tests for graphsTibor Frank1-0/+432
Groups of tests for graphs: - Packet Throughput - Packet Latency - Speedup Multi-Core Change-Id: Ib37c1231abb63c234fb1e98d059bb3338133da0c Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-08-19PAL: Select tests by name, functionsTibor Frank3-0/+751
- throughput - latency - speedup Change-Id: Ia8b33815f5bbb7b0fb50b23e7655068928733832 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-08-19Report: Add dataTibor Frank1-28/+130
- DPDK Change-Id: Ibc45c49e34b2b0abe0f0a9f3304ee478c174c01e Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-08-19PAL: Get DPDK version from output_info.xmlTibor Frank1-2/+2
Change-Id: I922c8143df39025cc0a78047f3cef7b9f5673b4b Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-08-19FIX: Topology reservationPeter Mikus1-16/+19
Last attempt [0] is doing more harm then good. If testbed is down but recovered quickly enough (reboot, temporary ssh connectivity issue, ...) it never gets back into pool making other testbeds overloaded and queued. This patch is suppose to partially revert previous behavior until proper patch will follow. [0] https://gerrit.fd.io/r/c/csit/+/21148 Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I8203946d10d3e7dd51e97519d679246b5dae59e3
2019-08-16FIX: Small errors in ansiblePeter Mikus1-16/+24
- that prevents installation Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I4fe4694ab7479481481aacc2eb550058bd7618e6
2019-08-16PAL: Process show runtime output 3Tibor Frank1-2/+4
- format the table Change-Id: I871251a8329e5d52c527c93afe35d875bddaed0c Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-08-16PAL: Process show runtime output 2Tibor Frank1-3/+2
- format the tables Change-Id: I31f786d53b79fa14c5d2dc21ff65d0465fde1d4f Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-08-15Refactor traffic profile verificationMiroslav Los1-94/+86
- CSIT-1194 Signed-off-by: Miroslav Los <miroslav.los@pantheon.tech> Change-Id: I0f4c234fb5f5f6543a5d525301f17f5a111e1053
2019-08-15PAL: Process show runtime outputTibor Frank1-5/+42
Change-Id: If7eac41cd33837eea7291f87129e2c176fbe6aea Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-08-14VAT-to-PAPI: Fix HTTP/TCP testsDave Wallace2-4/+4
Change-Id: Ie728bc73eb7429d246e82dd195fc63191c3ac51d Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
2019-08-14Move: WRK installation into ansiblePeter Mikus8-83/+70
- Remove ability to install from framework. - Control via ansible with other dependencies. Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I5fd0ca18b4f76c30b6c28b4dcd15e538e01cb315
2019-08-14Report: Add dataTibor Frank1-4/+12
- Dry runs - fix table 'VPP Soak vs NDR 2n-skx' Change-Id: I1fb101ab1b7cc40de49e8bb564818a730d3853a4 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-08-14Report: Add dataTibor Frank1-319/+99
- Dry runs Change-Id: Ib6e50853b5b4638dc0f4bc93a98b3818f5079658 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-08-14PAL: Archiving of input dataTibor Frank1-8/+24
Change-Id: I0902613047d7543378a4b7d46811fc67776c6ad9 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-08-13Report: Download first from logs.fd.ioTibor Frank4-161/+150
Change-Id: I308d7a7f72e0ea2e23b96be7db1ba35920bae519 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-08-13PAL: Get DPDK VersionTibor Frank1-5/+4
- Needed for trending Change-Id: I3d576e39d6e3b91821050fbd4a8a95380275797b Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-08-13PAL: Get TG IP address from output_info.xmlTibor Frank1-7/+5
Change-Id: I566c0e436fbe50e5e72da35be6a2afc81e8a33b6 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-08-12Report: dataTibor Frank1-1/+1
Change-Id: Id51e073d23d7bb54864eb5fd1c3c320077e6abb8 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-08-12Report: DataTibor Frank1-274/+219
Change-Id: Ibd1a5dc6e451d992eb85b223973734c876e37fe7 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-08-12FIX: Remove unwanted Jenkins dependencyPeter Mikus1-29/+10
Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I7a43c3183dc276fa5e4806f31a52cf5844792d4d
2019-08-09Skip bad testbeds in reservationVratko Polak1-3/+12
Previously, ssh-inaccesible testbeds were handled the same way as reserved, never ending the wait loop. With this, if no testbed is accessible, the job fails early. Change-Id: I01bc79094fe0232a47d795e53e3daa52e8742bac Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2019-08-09Trending: Fix ipsecTibor Frank1-0/+4
Change-Id: I0f35098047bc1137cbf2a1ae39107698b1e9bf79 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-08-09Report: ConfigurationTibor Frank2-12/+12
Change-Id: I55dc7412e28cc2c5eb9c3f151e75a06be2d36f69 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-08-09Trending: Set 90 days periodTibor Frank1-10/+191
Change-Id: I56403c30142876501602fe06c0ad2665fa73cb7b Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-08-09Trending: TSH ipsec testsTibor Frank2-12/+38
Change-Id: Ib9f867e2b55a61019b487c96b0a05e9fa175dd0f Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-08-08Trending: Reduce ipsec testsTibor Frank1-18/+18
Change-Id: Ib164551d09ccf3ab5a95baade6d8b2744bc5ce16 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-08-08Trending: ipsecTibor Frank2-98/+207
Change-Id: I2fc623ac152b8559a230b340be2f1cc92c7e934a Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-08-08Trending: Add dnv mrr testsTibor Frank1-2/+483
Change-Id: If0c0d6b346e64caf7af4432917a91468a1f0554a Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-08-07FIX: PylintPeter Mikus1-3/+3
- my bad Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I8c1f57f6b648b99338f3f6a6ff9ec943082e9bc4
2019-08-05Trending: Reduce input dataTibor Frank1-118/+10
Change-Id: Iab9e6686ef163eda04d836e4f355a310058e846e Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-08-05FIX: Freeze Vagrant versionPeter Mikus1-0/+1
- config.vm.box_version = "20190724.1.0" Signed-off-by: Peter Mikus <pmikus@cisco.com> Change-Id: I56d70d62f38a10365e447346a619652e33392cbb
2019-08-02Add 3n-tsh mrr data to trending docsjuraj.linkes1-0/+407
Change-Id: I82f074c0f7261bd1019ade1e01781278b063c0cd Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>
2019-08-02Trending: Add 8 big input filesTibor Frank2-26/+2
Change-Id: I9891c9589014be04fa69973e092fdf8b9926a56f Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-08-02Trending: Implement retries to requestsTibor Frank2-5/+30
Change-Id: Ief9ab61a54cffb529ae3539096121d1f77ee0167 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-08-02Trending: Remove multiprocessing from cptaTibor Frank2-56/+17
Change-Id: If53c5a72abed11fda9b15d043b24027d2eb9d86e Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-08-02Trending: Fix ignore list processingTibor Frank1-2/+2
Change-Id: I27c2ae25cc9cf6996f3c22417479b300faa73994 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-08-01Trending: Improve log outputTibor Frank1-2/+2
Change-Id: I37464dc15749d0f59a3ee67651483d6bc1388316 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-08-01Trending: remove multitaskingTibor Frank1-68/+22
Change-Id: Id331fb5bb1d2e5a4da9665b330b991010e5a11e2 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-08-01Trending: Add multiprocessing, remove archivingTibor Frank4-156/+192
Change-Id: I67cfde7dfc9b81fca3ae102b43f6defafe88f689 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-08-01Trending: Memory consumptionTibor Frank5-10/+75
Change-Id: I26a7d9e7ee0b1a64666c3ffbcfc424f04a52d046 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-07-31Trending: Reduce input dataTibor Frank1-2/+5
Change-Id: I8917e72717c672c44494a34aefce4039ac5efcc9 Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-07-31Trending: Set packages versionsTibor Frank1-1/+1
Change-Id: I272b7c4a5f9d2f446a0f91214d6052196690cdcd Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-07-31Trending: Set packages versionsTibor Frank2-53/+53
Change-Id: I8d9298733652f16dbfa0c183602060eb4f727dfe Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-07-31Trending: Reduce input dataTibor Frank2-4/+5
Change-Id: I6760f39e9438d1af97217f2fc28b933226b9cb2d Signed-off-by: Tibor Frank <tifrank@cisco.com>
2019-07-31Trending: Reduce input dataTibor Frank2-61/+59
Change-Id: I8dc4fb23c07b1ab9cc0ecad852cc594ec9922055 Signed-off-by: Tibor Frank <tifrank@cisco.com>