blob: bd906e174294af1f88242a50ea19d8ef35fd9e33 (
plain)
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
|
# Copyright (c) 2017 Cisco and/or its affiliates.
# Licensed under the Apache License, Version 2.0 (the "License");
# you may not use this file except in compliance with the License.
# You may obtain a copy of the License at:
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
*** Settings ***
| Library | resources.libraries.python.honeycomb.Performance
| Library | resources.libraries.python.InterfaceUtil
| Resource | resources/libraries/robot/honeycomb/honeycomb.robot
| Documentation | Keywords used in Honeycomb performance testing.
*** Keywords ***
| Configure Honeycomb Netconf threads
| | [Documentation] | Modify thread configuration of Honeycomb's Netconf server,
| | ... | Requires a restart of Honeycomb to take effect.
| | ...
| | ... | *Arguments:*
| | ... | - node - Node to change configuration on. Type: dictionary
| | ... | - threads - Number of threads to configure. Type: integer
| | ...
| | ... | *Example:*
| | ...
| | ... | \| Configure Honeycomb Netconf Threads \| ${nodes[DUT1]} \| ${2} \|
| | ...
| | [Arguments] | ${node} | ${threads}
| | Configure Netconf Threads | ${node} | ${threads}
| Run base operational read performance trial
| | [Documentation] | Send Netconf requests over plain TCP to obtain VPP version
| | ... | from Honeycomb operational data.
| | ...
| | ... | *Arguments:*
| | ... | - node - Node to run test on. Type: dictionary
| | ... | - cores - Number of available processor cores. Type: integer
| | ... | - cycles - Number of test cycles to run. Final results will\
| | ... | be averaged across all runs. Type: integer
| | ... | - threads - Number of threads to use for generating traffic.\
| | ... | Type: integer
| | ... | - requests - Number of requests to send in each thread and cycle.\
| | ... | Type: integer
| | ...
| | ... | *Example:*
| | ...
| | ... | \| Run base operational read performance trial \| ${nodes[DUT1]} \
| | ... | \| ${36} \| ${1} \| ${4} \| ${10000} \|
| | ...
| | [Arguments] | ${node} | ${cores} | ${cycles} | ${threads} | ${requests}
| | ${result}= | Run traffic script on DUT | ${node} | read_vpp_version.py
| | ... | ${cores} | cycles=${cycles} | threads=${threads}
| | ... | requests=${requests}
| | Set Test Message | ${result}
| Generate VPP Startup Configuration for Honeycomb Test on DUT
| | [Arguments] | ${node}
| | [Documentation] | Create VPP base startup configuration on DUT, then restart
| | ... | VPP to apply the configuration.
| | ...
| | ... | *Arguments:*
| | ... | - node - VPP node to configure. Type: dictionary
| | ...
| | ... | *Example:*
| | ...
| | ... | \| Generate VPP Startup Configuration for Honeycomb Test on DUT \
| | ... | \| ${nodes[DUT1]} \|
| | ...
| | Import Library | resources.libraries.python.VppConfigGenerator
| | ... | WITH NAME | VPP_config
| | Run keyword | VPP_config.Set Node | ${node}
| | Run keyword | VPP_config.Add Unix Log
| | Run keyword | VPP_config.Add Unix CLI Listen
| | Run keyword | VPP_config.Add Unix Nodaemon
| | Run keyword | VPP_config.Add CPU Main Core | ${1}
| | Run keyword | VPP_config.Apply Config
| Log Honeycomb and VPP process distribution on cores
| | [Documentation] | Log the distribution of VPP and Honeycomb child processes
| | ... | over the CPU cores.
| | ...
| | ... | *Arguments:*
| | ... | - node - Honeycomb node. Type: dictionary
| | ...
| | ... | *Example:*
| | ...
| | ... | \| Log Honeycomb and VPP process distribution on cores \
| | ... | \| ${nodes[DUT1]} \|
| | ...
| | [Arguments] | ${node}
| | Log Core Schedule | ${node} | vpp
| | Log Core Schedule | ${node} | java
| Generate Honeycomb startup configuration for performance test
| | [Documentation] | Create HC startup configuration and apply to config
| | ... | file on DUT. Requires Honeycomb restart to take effect.
| | ...
| | ... | *Arguments:*
| | ... | - node - Honeycomb node. Type: dictionary
| | ...
| | ... | *Example:*
| | ...
| | ... | \| Generate Honeycomb startup configuration for performance test \
| | ... | \| ${nodes[DUT1]} \|
| | ...
| | [Arguments] | ${node} | ${cores}
| | Import Library | resources.libraries.python.honeycomb.HoneycombSetup.HoneycombStartupConfig
| | ... | WITH NAME | HC_config
| | Run Keyword | HC_config.Set CPU Scheduler | FIFO
| | Run Keyword | HC_config.Set CPU Core Affinity | ${2} | ${cores}
| | Run Keyword | HC_config.Set JIT Compiler Mode | server
| | Run Keyword | HC_config.Set Memory Size | ${512} | ${2048}
| | Run Keyword | HC_config.Set Metaspace Size | ${128} | ${512}
| | Run Keyword | HC_config.Set NUMA Optimization
| | Run Keyword | HC_config.apply config | ${node}
|
