1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
|
# 1. Introduction
The purpose of this document is to illustrate how to build DMM and run applications on it.
Note:
Users can easily build DMM by running DMM/scripts/build.sh, which contains following steps.
# 2. Build DPDK
DPDK needs to be built first for DMM RTE memory dependency.
- Steps:
Download dpdk-18.02.tar.xz from DPDK release, you can get it from [http://static.dpdk.org/rel](http://static.dpdk.org/rel)
```sh
wget http://static.dpdk.org/rel/dpdk-18.02.tar.xz
tar xvf dpdk-18.02.tar.xz
vi dpdk-18.02/config/common_base
//make CONFIG_RTE_BUILD_SHARED_LIB=y, CONFIG_RTE_EXEC_ENV=y, CONFIG_RTE_LIBRTE_EAL=y, CONFIG_RTE_EAL_PMD_PATH="/tmp/dpdk/drivers/"
cd dpdk-18.02
make install T=x86_64-native-linuxapp-gcc DESTDIR=/usr -j 4
cd x86_64-native-linuxapp-gcc
make # install the dpdk which will generate .so inside lib folder in the path.
mkdir -p /tmp/dpdk/drivers/
cp -f /usr/lib/librte_mempool_ring.so /tmp/dpdk/drivers/
```
Note:
Under certain kernel versions (e.g. v3.10.0 adopted by CentOS 7.5), compiling DPDK with default
configuration will encounter errors like below.
`error: unknown field 'ndo_change_mtu' specified in initializer .no_change_mtu = kni_net_change_mtu`
This is caused by `kni` compiling, disable `kni` in dpdk config file will figure it out.
Actually, we have tested ubuntu 14.04 ~ 16.04, CentOS 7.2, and they worked well.
# 3. Build DMM
```sh
cd $(DMM_DIR)/thirdparty/glog/glog-0.3.4/ && autoreconf -ivf
cd $(DMM_DIR)/build
cmake ..
```
Note:
$(DMM_DIR) is the directory where dmm has been cloned.
After cmake all the makefiles and dependent .sh files will be copied under build directory.
```sh
make -j 8
```
Then we can get libnStackAPI.so
For centos we can use the command 'make pkg-rpm' to generate the rpm package in release/rpm.
# 4. Build rsocket
```sh
cd $(DMM_DIR)/build
make dmm_rsocket
```
Note:
Make sure Mellanox OFED has been installed in your computer, or run the following command before compiling
```sh
cd $DMM_DIR/stacks/rsocket
#Take ubuntu16.04 as an example, the tgz file has the format MLNX_OFED_LINUX-<ver>-<OS label><CPU arch>.tgz
wget http://www.mellanox.com/downloads/ofed/MLNX_OFED-4.4-1.0.0.0/MLNX_OFED_LINUX-4.4-1.0.0.0-ubuntu16.04-x86_64.tgz
tar -zxvf MLNX_OFED_LINUX-4.4-1.0.0.0-ubuntu16.04-x86_64.tgz
cd MLNX_OFED_LINUX-4.4-1.0.0.0-ubuntu16.04-x86_64
./mlnxofedinstall --force
```
# 5. Env Setting
- Hugepage setting:
```sh
sudo sysctl -w vm.nr_hugepages=1024
```
Check hugepage info
```sh
cat /proc/meminfo
```
- Mount hugepages:
```sh
sudo mkdir -p /mnt/nstackhuge/
sudo mount -t hugetlbfs -o pagesize=2M none /mnt/nstackhuge/
sudo mkdir -p /var/run/ip_module
```
# 6. Build and Run the APP
- Link the app with the lib **libnStackAPI.so** first, you can refer to app_example/perf-test
- Enable detail log of nstack by setting env var
```sh
export LD_LIBRARY_PATH=/dmm/release/lib64
export NSTACK_LOG_ON=DBG
```
- Copy and update the module_config.json, rd_config.json into the same folder of app
- Run your app
|
