blob: 58bd6b87058d49d91220a70e174e0f1b21706da7 (
plain)
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
|
# 1. Introduction:
The purpose of this document is to illustrate how to build DMM and run applications on it.
Note:
Users can easily build DMM by running DMM/scripts/build.sh, which contains following steps.
# 2. Build DPDK:
DPDK needs to be built first for DMM RTE memory dependency.
- Steps :
Download dpdk-18.02.tar.xz from DPDK release, you can get it from [http://static.dpdk.org/rel](http://static.dpdk.org/rel)
```
#wget http://static.dpdk.org/rel/dpdk-18.02.tar.xz
#tar xvf dpdk-18.02.tar.xz
#vi dpdk-18.02/config/common_base
//make CONFIG_RTE_BUILD_SHARED_LIB=y, CONFIG_RTE_EXEC_ENV=y, CONFIG_RTE_LIBRTE_EAL=y, CONFIG_RTE_EAL_PMD_PATH="/tmp/dpdk/drivers/"
#cd dpdk-18.02
#make install T=x86_64-native-linuxapp-gcc DESTDIR=/usr -j 4
#cd x86_64-native-linuxapp-gcc
#make //install the dpdk which will generate .so inside lib folder in the path.
#mkdir -p /tmp/dpdk/drivers/
#cp -f /usr/lib/librte_mempool_ring.so /tmp/dpdk/drivers/
```
Note:
Environment:
Linux ubuntu 16.04 or some distro which support dpdk-18.02
# 3. Build DMM:
```
#cd $(DMM_DIR)/thirdparty/glog/glog-0.3.4/ && autoreconf -ivf
#cd $(DMM_DIR)/build
#cmake ..
```
Note:
$(DMM_DIR) is the directory where dmm has been cloned.
After cmake all the makefiles and dependent .sh files will be copied under build directory.
```
#make -j 8
```
Then we can get libnStackAPI.so
For centos we can use the command 'make pkg-rpm' to generate the rpm package in release/rpm.
# 4. Build rsocket:
```
#cd $(DMM_DIR)/build
#make dmm_rsocket
```
Note:
Make sure Mellanox OFED has been installed in your computer, or run the following command before compiling
```
#cd $DMM_DIR/stacks/rsocket
//Take ubuntu16.04 as an example, the tgz file has the format MLNX_OFED_LINUX-<ver>-<OS label><CPU arch>.tgz
#wget http://www.mellanox.com/downloads/ofed/MLNX_OFED-4.4-1.0.0.0/MLNX_OFED_LINUX-4.4-1.0.0.0-ubuntu16.04-x86_64.tgz
#tar -zxvf MLNX_OFED_LINUX-4.4-1.0.0.0-ubuntu16.04-x86_64.tgz
#cd MLNX_OFED_LINUX-4.4-1.0.0.0-ubuntu16.04-x86_64
#./mlnxofedinstall --force
```
# 5. Env Setting:
- Hugepage setting:
```
#sudo sysctl -w vm.nr_hugepages=1024
```
Check hugepage info
```
#cat /proc/meminfo
```
- Mount hugepages:
```
#sudo mkdir -p /mnt/nstackhuge/
#sudo mount -t hugetlbfs -o pagesize=2M none /mnt/nstackhuge/
#sudo mkdir -p /var/run/ip_module
```
# 6. Biuld and Run the APP
- Link the app with the lib **libnStackAPI.so** first, you can refer to app_example/perf-test
- Enable detail log of nstack by setting env var
```
#export LD_LIBRARY_PATH=/dmm/release/lib64
#export NSTACK_LOG_ON=DBG
```
- Copy and update the module_config.json, rd_config.json into the same folder of app
- Run your app
|