本篇文章为大家展示了BeeGFS开发环境搭建中如何安装和配置MPICH和MDTEST,内容简明扼要并且容易理解,绝对能使你眼前一亮,通过这篇文章的详细介绍希望你能有所收获。
安装好之后,如果我们想对其元数据服务的性能进行评估和测试,可以安装MDTEST
工具,具体的步骤如下:
MDTEST
测试工具依赖MPI
协议,所以需要首先安装MPICH
(MPI
协议的一种实现)。
安装和配置(三个节点使用相同操作):
# http://www.mpich.org/
$ yum install -y gcc gcc-c++ gcc-gfortran
$ wget http://www.mpich.org/static/downloads/3.3/mpich-3.3.tar.gz
$ tar xvf mpich-3.3.tar.gz
$ cd mpich-3.3/
$ ./configure --prefix=/usr/local/mpich
$ make -j $(nproc) && make install
$ cp -r examples/ /usr/local/mpich
$ vi ~/.bashrc
PATH=$PATH:/usr/local/mpich/bin
MANPATH=$MANPATH:/usr/local/mpich/man
export PATH MANPATH
$ . ~/.bashrc
测试安装是否正常(三个节点间SSH需要配置免密登录):
$ mpirun -np 10 /usr/local/mpich/examples/cpi
Process 2 of 10 is on sacd01
Process 3 of 10 is on sacd01
Process 8 of 10 is on sacd01
Process 1 of 10 is on sacd01
Process 0 of 10 is on sacd01
Process 5 of 10 is on sacd01
Process 9 of 10 is on sacd01
Process 4 of 10 is on sacd01
Process 7 of 10 is on sacd01
Process 6 of 10 is on sacd01
pi is approximately 3.1415926544231256, Error is 0.0000000008333325
wall clock time = 0.002448
$ vi servers
sacd01:2
sacd02:2
sacd03:2
$ mpirun -np 10 -f servers /usr/local/mpich/examples/cpi
Process 6 of 10 is on sacd01
Process 7 of 10 is on sacd01
Process 0 of 10 is on sacd01
Process 5 of 10 is on sacd03
Process 1 of 10 is on sacd01
Process 2 of 10 is on sacd02
Process 8 of 10 is on sacd02
Process 9 of 10 is on sacd02
Process 3 of 10 is on sacd02
Process 4 of 10 is on sacd03
pi is approximately 3.1415926544231256, Error is 0.0000000008333325
wall clock time = 0.001612
安装和配置MDTEST
:
$ wget https://sourceforge.net/projects/mdtest/files/mdtest%20latest/mdtest-1.9.3/mdtest-1.9.3.tgz
$ mkdir mdtest-1.9.3 && tar xvf mdtest-1.9.3.tgz -C mdtest-1.9.3 && cd mdtest-1.9.3
$ MPI_CC=mpicc make
$ cp mdtest /usr/bin/
测试安装是否正常:
$ cd /mnt/beegfs/
$ mdtest -I 10 -z 5 -b 2 -L
-- started at 05/08/2019 17:17:42 --
mdtest-1.9.3 was launched with 1 total task(s) on 1 node(s)
Command line used: mdtest -I 10 -z 5 -b 2 -L
Path: /mnt
FS: 122.3 GiB Used FS: 11.0% Inodes: 61.2 Mi Used Inodes: 1.8%
1 tasks, 630 files/directories
SUMMARY: (of 1 iterations)
Operation Max Min Mean Std Dev
--------- --- --- ---- -------
Directory creation: 1305.970 1305.970 1305.970 0.000
Directory stat : 2253.825 2253.825 2253.825 0.000
Directory removal : 1170.048 1170.048 1170.048 0.000
File creation : 1045.978 1045.978 1045.978 0.000
File stat : 2025.179 2025.179 2025.179 0.000
File read : 1334.224 1334.224 1334.224 0.000
File removal : 1623.509 1623.509 1623.509 0.000
Tree creation : 429.608 429.608 429.608 0.000
Tree removal : 799.761 799.761 799.761 0.000
-- finished at 05/08/2019 17:17:45 --
$ vi servers
sacd01:2
sacd02:2
sacd03:2
$ mpirun -np 10 -f servers mdtest -d /mnt/beegfs -I 10 -z 5 -b 2 -L
-- started at 05/08/2019 17:25:13 --
mdtest-1.9.3 was launched with 10 total task(s) on 2 node(s)
Command line used: mdtest -d /mnt/beegfs -I 10 -z 5 -b 2 -L
Path: /mnt
FS: 122.3 GiB Used FS: 64.1% Inodes: 61.2 Mi Used Inodes: 2.5%
10 tasks, 6300 files/directories
SUMMARY: (of 1 iterations)
Operation Max Min Mean Std Dev
--------- --- --- ---- -------
Directory creation: 2778.114 2778.114 2778.114 0.000
Directory stat : 4538.071 4538.071 4538.071 0.000
Directory removal : 3858.621 3858.621 3858.621 0.000
File creation : 2146.615 2146.615 2146.615 0.000
File stat : 4305.599 4305.599 4305.599 0.000
File read : 3106.186 3106.186 3106.186 0.000
File removal : 3695.281 3695.281 3695.281 0.000
Tree creation : 670.204 670.204 670.204 0.000
Tree removal : 748.542 748.542 748.542 0.000
-- finished at 05/08/2019 17:25:27 --
$ mpirun -np 10 -f servers mdtest -d /mnt/beegfs -i 2 -I 100 -b 10 -u -L -F
-- started at 05/08/2019 17:26:11 --
mdtest-1.9.3 was launched with 10 total task(s) on 2 node(s)
Command line used: mdtest -d /mnt/beegfs -i 2 -I 100 -b 10 -u -L -F
Path: /mnt
FS: 122.3 GiB Used FS: 64.1% Inodes: 61.2 Mi Used Inodes: 2.5%
10 tasks, 1000 files
SUMMARY: (of 2 iterations)
Operation Max Min Mean Std Dev
--------- --- --- ---- -------
File creation : 2150.731 1990.272 2070.502 80.229
File stat : 4334.598 4025.630 4180.114 154.484
File read : 2337.454 2256.293 2296.873 40.581
File removal : 4273.461 3998.520 4135.991 137.470
Tree creation : 243.232 55.898 149.567 93.666
Tree removal : 296.417 265.496 280.957 15.461
-- finished at 05/08/2019 17:26:13 --
查看命令帮助:
$ mdtest --help
Usage: mdtest [-b branching_factor] [-B] [-c] [-C] [-d testdir] [-D] [-e number_of_bytes_to_read]
[-E] [-f first] [-F] [-h] [-i iterations] [-I items_per_dir] [-l last] [-L]
[-n number_of_items] [-N stride_length] [-p seconds] [-r]
[-R[seed]] [-s stride] [-S] [-t] [-T] [-u] [-v]
[-V verbosity_value] [-w number_of_bytes_to_write] [-y] [-z depth]
-b: branching factor of hierarchical directory structure
-B: no barriers between phases
-c: collective creates: task 0 does all creates
-C: only create files/dirs
-d: the directory in which the tests will run
-D: perform test on directories only (no files)
-e: bytes to read from each file
-E: only read files/dir
-f: first number of tasks on which the test will run
-F: perform test on files only (no directories)
-h: prints this help message
-i: number of iterations the test will run
-I: number of items per directory in tree
-l: last number of tasks on which the test will run
-L: files only at leaf level of tree
-n: every process will creat/stat/read/remove # directories and files
-N: stride # between neighbor tasks for file/dir operation (local=0)
-p: pre-iteration delay (in seconds)
-r: only remove files or directories left behind by previous runs
-R: randomly stat files (optional argument for random seed)
-s: stride between the number of tasks for each test
-S: shared file access (file only, no directories)
-t: time unique working directory overhead
-T: only stat files/dirs
-u: unique working directory for each task
-v: verbosity (each instance of option increments by one)
-V: verbosity value
-w: bytes to write to each file after it is created
-y: sync file after writing
-z: depth of hierarchical directory structure
上述内容就是BeeGFS开发环境搭建中如何安装和配置MPICH和MDTEST,你们学到知识或技能了吗?如果还想学到更多技能或者丰富自己的知识储备,欢迎关注亿速云行业资讯频道。
亿速云「云服务器」,即开即用、新一代英特尔至强铂金CPU、三副本存储NVMe SSD云盘,价格低至29元/月。点击查看>>
免责声明:本站发布的内容(图片、视频和文字)以原创、转载和分享为主,文章观点不代表本网站立场,如果涉及侵权请联系站长邮箱:is@yisu.com进行举报,并提供相关证据,一经查实,将立刻删除涉嫌侵权内容。
原文链接:https://my.oschina.net/LastRitter/blog/3061771