On 2016/01/08, 02:35, "David Roman"
<David.Roman@noveltis.fr<mailto:David.Roman@noveltis.fr>> wrote:
I use lustre 2.7.0. When I compile a tool in C++ language (configure, make, make install).
The compilation time on the Lustre is 28min. But the same compilation on a local disk or a
NFS volume (Ext4 file system) the time is about 8min.
I tried to change the stripe count without any succes.
I did some tests with the dd commande. I have a bandwidth about 120 Mb/s
How can I do to improve the compilations on Lustre files system ?
Are you doing a serial or parallel make (i.e. "make -j N")? For small files
like this, it is best to only have a single stripe per file, and increasing the stripe
count would hurt performance. It is likely that the bottleneck is due to single-threaded
metadata updates per client, which are fixed in Lustre 2.8. You could also run the make
in parallel on multiple nodes, using "distcc" or similar tools.
Cheers, Andreas
--
Andreas Dilger
Lustre Principal Architect
Intel High Performance Data Division