Re: [HPDD-discuss] Bad performance with g++ compiler
I already use make -j N, and it is true that it improves the compilation time, but it is
less good. I hope to improve this time by custuming lustre file system if this is
possible
I tried in folder with stripe count to 1 and -1 and the time is the same
-----Message d'origine-----
De : Dilger, Andreas [mailto:andreas.dilger@intel.com]
Envoyé : vendredi 8 janvier 2016 14:14
À : David Roman <David.Roman(a)noveltis.fr>; hpdd-discuss(a)ml01.01.org
Objet : Re: [HPDD-discuss] Bad performance with g++ compiler
On 2016/01/08, 02:35, "David Roman"
<David.Roman@noveltis.fr<mailto:David.Roman@noveltis.fr>> wrote:
I use lustre 2.7.0. When I compile a tool in C++ language (configure, make, make install).
The compilation time on the Lustre is 28min. But the same compilation on a local disk or a
NFS volume (Ext4 file system) the time is about 8min.
I tried to change the stripe count without any succes.
I did some tests with the dd commande. I have a bandwidth about 120 Mb/s
How can I do to improve the compilations on Lustre files system ?
Are you doing a serial or parallel make (i.e. "make -j N")? For small files
like this, it is best to only have a single stripe per file, and increasing the stripe
count would hurt performance. It is likely that the bottleneck is due to single-threaded
metadata updates per client, which are fixed in Lustre 2.8. You could also run the make
in parallel on multiple nodes, using "distcc" or similar tools.
Cheers, Andreas
--
Andreas Dilger
Lustre Principal Architect
Intel High Performance Data Division