1:02 a.m.
Hi Roland,
Thanks for your answer. Here are answers to your questions:
There are two things here that make me wonder though:
a) You don't have an option like --with-linux=${KSRC}
no I don't use that option, which make no differences since the configure script uses
/usr/src/linux-source-3.2.0. I tried the option
--with-linux=/usr/src/linux-source-3.2.0
b) What's underneath /usr/src/mlnx-ofed-kernel-2.0?
Makefile@ compat/ compat_base_tree compat_version
dkms.conf include/ net/
backports/ compat_base compat_base_tree_version configure@
drivers/ makefile@ ofed_scripts/
I did a little hack for a test: I replaced the two occurences of
"ENABLEO2IB=3" by ENABLEO2IB=1 in the configure script after reading a
couple of threads found on Google. That make the compile work without
error, but the o2ib network returns error 100.
mel-bc1e41-be14:~# cat /etc/modprobe.d/lustre.conf
options lnet networks=o2ib(ib0.8002)
and here is what I get when I try to start lnet:
mel-bc1e41-be14:~# modprobe lnet
mel-bc1e41-be14:~# lctl network configure
LNET configure error 100: Network is down
And the syslog reports this:
Dec 16 12:11:34 mel-bc1e41-be14 kernel: [ 231.667631] LNetError:
2766:0:(api-ni.c:1227:lnet_startup_lndnis()) Can't load LND o2ib, module
ko2iblnd, rc=256
the tcp network works fine with the client compiled that way,
Thanks!
On 12/16/13 13:40, rf(a)q-leap.de wrote:
>>>>> "Patrice" == Patrice
Hamelin<patrice.hamelin(a)ssc-spc.gc.ca> writes:
Hi Patrice,
Patrice> Hi,
Patrice> Somebody has ever successfully compiled Lustre Client
Patrice> 2.4.1 on Ubuntu
Patrice> Precise 12.04 with Mellanox OFED 2.0.3?
we have built (and support) it (server + client) under Ubuntu 12.04.x for
Qlustar. However, we use kernel 2.6.32.x for the server and kernel
3.12.x (in-kernel client with some fixes see Lustre jira) for the
client and build against the stock OFED sources (for 2.6.32.x). I'm not
sure whether the stock 12.04 kernels (3.2 or higher) will support a
2.4.1 compile without major modifications (a client only compile
obviously has a lot better chances though).
Patrice> I am stucked with this error:
Patrice> mel-bc1e41-be14:/usr/src/lustre-2.4.1# ./configure
Patrice> --with-o2ib=/usr/src/mlnx-ofed-kernel-2.0 --disable-server
Patrice> checking build system type... x86_64-unknown-linux-gnu . .
Patrice> . checking whether to enable OpenIB gen2 support... no
Patrice> configure: error: can't compile with OpenIB gen2 headers
Patrice> under /usr/src/mlnx-ofed-kernel-2.0
There are two things here that make me wonder though:
a) You don't have an option like --with-linux=${KSRC}
b) What's underneath /usr/src/mlnx-ofed-kernel-2.0? For stock OFED I
have:
Documentation/ configure.mk.kernel kernel-build/ makefile@ patches/
Makefile@ drivers/ kernel_addons/ net/
config.mk include/ kernel_patches/ ofa_kernel.spec@
configure@ kernel/ lib/ ofed_scripts/
Does Mellanox OFED have the same layout? If not, it's possible the headers
can't be found.
Patrice> I tried a couple of patches/hacks found on Google but
Patrice> without success.
Patrice> Thanks.
Good luck,
Roland
--
https://qlustar.com
--
Patrice Hamelin
Specialiste sénior en systèmes d'exploitation | Senior OS specialist
Environnement Canada | Environment Canada
2121, route Transcanadienne | 2121 Transcanada Highway
Dorval, QC H9P 1J3
Téléphone | Telephone 514-421-5303
Télécopieur | Facsimile 514-421-7231
Gouvernement du Canada | Government of Canada