After installing Mellanox MOFED, I configured Luster in the following way
./configure --disable-server --with-o2ib=/usr/src/mlnx-ofed-kernel-2.3
and was able to compile kernel modules.
But the version of function symbols that were compiled in ko2iblnd
module belongs to original kernel modules and not to the OFED
modules. As results compiled module refuse to load.
For example ib_destroy_cq function
modprobe --dump-modversions
/lib/modules/3.13.0-32-generic/extra/klnds/o2iblnd/ko2iblnd.ko |grep
ib_destroy_cq
0xad52ad2c ib_destroy_cq
And this is the address from the MOFED Module.symvers file
root@kickseed:/usr/src/lustre-release# grep ib_destroy_cq Module.symvers
0x9a1f091e __crc_ib_destroy_cq
/lib/modules/3.13.0-32-generic/updates/dkms/ib_core (unknown)
It looks like an issue in Lustre.
Setup
Ubuntu-14.04
kernel-3.13.0.32-generic
MOFED-2.3