So, it seems the OFED package is there and you have a working ib0
interface, but the ko2iblnd kernel module was not loaded for some reason.
could you verify that the file exists for the kernel you are running? If
not, there are configure options to tell the location of the ofed
headers and libs
On 12/05/2014 03:47 PM, Bihary, Sandor wrote:
Hello Dennis!
Server side.
If I set the lustre conf to options lnet networks=tcp0(ib0) it looks working.
But If I use the options lnet networks=o2ib(ib0) I got the error message I mentioned on
my last email.
From: Dennis Zheleznyak [mailto:dennis@eshkol.com.co]
Sent: Friday, December 05, 2014 3:43 PM
To: Bihary, Sandor
Cc: HPDD-discuss(a)lists.01.org; Regos, Szabolcs; Horvath, Zoltan (zoly)
Subject: Re: [HPDD-discuss] Ieel Lustre + Infiniband
Hi Sanyi,
Are you getting the error on the client side or the server side ?
Dennis.
On Fri, Dec 5, 2014 at 2:28 PM, Bihary, Sandor
<sandor.bihary@hp.com<mailto:sandor.bihary@hp.com>> wrote:
Hello All!
We are buliding a Lustre system.
The OS is RHEL 6.5.
The IB driver is MLNX_OFED_LINUX-2.3-2.0.1-rhel6.5-x86_64.iso
The Lustre version is: ieel-2.0.1.1
The install was fine (using the install script), but we cannot add the IB interface to
the Lnet.
We got this error message below. Could somebody help us how to make it work?
Best Regards,
Sanyi
Traceback (most recent call last):
File
"/usr/lib/python2.6/site-packages/chroma_agent/device_plugins/action_runner.py",
line 177, in run
File "/usr/lib/python2.6/site-packages/chroma_agent/plugin_manager.py", line
283, in run
File
"/usr/lib/python2.6/site-packages/chroma_agent/action_plugins/manage_lnet.py",
line 91, in start_lnet
File "/usr/lib/python2.6/site-packages/chroma_agent/shell.py", line 140, in
try_run
CommandExecutionError: Error (1) running 'lctl net up': '' 'LNET
configure error 100: Network is down
ko2iblnd: disagrees about version of symbol ib_dealloc_pd
ko2iblnd: Unknown symbol ib_dealloc_pd
ko2iblnd: disagrees about version of symbol ib_fmr_pool_map_phys
ko2iblnd: Unknown symbol ib_fmr_pool_map_phys
LNetError: 30418:0:(api-ni.c:1208:lnet_startup_lndnis()) Can't load LND o2ib, module
ko2iblnd, rc=256