12:04 a.m.
You don't need to use Mellanox-OFED to get FDR cards working. I have centos 6.3 and
OFED 3.5-rc2 installed on my
machine. Both Lustre and OFED work fine at 56Gbps!
Basically, I loaded Centos 6.3, installed Lustre kernel-packages on top (as described) and
then installed OFED package
3.5.rc2 (that I download from OpenFabrics.org).
Unless you need certain debug utilities that Mellanox OFED provides (and if you don't
want to install NfsORDMA) then
there is no reason to use Mellanox OFED. OpenFabrics OFED is fine!
Hope this helps.
Suri
-----Original Message-----
From: hpdd-discuss-bounces(a)ml01.01.org [mailto:hpdd-discuss-bounces@ml01.01.org] On
Behalf Of Charles
Taylor
Sent: Tuesday, May 07, 2013 9:30 AM
To: Brian J. Murrell
Cc: hpdd-discuss(a)ml01.01.org
Subject: Re: [HPDD-discuss] Mellanox OFED MLNX_OFED_LINUX-1.5.3-3 for Lustrenot working
Touche! We are being forced to use the Mellanox/OFED stack now to support our new FDR
IB cards and
it *is* painful. We have a meeting with Mellanox today to give them "what
for" (as the Geico Gecko
puts it). They seem little concerned with the needs of their customers in this regard.
Nonetheless, we will push.
Of course, a little pressure from a competitor such as Intel, could not hurt either. ;)
Charles A. Taylor
UF HPC Center
On May 7, 2013, at 7:36 AM, Brian J. Murrell wrote:
> On Tue, 2013-05-07 at 16:57 +0530, linux freaker wrote:
>
>
>>
>> I can try it once more but really I feel its painful.
>
> It is, which is why we encourage people to use the I/B stack provided by
> RedHat, already built into their kernel and the corresponding user-space
> packages.
>
> It seems that a lot of people (think they) need to install the Mellanox
> I/B stack instead. Perhaps this is true for your (and everyone else's)
> case, or perhaps not. I can't really tell, and am not really involved
> closely enough in I/B to know.
>
> But ultimately, I wonder why, given all of the apparent need for
> whatever Mellanox does differently than the upstream OFED and/or RH I/B
> stacks are doing, that these needs for the Mellanox stack are not being
> pushed back into either OFED or the upstream kernel I/B stack. Life
> really would be so much easier for so many people if it were.
>
> Maybe if Mellanox hears from enough of their customers about the pain it
> is to use their hardware they might try to get their stuff upstream.
>
> b.
>
>
>
> _______________________________________________
> HPDD-discuss mailing list
> HPDD-discuss(a)lists.01.org
> https://lists.01.org/mailman/listinfo/hpdd-discuss
_______________________________________________
HPDD-discuss mailing list
HPDD-discuss(a)lists.01.org
https://lists.01.org/mailman/listinfo/hpdd-discuss