Re: [HPDD-discuss] Mellanox OFED MLNX_OFED_LINUX-1.5.3-3 for Lustrenot working

You don't need to use Mellanox-OFED to get FDR cards working. I have centos 6.3 and OFED 3.5-rc2 installed on my machine. Both Lustre and OFED work fine at 56Gbps! Basically, I loaded Centos 6.3, installed Lustre kernel-packages on top (as described) and then installed OFED package 3.5.rc2 (that I download from OpenFabrics.org). Unless you need certain debug utilities that Mellanox OFED provides (and if you don't want to install NfsORDMA) then there is no reason to use Mellanox OFED. OpenFabrics OFED is fine! Hope this helps. Suri > -----Original Message----- > From: hpdd-discuss-bounces(a)ml01.01.org [mailto:hpdd-discuss-bounces@ml01.01.org] On Behalf Of Charles > Taylor > Sent: Tuesday, May 07, 2013 9:30 AM > To: Brian J. Murrell > Cc: hpdd-discuss(a)ml01.01.org > Subject: Re: [HPDD-discuss] Mellanox OFED MLNX_OFED_LINUX-1.5.3-3 for Lustrenot working > > Touche! We are being forced to use the Mellanox/OFED stack now to support our new FDR IB cards and > it *is* painful. We have a meeting with Mellanox today to give them "what for" (as the Geico Gecko > puts it). They seem little concerned with the needs of their customers in this regard. > Nonetheless, we will push. > > Of course, a little pressure from a competitor such as Intel, could not hurt either. ;) > > Charles A. Taylor > UF HPC Center > > On May 7, 2013, at 7:36 AM, Brian J. Murrell wrote: > >> On Tue, 2013-05-07 at 16:57 +0530, linux freaker wrote: >> >> >>> >>> I can try it once more but really I feel its painful. >> >> It is, which is why we encourage people to use the I/B stack provided by >> RedHat, already built into their kernel and the corresponding user-space >> packages. >> >> It seems that a lot of people (think they) need to install the Mellanox >> I/B stack instead. Perhaps this is true for your (and everyone else's) >> case, or perhaps not. I can't really tell, and am not really involved >> closely enough in I/B to know. >> >> But ultimately, I wonder why, given all of the apparent need for >> whatever Mellanox does differently than the upstream OFED and/or RH I/B >> stacks are doing, that these needs for the Mellanox stack are not being >> pushed back into either OFED or the upstream kernel I/B stack. Life >> really would be so much easier for so many people if it were. >> >> Maybe if Mellanox hears from enough of their customers about the pain it >> is to use their hardware they might try to get their stuff upstream. >> >> b. >> >> >> >> _______________________________________________ >> HPDD-discuss mailing list >> HPDD-discuss(a)lists.01.org >> https://lists.01.org/mailman/listinfo/hpdd-discuss > > _______________________________________________ > HPDD-discuss mailing list > HPDD-discuss(a)lists.01.org > https://lists.01.org/mailman/listinfo/hpdd-discuss