Re: [HPDD-discuss] Mellanox OFED MLNX_OFED_LINUX-1.5.3-3 for Lustrenot working

-----Original Message----- From: Charles Taylor [mailto:taylor@hpc.ufl.edu] Sent: Tuesday, May 07, 2013 10:11 AM To: Suresh Shelvapille Cc: hpdd-discuss(a)ml01.01.org Subject: Re: [HPDD-discuss] Mellanox OFED MLNX_OFED_LINUX-1.5.3-3 for Lustrenot working Unfortunately, that is not true for *all* Mellanox cards at the moment. Hopefully, it will be the case soon but it is not now. Regards, Charlie On May 7, 2013, at 10:04 AM, Suresh Shelvapille wrote: > You don't need to use Mellanox-OFED to get FDR cards working. I have centos 6.3 and OFED 3.5-rc2 installed on my > machine. Both Lustre and OFED work fine at 56Gbps! > > Basically, I loaded Centos 6.3, installed Lustre kernel-packages on top (as described) and then installed OFED package > 3.5.rc2 (that I download from OpenFabrics.org). > > Unless you need certain debug utilities that Mellanox OFED provides (and if you don't want to install NfsORDMA) then > there is no reason to use Mellanox OFED. OpenFabrics OFED is fine! > > Hope this helps. > Suri > >> -----Original Message----- >> From: hpdd-discuss-bounces(a)ml01.01.org [mailto:hpdd-discuss-bounces@ml01.01.org] On Behalf Of Charles >> Taylor >> Sent: Tuesday, May 07, 2013 9:30 AM >> To: Brian J. Murrell >> Cc: hpdd-discuss(a)ml01.01.org >> Subject: Re: [HPDD-discuss] Mellanox OFED MLNX_OFED_LINUX-1.5.3-3 for Lustrenot working >> >> Touche! We are being forced to use the Mellanox/OFED stack now to support our new FDR IB cards and >> it *is* painful. We have a meeting with Mellanox today to give them "what for" (as the Geico Gecko >> puts it). They seem little concerned with the needs of their customers in this regard. >> Nonetheless, we will push. >> >> Of course, a little pressure from a competitor such as Intel, could not hurt either. ;) >> >> Charles A. Taylor >> UF HPC Center >> >> On May 7, 2013, at 7:36 AM, Brian J. Murrell wrote: >> >>> On Tue, 2013-05-07 at 16:57 +0530, linux freaker wrote: >>> >>> >>>> >>>> I can try it once more but really I feel its painful. >>> >>> It is, which is why we encourage people to use the I/B stack provided by >>> RedHat, already built into their kernel and the corresponding user-space >>> packages. >>> >>> It seems that a lot of people (think they) need to install the Mellanox >>> I/B stack instead. Perhaps this is true for your (and everyone else's) >>> case, or perhaps not. I can't really tell, and am not really involved >>> closely enough in I/B to know. >>> >>> But ultimately, I wonder why, given all of the apparent need for >>> whatever Mellanox does differently than the upstream OFED and/or RH I/B >>> stacks are doing, that these needs for the Mellanox stack are not being >>> pushed back into either OFED or the upstream kernel I/B stack. Life >>> really would be so much easier for so many people if it were. >>> >>> Maybe if Mellanox hears from enough of their customers about the pain it >>> is to use their hardware they might try to get their stuff upstream. >>> >>> b. >>> >>> >>> >>> _______________________________________________ >>> HPDD-discuss mailing list >>> HPDD-discuss(a)lists.01.org >>> https://lists.01.org/mailman/listinfo/hpdd-discuss >> >> _______________________________________________ >> HPDD-discuss mailing list >> HPDD-discuss(a)lists.01.org >> https://lists.01.org/mailman/listinfo/hpdd-discuss >