Hi Nico,

Thanks for providing these details. I would keep this in mind while running clients on ubuntu.
You mentioned that the problem has been resolved by building a custom vanilla 3.12.30 kernel with Lustre from git source. If possible, can you provide me the details/steps on how this was done?

Regards,
Akhilesh.

On Mon, Apr 13, 2015 at 5:12 PM, Nico Budewitz <Nico.Budewitz@met.no> wrote:
HI,

just a comment on the client side Ubuntu Lustre kernel module.

I am running Lustre 2.6 in production on Centos 6 Servers and Trusty Ubuntu client systems.

I have nothing to add regarding the server setup, but be careful with the Trusty Lustre kernel module.
Have a look at the mail I have send to this list on 09/10/2014: subject "LNET: out of memory at /build/buildd/linux-3.13.0/drivers/staging/lustre/"

The Ubuntu Lustre kernel module was quite unstable at that time and it seemed Lustre patches have not been added to the Ubuntu stock kernel.
The problem has been resolved by building a custom vanilla 3.12.30 kernel and building Lustre from source. Since then, all Trusty clients are stable.

just in case.

-Nico

 
On 04/13/2015 04:46 PM, Akhilesh Gadde wrote:
Thanks Eli.
I was trying to build the server on Ubuntu and couldn't find much help. Yes. I agree that not much work is needed for client since the client module is already incorporated as part of the kernel.
Shifted to CentOS now due to time constraints for my project. If James could provide the details on how to do that, I would be glad to test during my spare time and post the details/results to the community.

Regards,
Akhilesh.

On Sun, Apr 12, 2015 at 12:30 PM, E.S. Rosenberg <esr@cs.huji.ac.il> wrote:
On Sun, Apr 12, 2015 at 7:24 PM, Akhilesh Gadde
<akhilesh.gadde@stonybrook.edu> wrote:
> Hi Rosenberg,
>
> I have been trying the entire weekend on how to do this. Not finding the
> right way to do that. :(
Sorry to hear :(

For clients you don't need anything special, the stock kernel should
suffice (though you may want a newer kernel for bugfixes etc).

For the servers I can't tell you (yet), but it seemed from James' post
that he built that successfully...

Regards,
Eli

PS: this is the ./configure we use to build our clients:

./configure --disable-modules --disable-server --enable-client
--prefix=/usr/local/lustre/[version]


>
>
> Regards,
> Akhilesh Gadde.
>
> On Sun, Apr 12, 2015 at 7:50 AM, E.S. Rosenberg
> <esr+hpdd-discuss@mail.hebrew.edu> wrote:
>>
>> Please report how it went, here we have an all Debian-client setup but
>> since we/the consultants on the project didn't want to be guinea pigs
>> we stuck with CentOS 6 servers....
>>
>> On Fri, Apr 10, 2015 at 8:12 PM, Simmons, James A. <simmonsja@ornl.gov>
>> wrote:
>> >>Hi Simmons,
>> >
>> >>Thanks for the response. Now I got the confidence that I could deploy
>> >> Lustre servers on Ubuntu nodes. :)
>> >
>> >>I am planning to use ZFS as the backing store. So as you mentioned, I
>> >> should not be having a problem with that. Also, I am planning to use
>> >> the
>> >> latest Lustre version - 2.7.
>> >
>> >>In Lustre.org downloads section for 2.7 release, I see the below:
>> >
>> >>Can I go with the packages in el6.6 for my deployment?
>> >
>> >>(I am guessing that 'el' implies Enterprise Linux and 'sles' implies
>> >> Solaris enterprise Linux)
>> >
>> > There is no prebuilt versus. You need to build yourself. To work with
>> > the
>> > latest code do a
>> >
>> > git clone git://git.hpdd.intel.com/fs/lustre-release
>> >
>> > cd lustre-release
>> >
>> > sh ./autogen.sh
>> >
>> > ./configure –with-spl=/where/spl/is  -–with-zfs=/where/zfs/lives
>> >
>> > dpkg-buildpackage -us –uc
>> >
>> >
>> >
>> >
>> > _______________________________________________
>> > HPDD-discuss mailing list
>> > HPDD-discuss@lists.01.org
>> > https://lists.01.org/mailman/listinfo/hpdd-discuss
>> >
>
>



_______________________________________________
HPDD-discuss mailing list
HPDD-discuss@lists.01.org
https://lists.01.org/mailman/listinfo/hpdd-discuss


-- 
Nico Budewitz
Senior Engineer, IT infrastructure
Norwegian Meteorological Institute, Oslo