2:55 a.m.
Hi,
for compiling Whancloud's Lustre 1.8.9 for use with OFED2 on Scientific
Linux 6.6 running kernel 2.6.32-504.el6.x86_64 I had to backport this
commit:
http://git.whamcloud.com/fs/lustre-release.git/patch/6df47ff8445b7d86ec23...
It's basically the same patch, just a few minor adjustments to make it
apply cleanly on the 1.8 branch.
I'm attaching the backported patch to this mail.
best regards,
Martin
10:14 a.m.
Martin,
Could you disclose how you managed to compile? - This would be quite interesting for my
system here (Lustre-1.8.9, EL5 servers, EL6 client).
I may be missing something basic. I unpacked a .src.rpm and added your patch to the spec
file:
$ diff SPECS/lustre.spec.orig SPECS/lustre.spec
60a61
Patch0: lustre-1.8.9wc1-kernel-2.6.32-504.el6.patch
139a141
%patch0 -p1
I then adapted
https://wiki.hpdd.intel.com/display/PUB/Rebuilding+the+Lustre-client+rpms...
and tried:
rpmbuild --define 'kversion 2.6.32-504.el6.x86_64' \
--define 'kdir /usr/src/kernels/2.6.32-504.el6.x86_64/' \
--without servers \
--bb SPECS/lustre.spec \
2>&1 | tee ./lustre-client-1.8.9-el6.log
I did not get very far:
...
checking for /usr/src/kernels/2.6.32-504.el6.x86_64/include/linux/lustre_version.h... no
configure: WARNING: Unpatched kernel detected.
configure: WARNING: Lustre servers cannot be built with an unpatched kernel;
configure: WARNING: disabling server build
...
checking which ldiskfs series to use... configure: WARNING: Unknown kernel version
2.6.32-504.el6.x86_64, fix ldiskfs/configure.ac
...
config.status: creating autoMakefile
Making all in .
cc1: error: -D__KERNEL__: No such file or directory
cc1: error: -D__KERNEL__: No such file or directory
cc1: error: -D__KERNEL__: No such file or directory
cc1: error: -D__KERNEL__: No such file or directory
cc1: error: -D__KERNEL__: No such file or directory
cc1: error: -D__KERNEL__: No such file or directory
cc1: error: -D__KERNEL__: No such file or directory
/home/share/soft/rpm/BUILD/lustre-1.8.9/lustre/llite/lloop.c:85:26: error:
linux/config.h: No such file or directory
make[6]: *** [/home/share/soft/rpm/BUILD/lustre-1.8.9/lnet/lnet/api-errno.o] Error 1
cc1: error: -D__KERNEL__: No such file or directory
make[5]: *** [/home/share/soft/rpm/BUILD/lustre-1.8.9/lnet/lnet] Error 2
make[5]: *** Waiting for unfinished jobs....
make[6]: *** [/home/share/soft/rpm/BUILD/lustre-1.8.9/lnet/selftest/console.o] Error 1
make[5]: *** [/home/share/soft/rpm/BUILD/lustre-1.8.9/lnet/selftest] Error 2
In file included from
/usr/src/kernels/2.6.32-504.el6.x86_64/arch/x86/include/asm/percpu.h:45,
from
/usr/src/kernels/2.6.32-504.el6.x86_64/arch/x86/include/asm/current.h:5,
from
/usr/src/kernels/2.6.32-504.el6.x86_64/arch/x86/include/asm/processor.h:15,
from
/usr/src/kernels/2.6.32-504.el6.x86_64/include/linux/prefetch.h:14,
from /usr/src/kernels/2.6.32-504.el6.x86_64/include/linux/list.h:7,
from /usr/src/kernels/2.6.32-504.el6.x86_64/include/linux/module.h:9,
from /home/share/soft/rpm/BUILD/lustre-1.8.9/lustre/llite/lloop.c:87:
/usr/src/kernels/2.6.32-504.el6.x86_64/include/linux/kernel.h:962:2: error: #warning
Attempt to use kernel headers from user space, see http: [cut off]
...
I have kernel-devel, kernel-headers, and rpm-build duly installed.
$ rpm -qa | grep kernel | sort
abrt-addon-kerneloops-2.0.8-26.el6.centos.x86_64
dracut-kernel-004-356.el6.noarch
kernel-2.6.32-279.19.1.el6.x86_64
kernel-2.6.32-504.el6.x86_64
kernel-devel-2.6.32-504.el6.x86_64
kernel-firmware-2.6.32-504.el6.noarch
kernel-headers-2.6.32-504.el6.x86_64
libreport-plugin-kerneloops-2.0.9-21.el6.centos.x86_64
with best regards,
Michael
On 2014-11-07, at 09:55 , Martin Hecht <hecht(a)hlrs.de> wrote:
for compiling Whancloud's Lustre 1.8.9 for use with OFED2 on Scientific
Linux 6.6 running kernel 2.6.32-504.el6.x86_64 I had to backport this
commit:
http://git.whamcloud.com/fs/lustre-release.git/patch/6df47ff8445b7d86ec23...
It's basically the same patch, just a few minor adjustments to make it
apply cleanly on the 1.8 branch.
I'm attaching the backported patch to this mail.
<lustre-1.8.9wc1-kernel-2.6.32-504.el6.patch>_______________________________________________
6:51 a.m.
How can one teach lustre-1.8.9 about linux/kconfig.h, a header backported from 3.x kernels
to the EL6.6 kernel?
Following up myself: I did get lustre-client and lustre-client-modules RPMs produced by
compiling while the target kernel was running, applying this patch:
http://review.whamcloud.com/8607 , and swapping args for __attribute__((packed,
__may_alias__)) at lustre/include/lustre/lustre_user.h:192 .
Trouble is, the ko2iblnd.ko (OFED) kernel module is missing from lustre-client-modules.
This seems to be related to linux/kconfig.h, which defines an IS_ENABLED() macro which is
referenced but missing when OpenIB support is being tested in the Lustre configure step:
configure:8240: checking whether to enable OpenIB gen2 support
configure:8351: cp conftest.c build && make -d modules CC=gcc -f
/home/share/soft/rpm/BUILD/lustre-1.8.9/build/Makefile
LUSTRE_LINUX_CONFIG=/usr/src/kernels/2.6.32-504.el6.x86_64/.config LINUXINCLUDE=
-I/usr/src/kernels/2.6.32-504.el6.x86_64/include
-I/usr/src/kernels/2.6.32-504.el6.x86_64/arch/x86/include -I/usr/sr
c/kernels/2.6.32-504.el6.x86_64/include -I/usr/src/kernels/2.6.32-504.el6.x86_64/include
-I/usr/src/kernels/2.6.32-504.el6.x86_64/include2 -include include/linux/autoconf.h -o
tmp_include_depends -o scripts -o include/config/MARKER -C
/usr/src/kernels/2.6.32-504.el6.x86_64 EXTRA_CFLAGS=-Werror-implicit-function-decla
ration -g -I/home/share/soft/rpm/BUILD/lustre-1.8.9/lnet/include
-I/home/share/soft/rpm/BUILD/lustre-1.8.9/lnet/include
-I/home/share/soft/rpm/BUILD/lustre-1.8.9/lustre/include
-I/usr/src/kernels/2.6.32-504.el6.x86_64/include
M=/home/share/soft/rpm/BUILD/lustre-1.8.9/build
In file included from /usr/src/kernels/2.6.32-504.el6.x86_64/include/rdma/ib_addr.h:44,
from /usr/src/kernels/2.6.32-504.el6.x86_64/include/rdma/rdma_cm.h:39,
from /home/share/soft/rpm/BUILD/lustre-1.8.9/build/conftest.c:40:
/usr/src/kernels/2.6.32-504.el6.x86_64/include/net/ipv6.h:271:5: warning:
"IS_ENABLED" is not defined
/usr/src/kernels/2.6.32-504.el6.x86_64/include/net/ipv6.h:271:15: error: missing binary
operator before token "("
/home/share/soft/rpm/BUILD/lustre-1.8.9/build/conftest.c: In function 'main':
/home/share/soft/rpm/BUILD/lustre-1.8.9/build/conftest.c:54: warning: unused variable
'rej_reason'
/home/share/soft/rpm/BUILD/lustre-1.8.9/build/conftest.c:53: warning: unused variable
'pool_fmr'
/home/share/soft/rpm/BUILD/lustre-1.8.9/build/conftest.c:52: warning: unused variable
'qp_attr'
/home/share/soft/rpm/BUILD/lustre-1.8.9/build/conftest.c:51: warning: unused variable
'device_attr'
/home/share/soft/rpm/BUILD/lustre-1.8.9/build/conftest.c:50: warning: unused variable
'conn_param'
/home/share/soft/rpm/BUILD/lustre-1.8.9/build/conftest.c:49: warning: unused variable
'cm_id'
make[1]: *** [/home/share/soft/rpm/BUILD/lustre-1.8.9/build/conftest.o] Error 1
make: *** [_module_/home/share/soft/rpm/BUILD/lustre-1.8.9/build] Error 2
Best wishes,
Michael
On Nov 19, 2014, at 17:14 , Sternberg, Michael G.
<sternberg(a)anl.gov> wrote:
Could you disclose how you managed to compile? - This would be quite interesting for my
system here (Lustre-1.8.9, EL5 servers, EL6 client).
…
I have kernel-devel, kernel-headers, and rpm-build duly installed.
$ rpm -qa | grep kernel | sort
abrt-addon-kerneloops-2.0.8-26.el6.centos.x86_64
dracut-kernel-004-356.el6.noarch
kernel-2.6.32-279.19.1.el6.x86_64
kernel-2.6.32-504.el6.x86_64
kernel-devel-2.6.32-504.el6.x86_64
kernel-firmware-2.6.32-504.el6.noarch
kernel-headers-2.6.32-504.el6.x86_64
libreport-plugin-kerneloops-2.0.9-21.el6.centos.x86_64
3:06 a.m.
Hi Michael,
For patches which modify the autoconf-inputs you have to run the
autogen.sh right after the patches are applied, so that the configure
script itself is re-generated. I do it here in the spec-file:
# Set an explicit path to our Linux tree, if we can.
cd $RPM_BUILD_DIR/lustre-%{version}
sh autogen.sh # <--- run the autoconf stuff to re-generate the
configure scripts
# override %optflags so that the vendor's overzealous flags don't create
# build failures
%define optflags -g -O2 -Werror
CONFIGURE_ARGS="%{?configure_args} --with-release=%release"
I assume that this is the main point. I set kversion, kdir, and kobjdir
manually at the top of the spec file (but calling rpmbuild with
appropriate defines should be fine as well).
I have also added the following line:
%{!?is_client: %define is_client 1}
to avoid the complains about the unpatched kernel.
I also apply a few other patches from the master branch on jira but I'm
not sure which ones are actually still needed.
I have started this with 1.8.6 on Scientific Linux 5.5, and some of them
are probably obsolete in the meantime.
Let me know if you are still getting errors, then I'll have a look which
ones are actually needed in addition to the latest one.
best regards,
Martin
On 11/20/2014 12:14 AM, Sternberg, Michael G. wrote:
Martin,
Could you disclose how you managed to compile? - This would be quite interesting for my
system here (Lustre-1.8.9, EL5 servers, EL6 client).
I may be missing something basic. I unpacked a .src.rpm and added your patch to the spec
file:
$ diff SPECS/lustre.spec.orig SPECS/lustre.spec
60a61
> Patch0: lustre-1.8.9wc1-kernel-2.6.32-504.el6.patch
139a141
> %patch0 -p1
I then adapted
https://wiki.hpdd.intel.com/display/PUB/Rebuilding+the+Lustre-client+rpms...
and tried:
rpmbuild --define 'kversion 2.6.32-504.el6.x86_64' \
--define 'kdir /usr/src/kernels/2.6.32-504.el6.x86_64/' \
--without servers \
--bb SPECS/lustre.spec \
2>&1 | tee ./lustre-client-1.8.9-el6.log
I did not get very far:
> ...
> checking for /usr/src/kernels/2.6.32-504.el6.x86_64/include/linux/lustre_version.h...
no
> configure: WARNING: Unpatched kernel detected.
> configure: WARNING: Lustre servers cannot be built with an unpatched kernel;
> configure: WARNING: disabling server build
> ...
> checking which ldiskfs series to use... configure: WARNING: Unknown kernel version
2.6.32-504.el6.x86_64, fix ldiskfs/configure.ac
> ...
> config.status: creating autoMakefile
> Making all in .
> cc1: error: -D__KERNEL__: No such file or directory
> cc1: error: -D__KERNEL__: No such file or directory
> cc1: error: -D__KERNEL__: No such file or directory
> cc1: error: -D__KERNEL__: No such file or directory
> cc1: error: -D__KERNEL__: No such file or directory
> cc1: error: -D__KERNEL__: No such file or directory
> cc1: error: -D__KERNEL__: No such file or directory
> /home/share/soft/rpm/BUILD/lustre-1.8.9/lustre/llite/lloop.c:85:26: error:
linux/config.h: No such file or directory
> make[6]: *** [/home/share/soft/rpm/BUILD/lustre-1.8.9/lnet/lnet/api-errno.o] Error 1
> cc1: error: -D__KERNEL__: No such file or directory
> make[5]: *** [/home/share/soft/rpm/BUILD/lustre-1.8.9/lnet/lnet] Error 2
> make[5]: *** Waiting for unfinished jobs....
> make[6]: *** [/home/share/soft/rpm/BUILD/lustre-1.8.9/lnet/selftest/console.o] Error
1
> make[5]: *** [/home/share/soft/rpm/BUILD/lustre-1.8.9/lnet/selftest] Error 2
> In file included from
/usr/src/kernels/2.6.32-504.el6.x86_64/arch/x86/include/asm/percpu.h:45,
> from
/usr/src/kernels/2.6.32-504.el6.x86_64/arch/x86/include/asm/current.h:5,
> from
/usr/src/kernels/2.6.32-504.el6.x86_64/arch/x86/include/asm/processor.h:15,
> from
/usr/src/kernels/2.6.32-504.el6.x86_64/include/linux/prefetch.h:14,
> from /usr/src/kernels/2.6.32-504.el6.x86_64/include/linux/list.h:7,
> from
/usr/src/kernels/2.6.32-504.el6.x86_64/include/linux/module.h:9,
> from
/home/share/soft/rpm/BUILD/lustre-1.8.9/lustre/llite/lloop.c:87:
> /usr/src/kernels/2.6.32-504.el6.x86_64/include/linux/kernel.h:962:2: error: #warning
Attempt to use kernel headers from user space, see http: [cut off]
> ...
I have kernel-devel, kernel-headers, and rpm-build duly installed.
$ rpm -qa | grep kernel | sort
abrt-addon-kerneloops-2.0.8-26.el6.centos.x86_64
dracut-kernel-004-356.el6.noarch
kernel-2.6.32-279.19.1.el6.x86_64
kernel-2.6.32-504.el6.x86_64
kernel-devel-2.6.32-504.el6.x86_64
kernel-firmware-2.6.32-504.el6.noarch
kernel-headers-2.6.32-504.el6.x86_64
libreport-plugin-kerneloops-2.0.9-21.el6.centos.x86_64
with best regards,
Michael
> On 2014-11-07, at 09:55 , Martin Hecht <hecht(a)hlrs.de> wrote:
> for compiling Whancloud's Lustre 1.8.9 for use with OFED2 on Scientific
> Linux 6.6 running kernel 2.6.32-504.el6.x86_64 I had to backport this
> commit:
>
http://git.whamcloud.com/fs/lustre-release.git/patch/6df47ff8445b7d86ec23...
> It's basically the same patch, just a few minor adjustments to make it
> apply cleanly on the 1.8 branch.
> I'm attaching the backported patch to this mail.
>
>
<lustre-1.8.9wc1-kernel-2.6.32-504.el6.patch>_______________________________________________
9:48 a.m.
Dear Martin, Tommy,
With your pointers I was able to properly compile and install the 1.8.9 client on EL6.6.
- Required were only Martin's patch and http://review.whamcloud.com/8607 (as mentioned
previously).
- Only one inconsequential error occurred which thwarts building a lustre-iokit RPM (not
needed).
What threw me off was that I had been working off the 1.8.9-wc1 SRPM sources exclusively
which do not contain autogen.sh. I was able to compile this tree eventually after
scripting a change of all occurrences of include/autoconf.h into include/kconfig.h, but
surely that was not kosher.
I note that the GIT sources for 1.8.9 go a little further than the SRPM tree:
$ diff {lustre-1.8.9-srpm,git-b1_8}/lustre/ChangeLog
4,5c4,5
< 2.6.18-348.1.1.el5 (RHEL 5)
< 2.6.32-279.19.1.el6 (RHEL 6) - patchless client only
---
> 2.6.18-348.3.1.el5 (RHEL 5)
> 2.6.32-358.2.1.el6 (RHEL 6) - patchless client only
Thank you for taking the time to point out the correct approach.
With best regards,
--
Michael Sternberg, Ph.D.
Center for Nanoscale Materials
Argonne National Laboratory
On 2014-11-24, at 10:06 , Martin Hecht <hecht(a)hlrs.de> wrote:
Hi Michael,
For patches which modify the autoconf-inputs you have to run the
autogen.sh right after the patches are applied, so that the configure
script itself is re-generated. I do it here in the spec-file:
# Set an explicit path to our Linux tree, if we can.
cd $RPM_BUILD_DIR/lustre-%{version}
sh autogen.sh # <--- run the autoconf stuff to re-generate the
configure scripts
# override %optflags so that the vendor's overzealous flags don't create
# build failures
%define optflags -g -O2 -Werror
CONFIGURE_ARGS="%{?configure_args} --with-release=%release"
I assume that this is the main point. I set kversion, kdir, and kobjdir
manually at the top of the spec file (but calling rpmbuild with
appropriate defines should be fine as well).
I have also added the following line:
%{!?is_client: %define is_client 1}
to avoid the complains about the unpatched kernel.
2855
days inactive
2872
days old
4 comments
2 participants
participants (2)
-
Martin Hecht -
Sternberg, Michael G.