[Pkg-ofed-devel] ofa-kernel build fails

Nenad Kreculj nkreculj at neuraliq.com
Tue Oct 20 00:00:34 UTC 2009


OK, so debian lenny 2.6.26-2-686, combined with OFED 1.4.2 works fine!

In 2 blades back-to-back config, performance with sdp is 2-3 times higher
than with IPoIB (netperf and netpipe-tcp)

Thanks Guy!

Nenad


On Mon, Oct 19, 2009 at 10:17 AM, Nenad Kreculj <nkreculj at neuraliq.com>wrote:

> Thanks, will try that combo.
>
> Nenad
>
>
>
> On Sun, Oct 18, 2009 at 4:26 AM, Guy Coates <gmpc at sanger.ac.uk> wrote:
>
>> Nenad Kreculj wrote:
>> >
>> > Hi,
>> >
>> > I'm trying to build sdp driver for debian.
>> >
>> > My kernel is:
>> > Linux debian 2.6.30-2-686-bigmem #1 SMP Sat Sep 26 02:30:18 UTC 2009
>> > i686 GNU/Linux
>> >
>> > I followed this link for instructions:
>> > http://pkg-ofed.alioth.debian.org/howto/infiniband-howto-3.html
>> >
>> > Since my kernel is 2.6.30, I used OFED 1.4:
>> > ii  ofa-kernel-source                 1.4.2-2                  Source
>> > for InfiniBand kernel drivers
>> >
>> > "module-assistant prepare" followed by "module-assistant clean
>> > ofa-kernel" works, but module-assistant build ofa-kernel fails (all
>> > patches were applied without problems):
>> >
>> >  -D__KERNEL__ -Wall -Wundef -Wstrict-prototypes -Wno-trigraphs
>> > -fno-strict-aliasing -fno-common -Werror-implicit-function-declaration
>> > -fno-delete-null-pointer-checks -Os -m32 -msoft-float -mregparm=3
>> > -freg-struct-return -mpreferred-stack-boundary=2 -march=i686
>> > -mtune=generic -Wa,-mtune=generic32 -ffreestanding -DCONFIG_AS_CFI=1
>> > -DCONFIG_AS_CFI_SIGNAL_FRAME=1 -pipe -Wno-sign-compare
>> > -fno-asynchronous-unwind-tables -mno-sse -mno-mmx -mno-sse2 -mno-3dnow
>> > -fno-stack-protector -fomit-frame-pointer -g
>> > -Wdeclaration-after-statement -Wno-pointer-sign -fno-strict-overflow
>> > -DMODULE -D"KBUILD_STR(s)=#s" -D"KBUILD_BASENAME=KBUILD_STR(cm)"
>> > -D"KBUILD_MODNAME=KBUILD_STR(ib_cm)"  -c -o
>> > /usr/src/modules/ofa-kernel/drivers/infiniband/core/.tmp_cm.o
>> > /usr/src/modules/ofa-kernel/drivers/infiniband/core/cm.c
>> > /usr/src/modules/ofa-kernel/drivers/infiniband/core/cm.c: In function
>> > ‘cm_add_one’:
>> > /usr/src/modules/ofa-kernel/drivers/infiniband/core/cm.c:3741: error:
>> > implicit declaration of function ‘device_create_drvdata’
>> > /usr/src/modules/ofa-kernel/drivers/infiniband/core/cm.c:3743: warning:
>> > assignment makes pointer from integer without a cast
>> > make[6]: *** [/usr/src/modules/ofa-kernel/drivers/infiniband/core/cm.o]
>> > Error 1
>> > make[5]: *** [/usr/src/modules/ofa-kernel/drivers/infiniband/core] Error
>> 2
>> > make[4]: *** [/usr/src/modules/ofa-kernel/drivers/infiniband] Error 2
>> > make[3]: *** [_module_/usr/src/modules/ofa-kernel] Error 2
>> > make[3]: Leaving directory `/usr/src/linux-source-2.6.30'
>> > make[2]: *** [kernel] Error 2
>> > make[2]: Leaving directory `/usr/src/modules/ofa-kernel'
>> > make[1]: *** [binary-modules] Error 2
>> > make[1]: Leaving directory `/usr/src/modules/ofa-kernel'
>> > make: *** [kdist_build] Error 2
>> >
>> >
>> > On the same system, IB with IPoIB works just fine (two machines
>> > connected back-to-back, tested with netperf).
>> >
>> > Any suggestion how to fix the problem is most welcomed, or other
>> > approaches to building sdp driver.
>> >
>> > Thanks,
>> >
>> > Nenad
>> >
>> >
>> >
>> >
>> >
>> > ------------------------------------------------------------------------
>> >
>> > _______________________________________________
>> > Pkg-ofed-devel mailing list
>> > Pkg-ofed-devel at lists.alioth.debian.org
>> > http://lists.alioth.debian.org/mailman/listinfo/pkg-ofed-devel
>>
>> The short answer is that you should use the 2.6.26 lenny kernel +
>> ofa-kernel modules + the userspace packages.
>>
>> If you step outside that combination, you run the risk of things breaking.
>>
>> The OFED 1.4.X ofa-kernel modules only supports kernel versions up to
>> 2.6.26; if you are using a later kernel you will need to use the
>> infiniband drivers included in the vanilla kernel tree.
>>
>> However, the vanilla kernel infiniband modules do not yet contain some
>> of the features that included  in OFED ofa-kernel modules (eg XRC). If
>> you use the vanilla kernel modules you might find that some of the
>> userspace utilities breaks.
>>
>> Cheers,
>>
>> Guy
>>
>>
>> --
>> Dr Guy Coates,  Informatics System Group
>> The Wellcome Trust Sanger Institute, Hinxton, Cambridge, CB10 1HH, UK
>> Tel: +44 (0)1223 834244 ex 6925
>> Fax: +44 (0)1223 496802
>>
>>
>> --
>>  The Wellcome Trust Sanger Institute is operated by Genome Research
>>  Limited, a charity registered in England with number 1021457 and a
>>  company registered in England with number 2742969, whose registered
>>  office is 215 Euston Road, London, NW1 2BE.
>>
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.alioth.debian.org/pipermail/pkg-ofed-devel/attachments/20091019/942dfb5f/attachment.htm>


More information about the Pkg-ofed-devel mailing list