From jwm at horde.net Fri Oct 17 16:44:27 2014 From: jwm at horde.net (John Morrissey) Date: Fri, 17 Oct 2014 12:44:27 -0400 Subject: [Pkg-lustre-maintainers] Please re-add Lustre userland utilities Message-ID: <20141017164427.GA8726@boost.horde.net> [tl;dr: if a DD is interested in actively sponsoring uploads, I'll look into packaging this] Greetings Lustre packaging maintainers, I'm doing some large-scale bioinformatics work on Lustre filesystems, so it would be really nice to have the Lustre userland utilities. Even with Lustre support in mainline Linux, you still need the userland utilities to mount the filesystem, let alone interact with the Lustre internals in a meaningful way for troubleshooting and management. Looks like Ben asked about this a couple months ago: http://lists.alioth.debian.org/pipermail/pkg-lustre-maintainers/2014-August/000435.html I can probably get my client to sponsor this work, but I've experienced a number of cases in the past where getting someone's attention for a sponsored upload to Debian, even with great looking, lintian-clean, bug free packaging, has been difficult or impossible. I realize that wasn't your problem, but I hope you can understand that I don't want to go to the effort of this client pitch and the resulting packaging work if the result won't end up in Debian. Best, -john From jwm at horde.net Fri Oct 17 16:48:55 2014 From: jwm at horde.net (John Morrissey) Date: Fri, 17 Oct 2014 12:48:55 -0400 Subject: [Pkg-lustre-maintainers] Please re-add Lustre userland utilities In-Reply-To: <1413564377.23022.8.camel@decadent.org.uk> References: <20141017164427.GA8726@boost.horde.net> <1413564377.23022.8.camel@decadent.org.uk> Message-ID: <20141017164855.GB8726@boost.horde.net> On Fri, Oct 17, 2014 at 06:46:17PM +0200, Ben Hutchings wrote: > On Fri, 2014-10-17 at 12:44 -0400, John Morrissey wrote: > > [tl;dr: if a DD is interested in actively sponsoring uploads, I'll look > > into packaging this] > > > > Greetings Lustre packaging maintainers, > > > > I'm doing some large-scale bioinformatics work on Lustre filesystems, so it > > would be really nice to have the Lustre userland utilities. > > > > Even with Lustre support in mainline Linux, you still need the userland > > utilities to mount the filesystem, let alone interact with the Lustre > > internals in a meaningful way for troubleshooting and management. > > > > Looks like Ben asked about this a couple months ago: > > > > http://lists.alioth.debian.org/pipermail/pkg-lustre-maintainers/2014-August/000435.html > > > > I can probably get my client to sponsor this work, but I've experienced a > > number of cases in the past where getting someone's attention for a > > sponsored upload to Debian, even with great looking, lintian-clean, bug free > > packaging, has been difficult or impossible. I realize that wasn't your > > problem, but I hope you can understand that I don't want to go to the effort > > of this client pitch and the resulting packaging work if the result won't > > end up in Debian. > > Bastian Blank (cc'd) is now working on this. Rad. Thanks, Ben. Bastian, I'm happy to help, so please let me know if there's anything I can do. -john From jwm at horde.net Thu Oct 23 22:38:33 2014 From: jwm at horde.net (John Morrissey) Date: Thu, 23 Oct 2014 18:38:33 -0400 Subject: [Pkg-lustre-maintainers] Please re-add Lustre userland utilities In-Reply-To: <20141021160532.GA19793@mail.waldi.eu.org> References: <20141017164427.GA8726@boost.horde.net> <1413564377.23022.8.camel@decadent.org.uk> <20141017164855.GB8726@boost.horde.net> <20141021160532.GA19793@mail.waldi.eu.org> Message-ID: <20141023223832.GA8279@boost.horde.net> On Tue, Oct 21, 2014 at 06:05:32PM +0200, Bastian Blank wrote: > On Fri, Oct 17, 2014 at 12:48:55PM -0400, John Morrissey wrote: > > Bastian, I'm happy to help, so please let me know if there's anything I can > > do. > > As the lustre client support in 3.16 is broken, could you review the > changes in 3.17 and see if a backport looks reasonable? It seems the client is broken on systems with more than one CPU, which I kludged around with 'cpu_npartitions=1' - is that the breakage you're talking about? I haven't had a chance to look at or try 3.17 yet. > Also a test setup with some rhel/centos 6 server would be helpful. Will do. I'm actually working with Intel to do some benchmarking with their Amazon Web Services offering for Lustre, which runs CentOS 6 on the server. -john From jwm at horde.net Thu Oct 23 22:45:36 2014 From: jwm at horde.net (John Morrissey) Date: Thu, 23 Oct 2014 18:45:36 -0400 Subject: [Pkg-lustre-maintainers] Please re-add Lustre userland utilities In-Reply-To: <20141022124322.GB24875@mail.waldi.eu.org> References: <20141017164427.GA8726@boost.horde.net> <1413564377.23022.8.camel@decadent.org.uk> <20141017164855.GB8726@boost.horde.net> <20141021160532.GA19793@mail.waldi.eu.org> <20141022124322.GB24875@mail.waldi.eu.org> Message-ID: <20141023224536.GA8330@boost.horde.net> On Wed, Oct 22, 2014 at 02:43:23PM +0200, Bastian Blank wrote: > On Tue, Oct 21, 2014 at 06:05:32PM +0200, Bastian Blank wrote: > > I decided not to use the old packaging. It is complex and for now I > > only want to get minimal working setup, so only client. I'll publish > > what I've got tomorrow. > > git://git.debian.org/users/waldi/lustre.git > > This still needs > - a copyright file, > - some fixes to build more than once (the upstream makefiles are sloppy > in cleaning up there mess) and > - lintian. Hi Bastian, where'd you get your orig.tar.gz? I built one with 'make dist', but the Debian packages fail to build due to a bunch of new executable files in the git repository that aren't in the orig.tar.gz. -john From ben at decadent.org.uk Fri Oct 17 16:46:17 2014 From: ben at decadent.org.uk (Ben Hutchings) Date: Fri, 17 Oct 2014 18:46:17 +0200 Subject: [Pkg-lustre-maintainers] Please re-add Lustre userland utilities In-Reply-To: <20141017164427.GA8726@boost.horde.net> References: <20141017164427.GA8726@boost.horde.net> Message-ID: <1413564377.23022.8.camel@decadent.org.uk> On Fri, 2014-10-17 at 12:44 -0400, John Morrissey wrote: > [tl;dr: if a DD is interested in actively sponsoring uploads, I'll look > into packaging this] > > Greetings Lustre packaging maintainers, > > I'm doing some large-scale bioinformatics work on Lustre filesystems, so it > would be really nice to have the Lustre userland utilities. > > Even with Lustre support in mainline Linux, you still need the userland > utilities to mount the filesystem, let alone interact with the Lustre > internals in a meaningful way for troubleshooting and management. > > Looks like Ben asked about this a couple months ago: > > http://lists.alioth.debian.org/pipermail/pkg-lustre-maintainers/2014-August/000435.html > > I can probably get my client to sponsor this work, but I've experienced a > number of cases in the past where getting someone's attention for a > sponsored upload to Debian, even with great looking, lintian-clean, bug free > packaging, has been difficult or impossible. I realize that wasn't your > problem, but I hope you can understand that I don't want to go to the effort > of this client pitch and the resulting packaging work if the result won't > end up in Debian. Bastian Blank (cc'd) is now working on this. Ben. -- Ben Hutchings Life is what happens to you while you're busy making other plans. - John Lennon -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 811 bytes Desc: This is a digitally signed message part URL: From waldi at debian.org Tue Oct 21 16:05:32 2014 From: waldi at debian.org (Bastian Blank) Date: Tue, 21 Oct 2014 18:05:32 +0200 Subject: [Pkg-lustre-maintainers] Please re-add Lustre userland utilities In-Reply-To: <20141017164855.GB8726@boost.horde.net> References: <20141017164427.GA8726@boost.horde.net> <1413564377.23022.8.camel@decadent.org.uk> <20141017164855.GB8726@boost.horde.net> Message-ID: <20141021160532.GA19793@mail.waldi.eu.org> Hi John I decided not to use the old packaging. It is complex and for now I only want to get minimal working setup, so only client. I'll publish what I've got tomorrow. On Fri, Oct 17, 2014 at 12:48:55PM -0400, John Morrissey wrote: > Bastian, I'm happy to help, so please let me know if there's anything I can > do. As the lustre client support in 3.16 is broken, could you review the changes in 3.17 and see if a backport looks reasonable? Also a test setup with some rhel/centos 6 server would be helpful. Bastian -- A father doesn't destroy his children. -- Lt. Carolyn Palamas, "Who Mourns for Adonais?", stardate 3468.1. From waldi at debian.org Wed Oct 22 12:43:23 2014 From: waldi at debian.org (Bastian Blank) Date: Wed, 22 Oct 2014 14:43:23 +0200 Subject: [Pkg-lustre-maintainers] Please re-add Lustre userland utilities In-Reply-To: <20141021160532.GA19793@mail.waldi.eu.org> References: <20141017164427.GA8726@boost.horde.net> <1413564377.23022.8.camel@decadent.org.uk> <20141017164855.GB8726@boost.horde.net> <20141021160532.GA19793@mail.waldi.eu.org> Message-ID: <20141022124322.GB24875@mail.waldi.eu.org> On Tue, Oct 21, 2014 at 06:05:32PM +0200, Bastian Blank wrote: > I decided not to use the old packaging. It is complex and for now I > only want to get minimal working setup, so only client. I'll publish > what I've got tomorrow. git://git.debian.org/users/waldi/lustre.git This still needs - a copyright file, - some fixes to build more than once (the upstream makefiles are sloppy in cleaning up there mess) and - lintian. > Also a test setup with some rhel/centos 6 server would be helpful. I'v done a small test setup with two centos 6 machines for metadata and data server. Initial testing looks something like: | Filesystem Size Used Avail Use% Mounted on | 10.23.4.2 at tcp:/lustrewt 12G 442M 11G 4% /mnt I haven't tested the other utils yet. Bastian -- Humans do claim a great deal for that particular emotion (love). -- Spock, "The Lights of Zetar", stardate 5725.6 -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 490 bytes Desc: Digital signature URL: From jwm at horde.net Tue Oct 28 22:53:44 2014 From: jwm at horde.net (John Morrissey) Date: Tue, 28 Oct 2014 18:53:44 -0400 Subject: [Pkg-lustre-maintainers] Please re-add Lustre userland utilities In-Reply-To: <20141023223832.GA8279@boost.horde.net> References: <20141017164427.GA8726@boost.horde.net> <1413564377.23022.8.camel@decadent.org.uk> <20141017164855.GB8726@boost.horde.net> <20141021160532.GA19793@mail.waldi.eu.org> <20141023223832.GA8279@boost.horde.net> Message-ID: <20141028225344.GA22516@boost.horde.net> On Thu, Oct 23, 2014 at 06:38:32PM -0400, John Morrissey wrote: > On Tue, Oct 21, 2014 at 06:05:32PM +0200, Bastian Blank wrote: > > On Fri, Oct 17, 2014 at 12:48:55PM -0400, John Morrissey wrote: > > > Bastian, I'm happy to help, so please let me know if there's anything I can > > > do. > > > > As the lustre client support in 3.16 is broken, could you review the > > changes in 3.17 and see if a backport looks reasonable? > > It seems the client is broken on systems with more than one CPU, which I > kludged around with 'cpu_npartitions=1' - is that the breakage you're > talking about? I haven't had a chance to look at or try 3.17 yet. I looked through the changes in the Lustre client between 3.16 and 3.17, there were a few bugfixes, but mostly stylistic changes. It's a clean backport with the addition of the attached patch, to account for the hlist_add_ API changes. I built backported 3.16 kernel packages and did some basic tests on a mounted Lustre filesystem, which seemed fine. > > Also a test setup with some rhel/centos 6 server would be helpful. > > Will do. I'm actually working with Intel to do some benchmarking with > their Amazon Web Services offering for Lustre, which runs CentOS 6 on the > server. Are you looking for access to a test setup with CentOS 6-based Lustre servers, or someone to test the Debian kernel's Lustre client with CentOS 6? Like I said, I did some basic smoke tests with the Lustre client in 3.17 (and that version of the client backported to 3.16). I might be able to make a Lustre server setup available for a short period (a week or so), or I could run some other tests. -john -------------- next part -------------- A non-text attachment was scrubbed... Name: lustre-3.17-backport.patch Type: text/x-diff Size: 752 bytes Desc: not available URL: