Supposed fix to #317518: New version of libsql-statement-perl is very, very much slower

Jeff Zucker jeff at vpservices.com
Tue Oct 20 15:56:30 UTC 2009 

Greg,

I am no longer the primary maintainer of SQL::Statement, I am cc'ing Jens
Rehsack, the new primary maintainer.

In comparing the pre 1.-0 release to current releases you are comparing
apples to oranges since the pre-1.0 release supported almost no actual SQL
while the post releases have gotten successively richer in the SQL they
support.  My $0.02 is that if speed, rather than compatibility with other
SQL implementations is a concern, one is best off using Text::CSV_XS
directly or importing the data into SQLite or another db for processing.
OTOH, it's possible Jens has or will be introducing speed improvements I
know nothing about.

One other consideration - all of the drivers (DBD::CSV, etc.) that use
SQL::Statement are also able to use DBI::SQL::Nano (comes with the DBI
distro) which has about the same feature set as the pre 1-0 release and
which can be much faster than the full SQL::Statement for some tasks.

-- 
Jeff

rehsack at googlemail.com

On Tue, Oct 20, 2009 at 2:35 AM, Paul Beardsell <paul at beardsell.com> wrote:

> Jeff,
>
> (cc Greg, the Debian maintainer of libsql-statement-perl)
>
> I understand you are perhaps the developer/maintainer or primary contact re
> the Perl package SQL::Statement.
>
> I am an enthusuastic user of the pre 1.0 release of SQL::Statement as found
> in Debian "Woody" Linux.  1.0 and later releases of SQL::Statement in more
> current versions of Debian Linux have been found by me to be much, much
> slower than the pre-1.0 releases on text CSV databases of only 2000 rows.  I
> reported this bug to Debian and they now say it is "fixed" but no evidence
> as to what has been done is presented other than to say they have accepted a
> new upstream release, 1.22.
>
> I understand the reason for the performance fall was the re-write of C-code
> into pure Perl.  Fine, but if that is the reason I am sure that you have not
> re-introduced the old C code!  I also note a number of performance
> improvements were reported between 1.11 and 1.14 but *my* benchmarking
> showed a 20% reduction in speed between from 1.11 to 1.14.
>
> (1) Are you aware of any changes made to SQL::Statement between 1.14 and
> 1.22 which may have restored the excellent performance of the pre-1.0
> releases of SQL::Statement?
>
> (2) It also strikes me that possibly the problem is not in SQL::Statement
> but in DBD::CSV.  What do you think?
>
> Regards (and thanks for an [otherwise!] excellent package),
> Paul
>
> Paul Beardsell
> Paul at Beardsell.com
>
>
> 2009/10/20 Paul Beardsell <paul at beardsell.com>
>
>> Hi, I have been notified that the bug I reported "#317518: New version of
>> libsql-statement-perl is very, very much slower" is reported as fixed and
>> has been closed by you.  The notification says that details of the changes
>> are to be found "below" but whereas I see lots of admin detail I nothing of
>> what has been done to supposedly restore the previous performance of this
>> package.  What has been done?  How do I find this out?
>>
>> Thanks,
>> Paul
>>
>> Paul Beardsell
>> Paul at Beardsell.com
>>
>>
>> 2009/10/19 Debian Bug Tracking System <owner at bugs.debian.org>
>>
>>> This is an automatic notification regarding your Bug report
>>> which was filed against the libsql-statement-perl package:
>>>
>>> #317518: New version of libsql-statement-perl is very, very much slower
>>>
>>> It has been closed by gregor herrmann <gregoa at debian.org>.
>>>
>>> Their explanation is attached below along with your original report.
>>> If this explanation is unsatisfactory and you have not received a
>>> better one in a separate message then please contact gregor herrmann <
>>> gregoa at debian.org> by
>>> replying to this email.
>>>
>>>
>>> --
>>> 317518: http://bugs.debian.org/cgi-bin/bugreport.cgi?bug=317518
>>> Debian Bug Tracking System
>>> Contact owner at bugs.debian.org with problems
>>>
>>>
>>> ---------- Forwarded message ----------
>>> From: gregor herrmann <gregoa at debian.org>
>>> To: 317518-close at bugs.debian.org
>>> Date: Mon, 19 Oct 2009 17:03:41 +0000
>>> Subject: Bug#317518: fixed in libsql-statement-perl 1.22-1
>>> Source: libsql-statement-perl
>>> Source-Version: 1.22-1
>>>
>>> We believe that the bug you reported is fixed in the latest version of
>>> libsql-statement-perl, which is due to be installed in the Debian FTP
>>> archive:
>>>
>>> libsql-statement-perl_1.22-1.diff.gz
>>>  to
>>> pool/main/libs/libsql-statement-perl/libsql-statement-perl_1.22-1.diff.gz
>>> libsql-statement-perl_1.22-1.dsc
>>>  to pool/main/libs/libsql-statement-perl/libsql-statement-perl_1.22-1.dsc
>>> libsql-statement-perl_1.22-1_all.deb
>>>  to
>>> pool/main/libs/libsql-statement-perl/libsql-statement-perl_1.22-1_all.deb
>>> libsql-statement-perl_1.22.orig.tar.gz
>>>  to
>>> pool/main/libs/libsql-statement-perl/libsql-statement-perl_1.22.orig.tar.gz
>>>
>>>
>>>
>>> A summary of the changes between this version and the previous one is
>>> attached.
>>>
>>> Thank you for reporting the bug, which will now be closed.  If you
>>> have further comments please address them to 317518 at bugs.debian.org,
>>> and the maintainer will reopen the bug report if appropriate.
>>>
>>> Debian distribution maintenance software
>>> pp.
>>> gregor herrmann <gregoa at debian.org> (supplier of updated
>>> libsql-statement-perl package)
>>>
>>> (This message was generated automatically at their request; if you
>>> believe that there is a problem with it please contact the archive
>>> administrators by mailing ftpmaster at debian.org)
>>>
>>>
>>> -----BEGIN PGP SIGNED MESSAGE-----
>>> Hash: SHA1
>>>
>>> Format: 1.8
>>> Date: Mon, 19 Oct 2009 18:12:55 +0200
>>> Source: libsql-statement-perl
>>> Binary: libsql-statement-perl
>>> Architecture: source all
>>> Version: 1.22-1
>>> Distribution: unstable
>>> Urgency: low
>>> Maintainer: Debian Perl Group <
>>> pkg-perl-maintainers at lists.alioth.debian.org>
>>> Changed-By: gregor herrmann <gregoa at debian.org>
>>> Description:
>>>  libsql-statement-perl - Perl SQL parsing and processing engine
>>> Closes: 317518 531238
>>> Changes:
>>>  libsql-statement-perl (1.22-1) unstable; urgency=low
>>>  .
>>>   [ gregor herrmann ]
>>>   * debian/control: Changed: Switched Vcs-Browser field to ViewSVN
>>>     (source stanza).
>>>   * debian/control: Added: ${misc:Depends} to Depends: field.
>>>  .
>>>   [ Rene Mayorga ]
>>>   * New upstream release
>>>   * debian/control:
>>>     + wrap long lines
>>>     + add myself to uploaders
>>>     + add libdbd-csv-perl to B-D-I
>>>   * debian/rules; updated using dh-make-perl
>>>   * debhelper and debian/compat set to 7
>>>   * libsql-statement-perl.doc; keep README
>>>   * debian/copyright:
>>>     + use (new)format
>>>     + add copyright years to upstream
>>>     + add upstream's missing copyright statement
>>>     + split copyright stanzas for debian/*
>>>  .
>>>   [ Ryan Niebur ]
>>>   * New upstream release
>>>   * Add myself to uploaders
>>>   * Add libclone-perl and libparams-util-perl to B-D-I and Depends
>>>   * Update ryan52's email address
>>>  .
>>>   [ Nathan Handler ]
>>>   * debian/watch: Update to ignore development releases.
>>>  .
>>>   [ gregor herrmann ]
>>>   * Change my email address.
>>>   * New upstream release 1.22.
>>>     + update dependencies
>>>     + closes: #531238, #317518
>>>     + remove patch and quilt framework, RT#13080 (Debian bug #311788) is
>>>       resolved
>>>     + update and compact copyright
>>>   * Minimize debian/rules, adjust build deps.
>>>   * Set Standards-Version to 3.8.3; remove version from perl dependency.
>>>   * Rename debian/README.update.Debian to debian/README.Debian, add
>>>     debian/NEWS about possible problems, install upstream Todo.
>>> Checksums-Sha1:
>>>  8ea04c5a0f6c41a289302357ee075b1f6270c54a 1580
>>> libsql-statement-perl_1.22-1.dsc
>>>  fbab6660699617cc0c21102e08e6e88cbe02dae0 100115
>>> libsql-statement-perl_1.22.orig.tar.gz
>>>  cc274e2d425832bd5b9a2c9ad9cfb6741a361ccd 4785
>>> libsql-statement-perl_1.22-1.diff.gz
>>>  a31143c90b288c381e11ef84a3a22022274773f3 150546
>>> libsql-statement-perl_1.22-1_all.deb
>>> Checksums-Sha256:
>>>  3137632930c07f758f066f59261011bcb585e1dd337aad6d8f050d72cbf23d6b 1580
>>> libsql-statement-perl_1.22-1.dsc
>>>  56fa1b3875abaa474441857a4ebbd8fbcaa0112527bc4c764d37ca782bd9d467 100115
>>> libsql-statement-perl_1.22.orig.tar.gz
>>>  7da01f746f20b4fec71623a190cb30601fbb8cdc90d8c6674026e1d1d99a918d 4785
>>> libsql-statement-perl_1.22-1.diff.gz
>>>  3b47ce8dc7e66a1d6f51cf9e5571f663f59c952925b59d0fe1b763157f6668aa 150546
>>> libsql-statement-perl_1.22-1_all.deb
>>> Files:
>>>  40fe0dbc79fdd60c2861260ef228936b 1580 perl optional
>>> libsql-statement-perl_1.22-1.dsc
>>>  78c591dc36b6e011abd59717f6450870 100115 perl optional
>>> libsql-statement-perl_1.22.orig.tar.gz
>>>  5bbe6fca7e17704af4cfb8728348226b 4785 perl optional
>>> libsql-statement-perl_1.22-1.diff.gz
>>>  5ddc15298d77f8620710b60f0d08e3eb 150546 perl optional
>>> libsql-statement-perl_1.22-1_all.deb
>>>
>>> -----BEGIN PGP SIGNATURE-----
>>> Version: GnuPG v1.4.10 (GNU/Linux)
>>>
>>> iEYEARECAAYFAkrckHAACgkQOzKYnQDzz+SpTQCfSo3kzS3vV0B+A7DVhLlNKIaK
>>> kKEAn1M2KOJXT+RHhFNju2VIYBe/GlpH
>>> =0IYS
>>> -----END PGP SIGNATURE-----
>>>
>>>
>>>
>>>
>>> ---------- Forwarded message ----------
>>> From: Paul Beardsell <Paul at Beardsell.com>
>>> To: Debian Bug Tracking System <submit at bugs.debian.org>
>>> Date: Sat, 09 Jul 2005 12:00:27 +0100
>>> Subject: New version of libsql-statement-perl is very, very much slower
>>> Package: libsql-statement-perl
>>> Version: 1.11-1
>>> Severity: normal
>>>
>>>
>>> I depend upon libsql-statement-perl to manage small
>>> plain text databases of approx 2000 rows.  Performance
>>> was fine in the version of libsql-statement-perl
>>> which came with woody but the newer version in sarge
>>> is very, very much slower.  I understand this may
>>> be because because C code in the former version has
>>> been replaced with Perl code.  Fine, but this makes
>>> the package nearly unusable for me because of the
>>> performance problem.  I do not want to have to switch
>>> over to SQLite.
>>>
>>> -- System Information:
>>> Debian Release: 3.1
>>>  APT prefers testing
>>>  APT policy: (70, 'testing'), (60, 'unstable')
>>> Architecture: i386 (i686)
>>> Kernel: Linux 2.6.8-2-686
>>> Locale: LANG=C, LC_CTYPE=C (charmap=ANSI_X3.4-1968)
>>>
>>> Versions of packages libsql-statement-perl depends on:
>>> ii  perl                          5.8.4-8    Larry Wall's Practical
>>> Extraction
>>>
>>> -- no debconf information
>>>
>>>
>>>
>>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.alioth.debian.org/pipermail/pkg-perl-maintainers/attachments/20091020/bb8ee9d1/attachment-0001.htm>

More information about the pkg-perl-maintainers mailing list