Bug#674788: LWP::UserAgent cuts chunked response

[Modestas Vainius]

Package: libnet-http-perl
Version: 6.03-1
Severity: normal

Hello,

when running the following script:
------------------------------
#!/usr/bin/perl

use LWP::UserAgent;

my $browser = LWP::UserAgent->new();
$browser->show_progress(1);
my $resp = $browser->get("https://buildd.debian.org/status/fetch.php?pkg=qtwebkit&arch=armhf&ver=2.2.1-3&stamp=1336897582",
    ":content_file" => "output.html");
print $resp->as_string();
------------------------------

output.html is not retrieved fully (the output is cut randomly each time the
script is run). The script gives the following output:

** GET https://buildd.debian.org/status/fetch.php?pkg=qtwebkit&arch=armhf&ver=2.2.1-3&stamp=1336897582 ==> 200 OK (2s)
HTTP/1.1 200 OK
Connection: close
Date: Sun, 27 May 2012 16:18:52 GMT
Server: Apache
Vary: Accept-Encoding
Content-Type: text/html
Client-Aborted: die
Client-Date: Sun, 27 May 2012 16:18:53 GMT
Client-Peer: 194.177.211.200:443
Client-Response-Num: 1
Client-SSL-Cert-Issuer: /O=Debian/CN=ca.debian.org/emailAddress=debian-admin at debian.org
Client-SSL-Cert-Subject: /O=Debian/CN=buildd.debian.org/emailAddress=debian-admin at debian.org
Client-SSL-Cipher: DHE-RSA-AES256-SHA
Client-SSL-Socket-Class: IO::Socket::SSL
Client-Transfer-Encoding: chunked
Link: <media/revamp.css>; rel="stylesheet"; type="text/css"
Link: <media/pkg.css>; rel="StyleSheet"; type="text/css"
Link: <media/status.css>; rel="StyleSheet"; type="text/css"
Title: Build log for qtwebkit (2.2.1-3) on armhf
X-Died: Missing newline after chunk data: 'DQT_MAKEDLL -DQT_NO_DEBUG -DQT_GUI_LIB -DQT_NETWORK_LIB -DQT_CORE_LIB -DQT_SHARED -I/usr/share/qt4/mkspecs/linux-g++ -I. -I/usr/include/qt4/QtCore -I/usr/include/qt4/QtNetwork -I/usr/include/qt4/QtGui -I/usr/include/qt4 -I../JavaScriptCore -I../../Source -I../ThirdParty -I../JavaScriptCore/assembler -I../JavaScriptCore/bytecode -I../JavaScriptCore/bytecompiler -I../JavaScriptCore/heap -I../JavaScriptCore/dfg -I../JavaScriptCore/debugger -I../JavaScriptCore/interpreter -I../JavaScriptCore/jit -I../JavaScriptCore/parser -I../JavaScriptCore/profiler -I../JavaScriptCore/runtime -I../JavaScriptCore/wtf -I../JavaScriptCore/wtf/gobject -I/build/buildd-qtwebkit_2.2.1-3-armhf-lTRdTt/qtwebkit-2.2.1/Source/JavaScriptCore/wtf/symbian -I../JavaScriptCore/wtf/unicode -I../JavaScriptCore/yarr -I../JavaScriptCore/API -I../JavaScriptCore/ForwardingHeaders -I../JavaScriptCore/generated -Ibridge/qt -Ipage/qt -Iplatform/graphics/qt -Iplatform/network/qt
  -Iplatform/qt -I../WebKit/qt/Api -I../WebKit/qt/WebCoreSupport -I. -Iaccessibility -Ibindings -Ibindings/generic -Ibridge -Icss -Idom -Idom/default -Iediting -Ifileapi -Ihistory -Ihtml -Ihtml/canvas -Ihtml/parser -Ihtml/shadow -Iinspector -Iloader -Iloader/appcache -Iloader/archive -Iloader/cache -Iloader/icon -Imathml -Inotifications -Ipage -Ipage/animation -Iplatform -Iplatform/animation -Iplatform/audio -Iplatform/graphics -Iplatform/graphics/filters -Iplatform/graphics/filters/arm -Iplatform/graphics/texmap -Iplatform/graphics/transforms -Iplatform/image-decoders -Iplatform/leveldb -Iplatform/mock -Iplatform/network -Iplatform/sql -Iplatform/text -Iplatform/text/transcoder -Iplugins -Irendering -Irendering/mathml -Irendering/style -Irendering/svg -Istorage -Isvg -Isvg/animation -Isvg/graphics -Isvg/graphics/filters -Isvg/properties -Itesting -Iwebaudio -Iwebsockets -I/build/buildd-qtwebkit_2.2.1-3-armhf-lTRdTt/qtwebkit-2.2.1/Source/WebCore/wml -Iworkers -Ixml -Ibridge/j
 sc -Ibindings/js -I/build/buildd-qtwebkit_2.2.1-3-armhf-lTRdTt/qtwebkit-2.2.1/Source/WebCore/bindings/js/specialization -Ibridge/c -Itesting/js -Igenerated -I../../Source -I/build/buildd-qtwebkit_2.2.1-3-armhf-lTRdTt/qtwebkit-2.2.1/Source/../include -I../include/QtWebKit -I../include -I/usr/src/3rdparty/sqlite/ -Iplatform/graphics/gstreamer -I/usr/include/glib-2.0 -I/usr/lib/arm-linux-gnueabihf/glib-2.0/include -I/usr/include/gstreamer-0.10 -I/usr/include/libxml2 -I/usr/X11R6/include -I. -o obj/release/CSSProperty.o css/CSSProperty.cpp' at /usr/share/perl5/Net/HTTP/Methods.pm line 481.
X-Powered-By: PHP/5.3.3-7+squeeze9
--------------------------------------------

If I disable show_progress(), the bug does not occur (probably because the
response is not chunked then).

This bug could be related to https://bugzilla.redhat.com/show_bug.cgi?id=768394

-- System Information:
Debian Release: wheezy/sid
  APT prefers unstable
  APT policy: (500, 'unstable'), (500, 'testing'), (110, 'experimental')
Architecture: amd64 (x86_64)

Kernel: Linux 3.2.0-2-amd64 (SMP w/4 CPU cores)
Locale: LANG=lt_LT.UTF-8, LC_CTYPE=lt_LT.UTF-8 (charmap=UTF-8)
Shell: /bin/sh linked to /bin/dash

Versions of packages libnet-http-perl depends on:
ii  perl  5.14.2-11

Versions of packages libnet-http-perl recommends:
ii  libio-socket-ssl-perl  1.74-1

libnet-http-perl suggests no packages.

-- no debconf information