Bug#576245: clive: failures with newer youtube videos

Paul Wise pabs at debian.org
Fri Apr 2 04:20:03 UTC 2010


Package: clive
Version: 2.2.8-1
Severity: important

I can't get clive to download youtube URLs any more. It looks like the
recent youtube page format changes are preventing clive from finding the
video_id field, which seems to have moved to a hidden form element.

Luckily youtube-dl still works.

Some examples:

http://www.youtube.com/watch?v=gxtaPr8aA0E
http://youtube.com/?v=ikxUKJsyRsE
http://youtube.com/?v=K6v6xq90mLo
http://youtube.com/?v=RII9ceqAoxQ

These all give this output:

$ clive http://youtube.com/?v=ABF5581sGek
fetch http://youtube.com/?v=ABF5581sGek ...done.
error: no match: `(?-xism:"video_id": "(.*?)")'

I get the following when I run with --debug:

$ clive --debug http://youtube.com/?v=ABF5581sGek
fetch http://youtube.com/?v=ABF5581sGek ...* About to connect() to youtube.com port 80 (#0)
*   Trying 74.125.45.100... * connected
* Connected to youtube.com (74.125.45.100) port 80 (#0)
> GET /?v=ABF5581sGek HTTP/1.1
User-Agent: Mozilla/5.0
Host: youtube.com
Accept: */*
Accept-Encoding: deflate, gzip

< HTTP/1.1 301 Moved Permanently
< Date: Fri, 02 Apr 2010 04:13:41 GMT
< Server: Apache
< Location: http://www.youtube.com/?v=ABF5581sGek
< Content-Length: 310
< Content-Type: text/html; charset=iso-8859-1
< X-XSS-Protection: 0
< 
* Ignoring the response-body
* Connection #0 to host youtube.com left intact
* Issue another request to this URL: 'http://www.youtube.com/?v=ABF5581sGek'
* About to connect() to www.youtube.com port 80 (#1)
*   Trying 72.14.203.139... * connected
* Connected to www.youtube.com (72.14.203.139) port 80 (#1)
> GET /?v=ABF5581sGek HTTP/1.1
User-Agent: Mozilla/5.0
Host: www.youtube.com
Accept: */*
Accept-Encoding: deflate, gzip
Referer: http://youtube.com/?v=ABF5581sGek

< HTTP/1.1 303 See Other
< Date: Fri, 02 Apr 2010 04:13:41 GMT
< Server: Apache
< X-Content-Type-Options: nosniff
< Set-Cookie: use_hitbox=72c46ff6cbcdb7c5585c36411b6b334edAEAAAAw; path=/; domain=.youtube.com
< Set-Cookie: VISITOR_INFO1_LIVE=lPQvSi1pVtg; path=/; domain=.youtube.com; expires=Sun, 28-Nov-2010 04:13:41 GMT
< Set-Cookie: PREF=f1=40000000; path=/; domain=.youtube.com; expires=Mon, 30-Mar-2020 04:13:41 GMT
< Set-Cookie: GEO=4fce106cd2294500234fea1f3d21f614cwsAAAAzQVV6aUyMS7Vu9Q==; path=/; domain=.youtube.com
< Expires: Tue, 27 Apr 1971 19:44:06 EST
< Content-Length: 0
< X-YouTube-MID: sWkFSZzctYUFHdmhPQkw1UXNwNGFQVVlPekg4YlRiWnN2ZjBTSlVHNUYxRWoyLU5JallEdmxn
< Cache-Control: no-cache
< Location: http://www.youtube.com/watch?v=ABF5581sGek
< Content-Type: text/html; charset=utf-8
< 
* Connection #1 to host www.youtube.com left intact
* Issue another request to this URL: 'http://www.youtube.com/watch?v=ABF5581sGek'
* Re-using existing connection! (#1) with host www.youtube.com
* Connected to www.youtube.com (72.14.203.139) port 80 (#1)
> GET /watch?v=ABF5581sGek HTTP/1.1
User-Agent: Mozilla/5.0
Host: www.youtube.com
Accept: */*
Accept-Encoding: deflate, gzip
Referer: http://www.youtube.com/?v=ABF5581sGek

< HTTP/1.1 200 OK
< Date: Fri, 02 Apr 2010 04:13:42 GMT
< Server: Apache
< X-Content-Type-Options: nosniff
< Content-Encoding: gzip
< Set-Cookie: use_hitbox=72c46ff6cbcdb7c5585c36411b6b334edAEAAAAw; path=/; domain=.youtube.com
< Set-Cookie: VISITOR_INFO1_LIVE=hMk7uOFWLpI; path=/; domain=.youtube.com; expires=Sun, 28-Nov-2010 04:13:42 GMT
< Set-Cookie: PREF=f1=40000000; path=/; domain=.youtube.com; expires=Mon, 30-Mar-2020 04:13:42 GMT
< Set-Cookie: GEO=b916ef5e9cad0fdcf53533cd3163ffeacwsAAAAzQVV6aUyMS7Vu9g==; path=/; domain=.youtube.com
< Set-Cookie: watched_video_id_list=8dc828cf6530a4da775403c91180b2e8WwEAAABzCwAAAEFCRjU1ODFzR2Vr; path=/; domain=.youtube.com
< Expires: Tue, 27 Apr 1971 19:44:06 EST
< X-YouTube-MID: sWkFSZzctYUFHdmd5ZEVHTHktSDJENU5NZ2dFRFJRX0EyOGxKN2R3UnkwcjJsSjB6NTNLRFNR
< Cache-Control: no-cache
< Content-Length: 11741
< Content-Type: text/html; charset=utf-8
< 
* Connection #1 to host www.youtube.com left intact
done.
error: no match: `(?-xism:"video_id": "(.*?)")'
* Closing connection #0
* Closing connection #1

-- System Information:
Debian Release: squeeze/sid
  APT prefers testing
  APT policy: (700, 'testing'), (600, 'unstable'), (550, 'experimental')
Architecture: amd64 (x86_64)

Kernel: Linux 2.6.33-2-amd64 (SMP w/2 CPU cores)
Locale: LANG=en_AU.UTF-8, LC_CTYPE=en_AU.UTF-8 (charmap=UTF-8)
Shell: /bin/sh linked to /bin/dash

Versions of packages clive depends on:
ii  libclass-singleton-perl       1.4-1      implementation of a "Singleton" cl
ii  libconfig-tiny-perl           2.12-1     Read/Write .ini style files with a
ii  libexpect-perl                1.20-2     Expect.pm - Perl Expect interface
ii  libgetopt-argvfile-perl       1.11-1     Perl module for reading script opt
ii  libhtml-parser-perl           3.64-1     collection of modules that parse H
ii  liburi-perl                   1.52-1     module to manipulate and access UR
ii  libwww-curl-perl              4.11-1     Perl bindings to libcurl
ii  perl [libdigest-sha-perl]     5.10.1-11  Larry Wall's Practical Extraction 

Versions of packages clive recommends:
ii  clive-utils                   2.1.6-1    additional utilities for clive
ii  libberkeleydb-perl            0.41-1     use Berkeley DB 4 databases from P
ii  libterm-readkey-perl          2.30-4     A perl module for simple terminal 

Versions of packages clive suggests:
ii  ffmpeg                        4:0.5.1-3  multimedia player, server and enco

-- 
bye,
pabs

http://wiki.debian.org/PaulWise
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: application/pgp-signature
Size: 198 bytes
Desc: This is a digitally signed message part
URL: <http://lists.alioth.debian.org/pipermail/pkg-perl-maintainers/attachments/20100402/fb3d1e1b/attachment.pgp>


More information about the pkg-perl-maintainers mailing list