Bug#656572: Segfaults when using vaapi

[Reinhard Tartler]

severity 656572 important
affects 656572 vlc
stop

On Fr, Jan 20, 2012 at 09:26:45 (CET), Andrey Rahmatullin wrote:

> Package: libavcodec53
> Version: 4:0.8~beta2-3
> Severity: normal
>
> I'm trying to play video with vlc and vaapi enabled and it crashes:
>
> libva: libva version 0.32.0
> Xlib:  extension "XFree86-DRI" missing on display ":0".
> libva: va_getDriverName() returns 0
> libva: Trying to open /usr/lib/dri/nvidia_drv_video.so
> libva: va_openDriver() returns 0
> [0x824950] avcodec decoder: Using VA API version 0.32 for hardware decoding.
>
> Program received signal SIGSEGV, Segmentation fault.
> [Switching to Thread 0x7fffdfaf4700 (LWP 25963)]
> vaapi_mpeg4_start_frame (avctx=0x817480, buffer=<optimized out>, size=2420) at
> /build/libav-Hw7_og/libav-0.8~beta2/libavcodec/vaapi_mpeg4.c:52
> 52      /build/libav-Hw7_og/libav-0.8~beta2/libavcodec/vaapi_mpeg4.c: Нет
> такого файла или каталога.
>         in /build/libav-Hw7_og/libav-0.8~beta2/libavcodec/vaapi_mpeg4.c
> (gdb) bt
> #0  vaapi_mpeg4_start_frame (avctx=0x817480, buffer=<optimized out>, size=2420)
> at /build/libav-Hw7_og/libav-0.8~beta2/libavcodec/vaapi_mpeg4.c:52
> #1  0x00007fffe0c715bc in ff_h263_decode_frame (avctx=0x817480, data=0x847360,
> data_size=0x8474d0, avpkt=<optimized out>) at /build/libav-
> Hw7_og/libav-0.8~beta2/libavcodec/h263dec.c:627
> #2  0x00007fffe0e5860b in frame_worker_thread (arg=0x847200) at /build/libav-
> Hw7_og/libav-0.8~beta2/libavcodec/pthread.c:377
> #3  0x00007ffff76c4b50 in start_thread (arg=<optimized out>) at
> pthread_create.c:304
> #4  0x00007ffff720b4ad in clone () at
> ../sysdeps/unix/sysv/linux/x86_64/clone.S:112
> #5  0x0000000000000000 in ?? ()
>

I think this patch from upstream should avoid the crash:

http://patches.libav.org/patch/15408/

It is currently under discussion, see the thread of discussion below.
Maybe we should include it nevertheless?

Cheers,
Reinhard

-- 
Gruesse/greetings,
Reinhard Tartler, KeyID 945348A4