Bug#557655: Segmentation fault with hwac3

[Max Kellermann]

Package: mplayer
Version: 1.0~rc3+svn20090405-1

I'm trying to play a file with an AC3 audio stream, with AC3 over
SPDIF pass-through (ac=hwac3 in ~/.mplayer/config).  Here is a
transcript of a gdb session.  You see that by mistake, mplayer chose
OSS instead of ALSA, and failed to set up AC3 on the OSS device.  With
"ao=alsa", the crash does not occur.

max at woodpecker:/tmp$ gdb --args mplayer big_buck_bunny_720p_surround.avi
GNU gdb (GDB) 7.0-debian
Copyright (C) 2009 Free Software Foundation, Inc.
License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>
This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law.  Type "show copying"
and "show warranty" for details.
This GDB was configured as "x86_64-linux-gnu".
For bug reporting instructions, please see:
<http://www.gnu.org/software/gdb/bugs/>...
Reading symbols from /usr/bin/mplayer...Reading symbols from /usr/lib/debug/usr/bin/mplayer...done.
(no debugging symbols found)...done.
(gdb) run
Starting program: /usr/bin/mplayer big_buck_bunny_720p_surround.avi
[Thread debugging using libthread_db enabled]
MPlayer SVN-r29142-4.3.3 (C) 2000-2009 MPlayer Team

Playing big_buck_bunny_720p_surround.avi.
Cache fill:  0.00% (0 bytes)   
AVI file format detected.
[aviheader] Video stream found, -vid 0
[aviheader] Audio stream found, -aid 1
AVI: ODML: Building ODML index (2 superindexchunks).
VIDEO:  [FMP4]  1280x720  24bpp  24.000 fps  4001.7 kbps (488.5 kbyte/s)
Clip info:
 Software: AVI-Mux GUI 1.17.7, Aug  8 2006  20:59:17
vo: couldn't open the X11 display ()!
Error opening/initializing the selected video_out (-vo) device.
==========================================================================
Forced audio codec: hwac3
Opening audio decoder: [hwac3] AC3/DTS pass-through S/PDIF
No accelerated IMDCT transform found
hwac3: switched to AC3, 448000 bps, 48000 Hz
AUDIO: 48000 Hz, 2 ch, ac3, 448.0 kbit/29.17% (ratio: 56000->192000)
Selected audio codec: [hwac3] afm: hwac3 (AC3 through S/PDIF)
==========================================================================
[AO OSS] Can't set audio device /dev/dsp to ac3 output, trying s16le...
AO: [oss] 48000Hz 2ch s16le (2 bytes per sample)
[format] Sample format big-endian AC3 not yet supported 
[libaf] Reinitialization did not work, audio filter 'format' returned error code -2
Couldn't find matching filter/ao format!
Video: no video
Starting playback...

Program received signal SIGSEGV, Segmentation fault.
af_calc_filter_multiplier (s=0x0) at libaf/af.c:561
561     libaf/af.c: No such file or directory.
        in libaf/af.c
(gdb) bt
#0  af_calc_filter_multiplier (s=0x0) at libaf/af.c:561
#1  0x0000000000519d35 in decode_audio (sh_audio=0xc31420, minlen=65536) at libmpcodecs/dec_audio.c:425
#2  0x0000000000464553 in fill_audio_out_buffers (argc=<value optimized out>, 
    argv=<value optimized out>) at mplayer.c:2041
#3  main (argc=<value optimized out>, argv=<value optimized out>) at mplayer.c:3662