OK, this wasn't a problem with libopenal-dev being arch=all, the problem was that there's a missing symlink (/usr/lib32/libopenal.so does not exist). My bad, though that link should still be generated by the ia32-libopenal1 package from ia32-apt-get.