This bug is still present in 0.12.8, but I think it's not a rhythmbox problem, it could be gstreamer. I got the same delay when playing music or videos with totem.