I too saw these messages. In my case it was during a fresh installation (not upgrade). The user-visible result of this bug is that help no longer works: when you go to Help->Contents, the help window will open but no help text will be shown. If Rhythmbox was started from a terminal you can see the XML errors there.