My guess would be that the testsuite is just extremely slow on armel (which uses software floating point). Would it be possible to disable longer-running tests or is the testsuite an all-or-nothing thing?