Bug#1021085: mksh: ignored test making the build unreproducible

Chris Lamb lamby at debian.org
Sat Oct 1 18:35:03 BST 2022


Source: mksh
Version: 59c-18
Severity: wishlist
User: reproducible-builds at lists.alioth.debian.org
Usertags: randomness
X-Debbugs-Cc: reproducible-bugs at lists.alioth.debian.org

Hi,

Whilst working on the Reproducible Builds effort we noticed that
mksh could not be built reproducibly anymore.

This is because the test summary is printed in README.Debian, and if
any of the tests are "ignored" this is recorded as well.

However, if the number of ignored tests is different between two
specimen builds, then the package is rendered unreproducible. For
example:

   Regression test results:
  -| FAIL ../../check.t:heredoc-tmpfile-8 (ignored)
  -| Total failed: 1 (1 ignored)
  -| Total passed: 576
  +| Total failed: 0
  +| Total passed: 577

To be clear, that mksh includes test info is not necessarily a bug,
and nor is it necessarily a bug in mksh that some test is failing in
some weird environment. But the combination of the two is
unfortunately causing a reproducibility regression and I thought you
may have more context.



Regards,

-- 
      ,''`.
     : :'  :     Chris Lamb
     `. `'`      lamby at debian.org / chris-lamb.co.uk
       `-


More information about the Reproducible-bugs mailing list