Bug#1052257: diffoscope crashes(?) comparing some i386 debs (and others)

[Holger Levsen]

package: diffoscope
version: 240
severity: important
x-debbugs-cc: reproducible-builds at lists.alioth.debian.org

hi,

On Tue, Sep 05, 2023 at 10:05:58PM +0200, FC Stegerman wrote:
> It worked (and was probably needed) before as the "--" was interpreted
> by schroot, not diffoscope.  So the solution should be to remove the
> "--" and just use:
>   diffoscope --version

thanks, Mattia implemented this in the meantime.

and then I did some commit so we can see on which packages diffoscope
cause the machine go into absurd loads (and sometimes make diffoscope
crash) crashes and the results have been interesting, out of 87
cases where diffoscope didnt finish this happened on:

47 trixie_i386
21 unstable_i386
5 unstable_armhf
4 trixie_arm64
4 trixie_amd64
3 unstable_arm64
2 trixie_armhf
1 experimental_amd64

so I guess my short-term measure will be to disable i386 testing...
(which I consider just wildly poking around.)

Also, this is caused mostly when running diffoscope on 3-4 distinct packages
(so far):

21 ocaml-obuild_trixie_i386
8 pgocaml_trixie_i386
8 omake_unstable_i386
8 ocaml-dune_unstable_i386
8 ocaml-dune_trixie_i386
6 ben_trixie_i386
2 wpewebkit_trixie_arm64
2 hevea_trixie_i386
2 astropy_unstable_armhf

Please not that this is diffoscope running on amd64, testing those packages
build for any arch. (using diffoscope from bookworm currently but I dont see
any major changes between diffoscope from bookworm and sid currently.)

Looking at https://tests.reproducible-builds.org/debian/history/ocaml-dune.html
it shows usual build times of very few minutes, however the last test for trixie/i386 took
over 2h. (?!?)

ocaml-obuild is the package which was tried most in the last days, what this
clearly shows is that the package is build twice, then diffoscope appearantly
crashes and the packages is tested again and again and again:

root at jenkins:/var/log/reproducible-builds# ls *ocaml-obuild* -lart
-rw-r--r-- 1 jenkins jenkins 0 Sep 18 09:29 diffoscope_stamp_ocaml-obuild_trixie_i386_1695029345
-rw-r--r-- 1 jenkins jenkins 0 Sep 18 09:39 diffoscope_stamp_ocaml-obuild_trixie_i386_1695029961
-rw-r--r-- 1 jenkins jenkins 0 Sep 18 09:47 diffoscope_stamp_ocaml-obuild_trixie_i386_1695030452
-rw-r--r-- 1 jenkins jenkins 0 Sep 18 09:55 diffoscope_stamp_ocaml-obuild_trixie_i386_1695030952
-rw-r--r-- 1 jenkins jenkins 0 Sep 18 10:07 diffoscope_stamp_ocaml-obuild_trixie_i386_1695031674
-rw-r--r-- 1 jenkins jenkins 0 Sep 18 11:20 diffoscope_stamp_ocaml-obuild_trixie_i386_1695036023
-rw-r--r-- 1 jenkins jenkins 0 Sep 18 11:31 diffoscope_stamp_ocaml-obuild_trixie_i386_1695036663
-rw-r--r-- 1 jenkins jenkins 0 Sep 18 11:41 diffoscope_stamp_ocaml-obuild_trixie_i386_1695037307
-rw-r--r-- 1 jenkins jenkins 0 Sep 18 11:50 diffoscope_stamp_ocaml-obuild_trixie_i386_1695037840
-rw-r--r-- 1 jenkins jenkins 0 Sep 18 12:04 diffoscope_stamp_ocaml-obuild_trixie_i386_1695038698
-rw-r--r-- 1 jenkins jenkins 0 Sep 18 14:40 diffoscope_stamp_ocaml-obuild_trixie_i386_1695048004
-rw-r--r-- 1 jenkins jenkins 0 Sep 18 15:05 diffoscope_stamp_ocaml-obuild_trixie_i386_1695049528
-rw-r--r-- 1 jenkins jenkins 0 Sep 18 15:19 diffoscope_stamp_ocaml-obuild_trixie_i386_1695050391
-rw-r--r-- 1 jenkins jenkins 0 Sep 18 15:35 diffoscope_stamp_ocaml-obuild_trixie_i386_1695051344
-rw-r--r-- 1 jenkins jenkins 0 Sep 18 15:51 diffoscope_stamp_ocaml-obuild_trixie_i386_1695052268
-rw-r--r-- 1 jenkins jenkins 0 Sep 18 16:01 diffoscope_stamp_ocaml-obuild_trixie_i386_1695052915
-rw-r--r-- 1 jenkins jenkins 0 Sep 18 16:11 diffoscope_stamp_ocaml-obuild_trixie_i386_1695053485
-rw-r--r-- 1 jenkins jenkins 0 Sep 18 16:28 diffoscope_stamp_ocaml-obuild_trixie_i386_1695054506
-rw-r--r-- 1 jenkins jenkins 0 Sep 18 16:45 diffoscope_stamp_ocaml-obuild_trixie_i386_1695055539
-rw-r--r-- 1 jenkins jenkins 0 Sep 18 17:04 diffoscope_stamp_ocaml-obuild_trixie_i386_1695056683
-rw-r--r-- 1 jenkins jenkins 0 Sep 18 17:32 diffoscope_stamp_ocaml-obuild_trixie_i386_1695058357

I'm filing this as a bug in the Debian BTS now to benefit from x-debbugs-cc :)


-- 
cheers,
	Holger

 ⢀⣴⠾⠻⢶⣦⠀
 ⣾⠁⢠⠒⠀⣿⡁  holger@(debian|reproducible-builds|layer-acht).org
 ⢿⡄⠘⠷⠚⠋⠀  OpenPGP: B8BF54137B09D35CF026FE9D 091AB856069AAA1C
 ⠈⠳⣄

Reporter: You're the first person ever to win two Olympic tennis gold medals.
That's an extraordinary feat, isn't it?
Andy Murray: I think Venus and Serena have won about four each.
-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 833 bytes
Desc: not available
URL: <http://alioth-lists.debian.net/pipermail/reproducible-builds/attachments/20230919/ccb1a0d7/attachment.sig>