Bug#893599: autopkgtest fails with UnicodeDecodeError if stderr contains non-UTF-8

[Paul Gevers]

Package: autopkgtest
Version: 5.1
Severity: normal
Control: affects -1 src:conv-tools

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA256

The autopkgtest of conv-tools is testing if non-UTF-8 characters are correctly
processed by its tools. In the process, it echos these characters to stderr
(yes, it could refrain from doing so). However, autopkgtest should not fail¹ on
it as it currently does.

autopkgtest [05:15:59]: ERROR: unexpected error:
Traceback (most recent call last):
  File "/usr/bin/autopkgtest", line 659, in main
    process_actions()
  File "/usr/bin/autopkgtest", line 619, in process_actions
    run_tests(tests, tests_tree)
  File "/usr/bin/autopkgtest", line 156, in run_tests
    opts.build_parallel)
  File "/usr/share/autopkgtest/lib/adt_testbed.py", line 1167, in run_test
    stderr_top = f.readline().rstrip('\n \t\r')
  File "/usr/lib/python3.5/codecs.py", line 321, in decode
    (result, consumed) = self._buffer_decode(data, self.errors, final)
UnicodeDecodeError: 'utf-8' codec can't decode byte 0xe6 in position 315: invalid continuation byte

¹ https://ci.debian.net/data/autopkgtest/unstable/amd64/c/conv-tools/30699/log.gz

- -- System Information:
Debian Release: buster/sid
  APT prefers testing-debug
  APT policy: (500, 'testing-debug'), (500, 'testing'), (200, 'testing'), (50, 'testing')
Architecture: amd64 (x86_64)

Kernel: Linux 4.15.0-1-amd64 (SMP w/2 CPU cores)
Locale: LANG=en_US.UTF-8, LC_CTYPE=en_US.UTF-8 (charmap=UTF-8), LANGUAGE=en_US:en (charmap=UTF-8)
Shell: /bin/sh linked to /bin/dash
Init: systemd (via /run/systemd/system)
LSM: AppArmor: enabled

Versions of packages autopkgtest depends on:
ii  apt-utils       1.6~beta1
ii  libdpkg-perl    1.19.0.5
ii  procps          2:3.3.12-4
ii  python3         3.6.4-1
ii  python3-debian  0.1.32

Versions of packages autopkgtest recommends:
ii  autodep8  0.11.1

Versions of packages autopkgtest suggests:
ii  lxc          1:2.0.9-6
pn  lxd-client   <none>
pn  qemu-system  <none>
ii  qemu-utils   1:2.11+dfsg-1
ii  schroot      1.6.10-4

- -- no debconf information

-----BEGIN PGP SIGNATURE-----

iQEzBAEBCAAdFiEEWLZtSHNr6TsFLeZynFyZ6wW9dQoFAlqw3t4ACgkQnFyZ6wW9
dQo1mQf/ZT82EZGplL9a5tntTvPwXIdJWSrag9SFCewqcpGQxBnwJG9xoY+3bEiq
7GXgj8KhlOkLjIVMpcDueDSSIaVXIgjQ0eUeAJhXvL/hlIaiXT5G9EMTVjV8K2tr
6UfHTYDdXu4Ps4CGzTjHoIwAVZurl2ASua3/2VvT8/YVBtCaWFjVsHJa/m7DwJbb
RGfFRyoVqUiMVOal+h+A89l1NvjDJDOrxgqX5Vhuoiv9mYNDkUO3F3oBTCbgwAgQ
/zCWijWMboDAjDHty0pov/U8EsHUJww3tErj6AuPww2dWsawnSK2faW9oU4W/oV0
OWJuZeCkVeI3hetZ33gjMDn5MkfhPA==
=SwDF
-----END PGP SIGNATURE-----