[Qa-jenkins-scm] Build failed in Jenkins: reproducible_scheduler #36223

[jenkins at jenkins.debian.net]

See <https://jenkins.debian.net/job/reproducible_scheduler/36223/display/redirect>

Changes:


------------------------------------------
Started by timer
Running as SYSTEM
[EnvInject] - Loading node environment variables.
Building on the built-in node in workspace <https://jenkins.debian.net/job/reproducible_scheduler/ws/>
[workspace] $ /bin/sh -xe /tmp/jenkins3472098734378357180.sh
+ /srv/jenkins/bin/reproducible_scheduler.py
/srv/jenkins/bin/reproducible_scheduler.py:15: DeprecationWarning: please use 'debian.deb822' instead
  import deb822
[2022-07-24 05:23:00] INFO: Starting at 2022-07-24 05:23:00.317252
[2022-07-24 05:23:00] INFO: Updating sources tables for all suites.
[2022-07-24 05:23:00] INFO: Downloading sources file for stretch: http://deb.debian.org/debian/dists/stretch/main/source/Sources.xz
[2022-07-24 05:23:01] INFO: Updating sources db for stretch/amd64...
/usr/lib/python3/dist-packages/debian/deb822.py:748: UserWarning: Parsing of Deb822 data with python-apt's apt_pkg was requested but this cannot be done on non-file input.
  warnings.warn(msg)
[2022-07-24 05:23:21] INFO: Pushing 0 updated packages to the database...
[2022-07-24 05:23:33] INFO: Now deleting 0 removed packages: []
[2022-07-24 05:23:33] INFO: DB update done for stretch/amd64 done at 2022-07-24 05:23:33.
[2022-07-24 05:23:33] INFO: Updating sources db for stretch/i386...
[2022-07-24 05:23:54] INFO: Pushing 0 updated packages to the database...
[2022-07-24 05:24:07] INFO: Now deleting 0 removed packages: []
[2022-07-24 05:24:07] INFO: DB update done for stretch/i386 done at 2022-07-24 05:24:07.
[2022-07-24 05:24:07] INFO: Updating sources db for stretch/arm64...
[2022-07-24 05:24:24] INFO: Pushing 0 updated packages to the database...
[2022-07-24 05:24:37] INFO: Now deleting 0 removed packages: []
[2022-07-24 05:24:37] INFO: DB update done for stretch/arm64 done at 2022-07-24 05:24:37.
[2022-07-24 05:24:37] INFO: Updating sources db for stretch/armhf...
[2022-07-24 05:24:55] INFO: Pushing 0 updated packages to the database...
[2022-07-24 05:25:09] INFO: Now deleting 0 removed packages: []
[2022-07-24 05:25:09] INFO: DB update done for stretch/armhf done at 2022-07-24 05:25:09.
[2022-07-24 05:25:09] INFO: Sources for suite stretch done at 2022-07-24 05:25:09.
[2022-07-24 05:25:09] INFO: Downloading sources file for buster: http://deb.debian.org/debian/dists/buster/main/source/Sources.xz
[2022-07-24 05:25:12] INFO: Updating sources db for buster/amd64...
[2022-07-24 05:25:33] INFO: Pushing 0 updated packages to the database...
[2022-07-24 05:25:52] INFO: Now deleting 0 removed packages: []
[2022-07-24 05:25:52] INFO: DB update done for buster/amd64 done at 2022-07-24 05:25:52.
[2022-07-24 05:25:52] INFO: Updating sources db for buster/i386...
[2022-07-24 05:26:15] INFO: Pushing 0 updated packages to the database...
[2022-07-24 05:26:35] INFO: Now deleting 0 removed packages: []
[2022-07-24 05:26:35] INFO: DB update done for buster/i386 done at 2022-07-24 05:26:35.
[2022-07-24 05:26:35] INFO: Updating sources db for buster/arm64...
[2022-07-24 05:26:54] INFO: Pushing 0 updated packages to the database...
[2022-07-24 05:27:17] INFO: Now deleting 0 removed packages: []
[2022-07-24 05:27:17] INFO: DB update done for buster/arm64 done at 2022-07-24 05:27:17.
[2022-07-24 05:27:17] INFO: Updating sources db for buster/armhf...
[2022-07-24 05:27:37] INFO: Pushing 0 updated packages to the database...
[2022-07-24 05:27:54] INFO: Now deleting 0 removed packages: []
[2022-07-24 05:27:54] INFO: DB update done for buster/armhf done at 2022-07-24 05:27:54.
[2022-07-24 05:27:54] INFO: Sources for suite buster done at 2022-07-24 05:27:54.
[2022-07-24 05:27:54] INFO: Downloading sources file for bullseye: http://deb.debian.org/debian/dists/bullseye/main/source/Sources.xz
[2022-07-24 05:27:55] INFO: Updating sources db for bullseye/amd64...
[2022-07-24 05:28:17] INFO: Pushing 0 updated packages to the database...
[2022-07-24 05:28:39] INFO: Now deleting 0 removed packages: []
[2022-07-24 05:28:39] INFO: DB update done for bullseye/amd64 done at 2022-07-24 05:28:39.
[2022-07-24 05:28:39] INFO: Updating sources db for bullseye/i386...
[2022-07-24 05:29:02] INFO: Pushing 0 updated packages to the database...
[2022-07-24 05:29:24] INFO: Now deleting 0 removed packages: []
[2022-07-24 05:29:25] INFO: DB update done for bullseye/i386 done at 2022-07-24 05:29:25.
[2022-07-24 05:29:25] INFO: Updating sources db for bullseye/arm64...
[2022-07-24 05:29:46] INFO: Pushing 0 updated packages to the database...
[2022-07-24 05:30:08] INFO: Now deleting 0 removed packages: []
[2022-07-24 05:30:08] INFO: DB update done for bullseye/arm64 done at 2022-07-24 05:30:08.
[2022-07-24 05:30:08] INFO: Updating sources db for bullseye/armhf...
[2022-07-24 05:30:31] INFO: Pushing 0 updated packages to the database...
[2022-07-24 05:30:53] INFO: Now deleting 0 removed packages: []
[2022-07-24 05:30:53] INFO: DB update done for bullseye/armhf done at 2022-07-24 05:30:53.
[2022-07-24 05:30:53] INFO: Sources for suite bullseye done at 2022-07-24 05:30:53.
[2022-07-24 05:30:53] INFO: Downloading sources file for bookworm: http://deb.debian.org/debian/dists/bookworm/main/source/Sources.xz
[2022-07-24 05:30:54] INFO: Updating sources db for bookworm/amd64...
[2022-07-24 05:31:18] INFO: Pushing 34 updated packages to the database...
[2022-07-24 05:31:18] INFO: Now inserting 2 new sources in the database: [{'name': 'cnvkit', 'version': '0.9.9-2', 'suite': 'bookworm', 'architecture': 'amd64'}, {'name': 'cwl-upgrader', 'version': '1.2.2-2', 'suite': 'bookworm', 'architecture': 'amd64'}]
[2022-07-24 05:31:42] INFO: Now deleting 6 removed packages: ['snakemake', 'nipype', 'python-prov', 'ayatana-indicator-datetime', 'heudiconv', 'python-pyrdfa']
[2022-07-24 05:31:42] INFO: Building pages for the new packages
[2022-07-24 05:31:42] INFO: Generating the pages of 2 package(s)
[2022-07-24 05:31:43] ERROR: Either /var/lib/jenkins/userContent/reproducible/debian/logs/buster/i386/cnvkit_0.9.5-3.build2.log.gz or /var/lib/jenkins/userContent/reproducible/debian/logdiffs/buster/i386/cnvkit_0.9.5-3.diff.gz is missing
[2022-07-24 05:31:43] ERROR: Either /var/lib/jenkins/userContent/reproducible/debian/logs/buster/arm64/cnvkit_0.9.5-3.build2.log.gz or /var/lib/jenkins/userContent/reproducible/debian/logdiffs/buster/arm64/cnvkit_0.9.5-3.diff.gz is missing
[2022-07-24 05:31:43] ERROR: Either /var/lib/jenkins/userContent/reproducible/debian/logs/buster/armhf/cnvkit_0.9.5-3.build2.log.gz or /var/lib/jenkins/userContent/reproducible/debian/logdiffs/buster/armhf/cnvkit_0.9.5-3.diff.gz is missing
[2022-07-24 05:31:43] ERROR: Either /var/lib/jenkins/userContent/reproducible/debian/logs/bullseye/i386/cnvkit_0.9.8-1.build2.log.gz or /var/lib/jenkins/userContent/reproducible/debian/logdiffs/bullseye/i386/cnvkit_0.9.8-1.diff.gz is missing
[2022-07-24 05:31:43] ERROR: Either /var/lib/jenkins/userContent/reproducible/debian/logs/bullseye/armhf/cnvkit_0.9.8-1.build2.log.gz or /var/lib/jenkins/userContent/reproducible/debian/logdiffs/bullseye/armhf/cnvkit_0.9.8-1.diff.gz is missing
[2022-07-24 05:31:43] ERROR: Either /var/lib/jenkins/userContent/reproducible/debian/logs/unstable/i386/cnvkit_0.9.9-2.build2.log.gz or /var/lib/jenkins/userContent/reproducible/debian/logdiffs/unstable/i386/cnvkit_0.9.9-2.diff.gz is missing
[2022-07-24 05:31:43] ERROR: Either /var/lib/jenkins/userContent/reproducible/debian/logs/unstable/armhf/cnvkit_0.9.9-2.build2.log.gz or /var/lib/jenkins/userContent/reproducible/debian/logdiffs/unstable/armhf/cnvkit_0.9.9-2.diff.gz is missing
[2022-07-24 05:31:43] INFO: DB update done for bookworm/amd64 done at 2022-07-24 05:31:43.
[2022-07-24 05:31:43] INFO: Updating sources db for bookworm/i386...
[2022-07-24 05:32:06] INFO: Pushing 34 updated packages to the database...
[2022-07-24 05:32:06] INFO: Now inserting 2 new sources in the database: [{'name': 'cnvkit', 'version': '0.9.9-2', 'suite': 'bookworm', 'architecture': 'i386'}, {'name': 'cwl-upgrader', 'version': '1.2.2-2', 'suite': 'bookworm', 'architecture': 'i386'}]
[2022-07-24 05:32:31] INFO: Now deleting 6 removed packages: ['nipype', 'snakemake', 'python-prov', 'ayatana-indicator-datetime', 'heudiconv', 'python-pyrdfa']
[2022-07-24 05:32:31] INFO: Building pages for the new packages
[2022-07-24 05:32:31] INFO: Generating the pages of 2 package(s)
[2022-07-24 05:32:31] ERROR: Either /var/lib/jenkins/userContent/reproducible/debian/logs/buster/i386/cnvkit_0.9.5-3.build2.log.gz or /var/lib/jenkins/userContent/reproducible/debian/logdiffs/buster/i386/cnvkit_0.9.5-3.diff.gz is missing
[2022-07-24 05:32:31] ERROR: Either /var/lib/jenkins/userContent/reproducible/debian/logs/buster/arm64/cnvkit_0.9.5-3.build2.log.gz or /var/lib/jenkins/userContent/reproducible/debian/logdiffs/buster/arm64/cnvkit_0.9.5-3.diff.gz is missing
[2022-07-24 05:32:31] ERROR: Either /var/lib/jenkins/userContent/reproducible/debian/logs/buster/armhf/cnvkit_0.9.5-3.build2.log.gz or /var/lib/jenkins/userContent/reproducible/debian/logdiffs/buster/armhf/cnvkit_0.9.5-3.diff.gz is missing
[2022-07-24 05:32:31] ERROR: Either /var/lib/jenkins/userContent/reproducible/debian/logs/bullseye/i386/cnvkit_0.9.8-1.build2.log.gz or /var/lib/jenkins/userContent/reproducible/debian/logdiffs/bullseye/i386/cnvkit_0.9.8-1.diff.gz is missing
[2022-07-24 05:32:31] ERROR: Either /var/lib/jenkins/userContent/reproducible/debian/logs/bullseye/armhf/cnvkit_0.9.8-1.build2.log.gz or /var/lib/jenkins/userContent/reproducible/debian/logdiffs/bullseye/armhf/cnvkit_0.9.8-1.diff.gz is missing
[2022-07-24 05:32:31] ERROR: Either /var/lib/jenkins/userContent/reproducible/debian/logs/unstable/i386/cnvkit_0.9.9-2.build2.log.gz or /var/lib/jenkins/userContent/reproducible/debian/logdiffs/unstable/i386/cnvkit_0.9.9-2.diff.gz is missing
[2022-07-24 05:32:31] ERROR: Either /var/lib/jenkins/userContent/reproducible/debian/logs/unstable/armhf/cnvkit_0.9.9-2.build2.log.gz or /var/lib/jenkins/userContent/reproducible/debian/logdiffs/unstable/armhf/cnvkit_0.9.9-2.diff.gz is missing
[2022-07-24 05:32:31] INFO: DB update done for bookworm/i386 done at 2022-07-24 05:32:31.
[2022-07-24 05:32:31] INFO: Updating sources db for bookworm/arm64...
[2022-07-24 05:32:53] INFO: Pushing 34 updated packages to the database...
[2022-07-24 05:32:53] INFO: Now inserting 2 new sources in the database: [{'name': 'cwl-upgrader', 'version': '1.2.2-2', 'suite': 'bookworm', 'architecture': 'arm64'}, {'name': 'cnvkit', 'version': '0.9.9-2', 'suite': 'bookworm', 'architecture': 'arm64'}]
[2022-07-24 05:33:20] INFO: Now deleting 6 removed packages: ['python-pyrdfa', 'nipype', 'snakemake', 'python-prov', 'ayatana-indicator-datetime', 'heudiconv']
[2022-07-24 05:33:20] INFO: Building pages for the new packages
[2022-07-24 05:33:20] INFO: Generating the pages of 2 package(s)
[2022-07-24 05:33:20] ERROR: Either /var/lib/jenkins/userContent/reproducible/debian/logs/buster/i386/cnvkit_0.9.5-3.build2.log.gz or /var/lib/jenkins/userContent/reproducible/debian/logdiffs/buster/i386/cnvkit_0.9.5-3.diff.gz is missing
[2022-07-24 05:33:20] ERROR: Either /var/lib/jenkins/userContent/reproducible/debian/logs/buster/arm64/cnvkit_0.9.5-3.build2.log.gz or /var/lib/jenkins/userContent/reproducible/debian/logdiffs/buster/arm64/cnvkit_0.9.5-3.diff.gz is missing
[2022-07-24 05:33:20] ERROR: Either /var/lib/jenkins/userContent/reproducible/debian/logs/buster/armhf/cnvkit_0.9.5-3.build2.log.gz or /var/lib/jenkins/userContent/reproducible/debian/logdiffs/buster/armhf/cnvkit_0.9.5-3.diff.gz is missing
[2022-07-24 05:33:20] ERROR: Either /var/lib/jenkins/userContent/reproducible/debian/logs/bullseye/i386/cnvkit_0.9.8-1.build2.log.gz or /var/lib/jenkins/userContent/reproducible/debian/logdiffs/bullseye/i386/cnvkit_0.9.8-1.diff.gz is missing
[2022-07-24 05:33:20] ERROR: Either /var/lib/jenkins/userContent/reproducible/debian/logs/bullseye/armhf/cnvkit_0.9.8-1.build2.log.gz or /var/lib/jenkins/userContent/reproducible/debian/logdiffs/bullseye/armhf/cnvkit_0.9.8-1.diff.gz is missing
[2022-07-24 05:33:20] ERROR: Either /var/lib/jenkins/userContent/reproducible/debian/logs/unstable/i386/cnvkit_0.9.9-2.build2.log.gz or /var/lib/jenkins/userContent/reproducible/debian/logdiffs/unstable/i386/cnvkit_0.9.9-2.diff.gz is missing
[2022-07-24 05:33:20] ERROR: Either /var/lib/jenkins/userContent/reproducible/debian/logs/unstable/armhf/cnvkit_0.9.9-2.build2.log.gz or /var/lib/jenkins/userContent/reproducible/debian/logdiffs/unstable/armhf/cnvkit_0.9.9-2.diff.gz is missing
[2022-07-24 05:33:20] INFO: DB update done for bookworm/arm64 done at 2022-07-24 05:33:20.
[2022-07-24 05:33:20] INFO: Updating sources db for bookworm/armhf...
[2022-07-24 05:33:42] INFO: Pushing 34 updated packages to the database...
[2022-07-24 05:33:42] INFO: Now inserting 2 new sources in the database: [{'name': 'cwl-upgrader', 'version': '1.2.2-2', 'suite': 'bookworm', 'architecture': 'armhf'}, {'name': 'cnvkit', 'version': '0.9.9-2', 'suite': 'bookworm', 'architecture': 'armhf'}]
[2022-07-24 05:34:09] INFO: Now deleting 6 removed packages: ['nipype', 'snakemake', 'python-prov', 'ayatana-indicator-datetime', 'heudiconv', 'python-pyrdfa']
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/sqlalchemy/engine/base.py", line 1256, in _execute_context
    self.dialect.do_executemany(
  File "/usr/lib/python3/dist-packages/sqlalchemy/dialects/postgresql/psycopg2.py", line 898, in do_executemany
    cursor.executemany(statement, parameters)
psycopg2.errors.UniqueViolation: duplicate key value violates unique constraint "removed_packages_pkey"
DETAIL:  Key (name, suite, architecture)=(ayatana-indicator-datetime, bookworm, armhf) already exists.


The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/srv/jenkins/bin/reproducible_scheduler.py", line 798, in <module>
    update_sources(suite)
  File "/srv/jenkins/bin/reproducible_scheduler.py", line 304, in update_sources
    update_sources_db(suite, arch, sources)
  File "/srv/jenkins/bin/reproducible_scheduler.py", line 425, in update_sources_db
    conn_db.execute(removed_packages_table.insert(), pkgs_to_rm)
  File "/usr/lib/python3/dist-packages/sqlalchemy/engine/base.py", line 1011, in execute
    return meth(self, multiparams, params)
  File "/usr/lib/python3/dist-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection
    return connection._execute_clauseelement(self, multiparams, params)
  File "/usr/lib/python3/dist-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement
    ret = self._execute_context(
  File "/usr/lib/python3/dist-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context
    self._handle_dbapi_exception(
  File "/usr/lib/python3/dist-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception
    util.raise_(
  File "/usr/lib/python3/dist-packages/sqlalchemy/util/compat.py", line 182, in raise_
    raise exception
  File "/usr/lib/python3/dist-packages/sqlalchemy/engine/base.py", line 1256, in _execute_context
    self.dialect.do_executemany(
  File "/usr/lib/python3/dist-packages/sqlalchemy/dialects/postgresql/psycopg2.py", line 898, in do_executemany
    cursor.executemany(statement, parameters)
sqlalchemy.exc.IntegrityError: (psycopg2.errors.UniqueViolation) duplicate key value violates unique constraint "removed_packages_pkey"
DETAIL:  Key (name, suite, architecture)=(ayatana-indicator-datetime, bookworm, armhf) already exists.

[SQL: INSERT INTO removed_packages (name, suite, architecture) VALUES (%(name)s, %(suite)s, %(architecture)s)]
[parameters: ({'name': 'nipype', 'suite': 'bookworm', 'architecture': 'armhf'}, {'name': 'snakemake', 'suite': 'bookworm', 'architecture': 'armhf'}, {'name': 'python-prov', 'suite': 'bookworm', 'architecture': 'armhf'}, {'name': 'ayatana-indicator-datetime', 'suite': 'bookworm', 'architecture': 'armhf'}, {'name': 'heudiconv', 'suite': 'bookworm', 'architecture': 'armhf'}, {'name': 'python-pyrdfa', 'suite': 'bookworm', 'architecture': 'armhf'})]
(Background on this error at: http://sqlalche.me/e/13/gkpj)
[2022-07-24 05:34:09] INFO: Finished at 2022-07-24 05:34:09.093568, took: 0:11:08.776323
Build step 'Execute shell' marked build as failure