Upgrading libc6-lse breaks on systems it is in use

Removing libc6-lse before the release upgrade resolves the issue.

Since the libc6-lse went away in hirsute anyway and ubuntu-release-upgrader updates are much easier and quicker than glibc ones I propose adding a quirk to remove libc6-lse before upgrades and possibly install it again if it is avaliable.

Status changed to 'Confirmed' because the bug affects multiple users.

Hirsute does not provide separate libc6-lse packages thus Groovy -> Hirsute upgrade is OK and Focal -> Hirusute (and later) upgrade will be OK as well when those get enabled.

In Bionic the fix for LP: #1885012 introduced the libc6-lse package and caused this upgrade issue.

The fixed version for Groovy is prepared in https://bileto.ubuntu.com/#/ticket/4512 and is waiting for the riscv64 build to finish.

Hello Giovanni, or anyone else affected,

Accepted glibc into groovy-proposed. The package will build now and be available at https://launchpad.net/ubuntu/+source/glibc/2.32-0ubuntu3.2 in a few hours, and then in the -proposed repository.

Please help us by testing this new package. See https://wiki.ubuntu.com/Testing/EnableProposed for documentation on how to enable and use -proposed. Your feedback will aid us getting this update out to other Ubuntu users.

If this package fixes the bug for you, please add a comment to this bug, mentioning the version of the package you tested, what testing has been performed on the package and change the tag from verification-needed-groovy to verification-done-groovy. If it does not fix the bug for you, please add a comment stating that, and change the tag to verification-failed-groovy. In either case, without details of your testing we will not be able to proceed.

Further information regarding the verification process can be found at https://wiki.ubuntu.com/QATeam/PerformingSRUVerification . Thank you in advance for helping!

N.B. The updated package will be released to -updates after the bug(s) fixed by this package have been verified and the package has been in -proposed for a minimum of 7 days.

Hello Giovanni, or anyone else affected,

Accepted glibc into focal-proposed. The package will build now and be available at https://launchpad.net/ubuntu/+source/glibc/2.31-0ubuntu9.3 in a few hours, and then in the -proposed repository.

Please help us by testing this new package. See https://wiki.ubuntu.com/Testing/EnableProposed for documentation on how to enable and use -proposed. Your feedback will aid us getting this update out to other Ubuntu users.

If this package fixes the bug for you, please add a comment to this bug, mentioning the version of the package you tested, what testing has been performed on the package and change the tag from verification-needed-focal to verification-done-focal. If it does not fix the bug for you, please add a comment stating that, and change the tag to verification-failed-focal. In either case, without details of your testing we will not be able to proceed.

Further information regarding the verification process can be found at https://wiki.ubuntu.com/QATeam/PerformingSRUVerification . Thank you in advance for helping!

N.B. The updated package will be released to -updates after the bug(s) fixed by this package have been verified and the package has been in -proposed for a minimum of 7 days.

All autopkgtests for the newly accepted glibc (2.31-0ubuntu9.3) for focal have finished running.
The following regressions have been reported in tests triggered by the package:

libgdata/0.17.12-1 (armhf)
ruby-grib/0.4.0-4build1 (s390x)
libclang-perl/0.09-4build8 (arm64)
dealer/20190529+ds-1 (ppc64el)
t-coffee/12.00.7fb08c2-4build1 (s390x)
xpra/3.0.6+dfsg1-1build1 (amd64)
makedumpfile/1:1.6.7-1ubuntu2.1 (amd64)
libepubgen/0.1.1-1ubuntu2 (arm64)
apt/2.0.5 (armhf)
pg-qualstats/1.0.9-1 (s390x)
booth/1.0-174-gce9f821-1 (amd64)
gnustep-base/1.26.0-7 (s390x)
fclib/3.0.0+dfsg-2build1 (arm64)
asterisk/1:16.2.1~dfsg-2ubuntu1 (amd64)
golang-github-grpc-ecosystem-grpc-gateway/1.6.4-2 (ppc64el, s390x)
puma/3.12.4-1ubuntu2 (s390x)
cmark-gfm/0.29.0.gfm.0-4 (amd64)
lua-nvim/0.2.1-1-1 (armhf)
saods9/8.1+repack-1 (amd64)
ruby-gpgme/2.0.19-3build1 (s390x)
ruby-bootsnap/1.4.6-1 (arm64)
staden-io-lib/1.14.11-6 (ppc64el)
s3ql/3.3.2+dfsg-1ubuntu1 (armhf)
mercurial/5.3.1-1ubuntu1 (amd64)
libterm-readline-gnu-perl/1.36-2build1 (ppc64el)
casper/1.445.1 (amd64)
datefudge/1.23ubuntu1 (armhf, ppc64el)
source-extractor/2.25.0+ds-2 (s390x)
smcroute/2.4.2-4 (arm64)
disulfinder/1.2.11-8build1 (arm64)
autofs/5.1.6-2ubuntu0.1 (ppc64el)
debconf-kde/1.0.3-3 (ppc64el)
libfastahack/1.0.0+dfsg-5build1 (ppc64el)
gemma/0.98.1+dfsg-1 (arm64)
missidentify/1.0-10 (ppc64el)
r-cran-systemfonts/0.1.1-1build1 (s390x)
bcalm/2.2.1-2build1 (ppc64el)
ipgrab/0.9.10-4 (ppc64el)
ruby-libxml/3.1.0-2 (s390x)
r-bioc-delayedarray/0.12.2+dfsg-1 (armhf)
netplan.io/0.101-0ubuntu3~20.04.2 (arm64)
6tunnel/1:0.13-1 (armhf)
taptempo/1.4.4-1 (s390x, armhf)

Please visit the excuses page listed below and investigate the failures, proceeding afterwards as per the StableReleaseUpdates policy regarding autopkgtest regressions [1].

https://people.canonical.com/~ubuntu-archive/proposed-migration/focal/update_excuses.html#glibc

[1] https://wiki.ubuntu.com/StableReleaseUpdates#Autopkgtest_Regressions

Thank you!

All autopkgtests for the newly accepted glibc (2.32-0ubuntu3.2) for groovy have finished running.
The following regressions have been reported in tests triggered by the package:

cyrus-imapd/3.2.3-2ubuntu1 (armhf)
pyqt5/5.15.0+dfsg-1 (s390x)
libsass/3.6.4-3 (s390x)
network-manager/1.26.2-1ubuntu1 (arm64)
reprotest/0.7.15 (s390x)
flatpak/1.8.2-1ubuntu0.1 (arm64)
puma/3.12.4-1ubuntu2 (arm64, s390x)
libtext-charwidth-perl/0.04-10 (ppc64el)
systemd/246.6-1ubuntu1.3 (arm64)
taptempo/1.4.5-1 (arm64)
uftrace/0.9.3-1ubuntu1 (arm64)
libgdata/0.17.12-1 (armhf)
cysignals/1.10.2+ds-4 (amd64)
hyphy/2.5.1+dfsg-3build1 (amd64)
glibc/2.32-0ubuntu3.2 (amd64)
libdate-simple-perl/3.0300-3 (arm64)
netplan.io/0.101-0ubuntu3~20.10.1 (amd64)
libastro-fits-cfitsio-perl/1.14-1 (ppc64el)
fwlogwatch/1.4-2 (arm64)
pandas/1.0.5+dfsg-3 (ppc64el, armhf, s390x, amd64, arm64)
rhonabwy/0.9.12-2build1 (s390x)
jailkit/2.21-2 (ppc64el)
openjdk-lts/11.0.10+9-0ubuntu1~20.10 (s390x)
dbus/1.12.20-1ubuntu1 (arm64)
pymca/5.5.5+dfsg-2build2 (arm64)
euslisp/9.27+dfsg-6 (armhf, amd64)
libflame/5.2.0-2 (amd64)
samtools/1.10-4 (arm64)
syncthing/1.10.0~ds1-1 (amd64, s390x)
endlessh/1.1-4 (armhf)
r-cran-amore/0.2-16-1build1 (ppc64el)
crrcsim/0.9.13-3.2build1 (ppc64el)
samplv1/0.9.17-1 (ppc64el)
hugo/0.74.3-1 (armhf)
libcsfml/2.5-1build1 (ppc64el)
firefox/87.0+build3-0ubuntu0.20.10.1 (armhf)
etcd/3.2.26+dfsg-8 (amd64)
libnxml/0.18.3-8 (s390x)
google-osconfig-agent/20210219.00-0ubuntu1~20.10.0 (armhf)
combblas/1.6.2-5build1 (arm64)
libbio-db-hts-perl/3.01-3 (amd64)
libterm-readkey-perl/2.38-1build1 (s390x)
ruby2.7/2.7.1-3ubuntu1.2 (armhf)
hkl/5.0.0.2620-1build1 (ppc64el)
liblinux-inotify2-perl/1:2.2-2 (ppc64el)
datefudge/1.24 (ppc64el)
libpgplot-perl/1:2.24-1build1 (s390x)
healpy/1.14.0-1 (arm64)
udisks2/2.9.1-2ubuntu1 (amd64)
kopanocore/8.7.0-7ubuntu4 (arm64)
gyoto/1.4.4-3build1 (s390x)
cpdb-libs/1.2.0-0ubuntu8 (armhf)
ruby-concurrent/1.1.6+dfsg-3 (amd64)
postgis/3.0.2+dfsg-2ubuntu2 (armhf)

Please visit the excuses page listed below and investigate the failures, proceeding afterwards as per the StableReleaseUpdates policy regarding autopkgtest regressions [1].

https://people.canonical.com/~ubuntu-archive/proposed-migration/groovy/update_excuses.html#glibc

[1] https://wiki.ubuntu.com/StableReleaseUpdates#Autopkgtest_Regressions

Thank you!

Verified glibc 2.31-0ubuntu9.3 on Focal.

root@ff-lp1912652:~# gcc -O2 -o a.out a.c -lpthread -DITER=1000 -DTHREADS=64
root@ff-lp1912652:~# time ./a.out
thread 0: min=128, max=390014464, average=15175.931641, mutexes_locked=224170, flips=12
...
thread 63: min=128, max=212314560, average=31851.539062, mutexes_locked=105648, flips=1
server: min=128, max=249241888, average=581391.875000, mutexes_locked=6158, flips=1000

real 0m0.938s
user 0m7.363s
sys 0m0.064s
root@ff-lp1912652:~# apt install libc6-lse
Reading package lists... Done
Building dependency tree
Reading state information... Done
The following NEW packages will be installed:
  libc6-lse
0 upgraded, 1 newly installed, 0 to remove and 0 not upgraded.
Need to get 1035 kB of archives.
After this operation, 3244 kB of additional disk space will be used.
Get:1 http://ports.ubuntu.com/ubuntu-ports focal-updates/main arm64 libc6-lse arm64 2.31-0ubuntu9.2 [1035 kB]
Fetched 1035 kB in 1s (1393 kB/s)
Selecting previously unselected package libc6-lse:arm64.
(Reading database ... 35769 files and directories currently installed.)
Preparing to unpack .../libc6-lse_2.31-0ubuntu9.2_arm64.deb ...
Unpacking libc6-lse:arm64 (2.31-0ubuntu9.2) ...
Setting up libc6-lse:arm64 (2.31-0ubuntu9.2) ...
Processing triggers for libc-bin (2.31-0ubuntu9.2) ...
root@ff-lp1912652:~# reboot

Session terminated, killing shell... ...killed.
ubuntu@ip-172-31-20-158:~$ lxc shell ff-lp1912652
root@ff-lp1912652:~# time ./a.out
thread 0: min=128, max=1119296, average=20925.992188, mutexes_locked=1371, flips=36
...thread 61: min=128, max=15716704, average=295146.343750, mutexes_locked=96, flips=0
thread 62: min=1000000, max=12458848, average=12458848.000000, mutexes_locked=1, flips=0
thread 63: min=128, max=9601760, average=27332.921875, mutexes_locked=1255, flips=9
server: min=128, max=5040224, average=19802.298828, mutexes_locked=1437, flips=1000

real 0m0.014s
user 0m0.023s
sys 0m0.059s
root@ff-lp1912652:~# apt install libc-bin libc-dev-bin libc6 libc6-dev locales
Reading package lists... Done
Building dependency tree
Reading state information... Done
Suggested packages:
  glibc-doc
The following packages will be REMOVED:
  libc6-lse
The following packages will be upgraded:
  libc-bin libc-dev-bin libc6 libc6-dev locales
5 upgraded, 0 newly installed, 1 to remove and 12 not upgraded.
Need to get 8770 kB of archives.
After this operation, 3159 kB disk space will be freed.
Do you want to continue? [Y/n]
Get:1 http://ports.ubuntu.com/ubuntu-ports focal-proposed/main arm64 libc6-dev arm64 2.31-0ubuntu9.3 [2068 kB]
Get:2 http://ports.ubuntu.com/ubuntu-ports focal-proposed/main arm64 libc-dev-bin arm64 2.31-0ubuntu9.3 [64.2 kB]
Get:3 http://ports.ubuntu.com/ubuntu-ports focal-proposed/main arm64 libc6 arm64 2.31-0ubuntu9.3 [2270 kB]
Get:4 http://ports.ubuntu.com/ubuntu-ports focal-proposed/main arm64 locales all 2.31-0ubuntu9.3 [3862 kB]
Get:5 http://ports.ubuntu.com/ubuntu-ports focal-proposed/main arm64 libc-bin arm64 2.31-0ubuntu9.3 [506 kB]
Fetched 8770 kB in 1s (7065 kB/s)
Preconfiguring packages ...
(Reading database ... 35813 files and directories currently installed.)
Removing libc6-lse:arm64 (2.31-0ub...

This bug was fixed in the package glibc - 2.31-0ubuntu9.3

---------------
glibc (2.31-0ubuntu9.3) focal; urgency=medium

  [ Aurelien Jarno ]
  * debian/patches/any/git-surplus-tls-accounting.diff: backport TLS surplus
    accounting from upstream. (Closes: #964141) (LP: #1914044)

  [ Balint Reczey ]
  * Update debian/patches/ubuntu/local-disable-ld_audit.diff
  * Prevent rare deadlock in pthread_cond_signal (LP: #1899800)
  * Cherry-pick upstream patch to fix building with -moutline-atomics
  * Make libc6 provide libc6-lse on arm64.
    Libc6 is now compiled with -moutline-atomics thus the separate binary
    package is dropped. (LP: #1912652)
  * debian/control: Libc6 should Conflict and Replace libc6-lse

 -- Balint Reczey <email address hidden> Mon, 29 Mar 2021 22:11:32 +0200

The verification of the Stable Release Update for glibc has completed successfully and the package is now being released to -updates. Subsequently, the Ubuntu Stable Release Updates Team is being unsubscribed and will not receive messages about this bug report. In the event that you encounter a regression using the package from -updates please report a new bug using ubuntu-bug and tag the bug report regression-update so we can easily find any regressions.

With releasing the fix for Focal (20.04) the release upgrades from Bionic (18.04) are also fixed.

Upgrades to a newer libc6-lse version in Bionic would still crash, but there is no newer official libc6-lse package for Bionic.

The fixed version has been moved back to focal-proposed due to regressions caused by LP: #1914044.

Status changed to 'Confirmed' because the bug affects multiple users.

I've copied 2.31-0ubuntu9.3 to https://launchpad.net/~ci-train-ppa-service/+archive/ubuntu/4547 until the new update can be released including this fix.

With https://bugs.launchpad.net/ubuntu/+source/glibc/+bug/1912652/comments/20 I can now upgrade to groovy and hirsute in arm64, Thanks!

Hello Giovanni, or anyone else affected,

Accepted glibc into focal-proposed. The package will build now and be available at https://launchpad.net/ubuntu/+source/glibc/2.31-0ubuntu9.8 in a few hours, and then in the -proposed repository.

Please help us by testing this new package. See https://wiki.ubuntu.com/Testing/EnableProposed for documentation on how to enable and use -proposed. Your feedback will aid us getting this update out to other Ubuntu users.

If this package fixes the bug for you, please add a comment to this bug, mentioning the version of the package you tested, what testing has been performed on the package and change the tag from verification-needed-focal to verification-done-focal. If it does not fix the bug for you, please add a comment stating that, and change the tag to verification-failed-focal. In either case, without details of your testing we will not be able to proceed.

Further information regarding the verification process can be found at https://wiki.ubuntu.com/QATeam/PerformingSRUVerification . Thank you in advance for helping!

N.B. The updated package will be released to -updates after the bug(s) fixed by this package have been verified and the package has been in -proposed for a minimum of 7 days.

All autopkgtests for the newly accepted glibc (2.31-0ubuntu9.8) for focal have finished running.
The following regressions have been reported in tests triggered by the package:

ruby-stackprof/0.2.15-2 (arm64)
sphinxbase/0.8+5prealpha+1-8 (armhf)
r-cran-ps/1.3.2-2 (s390x)
linux-hwe-5.13/5.13.0-37.42~20.04.1 (armhf)
mercurial/5.3.1-1ubuntu1 (armhf, ppc64el)
linux-hwe-5.11/5.11.0-61.61 (armhf)
mbedtls/2.16.4-1ubuntu2 (s390x)
libreoffice/1:6.4.7-0ubuntu0.20.04.4 (armhf)
ruby-ferret/0.11.8.7-2 (amd64)
cross-toolchain-base/43ubuntu3.1 (ppc64el)

Please visit the excuses page listed below and investigate the failures, proceeding afterwards as per the StableReleaseUpdates policy regarding autopkgtest regressions [1].

https://people.canonical.com/~ubuntu-archive/proposed-migration/focal/update_excuses.html#glibc

[1] https://wiki.ubuntu.com/StableReleaseUpdates#Autopkgtest_Regressions

Thank you!

Hello Giovanni, or anyone else affected,

Accepted glibc into focal-proposed. The package will build now and be available at https://launchpad.net/ubuntu/+source/glibc/2.31-0ubuntu9.9 in a few hours, and then in the -proposed repository.

Please help us by testing this new package. See https://wiki.ubuntu.com/Testing/EnableProposed for documentation on how to enable and use -proposed. Your feedback will aid us getting this update out to other Ubuntu users.

If this package fixes the bug for you, please add a comment to this bug, mentioning the version of the package you tested, what testing has been performed on the package and change the tag from verification-needed-focal to verification-done-focal. If it does not fix the bug for you, please add a comment stating that, and change the tag to verification-failed-focal. In either case, without details of your testing we will not be able to proceed.

Further information regarding the verification process can be found at https://wiki.ubuntu.com/QATeam/PerformingSRUVerification . Thank you in advance for helping!

N.B. The updated package will be released to -updates after the bug(s) fixed by this package have been verified and the package has been in -proposed for a minimum of 7 days.

All autopkgtests for the newly accepted glibc (2.31-0ubuntu9.9) for focal have finished running.
The following regressions have been reported in tests triggered by the package:

hilive/2.0a-3build2 (arm64)
tomb/2.7+dfsg2-1 (arm64)
linux-hwe-5.13/5.13.0-40.45~20.04.1 (armhf)
bali-phy/3.4.1+dfsg-2build1 (s390x, arm64)
smalt/0.7.6-9 (ppc64el)
mariadb-10.3/1:10.3.34-0ubuntu0.20.04.1 (armhf)
feersum/1.407-2 (s390x)
kopanocore/8.7.0-7ubuntu1 (amd64)
r-cran-ps/1.3.2-2 (s390x, ppc64el)
libreoffice/1:6.4.7-0ubuntu0.20.04.4 (amd64)
imagemagick/8:6.9.10.23+dfsg-2.1ubuntu11.4 (armhf)
ruby-stackprof/0.2.15-2 (amd64)
gnome-photos/3.34.1-1 (ppc64el)
linux-azure-5.11/5.11.0-1029.32~20.04.2 (amd64)
linux-intel-5.13/5.13.0-1010.10 (amd64)
php-luasandbox/3.0.3-2build2 (armhf, arm64)
mbedtls/2.16.4-1ubuntu2 (amd64, ppc64el)
cross-toolchain-base/43ubuntu3.1 (ppc64el)
rtags/2.37-1 (amd64)
gvfs/1.44.1-1ubuntu1 (arm64, ppc64el)
linux-oem-5.14/5.14.0-1033.36 (amd64)
linux-azure-cvm/5.4.0-1076.79+cvm1 (amd64)
mercurial/5.3.1-1ubuntu1 (armhf)
r-cran-satellite/1.0.2-1build1 (armhf)
s3ql/3.3.2+dfsg-1ubuntu1 (armhf)
snapd/2.54.3+20.04.1ubuntu0.2 (s390x, arm64, amd64, ppc64el)
sphinxbase/0.8+5prealpha+1-8 (armhf)
gemma/0.98.1+dfsg-1 (armhf)

Please visit the excuses page listed below and investigate the failures, proceeding afterwards as per the StableReleaseUpdates policy regarding autopkgtest regressions [1].

https://people.canonical.com/~ubuntu-archive/proposed-migration/focal/update_excuses.html#glibc

[1] https://wiki.ubuntu.com/StableReleaseUpdates#Autopkgtest_Regressions

Thank you!

I verified that arm64 systems with and without libc6-lse installed upgrade to the new version of glibc in proposed smoothly.

This bug was fixed in the package glibc - 2.31-0ubuntu9.9

---------------
glibc (2.31-0ubuntu9.9) focal; urgency=medium

  * Disable testsuite on riscv64. It is failing maths tests intermittently in
    ways that cannot be a glibc regression and is disabled in later series
    anyway.

glibc (2.31-0ubuntu9.8) focal; urgency=medium

  * Update for 20.04. (LP: #1951033)

  [ Balint Reczey ]
  * Cherry-pick upstream patch to fix building with -moutline-atomics
  * Prevent rare deadlock in pthread_cond_signal (LP: #1899800)

  [ Matthias Klose ]
  * Revert: Use DH_COMPAT=8 for dh_strip to fix debug sections for valgrind.
    Enables debugging ld.so related issues. (LP: #1918035)
  * Don't strip ld.so on armhf. (LP: #1927192)

  [ Gunnar Hjalmarsson ]
  * d/local/usr_sbin/update-locale: improve sanity checks. (LP: #1892825)

  [ Heitor Alves de Siqueira ]
  * d/p/u/git-lp1928508-reversing-calculation-of-__x86_shared_non_temporal.patch:
    - Fix memcpy() performance regression on x86 AMD systems (LP: #1928508)

  [ Aurelien Jarno ]
  * debian/debhelper.in/libc.preinst: drop the check for kernel release
    > 255 now that glibc and preinstall script are fixed. (LP: #1962225)

  [ Michael Hudson-Doyle ]
  * libc6 on arm64 is now built with -moutline-atomics so libc6-lse can now be
    an empty package that is safe to remove. (LP: #1912652)
  * d/patches/u/aarch64-memcpy-improvements.patch: Backport memcpy
    improvements. (LP: #1951032)
  * Add test-float64x-yn to xfails on riscv64.

 -- Michael Hudson-Doyle <email address hidden> Thu, 07 Apr 2022 13:24:41 +1200