updates stuck on ubuntu-advantage-tools

Asked by MB-DeX

I have a VM with Ubuntu 21.10.
During one upgrade process of the ubuntu-advantage-tools_27.5~21.10.1_amd64.deb package I mistakenly closed the windows instead of minimizing the window. I tried to re-run the upgrade process but it now stuck and won't go further.
Even in the console when I run "sudo apt upgrade" first time it gives me an error and requires to run "sudo dpkg --configure -a".
Even after that, if I run again upgrade it freezes with progress 0%.
In syslog if I monitor this it shows the following when its stuck:

Jan 21 09:42:57 dex-VirtualBox update-notifier.desktop[14963]: /var/lib/dpkg/lock:
Jan 21 09:42:59 dex-VirtualBox systemd[1]: Starting ZSYS daemon service...
Jan 21 09:43:00 dex-VirtualBox systemd[1]: Started ZSYS daemon service.
Jan 21 09:43:01 dex-VirtualBox kernel: [55878.338882] VERIFY(0 == sa_handle_get_from_db(zfsvfs->z_os, db, zp, SA_HDL_SHARED, &zp->z_sa_hdl)) failed
Jan 21 09:43:01 dex-VirtualBox kernel: [55878.338885] PANIC at zfs_znode.c:339:zfs_znode_sa_init()
Jan 21 09:43:01 dex-VirtualBox kernel: [55878.338886] Showing stack for process 15394
Jan 21 09:43:01 dex-VirtualBox kernel: [55878.338887] CPU: 0 PID: 15394 Comm: dpkg Tainted: P O 5.13.0-25-generic #26-Ubuntu
Jan 21 09:43:01 dex-VirtualBox kernel: [55878.338889] Hardware name: innotek GmbH VirtualBox/VirtualBox, BIOS VirtualBox 12/01/2006
Jan 21 09:43:01 dex-VirtualBox kernel: [55878.338890] Call Trace:
Jan 21 09:43:01 dex-VirtualBox kernel: [55878.338892] show_stack+0x52/0x58
Jan 21 09:43:01 dex-VirtualBox kernel: [55878.338896] dump_stack+0x7d/0x9c
Jan 21 09:43:01 dex-VirtualBox kernel: [55878.338898] spl_dumpstack+0x29/0x2b [spl]
Jan 21 09:43:01 dex-VirtualBox kernel: [55878.338906] spl_panic+0xd4/0xfc [spl]
Jan 21 09:43:01 dex-VirtualBox kernel: [55878.338912] ? slab_pre_alloc_hook.constprop.0+0x96/0xe0
Jan 21 09:43:01 dex-VirtualBox kernel: [55878.338916] ? queued_spin_unlock+0x9/0x10 [zfs]
Jan 21 09:43:01 dex-VirtualBox kernel: [55878.338982] ? do_raw_spin_unlock+0x9/0x10 [zfs]
Jan 21 09:43:01 dex-VirtualBox kernel: [55878.339032] ? __raw_spin_unlock+0x9/0x10 [zfs]
Jan 21 09:43:01 dex-VirtualBox kernel: [55878.339082] ? dmu_buf_replace_user+0x65/0x80 [zfs]
Jan 21 09:43:01 dex-VirtualBox kernel: [55878.339133] ? dmu_buf_set_user+0x13/0x20 [zfs]
Jan 21 09:43:01 dex-VirtualBox kernel: [55878.339184] ? dmu_buf_set_user_ie+0x15/0x20 [zfs]
Jan 21 09:43:01 dex-VirtualBox kernel: [55878.339234] zfs_znode_sa_init+0xd9/0xe0 [zfs]
Jan 21 09:43:01 dex-VirtualBox kernel: [55878.339314] zfs_znode_alloc+0x101/0x580 [zfs]
Jan 21 09:43:01 dex-VirtualBox kernel: [55878.339393] ? dmu_buf_unlock_parent+0x5d/0x90 [zfs]
Jan 21 09:43:01 dex-VirtualBox kernel: [55878.339445] ? do_raw_spin_unlock+0x9/0x10 [zfs]
Jan 21 09:43:01 dex-VirtualBox kernel: [55878.339495] ? dbuf_read_impl.constprop.0+0x30a/0x3e0 [zfs]
Jan 21 09:43:01 dex-VirtualBox kernel: [55878.339578] ? dbuf_rele_and_unlock+0x13b/0x520 [zfs]
Jan 21 09:43:01 dex-VirtualBox kernel: [55878.339644] ? __cond_resched+0x1a/0x50
Jan 21 09:43:01 dex-VirtualBox kernel: [55878.339646] ? slab_pre_alloc_hook.constprop.0+0x96/0xe0
Jan 21 09:43:01 dex-VirtualBox kernel: [55878.339648] ? queued_spin_unlock+0x9/0x10 [zfs]
Jan 21 09:43:01 dex-VirtualBox kernel: [55878.339695] ? do_raw_spin_unlock+0x9/0x10 [zfs]
Jan 21 09:43:01 dex-VirtualBox kernel: [55878.339742] ? __cond_resched+0x1a/0x50
Jan 21 09:43:01 dex-VirtualBox kernel: [55878.339744] ? down_read+0x13/0x90
Jan 21 09:43:01 dex-VirtualBox kernel: [55878.339745] ? dbuf_read+0x1c9/0x560 [zfs]
Jan 21 09:43:01 dex-VirtualBox kernel: [55878.339796] ? queued_spin_unlock+0x9/0x10 [zfs]
Jan 21 09:43:01 dex-VirtualBox kernel: [55878.339852] ? do_raw_spin_unlock+0x9/0x10 [zfs]
Jan 21 09:43:01 dex-VirtualBox kernel: [55878.339909] ? __raw_spin_unlock+0x9/0x10 [zfs]
Jan 21 09:43:01 dex-VirtualBox kernel: [55878.339965] ? dnode_rele_and_unlock+0x69/0xe0 [zfs]
Jan 21 09:43:01 dex-VirtualBox kernel: [55878.340021] ? dmu_object_info_from_dnode+0x8e/0xa0 [zfs]
Jan 21 09:43:01 dex-VirtualBox kernel: [55878.340074] zfs_zget+0x235/0x280 [zfs]
Jan 21 09:43:01 dex-VirtualBox kernel: [55878.340152] zfs_dirent_lock+0x420/0x560 [zfs]
Jan 21 09:43:01 dex-VirtualBox kernel: [55878.340231] zfs_dirlook+0x91/0x2d0 [zfs]
Jan 21 09:43:01 dex-VirtualBox kernel: [55878.340309] zfs_lookup+0x257/0x400 [zfs]
Jan 21 09:43:01 dex-VirtualBox kernel: [55878.340387] zpl_lookup+0xcb/0x220 [zfs]
Jan 21 09:43:01 dex-VirtualBox kernel: [55878.340464] __lookup_slow+0x84/0x150
Jan 21 09:43:01 dex-VirtualBox kernel: [55878.340465] walk_component+0x141/0x1b0
Jan 21 09:43:01 dex-VirtualBox kernel: [55878.340466] ? path_init+0x2c1/0x3f0
Jan 21 09:43:01 dex-VirtualBox kernel: [55878.340468] path_lookupat+0x6e/0x1c0
Jan 21 09:43:01 dex-VirtualBox kernel: [55878.340469] filename_lookup+0xbf/0x1c0
Jan 21 09:43:01 dex-VirtualBox kernel: [55878.340470] ? __check_object_size.part.0+0x128/0x150
Jan 21 09:43:01 dex-VirtualBox kernel: [55878.340472] ? __check_object_size+0x1c/0x20
Jan 21 09:43:01 dex-VirtualBox kernel: [55878.340473] ? strncpy_from_user+0x44/0x140
Jan 21 09:43:01 dex-VirtualBox kernel: [55878.340476] user_path_at_empty+0x59/0x90
Jan 21 09:43:01 dex-VirtualBox kernel: [55878.340477] vfs_statx+0x7a/0x120
Jan 21 09:43:01 dex-VirtualBox kernel: [55878.340479] ? security_file_free+0x54/0x60
Jan 21 09:43:01 dex-VirtualBox kernel: [55878.340481] __do_sys_newfstatat+0x36/0x70
Jan 21 09:43:01 dex-VirtualBox kernel: [55878.340483] ? call_rcu+0xe/0x10
Jan 21 09:43:01 dex-VirtualBox kernel: [55878.340485] ? __fput+0x123/0x250
Jan 21 09:43:01 dex-VirtualBox kernel: [55878.340486] ? __cond_resched+0x1a/0x50
Jan 21 09:43:01 dex-VirtualBox kernel: [55878.340488] __x64_sys_newfstatat+0x1c/0x20
Jan 21 09:43:01 dex-VirtualBox kernel: [55878.340489] do_syscall_64+0x61/0xb0
Jan 21 09:43:01 dex-VirtualBox kernel: [55878.340491] ? syscall_exit_to_user_mode+0x27/0x50
Jan 21 09:43:01 dex-VirtualBox kernel: [55878.340493] ? __x64_sys_close+0x11/0x40
Jan 21 09:43:01 dex-VirtualBox kernel: [55878.340523] ? do_syscall_64+0x6e/0xb0
Jan 21 09:43:01 dex-VirtualBox kernel: [55878.340525] ? exit_to_user_mode_prepare+0x37/0xb0
Jan 21 09:43:01 dex-VirtualBox kernel: [55878.340527] ? syscall_exit_to_user_mode+0x27/0x50
Jan 21 09:43:01 dex-VirtualBox kernel: [55878.340528] ? __x64_sys_newfstatat+0x1c/0x20
Jan 21 09:43:01 dex-VirtualBox kernel: [55878.340530] ? do_syscall_64+0x6e/0xb0
Jan 21 09:43:01 dex-VirtualBox kernel: [55878.340531] ? do_syscall_64+0x6e/0xb0
Jan 21 09:43:01 dex-VirtualBox kernel: [55878.340532] entry_SYSCALL_64_after_hwframe+0x44/0xae
Jan 21 09:43:01 dex-VirtualBox kernel: [55878.340534] RIP: 0033:0x7f59c5704e7e
Jan 21 09:43:01 dex-VirtualBox kernel: [55878.340535] Code: 48 89 f2 b9 00 01 00 00 48 89 fe bf 9c ff ff ff e9 07 00 00 00 0f 1f 80 00 00 00 00 f3 0f 1e fa 41 89 ca b8 06 01 00 00 0f 05 <3d> 00 f0 ff ff 77 0b 31 c0 c3 0f 1f 84 00 00 00 00 00 48 8b 15 79
Jan 21 09:43:01 dex-VirtualBox kernel: [55878.340537] RSP: 002b:00007ffd11afa0b8 EFLAGS: 00000202 ORIG_RAX: 0000000000000106
Jan 21 09:43:01 dex-VirtualBox kernel: [55878.340538] RAX: ffffffffffffffda RBX: 0000000000000000 RCX: 00007f59c5704e7e
Jan 21 09:43:01 dex-VirtualBox kernel: [55878.340539] RDX: 00007ffd11afa210 RSI: 000055fa172d6820 RDI: 00000000ffffff9c
Jan 21 09:43:01 dex-VirtualBox kernel: [55878.340540] RBP: 00007ffd11afa5e0 R08: 000055fa186340d0 R09: 000000000000009e
Jan 21 09:43:01 dex-VirtualBox kernel: [55878.340541] R10: 0000000000000100 R11: 0000000000000202 R12: 000055fa1476bb00
Jan 21 09:43:01 dex-VirtualBox kernel: [55878.340542] R13: 000055fa17b893b0 R14: 00007ffd11afa210 R15: 000055fa16740a70

If anyone has a clue how to fix this please let me know.
I now can't even shutdown the VM properly.
To do this I have to pull the plug on it.

Kind Regards,
MB

Question information

Language:
English Edit question
Status:
Answered
For:
Ubuntu Edit question
Assignee:
No assignee Edit question
Last query:
Last reply:
Revision history for this message
Manfred Hampl (m-hampl) said :
#1

This seems to be the same as Bug #1906476

Which version of the zfs programs and the kernel do you have installed?

Revision history for this message
Bernard Stafford (bernard010) said (last edit ):
#2

My self I would purge the the package and reinstall it.
That happens if the upgrade is interrupted.
First purge the package then run an update.
Then reinstall Ubuntu Advantage tools and configure it.
https://packages.ubuntu.com/impish/ubuntu-advantage-tools

Revision history for this message
MB-DeX (gldexter) said :
#3

Hi @Manfred

Here is my ZFS programs version:
dpkg --list | grep zfs
libzfs4linux 2.0.6-1ubuntu2 amd64 OpenZFS filesystem library for Linux
zfs-initramfs 2.0.6-1ubuntu2 amd64 OpenZFS root filesystem capabilities for Linux - initramfs
zfs-zed 2.0.6-1ubuntu2 amd64 OpenZFS Event Daemon
zfsutils-linux 2.0.6-1ubuntu2 amd64 command-line tools to manage OpenZFS filesystems

Hi @Bernard

I tried to purge the package but seems to be to interconnected and can't do it.
Current version is: 27.4.2~21.10.1 and the one I should be updating to is 27.5~21.10.1

Any other ideas guys ?

Revision history for this message
Manfred Hampl (m-hampl) said :
#4

The only idea that I have is Bug #1906476

My assumption is that due to that bug some of your files are broken, and whenever you try accessing one of them the system stalls.
Your problem has nothing to do with ubuntu-advantage-tools, but with the zfs programs.

You should read the bug report and the linked references.

Revision history for this message
MB-DeX (gldexter) said :
#5

I think my system is totally FKD .... because I can't run any upgrade on the system as it's first trying to do the package that is PANICing the system...
I may have to save what I have on that system and reinstall it.
To bad there isn't a way to repair the system without having to reinstall everything.

Revision history for this message
Manfred Hampl (m-hampl) said :
#6

What you could try is booting from an Ubuntu installer in the "Try Ubuntu without installing" mode and running a file system check on your hard disk partitions.

Revision history for this message
krishaybaxter (krishabaxter) said :
#7

Your problem has nothing to do with ubuntu-advantage-tools, but with the zfs programs.

Revision history for this message
krishaybaxter (krishabaxter) said :
#8

Your problem has nothing to do with ubuntu-advantage-tools, but with the zfs programs.

Can you help with this problem?

Provide an answer of your own, or ask MB-DeX for more information if necessary.

To post a message you must log in.