"The AppStream system cache was updated, but some components were ignored. Refer to the verbose log for more information."

Bug #1861631 reported by Jonathan Kamens
156
This bug affects 36 people
Affects Status Importance Assigned to Milestone
appstream (Ubuntu)
Invalid
Undecided
Unassigned
gnome-software (Ubuntu)
In Progress
Undecided
Unassigned

Bug Description

`apt-get update` and the nightly `apticron --cron` job are reporting:

"The AppStream system cache was updated, but some components were ignored. Refer to the verbose log for more information."

This is pretty much meaningless to most people who have no idea what AppStream is and what "verbose log" is being referred to. I dug around and managed to discover `appstreamcli refresh-cache --force --verbose`, whose output is attached.

I don't know what the "bad" output is or how to fix it. All I know is that I hope Focal isn't going to be generating this message when it ships, because it isn't going to make sense to most people and most people won't know how to fix it and it causes annoying emails from apticron every night.

ProblemType: Bug
DistroRelease: Ubuntu 20.04
Package: appstream 0.12.10-1
ProcVersionSignature: Ubuntu 5.4.0-12.15-generic 5.4.8
Uname: Linux 5.4.0-12-generic x86_64
ApportVersion: 2.20.11-0ubuntu16
Architecture: amd64
CurrentDesktop: ubuntu:GNOME
Date: Sun Feb 2 16:01:24 2020
InstallationDate: Installed on 2019-08-16 (170 days ago)
InstallationMedia: Ubuntu 19.04 "Disco Dingo" - Release amd64 (20190416)
SourcePackage: appstream
UpgradeStatus: Upgraded to focal on 2020-01-31 (2 days ago)

Revision history for this message
Jonathan Kamens (jik) wrote :
Revision history for this message
Launchpad Janitor (janitor) wrote :

Status changed to 'Confirmed' because the bug affects multiple users.

Changed in appstream (Ubuntu):
status: New → Confirmed
Revision history for this message
Matthias Klumpp (ximion) wrote :

This error message is shown not to alert users, but rather make users report these issues to the distributor, as this particular issue means the distributor has a mistake in their metadata somewhere.
In this case it's not Ubuntu's fault directly, but rather GNOME Software injecting invalid metadata.
This is fixed upstream with commit https://gitlab.gnome.org/GNOME/gnome-software/commit/7c1620990b6361fac370b76c9828f8f77ff77a72 which should land in the next Ubuntu release naturally (but may be cherry-picked to make this issue go away even sooner).

Changed in appstream (Ubuntu):
status: Confirmed → Invalid
Changed in gnome-software (Ubuntu):
status: New → Triaged
Revision history for this message
Julian Andres Klode (juliank) wrote :

I believe this error message needs rework, people have no idea what AppStream is or where they can find the verbose log or why they even see that.

Changed in appstream (Ubuntu):
status: Invalid → Triaged
Revision history for this message
Dan Watkins (oddbloke) wrote :

Agreed, if the intent is for people to file bugs then it should be clearer.

(Alternatively, might there be a better way for us to report this on Ubuntu as a "crash", if users truly can't do anything about it?)

Revision history for this message
Matthias Klumpp (ximion) wrote :

Technically, PPAs with AppStream data or other repositories with broken data can trigger this as well.
AppStream could make a guess who is to blame for the breakage and give a more specific error, but that will require some more extensive code changes.

Mustapha Hadid (mhadidg)
Changed in gnome-software (Ubuntu):
status: Triaged → Confirmed
Revision history for this message
Naël (nathanael-naeri) wrote :

This bug is still present because the change that Matthias did was unintentionally undone the following week. So it was not shipped as it should have been, as part of gnome-software 3.35.91, which is the current version in Ubuntu. I have signaled this issue upstream.

Revision history for this message
Russ Burghorn (alienwar) wrote :

Is there a fix yet, I too have this error.

Revision history for this message
Naël (nathanael-naeri) wrote :

The fix was made upstream on Mar 24 [1], released as part of gnome-software 3.36 on Apr 3 [2], which was packaged for Ubuntu today Apr 6 [3]. I'd say it's just a matter of hours before it's available in the repository :)

[1] https://gitlab.gnome.org/GNOME/gnome-software/-/commit/bb7f58f5f88381857cd9b5dbe608e75d459873f1
[2] https://gitlab.gnome.org/GNOME/gnome-software/-/commits/gnome-3-36
[3] https://launchpadlibrarian.net/473131226/gnome-software_3.36.0-0ubuntu1_source.changes

Changed in appstream (Ubuntu):
status: Triaged → Invalid
Changed in gnome-software (Ubuntu):
status: Confirmed → Fix Committed
Revision history for this message
Naël (nathanael-naeri) wrote :

Please disregard my previous comment. Looking at the code, I realize that the maintainer packaged the upstream gnome-software "3.36.0" tag, not the "gnome-3-36" branch, which makes a lot more sense indeed.

So even though the fix is made upstream, it is NOT YET released, and therefore not packaged for Ubuntu. I think this bug is stuck until upstream releases 3.36.1.

Changed in gnome-software (Ubuntu):
status: Fix Committed → In Progress
Revision history for this message
Naël (nathanael-naeri) wrote :

With the replacement of gnome-software by snap-store in 20.04, this bug is no longer apparent. Only users who manually (re-)install gnome-software will see it.

Revision history for this message
Jonathan Kamens (jik) wrote :

>With the replacement of gnome-software by snap-store in 20.04, this bug is no longer apparent. Only users who manually (re-)install gnome-software will see it.

I am not sure what you mean. There is no "snap-store" deb on my 20.04 system, nor does "apt search snap-store" yield any results.

Furthermore, this bug was initially reported about the output of apticron showing up in cron job emails; as far as I know, apticron is independent of gnome-software.

Please clarify your meaning.

Revision history for this message
Dan Watkins (oddbloke) wrote : Re: [Bug 1861631] Re: "The AppStream system cache was updated, but some components were ignored. Refer to the verbose log for more information."

On Tue, Apr 14, 2020 at 11:19:53AM -0000, Naël wrote:
> With the replacement of gnome-software by snap-store in 20.04, this bug
> is no longer apparent. Only users who manually (re-)install gnome-
> software will see it.

I have an up-to-date focal system and I am still seeing this.

Revision history for this message
Naël (nathanael-naeri) wrote :

Hi Jonathan and Dan:

> I am not sure what you mean. There is no "snap-store" deb on my
> 20.04 system, nor does "apt search snap-store" yield any results.

It's a snap application, which you'll see in the output of the "snap list" command if it is installed. It provides the Ubuntu Software application on 20.04 and replaces the "gnome-software" deb, cf https://discourse.ubuntu.com/t/is-ubuntu-software-going-to-be-remove-for-snap-snap-store/14542 and bug 1868409.

If I understand correctly, at this point in time, your system shouldn't have the "gnome-software" deb any longer unless you've manually installed it yourself, and it should have the "snap-store" snap instead.

> Furthermore, this bug was initially reported about the output of
> apticron showing up in cron job emails; as far as I know, apticron
> is independent of gnome-software.

This is unclear to me too, but Matthias Klumpp identified the cause of this error as lying with gnome-software metadata, and he fixed it upstream in gnome-software, cf comment 3 on this bug. Perhaps apticron runs apt-get update?

> I have an up-to-date focal system and I am still seeing this.

I don't see it any more. The plot thickens. You may still have the "gnome-software" deb? If yes, and you don't mind migrating to the "snap-store" snap for you Ubuntu Software application, then you could run the update-manager (the graphical application), it will take care of the transition, see bug 1868409 for details.

Revision history for this message
Jonathan Kamens (jik) wrote :

I think Naël is correct that this problem goes away when gnome-software is replaced by snap-store. Or, at least, it appears to have gone away for me when I did that.

I'm a bit concerned about that, though, because the reason why I didn't get that update is because I pretty much exclusively use apt to do my updates, and apparently that's no longer sufficient to get all the updates needed on an Ubuntu system. I don't want to have to run the graphical update-manager to do updates. I know this is mostly off-topic here, but I don't suppose anyone knows whether there is a way to do the equivalent of what update-manager does, but from the command line?

Revision history for this message
Dan Watkins (oddbloke) wrote :

On Wed, Apr 22, 2020 at 10:24:41AM -0000, Jonathan Kamens wrote:
> I'm a bit concerned about that, though, because the reason why I didn't
> get that update is because I pretty much exclusively use apt to do my
> updates, and apparently that's no longer sufficient to get all the
> updates needed on an Ubuntu system. I don't want to have to run the
> graphical update-manager to do updates. I know this is mostly off-topic
> here, but I don't suppose anyone knows whether there is a way to do the
> equivalent of what update-manager does, but from the command line?

Snaps are updated ("refreshed" in snap terms) automatically by snapd,
independent of the other update mechanisms for the system. If you run
`snap changes` after a system (with snaps installed, of course) has been
up for a few hours, you should see entries like:

ID Status Spawn Ready Summary
263 Done yesterday at 17:53 EDT yesterday at 17:53 EDT Auto-refresh snap "gtk-common-themes"
264 Done today at 03:03 EDT today at 03:04 EDT Auto-refresh snap "lxd"

Revision history for this message
Jonathan Kamens (jik) wrote :

I understand that, but in this particular case we're talking about a transition from a deb to a snap, not a snap update. Apparently there's special logic in update-manager to handle this, and perhaps in do-release-upgrade as well, but I don't think either apt nor snap auto-updates will handle this.

Revision history for this message
Dan Watkins (oddbloke) wrote :

On Wed, Apr 22, 2020 at 02:53:48PM -0000, Jonathan Kamens wrote:
> I understand that, but in this particular case we're talking about a
> transition from a deb to a snap, not a snap update.

Aha, apologies, I misread your previous comment.

> Apparently there's special logic in update-manager to handle this, and
> perhaps in do- release-upgrade as well, but I don't think either apt
> nor snap auto- updates will handle this.

There has been special logic in update-manager for other cases before,
but this is not my area of expertise so I'll leave others to comment
further. :)

Revision history for this message
Naël (nathanael-naeri) wrote :

Hi Jonathan and Dan:

> I don't think either apt nor snap auto-updates will handle this.

I don't think so either, and nor will manual snap updates ("snap refresh" command).

My assumption is that deb-to-snap and snap-to-deb transitions are limited to development releases. It would be very surprising to have such transitions happen once a release is out, wouldn't it? But then again I don't know.

Canonical's Marcus Tomlinson, who implemented the special deb-to-snap/snap-to-deb logic in update-manager to fix bug 1868409 and bug 1872958, could tell us more, and let us know if we now need to do more than run apt to keep our systems up-to-date. But I'm not sure how to contact him or his team. This bug, or Launchpad in general, don't seem like the right place, as it's not a bug. Perhaps a mailing list (which one?), the Freenode IRC network (which channel?), Ubuntu Discourse or Ask Ubuntu are better places for this question.

Revision history for this message
Naël (nathanael-naeri) wrote :

Jonathan:

Actually that sounds like a question for the update-manager developers, so I've asked it there and subscribed you to it: https://answers.launchpad.net/ubuntu/+source/update-manager/+question/690201

Matthias:

Thanks for the downstream patch! It's awesome to see this fixed without having to wait for a new upstream version.

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.