Ubuntu

Update issues with many enabled repositories

Asked by Simone Alecci

If I enable many repositories (at least 20-30 ones), the apt-get update process become buggy: regardless the used server, some pubkey isn't found, causing annoying "Not authenticated" warning messages when downloading packages.

I hope it's an Ubuntu bug, ignored as many people prefer to use the official repository.
But it may be not, so below I've published all the typed command lines to add repositories:

----------------------------------

sudo su
echo deb http://archive.getdeb.net/ubuntu utopic-getdeb apps >> /etc/apt/sources.list && echo deb http://archive.getdeb.net/ubuntu utopic-getdeb games >> /etc/apt/sources.list && wget -q -O- http://archive.getdeb.net/getdeb-archive.key | apt-key add - && echo deb http://download.virtualbox.org/virtualbox/debian utopic contrib >> /etc/apt/sources.list && wget -q https://www.virtualbox.org/download/oracle_vbox.asc -O- | apt-key add -

sudo add-apt-repository ppa:mamarley/nvidia -y && sudo add-apt-repository ppa:webupd8team/y-ppa-manager -y && sudo add-apt-repository ppa:danielrichter2007/grub-customizer -y && sudo add-apt-repository ppa:i-nex-development-team/stable -y && sudo add-apt-repository ppa:iconnor/zoneminder -y && sudo add-apt-repository ppa:remmina-ppa-team/remmina-master -y && sudo add-apt-repository ppa:thefanclub/grive-tools -y && sudo add-apt-repository ppa:pidgin-developers/ppa -y && sudo add-apt-repository ppa:whatsapp-purple/ppa -y && sudo add-apt-repository ppa:git-core/ppa -y && sudo add-apt-repository ppa:webupd8team/nemo -y && sudo apt-add-repository ppa:teejee2008/ppa -y && sudo add-apt-repository ppa:thad-fisch/freshplayerplugin -y && sudo add-apt-repository ppa:ondrej/php5 -y && sudo add-apt-repository ppa:ubuntu-wine/ppa -y && sudo add-apt-repository ppa:libreoffice/ppa -y && sudo apt-add-repository ppa:jtaylor/keepass -y && sudo add-apt-repository ppa:bitcoin/bitcoin -y && sudo add-apt-repository ppa:plushuang-tw/uget-stable -y && sudo add-apt-repository ppa:djcj/mediainfo -y && sudo add-apt-repository ppa:clipgrab-team/ppa -y && sudo add-apt-repository ppa:yorba/ppa -y && sudo add-apt-repository ppa:stebbins/handbrake-releases -y && sudo add-apt-repository ppa:otto-kesselgulasch/gimp -y && sudo add-apt-repository ppa:otto-kesselgulasch/lightzone -y && sudo add-apt-repository ppa:gstreamer-developers/ppa -y && sudo add-apt-repository ppa:kxstudio-debian/kxstudio -y && sudo add-apt-repository ppa:freecad-maintainers/freecad-stable -y && sudo add-apt-repository ppa:freecad-maintainers/oce-release -y && sudo add-apt-repository ppa:pasgui/ppa -y && sudo add-apt-repository ppa:wxformbuilder/wxwidgets -y && sudo add-apt-repository ppa:wxformbuilder/release -y && sudo add-apt-repository ppa:glennric/dolphin-emu -y && sudo add-apt-repository ppa:wfg/0ad -y && sudo apt-add-repository ppa:wfg/0ad.dev -y && sudo add-apt-repository ppa:spring/ppa -y && sudo add-apt-repository ppa:s44/stable -y && sudo add-apt-repository ppa:christoph-egger/unknown-horizons -y && sudo add-apt-repository ppa:speed-dreams/ppa -y && sudo add-apt-repository ppa:saiarcot895/flightgear -y

Question information

Language:
English Edit question
Status:
Solved
For:
Ubuntu Edit question
Assignee:
No assignee Edit question
Solved by:
Manfred Hampl
Solved:
Last query:
Last reply:
Revision history for this message
actionparsnip (andrew-woodhead666) said : 		#1

With all those PPAs I'm surprised the OS even boots.

What is the output of:

sudo apt-get update

Revision history for this message
Manfred Hampl (m-hampl) said : 		#2

This might be bug #1263540

There is a maximum number of keyring files that gnugpg can handle.

Do you get error messages when trying to add a new ppa (and its key)?
What is the output of
ls -l /etc/apt/trusted.gpg.d/

Revision history for this message
Simone Alecci (simone98rc) said : 		#3

The "sudo apt-get update" output (in Italian language, sorry but you have to translate):

W: Errore GPG: http://archive.canonical.com utopic Release: Le seguenti firme non sono state verificate perché la chiave pubblica non è disponibile: NO_PUBKEY 40976EAF437D05B5 NO_PUBKEY 3B4FE6ACC0B21F32
W: Errore GPG: http://extras.ubuntu.com utopic Release: Le seguenti firme non sono state verificate perché la chiave pubblica non è disponibile: NO_PUBKEY 16126D3A3E5C1192
W: Errore GPG: http://archive.getdeb.net utopic-getdeb InRelease: Le seguenti firme non sono state verificate perché la chiave pubblica non è disponibile: NO_PUBKEY A8A515F046D7E7CF
W: Errore GPG: http://download.virtualbox.org utopic InRelease: Le seguenti firme non sono state verificate perché la chiave pubblica non è disponibile: NO_PUBKEY 54422A4B98AB5139
W: Errore GPG: http://archive.ubuntu.com utopic Release: Le seguenti firme non sono state verificate perché la chiave pubblica non è disponibile: NO_PUBKEY 40976EAF437D05B5 NO_PUBKEY 3B4FE6ACC0B21F32
W: Errore GPG: http://archive.ubuntu.com utopic-updates Release: Le seguenti firme non sono state verificate perché la chiave pubblica non è disponibile: NO_PUBKEY 40976EAF437D05B5 NO_PUBKEY 3B4FE6ACC0B21F32
W: Errore GPG: http://archive.ubuntu.com utopic-backports Release: Le seguenti firme non sono state verificate perché la chiave pubblica non è disponibile: NO_PUBKEY 40976EAF437D05B5 NO_PUBKEY 3B4FE6ACC0B21F32
W: Errore GPG: http://archive.ubuntu.com utopic-security Release: Le seguenti firme non sono state verificate perché la chiave pubblica non è disponibile: NO_PUBKEY 40976EAF437D05B5 NO_PUBKEY 3B4FE6ACC0B21F32
E: Impossibile analizzare il file di pacchetto /var/lib/apt/lists/partial/archive.getdeb.net_ubuntu_dists_utopic-getdeb_apps_i18n_Translation-it.decomp (1)

"ls -l /etc/apt/trusted.gpg.d/" output:

-rw-r--r-- 1 root root 1460 feb 14 20:29 bitcoin_ubuntu_bitcoin.gpg
-rw-r--r-- 1 root root 0 feb 14 20:29 bitcoin_ubuntu_bitcoin.gpg~
-rw-r--r-- 1 root root 360 feb 14 20:30 christoph-egger_ubuntu_unknown-horizons.gpg
-rw-r--r-- 1 root root 0 feb 14 20:30 christoph-egger_ubuntu_unknown-horizons.gpg~
-rw-r--r-- 1 root root 355 feb 14 20:29 clipgrab-team_ubuntu_ppa.gpg
-rw-r--r-- 1 root root 0 feb 14 20:29 clipgrab-team_ubuntu_ppa.gpg~
-rw-r--r-- 1 root root 758 feb 14 20:29 danielrichter2007_ubuntu_grub-customizer.gpg
-rw-r--r-- 1 root root 0 feb 14 20:29 danielrichter2007_ubuntu_grub-customizer.gpg~
-rw-r--r-- 1 root root 357 feb 14 20:29 djcj_ubuntu_mediainfo.gpg
-rw-r--r-- 1 root root 0 feb 14 20:29 djcj_ubuntu_mediainfo.gpg~
-rw-r--r-- 1 root root 372 feb 14 20:29 freecad-maintainers_ubuntu_freecad-stable.gpg
-rw-r--r-- 1 root root 0 feb 14 20:29 freecad-maintainers_ubuntu_freecad-stable.gpg~
-rw-r--r-- 1 root root 372 feb 14 20:29 freecad-maintainers_ubuntu_oce-release.gpg
-rw-r--r-- 1 root root 0 feb 14 20:29 freecad-maintainers_ubuntu_oce-release.gpg~
-rw-r--r-- 1 root root 373 feb 14 20:29 git-core_ubuntu_ppa.gpg
-rw-r--r-- 1 root root 0 feb 14 20:29 git-core_ubuntu_ppa.gpg~
-rw-r--r-- 1 root root 359 feb 14 20:30 glennric_ubuntu_dolphin-emu.gpg
-rw-r--r-- 1 root root 0 feb 14 20:30 glennric_ubuntu_dolphin-emu.gpg~
-rw-r--r-- 1 root root 447 feb 14 20:29 gstreamer-developers_ubuntu_ppa.gpg
-rw-r--r-- 1 root root 0 feb 14 20:29 gstreamer-developers_ubuntu_ppa.gpg~
-rw-r--r-- 1 root root 365 feb 14 20:29 iconnor_ubuntu_zoneminder.gpg
-rw-r--r-- 1 root root 0 feb 14 20:29 iconnor_ubuntu_zoneminder.gpg~
-rw-r--r-- 1 root root 375 feb 14 20:29 i-nex-development-team_ubuntu_stable.gpg
-rw-r--r-- 1 root root 0 feb 14 20:29 i-nex-development-team_ubuntu_stable.gpg~
-rw-r--r-- 1 root root 366 feb 14 20:29 jtaylor_ubuntu_keepass.gpg
-rw-r--r-- 1 root root 0 feb 14 20:29 jtaylor_ubuntu_keepass.gpg~
-rw-r--r-- 1 root root 368 feb 14 20:29 kxstudio-debian_ubuntu_kxstudio.gpg
-rw-r--r-- 1 root root 0 feb 14 20:29 kxstudio-debian_ubuntu_kxstudio.gpg~
-rw-r--r-- 1 root root 1340 feb 14 20:29 libreoffice_ubuntu_ppa.gpg
-rw-r--r-- 1 root root 0 feb 14 20:29 libreoffice_ubuntu_ppa.gpg~
-rw-r--r-- 1 root root 441 feb 14 20:29 mamarley_ubuntu_nvidia.gpg
-rw-r--r-- 1 root root 0 feb 14 20:29 mamarley_ubuntu_nvidia.gpg~
-rw-r--r-- 1 root root 364 feb 14 20:29 ondrej_ubuntu_php5.gpg
-rw-r--r-- 1 root root 0 feb 14 20:29 ondrej_ubuntu_php5.gpg~
-rw-r--r-- 1 root root 643 feb 14 20:29 otto-kesselgulasch_ubuntu_gimp.gpg
-rw-r--r-- 1 root root 0 feb 14 20:29 otto-kesselgulasch_ubuntu_gimp.gpg~
-rw-r--r-- 1 root root 643 feb 14 20:29 otto-kesselgulasch_ubuntu_lightzone.gpg
-rw-r--r-- 1 root root 0 feb 14 20:29 otto-kesselgulasch_ubuntu_lightzone.gpg~
-rw-r--r-- 1 root root 357 feb 14 20:30 pasgui_ubuntu_ppa.gpg
-rw-r--r-- 1 root root 0 feb 14 20:30 pasgui_ubuntu_ppa.gpg~
-rw-r--r-- 1 root root 620 feb 14 20:29 pidgin-developers_ubuntu_ppa.gpg
-rw-r--r-- 1 root root 0 feb 14 20:29 pidgin-developers_ubuntu_ppa.gpg~
-rw-r--r-- 1 root root 365 feb 14 20:29 plushuang-tw_ubuntu_uget-stable.gpg
-rw-r--r-- 1 root root 0 feb 14 20:29 plushuang-tw_ubuntu_uget-stable.gpg~
-rw-r--r-- 1 root root 1139 feb 14 20:29 remmina-ppa-team_ubuntu_remmina-master.gpg
-rw-r--r-- 1 root root 0 feb 14 20:29 remmina-ppa-team_ubuntu_remmina-master.gpg~
-rw-r--r-- 1 root root 373 feb 14 20:30 s44_ubuntu_stable.gpg
-rw-r--r-- 1 root root 0 feb 14 20:30 s44_ubuntu_stable.gpg~
-rw-r--r-- 1 root root 369 feb 14 20:30 saiarcot895_ubuntu_flightgear.gpg
-rw-r--r-- 1 root root 0 feb 14 20:30 saiarcot895_ubuntu_flightgear.gpg~
-rw-r--r-- 1 root root 365 feb 14 20:30 speed-dreams_ubuntu_ppa.gpg
-rw-r--r-- 1 root root 0 feb 14 20:30 speed-dreams_ubuntu_ppa.gpg~
-rw-r--r-- 1 root root 368 feb 14 20:30 spring_ubuntu_ppa.gpg
-rw-r--r-- 1 root root 0 feb 14 20:30 spring_ubuntu_ppa.gpg~
-rw-r--r-- 1 root root 362 feb 14 20:29 stebbins_ubuntu_handbrake-releases.gpg
-rw-r--r-- 1 root root 0 feb 14 20:29 stebbins_ubuntu_handbrake-releases.gpg~
-rw-r--r-- 1 root root 655 feb 14 20:29 teejee2008_ubuntu_ppa.gpg
-rw-r--r-- 1 root root 0 feb 14 20:29 teejee2008_ubuntu_ppa.gpg~
-rw-r--r-- 1 root root 374 feb 14 20:29 thad-fisch_ubuntu_freshplayerplugin.gpg
-rw-r--r-- 1 root root 0 feb 14 20:29 thad-fisch_ubuntu_freshplayerplugin.gpg~
-rw-r--r-- 1 root root 365 feb 14 20:29 thefanclub_ubuntu_grive-tools.gpg
-rw-r--r-- 1 root root 0 feb 14 20:29 thefanclub_ubuntu_grive-tools.gpg~
-rw-r--r-- 1 root root 1509 feb 14 20:29 ubuntu-wine_ubuntu_ppa.gpg
-rw-r--r-- 1 root root 0 feb 14 20:29 ubuntu-wine_ubuntu_ppa.gpg~
-rw-r--r-- 1 root root 346 feb 14 20:29 webupd8team_ubuntu_nemo.gpg
-rw-r--r-- 1 root root 0 feb 14 20:29 webupd8team_ubuntu_nemo.gpg~
-rw-r--r-- 1 root root 346 feb 14 20:29 webupd8team_ubuntu_y-ppa-manager.gpg
-rw-r--r-- 1 root root 0 feb 14 20:29 webupd8team_ubuntu_y-ppa-manager.gpg~
-rw-r--r-- 1 root root 349 feb 14 20:30 wfg_ubuntu_0ad_dev.gpg
-rw-r--r-- 1 root root 0 feb 14 20:30 wfg_ubuntu_0ad_dev.gpg~
-rw-r--r-- 1 root root 349 feb 14 20:30 wfg_ubuntu_0ad.gpg
-rw-r--r-- 1 root root 0 feb 14 20:30 wfg_ubuntu_0ad.gpg~
-rw-r--r-- 1 root root 378 feb 14 20:29 whatsapp-purple_ubuntu_ppa.gpg
-rw-r--r-- 1 root root 0 feb 14 20:29 whatsapp-purple_ubuntu_ppa.gpg~
-rw-r--r-- 1 root root 350 feb 14 20:30 wxformbuilder_ubuntu_release.gpg
-rw-r--r-- 1 root root 0 feb 14 20:30 wxformbuilder_ubuntu_release.gpg~
-rw-r--r-- 1 root root 350 feb 14 20:30 wxformbuilder_ubuntu_wxwidgets.gpg
-rw-r--r-- 1 root root 0 feb 14 20:30 wxformbuilder_ubuntu_wxwidgets.gpg~
-rw-r--r-- 1 root root 348 feb 14 20:29 yorba_ubuntu_ppa.gpg
-rw-r--r-- 1 root root 0 feb 14 20:29 yorba_ubuntu_ppa.gpg~

Revision history for this message
Simone Alecci (simone98rc) said : 		#4

A new issue about is happened and it's very interesting to known the problem cause: today the GetDeb repositories caused the last error which I reported in the "sudo apt-get update" output.

It's absolutely new, so I thought to remove the corrupted repositories: I re-did the update process, which was really completed, no more stopped by that error which is disappeared.

Now I'm trying to re-add the GedDeb repositories by typing in terminal:

echo deb http://archive.getdeb.net/ubuntu utopic-getdeb apps >> /etc/apt/sources.list && echo deb http://archive.getdeb.net/ubuntu utopic-getdeb games >> /etc/apt/sources.list && wget -q -O- http://archive.getdeb.net/getdeb-archive.key | apt-key add -

And the output is:

gpg: keyblock resource "/etc/apt/trusted.gpg.d/wxformbuilder_ubuntu_wxwidgets.gpg": resource limit
gpg: keyblock resource "/etc/apt/trusted.gpg.d/yorba_ubuntu_ppa.gpg": resource limit

So the @m-hampl theory may be true.

Revision history for this message
actionparsnip (andrew-woodhead666) said : 		#5

sudo apt-key adv --recv-key --keyserver keyserver.ubuntu.com 40976EAF437D05B5
sudo apt-key adv --recv-key --keyserver keyserver.ubuntu.com 3B4FE6ACC0B21F32
sudo apt-key adv --recv-key --keyserver keyserver.ubuntu.com 16126D3A3E5C1192
sudo apt-key adv --recv-key --keyserver keyserver.ubuntu.com A8A515F046D7E7CF
sudo apt-key adv --recv-key --keyserver keyserver.ubuntu.com 54422A4B98AB5139

Why do you add so many PPAs?

For example, what is in the Virtualbox in the Virtualbox PPA, that you need that isn't in the Virtualbox in the official repos?

Revision history for this message
Simone Alecci (simone98rc) said : 		#6

There is a bad practice (very popular) in official repo: keep old versions for old, but supported Ubuntu distributions (perhaps, the 14.04 LTS is included).
It shouldn't be a problem for me, as I'm already using latest OS releases.

But another and the most important problem is the long times to wait for updates: Virtualbox was one of the worst examples in past, now still in 4.3.18, while the latest version is 4.3.22 (we have to recognize that they improved times than in past, wow ;-) ).

Same story for a lot of other apps, even worse for games. So much 3rd-party repositories are needed by me until developers will think of moving seriously to the official repo.

Revision history for this message
Simone Alecci (simone98rc) said : 		#7

Now I've removed all the 3rd-party repositories.

The GPG errors continue to exist, so I typed:

sudo apt-key adv --keyserver keyserver.ubuntu.com --recv-keys 40976EAF437D05B5
sudo apt-key adv --keyserver keyserver.ubuntu.com --recv-keys 3B4FE6ACC0B21F32

But the problem want persist.

---

At this point, take your considerations, I'm waiting for other answers, I did enough tries.

Revision history for this message
actionparsnip (andrew-woodhead666) said : 		#8

What is in the virtualbox in the PPA, that isn't in the version in the repository? What functionality is in the new version that you require?

Revision history for this message
Simone Alecci (simone98rc) said : 		#9

Nothing, mainly bug fixing.
I'm virtualizing freshest and unstable releases (Ubuntu Next 15.04, Fedora 21a1, Windows 10 Preview etc.) and all the fixes are mainly regarding the new OSes support.

Outspread this, regardless my intentions, I want latest versions, and the only way to obtain this, is adding "a lot" of PPAs.

If many PPAs cause issues, the Ubuntu team has to solve, sadly I don't want to use Ubuntu with until they solve this problem. I hate loopholes mentality.

Ps in the bug linked by @m-hampl, the issue seems to be related to machines with more than 40 keys.
For the moment, I've not reached that amount :-) ...and the GPG errors are regarding just the official repositories.

Revision history for this message
actionparsnip (andrew-woodhead666) said : 		#10

So you didn't even test to see if what is available suits your needs and does what is needed. Sounds like you are blindly chasing version numbers rather than looking at functionality of the tried and tested packages.

Revision history for this message
Simone Alecci (simone98rc) said : 		#11

Considering that we are off-topic... packages are already tested by the resoective developers, I don't need other checks which slowdown the update times.

And I'm not discussing about the benefits of a "blind chasing version numbers", but about a potential bug which represent a problem for anyone who need, maybe for wiser reasons than mines, of many PPAs.

Please help me by basing on concrete facts, is the only way to solve the issue, or in the worst case, to know about a serious limit for GPG keys.

Revision history for this message
actionparsnip (andrew-woodhead666) said : 		#12

I suggest you go for a rolling release distribution like Debian.

Revision history for this message
Best Manfred Hampl (m-hampl) said : 		#13

I do not intend to discuss the pro's and con's of PPAs.

If I look at the contents of your /etc/apt/trusted.gpg.d/ directory, I see 40 files with .gpg extension. Plus the file /etc/apt/trusted.gpg itself makes 41. So you really seem to be over the limit.

For solving that problem the only possibility I see is to reduce the number of .gpg files in use
You can do that by
1. limiting the number of PPAs that you use to max. 39
or
2. reducing the number of .gpg files in use despite keeping the PPAs:

It might be the case that some of your .gpg files have identical contents.
E.g.
https://launchpad.net/~webupd8team/+archive/ubuntu/nemo and https://launchpad.net/~webupd8team/+archive/ubuntu/y-ppa-manager show that the signing keys and fingerprints are identical, and webupd8team_ubuntu_nemo.gpg and webupd8team_ubuntu_y-ppa-manager.gpg have same size.
It should be possible to remove one of the files, because apt should find the information in the other one.
(probably similar for wfg, wxformbuilder, freecad-maintainers and otto-kesselgulasch)
see also http://ubuntuforums.org/showthread.php?t=2195579&p=12931870#post12931870

And by the way:
It does not really help much if you post the command line that you execute in a Launchpad question document. The useful information usually is contained in the results of the execution of the commands.

Revision history for this message
Simone Alecci (simone98rc) said : 		#14

Thanks Manfred Hampl, that solved my question.