🚀 YunoHost 12.0 (Bookworm) release / Sortie de YunoHost 12.0 (Bookworm)

Hi all! Since upgrading to 12.x, I noticed that the server takes an unusually long time (5+ minutes) to perform any action related to domains
 what could it be? How can I debug this?

My gut says that there is some obsolete configuration somewhere that is slowing things down.

I carried out the migration via SSH yesterday.

Thanks for the great work. It went smoothly, I only had to update SearxNG ‘on foot’, then it worked again.

I admit, I was a little scared because it affected my production system and because I wasn’t sure that my Hubzilla installation would come through unscathed (especially since I didn’t install it as an app, but manually in a My_Webapp).

All good!

1 Like

Salut,
J’ai serrĂ© les fesses et tentĂ© la mise Ă  jour en ligne de commande (remote ssh).

J’ai perdu :

$ sudo yunohost tools migrations run --accept-disclaimer
Info: Running migration 0027_migrate_to_bookworm

Info: Starting migration to Bookworm

Info: Patching the sources.lists file

error: Cannot find a question for postgresql-common/obsolete-major
Info: Applying patch to workaround conflict issue

Info: Starting main upgrade

Info: Downloading...
Error: Migration 0027_migrate_to_bookworm did not complete, aborting. Error: Failed to run command 'aptitude full-upgrade cron rspamd- luajit- libluajit-5.1-2- --show-why -o APT::Force-LoopBreak=1 -o Dpkg::Options::='--force-confold''
Info: The operation 'Run migrations' could not be completed. Please share the full log of this operation using the command 'yunohost log share 20241115-170853-tools_migrations_migrate_forward' to get help

Log complet : https://paste.yunohost.org/raw/enayuquxag

Une suggestion ? :cry:
(rien d’urgent, mon serveur tourne comme avant la tentative de migration : comme un charme)

Si à la main en SSH tu fais sudo aptitude full-upgrade cron rspamd- luajit- libluajit-5.1-2- --show-why -o APT::Force-LoopBreak=1 -o Dpkg::Options::='--force-confold', ça raconte quoi ?

I think that may be related to the pydantic system which adds some overhead 
 (I assume you are on an ARM board ?) I’m not sure there’s anything to fix/improve on your side, it’s purely something in the code that we need to ideally optimize somehow

1 Like

Hello,
The migration fails on my (old) BananaPi for no obvious reason.

root@pihole:~# yunohost tools migrations run migrate_to_bookworm --accept-disclaimer
Error: Failed to read info for cachet : Invalid version: '2.3.18~ynh1'
Info: Running migration 0027_migrate_to_bookworm

Info: Starting migration to Bookworm

Info: Patching the sources.lists file

Warning: W: http://apt.armbian.com/dists/bookworm/InRelease: Key is stored in legacy trusted.gpg keyring (/etc/apt/trusted.gpg), see the DEPRECATION section in apt-key(8) for details.
chattr: Operation not supported while reading flags on /etc/resolv.conf
Info: Applying patch to workaround conflict issue

Info: Starting main upgrade

Error: Migration 0027_migrate_to_bookworm did not complete, aborting. Error: Something went wrong during the main upgrade, the system appears to still be on Debian Bullseye.
Info: The operation 'Run migrations' could not be completed. Please share the full log of this operation using the command 'yunohost log share 20241116-153722-tools_migrations_migrate_forward' to get help

Here are the logs: https://paste.yunohost.org/raw/eyuliqeqov
Relaunching the migration causes the same exact error.

EDIT: I proceeded with apt install moulinette yunohost yunohost-admin ssowat and it went through!

Hello everyone,
Many many thanks to the whole team for all this migration hard work.
On my side, it went rather smooth, exept for 2 or 3 steps:

  • Lack of space in /boot.
    Solved with the help of this topic:
    Migration Yunohost 11.3.0.2 towards 12 / lacking space in /boot/

  • Migration returned 500 internal server error (nginx).
    Just clicked ok, user interface were still working, went back in migration and there were 2 pending:
    A python rebuild stuff related to ihatemoney app. Didn’t pass but logs told me which command i had to use un CLI, so now it’s ok (force upgrade).
    The term and licence agreement.

  • After that I ran a diagnostic, and it returned a default in a conf file, apparently modified. But prior to migration no file were modified, all were compliant whith recommandation. As log indicated, I forced regen conf in CLI.

I did a reboot of the server as a Tourette Windows user.

Now everything is working fine!
Thank you again!

2 Likes

Lorsque je lance cette commande, j’ai ce retour :

$ sudo aptitude full-upgrade cron rspamd- luajit- libluajit-5.1-2- --show-why -o APT::Force-LoopBreak=1 -o Dpkg::Options::='--force-confold'
[sudo] password for XXXXXX: 
                                         

The following NEW packages will be installed:
  cron-daemon-common{a} (for cron)  
The following packages will be REMOVED:
  fonts-glyphicons-halflings{u}  libjs-bootstrap4{u}  libjs-popper.js{u}  libjs-requirejs{u}  libjs-sizzle{u}  libluajit-5.1-2  libluajit-5.1-common{u}  luajit  node-jquery{u}  php7.4-apcu{u}  
  php8.0-apcu{u}  php8.0-curl{u}  rspamd{u}  
The following packages will be upgraded:
  cron  libc-bin  libc-l10n (for locales)  libc6  locales  
5 packages upgraded, 1 newly installed, 13 to remove and 1020 not upgraded.
Need to get 0 B/12.4 MB of archives. After unpacking 12.5 MB will be freed.
The following packages have unmet dependencies:
 libc-dev-bin : Depends: libc6 (< 2.32) but 2.36-9+rpt2+deb12u9 is to be installed
 unscd : Depends: libc6 (< 2.32) but 2.36-9+rpt2+deb12u9 is to be installed
 libc6-dbg : Depends: libc6 (= 2.31-13+rpt2+rpi1+deb11u11) but 2.36-9+rpt2+deb12u9 is to be installed
 libc6-dev : Depends: libc6 (= 2.31-13+rpt2+rpi1+deb11u11) but 2.36-9+rpt2+deb12u9 is to be installed
open: 45; closed: 104; defer: 6; conflict: 7                                                                                                                                                                      oThe following actions will resolve these dependencies:

      Install the following packages:                                                  
1)      gcc-12-base [12.2.0-14 (stable)]                                               
2)      gcc-12-base:armhf [12.2.0-14 (stable)]                                         
3)      libc6:armhf [2.36-9+rpt2+deb12u9 (stable)]                                     
4)      libgcc-s1:armhf [12.2.0-14 (stable)]                                           
5)      libgprofng0 [2.40-2 (stable)]                                                  
6)      libidn2-0:armhf [2.3.3-1+b1 (stable)]                                          
7)      libunistring2:armhf [1.0-2 (stable)]                                           
8)      rpcsvc-proto:armhf [1.4.3-1 (stable)]                                          

      Upgrade the following packages:                                                  
9)      binutils [2.35.2-2 (now) -> 2.40-2 (stable)]                                   
10)     binutils-aarch64-linux-gnu [2.35.2-2 (now) -> 2.40-2 (stable)]                 
11)     binutils-common [2.35.2-2 (now) -> 2.40-2 (stable)]                            
12)     libbinutils [2.35.2-2 (now) -> 2.40-2 (stable)]                                
13)     libc-dev-bin [2.31-13+rpt2+rpi1+deb11u11 (now) -> 2.36-9+rpt2+deb12u9 (stable)]
14)     libc6-dbg [2.31-13+rpt2+rpi1+deb11u11 (now) -> 2.36-9+rpt2+deb12u9 (stable)]   
15)     libc6-dev [2.31-13+rpt2+rpi1+deb11u11 (now) -> 2.36-9+rpt2+deb12u9 (stable)]   
16)     libctf-nobfd0 [2.35.2-2 (now) -> 2.40-2 (stable)]                              
17)     libctf0 [2.35.2-2 (now) -> 2.40-2 (stable)]                                    
18)     libgcc-s1 [10.2.1-6 (now) -> 12.2.0-14 (stable)]                               
19)     libidn2-0 [2.3.0-5 (now) -> 2.3.3-1+b1 (stable)]                               
20)     libjansson4 [2.13.1-1.1 (now) -> 2.14-2 (stable)]                              
21)     libunistring2 [0.9.10-4 (now) -> 1.0-2 (stable)]                               
22)     libzstd1 [1.4.8+dfsg-2.1 (now) -> 1.5.4+dfsg2-5 (stable)]                      
23)     unscd [0.54-1 (now) -> 0.54-1+b6 (stable)]                                     



Accept this solution? [Y/n/q/?] The following NEW packages will be installed:
  cron-daemon-common{a} (for cron)  gcc-12-base{a} (for libgcc-s1)  gcc-12-base:armhf{a}  libc6:armhf{a}  libgcc-s1:armhf{a}  libgprofng0{a}  libidn2-0:armhf{a}  libunistring2:armhf{a}  
  rpcsvc-proto:armhf{a}  
The following packages will be REMOVED:
  fonts-glyphicons-halflings{u}  libc-devtools{u}  libjs-bootstrap4{u}  libjs-popper.js{u}  libjs-requirejs{u}  libjs-sizzle{u}  libluajit-5.1-2  libluajit-5.1-common{u}  luajit  node-jquery{u}  
  php7.4-apcu{u}  php8.0-apcu{u}  php8.0-curl{u}  rspamd{u}  
The following packages will be upgraded:
  binutils  binutils-aarch64-linux-gnu  binutils-common  cron  libbinutils  libc-bin  libc-dev-bin  libc-l10n (for locales)  libc6  libc6-dbg  libc6-dev  libctf-nobfd0  libctf0  libgcc-s1  libidn2-0  
  libjansson4  libunistring2  libzstd1  locales  unscd  
The following packages are RECOMMENDED but will NOT be installed:
  libc-devtools:armhf  
20 packages upgraded, 9 newly installed, 14 to remove and 1004 not upgraded.
Need to get 0 B/34.9 MB of archives. After unpacking 4,208 kB will be used.
Reading changelogs... Done               
apt-listchanges: Mailing root: apt-listchanges: news for XXXX.fr

For the record for Olinuxino (an open-source ARM board) owners, one cannot migrate directly to Yunohost 12 due to the lack of support of Bookworm from Olimex Debian repository:

WARNING - E: The repository 'http://repository.olimex.com bookworm Release' does not have a Release file.
WARNING - W: Failed to fetch http://repository.olimex.com/dists/bookworm/Release: 404  Not Found

However moving away /etc/apt/sources.list.d/olimex.list allow to perform the migration (duration around 1h45). At least for tests purpose as you won’t receive updates for the kernel etc. afterwards. Stay tuned here : Bookworm upgrade availability soon ?

1 Like

Thanks a lot for your hint to:

I’ve been bitten by the same problem

Error: Migration 0029_postgresql_13_to_15 did not complete, aborting. Error: Failed to run command 'LC_ALL=C pg_upgradecluster -m upgrade 13 main -v 15'.

with

Checking for presence of required libraries                 fatal

Your installation references loadable libraries that are missing from the
new installation.  You can add these libraries to the new installation,
or remove the functions using them from the old installation.  A list of
problem libraries is in the file:
    /var/lib/postgresql/15/main/pg_upgrade_output.d/20241117T012119.742/loadable_libraries.txt

Failure, exiting

of course this file didn’t exist on my system, as well.

Thankfully your solution solves my problem, too:

apt install postgresql-15-postgis-3 postgresql-15-postgis-3-scripts

Merci beaucoup pour cette nouvelle version majeure de Yunohost ! Je l’attendais et je ne suis nullement déçu. Vous faites un super taf !
La revue du site internet est aussi un plus d’ailleurs, ça devrait attirer encore plus de monde. ^^

La migration s’est bien passĂ©e sur deux de mes serveurs.
Ça ouvre de nouvelles perspectives.

Merci encore pour tout votre travail !

1 Like

Hello, thank you for the upgrade, for the record I ran into trouble: a 500 error on the webadmin, I waited a little and then I rebooted, and then I got 403 when trying to access my server on my browser.
The fix was simply to install yunohost-portal by hand with apt and everything seems to work now!

J’ai ensuite relancĂ© la migration mais ça a Ă  nouveau planté 

Info: [###################.] > 99.9% Processing libgdk-pixbuf-2.0-0
Info: [####################] > 100.0% Done 
Success! Configuration updated for 'nsswitch'
Info: Cleaning up cache and packages not useful anymore

Reading package lists... Done
Building dependency tree... Done
Reading state information... Done
0 upgraded, 0 newly installed, 0 to remove and 7 not upgraded.
Info: Starting YunoHost core upgrade

Info: Downloading...
Info: [....................] > 0.0% Installing python3-all
Info: [....................] > 3.1% Installing lua-rex-pcre2
Info: [#...................] > 6.2% Installing lua-basexx
Info: [#...................] > 9.3% Installing lua-luaossl
Info: [##..................] > 12.4% Installing lua-logging
Info: [###.................] > 15.5% Installing lua-cjson
Info: [###.................] > 18.6% Installing ssowat
Info: [####................] > 21.7% Installing python3-jwt
Info: [####................] > 24.8% Installing python3-passlib
Info: [#####...............] > 27.9% Installing python3-magic
Info: [######..............] > 31.0% Installing python3-typing-extensions
Info: [######..............] > 34.1% Installing python3-pydantic
Info: [#######.............] > 37.2% Installing python3-email-validator
Info: [########............] > 40.3% Installing libmilter1.0.1
Info: [########............] > 43.4% Installing opendkim
Info: [#########...........] > 46.5% Installing openresolv
Info: [#########...........] > 48.1% Installing moulinette
Info: [##########..........] > 51.2% Installing resolvconf
Info: [##########..........] > 53.4% Installing yunohost
Warning: Killed
Warning: E: Could not get lock /var/lib/dpkg/lock-frontend. It is held by process 1278000 (dpkg)
Warning: E: Unable to acquire the dpkg frontend lock (/var/lib/dpkg/lock-frontend), is another process using it?
Warning: W: Could not lock the cache file; this usually means that dpkg or another apt tool is already installing packages.  Opening in read-only mode; any changes you make to the states of packages will NOT be preserved!
Warning: E: Could not get lock /var/lib/dpkg/lock-frontend. It is held by process 1278000 (dpkg)
Warning: E: Unable to acquire the dpkg frontend lock (/var/lib/dpkg/lock-frontend), is another process using it?
Error: Migration 0027_migrate_to_bookworm did not complete, aborting. Error: Failed to run command 'aptitude unhold baikal-ynh-deps jirafeau-ynh-deps nextcloud-ynh-deps shellinabox-ynh-deps snappymail-ynh-deps transmission-ynh-deps'
Info: The operation 'Run migrations' could not be completed. Please share the full log of this operation using the command 'yunohost log share 20241117-145259-tools_migrations_migrate_forward' to get help

https://paste.yunohost.org/raw/adujimiqub

yunohost.utils.error.YunohostError: Failed to run command 'aptitude unhold baikal-ynh-deps jirafeau-ynh-deps nextcloud-ynh-deps shellinabox-ynh-deps snappymail-ynh-deps transmission-ynh-deps'

J’ai alors re-relancĂ© la migration, et ça c’est finalement bien terminĂ©.

Mais j’avais alors une Erreur 403, j’ai appliquĂ© ce que propose le poisson libre juste au dessus (sudo apt install yunohost-portal) : tout est rĂ©glĂ© !!! \o/

Yoohooo, merci Ă  tous !

1 Like

Thanks for your reply, @Aleks!

Actually, I am not. I am using a quite beefy VPS (6 cores, 16 GB RAM)

Could you help me analyse the performance in general, so that maybe we can pinpoint the process with the most overhead?

Ah interesting

Hmmmm well first would you have an example of some operation that takes an unexpected amount of time, ideally from the command line ? Naively I would run this command with --debug and that may allow to have a more precise idea of where the issue lies

(Congratz on the italian translation btw, it’s live now !)

2 Likes

Migration rĂ©ussie “mais”
1- j’ai eu un message d’erreur 500 cf capture ci-aprùs
2- les applications fonctionnent mais la plupart ont disparu de l’écran d’accueil. Heureusement, elles sont toujours lĂ  si je passe par l’interface admin. Il n’y a juste pas d’icone sur l’ecran d’accueil normal.

Oui c’est pas idĂ©al mais c’est annoncĂ© dans les instructions d’upgrade (en haut de ce topic)

Si tes applications sont sur un “arbre de domaine” diffĂ©rents de celui du portail, il te faut activer l’option “Show other domain apps” dans la webadmin > Domaines > ton.domaine.tld > descendre en bas dans “Portail customization”

1 Like

Ah ok, je n’avais pas vu
Et donc je peux dire que j’ai eu une migration qui a marchĂ© Ă  100 %! :partying_face:
Merci et bravo !!

Yes! Here is the log of the command yunohost domain add testtest.tommi.space --debug.

I noticed that the process is stuck/slow whenever there is ++ jq -r '.domains[]' or ++ tr '\n' ' '.

Salut,
J’ai une question post-upgrade. Comme marquĂ© dans la doc, Rspamd n’est plus installĂ© par dĂ©faut. Il faut maintenant l’installer comme une application.

Ma question est : faut-il paramĂ©trer quelque chose ou effectuer une action aprĂšs l’avoir installĂ© pour que cela fonctionne bien ?

Merci pour votre aide.