Best method to backup yunohost to S3 compatible bucket

Discuss
1

So, what is the best method to backup to a S3 bucket? I configured archivist, but i don’t see any backup on my bucket.

Any how to would be useful
Thanks

3 Likes
2

What does Archivist say in its logs? Can you share your config (and remove any passwords or id)?

3

I use restic to do my backups. It supports S3 buckets and these other backends.

    Local directory
    sftp server (via SSH)
    HTTP REST server (protocol, rest-server)
    Amazon S3 (either from Amazon or using the Minio server)
    OpenStack Swift
    BackBlaze B2
    Microsoft Azure Blob Storage
    Google Cloud Storage
    And many other services via the rclone Backend

I have a tutorial I made for using it with Yunohost, not with S3 buckets, but it’s not much different based on the different backends. I used it with Wasabi before.

2 Likes
4

I have set a daily backup in initial config, then i wasn’t seeing any files in my bucket, so i did a forced backup in archivist/actions. I think it’s still running since yesterday because i can’t acess any yunohost webui options. My bucket tells me that has only 300Mb of files.

Also i had mounted bucket with s3fs to /mnt/backups and set this location in archivist config

5

Should i use the same config as wasabi? It’s a contabo object store

Edit: So with restic, i have to make a full yunohost backup to /home/yunohost.backup/archives and then restic sends it to the bucket?

That wasn’t my idea, i want to send directly to the bucket

6

I wouldn’t do that either. I wouldn’t bother with Yunohost backups at all. The most important thing is the data right? So just backup your data and tag it in restic. It was so easy to do a full-reinstall of Yunohost. I recently reinstalled my whole Yunohost and brought my data back from my restic backup. So easy!

I’m wary of all these s3 things because I don’t know how they charge you. There are lots of discussions about these sort of queries on their forum though. I am not an online storage user, so I don’t know much about that, just that Restic has that capability.

I was just browsing their forum and noticed that CERN is testing out Restic to use as their backup solution. Cool!

Anyways getting off topic here. Keep us updated on how it goes :smiley:

2 Likes
7

I arrive after the battle, but I would be careful about backing up “just the data”.
Scenario:

  1. You create your backup for my_critical_app_v2.4
  2. Unrecoverable hard-drive crash
  3. New hard-drive, reinstall. App comes now in v3.0
  4. Your data from 2.4 cannot be restored on the v3.0 of the app
  5. Suffering

I’m not saying it would be hopeless, but it would dramatically increase the complexity of the restore process.
Note that if you’re unlucky, my_critical_app_v2.4 is not installable on the update of the Yunohost version that was just released after your hard-drive crash. So I guess there is no guaranteed easy restore (?)

8

To answer to the primary question about S3, i recommend you to use the yunohost app “restic” (even if i think you should be carreful and test your backup cause i think some bug corrected in yunohost borg app have not been corrected in restic).

About the second question, if you use borg_ynh, restic_ynh, archivist or just download an archive produce with yunohost, you backup what you need.
When you restore it will restore the app in the version of your backup. In some case you could have dependencies rebuild issues OR if you restore on a upper major version of yunohost you could be sometimes in a bad situation.

For example, restore an app using python2.7 on YunoHost 11 won’t work, cause python2.7 is not installed.

2 Likes
9

Hello!
I have used the app and tweaked the conf to use s3 (scaleway server) instead of sftp.
I’m reinstalling my server after a crash, and now I have an issue:

Fatal: unable to open config file: Stat: The authorization header is malformed; the region 'u
s-east-1' is wrong; expecting 'fr-par

Checking the restic bug reports, it seems to be related to some config file, but I don’t understand what we’re talking about. From my laptop, I can execute that command without any issue.
What am I missing on my server??

10

Answering to myself and warning for everyone reinstalling:
You’ll face a chicken & egg question: you need restic to restore, but you haven’t restored restic…

My first thought was to install the official restic Debian package and remove it before restoring restic itself.
DON’T DO THAT!

The Yuno app uses restic 0.12.0, and buster is on an older version. After removing the package and manually installing the 0.12.0, my above command worked.

11

I am trying to do this, but I am failing! Could you share the steps you made, @valterbarreira?

Thanks a lot :heart:

12

install it manually (download the release, drop it in /bin). with the self-update mechanism, it’s very easy to deal with restic updates.

https://restic.readthedocs.io/en/stable/020_installation.html

13

@arkadi an you be more specific? Download what release from where? Using terminal ? Would you be kind enough to show step by step ?

14

https://restic.readthedocs.io/en/stable/020_installation.html#stable-releases

  • go to releases page on Restic github
  • copy file location (probably amd64 if you have a 64 bit x86, are you using ARM? then get arm64)
  • login to your Yunohost box with ssh
  • paste type wget COPIED_FILE_LOCATION (need to paste where the file is from the releases page)
  • it will download the file
  • run SHA256SUM on the file you just downloaded sha256sum FILENAME
  • does it match the one here
  • uncompress the file, need to install bzip2 → sudo apt-get -y install bzip2
  • move file to /bin sudo mv FILENAME /bin

these links are for the current release, 0.16

2 Likes
15

Merci.

It was not clear to me from your original post whether you meant the Yunohost version of Restic. Now I understand.

1 Like