Hello,

I know it is strictly related to selfhosting but I don’t have a reddit account so please bear with me. I’ve been using a Blackblaze B2 bucket as the storage for my restic backup for my whole homelab for a while and recently when reading from that bucket it is so so so so so so slow and unreliable (a lot of unexpected EOF and interruption). I’ve tested this on several machines (including a VPS on Hetzer) and I can access other sites just fine. Their status page says nothing and I wonder is it just me or do some of you also experience the same thing ?

Also any alternative recommendation is welcome but I can not selfhost my S3 at the moment :(

Thank you very much!

Edit: this is the log for my restic check --read-data (something similar on Hetzner VPS).

create exclusive lock for repository
load indexes
check all packs
check snapshots, trees and blobs
Load(<data/ef0e80ecc6>, 541, 6322304) returned error, retrying after 508.096097ms: unexpected EOF
Load(<data/ef0e80ecc6>, 541, 6322304) operation successful after 1 retries
Load(<data/c10459132f>, 535, 14002087) returned error, retrying after 1.352882596s: unexpected EOF
Load(<data/c10459132f>, 535, 14002087) operation successful after 1 retries
Load(<data/44089c2105>, 536, 10041504) returned error, retrying after 1.094099947s: unexpected EOF
Load(<data/44089c2105>, 536, 10041504) operation successful after 1 retries
Load(<data/c10459132f>, 481, 3262415) returned error, retrying after 1.418694544s: unexpected EOF
Load(<data/927e700367>, 467, 7776453) returned error, retrying after 634.119689ms: unexpected EOF
Load(<data/927e700367>, 473, 7798234) returned error, retrying after 849.03055ms: unexpected EOF
Load(<data/927e700367>, 467, 7776453) returned error, retrying after 1.243622488s: unexpected EOF
Load(<data/653ef7abb0>, 523, 8280899) returned error, retrying after 578.669152ms: unexpected EOF
Load(<data/fd9edf4117>, 533, 485866) returned error, retrying after 823.382046ms: unexpected EOF
Load(<data/c10459132f>, 528, 3248055) returned error, retrying after 1.402372952s: unexpected EOF
Load(<data/c10459132f>, 524, 3175555) returned error, retrying after 1.425799941s: unexpected EOF
Load(<data/9b179c749d>, 534, 13802701) returned error, retrying after 1.234603672s: unexpected EOF
Load(<data/7b827c96f6>, 531, 8412866) returned error, retrying after 1.49579899s: unexpected EOF
Load(<data/ef0e80ecc6>, 530, 5093059) returned error, retrying after 1.405885227s: unexpected EOF
Load(<data/927e700367>, 409, 7763564) returned error, retrying after 798.04783ms: unexpected EOF
Load(<data/c10459132f>, 481, 3262415) returned error, retrying after 1.362966862s: unexpected EOF
Load(<data/653ef7abb0>, 523, 8280899) returned error, retrying after 2.966804822s: unexpected EOF
Load(<data/927e700367>, 467, 7776453) operation successful after 2 retries
Load(<data/fd9edf4117>, 533, 485866) operation successful after 1 retries
Load(<data/927e700367>, 409, 7763564) operation successful after 1 retries
Load(<data/9b179c749d>, 534, 13802701) operation successful after 1 retries
Load(<data/c10459132f>, 528, 3248055) operation successful after 1 retries
...

Edit: After a day my restic check --read-data finished with no data corruption but it took a lot of retrying, even 7 retries to read the correct data :/ So I guess it is a sign for me to move to somewhere else.

  • Mad_Punda@feddit.orgEnglish
    1·
    8 days ago

    My restic backups go to a bucket on scaleway. I’m not having any trouble with that.

    They have a free trial, so maybe you could try and see if it works better for you.

    I have experienced restic being very slow when it didn’t have a cache. Maybe something worth double checking. I believe it mentions it in the output.

  • Augmented1207@feddit.orgEnglish
    0·
    8 days ago

    To throw in yet another opinion that does not help you right now: My friend has a backup server at his place and I have our home lab at my place.

    Just a rough calculation: 2 8tb drives for a mirror is 150€ each (during a normal market, and when we bought it), so 300 combined. That is 60€per year if we assume they die quickly after 5years.

    With a very light old desktop pc that is power efficient we can reach 25w

    That is: 25w/1000 (for kW) * 24h * 365d * 0.35€/kW = 78€ per year of energy.

    That is combined 138€/year.

    The hetzner storage box is 24€/Month @ 10tb

    So that is 288€/year.

    So I would argue that its even cheaper to pay a friend to put a small old pc at their place and paying them 40ct /kwh is still cheaper than the clouds? Assuming you can find hdds at a reasonable price. But I could find cheap used offers with a runtime of 3y for 100€.

    If you only need 1tb, its not worth it to run your own storage, as the power stays roughly the same:

    Hetzner: 3,8€/1tb * 12m = 46.6€ So allone the power of running the backup server is not worth it financially.

    For the 5tb plan: 12€*12m=144€ so that is the break even point I assume, as drives don’t scale too mich with price?