SSDs for backup? Being rich must be nice. More srsly if you have the upstream pipe for it, remote backups are preferable in case something happens at home.
this post was submitted on 29 Nov 2024
21 points (88.9% liked)
Selfhosted
40474 readers
381 users here now
A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don't control.
Rules:
-
Be civil: we're here to support and learn from one another. Insults won't be tolerated. Flame wars are frowned upon.
-
No spam posting.
-
Posts have to be centered around self-hosting. There are other communities for discussing hardware or home computing. If it's not obvious why your post topic revolves around selfhosting, please include details to make it clear.
-
Don't duplicate the full text of your blog or github here. Just post the link for folks to click.
-
Submission headline should match the article title (don’t cherry-pick information from the title to fit your agenda).
-
No trolling.
Resources:
- selfh.st Newsletter and index of selfhosted software and apps
- awesome-selfhosted software
- awesome-sysadmin resources
- Self-Hosted Podcast from Jupiter Broadcasting
Any issues on the community? Report it using the report flag.
Questions? DM the mods!
founded 2 years ago
MODERATORS
Yes I follow the 3 2 1 rule, one local backup on the hdd, one on another disk at home (connected to a openwrt router) and one offsite on my vps.
I was using ssd for backup because I was dumb... I guess...
Because needed extra space and added mindlessly the hdd without realizing I should have moved to a more efficient approach.
borgbackup has great versioning, reduplication and compression
I saw something about Restic as an alternative to Borgbackup when I was looking around at what to so about backup https://github.com/restic/restic/
I use restic and backrest
Right, something like hetzner storage box is a good complement to raid 5 in order to follow the 321 backup rule. You can use rclone to sync your backup to hetzner, and even encrypt it, and they can do automatic snapshots on their end to protect against ransomware.
I do my offsite on a vps I rent, all managed by restic / backrest.
Looks like a good setup to me. Hdds have a lot of downsides, so if you can afford the extra $20/TB, an all flash array is super useful. Mdadm is rock solid.
The only issue I think is that it's not possible to expand this array like you can on LVM or ZFS, so just watch out for that.
Good point on the expansion. But o am not too bothered about it, as I have always done by moving data around. Takes a while, but leaves you with a set of disks with the old data still there, and it saved my ass a few times in the past. Now I should be fine with good backups, but you never know.
Btrfs on a single storage prevents it from doing auto correction via checksums. I would get rid of the raid5 and do a btrfs raid1 out of these devices. Makes it also easier to swap out devices or expand the raid as btrfs supports arbitrary sizes.
The point was to her 12tb instead of 8tb... Raid1 would negate that...
What do you mean auto correction via checksum?
One of the main features of file systems like btrfs or ZFS is to store a checksum of each file and allow you to compare that to the current file to notice files becoming corrupted. With a single drive all btrfs can do then is to inform you that the checksum doesn't match to the file any longer and that it is thus likely corrupted, but on a btrfs raid it can look at one of the still correct duplicates and heal the file from that.
IMHO the little extra space from mdadm RAID5 is not worth the much reduced flexibility in future drive composition compared to a native btrfs raid1.
Interesting feature, but how often is that needed? O I never had such issue ever in my life.
Is it something that can happen on such filesystems? Then I guess ext4 is far superior (/s).
Jokes aside, that extra space with raid5 if by far more tangible and statistically sound than the bit flipping fearmonger.
Which never happened to me so far.
Frankly, if a pixel of a photo or a piece of a scene of a movie is corrupted, I will just never know, and never even notice. Nor a corrupted bit in a text note would be critical.
I cannot think of any unreplaceable file of mine that would actually suffer from bit rot issue.
Can you? Would be interested in which kind.
It nearly certainly happened to you, but you are simply not aware as filesystems like ext4 are completely oblivious to it happening and for example larger video formats are relatively robust to small file corruptions.
And no, this doesn't only happen due to random bit flips. There are many reasons for files becoming corrupted and it often happens on older drives that are nearing the end of their life-span and good management of such errors can expand the secure use of older drives significantly. And it can also help mitigate the use of non-ECC memory to some extend.
Edit: And my comment regarding mdadm Raid5 was about it requiring equal sized drives and not being able to shrink or expand the size and number of drives on the fly, like it is possible with btrfs raids.