1. Posts must be related to the discussion of digital piracy
2. Don't request invites, trade, sell, or self-promote
3. Don't request or link to specific pirated titles, including DMs
4. Don't submit low-quality posts, be entitled, or harass others
📜 c/Piracy Wiki (Community Edition):
Torrenting:
Gaming:
💰 Please help cover server costs.
 |
 |
|---|---|
| Ko-fi | Liberapay |
If you're dealing with this much storage, it's time to upgrade to a rack. Don't deal with having to shove 10 drives into a packed full-size.
Start scouring 2nd hand auction sites and buy one used. They're pretty cheap as far as solutions go if you can grab them used. Something like this would be ideal: https://www.silverstonetek.com/en/product/info/server-nas/RM22-312/
My only problem is space. I have everything connected in my room, modem, router, phone, desktop, etc. It was how the house was wired and it's a real mess. I'd have to hang a rank from the ceiling but thank you for the product information and input.
Remember, 3-2-1 is all about not fully trusting any one backup.
I have 4 replicants of my data at home (because any one of them could die at any time) with an online backup. Not the best setup, but it's what I can do at the moment.
As for RAID, that's a solution for a specific problem(s).
Horders Unite! lol I'd be like you probably if I had what I wanted. I HATE to have to recreate all the hard work I put into my systems and videos. Yeah, I've always heard people saying NO, NO, NO RAID for backup so, I guess, no raid.
Also, I'd need it to have a USB-type connection for a USB SSD drive to pop-out & connect to my Smart TV for viewing.
Let me introduce you to my friend Jellyfin.
My experience with all the media servers is not great.
Popped up Jellyfin once again just last weekend and the quality was not great, and it had issues streaming. Just like every time I've tried any media server.
The answer for me is a media player pc at the TV running something like Kodi.
That's not anything to do with Jellyfin, that's something to do with your hardware.
I've heard of Jellyfin but my PC doesn't have a WiFi card, only a NIC. For some reason when they rebuilt my computer they didn't put a WiFi card back in. I can't use Jellyfin w/o that, can I?
As long as you are in some way connected to the same network as the TV (by cable, wifi, black magic...) you can use jellyfin.
They both use the same Internet source if that's what you mean. That's great news! I'm looking at videos on setup right now. Do you happen to know if Jellyfin is natively available for an LG Smart TV or are there "hoops" to jump through to get it on there? Thanks again!
I have an LG TV. Yes, the jellyfin client app is available in the LG store. You'll just need to install it and tell it to connect to "IP_OF_YOUR_JELLYFIN_SERVER:8096".
Alternatively, the Jellyfin server can broadcast as a DLNA server (in settings somewhere) and your TV's Jellyfin client may automatically detect the server in that case.
Speaking to your other question, I use a Sabrent hard drive bay with some 20TiB drives setup as raid 5 logical volumes. It's a good setup for me.
No, you definitely don't need a WiFi card.
This. I do NOT recommend using a Wi-Fi card for any server related activities.
Wow, now I really feel stupid. I've been sitting here all this time with tons of video on my system thinking I had to have WiFi to access it through Plex, Emby or Jellyfin and now I find out I don't. Like, I said, I'm really not literate when it comes to Hardware. I'm gonna lookup some videos on Jellyfin and see how to use it. I still need to get some more storage but, at least, I can watch what I already have. Any tips, videos, sites, etc. are greatly appreciated. Thanks for the insight!!! 😊
I've been in the IT field for almost 25 years and I still feel stupid about various things.
The point is to learn and grow. And then feel stupid again.
The best lessons I've learned about IT is that knowing where to start is the hardest thing. But with experience, you kind of get an idea of where things tend to go. But you need to have a level of background.
I'll give you a recent example for me: I recently got a new android phone and have been curious about MagSafe. I know nothing about it except that it was a magnetic plug for old MacBooks before they switched to USB C. I didn't quite understand how you can have a MagSafe pop socket that you can use to charge via Qi wireless charging.
Then...like an idiot, I realized that it's a fucking magnet. You just pull the pop socket off and charge the phone.
You don't know what you don't know until you do.
Any case, feel dumb. We all do. Learning is the best thing.
Ah yeah. It's kinda complicated and hard to sum up in a short comment. You can message me on SimpleX if you need help. I'm not a genius but I do run about a dozen of my own services.
Off topic: how do you like simplex. I have heard of it, but you're the first I've encountered who used it.
I like it a lot. If you're looking to get started there is a groups directory bot. The biggest problem is notifications are very slow. Sometimes hours behind.
The keyword here is DAS - Direct Attached Storage
I'd start by noting that raid is more about availability, not backup... I suspect you already have that in mind but just in case. Ideally if you are up for learning ZFS, that is one of the most resilient raid tools out there. Most NAS and Unix or Linux OS will have support for this.
Never connect RAID disks via USB... This only causes headaches.
Avoid SATA port multipliers, these can cause problems in raid.
SAS has the most reliable and flexible options for connectivity. Used JBOD chassis, even small, can be found cheaply and will run SATA disks well.
As to cloud data, I strongly recommend BackBlaze. Many utilities can natively interact with it (API compatible with Amazon s3) and you can handle encryption on the fly with several sync options. They are one of the cheapest solutions, and storage is pretty much all they do.
With pretty much any cloud storage, look at the ingress/egress cost of your data too... That is where many can bite you unexpectedly.
Worth noting that when you get to large storage, a good organization method for your data is key so you can prune and prioritize without getting overwhelmed later... Don't want several copies of the same thing eating cash needlessly.
Good luck! And welcome to the wonderful illness known as data hoarding!
How much are you storing on Backblaze? I love their Desktop Backup, and I've got about 20TB backed up with it. But I'm planning to add a significant amount of additional storage on a new machine and I worry that their unlimited plan may not actually be unlimited. I've heard good things about their B2 service but the cost would astronomical, way way out of my budget.
edit: Oh, apparently Backblaze Desktop doesn't support Linux. Well, I'm hosed. Got any suggestions for affordably backing up a significant amount of data on a Linux PC?
Check out storj.io
apparently Backblaze Desktop doesn't support Linux.
I haven't tried it, but apparently if you do a mapped network drive in Windows then BackBlaze will let you back it up as normal.
Unfortunately the client seems to explicitly skip network shares, so unless there's some trickery I don't think that is viable.
Seems explicitly against TOS too now:
https://www.backblaze.com/docs/cloud-storage-network-attached-storage-devices
I'm all for any workaround, but worth noting so we don't get OOP caught out unexpectedly
Tapes are how you back up large amounts of data. A small tape robot can handle petabytes.
This! Tape is still the golden standard for high capacity!
Any specific models you'd suggest?
I use b2 for about 15tb, still one of the cheapest really without being sketchy. Cost isn't too bad unless you are reading it often.
As another person already noted, if you really need to back up high amounts, tape is the way to go. Plan to keep your critical stuff off site somehow too. For large amounts sneaker net is still best unfortunately.
Wow, thanks for all the insight. I've just got to find a good JBOD chassis and then figure out what disk drives to use. I'm really not literate when it comes to RAID. I'd just prefer to use my Sync software to backup to the individual drives and then store one offsite as part of a 3-2-1 plan.
I've heard of BackBlaze and I think I looked into it at one point. I just keep seeing bad reviews on just about all the Cloud services with people saying they can't get access to their data or there is data loss but I will give it a look again.
I appreciate the good wishes and you better believe, I'm a "hoarder". It only took ONCE to lose everything and now I want like 10 complete backups of everything. LMAO. 😜 Best to you!
I've never had issues; maybe been lucky lol.
That said, they provide some amazingly detailed status about drives! Worth looking at the reports they post. Might get you insight into what to expect from the various manufacturers and models... Maybe avoid some junk drives in the process.
One of the most recent of these:
https://www.backblaze.com/blog/backblaze-drive-stats-for-q3-2024/
Raw statistics might help cut through a lot of bias!
Oh important note! Check to make sure any drives you'll use are CMR, not SMR (shingled)! SMR will not function right in raid and will fail from arrays.
I build a NAS in 2015. It runs TrueNAS Scale, tons of docker containers for self hosting everything, and 4x 16TB disks in RAIDZ2. I can lose any 2 disks and be ok.
Edit:
I should add that I also ship my data with rsync to back blaze b2, and truenas has built in capabilities to encrypt the datasets before shipment, including directory/dataset names. My shits all up there encrypted and randomly named.
I just JBOD a bunch of random sized disks in various forms of enclosures (a 4-bay cheap piece of Chinese shit filled with 4 random sized HDDs harvested from dead PCs, a couple of USB-3 external laptop drives, two random sized SSDs in their own enclosures harvested from dead laptops) within a linux LVM using WSL2 to host all the drives using a VM of Debian running on a Windows PC.
I think I've kludged together approximately 20 Tb of total disk space, and all i need to do to enable Striped RAID on it all is wait for a refurbished single enormous NAS drive to go on sale on Amazon and enable RAID on the LVM as a separate volume.