you have been banned from /c/DataHoarder
this post was submitted on 30 Dec 2023
88 points (96.8% liked)
Selfhosted
40347 readers
325 users here now
A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don't control.
Rules:
-
Be civil: we're here to support and learn from one another. Insults won't be tolerated. Flame wars are frowned upon.
-
No spam posting.
-
Posts have to be centered around self-hosting. There are other communities for discussing hardware or home computing. If it's not obvious why your post topic revolves around selfhosting, please include details to make it clear.
-
Don't duplicate the full text of your blog or github here. Just post the link for folks to click.
-
Submission headline should match the article title (don’t cherry-pick information from the title to fit your agenda).
-
No trolling.
Resources:
- selfh.st Newsletter and index of selfhosted software and apps
- awesome-selfhosted software
- awesome-sysadmin resources
- Self-Hosted Podcast from Jupiter Broadcasting
Any issues on the community? Report it using the report flag.
Questions? DM the mods!
founded 1 year ago
MODERATORS
You can do this with custom formats. You'd want to create a custom format that gives a score if the file is below a certain size threshold (say 1.5GB per hour), then add minimum custom scores to the release profiles you use (e.g. Bluray 1080p). You can also add custom filters for release groups that prioritise file size. YTS for example keeps their releases as small as possible.
You got a remux, which is uncompressed. You can turn those off in Radarr to avoid those surprises.
If you want to fine-tune your file sizes (and quality) further, you can set up custom formats and quality profiles. The Trash Guides explain it well, the "HD Blu-ray + Web" profile on that page is a solid starting point. It'll usually grab 6-12GB movies, but you can tweak it if you want them smaller.
Trash Guides FTW. I’ve used them for all my *arr setups and it’s been flawless.
Doesn't Trash Guides prefer larger files though? Iirc if you just do everything as they recommend you'll always be grabbing the highest quality stuff available, which is the opposite of what this person wants.
The guide doesn’t set an upper bound on the UHD quality profiles, but that doesn’t mean you have to set up yours exactly the same.
I have mine set with reasonable limits and have never run into a problem with file size, just have to make sure you’re setting the values to something that’s a) realistic and b) that you can live with.
One thing to note: if you set your threshold cutoffs properly you don’t have to worry about downloading files that are always at the upper end of the limit. Once the service downloads a file that meets the threshold it stops downloading for that episode/movie. If it grabs a file that’s below the threshold, it will keep trying to upgrade the file until the threshold is met.
It always throws me when I see at 1080 movie less than 5gb, then I scroll across and see it's x265....
I get that and I love the x265 rips.
Serviceable, but still not great quality most of the time.
You can edit the accepted sizes under Settings > Quality
Also check out Tdarr! I convert everything to HEVC using that. Shrinks down some files to literally 50% of their original size
Yep, this is a good option for reducing file size at the expense of compatibility and CPU time. Every time OP downloads a file they'll then have to reencode the file, which can take significant time, depending on the CPU of their NAS box, the file size, etc. It's also worth noting that reencodes are lossy, so some amount of quality will be lost (although the quality difference may be imperceptible).
If disk space is the only variable we're optimizing for, then you're 100% correct, but I think it's worth calling out that this definitely isn't without tradeoffs.
It might also be worth considering how they're consuming this media. If the client isn't capable of playing back h265 then this will need to be transcoded again to play it back. Many media servers (like Plex) handle this automatically, but it's definitely worth testing this out with your setup on a couple of files before doing this on your whole media collection.
Thanks for calling those points out! You are 100% correct. I think I take it for granted that at this point, all of this "just works" on my setup :)
Does the audio suffer? I'm already sacrificing a lot by getting Yify/YTS stuff, the audio for those is piss poor as ot is
The audio should not be affected, as far as I'm aware. I get all my stuff from Usenet
I use tdarr on my gaming machine and use the higher end GPU to do the work. I also use the trash guide for getting the audio profile I want in my downloads. Then in tdarr, I strip away audio and subtitle languages I don't want and use the highest quality audio source to add a simple 2 channel audio to make it more compatible for more devices. That way I'm not needlessly transcoding 5.1 Dolby for people who are just watching on TV audio.
Most modern devices should support x265 playback which has the compression sizes you are looking for.
In addition to setting the cap to file sizes for media, you can also blacklist tags like REMUX etc.
This is an example of a custom format for hevc/x265 files that are no larger than 6Gigs. You just need to create a new custom quality profile and give below custom format a positive/higher score.
{
"name": "Minima",
"includeCustomFormatWhenRenaming": false,
"specifications": [
{
"name": "No mo than 6 Gigs",
"implementation": "SizeSpecification",
"negate": false,
"required": true,
"fields": {
"min": 0,
"max": 6
}
},
{
"name": "1080p",
"implementation": "ResolutionSpecification",
"negate": false,
"required": true,
"fields": {
"value": 1080
}
},
{
"name": "eng",
"implementation": "LanguageSpecification",
"negate": false,
"required": false,
"fields": {
"value": 1
}
},
{
"name": "Preferred x265",
"implementation": "ReleaseTitleSpecification",
"negate": false,
"required": false,
"fields": {
"value": "[xh][ ._-]?265|\\\\bHEVC(\\\\b|\\\\d)"
}
}
]
}
In the profiles? Not sure if that's the correct term, but there's settings for all the quality profiles 720p 1080p etc with a slider that can set minimum and maximum size for that quality.
Be sure to avoid "remux" quality. I didn't know what this meant at first - it's ~~a file with no compression~~ an uncompressed 1:1 copy of the source, so even "low-resolution" video files can be truly massive. A 1080p movie should be between 2GB-10GB or so; I've found that remuxes are typically 15GB-50GB, or even larger.
edit: updated for accuracy 👍
Remuxes aren’t uncompressed, nor are they losslessly compressed. They’re just a 1:1 direct copy from some other medium (generally blu-rays or DVD’s).
"Remuxing preserves the original video and audio quality because it doesn’t involve any compression"
https://techreviewadvisor.com/what-does-remux-mean/
So, what you said - it's a 1:1 copy of the source. With no compression. Which is what I said, as far as I can tell?
What I don't understand is why the article says it allows for smaller file sizes, when I've found without fail that remuxes are the largest variety by far. It made sense to me that a file produced without compression would be larger than the same file, compressed.
Ah, it looks like we have a small misunderstanding. I thought you were talking about uncompressed video, which is enormous. This is only used in HDMI cables for example. A 1080p60 uncompressed video is 2.98Gbit/s, or about 1.22 terabytes per hour.
A remux is “uncompressed” in the sense that it isn’t recompressed, or in this case transcoded. A remux is still compressed, just to a lesser degree than a transcode. This means the files are indeed larger, but the quality is also better than transcodes.
To clarify the article’s confusing statement: they claim that remuxes can reduce size by throwing away some audio streams, while keeping the original video. This is true, but the video itself hasn’t gotten any smaller: you are simply throwing away other information.
It can save data by excluding data streams that you don't need. For instance, I don't need French, Italian, Japanese, German 5.1 audio streams that each have 700Mbps bitrates or higher, nor do I need an English 1.5Gbps master audio stream, a 700 Mbps English stream, a 500 Mbps descriptive audio for the blind, and 5 different special edition commentary tracks for a film I'll watch once or twice. All those tracks can really add up, and torrent sites are often country or language specific, so remuxes might have original language and/or native language audio only.
Thank you, just went and disabled it completely, I'd never heard of that before either.
Use Quality Profiles and default to a lower quality. You can set the profile for each item when adding it, or change it after the fact.
https://trash-guides.info/Radarr/radarr-setup-quality-profiles/
Think the "Quality Definitions" section of the settings in Radarr is what you're looking for.
44gb for 1080 seems to be a remux file, which is the source of channel not converted but only repackaged. Just remove remux from your profiles and sed radarr to upgrade to other 1080 profiles by moving remux down in the list.