My current system is running on an old 2U HP rackmount server with dual 16-core AMD Opteron-6262HE CPU's and two RAID-5 arrays (fast SSD array and slow 2.5" HDD array). There are generally 5-6 VMs running under a Linux master at a given time but none of them are using a whole lot of CPU cycles.
In general, it's noisy but fairly effective for my needs.
I'm looking at the future and what might be good replacement that offers a blend of power-efficiency, flexibility, and storage cost.
In particular, I'd like to:
-
Ditch the 2.5" HDD array in favor of an efficient separate storage system, preferably an attached NAS with 3.5" disks on RAID5 but probably actually networked and not USB based (both for reliability and also so I can potentially provide storage directly to stuff running on separate SBC's etc). A storage system I could drop in now and still use after I upgrade the compute system would be great
-
I'd like to keep the SATA-SSD array for stuff that needs faster disk, or possibly move up to a RAID'ed M2/NVMe.
-
Move up to a more modern CPU that has a good Power-per-watt balance. 8-16 cores totally is probably good if that can be reasonably power efficient for idle cores etc, but dropping some VM's to run stuff on the aforementioned SBC's is also an option
-
Still be rack-mounted for the main system, but not so freaking loud, and actually fit in a standard 24" deep rack
-
Potentially be able to add a decent GPU or add-on board for processing AI models etc
Generally what it will be running is a bunch of VM's for stuff like NextCloud, remote-admin software, Media servers (Plex/Jellyfin), a Fileserver, some virtual desktops and various other fairly low-power VMs, BUT it'd be nice if I could add the dGPU or something with the horsepower for AI processing and periodic rendering/ripping/etc
I'm sorry debating on whether might make more sense to move all storage to BAD, then just replace the always-running stuff (NextCloud, Plex,Fileserver) with SBC's so that they're fairly easily swappable if something fails.
You're asking for a lot of different things that don't align, so instead of trying to guess what you need, let me just throw a few things out there:
I think you mean an Intel CPU for transcoding. Pretty much every piece of software can use QuickSync for hwaccel. My Celeron NAS can handle 3 simultaneous Plex transcodes as well as a 5-camera Frigate setup without breaking a sweat.
To OP - if you want energy efficiency AND ML, you will want pre-baked models that can be used on an edge compute device like Google Coral.