You could just run everything as root or configure sudo without timeout.
exu
joined 2 years ago
You'll want to install a reverse proxy of your choice on the VPS. Have clients access it over ipv4 and configure it to proxy pass it to your ipv6 address. Nginx at least is capable of doing ipv4 & ipv6 -> ipv4, I think the inverse should also be possible.
You can use OpenCL instead of ROCm for GPU offloading. In my tests with llama.cpp that improved performance massively.
Definitely do benchmarks for how many layers you can offload to the GPU. You'll see when it's too many, as performance will crater.
By launching llama.cpp as a server you'll actually be able to continue to use openwebui as you currently have.
Firewalld had, at least last time I checked, way more capabilities than UFW. Both are fine at being basic firewalls, but I don't think you can build a router using just UFW.
Firewalld allows some pretty advanced rules. I use it to redirect a bunch of web requests going to a certain address over a local ssh tunnel.
It'll also ignore the default firewalld rules. IIRC it uses the internal zone instead
It would probably take someone to sue them, but they would have to implement it.
It's probably still more efficient to keep a 192k opus and a 320k mp3 around than one flac.
I don't know how good it is, but for Turing and later GPUs there's a new official open source driver being developed. You'd likely have to use a more bleeding edge distro to get that.
VR works depending on your headset. Index is fine, Oculus doesn't work.
You could make a usb stick of your desired distro and test everything without permanent changes before commiting.
With Mozilla Location Services going away soon, I'm wondering at the legality of using the Apple data to seed a replacement.
You could use BTRFS, ZFS or BcacheFS to do compression on the filensystem level, but it's not gonna compress video files or other already compressed media.
Without knowing what was being hosted, the only surefire way would be pulling a complete disk image with cat or dd.
If you wanted to stay on a similar system, RHEL 9 would be a good option or one of its "as similar as possible" like AlmaLinux.
Other common distros for servers are Debian, Ubuntu server and Suse SLES/OpenSuse Leap.
Big ass enter is way better than the small one.
You can't change my mind.