homelab

6642 readers

28 users here now

founded 4 years ago

MODERATORS

CMonster@lemmy.ml

Can I expose my Nvidia gpu to the lan via a docker container? (lemmy.world)

submitted 10 months ago by thisisawayoflife@lemmy.world to c/homelab@lemmy.ml

6 comments fedilink hide all child comments

I have a P400 in my storage server which currently also runs some media containers like Plex, sonarr-sma, radarr-sma, Jellyfin, exploring Immich, etc. I have the GPU surfaced via docker and added it to each of the containers that needed access to the GPU for hardware acceleration needs. Is it possible to be able to leverage the Nvidia gpu container remotely (over the lan) without having the containers access it (pseudo) directly? I want to move the media handling containers to a Turing Pi 2 and keep just the GPU access on the storage server.

you are viewing a single comment's thread
view the rest of the comments

[–] GoddessOfGouda@lemmy.world 0 points 10 months ago (1 children)

here is a super user post about pcie virtualization, and it involves writing custom drivers.

Off the top of my head, a similar setup with transcoding comes to mind. In this case I used a shared volume mount between the media server and the transcoding server, and ssh to run ffmpeg on the remote server.

I think an easier setup would be to proxy app calls that use the gpu through ssh to your gpu container, then write the output to a volume that the non gpu host can read from.

[–] GoddessOfGouda@lemmy.world 5 points 10 months ago

If you’re looking for transcoding, check out rffmpeg