Sorry to hear about that mess.
I posted here https://lemmy.nz/comment/1784981 a while back about what I went through with the Nvidia driver on Linux.
From what I can tell, people who think Linux works fine on Nvidia probably only have one monitor or maybe two that happen to be the same model ( with unique EDID serials FWIW ). My experience with a whole bunch of mixed monitors / refresh rates was absolutely awful.
If you happen to give it another go, get yourself an AMD card, perhaps you can carry on using the Nvidia card for the language modelling, just don't plug your monitors into it.
I have two AMD Radeon cards for Linux that I'm pretty happy with that replaced a couple of Nvidia cards. They are an RX6800 and an RX6700XT. They were both ex mining cards that I bought when the miners were dumping their ethereum rigs, so they were pretty cheap.
If I had to buy a new card to fill that gap, I'd probably get a 7800XT, but if you don't game on them you could get a much lower end model like an RX7600.