homelab

6646 readers

31 users here now

founded 4 years ago

MODERATORS

CMonster@lemmy.ml

Looking to buy some Mellanox ConnectX-3 cards (sopuli.xyz)

submitted 8 months ago by thomasdouwes@sopuli.xyz to c/homelab@lemmy.ml

2 comments fedilink hide all child comments

I was found a listing on eBay for a "Mellanox CX354A ConnectX-3 FDR Infiniband 40GbE QSFP+" card for quite cheap. By the sound of the listing title it supports both infiniband and 40GbE, is that right? I would like to try out infiniband, but I would be buying for the 40GbE. And are there good drivers for modern linux distros for this card? Also, do I just buy some QSFP cables to direct attach them?

you are viewing a single comment's thread
view the rest of the comments

[–] thomasdouwes@sopuli.xyz 4 points 8 months ago

Thanks for the detailed reply. I found a QSFP+ DAC that says it supports IB and Ethernet.
I don't have enough computers to set up a fabric, only the 2 I would be direct attaching have PCIE slots.

I've never used infiniband before so my reason for wanting to try it is just to learn what it is, and how it works. That said, some of those use-cases look very interesting, especially transporting NVMe namespaces, I didn't know that was possible.