Not sure I'd be trusting Musk's communication network at this point. Especially not in Ukraine.
wewbull
joined 2 years ago
Matrix math is just stupid for whatever you pipe through it. It does the input, and gives an output.
Indeed.
That is exactly what all these "NPU" co processing cores are about from AMD, Intel, and to a further subset Amazon and Google on whatever they're calling their chips now. They are all about an input and output for math operations as fast as possible.
Yes, they are all matrix math accelerators, and none of which have any FPGA aspects.
I know exactly what they are. I design CPUs for a living, use FPGAs to emulate them, and have worked on GPUs and many other ASICs in the past.
FPGAs can accelerate certain functions, yes, but neural net evaluation is basically massive matrix multiplies. That's something that GPUs are already highly optimised for. Hence, why I asked what circuit you'd put on the FPGA. Unless you can accelerate the algorithmic evaluation by several orders of magnitude the inefficiency of FPGAs Vs ASICs will cripple you.
I don't really see how FPGA has a role to play here. What circuit are you going to put on it. If it's tensor multipliers, even at low precision, a GPU will be an order of magnitude faster just on clock speed, and another in terms of density.
What we've got right now has almost nothing to do with python, and everything to do with the compute density of GPUs crossing a threshold. FPGAs are lower density and slower.
Well Nvidia and AMD will get their money (and possibly some other investors money too) straight back in equipment purchases.
And LLMs themselves.
They're not dead. Not yet. I think the next 6 months will be interesting for them.
The current batch of stories seems to be coming from disclosures made during a tribunal case over the unfair dismissal of the CEO at the time. I'l think there's a lot of pearl clutching going on in the reporting here. Their IP just isn't on the same scale as companies like Nvidia and AMD so I don't know how they could possibly be much dirty laundry here.
Thanks for coming back and letting others know what your solution was.
For most people, using Linux is not a buggy experience. So no, people aren't gaslighting you. Normally, you grab a modern release like the latest Fedora or Ubuntu and you can get a live desktop up in seconds booting from a USB stick.
Esoteric hardware can be a problem if particular driver haven't been developed yet. That tends to hit laptops harder than desktops, but it's much less of an issue than it used to be.
People are asking for specifics because they don't share your experience and so can't fill in the blanks.
The fact that it's not protected is all down to America's fear of democratic socialism and workers rights.
Trouble is... HIP doesn't support all of AMDs GPUs. It's only 7900s in the consumer line-up.