These are primarily useful for developing CUDA targeted code on something that sits on your desk and has a lot of RAM.
They're not the best choice for anyone who wants to run LLMs as fast and cheap as possible at home. Think of it like a developer tool.
These boxes are confusing the internet because they've let the marketing teams run wild (or at least the marketing LLMs run wild) trying to make them out to be something everyone should want.
They're not the best choice for anyone who wants to run LLMs as fast and cheap as possible at home. Think of it like a developer tool.
These boxes are confusing the internet because they've let the marketing teams run wild (or at least the marketing LLMs run wild) trying to make them out to be something everyone should want.