Model fit

Which machine runs which model

Memory decides which models fit. Pick a model size and quality, and see every machine and card we sell that can hold it.

1. Model size
2. Quality (quantization)

4-bit is the usual choice at home: about half the memory of 8-bit, with a small loss in quality.

30–34B at 4-bit

About 20 GB of GPU memory

The sweet spot for many people: noticeably smarter answers, and still a single 24–32 GB card at 4-bit.

Examples: Gemma 2 27B, Qwen2.5 32B

13 of 15 machines and cards can run it

All numbers are approximate. We count about (parameters × bits ÷ 8) for the weights plus 20–30% for context and buffers, then treat 90% of a graphics card's memory and 75% of a unified-memory system's memory as usable. Long contexts, image models and batching need more. One card is counted on its own; several cards can be combined in one machine.