Graphics cards / NVIDIA

NVIDIA
NVIDIA GeForce RTX 4090
The previous-generation GeForce flagship and still a very capable card. 24 GB of GDDR6X and about 1 TB/s of bandwidth handle 4K gaming and run local models up to roughly 30B parameters at 4-bit.
$1,761What it can run
Up to 30–34B at 4-bit, 13–14B at 8-bit (approximate)
Based on 24 GB of GPU memory. See every machine by model size
Push the 16-pin power cable fully into the card and avoid sharp bends close to the plug. A loose connector is the most common cause of trouble with this card.
Who it's for
Buyers who want top-tier performance and 24 GB of memory without stepping up to the RTX 5090.
Full specifications
- GPU
- NVIDIA Ada Lovelace (AD102)
- CUDA cores
- 16,384
- Memory
- 24 GB GDDR6X
- Memory interface
- 384-bit, 1,008 GB/s
- Boost clock
- 2.52 GHz (reference)
- Tensor / RT Cores
- 4th generation / 3rd generation
- Interface
- PCIe 4.0 x16
- Graphics card power
- 450 W
- Power connector
- 16-pin (12VHPWR)
- Display outputs
- HDMI 2.1, 3 × DisplayPort 1.4a
Shipping, returns and warranty: see Shipping & returns.
Reviews
What reviewers say
PCWorld
Extremely fast, with DLSS 3 as the standout feature. The downsides are high power draw, a very large card and a high price.
“It's a behemoth of a GPU that draws a lot of power”
Read the review
Atomrig customer reviews
No customer reviews yet. Bought this from us? Tell us how it runs.
Related products

NVIDIA · 32GB
NVIDIA GeForce RTX 5090
32 GB runs 30B-class models comfortably at 4-bit, but a 70B model will not fit on one card. For 70B, plan for two cards or a large unified-memory system.
$1,999
AMD · 32GB
AMD Radeon AI PRO R9700 (32 GB)
Check that your tools support ROCm on your operating system before buying. PyTorch and llama.cpp do; some niche tools still assume CUDA.
$1,299
Intel · 24GB
Intel Arc Pro B60
Some partners put two B60 GPUs on one board (48 GB in total). Those dual cards need a motherboard slot that supports x8/x8 bifurcation, so check your board first.
$599.99
NVIDIA · 96GB
NVIDIA RTX PRO 6000 Blackwell (96 GB)
Pick the Max-Q Workstation Edition (300 W, blower) when you plan to stack several cards in one chassis; the 600 W Workstation Edition is the faster choice for a single card.
$14,594