Graphics cards / NVIDIA

NVIDIA GeForce RTX 4090

NVIDIA

NVIDIA GeForce RTX 4090

The previous-generation GeForce flagship and still a very capable card. 24 GB of GDDR6X and about 1 TB/s of bandwidth handle 4K gaming and run local models up to roughly 30B parameters at 4-bit.

$1,761
1

What it can run

Up to 30–34B at 4-bit, 13–14B at 8-bit (approximate)

Based on 24 GB of GPU memory. See every machine by model size

Push the 16-pin power cable fully into the card and avoid sharp bends close to the plug. A loose connector is the most common cause of trouble with this card.

Who it's for

Buyers who want top-tier performance and 24 GB of memory without stepping up to the RTX 5090.

Full specifications

GPU
NVIDIA Ada Lovelace (AD102)
CUDA cores
16,384
Memory
24 GB GDDR6X
Memory interface
384-bit, 1,008 GB/s
Boost clock
2.52 GHz (reference)
Tensor / RT Cores
4th generation / 3rd generation
Interface
PCIe 4.0 x16
Graphics card power
450 W
Power connector
16-pin (12VHPWR)
Display outputs
HDMI 2.1, 3 × DisplayPort 1.4a

Shipping, returns and warranty: see Shipping & returns.

Reviews

What reviewers say

  • PCWorld

    Extremely fast, with DLSS 3 as the standout feature. The downsides are high power draw, a very large card and a high price.

    “It's a behemoth of a GPU that draws a lot of power”

    Read the review

Atomrig customer reviews

No customer reviews yet. Bought this from us? Tell us how it runs.

Your rating

Related products