Overview
Runs a 70B model at 4-bit on one card.
Specifications
| Memory | 48GB GDDR7 ECC |
|---|
More graphics cards
View allAllocationExport rules
NVIDIA GeForce RTX 5090 32GB32GB GDDR7
575W
575W
$5,499
Ships in 2–4 weeks
Special order
NVIDIA GeForce RTX 5080 16GB16GB GDDR7
360W
360W
$1,649
Ships in 3–7 business days
Special order
AMD Radeon AI PRO R9700 32GB32GB GDDR6
Blower, stacks 2–4 cards
Blower, stacks 2–4 cards
$1,599
Ships in 3–7 business days
AllocationExport rules
NVIDIA RTX PRO 6000 Blackwell 96GB96GB GDDR7 ECC
$13,299
Ships in 2–4 weeks