Hardware
14 devices · 13 reference systemsAll hardware6 devices · 6 systems
Devices 6
A100 80GB
Datacenter card for large models and many users.
- Memory
- 80 GBVRAM
- Capacity
- ~120Bmodels at 4-bit
- Price
- No launch price
1 measurementView hardware →RTX 5090
Top consumer card: 30B-class models with room for long context.
- Memory
- 32 GBVRAM
- Capacity
- ~47Bmodels at 4-bit
- Price
- $1,999MSRP
1 measurementView hardware →RTX 4090
Runs 30B-class models on a single card.
- Memory
- 24 GBVRAM
- Capacity
- ~35Bmodels at 4-bit
- Price
- $1,599MSRP
2 measurementsView hardware →RTX 3090
Runs 30B-class models on a single card.
- Memory
- 24 GBVRAM
- Capacity
- ~35Bmodels at 4-bit
- Price
- $1,499MSRP
1 measurementView hardware →RTX 4060 Ti 16GB
Comfortable with 14B–24B models.
- Memory
- 16 GBVRAM
- Capacity
- ~22Bmodels at 4-bit
- Price
- $499MSRP
1 measurementView hardware →GB10 Grace Blackwell
One large shared memory pool; capacity is chosen when the system is bought.
- Memory
- Unifiedsize set per system
- Capacity
- Varieswith memory
- Price
- No launch price
No measurements yetView hardware →
Reference systems 6
GB10 mini workstation
Holds 70B-class and larger models in memory.
- Memory
- 128 GBunified
- Capacity
- ~160Bmodels at 4-bit
- Price
- ~$4,000build estimate
No measurements yetWhat can it run? →A100 80GB server
Holds 70B-class and larger models in memory.
- Memory
- 80 GBVRAM · 512 GB RAM
- Capacity
- ~120Bmodels at 4-bit
- Price
- No estimate
1 measurementWhat can it run? →Dual RTX 3090
Multi-GPU build that splits 70B-class models across cards.
- Memory
- 48 GBVRAM · 128 GB RAM
- Capacity
- ~73Bmodels at 4-bit
- Price
- ~$3,500build estimate
1 measurementWhat can it run? →RTX 5090 workstation
Handles 30B-class models comfortably.
- Memory
- 32 GBVRAM · 96 GB RAM
- Capacity
- ~47Bmodels at 4-bit
- Price
- ~$4,000build estimate
1 measurementWhat can it run? →RTX 4090 workstation
Handles 30B-class models comfortably.
- Memory
- 24 GBVRAM · 64 GB RAM
- Capacity
- ~35Bmodels at 4-bit
- Price
- ~$3,200build estimate
2 measurementsWhat can it run? →RTX 4060 Ti 16GB budget build
Entry system for 7B–14B models.
- Memory
- 16 GBVRAM · 32 GB RAM
- Capacity
- ~22Bmodels at 4-bit
- Price
- ~$1,400build estimate
1 measurementWhat can it run? →
Memory bandwidth, usable-memory scales, price per GB and side-by-side scanning are in the Technical view. Prices are launch MSRPs or editorial estimates, not current prices.