Hardware
14 devices · 13 reference systemsServer & multi-GPU1 device · 2 systems
Accelerators 1
A100 80GB
Datacenter card for large models and many users.
- Memory
- 80 GBVRAM
- Capacity
- ~120Bmodels at 4-bit
- Price
- No launch price
1 measurementView hardware →
Servers & multi-GPU builds 2
A100 80GB server
Holds 70B-class and larger models in memory.
- Memory
- 80 GBVRAM · 512 GB RAM
- Capacity
- ~120Bmodels at 4-bit
- Price
- No estimate
1 measurementWhat can it run? →Dual RTX 3090
Multi-GPU build that splits 70B-class models across cards.
- Memory
- 48 GBVRAM · 128 GB RAM
- Capacity
- ~73Bmodels at 4-bit
- Price
- ~$3,500build estimate
1 measurementWhat can it run? →
Memory bandwidth, usable-memory scales, price per GB and side-by-side scanning are in the Technical view. Prices are launch MSRPs or editorial estimates, not current prices.