Hardware
14 devices · 13 reference systemsWhat are you trying to do?
Skip to all hardware ↓All hardware14 devices · 13 systems
Devices 14
A100 80GB
Datacenter card for large models and many users.
- Memory
- 80 GBVRAM
- Capacity
- ~120Bmodels at 4-bit
- Price
- No launch price
1 measurementView hardware →RTX 5090
Top consumer card: 30B-class models with room for long context.
- Memory
- 32 GBVRAM
- Capacity
- ~47Bmodels at 4-bit
- Price
- $1,999MSRP
1 measurementView hardware →RTX 4090
Runs 30B-class models on a single card.
- Memory
- 24 GBVRAM
- Capacity
- ~35Bmodels at 4-bit
- Price
- $1,599MSRP
2 measurementsView hardware →RX 7900 XTX
Runs 30B-class models on a single card.
- Memory
- 24 GBVRAM
- Capacity
- ~35Bmodels at 4-bit
- Price
- $999MSRP
1 measurementView hardware →RTX 3090
Runs 30B-class models on a single card.
- Memory
- 24 GBVRAM
- Capacity
- ~35Bmodels at 4-bit
- Price
- $1,499MSRP
1 measurementView hardware →M2 Ultra (76-core GPU)
One large shared memory pool; capacity is chosen when the system is bought.
- Memory
- Unifiedsize set per system
- Capacity
- Varieswith memory
- Price
- No launch price
1 measurementView hardware →M4 Max (40-core GPU)
One large shared memory pool; capacity is chosen when the system is bought.
- Memory
- Unifiedsize set per system
- Capacity
- Varieswith memory
- Price
- No launch price
1 measurementView hardware →M3 Max (40-core GPU)
One large shared memory pool; capacity is chosen when the system is bought.
- Memory
- Unifiedsize set per system
- Capacity
- Varieswith memory
- Price
- No launch price
2 measurementsView hardware →RTX 4060 Ti 16GB
Comfortable with 14B–24B models.
- Memory
- 16 GBVRAM
- Capacity
- ~22Bmodels at 4-bit
- Price
- $499MSRP
1 measurementView hardware →M4 Pro (20-core GPU)
One large shared memory pool; capacity is chosen when the system is bought.
- Memory
- Unifiedsize set per system
- Capacity
- Varieswith memory
- Price
- No launch price
No measurements yetView hardware →GB10 Grace Blackwell
One large shared memory pool; capacity is chosen when the system is bought.
- Memory
- Unifiedsize set per system
- Capacity
- Varieswith memory
- Price
- No launch price
No measurements yetView hardware →Ryzen AI Max+ 395
One large shared memory pool; capacity is chosen when the system is bought.
- Memory
- Unifiedsize set per system
- Capacity
- Varieswith memory
- Price
- No launch price
1 measurementView hardware →EPYC 7763
Runs small models without a graphics card, slowly.
- Memory
- System RAMno VRAM
- Capacity
- Varieswith memory
- Price
- No launch price
1 measurementView hardware →Ryzen 9 7950X
Runs small models without a graphics card, slowly.
- Memory
- System RAMno VRAM
- Capacity
- Varieswith memory
- Price
- $699MSRP
7 measurementsView hardware →
Reference systems 13
Mac Studio M2 Ultra 192 GB
Holds 70B-class and larger models in memory.
- Memory
- 192 GBunified
- Capacity
- ~240Bmodels at 4-bit
- Price
- ~$6,600build estimate
1 measurementWhat can it run? →GB10 mini workstation
Holds 70B-class and larger models in memory.
- Memory
- 128 GBunified
- Capacity
- ~160Bmodels at 4-bit
- Price
- ~$4,000build estimate
No measurements yetWhat can it run? →MacBook Pro M4 Max 128 GB
Holds 70B-class and larger models in memory.
- Memory
- 128 GBunified
- Capacity
- ~160Bmodels at 4-bit
- Price
- ~$5,400build estimate
1 measurementWhat can it run? →Ryzen AI Max+ 395 mini PC
Holds 70B-class and larger models in memory.
- Memory
- 128 GBunified
- Capacity
- ~160Bmodels at 4-bit
- Price
- ~$2,000build estimate
1 measurementWhat can it run? →A100 80GB server
Holds 70B-class and larger models in memory.
- Memory
- 80 GBVRAM · 512 GB RAM
- Capacity
- ~120Bmodels at 4-bit
- Price
- No estimate
1 measurementWhat can it run? →MacBook Pro M3 Max 64 GB
Holds 70B-class models.
- Memory
- 64 GBunified
- Capacity
- ~77Bmodels at 4-bit
- Price
- ~$4,000build estimate
2 measurementsWhat can it run? →Dual RTX 3090
Multi-GPU build that splits 70B-class models across cards.
- Memory
- 48 GBVRAM · 128 GB RAM
- Capacity
- ~73Bmodels at 4-bit
- Price
- ~$3,500build estimate
1 measurementWhat can it run? →Mac mini M4 Pro 48 GB
Handles 30B-class models comfortably.
- Memory
- 48 GBunified
- Capacity
- ~57Bmodels at 4-bit
- Price
- ~$1,800build estimate
No measurements yetWhat can it run? →RTX 5090 workstation
Handles 30B-class models comfortably.
- Memory
- 32 GBVRAM · 96 GB RAM
- Capacity
- ~47Bmodels at 4-bit
- Price
- ~$4,000build estimate
1 measurementWhat can it run? →RTX 4090 workstation
Handles 30B-class models comfortably.
- Memory
- 24 GBVRAM · 64 GB RAM
- Capacity
- ~35Bmodels at 4-bit
- Price
- ~$3,200build estimate
2 measurementsWhat can it run? →RX 7900 XTX desktop
Handles 30B-class models comfortably.
- Memory
- 24 GBVRAM · 64 GB RAM
- Capacity
- ~35Bmodels at 4-bit
- Price
- ~$2,400build estimate
1 measurementWhat can it run? →RTX 4060 Ti 16GB budget build
Entry system for 7B–14B models.
- Memory
- 16 GBVRAM · 32 GB RAM
- Capacity
- ~22Bmodels at 4-bit
- Price
- ~$1,400build estimate
1 measurementWhat can it run? →CPU-only Ryzen 9 7950X
Budget build without a graphics card; best for small models.
- Memory
- 128 GBRAM, no GPU
- Capacity
- ~170Bmodels at 4-bit, slowly
- Price
- ~$1,600build estimate
1 measurementWhat can it run? →
Memory bandwidth, usable-memory scales, price per GB and side-by-side scanning are in the Technical view. Prices are launch MSRPs or editorial estimates, not current prices.