Hardware
14 devices · 13 reference systemsComplete systems12 systems
Mac Studio M2 Ultra 192 GB
Holds 70B-class and larger models in memory.
- Memory
- 192 GBunified
- Capacity
- ~240Bmodels at 4-bit
- Price
- ~$6,600build estimate
1 measurementWhat can it run? →GB10 mini workstation
Holds 70B-class and larger models in memory.
- Memory
- 128 GBunified
- Capacity
- ~160Bmodels at 4-bit
- Price
- ~$4,000build estimate
No measurements yetWhat can it run? →MacBook Pro M4 Max 128 GB
Holds 70B-class and larger models in memory.
- Memory
- 128 GBunified
- Capacity
- ~160Bmodels at 4-bit
- Price
- ~$5,400build estimate
1 measurementWhat can it run? →Ryzen AI Max+ 395 mini PC
Holds 70B-class and larger models in memory.
- Memory
- 128 GBunified
- Capacity
- ~160Bmodels at 4-bit
- Price
- ~$2,000build estimate
1 measurementWhat can it run? →MacBook Pro M3 Max 64 GB
Holds 70B-class models.
- Memory
- 64 GBunified
- Capacity
- ~77Bmodels at 4-bit
- Price
- ~$4,000build estimate
2 measurementsWhat can it run? →Dual RTX 3090
Multi-GPU build that splits 70B-class models across cards.
- Memory
- 48 GBVRAM · 128 GB RAM
- Capacity
- ~73Bmodels at 4-bit
- Price
- ~$3,500build estimate
1 measurementWhat can it run? →Mac mini M4 Pro 48 GB
Handles 30B-class models comfortably.
- Memory
- 48 GBunified
- Capacity
- ~57Bmodels at 4-bit
- Price
- ~$1,800build estimate
No measurements yetWhat can it run? →RTX 5090 workstation
Handles 30B-class models comfortably.
- Memory
- 32 GBVRAM · 96 GB RAM
- Capacity
- ~47Bmodels at 4-bit
- Price
- ~$4,000build estimate
1 measurementWhat can it run? →RTX 4090 workstation
Handles 30B-class models comfortably.
- Memory
- 24 GBVRAM · 64 GB RAM
- Capacity
- ~35Bmodels at 4-bit
- Price
- ~$3,200build estimate
2 measurementsWhat can it run? →RX 7900 XTX desktop
Handles 30B-class models comfortably.
- Memory
- 24 GBVRAM · 64 GB RAM
- Capacity
- ~35Bmodels at 4-bit
- Price
- ~$2,400build estimate
1 measurementWhat can it run? →RTX 4060 Ti 16GB budget build
Entry system for 7B–14B models.
- Memory
- 16 GBVRAM · 32 GB RAM
- Capacity
- ~22Bmodels at 4-bit
- Price
- ~$1,400build estimate
1 measurementWhat can it run? →CPU-only Ryzen 9 7950X
Budget build without a graphics card; best for small models.
- Memory
- 128 GBRAM, no GPU
- Capacity
- ~170Bmodels at 4-bit, slowly
- Price
- ~$1,600build estimate
1 measurementWhat can it run? →
Memory bandwidth, usable-memory scales, price per GB and side-by-side scanning are in the Technical view. Prices are launch MSRPs or editorial estimates, not current prices.