Hardware · 19 devices · 19 reference systems
Buy for the models you want to run.
Memory decides which models fit, so hardware is grouped the same way as the models page: a machine in a group runs every model in that group.
Complete systems7 systems
Usable memory for a model: graphics cards keep about 95% of their memory for it, unified-memory Macs about 75%.
A 16 GB graphics card
6–15 GBRuns every model that needs up to 15 GB.
- Entry system for 7B–14B models.Desktop · RTX 4060 Ti 16GB + Ryzen 9 7950X · 1 measurement · What can it run?16 GBVRAM~22B estimateparameters~$1,400build estimate
A 24 GB graphics card
15–22 GBRuns every model that needs up to 22 GB.
- 24 GBVRAM~35B estimateparameters~$3,200build estimateRTX 4090 workstationSystemHandles 30B-class models comfortably.Desktop · RTX 4090 + Ryzen 9 7950X · 2 measurements · What can it run?
- 24 GBVRAM~35B estimateparameters~$2,400build estimateRX 7900 XTX desktopSystemHandles 30B-class models comfortably.Desktop · RX 7900 XTX + Ryzen 9 7950X · 1 measurement · What can it run?
A 32 GB graphics card
22–30 GBRuns every model that needs up to 30 GB.
- 32 GBVRAM~47B estimateparameters~$4,000build estimateRTX 5090 workstationSystemHandles 30B-class models comfortably.Desktop · RTX 5090 + Ryzen 9 7950X · 1 measurement · What can it run?
- 48 GBVRAM~73B estimateparameters~$3,500build estimateDual RTX 3090SystemMulti-GPU build that splits 70B-class models across cards.Desktop · 2× RTX 3090 + Ryzen 9 7950X · 1 measurement · What can it run?
Server-class memory
over 92 GBRuns models that need more than 92 GB.
- Holds 70B-class and larger models in memory.Mini PC · Ryzen AI Max+ 395 · 1 measurement · What can it run?128 GBunified~160B estimateparameters~$2,000build estimate
- 128 GBRAM, no GPU~170B estimateslowly, on CPU~$1,600build estimateCPU-only Ryzen 9 7950XSystemBudget build without a graphics card; best for small models.Desktop · Ryzen 9 7950X · 1 measurement · What can it run?
Memory bandwidth, usable-memory scales, price per GB and side-by-side scanning are in the Technical view. Prices are launch MSRPs or editorial estimates, not current prices.