Buy for the models you want to run.
Memory decides which models fit, so hardware is grouped the same way as the models page: a machine in a group runs every model in that group.
All hardware6 devices · 6 systems
Usable memory for a model: graphics cards keep about 95% of their memory for it, unified-memory Macs about 75%.
A 16 GB graphics card
6–15 GBRuns every model that needs up to 15 GB.
- 16 GBVRAM~22B estimateparameters$499MSRP
- Entry system for 7B–14B models.Desktop · RTX 4060 Ti 16GB + Ryzen 9 7950X · 1 measurement · What can it run?16 GBVRAM~22B estimateparameters~$1,400build estimate
A 24 GB graphics card
15–22 GBRuns every model that needs up to 22 GB.
- 24 GBVRAM~35B estimateparameters$1,599MSRP
- 24 GBVRAM~35B estimateparameters$1,499MSRP
- 24 GBVRAM~35B estimateparameters~$3,200build estimateRTX 4090 workstationSystemHandles 30B-class models comfortably.Desktop · RTX 4090 + Ryzen 9 7950X · 2 measurements · What can it run?
A 32 GB graphics card
22–30 GBRuns every model that needs up to 30 GB.
- Top consumer card: 30B-class models with room for long context.NVIDIA · Graphics card · 2025 · 1 measurement32 GBVRAM~47B estimateparameters$1,999MSRP
- 32 GBVRAM~47B estimateparameters~$4,000build estimateRTX 5090 workstationSystemHandles 30B-class models comfortably.Desktop · RTX 5090 + Ryzen 9 7950X · 1 measurement · What can it run?
- 48 GBVRAM~73B estimateparameters~$3,500build estimateDual RTX 3090SystemMulti-GPU build that splits 70B-class models across cards.Desktop · 2× RTX 3090 + Ryzen 9 7950X · 1 measurement · What can it run?
A 64 GB Mac or two graphics cards
30–46 GBRuns every model that needs up to 46 GB.
- Datacenter card for large models and many users.NVIDIA · Datacenter GPU · 2020 · 1 measurement80 GBVRAM~120B estimateparametersNo launch price
- 80 GBVRAM~120B estimateparametersNo estimateA100 80GB serverSystemHolds 70B-class and larger models in memory.Server · A100 80GB + EPYC 7763 · 1 measurement · What can it run?
Server-class memory
over 92 GBRuns models that need more than 92 GB.
- 128 GBunified~160B estimateparameters~$4,000build estimateGB10 mini workstationSystemHolds 70B-class and larger models in memory.Mini PC · GB10 Grace Blackwell · What can it run?
Sized per machine
Unified-memory chips and CPUs: what fits depends on how much memory the machine is bought with. The systems built on them are in the groups above.
- One large shared memory pool; capacity is chosen when the system is bought.NVIDIA · Unified-memory chip · 2025Unifiedset per machineVarieswith memoryNo launch price
Memory bandwidth, usable-memory scales, price per GB and side-by-side scanning are in the Technical view. Prices are launch MSRPs or editorial estimates, not current prices.