Hardware · 19 devices · 19 reference systems
Buy for the models you want to run.
Memory decides which models fit, so hardware is grouped the same way as the models page: a machine in a group runs every model in that group.
Complete systems9 systems
Usable memory for a model: graphics cards keep about 95% of their memory for it, unified-memory Macs about 75%.
Most laptops
up to 6 GBRuns every model that needs up to 6 GB.
- 8 GBunified~6B estimateparametersNo estimate
- 16 GBunified~16B estimateparametersNo estimate
- 16 GBunified~16B estimateparametersNo estimate
- 16 GBunified~16B estimateparametersNo estimate
- 16 GBunified~16B estimateparametersNo estimate
A 32 GB graphics card
22–30 GBRuns every model that needs up to 30 GB.
- 48 GBunified~57B estimateparameters~$1,800build estimate
A 64 GB Mac or two graphics cards
30–46 GBRuns every model that needs up to 46 GB.
- 64 GBunified~77B estimateparameters~$4,000build estimateMacBook Pro M3 Max 64 GBSystemHolds 70B-class models.Laptop · M3 Max · 2 measurements · What can it run?
Server-class memory
over 92 GBRuns models that need more than 92 GB.
- Holds 70B-class and larger models in memory.Laptop · M4 Max · 1 measurement · What can it run?128 GBunified~160B estimateparameters~$5,400build estimate
- Holds 70B-class and larger models in memory.Desktop · M2 Ultra · 1 measurement · What can it run?192 GBunified~240B estimateparameters~$6,600build estimate
Memory bandwidth, usable-memory scales, price per GB and side-by-side scanning are in the Technical view. Prices are launch MSRPs or editorial estimates, not current prices.