Hardware · 19 devices · 19 reference systems

Buy for the models you want to run.

Memory decides which models fit, so hardware is grouped the same way as the models page: a machine in a group runs every model in that group.

Complete systems18 systems

Usable memory for a model: graphics cards keep about 95% of their memory for it, unified-memory Macs about 75%.

Filters
Reset

Most laptops

up to 6 GB

Runs every model that needs up to 6 GB.

A 16 GB graphics card

6–15 GB

Runs every model that needs up to 15 GB.

A 24 GB graphics card

15–22 GB

Runs every model that needs up to 22 GB.

  • Handles 30B-class models comfortably.Desktop · RTX 4090 + Ryzen 9 7950X · 2 measurements · What can it run?
    24 GBVRAM~35B estimateparameters~$3,200build estimate
  • Handles 30B-class models comfortably.Desktop · RX 7900 XTX + Ryzen 9 7950X · 1 measurement · What can it run?
    24 GBVRAM~35B estimateparameters~$2,400build estimate

A 32 GB graphics card

22–30 GB

Runs every model that needs up to 30 GB.

  • Handles 30B-class models comfortably.Desktop · RTX 5090 + Ryzen 9 7950X · 1 measurement · What can it run?
    32 GBVRAM~47B estimateparameters~$4,000build estimate
  • Handles 30B-class models comfortably.Mini PC · M4 Pro · What can it run?
    48 GBunified~57B estimateparameters~$1,800build estimate
  • Multi-GPU build that splits 70B-class models across cards.Desktop · 2× RTX 3090 + Ryzen 9 7950X · 1 measurement · What can it run?
    48 GBVRAM~73B estimateparameters~$3,500build estimate

A 64 GB Mac or two graphics cards

30–46 GB

Runs every model that needs up to 46 GB.

Server-class memory

over 92 GB

Runs models that need more than 92 GB.

Memory bandwidth, usable-memory scales, price per GB and side-by-side scanning are in the Technical view. Prices are launch MSRPs or editorial estimates, not current prices.