Hardware · 19 devices · 19 reference systems

Buy for the models you want to run.

Memory decides which models fit, so hardware is grouped the same way as the models page: a machine in a group runs every model in that group.

Workstation7 systems

Desktop and compact systems with about 40 GB or more usable for models, largest first. Show all hardware

Filters
Reset

A 32 GB graphics card

22–30 GB

Runs every model that needs up to 30 GB.

  • Multi-GPU build that splits 70B-class models across cards.Desktop · 2× RTX 3090 + Ryzen 9 7950X · 1 measurement · What can it run?
    48 GBVRAM~73B estimateparameters~$3,500build estimate

A 64 GB Mac or two graphics cards

30–46 GB

Runs every model that needs up to 46 GB.

Server-class memory

over 92 GB

Runs models that need more than 92 GB.

Memory bandwidth, usable-memory scales, price per GB and side-by-side scanning are in the Technical view. Prices are launch MSRPs or editorial estimates, not current prices.