Hardware · 19 devices · 19 reference systems

Buy for the models you want to run.

Memory decides which models fit, so hardware is grouped the same way as the models page: a machine in a group runs every model in that group.

Graphics cards1 device

Usable memory for a model: graphics cards keep about 95% of their memory for it, unified-memory Macs about 75%.

Filters
Reset

A 24 GB graphics card

15–22 GB

Runs every model that needs up to 22 GB.

  • Runs 30B-class models on a single card.AMD · Graphics card · 2022 · 1 measurement
    24 GBVRAM~35B estimateparameters$999MSRP

Memory bandwidth, usable-memory scales, price per GB and side-by-side scanning are in the Technical view. Prices are launch MSRPs or editorial estimates, not current prices.