Hardware · 19 devices · 19 reference systems

Buy for the models you want to run.

Memory decides which models fit, so hardware is grouped the same way as the models page: a machine in a group runs every model in that group.

Upgrade my GPU5 devices

Graphics cards with the most usable memory first. Memory decides what fits; memory speed decides how fast it replies. Show all hardware

Filters
Reset

A 16 GB graphics card

6–15 GB

Runs every model that needs up to 15 GB.

  • Comfortable with 14B–24B models.NVIDIA · Graphics card · 2023 · 1 measurement
    16 GBVRAM~22B estimateparameters$499MSRP

A 24 GB graphics card

15–22 GB

Runs every model that needs up to 22 GB.

  • Runs 30B-class models on a single card.NVIDIA · Graphics card · 2022 · 2 measurements
    24 GBVRAM~35B estimateparameters$1,599MSRP
  • Runs 30B-class models on a single card.AMD · Graphics card · 2022 · 1 measurement
    24 GBVRAM~35B estimateparameters$999MSRP
  • Runs 30B-class models on a single card.NVIDIA · Graphics card · 2020 · 1 measurement
    24 GBVRAM~35B estimateparameters$1,499MSRP

A 32 GB graphics card

22–30 GB

Runs every model that needs up to 30 GB.

  • Top consumer card: 30B-class models with room for long context.NVIDIA · Graphics card · 2025 · 1 measurement
    32 GBVRAM~47B estimateparameters$1,999MSRP

Memory bandwidth, usable-memory scales, price per GB and side-by-side scanning are in the Technical view. Prices are launch MSRPs or editorial estimates, not current prices.