Hardware · 19 devices · 19 reference systems

Buy for the models you want to run.

Memory decides which models fit, so hardware is grouped the same way as the models page: a machine in a group runs every model in that group.

Every machine, by what it can run19 devices · 19 systems

Usable memory for a model: graphics cards keep about 95% of their memory for it, unified-memory Macs about 75%.

Filters
Reset

Most laptops

up to 6 GB

Runs every model that needs up to 6 GB.

A 16 GB graphics card

6–15 GB

Runs every model that needs up to 15 GB.

  • Comfortable with 14B–24B models.NVIDIA · Graphics card · 2023 · 1 measurement
    16 GBVRAM~22B estimateparameters$499MSRP
  • Entry system for 7B–14B models.Desktop · RTX 4060 Ti 16GB + Ryzen 9 7950X · 1 measurement · What can it run?
    16 GBVRAM~22B estimateparameters~$1,400build estimate

A 24 GB graphics card

15–22 GB

Runs every model that needs up to 22 GB.

  • Runs 30B-class models on a single card.NVIDIA · Graphics card · 2022 · 2 measurements
    24 GBVRAM~35B estimateparameters$1,599MSRP
  • Runs 30B-class models on a single card.AMD · Graphics card · 2022 · 1 measurement
    24 GBVRAM~35B estimateparameters$999MSRP
  • Runs 30B-class models on a single card.NVIDIA · Graphics card · 2020 · 1 measurement
    24 GBVRAM~35B estimateparameters$1,499MSRP
  • Handles 30B-class models comfortably.Desktop · RTX 4090 + Ryzen 9 7950X · 2 measurements · What can it run?
    24 GBVRAM~35B estimateparameters~$3,200build estimate
  • Handles 30B-class models comfortably.Desktop · RX 7900 XTX + Ryzen 9 7950X · 1 measurement · What can it run?
    24 GBVRAM~35B estimateparameters~$2,400build estimate

A 32 GB graphics card

22–30 GB

Runs every model that needs up to 30 GB.

  • Top consumer card: 30B-class models with room for long context.NVIDIA · Graphics card · 2025 · 1 measurement
    32 GBVRAM~47B estimateparameters$1,999MSRP
  • Handles 30B-class models comfortably.Desktop · RTX 5090 + Ryzen 9 7950X · 1 measurement · What can it run?
    32 GBVRAM~47B estimateparameters~$4,000build estimate
  • Handles 30B-class models comfortably.Mini PC · M4 Pro · What can it run?
    48 GBunified~57B estimateparameters~$1,800build estimate
  • Multi-GPU build that splits 70B-class models across cards.Desktop · 2× RTX 3090 + Ryzen 9 7950X · 1 measurement · What can it run?
    48 GBVRAM~73B estimateparameters~$3,500build estimate

A 64 GB Mac or two graphics cards

30–46 GB

Runs every model that needs up to 46 GB.

  • Holds 70B-class models.Laptop · M3 Max · 2 measurements · What can it run?
    64 GBunified~77B estimateparameters~$4,000build estimate
  • Datacenter card for large models and many users.NVIDIA · Datacenter GPU · 2020 · 1 measurement
    80 GBVRAM~120B estimateparametersNo launch price
  • Holds 70B-class and larger models in memory.Server · A100 80GB + EPYC 7763 · 1 measurement · What can it run?
    80 GBVRAM~120B estimateparametersNo estimate

Server-class memory

over 92 GB

Runs models that need more than 92 GB.

Sized per machine

Unified-memory chips and CPUs: what fits depends on how much memory the machine is bought with. The systems built on them are in the groups above.

  • One large shared memory pool; capacity is chosen when the system is bought.Apple · Unified-memory chip · 2023 · 1 measurement
    Unifiedset per machineVarieswith memoryNo launch price
  • One large shared memory pool; capacity is chosen when the system is bought.Apple · Unified-memory chip · 2024 · 1 measurement
    Unifiedset per machineVarieswith memoryNo launch price
  • One large shared memory pool; capacity is chosen when the system is bought.Apple · Unified-memory chip · 2023 · 2 measurements
    Unifiedset per machineVarieswith memoryNo launch price
  • One large shared memory pool; capacity is chosen when the system is bought.NVIDIA · Unified-memory chip · 2025
    Unifiedset per machineVarieswith memoryNo launch price
  • One large shared memory pool; capacity is chosen when the system is bought.Apple · Unified-memory chip · 2024
    Unifiedset per machineVarieswith memoryNo launch price
  • One large shared memory pool; capacity is chosen when the system is bought.AMD · Unified-memory chip · 2025 · 1 measurement
    Unifiedset per machineVarieswith memoryNo launch price
  • One large shared memory pool; capacity is chosen when the system is bought.Apple · Unified-memory chip · 2024
    Unifiedset per machineVarieswith memoryNo launch price
  • One large shared memory pool; capacity is chosen when the system is bought.Apple · Unified-memory chip · 2022
    Unifiedset per machineVarieswith memoryNo launch price
  • One large shared memory pool; capacity is chosen when the system is bought.Apple · Unified-memory chip · 2023
    Unifiedset per machineVarieswith memoryNo launch price
  • One large shared memory pool; capacity is chosen when the system is bought.Apple · Unified-memory chip · 2020
    Unifiedset per machineVarieswith memoryNo launch price
  • Runs small models without a graphics card, slowly.Intel · Processor · 2023
    RAMno VRAMVarieswith memoryNo launch price
  • Runs small models without a graphics card, slowly.AMD · Processor · 2022 · 7 measurements
    RAMno VRAMVarieswith memory$699MSRP
  • Runs small models without a graphics card, slowly.AMD · Processor · 2021 · 1 measurement
    RAMno VRAMVarieswith memoryNo launch price

Memory bandwidth, usable-memory scales, price per GB and side-by-side scanning are in the Technical view. Prices are launch MSRPs or editorial estimates, not current prices.