Menu
mutinaiPreview: Public preview · figures are illustrative fixture data, attributed to their source · data to May 2025 · read-only
What can I run?
Models · 28 tracked

Pick a model by what you have and what you want it for.

Every model here can be downloaded and run on your own hardware. The number that matters most is the memory it needs, so the list is grouped by it.

Every model, by what it needs to run9 of 28

Memory at 4-bit, the usual way people run models locally, with room for a working conversation.

Filters1
Reset
Looking for
CodingRun locallyReasoningVisionAgents & tool useFast modelsSmall modelsPermissive licenses
AppliedTool use ×Clear all

Most laptops

up to 6 GB

Runs on most laptops, even without a graphics card.

  • Qwen2.5 7B
    Compact general-purpose model for coding and tool use.Qwen Team (Alibaba Cloud) · Runs well on most reference systems
    ~6 GB estimateto runPermissive
  • Llama 3.1 8B
    Compact general-purpose model for coding and tool use.Meta · Runs well on most reference systems
    ~6 GB estimateto runPermissive
  • Mistral 7B
    Compact chat model that can call tools.Mistral AI · Runs well on most reference systems
    ~6 GB estimateto runPermissive

A 16 GB graphics card

6–15 GB

Or a Mac with 24 GB of memory.

  • Mistral Small 24B
    Chat model that can call tools.Mistral AI · Runs well on many reference systems
    ~15 GB estimateto runPermissive
  • Qwen2.5 14B
    General-purpose model for coding and tool use.Qwen Team (Alibaba Cloud) · Runs well on most reference systems
    ~10 GB estimateto runPermissive

A 24 GB graphics card

15–22 GB

Or a Mac with 32 GB of memory.

  • Qwen3 30B-A3B
    Efficient general-purpose model for coding, reasoning and tool use.Qwen Team (Alibaba Cloud) · Runs well on many reference systems
    ~18 GB estimateto runPermissive
  • Qwen2.5 32B
    General-purpose model for coding, reasoning and tool use. Among the strongest open models at reasoning.Qwen Team (Alibaba Cloud) · Runs well on many reference systems
    ~21 GB estimateto runPermissive

A 64 GB Mac or two graphics cards

30–46 GB

Where 70B-class models start to fit.

  • Llama 3.3 70B
    Chat model that can call tools. Among the strongest open models at following instructions.Meta · Runs well only on high-memory systems
    ~37 GB estimateto runRestricted
  • Llama 3.1 70B
    Chat model that can call tools.Meta · Runs well only on high-memory systems
    ~42 GB estimateto runRestricted

Parameters, context length, capability profiles and side-by-side comparison are in the Technical view.