Menu
mutinaiPreview: Public preview · figures are illustrative fixture data, attributed to their source · data to May 2025 · read-only
What can I run?
Models · 25 tracked

Pick a model by what you have and what you want it for.

Every model here can be downloaded and run on your own hardware. The number that matters most is the memory it needs, so the list is grouped by it.

Run locally12 of 25

Needs 22 GB or less at 8K context. Ordered by how many reference systems run it well. Show all models

Filters1
Reset
Looking for
CodingRun locallyReasoningVisionAgents & tool useFast modelsSmall modelsPermissive licenses
AppliedChat ×Clear all

Most laptops

up to 6 GB

Runs on most laptops, even without a graphics card.

  • Qwen2.5 7B
    Compact general-purpose model for coding and tool use.Qwen Team (Alibaba Cloud) · Runs well on most reference systems
    ~6 GB estimateto runPermissive
  • Llama 3.1 8B
    Compact general-purpose model for coding and tool use.Meta · Runs well on most reference systems
    ~6 GB estimateto runPermissive
  • Mistral 7B
    Compact chat model that can call tools.Mistral AI · Runs well on most reference systems
    ~6 GB estimateto runPermissive

A 16 GB graphics card

6–15 GB

Or a Mac with 24 GB of memory.

  • Phi-4 14B
    General-purpose model for coding and reasoning.Microsoft · Runs well on most reference systems
    ~10 GB estimateto runPermissive
  • Qwen2.5 14B
    General-purpose model for coding and tool use.Qwen Team (Alibaba Cloud) · Runs well on most reference systems
    ~10 GB estimateto runPermissive
  • Gemma 2 9B
    Compact model for everyday chat.Google DeepMind · Runs well on most reference systems
    ~9 GB estimateto runRestricted
  • Mistral Small 24B
    Chat model that can call tools.Mistral AI · Runs well on many reference systems
    ~15 GB estimateto runPermissive

A 24 GB graphics card

15–22 GB

Or a Mac with 32 GB of memory.

  • Qwen2.5-Coder 32B
    Model for coding. Among the strongest open models at coding.Qwen Team (Alibaba Cloud) · Runs well on many reference systems
    ~21 GB estimateto runPermissive
  • Qwen3 30B-A3B
    Efficient general-purpose model for coding, reasoning and tool use.Qwen Team (Alibaba Cloud) · Runs well on many reference systems
    ~18 GB estimateto runPermissive
  • Qwen2.5 32B
    General-purpose model for coding, reasoning and tool use. Among the strongest open models at reasoning.Qwen Team (Alibaba Cloud) · Runs well on many reference systems
    ~21 GB estimateto runPermissive
  • Gemma 3 27B
    Chat model that also understands images. Among the strongest open models at following instructions.Google DeepMind · Runs well on many reference systems
    ~20 GB estimateto runRestricted
  • Gemma 2 27B
    Model for everyday chat.Google DeepMind · Runs well on many reference systems
    ~20 GB estimateto runRestricted

Parameters, context length, capability profiles and side-by-side comparison are in the Technical view.