Models

Needs 22 GB or less at 8K context. Ordered by how many reference systems run it well.Show all models

• Qwen2.5-Math 7B

  Compact model for maths and reasoning.

  Qwen Team (Alibaba Cloud)
  • ~6 GB to run · fits most laptops
  • Runs well on most reference systems
  • Permissive license · Free to use, including commercially
  View model →

• Phi-4 14B

  General-purpose model for coding and reasoning.

  Microsoft
  • ~10 GB to run · fits a 16 GB graphics card
  • Runs well on most reference systems
  • Permissive license · Free to use, including commercially
  View model →

• Qwen2.5 14B

  General-purpose model for coding and tool use.

  Qwen Team (Alibaba Cloud)
  • ~10 GB to run · fits a 16 GB graphics card
  • Runs well on most reference systems
  • Permissive license · Free to use, including commercially
  View model →

• Qwen2.5 7B

  Compact general-purpose model for coding and tool use.

  Qwen Team (Alibaba Cloud)
  • ~6 GB to run · fits most laptops
  • Runs well on most reference systems
  • Permissive license · Free to use, including commercially
  View model →

• Llama 3.1 8B

  Compact general-purpose model for coding and tool use.

  Meta
  • ~6 GB to run · fits most laptops
  • Runs well on most reference systems
  • Permissive license · Free to use, including commercially
  View model →

• Qwen2.5-Coder 32B

  Model for coding. Among the strongest open models at coding.

  Qwen Team (Alibaba Cloud)
  • ~21 GB to run · fits a 24 GB graphics card
  • Runs well on most reference systems
  • Permissive license · Free to use, including commercially
  View model →

• Qwen3 30B-A3B

  Efficient general-purpose model for coding, reasoning and tool use.

  Qwen Team (Alibaba Cloud)
  • ~18 GB to run · fits a 24 GB graphics card
  • Runs well on most reference systems
  • Permissive license · Free to use, including commercially
  View model →

• Qwen2.5 32B

  General-purpose model for coding, reasoning and tool use. Among the strongest open models at reasoning.

  Qwen Team (Alibaba Cloud)
  • ~21 GB to run · fits a 24 GB graphics card
  • Runs well on most reference systems
  • Permissive license · Free to use, including commercially
  View model →

• Mistral Small 24B

  Chat model that can call tools.

  Mistral AI
  • ~15 GB to run · fits a 16 GB graphics card
  • Runs well on most reference systems
  • Permissive license · Free to use, including commercially
  View model →

• Gemma 3 27B

  Chat model that also understands images. Among the strongest open models at following instructions.

  Google DeepMind
  • ~20 GB to run · fits a 24 GB graphics card
  • Runs well on most reference systems
  • Restricted license · Weights are downloadable; the license limits some uses
  View model →

• Gemma 2 9B

  Compact model for everyday chat.

  Google DeepMind
  • ~9 GB to run · fits a 16 GB graphics card
  • Runs well on most reference systems
  • Restricted license · Weights are downloadable; the license limits some uses
  View model →

• Mistral 7B

  Compact chat model that can call tools.

  Mistral AI
  • ~6 GB to run · fits most laptops
  • Runs well on most reference systems
  • Permissive license · Free to use, including commercially
  View model →

• Gemma 2 27B

  Model for everyday chat.

  Google DeepMind
  • ~20 GB to run · fits a 24 GB graphics card
  • Runs well on most reference systems
  • Restricted license · Weights are downloadable; the license limits some uses
  View model →

Parameters, context length, capability profiles and side-by-side comparison are in the Technical view.