Models

Needs 22 GB or less at 8K context. Ordered by how many reference systems run it well.Show all models

• Qwen2.5 14B

  General-purpose model for coding and tool use.

  Qwen Team (Alibaba Cloud)
  • ~10 GB to run · fits a 16 GB graphics card
  • Runs well on most reference systems
  • Permissive license · Free to use, including commercially
  View model →

• Qwen2.5 7B

  Compact general-purpose model for coding and tool use.

  Qwen Team (Alibaba Cloud)
  • ~6 GB to run · fits most laptops
  • Runs well on most reference systems
  • Permissive license · Free to use, including commercially
  View model →

• Llama 3.1 8B

  Compact general-purpose model for coding and tool use.

  Meta
  • ~6 GB to run · fits most laptops
  • Runs well on most reference systems
  • Permissive license · Free to use, including commercially
  View model →

• Qwen3 30B-A3B

  Efficient general-purpose model for coding, reasoning and tool use.

  Qwen Team (Alibaba Cloud)
  • ~18 GB to run · fits a 24 GB graphics card
  • Runs well on most reference systems
  • Permissive license · Free to use, including commercially
  View model →

• Qwen2.5 32B

  General-purpose model for coding, reasoning and tool use. Among the strongest open models at reasoning.

  Qwen Team (Alibaba Cloud)
  • ~21 GB to run · fits a 24 GB graphics card
  • Runs well on most reference systems
  • Permissive license · Free to use, including commercially
  View model →

• Mistral Small 24B

  Chat model that can call tools.

  Mistral AI
  • ~15 GB to run · fits a 16 GB graphics card
  • Runs well on most reference systems
  • Permissive license · Free to use, including commercially
  View model →

• Mistral 7B

  Compact chat model that can call tools.

  Mistral AI
  • ~6 GB to run · fits most laptops
  • Runs well on most reference systems
  • Permissive license · Free to use, including commercially
  View model →

Parameters, context length, capability profiles and side-by-side comparison are in the Technical view.