Models · 28 tracked

Pick a model by what you have and what you want it for.

Every model here can be downloaded and run on your own hardware. The number that matters most is the memory it needs, so the list is grouped by it.

Every model, by what it needs to run2 of 28

Memory at 4-bit, the usual way people run models locally, with room for a working conversation.

Filters1
Reset

Most laptops

up to 6 GB

Runs on most laptops, even without a graphics card.

  • Compact chat model that can call tools.Mistral AI · Runs well on most reference systems
    ~6 GB estimateto runPermissive

A 16 GB graphics card

6–15 GB

Or a Mac with 24 GB of memory.

  • Chat model that can call tools.Mistral AI · Runs well on many reference systems
    ~15 GB estimateto runPermissive

Parameters, context length, capability profiles and side-by-side comparison are in the Technical view.