Models · 28 tracked
Pick a model by what you have and what you want it for.
Every model here can be downloaded and run on your own hardware. The number that matters most is the memory it needs, so the list is grouped by it.
Every model, by what it needs to run4 of 28
Memory at 4-bit, the usual way people run models locally, with room for a working conversation.
A 16 GB graphics card
6–15 GBOr a Mac with 24 GB of memory.
- ~9 GB estimateto runRestricted
A 24 GB graphics card
15–22 GBOr a Mac with 32 GB of memory.
- Chat model that also understands images. Among the strongest open models at following instructions.Google DeepMind · Runs well on many reference systems~20 GB estimateto runRestricted
- ~20 GB estimateto runRestricted
Memory not recorded yet
No download with a known size is on file, so what these need is not estimated.
- —License unknown
Parameters, context length, capability profiles and side-by-side comparison are in the Technical view.