Models · 28 tracked
Pick a model by what you have and what you want it for.
Every model here can be downloaded and run on your own hardware. The number that matters most is the memory it needs, so the list is grouped by it.
Every model, by what it needs to run3 of 28
Memory at 4-bit, the usual way people run models locally, with room for a working conversation.
Most laptops
up to 6 GBRuns on most laptops, even without a graphics card.
- Compact general-purpose model for coding and tool use.Meta · Runs well on most reference systems~6 GB estimateto runPermissive
A 64 GB Mac or two graphics cards
30–46 GBWhere 70B-class models start to fit.
- Chat model that can call tools. Among the strongest open models at following instructions.Meta · Runs well only on high-memory systems~37 GB estimateto runRestricted
- ~42 GB estimateto runRestricted
Parameters, context length, capability profiles and side-by-side comparison are in the Technical view.