Models · 28 tracked
Pick a model by what you have and what you want it for.
Every model here can be downloaded and run on your own hardware. The number that matters most is the memory it needs, so the list is grouped by it.
Run locally2 of 28
Needs 22 GB or less at 8K context. Ordered by how many reference systems run it well. Show all models
Most laptops
up to 6 GBRuns on most laptops, even without a graphics card.
- ~6 GB estimateto runPermissive
A 16 GB graphics card
6–15 GBOr a Mac with 24 GB of memory.
- ~15 GB estimateto runPermissive
Parameters, context length, capability profiles and side-by-side comparison are in the Technical view.