What can I run?
Start from the machine you have — we recommend a download, a runtime, and show memory and speed.Choose hardware
Desktops
Servers
Build your own setup
Reference systems at a glance
Usable memory and the largest dense model each holds at 4-bit.
- Mac Studio M2 Ultra 192 GBdesktopunified~144 GBholds~240B
- CPU-only Ryzen 9 7950XdesktopRAM~103 GBholds~170B
- GB10 mini workstationmini pcunified~96 GBholds~160B
- MacBook Pro M4 Max 128 GBlaptopunified~96 GBholds~160B
- Ryzen AI Max+ 395 mini PCmini pcunified~96 GBholds~160B
- A100 80GB serverserverGPU~76 GBholds~120B
- MacBook Pro M3 Max 64 GBlaptopunified~48 GBholds~77B
- Dual RTX 3090desktopGPU~46 GBholds~73B
- Mac mini M4 Pro 48 GBmini pcunified~36 GBholds~57B
- RTX 5090 workstationdesktopGPU~31 GBholds~47B
- RTX 4090 workstationdesktopGPU~23 GBholds~35B
- RX 7900 XTX desktopdesktopGPU~23 GBholds~35B
- RTX 4060 Ti 16GB budget builddesktopGPU~16 GBholds~22B