System · mini pc

Mac mini M4 16 GB

By estimate, runs models up to ~16B parameters at 4-bit in unified memory. Entry Mac desktop with 16 GB of unified memory.

Unified memory: 16 GB
System RAM: Shared
Runs: 8 of 19model variants, 8K
Estimated cost: —

Full compatibility

What it runs

Largest models that fit without spilling into system memory, at an 8K contextHow much text the model can consider at once, counted in tokens — roughly ¾ of a word each..

Everything →

Variant
Qwen2.5 14B Instruct
14.8B · MLX 4-bit via MLX-LM
Tight fit
~9 tok/s estimate
Variant
Phi-4
14.7B · MLX 4-bit via MLX-LM
Tight fit
~9 tok/s estimate
Variant
Gemma 2 9B IT
9.24B · Q4_K_M via llama.cpp
Runs well
~13 tok/s estimate
Variant
Hermes 3 Llama 3.1 8B
8.03B · Q8_0 via llama.cpp
Tight fit
~9 tok/s estimate
Variant
Llama 3.1 8B Instruct
8.03B · Q8_0 via llama.cpp
Tight fit
~9 tok/s estimate
Variant
Qwen2.5 7B Instruct
7.62B · Q8_0 via llama.cpp
Runs well
~9 tok/s estimate
Variant
DeepSeek-R1-Distill-Qwen-7B
7.62B · Q4_K_M via llama.cpp
Runs well
~15 tok/s estimate
Variant
Mistral 7B Instruct v0.3
7.25B · Q8_0 via llama.cpp
Runs well
~10 tok/s estimate

Components

1× Hardware Apple M4 soc

Measured performance

No performance measurements recorded yet.

Community results

Contributions are not open yet, so there is nothing here from members.

Reviews

Contributions are not open yet, so there is nothing here from members.