System · laptop
MacBook Air M1 8 GB
By estimate, runs models up to ~6B parameters at 4-bit in unified memory. The most common entry-level Mac laptop: 8 GB of unified memory.
- Unified memory
- 8 GB
- System RAM
- Shared
- Runs
- 2 of 19model variants, 8K
- Estimated cost
- —
What it runs
Largest models that fit without spilling into system memory, at an 8K contextHow much text the model can consider at once, counted in tokens — roughly ¾ of a word each..
- VariantQwen2.5 7B Instruct7.62B · MLX 4-bit via MLX-LMTight fit~9 tok/s estimate
- VariantDeepSeek-R1-Distill-Qwen-7B7.62B · Q4_K_M via llama.cppTight fit~9 tok/s estimate
Components
- 1× Hardware Apple M1 soc
Measured performance
No performance measurements recorded yet.
Community results
Contributions are not open yet, so there is nothing here from members.
Reviews
Contributions are not open yet, so there is nothing here from members.