System · laptop

Windows laptop 16 GB (no graphics card)

By estimate, runs models up to ~18B parameters at 4-bit in system RAM (CPU only). A typical recent laptop without a separate graphics card: models run on the processor and its 16 GB of RAM.

GPU memory: —
System RAM: 16 GB
Runs: 8 of 19model variants, 8K
Estimated cost: —

Full compatibility

What it runs

Largest models that fit without spilling into system memory, at an 8K contextHow much text the model can consider at once, counted in tokens — roughly ¾ of a word each..

Everything →

Variant
Qwen2.5 14B Instruct
14.8B · Q4_K_M via llama.cpp
Runs well
~6 tok/s estimate
Variant
Phi-4
14.7B · Q4_K_M via llama.cpp
Runs well
~6 tok/s estimate
Variant
Gemma 2 9B IT
9.24B · Q4_K_M via llama.cpp
Runs well
~9 tok/s estimate
Variant
Hermes 3 Llama 3.1 8B
8.03B · Q8_0 via llama.cpp
Runs well
~6 tok/s estimate
Variant
Llama 3.1 8B Instruct
8.03B · Q8_0 via llama.cpp
Runs well
~6 tok/s estimate
Variant
Qwen2.5 7B Instruct
7.62B · Q8_0 via llama.cpp
Runs well
~7 tok/s estimate
Variant
DeepSeek-R1-Distill-Qwen-7B
7.62B · Q4_K_M via llama.cpp
Runs well
~11 tok/s estimate
Variant
Mistral 7B Instruct v0.3
7.25B · Q8_0 via llama.cpp
Runs well
~7 tok/s estimate

Components

1× Hardware Intel Core Ultra 7 155H cpu
System RAM bandwidth 89.6 GB/s

Measured performance

No performance measurements recorded yet.

Community results

Contributions are not open yet, so there is nothing here from members.

Reviews

Contributions are not open yet, so there is nothing here from members.